Active participation of students is paramount not only for their learning experiences but also for their academic performance. Therefore, various methods have been developed and proven to help students achieve active learning. However, several shortcomings in these methods have been indicated as increasing students’ sense of burden and discomfort, eventually preventing them from benefiting sufficiently. This study aimed to determine the efficiency of a low-load web-based review quiz built by the researchers on Google Forms to enhance students’ reviewing habits and active class participation. Participants in this study were 53 first-year dental hygiene students in a 10-class microbiology course. After each class, all students were given the web-based quiz to prepare for a paper-based review test, which assessed the learning of the content covered in the previous classes. We analyzed the correlations between frequency of participation in the web-based quiz and the average scores of the weekly review tests or the final examination scores. Consequently, voluntary participation in the web-based quiz positively correlated with both short-term and long-term students’ learning outcomes. Through this web-based quiz during the first year of the dental hygiene program, students can develop the “self-learning attitude” needed to pass the national examination.

Ancient numismatics, that is, the study of ancient currencies (predominantly coins), is an interesting domain for the application of computer vision and machine learning, and has been receiving an increasing amount of attention in recent years. Notwithstanding the number of articles published on the topic, the variety of different methodological approaches described, and the mounting realisation that the relevant problems in the field are most challenging indeed, all research to date has entirely ignored one specific, readily accessible modality: colour. Invariably, colour is discarded and images of coins treated as being greyscale. The present article is the first one to question this decision (and indeed, it is a decision). We discuss the reasons behind the said choice, present a case why it ought to be reexamined, and in turn investigate the issue for the first time in the published literature. Specifically, we propose two new colour-based representations specifically designed with the aim of being applied to ancient coin analysis, and argue why it is sensible to employ them in the first stages of the classification process as a means of drastically reducing the initially enormous number of classes involved in type matching ancient coins (tens of thousands, just for Ancient Roman Imperial coins). Furthermore, we introduce a new data set collected with the specific aim of denomination-based categorisation of ancient coins, where we hypothesised colour could be of potential use, and evaluate the proposed representations. Lastly, we report surprisingly successful performances which goes further than confirming our hypothesis—rather, they convincingly demonstrate a much higher relevant information content carried by colour than even we expected. Thus we trust that our findings will be noted by others in the field and that more attention and further research will be devoted to the use of colour in automatic ancient coin analysis.

This paper investigates the use of deep learning techniques to perform energy demand forecasting. Specifically, the authors have adapted a deep neural network originally thought for image classification and composed of a convolutional neural network (CNN) followed by a multilayered fully connected artificial neural network (ANN). The convolutional part of the network was fed with a grid of temperature forecasting data distributed in the area of interest in order to extract a featured temperature. The subsequent ANN is then fed with this calculated temperature along with other data related to the timing of the forecast. The proposed structure was first trained and then used in a real setting aimed to provide the French energy demand forecast using ARPEGE forecasting weather data. The results show that the performance of this approach is in the line of the performance provided by the reference RTE subscription-based service, which opens the possibility to obtain high accuracy forecasting using widely accessible deep learning techniques through open-source machine learning platforms.

Modern energy systems collect high volumes of data that can provide valuable information about energy consumption. Electric companies can now use historical data to make informed decisions on energy production by forecasting the expected demand. Many deep learning models have been proposed to deal with these type of time series forecasting problems. Deep neural networks, such as recurrent or convolutional, can automatically capture complex patterns in time series data and provide accurate predictions. In particular, Temporal Convolutional Networks (TCN) are a specialised architecture that has advantages over recurrent networks for forecasting tasks. TCNs are able to extract long-term patterns using dilated causal convolutions and residual blocks, and can also be more efficient in terms of computation time. In this work, we propose a TCN-based deep learning model to improve the predictive performance in energy demand forecasting. Two energy-related time series with data from Spain have been studied: the national electric demand, and the power demand at charging stations for electric vehicles. An extensive experimental study has been conducted, involving more than 1900 models with different architectures and parametrisations. The TCN proposal outperforms the forecasting accuracy of Long Short-Term Memory (LSTM) recurrent networks, which are considered the state-of-the-art in the field.

A regularization approach to model selection, within a generalized HJM framework, is introduced which learns the closest arbitrage-free model to a prespecified factor model. This optimization problem is represented as the limit of a one-parameter family of computationally tractable penalized model selection tasks. General theoretical results are derived and then specialized to affine term-structure models where new types of arbitrage-free machine learning models for the forward-rate curve are estimated numerically and compared to classical short-rate and the dynamic Nelson-Siegel factor models.

Wind power as a renewable source of energy, has numerous economic, environmental and social benefits. In order to enhance and control the renewable wind power, it is vital to utilize models that predict wind speed with high accuracy. Due to neglecting of requirement and significance of data preprocessing and disregarding the inadequacy of using a single predicting model, many traditional models have poor performance in wind speed prediction. In the current study, for predicting wind speed at target stations in the north of Iran, the combination of a multi-layer perceptron model (MLP) with the Whale Optimization Algorithm (WOA) used to build new method (MLP-WOA) with a limited set of data (2004-2014). Then, the MLP-WOA model was utilized at each of the ten target stations, with the nine stations for training and tenth station for testing (namely: Astara, Bandar-E-Anzali, Rasht, Manjil, Jirandeh, Talesh, Kiyashahr, Lahijan, Masuleh and Deylaman) to increase the accuracy of the subsequent hybrid model. Capability of the hybrid model in wind speed forecasting at each target station was compared with the MLP model without the WOA optimizer. To determine definite results, numerous statistical performances were utilized. For all ten target stations, the MLP-WOA model had precise outcomes than the standalone MLP model. The hybrid model had acceptable performances with lower amounts of the RMSE, SI and RE parameters and higher values of NSE, WI and KGE parameters. It was concluded that WOA optimization algorithm can improve prediction accuracy of MLP model and may be recommended for accurate wind speed prediction.

This paper develops a multi-task learning framework that attempts to incorporate the image structure knowledge to assist image inpainting, which is not well explored in previous works. The primary idea is to train a shared generator to simultaneously complete the corrupted image and corresponding structures --- edge and gradient, thus implicitly encouraging the generator to exploit relevant structure knowledge while inpainting. In the meantime, we also introduce a structure embedding scheme to explicitly embed the learned structure features into the inpainting process, thus to provide possible preconditions for image completion. Specifically, a novel pyramid structure loss is proposed to supervise structure learning and embedding. Moreover, an attention mechanism is developed to further exploit the recurrent structures and patterns in the image to refine the generated structures and contents. Through multi-task learning, structure embedding besides with attention, our framework takes advantage of the structure knowledge and outperforms several state-of-the-art methods on benchmark datasets quantitatively and qualitatively.

Deep coal beds have been suggested as possible usable underground geological locations for carbon dioxide storage. Furthermore, injecting carbon dioxide into coal beds can improve the methane recovery. Due to importance of this issue, a novel investigation has been done on adsorption of carbon dioxide on various types of coal seam. This study has proposed four types of Gaussian Process Regression (GPR) approaches with different kernel functions to estimate excess adsorption of carbon dioxide in terms of temperature, pressure and composition of coal seams. The comparison of GPR outputs and actual excess adsorption expresses that proposed models have interesting accuracy and also the Exponential GPR approach has better performance than other ones. For this structure, R2=1, MRE=0.01542, MSE=0, RMSE=0.00019 and STD=0.00014 have been determined. Additionally, the impacts of effective parameters on excess adsorption capacity have been studied for the first time in literature. According to these results, the present work has valuable and useful tools for petroleum and chemical engineers who dealing with enhancement of recovery and environment protection.

Calculating hydrocarbon components solubility of natural gases is known as one of the important issues for operational works in petroleum and chemical engineering. In this work, a novel solubility estimation tool has been proposed for hydrocarbon gases including methane, ethane, propane and butane in aqueous electrolyte solutions based on extreme learning machine (ELM) algorithm. Comparing the ELM outputs with a comprehensive real databank which has 1175 solubility points concluded to R-squared values of 0.985 and 0.987 for training and testing phases respectively. Furthermore, the visual comparison of estimated and actual hydrocarbon solubility leaded to confirm the ability of proposed solubility model. Additionally, sensitivity analysis has been employed on the input variables of model to identify their impacts on hydrocarbon solubility. Such a comprehensive and reliable study can help engineers and scientists to successfully determine the important thermodynamic properties which are key factors in optimizing and designing different industrial units such as refineries and petrochemical plants.

A pixel-based segmentation method was demonstrated to be confounded by developmental stage in estimation of flowering of mango. Categorization of panicles into three developmental stages was undertaken with a single and a two-stage deep learning framework (YOLO and R2CNN), using either upright or rotated bounding boxes. For a validation image set and for total panicle count, the models MangoYOLO(-upright), MangoYOLO-rotated, YOLOv3-rotated, R2CNN(-rotated) and R2CNN-upright achieved: (i) RMSEs of 25.6, 16.0, 15.4, 25.8 and 32.3 panicles per tree image, (ii) Mean average precision (mAP) scores of 72.2, 69.1, 65.0, 62.5 and 70.9% and (iii) weighted F1-scores of 76.5, 76.1, 74.9, 74.0 and 82.0, respectively. For a test set of images involving a different orchard and cultivar and use of a different camera, the R2 for machine vision to human count of panicles per tree was 0.86, 0.80, 0.83, 0.81 and 0.76 for the same models, respectively. Thus, models generalised well, but with no consistent benefit from use of rotated over upright bounding boxes. While the YOLOv3-rotated model was superior in terms of total panicle count, the R2CNN-upright model was more accurate for panicle stage classification. To demonstrate practical application, panicle counts were made weekly for an orchard of 994 trees, with a peak detection routine applied to document multiple flowering events.

Accurate prediction of defects in software components plays a vital role in administrating the quality of the quality and efficiency of the system to be developed. So we have written a systematic literature review in order to evaluate the four main defect prediction techniques. Defect prediction paves way for the testers to find bugs and modify them in order to achieve input to output conformance. In this paper we have discussed the open issues in predicting software defects and have provided with a detailed analyzation of different methods including Machine Learning, Integrated Approach, Cross-Project and Deep Forest algorithm in order to prevent these flaws. However, it is almost impossible to rule which method is better than the other so every technique can be analyzed separately and the best technique according to the problem at hand can be used or can be altered to create hybrid technique suitable for the cause.

Automation is at the core of modern industry. It aims to increase production rates, decrease production costs, and reduce human intervention in order to avoid human mistakes and time delays during manufacturing. On the other hand, human assistance is usually required to customize products and reconfigure control systems through a special process interface called Human Machine Interface (HMI). Machine Learning (ML) algorithms can effectively be used to resolve this tradeoff between full automation and human assistance. This paper provides an example of the industrial application of ML algorithms to help human operators save their mental effort and avoid time delays and unintended mistakes for the sake of high production rates. Based on real-time sensor measurements, several ML algorithms have been tried to classify paper rolls according to paper grammage in a white paper mill. The performance evaluation shows that the AdaBoost algorithm is the best ML algorithm for this application with classification accuracy (CA), precision, and recall of 97.1%. The generalization of the proposed approach for achieving a cost-effective mill construction by reducing the total number of the required physical sensors will be the subject of our future research.

The history of Artificial Intelligence (AI) development dates to the 40s. The researchers showed strong expectations until the 70s, when they began to encounter serious difficulties and investments were greatly, reduced. With the introduction of the Industry 4.0, one of the techniques adopted for AI implementation is Machine Learning (ML) that focuses on the machines ability to receive data series and learn on their own. Given the considerable importance of the subject, researchers have completed many studies on ML to ensure that machines are able to replace or relieve human tasks. This research aims to analyze, systematically, the literature on several aspects, including publication year, authors, scientific sector, country, institution, keywords. Analyzing existing literature on AI is a necessary stage to recommend policy on the matter. The analysis has been done using Web of Science and SCOPUS database. Furthermore, UCINET and NVivo 12 software have been used to complete them. Literature review on ML and AI empirical studies published in the last century was carried out to highlight the evolution of the topic before and after Industry 4.0 introduction, from 1999 to now. Eighty-two articles were reviewed and classified. A first interesting result is the greater number of works published by USA and the increasing interest after the birth of Industry 4.0.

Advances in the availability of multitemporal and global built-/human-settlements datasets as derived from Remote Sensing (RS) can now provide globally consistent definitions of “human-settlement” at unprecedented spatial fineness. Yet, these data only provide a time-series of past extents and urban growth/expansion models have not had parallel advances at high-spatial resolution. We present a flexible modelling framework for producing annual built-settlement extents in the near future past last observed extents as provided by RS-based data. Using a random forest and autoregressive temporal models with short time-series of built-settlement extents and subnational level data, we predict annual 100m resolution binary settlement extents five years beyond the last observations. We applied this framework within varying contexts and predicted annual extents from 2010 to 2015. We found that our model framework preformed consistently across all sample countries and, when compared to time-specific imagery, demonstrated the capacity to capture human-settlement missed by the input time-series and validation extents. When comparing building footprints of small settlements to forecast extents, we saw that the modelling framework had a 12 percent increase in ground-truth accuracy. This framework shows promise for predicting near-future settlement extents, and provides a foundation for forecasts further into the future.

1) Background: One of the most common cancer that affects men worldwide and North American men is prostate cancer. Gleason score is a pathological grading system to examine the potential aggressiveness of the disease in the prostate tissue. The advancement in computing and next-generation sequencing technology now allow us to study the genomic profiles of patients in association with their different Gleason score more accurately and effectively. 2) Methods: In this study, we used a novel machine learning method to analyze gene expression of prostate tumors with different Gleason scores, and identify potential genetic biomarkers for each Gleason group. We obtained a publicly-available RNA-Seq dataset of a cohort of 104 prostate cancer patients from the National Center for Biotechnology Information’s (NCBI) Gene Expression Omnibus (GEO) repository, and categorized patients based on their Gleason scores to create a hierarchy of disease progression. A hierarchical model with standard classifiers in different Gleason groups, also known as nodes, was developed to identify and predict nodes based on their mRNA or gene expression. In each node, patient samples were analyzed via class imbalance and hybrid feature selection techniques to build the prediction model. The outcome from analysis of each node is a set of genes that can differentiate each Gleason group from the remaining groups. To validate the proposed method, the set of identified genes are used to classify a second dataset of 499 prostate cancer patients collected from cBioportal [1]. 3) Results: The overall accuracy of applying this novel method to the first dataset was 93.3%, and further validated to 87% accuracy using the second dataset. This method also identified genes that were not previously reported as potential biomarkers for specific Gleason groups. In particular, PIAS3 was identified as a potential biomarker for Gleason score 4+3=7, and UBE2V2 for Gleason score 6. 4) Insight: Previous reports show that the genes predicted by this newly proposed method strongly correlate with prostate cancer development and progression. Furthermore, pathway analysis shows that both PIAS3 and UBE2V2 share similar protein interaction pathways, the JAK/STAT signaling process.

Innovative teaching strategies are designing a new and promising landscape in education. They fill up the lessons with creativity and imagination either for the students and teachers. This article addresses an attempt to make easier the approach to science in a non-scientific environment: primary education at university level. Gamification methodologies were combined with flipped classroom in order to free up in-class time and engage the students with the taught courses. A qualitative study was merged with quantitative measures of emotional and motivational parameters. These results were improved with four semi-structured interviews. The results clearly showed a raise in the students' motivational level, an acknowledgment of good teaching practice and an evident enhancement of felt positive emotions toward science teaching and scientific issues.

We experimentally demonstrate, for the first time, blind nonlinearity compensation using the Density-Based Spatial-Clustering of Applications with Noise (DBSCAN) algorithm for a 40-Gb/s 16-quadrature amplitude modulated being transmitted at 50 km of standard single-mode fiber. At high launched optical powers, DBSCAN offers up to 0.83- and 8.84-dB enhancement in Q-factor when compared to conventional K-means clustering and linear equalization, respectively.

This paper presents a system based on pedestrian dead reckoning for localization of networked mobile users, which relies only on sensors embedded in the devices and device- to-device connectivity. The user trajectory is reconstructed by measuring step by step the user displacements. Though step length can be estimated rather accurately, heading evaluation is extremely problematic in indoor environments. Magnetometer is typically used, however measurements are strongly perturbed. To improve the location accuracy, this paper proposes a cooperative system to estimate the direction of motion based on a machine learning approach for perturbation detection and filtering, combined with a consensus algorithm for performance augmentation by cooperative data fusion at multiple device. A first algorithm filters out perturbed magnetometer measurements based on a-priori information on the Earth's magnetic field. A second algorithm aggregates groups of users walking in the same direction, while a third one combines the measurements of the aggregated users in a distributed way to extract a more accurate heading estimate. Extensive indoor experiments show that the heading error is highly reduced by the proposed approach thus leading to noticeable enhancements in localization performance.

In this paper we propose a novel self-supervised approach of keywords and keyphrases retrieval and extraction by an end-to-end deep learning approach, which is trained by contextually self-labelled corpus. Our proposed approach is novel to use contextual and semantic features to extract the keywords and has outperformed the state of the art. Through the experiment the proposed approach has been proved to be better in both semantic meaning and quality than the existing popular algorithms of keyword extraction. In addition, we propose to use contextual features from bidirectional transformers to automatically label short-sentence corpus with keywords and keyphrases to build the ground truth. This process avoids the human time to label the keywords and do not need any prior knowledge. To the best of our knowledge, our published dataset in this paper is a fine domain-independent corpus of short sentences with labelled keywords and keyphrases in the NLP community.

Accurate measurements of tree height and diameter at breast height (DBH) in forests to evaluate the growth rate of cultivars is still a significant challenge, even when using LiDAR and 3-D modeling. We propose an integrated pipeline methodology to measure the biomass of different tree cultivars in plantation forests with high crown density which that combines unmanned aerial vehicles (UAVs), hyperspectral image sensors, and data processing algorithms using machine learning. Using a planation of Cunninghamia lanceolate, commonly known as Chinese fir, in Fujian, China, images were collected using a hyperspectral camera and orthorectified in HiSpectral Stitcher. Vegetation indices and modeling were processed in Python using decision trees, random forests, support vector machine, and eXtreme Gradient Boosting (XGBoost) third-party libraries. Tree height and DBH of 2880 samples were measured manually and clustering into three groups: “fast growth,” “median,” growth and “normal” growth group, and 19 vegetation indices from 12,000 pixels were abstracted as the input of features for the modeling. After modeling and cross-validation, the classifier generated by random forests had the best prediction accuracy compare to other algorisms (75%). This framework can be applied to other tree species to make management and business decisions.

The goal of this study is both to determine the opinion that professors and students at the University of (details removed for peer review) have of active methodologies and to describe the perception and opinion of the modes of organization, methodological focuses, and evaluation systems that define the teaching-learning process. On surveying the professors and the students in their classes, we found significant differences in 32 of the 92 variables in common. The content of these results shows that professors and students are believe they are making progress toward a learning-centered model, that implementation of active methodologies implies new functions in their teaching practice.

Over 55% of stoma patients suffer complications such as dehydration. Outcomes may be improved through communicating stoma output data to the patient and their clinical teams. Past artificial neural networks to improve accuracy in fluid level sensing were designed to account for ‘slosh’ caused by variable acceleration in one or two axes of movement. This paper describes the development of a novel sensor platform for non-invasive monitoring of stoma output in real time through incorporating a volumetric array consisting of thermistors and capacitive sensors into an ostomy appliance. Stoma output which exits the body at core temperature passes into a stoma appliance in a pattern which is dictated by water content, existing effluent within the bag and distortion of the usual bag shape. By using thermistors, a thermal boundary demarcates the accumulated level of fecal material as the effluent settles. A capacitive array allows the measurement of volume of output. The sensing components communicates via near field communication (NFC) and transmits data to a smartphone application by Bluetooth low energy (BLE). Testing of the device on 11 existing ileostomy patients with 51.6 bag hours of data found a correlation between measured volume and predictive value, supporting its use in this population.

The increasing spatial and spectral resolution of hyperspectral imagers yields detailed spectroscopy measurements from both space-based and airborne platforms. Machine learning algorithms have achieved state-of-the-art material classification performance on benchmark hyperspectral data sets; however, these techniques often do not consider varying atmospheric conditions experienced in a real-world detection scenario. To reduce the impact of atmospheric effects in the at-sensor signal, atmospheric compensation must be performed. Radiative Transfer (RT) modeling can generate high-fidelity atmospheric estimates at detailed spectral resolutions, but is often too time-consuming for real-time detection scenarios. This research utilizes machine learning methods to perform dimension reduction on the transmittance, upwelling radiance, and downwelling radiance (TUD) data to create high accuracy atmospheric estimates with lower computational cost than RT modeling. The utility of this approach is investigated using the instrument line shape for the Mako long-wave infrared hyperspectral sensor. This study employs physics-based metrics and loss functions to identify promising dimension reduction techniques. As a result, TUD vectors can be produced in real-time allowing for atmospheric compensation across diverse remote sensing scenarios.

Online Social Networks (OSNs), such as Facebook and Twitter, have become a very important part of many people’s daily lives. Unfortunately, the high popularity of these platforms makes them very attractive to spammers. Machine-learning (ML) techniques have been widely used as a tool to address many cybersecurity application problems (such as spam and malware detection). However, most of the proposed approaches do not consider the presence of adversaries that target the defense mechanism itself. Adversaries can launch sophisticated attacks to undermine deployed spam detectors either during training or the prediction (test) phase. Not considering these adversarial activities at the design stage makes OSNs’ spam detectors prone to a range of adversarial attacks. This paper thus surveys the attacks against Twitter spam detectors in an adversarial environment. In addition, a general taxonomy of potential adversarial attacks is proposed by applying common frameworks from the literature. Examples of adversarial activities on Twitter were provided after observing Arabic trending hashtags. A new type of spam tweet (Adversarial spam tweet), which can be used to undermine deployed classifier, were found. In addition, possible countermeasures that could increase the robustness of Twitter spam detectors against such attacks are investigated.

Organised hiking and trekking tours are promoted by many providers in adventure travel. Such guided tours shall be engaging for the tourists and evoke positive attitudes towards enjoying nature. We present the Trekking Engagement Profile as a tool to evaluate engagement factors of such guided tours, based on engagement research performed in a different domain, namely evaluating engagement in museums and science centres. This tool shall strengthen guides’ soft skills and enable them to increase engagement during an ongoing arrangement. For instance, the Trekking Engagement Profile can be applied when tourists indicate that the quality of a guided tour is not entirely to their liking. We show the viability of using the Trekking Engagement Profile in a small study with guides and participants of trekking tours offered by the Norwegian Trekking Association. Further, we offer guidance and charts to promote its practical use.

The prevalence of autism in children in the world is estimated as one per 62 children, higher levels reported in some countries. These children experience significant problems with the development of social, behavioural and verbal and non-verbal communication skills. The skills impairment levels varies from an individual to another and that made teaching autistics a challenge for caregivers such as teachers and relatives. Hence, there are quite a number of frameworks of a software learning systems which focus on gaining the children’s attention using representational visual illustration as a learning method instead of the textual form. However, majority of these tools are lacking the personalisation ability to suite everyone in the spectrum. Assistive technology offers an alternative way to attract children with autism. Therefore, this research is proposing an Adaptive Content Management Learning System (ACMLS) model to assist caregivers to produce, design and fine-tune or customise the learning materials appropriately so that the system interface and the materials are suitable for every individual in the spectrum according to each child personal profile aiming to make learning attractive and to contribute in improving their social, communication and behavioural skills and nonetheless, their attention level to the delivered educational topics. The ACMLS model design adopts four main components which are: (1) Design component: which covers the visual design, design principles and the mental model of the children with autism. (2) Technology component: which covers the assistive technology tools and the architecture of the ACMLS system. (3) Education component: Which covers the learning objectives, styles, strategies, methods and the cognitive model. (4) Participants component: which covers the main participants who’re playing a role in the ACMLS model such as: caregivers and children with autism.

Indoor scene recognition has great significance for intelligent applications such as mobile robots, location-based services (LBS) and so on. Wherever we are or whatever we do, we are under a specific scene. The human brain can easily discern a scene with a quick glance. However, for a machine to achieve this purpose, on one hand, it often requires plenty of well-annotated data which is time-consuming and labor-intensive. On the other hand, it is hard to learn effective visual representations due to large intra-category variation and inter-categories similarity of indoor scenes. To solve these problems, in this paper, we adopted an unsupervised visual representation learning method which can learn from unlabeled data with a Siamese Convolutional Neural Network (Siamese ConvNet) and graph-based constraints. Specifically, we first mined relationships between unlabeled samples with a graph structure. And then, these relationships can be used as supervision for representation learning with a Siamese network. In this method, firstly, a k-NN graph would be constructed by taking each image as a node in the graph and its k nearest neighbors are linked to form the edges. Then, with this graph, cycle consistency and geodesic distance would be considered as criteria for positive and negative pairs mining respectively. In other words, by detecting cycles in the graph, images with large differences but in the same cycle can be considered as same category (positive pairs). By computing geodesic distance instead of Euclidean distance from one node to another, two nodes with large geodesic distance can be regarded as in different categories (negative pairs). After that, visual representations of indoor scenes can be learned by a Siamese network in an unsupervised manner with the mined pairs as inputs. In order to evaluate the proposed method, we tested it on two scene-centric datasets, MIT67 and Places365. Experiments with different number of categories have been conducted to excavate the potential of proposed method. The results demonstrated that semantic visual representations for indoor scenes can be learned in this unsupervised manner. In addition, with the learned visual representations, indoor scene recognition models trained with the learned representations and a few of labeled samples can achieve competitive performance compared to the state-of-the-art approaches.

Sparse recovery of fluid flows using data-driven proper orthogonal decomposition (POD) basis is systematically explored in this work. Fluid flows are manifestations of nonlinear multiscale PDE dynamical systems with inherent scale separation that impact the system dimensionality. Given that sparse reconstruction is inherently an ill-posed problem, the most successful approaches require the knowledge of the underlying basis space spanning the manifold in which the system resides. In this study, we employ an approach that learns basis from singular value decomposition (SVD) of training data to reconstruct sparsely sensed information. This results in a set of four control parameters for sparse recovery, namely, the choice of basis, system dimension required for sufficiently accurate reconstruction, sensor budget and their placement. The choice of control parameters implicitly determines the choice of algorithm as either $l_2$ minimization reconstruction or sparsity promoting $l_1$ norm minimization reconstruction. In this work, we systematically explore the implications of these control parameters on reconstruction accuracy so that practical recommendations can be identified. We observe that greedy-smart sensor placement provides the best balance of computational complexity and robust reconstruction for marginally oversampled cases which happens to be the most challenging regime in the explored parameter design space.

As education becomes more and more important in creating improved societies, many people who do not have access to it are falling behind. To help them catch up, many people, especially those in rural areas and developing countries, are turning to different methods of self-learning, especially those that utilize cheap technology and use interactive methods to teach. Our empirical study tests the effectiveness of an e-learning system that utilizes newer, less tested forms of interactivity and could potentially be used in these areas as a self-learning system and compares it to non-interactive video and textbook self-learning in two different topics. The results of the experiment showed that the increased interactivity provided by the e-learning system achieved significantly better learning performance over both non-interactive video and textbook self-learning. It was also found that students who learned through non-interactive video performed significantly better than those who used textbooks for self-learning.

In order to design effective protective coatings against corrosion, the polyvinyl alcohol (PVA) as compound and composite with silver nanoparticles (nAg/PVA) were electrodeposited on copper surface employing electrochemical techniques such as linear potentiometry and cyclic voltammetry. A new paradigm was used to distinguish the features of coatings, i.e., a Deep Convolutional Neural Network (CNN) was implemented to automatically and hierarchically extract the discriminative characteristics from the information given by optical microscopy images. The main arguments that invoke a CNN implementation in the surface science of materials are the following: artificial intelligence techniques can be successfully applied to learn differences between surface coatings; based on their popularity for image processing, CNN can model images related to the problem of coatings; deep learning is able to extract the features that are distinguishable between material surfaces. To provide an overview of the copper surface, CNN was applied on microscope slides (CNN@microscopy) and inherently learnt distinctive characteristics for each class of surface morphology. The material surface morphology controlled by CNN without the interference of the human factor was successfully conducted, in our study, to extract the similarities/differences between unprotected and protected surfaces to establish the PVA and nAg/PVA performance to retard the copper corrosion.

The Social-Ecological Systems (SES) framework serves as a valuable framework to explore and understand social and ecological interactions, and pathways in water governance. Yet, it lacks a robust understanding of change. We argue an analytical and methodological approach to engaging global changes in SES is critical to strengthening the scope and relevance of the SES framework. Relying on SES and resilience thinking, we propose an institutional and cognitive model of change that institutions and natural resources systems co-evolve to provide a dynamic understanding of SES that stands on three causal mechanisms: institutional complexity trap, rigidity trap, and learning processes. We illustrate how Data Cube technology could overcome current limitations and offer reliable avenues to test hypothesis about the dynamics of social-ecological systems and water security by offering to combine spatial and time data with no major technical requirements for users.

People localization is a key building block in many applications. In this paper, we propose a deep learning based approach that significantly improves the localization accuracy and reduces the runtime of Wi-Fi based localization systems. Three variants of the deep learning approach are proposed, a sub-task architecture, an end-to-end architecture, and an architecture that incorporates prior knowledge. The performance of the three architectures under different conditions is evaluated and the significant improvement of the three architectures over existing approaches is demonstrated.

Authentication systems based on biometrics characteristics and data represents one of the most important trend in the evolution of our world. In the near future, biometrics systems will be everywhere in the society, such as government, education, smart cities, banks etc. Due to its uniqueness characteristic, biometrics systems will become also vulnerable, privacy being one of the most important challenge. The classic cryptographic primitives are not sufficient to assure a strong level of secureness for privacy. The following work paper represents an effort to present the main cryptographic techniques and algorithms that can give us the possibility to raise a certain level of secureness for privacy. We will show their own challenges (strengths and weaknesses). We will demonstrate how we can use the most common and well-known techniques and algorithms in order to get a maximum efficiency and a high level in assuring the integrity of the biometrics data.

Despite the rapid adoption of bilingual programs (English-Chinese) in China's higher education institutions (HEIs), concerns have been raised on perceived language hindrance to students’ academic comprehension and then performance. In response to this, this paper investigates the effects of bilingual instruction on content-based learning and provides empirical evidence after testing related influential factors in bilingual environment. Analyzing a sample of 498 undergraduate students enrolling in a fundamental business course in a sample university in China, we find insignificant statistical difference in students' academic performance between bilingual and L1 classes. We attribute this to the English language support provided by the university and show that learning competence can help students to minimize language barrier and furthermore solve the common learning problems confronted by both bilingual and L1 students. Overall, our paper aims to identify key determinants of students' academic performance in bilingual instruction and provide policy implication for developing desirable bilingual programs in HEIs.

In this paper, we investigate an animal-human cohabitation problem with the help of machine learning and fiber-wireless (FiWi) access networks integrating cloud and edge (fog) computing. We propose an early warning system which detects wild animals nearby road/rail with the help of wireless sensor networks and alerts passing vehicles of possible animal crossing. Additionally, we show that animals' detection at the earliest and the related processing, if possible, at sensors would reduce the energy consumption of edge devices and the end-to-end delay in notifying vehicles, as compared to the scenarios where raw sensed data needs to be transferred up the base stations or the cloud. At the same time, machine learning helps in classification of captured images at edge devices, and in predicting different time-varying traffic profiles-- distinguished by latency and bandwidth requirements-- at base stations, including animal appearance events at sensors, and allocating bandwidth in FiWi access networks accordingly. We compare three scenarios of processing data at sensor nodes, base stations and a hybrid case of processing sensed data at either sensors or at base stations, and showed that dynamic allocation of bandwidth in FiWi access networks and processing data at its origin leads to lowering the congestion of network traffic at base stations and reducing the average end-to-end delay.

Reconstruction of fine-scale information from sparse data is often needed in practical fluid dynamics where the sensors are typically sparse and yet, one may need to learn the underlying flow structures or inform predictions through assimilation into data-driven models. Given that sparse reconstruction is inherently an ill-posed problem, the most successful approaches encode the physics into an underlying sparse basis space that spans the manifold to generate well-posedness. To achieve this, one commonly uses generic orthogonal Fourier basis or data specific proper orthogonal decomposition (POD) basis to reconstruct from sparse sensor information at chosen locations. Such a reconstruction problem is well-posed as long as the sensor locations are incoherent and can sample the key physical mechanisms. The resulting inverse problem is easily solved using $l_2$ minimization or if necessary, sparsity promoting $l_1$ minimization. Given the proliferation of machine learning and the need for robust reconstruction frameworks in the face of dynamically evolving flows, we explore in this study the suitability of non-orthogonal basis obtained from Extreme Learning Machine (ELM) auto-encoders for sparse reconstruction. In particular, we assess the interplay between sensor quantity and sensor placement for a given system dimension for accurate reconstruction of canonical fluid flows in comparison to POD-based reconstruction.

This paper presents a novel approach for indoor acoustic source localization using microphone arrays and based on a Convolutional Neural Network (CNN). The proposed solution is, to the best of our knowledge, the first published work in which the CNN is designed to directly estimate the three dimensional position of an acoustic source, using the raw audio signal as the input information avoiding the use of hand crafted audio features. Given the limited amount of available localization data, we propose in this paper a training strategy based on two steps. We first train our network using semi-synthetic data, generated from close talk speech recordings, and where we simulate the time delays and distortion suffered in the signal that propagates from the source to the array of microphones. We then fine tune this network using a small amount of real data. Our experimental results show that this strategy is able to produce networks that significantly improve existing localization methods based on SRP-PHAT strategies. In addition, our experiments show that our CNN method exhibits better resistance against varying gender of the speaker and different window sizes compared with the other methods.

This article addresses the trajectory tracking between two non-identical systems with chaotic properties. We employ the Rossler chaotic and RCL-shunted Josephson junctions model in similar phase space to study trajectory tracking. In order to achieve the goal tracking, we afford two stages to approximate the target tracking. The first stage utilizes the active control technique to transfer the output signal from the RCLs-J system into the quasi-Rossler system. Then next, the RCLs-J system employs the proposed the iterative learning control scheme and the control signal from the drive system to trace the trajectory of Rossler system. The numerical results demonstrate the proposed method and the tracking system is asymptotically stable.

This paper presents a study on the thermal efficiency improvement of the user equipment room in the district heating system based on reinforcement learning [1], and suggests a general method of constructing a learning network(DQN)[2] using deep Q learning[3], which is a reinforcement learning algorithm that does not specify a model. In addition, we introduce the big data platform system and the integrated heat management system for the energy field in the massive data processing from the IoT sensor installed in large number of thermal energy control facilities.

In this study, we examine the relationship of bank level lending and borrowing decisions and the risk preferences on the dynamics of the interbank lending We develop an agent-based model that incorporates individual bank decisions using the temporal difference reinforcement learning algorithm with empirical data of 6600 S. banks. The model can successfully replicate the key characteristics of interbank lending and borrowing relationships documented in the recent literatur A key finding of this study is that risk preferences at individual bank level can lead to unique interbank market structures which are suggestive of the capacity that the market responds to surprising

This paper serves a survey and empirical evaluation of the state-of-the-art in activity recognition methods using accelerometers. We examine research that has focused on the selection of activities, the features that are extracted from the accelerometer data, the segmentation of the time-series data, the locations of accelerometers, the selection and configuration trade-offs, the test/retest reliability, and the generalisation performance. Furthermore, we study these questions from an experimental platform and show, somewhat surprisingly, that many disparate experimental configurations yield comparable predictive performance on testing data. Our understanding of these results is that the experimental setup directly and indirectly defines a pathway for context to be delivered to the classifier, and that, in some settings, certain configurations are more optimal than alternatives. We conclude by identifying how the main results of this work can be used in practice, specifically in experimental configurations in challenging experimental conditions.

This study proposes a novel hybrid machine learning approach for modeling of rainfall-induced shallow landslides. The proposed approach is a combination of an instance-based learning algorithm (k-NN) and Rotation Forest (RF), state of the art machine techniques that have seldom explored for landslide modeling. The Lang Son city area (Vietnam) is selected as a case study. For this purpose, a spatial database for the study area was constructed, and then, was used to build and evaluate the hybrid model. Performance of the model was assessed using Receiver Operating Characteristic (ROC), area under the ROC curve (AUC), success rate and prediction rate, and several statistical evaluation metrics. The results showed that the model has high performance with both the training data (AUC = 0.948) and the validation data (AUC = 0.848). The results were compared with those obtained from soft computing techniques i.e. Random Forest, J48 Decision Trees, and Multilayer Perceptron Neural Networks. Overall, the performance of the proposed model is better than those obtained from the above methods. Therefore, the proposed model is a promising tool for landslide modeling. The research result can be highly useful for land use planning and management in landslide prone areas.

This multi-center retrospective study evaluated the diagnostic performance of a deep learning (DL)-based application for detecting, classifying, and highlighting suspected aortic dissections (ADs) on chest and thoraco-abdominal CT angiography (CTA) scans. CTA scans from over 200 U.S. and European cities acquired on 52 scanner models from 6 manufacturers were retrospectively collected and processed by CINA-CHEST (AD) (Avicenna.AI, La Ciotat, France) device. The di-agnostic performance of the device was compared with the ground truth established by the majority agreement of three US board-certified radiologists. Furthermore, the DL-algorithm's time-to-notification was evaluated to demonstrate clinical effectiveness. The study included 1,303 CTAs (mean age 58.8 ± 16.4 years old, 46.7% male, 10.5% positive). The device demonstrated a sensitivity of 94.2% [95% CI: 88.8% – 97.5%] and a specificity of 97.3% [95% CI: 96.2% - 98.1%]. The application classified positive cases by AD types with an accuracy of 99.5% [95% CI: 98.9% – 99.8%] for type A and 97.5 [95% CI: 96.4% – 98.3%] for type B. The application did not miss any type A cases. The device flagged 32 cases incorrectly, primarily due to acquisition artefacts and aortic pathologies mimicking AD. The mean time to process and notify of potential AD cases was 27.9 ± 8.7 seconds. This deep learning-based application demonstrated strong performance in detecting and classifying aortic dissection cases, potentially enabling faster triage of these urgent cases in clinical settings.

Variational Auto-Encoders (VAEs) are deep generative models used for unsupervised learning, however their standard version is not topology-aware in practice since the data topology may not be taken into consideration. In this paper, we propose two different approaches with the aim to preserve the topological structure between the input space and the latent representation of a VAE. Firstly, we introduce InvMap-VAE as a way to turn any dimensionality reduction technique, given an embedding it produces, into a generative model within a VAE framework providing an inverse mapping into original space. Secondly, we propose the Witness Simplicial VAE as an extension of the Simplicial Auto-Encoder to the variational setup using a witness complex for computing the simplicial regularization, and we motivate this method theoretically using tools from algebraic topology. The Witness Simplicial VAE is independent of any dimensionality reduction technique and together with its extension, Isolandmarks Witness Simplicial VAE, preserves the persistent Betti numbers of a data set better than a standard VAE.

The construction of different roads, such as freeways, highways, major roads or minor roads must be accompanied by constant monitoring and evaluation of service delivery. Pavements are generally assessed by engineers in terms of the smoothness, surface condition, structural condition and surface safety. Pavement assessment is often conducted using the qualitative indices such as international roughness index (IRI), pavement condition index (PCI), structural condition index (SCI) and skid resistance value (SRV), which are used for smoothness assessment, surface condition assessment, structural condition assessment, and surface safety assessment, respectively. In this paper, Tehran-Qom Freeway in Iran has been selected as the case study and its smoothness and pavement surface conditions are assessed. At 2-km intervals, a 100-meter sample unit is selected in the slow-speed lane (totally, 118 sample units). In these sample units, the PCI is calculated after a visual inspection of the pavement and the recording of distresses. Then, in each sample unit, the average IRI is computed. The purpose of this study is to provide a method for estimating PCI based on IRI. The proposed theory was developed by Random Forest (RF), and Random Forest optimized by Genetic Algorithm (RF-GA) methods and these methods were validated using correlation coefficient (CC), scattered index (SI), and Willmott’s index of agreement (WI) criteria. The proposed method reduces costs, saves time and eliminates the safety risks.

The rising severity and frequency of wildfires in recent years in the United States have raised numerous concerns regarding the improvement in wildfire emergency response management and decision-making systems, which require operational high temporal and spatial resolution monitoring capabilities. Satellites are one of the tools that can be used for wildfire monitoring. However, none of the currently available satellite systems provide both high temporal and spatial resolution. For example, GOES-17 geostationary satellite fire products have high temporal (1-5 min) but low spatial resolution (2 km), and VIIRS polar orbiter satellite fire products have low temporal (~12 h) but high spatial resolution (375 m). This work aims to leverage currently available satellite data sources, such as GOES and VIIRS, along with Deep Learning (DL) advances to achieve an operational high-resolution, both spatially and temporarily, wildfire monitoring tool. Specifically, this study considers the problem of increasing the spatial resolution of high temporal but low spatial resolution GOES-17 data products using low temporal but high spatial resolution VIIRS data products. The main idea is using an Autoencoder DL model to learn how to map GOES-17 geostationary low spatial resolution satellite images to VIIRS polar orbiter high spatial resolution satellite images. In this context, several loss functions and DL architectures are implemented and tested to predict both the fire area and the corresponding brightness temperature. These models are trained and tested on wildfire sites from 2019 to 2021 in the western U.S. The results indicate that DL models can improve the spatial resolution of GOES-17 images, leading to images that mimic the spatial resolution of VIIRS images. Combined with GOES-17 higher temporal resolution, the DL model can provide high-resolution near-real-time wildfire monitoring capability as well as semi-continuous wildfire progression maps.

Global rapidly evolving events, e.g., COVID-19, are usually followed by countermeasures and policies. As a reaction, the public tends to express their emotions on social media platforms. Therefore, predicting emotional responses to events is critical to put a plan to avoid risky behaviors. This paper proposes a machine learning-based framework to detect public emotions based on social media posts in response to specific events. It presents a precise measurement of population-level emotions which can aid governance in monitoring public response and guide it to put in place strategies such as targeted monitoring of mental health, to react to a rise in negative emotions in response to lockdowns, or information campaigns, for instance in response to elevated rates of fear in response to vaccination programs. We evaluate our framework by extracting 15,455 tweets. We annotate and categorize the emotions into 11 categories based on Plutchik’s study of emotion and extract the features using a combination of Bag of Words and Term Frequency-Inverse Document Frequency. We filter 813 COVID-19 vaccine-related tweets and use them to demonstrate our framework’s effectiveness. Numerical evaluation of emotions prediction using Random Forest and Logistic Regression shows that our framework predicts emotions with an accuracy up to 95%.

To minimise environmental impact, avoid regulatory penalties, and improve competitiveness, energy-intensive manufacturing firms require accurate forecasts of their energy consumption so that precautionary and mitigation measures can be taken. Deep learning is widely touted as a superior analytical technique to traditional artificial neural networks, machine learning, and other classical time series models due to its high dimensionality and problem solving capabilities. Despite this, research on its application in demand-side energy forecasting is limited. We compare two benchmarks (Autoregressive Integrated Moving Average (ARIMA), and an existing manual technique used at the case site) against three deep learning models (simple Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU)) and three machine learning models (Support Vector Regression (SVM), Random Forest, and K-Nearest Neighbors (KNN)) for short term load forecasting (STLF) using data from a Brazilian thermoplastic resin manufacturing plant. We use the grid search method to identify the best configurations for each model, and then use Diebold-Mariano testing to confirm the results. Results suggests that the legacy approach used at the case site is the worst performing, and that the GRU model outperformed all other models tested.

In the last few years, the agricultural field has undergone a digital transformation, incorporating artificial intelligence systems to make good employment of the growing volume of data from various sources and derive value from it. Within artificial intelligence, machine learning is a powerful tool for confronting the numerous challenges of developing knowledge-based farming systems. This study aims to comprehensively review the current scientific literature from 2017 to 2023, emphasizing machine learning in agriculture, especially viticulture, to detect and predict grape infections. Most of these studies (88%) were conducted within the last five years. A variety of machine learning algorithms were used, with those belonging to the neural network (CNN) standing out having the best results most of the time. Out of the list of diseases, the ones most researched were Grapevine Yellow, Flavescence Dorée, Esca, Downy mildew, Leafroll, Pierce’s, and Root Rot. Also, some other fields were studied which are water management, plant deficiencies, and classification. Because of the difficulty of the topic, it was collected all datasets that were available about grapevines, and it is described each dataset with the type of data (e.g., statistical, images, type of images), along with the number of images where it was mentioned. This work provides a unique source of information for a general audience comprising AI researchers, agricultural scientists, wine grape growers, and policymakers. Among others, its outcomes could be effective at curbing diseases in viticulture, which in turn will drive sustainable gains and boost success. Additionally, it could help build resilience in related farming industries such as winemaking.

Due to the adverse effect of prolonged drought stress on plants, accurate detection is essential for water use efficiency and maintaining productivity. Hyperspectral imaging is frequently used for non-invasive plant phenotyping, allowing for the long-term monitoring of crop health due to its sensitivity to subtle changes in leaf constituents. The broad spectrum of hyperspectral data enables the development of multiple vegetation indices (Vis) derived from the different spectral regions to estimate plant biophysical and biochemical traits. However, the known VIs often do not generalize well and perform poorly for multiple plant stresses. This study proposes new VIs combined with machine learning models to identify drought stress in wheat species under different nitrogen (N) levels. A wheat experiment was set up in the glasshouse with four treatments: well-watered high-N (WWHN), well-watered low-N (WWLN), drought-stress high N and drought-stress low-N. In addition to ensuring that plants were watered according to the experiment design, photosynthetic rate (Pn) and stomatal conductance (gs) were taken regularly, serving as the ground truth data for this study. Sensitive spectral features were selected using a custom-designed ensemble modelling technique. New drought VIs are proposed using different combinations of the selected features. Three classification models (support vector machines, random forest and deep neural network) were developed and trained using four sets of data: known VIs, proposed VIs, combined VIs (from the known and proposed VIs) and PCA-transformed features (over the whole spectral data). From the results, the proposed VIs outperformed the known VIs, yielding > 0.94 accuracies for all three models, and the performance improved when they were trained with the combined VIs. The combined VIs were used to train three regression models to predict the stomatal conductances and photosynthetic rates of plants. The random forest regression model performed best, suggesting that it could be used as a stand-alone tool to forecast gs and Pn and track drought stress in wheat.

Background: Despite recent advancements, medical technology has not yet reached its peak. Precision medicine is growing rapidly, thanks to machine learning breakthroughs powered by increased computational capabilities. This article explores a deep-learning application for computer-aided diagnosis in dermatology. Methods: Using a custom model based on EfficientNetB3 and deep learning, we propose an approach for skin lesion classification that offers superior results with smaller, cheaper, and faster inference times compared to other models. The skin images dataset used for this research includes 8,222 files selected from the authors' collection and the ISIC2019 archive, covering six dermatological conditions. Results: The model achieved 95.4% validation accuracy on four categories—melanoma, basal cell carcinoma, benign keratosis-like lesions, and melanocytic nevi—using an average of 1,600 images per category. Adding two categories with fewer images (about 700 each)—squamous cell carcinoma and actinic keratoses—reduced the validation accuracy to 88.8%. The model maintained accuracy on new clinical test images taken under the same conditions as the training dataset. Conclusions: The custom model demonstrated excellent performance on the diverse skin lesions dataset, with significant potential for further enhancements.

This paper presents a novel approach to designing beam codebooks for downlink multiuser hybrid multiple input multiple output (MIMO) wireless communication systems, leveraging multi-agent reinforcement learning (MARL). The primary objective is to develop an environment-specific beam codebook composed of non-interfering beams, learned by cooperative agents within the MARL framework. Machine learning (ML) based beam codebook design for downlink communications have been based on channel state information (CSI) feedback or only reference signal received power (RSRP) consisting of an offline training and user clustering phase. In massive MIMO, the full CSI feedback data is of large size and is resource-intensive to process, making it challenging to implement efficiently. RSRP alone for a stand-alone base station is not a good marker of the position of a receiver. Hence, in this work, uplink CSI estimated at the base station along with feedback of RSRP and binary acknowledgment of the accuracy of received data is utilized to design the beamforming codebook at the base station. Simulations using sub-array antenna and ray-tracing channel demonstrate the proposed system’s ability to learn topography-aware beam codebook for arbitrary beams serving multiple user groups simultaneously. The proposed method extends beyond mono-lobe and fixed beam architectures by dynamically adapting arbitrary shaped beams to avoid inter-beam interference, enhancing overall system performance. This work leverages MARL’s potential in creating efficient beam codebooks for hybrid MIMO systems, paving the way for enhanced multiuser communication in future wireless networks.

In this study, we explored the application of deep learning techniques for credit card fraud detection, aiming to improve the performance and reliability of anomaly detection methods in financial transactions. We first utilized the Isolation Forest algorithm, achieving a detection accuracy of 26% for the top 1000 transactions. Subsequently, we experimented with the Autoencoder algorithm, an unsupervised deep neural network model, which enhanced the detection accuracy to 33.6% in the best case despite some fluctuations. The results demonstrate deep learning models' strong feature extraction capability and adaptability, highlighting their potential to surpass traditional methods. However, the high imbalance in the dataset, with only 0.17% of transactions being fraudulent, poses a significant challenge. This study underscores the necessity for further experimentation and optimization of network structures and hyperparameters to achieve more stable and efficient fraud detection. The findings provide valuable insights and reference points for future research in financial fraud detection using deep learning methodologies.

This article comprehensively explores multiple aspects of cryptocurrencies and their price forecasting. Firstly, the article introduces the definition of cryptocurrency and its development process on a global scale, especially focusing on the launch of Facebook Libra and China's central bank digital currency, highlighting the importance and influence of digital currency in the global financial market. Subsequently, the article analyzes the advantages of digital currencies over traditional currencies, including improving economic transaction efficiency, reducing transaction costs and enhancing transaction transparency. Meanwhile, the article also explores the challenges and risks potentially brought by the development of digital currencies, such as regulatory uncertainty and market volatility. In this context, the article raises the importance of cryptocurrency price forecasting and introduces the forecasting models and techniques commonly used today. Finally, through specific experimental analysis, the effectiveness of using the deep learning model CNN-LSTM to predict the price of Bitcoin is demonstrated, and the directions of future research and optimization strategy are proposed. In summary, this paper comprehensively presents the research status and prospects of cryptocurrency and its price prediction field through systematic introduction and analysis.

Global climate change primarily affects the spatiotemporal variation of physical quantities such as relative humidity, atmospheric pressure, ambient temperature, and notably, precipitation levels. Accurate precipitation predictions remain elusive, necessitating tools for detailed spatiotemporal analysis to better understand climate impacts on the environment, agriculture, and society. This study compares three learning models: ARIMA (Autoregressive Integrated Moving Average), RF-R (Random Forest Regression), and LSTM-NN (Long Short-Term Memory Neural Network), utilizing monthly precipitation data (in millimeters) from 757 locations in Boyacá, Colombia. The LSTM-NN model outperformed others, precisely replicating precipitation observations in both training and testing datasets, significantly reducing the root mean square error (RMSE) with average monthly deviations of approximately 19 mm per location. Evaluation metrics (RMSE, MAE, R², MSE) underscore the LSTM model’s robustness and accuracy in capturing precipitation patterns. Consequently, the LSTM model was chosen to predict precipitation over a 16-month period starting from August 2023, offering a reliable tool for future meteorological forecasting and planning in the region.

Medical datasets may be imbalanced and contain errors due to subjective test results and clinical variability. The poor quality of original data affects classification accuracy and reliability. Hence, detecting abnormal samples in the dataset can help clinicians make better decisions. In this study, we propose an unsupervised error detection method using patterns discovered by the Pattern Discovery and Disentanglement (PDD) model, developed in our earlier work. Applied to the large data, the eICU Collaborative Research Database for sepsis risk assessment, the proposed algorithm can effectively discover statistically significant association patterns, generate an interpretable knowledge base for interpretability, cluster samples in an unsupervised learning manner, and detect abnormal samples from the dataset. As shown in the experimental result, our method outperformed K-Means by 38% on the full dataset and 47% on the reduced dataset for unsupervised clustering. Multiple supervised classifiers improve accuracy by an average of 4% after removing abnormal samples by the proposed error detection approach. Therefore, the proposed algorithm provides a robust and practical solution for unsupervised clustering and error detection in healthcare data.

Accurate prostate volume estimation is crucial for effective prostate disease management. Ultrasound (US) imaging, particularly transrectal ultrasound, offers a cost-effective and rapid assessment. However, US images often suffer from artifacts and poor contrast, making prostate volume estimation challenging. This review explores recent advancements in deep learning (DL) techniques for automatic prostate segmentation in US images as a primary step for prostate volume estimation. We examine various DL architectures, including traditional U-Net modifications and innovative designs incorporating residual connections, multi-directional image data, and attention mechanisms. Additionally, we discuss pre-processing methods to enhance image quality, the integration of shape information, and strategies to improve the consistency and robustness of DL models. The effectiveness of these techniques is evaluated through metrics such as Dice Similarity Coefficient, Jaccard Index, and Hausdorff Distance. The review highlights the potential of DL in improving prostate volume estimation accuracy and reducing clinical workload, while also identifying areas for future research to enhance model performance and generalizability.

Transformative education significantly advances society's growth as an essential doorway to fresh language learning chances. It equips people to succeed in a complicated world by encouraging critical thinking, inclusivity, social responsibility, lifelong learning, and international collaboration. Adopting transformative education can result in a more inventive, sustainable, and equal society where everyone can realize their potential and advance society's interests as educational systems change. This paper aims to gather literature regarding how transformative education becomes a door toward new learning opportunities in societal development especially language. Transformative education may produce a generation of knowledgeable, sympathetic, and proactive students who can bring about constructive social change by prioritizing holistic development. Hence, educators should work to foster a learning atmosphere where all students feel supported and respected. Through integrating social justice ideals into the educational process, transformative education equips students to act as change agents and advocates for equity both within and outside their communities.

This article explores the application of machine learning techniques, specifically focusing on ensemble methods like Random Forests, for detecting fraudulent activities in digital financial transactions. Highlighting the evolution from traditional statistical approaches to modern machine learning models, it underscores the effectiveness of Random Forests in handling the inherent challenges of imbalanced datasets typical in fraud detection scenarios. Using a Kaggle dataset of credit card transactions, the study optimizes Random Forest parameters through rigorous parameter tuning, achieving significant improvements in model performance metrics such as Area Under the Curve (AUC). The findings underscore the critical role of machine learning in enhancing fraud detection capabilities, emphasizing the ongoing evolution and future potential of these methodologies in financial risk management.

In the realm of agribusiness, transformative shifts are underway, propelled by the growing demands and expanding scales of grain production. This evolution calls for a critical reevaluation of the existing paradigms in coffee production and marketing paradigms, with a specific focus on integrating Artificial Intelligence (AI). This work aims to review, synthesize, and summarize the available data regarding how Machine Learning (ML) has been used to detect and classify characteristics in coffee beans and leaves. For this purpose, a comprehensive literature review of the most significant research contributions describing the application of AI for advanced classification techniques in coffee agriculture has been carried out. Our analysis suggests that implementing AI technologies allows the classification of coffee, encompassing various attributes such as maturity, roast intensity, disease identification, flavor profiles, and overall quality. More largely, this technological advancement holds the potential to revolutionize coffee farming by providing producers and agricultural specialists with sophisticated tools to enhance production efficiency, minimize costs, and improve the accuracy and confidence of their decision-making processes.

Accurate crop diseases classification is crucial for ensuring food security and enhancing agricultural productivity. However, existing crop disease classification algorithms primarily focus on a single image modality and typically require a large number of samples. Our research counters these issues by using pre-trained Vision-Language Models (VLMs), which enhances multimodal synergy for better crop disease classification than traditional unimodal approaches. Firstly, we apply the multimodal model Qwen-VL to generate meticulous textual descriptions for representative disease images selected through clustering from the training set, which will serve as prompt text for generating classifier weights. Compared to using solely the language model for prompt text generation, this approach better captures and conveys fine-grained and image-specific information, thereby enhancing prompt quality. Secondly, we integrate the cross-attention and the SE (Squeeze-and-Excitation) attention into the training-free mode VLCD (Vision-Language model for Crop Diseases classification) and the training-required mode VLCD-T (VLCD-Training) respectively for prompt text processing, enhancing classifier weights by emphasizing key text features. Experimental outcomes conclusively prove our method’s heightened classification effectiveness in few-shot crop disease scenarios, tackling data limitations and intricate disease recognition issues. It offers a pragmatic tool for agricultural pathology and reinforces the smart farming surveillance infrastructure.

Rice has become the second major food among rural people. It is one of the most nutrient and low-cost food available in Asia. Rice is composed of two major subspecies as Japonica and Indica and it belongs to the Poaceae family. The World Bank predicts that rice demand will grow 51% faster than population growth in 2025. It is high time to develop a model which predicts the type of infected paddy leaf and avoids the loss of grains. In this paper, the proposed hybrid CNN model, three CNN networks with different layer properties are trained parallel. The extracted feature from these CNN networks is combined to provide the classification of the type of infected leaf. Fieldwork was carried and about 340 samples are collected from five different types of classes. The proposed hybrid model was tested with both the fieldwork dataset and also with an available dataset on the internet. The experimental results show that the proposed model outperforms the other CNN network and yields an accuracy value of 98%, a precision value of 95%, and a misclassification rate of 4% respectively.

Recently, a significant number of tools for detecting dangerous objects have been developed. Unfortunately, the performance offered by them is overestimated due to the poor quality of the datasets used (insufficiently numerous, contain items not strictly related to dangerous objects, insufficient range of presentation conditions). To fill in a gap in this area we have built an extensive dataset dedicated to detecting the objects most often used in various acts of breaching public security (baseball bat, gun, knife, machete, rifle). This collection contains images presenting the detected objects with different quality and under different environmental conditions. We believe that the results obtained from it are more reliable and give a better idea of the detection accuracy that can be achieved under real conditions. We used the Faster R-CNN with different backbone networks in the study. The best results were obtained for the ResNet152 backbone. The mAP value was 85%, while the AP level ranged from 80% to 91%, depending on the item detected. An average real-time detection speed was 11-13 FPS. Both the accuracy and speed of the Faster R-CNN model allow it to be recommended for use in public security monitoring systems aimed at detecting potentially dangerous objects.

Great toe strength (GTS) weakness is linked to declines in balance and mobility. Assessing GTS, particularly great toe extension strength (GTES) accurately is often neglected in clinical evaluations due to cumbersome and subjective methods. This study aims to characterize the force development curve output from the ToeScale and examine GTES variations with age, sex, BMI, and grip strength (GS) using traditional analyses and machine learning (ML). We conducted a pilot, cross-sectional feasibility study with convenience samples. We assessed GS using a hand-grip dynamometer and GTES using the ToeScale. Data analysis included descriptive statistics, correlations, independent samples t-tests, and accuracy and area under the curve (AUC) scores for three ML models. Thirty-one participants (Males: 9, Females: 22), 14 young (18-24 years), and 17 older (>65 years) adults participated in the study. Males had significantly higher peak GTES than females in both age groups. Associations between GTES parameters with BMI and GS varied by age and sex. ML model accuracies and AUC scores were low-moderate but aligned with traditional analyses. Future studies with larger samples and optimized ML models are needed.

Traffic accidents are among the most common causes of death worldwide. According to statistics from the World Health Organization (WHO), 50 million people are involved in traffic accidents every year. Canada, particularly Montreal, is not immune to this problem. Data from the Société de l’Assurance Automobile du Québec (SAAQ) shows that there were 392 deaths on Québec roads in 2022, 38 of them related to the city of Montreal. This value represents an increase of 29.3% for the city of Montreal compared to the average for the years 2017 to 2021. In this context, it is important to take concrete measures to improve traffic safety in the city of Montreal. In this article, we present a web-based solution based on machine learning that predicts the severity of traffic accidents in the city of Montreal. This solution uses dataset of traffic accidents that occurred in Montreal between 2012 and 2021. Classification algorithms such as eXtreme Gradient Boosting (XGBoost), Categorical Boosting (CatBoost), Random Forest (RF) and Gradient Boosting (GB) were used to develop the prediction model. When evaluating the prediction model, performance metrics such as precision, recall, F1 score, and accuracy are taken into account. The performance analysis shows an excellent accuracy of 96% for the prediction model based on the XGBoost classifier. The other models (CatBoost, RF, GB) achieved 95%, 93% and 89% accuracy, respectively. The prediction model based on the XGBoost classifier was deployed using a client-server web application managed by Swagger-UI and the Flask Python framework.

The learning equations of an ANN are presented, giving an extremely concise derivation based on the principle of backpropagation through the descendent gradient. Then, a reflection is developed on the dual attention network that applies the learning equations and coordinates subnetworks toward purposeful behaviors. Speculation is made on possible developments of functionalities that could provide additional skills and at the same time shed light on competencies typical of ``natural intelligence".

Convolutional neural networks (CNNs) face challenges in capturing long-distance text correlations, and Bidirectional Long Short-Term Memory (BiLSTM) networks exhibit limited feature extraction capabilities for text classification of work order. To address the abovementioned problems, this work utilizes an ensemble learning approach to integrate model elements efficiently. This study presents a method for classifying work order texts using a hybrid neural network model called BERT-BiLSTM-CNN. First, use Bert for preprocessing to obtain text vector representations. Then, capture context and process sequence information through BiLSTM. Next, capture local features in the text through CNN. Finally, obtain classification results through Softmax. Through comparative analysis, the method of fusing these three models is superior to other hybrid neural network model architectures in multiple classification tasks. It has a significant effect on work order classification.

In orthopedics, bone drilling is a crucial part of a surgical method commonly carried out for internal fixation in bone fracture treatment. The primary purpose of bone drilling is the creation of holes for screw insertion to immobilize fractured parts. The bone drilling task depends on the orthopedist and surgeon’s high level of skill and experience. This paper aimed to provide a summary of previously published review studies in the field of bone drilling. This review paper also presents a comprehensive review of the application of machine learning for bone drilling and as a future direction for the automation system. This review can also help medical surgeons and bone drillers understand the latest improvements through parameter selection and optimization strategies to reduce bone damage in bone drilling procedures. Apart from the review study, bone drilling vibration data collected in the University laboratory experiment is also presented in this study. The vibration data consist of three different layers of femur cow bone which are processed and classified using several machine learning methods. LSTM is, used in the bone drilling classification study to prove that the layers of the bone drilling are associated with the vibration signal and can be classified and predicted using the machine learning method.

Pedestrian trajectories are crucial for self-driving cars to plan their paths effectively. The sensors implanted in these self-driving vehicles, despite being state-of-the-art ones, often face inaccuracies in the perception of surrounding environments due to technical challenges for adverse weather conditions, interference from other vehicles sensors and electronic devices, and signal reception failure, leading to incompleteness in trajectory data. But for real-time decision making for autonomous driving, the trajectory imputation is no less crucial. Previous attempts to address this issue such as statistical inference and machine learning approaches have shown promise. Yet, the landscape of deep learning is rapidly evolving with new and more robust models emerging. In this research, we have proposed an encoder-decoder architecture, Human Trajectory Imputation Model, coined as HTIM, to tackle these challenges. This architecture aims to fill in the missing parts of pedestrian trajectories. The model has been evaluated using the Intersection drone inD dataset, containing trajectory data at suitable altitudes preserving naturalistic pedestrian behavior with varied dataset sizes. To assess the effectiveness of our model, we have utilized L1, MSE, Quantile and ADE loss. Our experiments have demonstrated that HTIM outperforms the majority of the state-of-the-art methods in this field, thus indicating its superior performance in imputing pedestrian trajectories.

The volume of fluid (VOF) method is a popular technique for the direct numerical simulations of flows involving immiscible fluids. A discrete volume fraction field evolving in time represents the interface, in particular, to compute its geometric properties. The height function method (HF) is based on the volume fraction field, and its estimate of the interface curvature converges with second-order accuracy with grid refinement. Data-driven methods have been recently proposed as an alternative to computing the curvature, with particular consideration for a well-balanced input data set generation and symmetry preservation. In the present work, a two-layer feed-forward neural network is trained on an input data set generated from the height function data instead of the volume fraction field. The symmetries for rotations, reflections, and the anti-symmetry for the phase swapping have been considered to reduce the number of input parameters. The neural network, establishing a correlation between curvature and height function values, can efficiently predict the local interface curvature. We compare the trained neural network to the standard Height Function method to assess its performance and robustness.

Identifying the primary site of origin of metastatic cancer is vital for guiding treatment decisions, especially for patients with cancer of unknown primary (CUP). Despite advanced diagnostic techniques, CUP remains difficult to pinpoint and is responsible for a considerable number of cancer-related fatalities. Understanding its origin is crucial for effective management and potentially improving patient outcomes. This study introduces a machine learning framework ONCOfind-AI that leverages transcriptome-based gene set features to enhance the accuracy of predicting the origin of metastatic cancers. By ensuring compatibility between RNA-sequencing and micro-array data, we were able to construct a more comprehensive training dataset. Integrating data from different platforms improved the accuracy of our machine learning models for predicting cancer origins. Our method was validated using external data from clinical samples collected through Kangbuk Samsung Medical Center and the Gene Expression Omnibus. The external validation results demonstrated a top-1 accuracy ranging from 0.80 to 0.86, with a top-2 accuracy of 0.90. This study highlights that incorporating biological knowledge through curated gene sets can merge gene expression data from different platforms, enhancing the compatibility needed for more effective machine learning prediction models.

Particulate organic carbon (POC) is a pivotal component within the marine carbon cycle, actively involved in diverse biogeochemical processes. This study focuses on Mediterranean as the research region, selecting the most influential factors from 47 potential ones influencing surface POC. Using geographic detector for factor identification, ten primary influencers were identified. Preliminarily optimized random forest (BRF), backpropagation neural network, adaptive boosting, and extreme gradient boosting were utilized to construct POC assessment models. Notably BRF exhibited superior performance in estimating the sea surface POC. Further optimization of RF using the tuneRanger R package resulted in R² of 0.868, mean squared error of 1.119 (mg/m³) ², and mean absolute error of 1.041 (mg/m³). Surface POC concentrations in the Mediterranean for May and June 2017 were estimated. Spatial distribution analysis unveiled higher concentrations in the west, lower in the east, higher in the north, lower in the south, with higher levels near the coast and lower far from the coast. Additionally, the study deliberated on the impact of human activities on surface POC in the Mediterranean. This research contributes a high-precision method for satellite retrieval of surface POC concentrations in the Mediterranean, thereby enriching the understanding of POC dynamics in the area.

While researchers have made notable progress in bio-inspired swimming robot development, a persistent challenge lies in creating propulsive gaits tailored to these robotic systems. The California sea lion achieves its robust swimming abilities through a careful coordination of foreflippers and body segments. In this paper, reinforcement learning (RL) was used to develop a novel sea lion foreflipper gait for a bio-robotic swimmer using a numerically modelled computational representation of the robot. This model integration enabled reinforcement learning to develop desired swimming gaits in the challenging underwater domain. The novel RL gait outperformed the characteristic sea lion foreflipper gait in the simulated underwater domain. When applied to the real-world robot, the RL constructed novel gait performed as well or better than the characteristic sea lion gait in many factors. This work shows the potential for using complimentary bio-robotic and numerical models with reinforcement learning to enable the development of effective gaits and maneuvers for underwater swimming vehicles.

Droughts have a substantial effect on water resources, agriculture, and ecosystems on a worldwide scale. In the Mekong Delta of Vietnam, droughts exacerbated by climate change are significantly endangering the region's agricultural sustainability and output. Conventional forecasting techniques frequently do not capture the intricate dynamics of meteorological phenomena associated to drought effectively, prompting the exploration of more advanced methodologies. This work utilises artificial intelligence, par-ticularly machine learning methods like Gradient Boosting and Extreme Gradient Boosting (XGBoost), to enhance drought pre-diction in the Mekong Delta. The study utilises data from 11 meteorological stations spanning from 1990 to 2022 to create and evaluate Machine Learning models based on several climatic factors. We utilise Gradient Boosting and XGBoost algorithms to estimate the Standardised Precipitation-Evapotranspiration Index (SPEI) and evaluate their effectiveness in comparison to con-ventional forecasting techniques. The results show that Machine Learning, particularly XGBoost, surpasses traditional approaches in predicting SPEI accuracy at various time scales. XGBoost demonstrates skill in understanding the complex relationships between climatic factors, with R² values falling between 0.90 and 0.94 for 1-month forecasts. The progress highlights the potential of Machine Learning in improving drought management and adaptation tactics, proposing the incorporation of Machine Learning forecasting models into decision-making processes to enhance drought resistance in susceptible areas.

This study aims to provide analyses of the levels of airborne particulate matter (PM) using a two-pronged approach that combines data from in situ Internet of Things (IoT) sensor networks with remotely sensed aerosol optical depth (AOD). Our approach involved setting up a network of custom-designed PM sensors that could be powered by the electrical grid or solar panels. These sensors were strategically placed throughout densely populated areas of North Texas to collect data on PM levels, weather conditions, and other gases from September 2021 to June 2023. The collected data was then used to create models that predict PM concentrations in different size categories, demonstrating high accuracy with correlation coefficients greater than 0.9. This highlights the importance of collecting hyperlocal data with precise geographic and temporal alignment for PM analysis. Furthermore, we expanded our analysis to a national scale by developing machine learning models that estimate hourly PM2.5 levels throughout the continental United States. These models used high-resolution data from the Geostationary Operational Environmental Satellites (GOES-16) Aerosol Optical Depth (AOD) dataset, along with meteorological data from the European Center for Medium-Range Weather Forecasting (ECMWF), AOD reanalysis, and air pollutant information from the MERRA-2 database, covering the period from January 2020 to June 2023. Our models were refined using ground truth data from our IoT sensor network, the OpenAQ network, and the National Environmental Protection Agency (EPA) network, enhancing the accuracy of our remote sensing PM estimates. The findings demonstrate that the combination of AOD data with meteorological analyses and additional data sets can effectively model PM2.5 concentrations, achieving a significant correlation coefficient of 0.849. The reconstructed PM2.5 surfaces created in this study are invaluable for monitoring pollution events and performing detailed PM2.5 analyzes. These results were further validated through real-world observations from two in situ MINTS sensors located in Joppa (South Dallas) and Austin, confirming the effectiveness of our comprehensive approach to PM analysis. The US Environmental Protection Agency (EPA) recently updated the national standard for PM2.5 to 9 μg/m3, a move aimed at significantly reducing air pollution and protecting public health by lowering the allowable concentration of harmful fine particles in the air. Using our analysis approach to reconstruct the fine-time resolution PM2.5 distribution across the entire United States for our study period, we found that the entire nation encountered PM2.5 levels that exceeded 9 μg/m3 for more than 20% of the time of our analysis period, with the eastern United States and California experiencing concentrations exceeding 9 μg/m3 for over 50% of the time, highlighting the importance of regulatory efforts to maintain annual PM2.5 concentrations below 9 μg/m3.

The calculation of the global shear capacity of steel-concrete composite downstand cellular beams with precast hollow-core units is important as it affects the span to depth ratios and the amount of material used, hence affects the embodied CO2 calculation when designers are deciding on the floor grids. This paper presents a reliable tool that can be used by designers to alter and optimise grip options during the preliminary design stages, without the need to run onerous calculations. The global shear capacity prediction formula is developed using five machine learning models. First, a finite element model database is developed. The influence of the opening diameter, web opening spacing, tee-section height, concrete topping thickness, the interaction degree, and the number of shear studs above the web opening are investigated. Reliability analysis is conducted to assess the design method and propose new partial safety factors. The Catboost Regressor algorithm presented better accuracy compared to the other algorithms. An equation to predict the shear capacity of composite cellular beams with hollow-core units is proposed by Gene Expression Programming. In general, the partial safety factor for resistance, according to the reliability analysis, varied between 1.25 and 1.26.

With the advancement of technology, signal modulation types are becoming increasingly diverse and complex. The phenomenon of signal time-frequency overlap during transmission poses significant challenges for the classification and recognition of mixed signals, including poor recognition capabilities and low generality. This paper presents a recognition model for fine-grained analysis of mixed signal characteristics, proposing a Geometry Coordinate attention mechanism and introducing a low-rank bilinear pooling module to more effectively extract signal features for classification. The model employs a residual neural network as its backbone architecture and utilizes the Geometry Coordinate attention mechanism for time-frequency weighted analysis based on information geometry theory. This analysis targets multiple-scale features within the architecture, producing time-frequency weighted features of the signal. These weighted features are further analyzed through a low-rank bilinear pooling module, combined with the backbone features, to achieve fine-grained feature fusion. This results in a fused feature vector for mixed signal classification. Experiments were conducted on a simulated dataset comprising 39,600 mixed signal time-frequency plots. The model was benchmarked against a baseline using a residual neural network. The experimental outcomes demonstrated an improvement of 9% in the exact match ratio and 5% in the Hamming score. These results indicate that the proposed model significantly enhances the recognition capability and generalizability of mixed signal classification.

Within environmental perception, automatic navigation and object detection, computer vision is a crucial and demanding field with many applications in modern industries, such as multi-target long-term visual tracking in automated production, defect detection, and driverless robotic vehicles with sensing ability. The performance of computer vision has greatly improved recently thanks to developments in deep learning algorithms and hardware computing capabilities, which has spawned the creation of a large number of related applications. This paper presents the results of a detailed review of over 50 papers published over the course of two decades (1999–2024), with a primary focus on the technical advancement of computer vision. To elucidate the foundational principles, an examination of typical visual algorithms based on traditional correlation filtering was initially conducted. Subsequently, a comprehensive overview of the most recent advancements in deep learning-based computer vision techniques was compiled. Furthermore, a comparative analysis between conventional and novel algorithms was undertaken to discuss the future trends and directions of computer vision. Lastly, the feasibility of employing visual SLAM (Simultaneous Localization and Mapping) algorithms in the context of autonomous vehicles with sensing capability was explored. Furthermore, we explored a thorough and efficient architecture for utilizing these techniques in autonomous robotic vehicles into unmanned green and low-carbon smart factories, underlining novel advances as well as potential prospects for future research.

Responsible, efficient, and environmentally conscious energy consumption practices are increasingly essential for ensuring the reliability of the modern electricity grid. This study focuses on leveraging time series analysis to improve forecasting accuracy, crucial for various application domains where real-world time series data often exhibit complex, non-linear patterns. Our approach advocates for utilizing Long Short Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) models for precise time series forecasting. To ensure a fair evaluation, we compare the performance of our proposed approach with traditional neural networks, time-series forecasting methods, and conventional decline curves. Additionally, individual models based on LSTM, Bi-LSTM, and other machine learning methods are implemented for a comprehensive assessment. Experimental results consistently demonstrate that our proposed model outperforms all benchmarking methods in terms of mean absolute error (MAE) across most datasets. Addressing the imbalance between activations by consumer and prosumer groups, our predictions show superior performance compared to several traditional forecasting methods, such as the Autoregressive Integrated Moving Average model (ARIMA) and Seasonal Autoregressive Integrated Moving Average model (SARIMA). Specifically, the root mean square error (RMSE) of Bi-LSTM is 5.35%, 46.08%, and 50.6% lower than LSTM, ARIMA, and SARIMA, respectively, on the May test data.

Electric vehicles (EVs) play a significant role in reducing carbon emissions. In the US, EVs are mostly owned by multi-vehicle households, and their usage is primarily studied in the context of vehicle miles traveled. This study takes a unique approach by analyzing EV usage through the lens of vehicle choice (between EVs and internal combustion engine vehicles) within multi-vehicle households. A two-step machine-learning framework (clustering and decision trees) is proposed. The framework determines the preferred trip category for EV use and captures the effects of household attributes, driver attributes, built-environment factors, and gas prices on EV use in multi-vehicle households. Results indicate that discretionary trips (accumulated local effect = 0.037) are mostly preferred for EV use. EV preference is more pronounced among households with fewer workers (<2) and lower income levels. These findings are valuable for policymakers and auto manufacturers in targeting specific market segments and promoting EV adoption.

We present the use of interconnected optical mesh networks for early earthquake detection and localization, exploiting existing terrestrial fiber infrastructure. Employing a Waveplate model, we integrate real ground displacement data from seven earthquakes, magnitudes ranging from four to six, to simulate the strains within fiber cables and collect large set of light’s polarization evolution data. These simulations help to enhance a Machine-Learning model that is trained and validated to detect Primary waves arrivals that precede earthquakes’ destructive Surface waves. The validation results show that the model achieves over 95% accuracy. The Machine-Learning model is then tested against an M4.3 earthquake, exploiting three interconnected mesh networks as a smart sensing grid. Each network is equipped with a sensing fiber placed to correspond with three distinct seismic stations. The objective is to confirm earthquake detection across the interconnected networks, localize the epicenter coordinates by a triangulation method and calculate fibers to epicenter distance. This setup allows early warning generation to municipalities close to epicenter location, and progressing to those further away. The model testing shows 98% of accuracy in detecting primary wave and one-second of detection time, affording nearby areas 21-seconds to take countermeasures, and an extended 57-seconds in more distant areas.

To understand dynamics in climate change, informing policy decisions and prompting timely action to mitigate its impact, this study provides a comprehensive analysis of the short-term trend of year-on-year CO2 emission changes across ten countries, considering a broad range of factors including socioeconomic, CO2-related industry, and education. This study uniquely goes beyond the common country-based analysis, offering a broader understanding of the interconnected impact of CO2 emissions across countries. Our preliminary regression analysis, using the ten most significant features, could only explain 66% of variations in the target. To capture emissions trend variation, we categorized countries by the change in CO2 emission volatility (high, moderate, low with upward or downward trends), assessed using standard deviation. We employed machine learning techniques, including feature importance analysis, Partial Dependence Plots (PDPs), sensitivity analysis, and Pearson and Canonical correlation analyses, to identify influential factors driving these short-term changes. The Decision Tree Classifier was the most accurate model, with an accuracy of 96%. It revealed population size, CO2 emissions from coal, the three-year average change in CO2 emissions, GDP, CO2 emissions from oil, education level (incomplete primary), and contribution to temperature rise as the most significant predictors, in order of importance. Furthermore, this study estimates the likelihood of a country transitioning to a higher emission category. Our findings provide valuable insights into the temporal dynamics of factors influencing CO2 emissions changes, contributing to global efforts to address climate change

Over the past decade, the volume and quality of data in the oil and gas industry have exploded, breeding exciting opportunities to implement machine learning for better data- driven decisions. One critical example is hydraulic fracturing (HF), given our ever-growing reliance on HF to meet global hydrocarbon demand. This paper systematically explores the work of several researchers to apply ML techniques (including linear regression, neural networks, support vector machine, decision trees, and more) to HF-related operations, from production forecast to HF design. Furthermore, this study examines how optimization algorithms (including gradient-free, differential evolution, and surrogate-based optimizations) are incorporated with different ML techniques for selecting optimal HF parameters (like fracture number, proppant concentration, and more) during the planning process. The paper aims to provide a comprehensive overview without delving too deeply into technical intricacies to ensure accessibility for a broader audience. Additionally, it introduces innovative techniques currently being integrated into the industry and offers a clear understanding of the processes involved. Ultimately, the analysis concludes that machine learning is an accurate and cost-effective alternative for hydraulic fracturing optimization.

Partial Differential Equations (PDEs) constitute a fundamental framework for modeling various physical phenomena across diverse fields such as physics, engineering, and finance. Solving PDEs accurately and efficiently remains a significant challenge, particularly when dealing with complex systems or high-dimensional data. In this paper, we present a novel approach based on deep learning techniques to investigate the effective factors in solving PDEs. Our methodology leverages the expressive power of deep neural networks to learn and represent the underlying relationships between input parameters and the solutions of PDEs. By incorporating domain knowledge into the network architecture and training process, our approach aims to provide insights into the key factors influencing the solution of PDEs. We demonstrate the effectiveness of our method through numerical experiments on various PDEs, showcasing its capability to identify important features and improve predictive accuracy. Our findings suggest that deep learning techniques offer a promising avenue for understanding and analyzing the complex dynamics inherent in PDEs, paving the way for enhanced computational methods in scientific and engineering applications.

Considering the multifaceted nature of neurodegenerative diseases like dementia and the neces-sity for interprofessional knowledge, this research extends its scope to encompass professionals with diverse levels of training and experience in dementia care. A need analysis for the project “My INdividual Digital EDucation.RUHR” (MINDED.RUHR) is conducted to develop an au-tomatized recommender system for individual learning content using AI. In this sub-study, the aim was to reveal didactic specialties, knowledge gaps and structural challenges of further edu-cation in dementia care of different health professions and to derive learning preference personae. Eight focus group interviews among nine health professions and up to six participants (n = 34) each took place to survey distinct didactic experiences and learning needs. The results reflect various learning preferences, with a propensity to multimedia, practical and interactive tasks. Health professions are used to digital education but show aversions against certain e-learning formats. The derived learning preference personae constitute profound blueprints for a us-er-centred digital education design process, aiming to establish personalized and representative further education in dementia care applicable to various individual preferences and structural workplace challenges of healthcare professions.

Green and low-carbon development has become an important embodiment of China's path to becoming a strong agricultural country. How to enable agricultural enterprises to better adopt green technologies and conduct production and operation with the concept of sustainable development has become a key link. This article utilizes a structural equation model (SEM) to analyze the role paths and mediating effects of organizational learning ability and policy orientation in agricultural enterprises' market orientation and willingness to adopt green technologies[ The definition of green technology in this paper refers to Guo Kesha, Tian Xiaoxiao. Green technology and green transformation of industrial development mode [J]. Tianjin Social Sciences, 2024 (02) :99-107, including green manufacturing (production) technology and green service technology.]. The results show that market orientation, organizational learning ability, and policy effectiveness have significant direct positive impacts on the willingness to adopt; market orientation has a significant positive impact on agricultural enterprises' organizational learning ability, organizational learning ability has a significant positive impact on policy orientation, and market orientation has a significant positive impact on policy effectiveness; the results of mediation analysis also indicate that learning ability has a significant mediating effect between market orientation and willingness to adopt, and policy effectiveness has a significant mediating effect between market orientation and willingness to adopt. Through difference analysis, it is believed that the mediating effects of the three paths are equally important, and organizational learning ability and policy effectiveness play a partial mediating role in agricultural enterprises' willingness to adopt green technologies. Based on this, policy suggestions are proposed to improve enterprises' own organizational learning ability, increase the promotion of policies related to green technologies, improve relevant policies for the application of green technologies, and increase research and development efforts for green technologies.

With the escalation of size and complexity of modern Denial of Service attacks, there is a need for research in the context of Machine Learning (ML) used in attack execution and defense against such attacks. This paper investigates the potential use of ML in generating behavioral telemetry data using Long-Short Term Memory network and spoofing requests for the analyzed traffic to look legitimate. For this research, a custom testing environment was built, that listens for mouse and keyboard events and analyzes them accordingly. While the economic feasibility of this attack currently limits its immediate threat, advancements in technology could make it more cost-effective for attackers in the future. Therefore, proactive development of countermeasures remains essential to mitigate potential risks and stay ahead of evolving attack methods.

Gestational Diabetes Mellitus (GDM) is related with adverse outcomes for both the mother and the offspring. Immune and senescence play a crucial role in GDM progression. This study aims to explore the diagnostic significance of immune-related senescence (IRS) genes in GDM. We used weighted gene co-expression network analysis (WGCNA) and single sample gene set enrichment analysis (ssGSEA) to compute the immune score and aging score in control and GDM samples. Machine learning identified core IRS genes. Then we performed unsupervised cluster analysis in GDM patients to explore immune infiltration. Finally, we validated the core genes in clinical samples. We used the intersection of MEblack module from WGCNA and differentially expressed genes (DEGs) to obtain the potential genes. Next, a univariate logistic regression model including 23 potential genes were constructed, and these genes were filtered by least absolute shrinkage and selection operator (LASSO) algorithm. There were 5 potential genes (COX17, RRAS2, RRAGC, CECR1, and TACC2), which defined as biomarkers, remained eventually, and the efficacy of these biomarkers was evaluated by nomogram. Finally, the results from both qRT-PCR and western blot analyses demonstrated CECR1 was down-regulated, while TACC2 was up-regulated in GDM placental tissue. Our study identified CECR1 and TACC2 as diagnostic biomarkers for GDM associating with immune and senescence, providing a new perspective on GDM progression.

Citizen science substantially contributes to large-scale biodiversity monitoring and the enhancement of public literacy. While both of the contributions largely depend on the public’s self- regulated learning. In this study, we employed a mix- method approach, incorporating both a questionnaire survey of 133 participants and interviews with 12 volunteers, aiming to explore the feature of self- regulated learning in citizen science, as well as identify the main factors impacting it. The volunteers are all different ages, from different jobs, with varying educational backgrounds. The findings revealed that the educational background of volunteers did not significantly impact their self-regulated learning. However, an increased frequency of participation was linked to higher levels of self-regulated learning. Furthermore, achievement goal orientation mediates the prediction of self-regulation by scientific epistemology. These insights underscore the importance of enhancing citizen science's impact on scientific literacy by fostering self-regulated learning among participants. This can be achieved through explicit instruction in scientific epistemology and by fostering a sense of achievement to boost achievement goal orientations. Additionally, our study advocates for the promotion of social interaction between students and out- of- school citizen scientists in school-based citizen science projects. The main innovation of this study is to consider volunteers as learners, not merely as contributors of data.

This paper presents a novel approach to sentiment analysis specifically customized for predicting stock market movements, bypassing the need for external dictionaries which are often unavailable for many languages. Our methodology directly analyzes textual data, with a particular focus on context-specific sentiment words within neural network models. This specificity ensures our sentiment analysis is both relevant and accurate in identifying trends in the stock market. We employ sophisticated mathematical modeling techniques to enhance both the precision and interpretability of our models. Through meticulous data handling and advanced machine learning methods, we leverage large datasets from Twitter and financial markets to examine the impact of social media sentiment on financial trends. We achieved an accuracy exceeding 75%, highlighting the effectiveness of our modeling approach, which we further refined into a convolutional neural network model. This achievement contributes valuable insights into sentiment analysis within the financial domain, thereby improving the overall clarity of forecasting in this field.

A multimodal detection system with complementary capabilities for efficient detection was developed for impurity detection. The system consisted of a visible light camera, a multispectral camera, image correction and registration algorithms. It can obtain spectral feature and color feature at the same time, and has higher spatial resolution than a single spectral camera. This system was applied to detect impurities in Pu ’er tea to verify its high efficiency. The spectral and color features of each pixel in the images of Pu ’er tea were obtained by this system and used for pixel classification. The experimental results show that the accuracy of Support Vector Machine (SVM) model based on combined features is 93%, which is 7% higher than that based on only spectral features. By applying median filtering algorithm and contour detection algorithm to the label matrix extracted from pixel-classified images, 8 impurities except hair were detected successfully. Moreover, taking advantage of the high resolution of visible light camera, small impurities can be clearly imaged. By comparing the segmented color image with the pixel-classified image, small impurities such as hair could be detected successfully. Finally, it is proved that the system can obtain multiple images to allow a more detailed and comprehensive understanding of the detected items, and has excellent ability to detect small impurities.

Due to the significant price difference, expensive oils like olive oil are often blended with cheaper edible oils. This practice of adulteration in edible oils, aimed at increasing profits for producers, poses a major concern for consumers. Furthermore, adulteration in edible oils can lead to various health issues impacting consumer well-being. In order to meet the requirements of fast, non-destructive, universal, accurate and reliable quality testing for edible oil, the oblique-incidence reflectivity difference (OIRD) method combined with machine learning algorithms was introduced to detect a variety of edible oils. The prediction accuracy of Gradient Boosting, K-Nearest Neighbor, and Random Forest models exceeded 95%. Experimental results indicate that the OIRD method can serve as a powerful tool for detecting edible oils.

This study addresses the prediction of recurring failures in water supply networks, a complex and costly task, but essential for the effective maintenance of these vital infrastructures. Using historical failure data provided by Companhia de Água e Esgotos da Paraíba (CAGEPA), the research focuses on predicting the time until the next failure at specific points in the network. The authors divided the failures into two categories: Occurrences of New Faults (ONF) and Recurrences of Faults (RF). To make the predictions, they used predictive models based on Machine Learning, more specifically on MLP (Multi Layer Perceptron) neural networks. The study revealed that, by analyzing data from past failures and considering factors such as altitude, number of failures on the same street and days between failures, it is possible to achieve an accuracy greater than 80% in predicting failures within a 90-day interval. This demonstrates the feasibility of using fault history to predict future water supply outages with significant accuracy. These forecasts allow water utilities to plan and optimize their maintenance, minimizing inconvenience and losses. The article contributes to the field of water infrastructure management by suggesting that the data-driven approach can be applied in other cities or in networks of different types, such as energy or communication networks. The conclusions highlight the importance of data collection and analysis in preventing failures and optimizing water utilities’ resources.

End-to-end learned image compression codecs have notably emerged in recent years. These codecs have demonstrated superiority over conventional methods, showcasing remarkable flexibility and adaptability across diverse data domains while supporting new distortion losses. Despite challenges such as computational complexity, learned image compression methods inherently align with learning-based data processing and analytic pipelines due to their well-suited internal representations. The concept of Video Coding for Machines has garnered significant attention from both academic researchers and industry practitioners. This concept reflects the growing need to integrate data compression with computer vision applications. In light of these developments, we present a comprehensive survey and review of lossy image compression methods. Additionally, we provide a concise overview of two prominent international standards, MPEG Video Coding for Machines and JPEG AI. These standards are designed to bridge the gap between data compression and computer vision, catering to practical industry use cases.

Quantum computing (QC) has opened the door to advancements in machine learning (ML) tasks that are currently implemented in the classical domain. Convolutional neural networks (CNNs) are classical ML architectures that exploit data locality and possess a simpler structure than fully-connected multi-layer perceptrons (MLPs) without compromising the accuracy of classification. However, the concept of preserving data locality is usually overlooked in the existing quantum counterparts of CNNs, particularly for extracting multi-features in multidimensional data. In this paper, we present a multidimensional quantum convolutional classifier (MQCC) that performs multidimensional and multi-feature quantum convolution with average and Euclidean pooling and thus adapting the CNN structure to a variational quantum algorithm (VQA). Average pooling is based on the quantum Haar transform (QHT) and Euclidean pooling is based on partial quantum measurement. The experimental work was conducted using multidimensional data to validate the correctness and demonstrate the scalability of the proposed method utilizing both noisy and noise-free quantum simulations. We evaluated the MQCC model with reference to reported work on state-of-the-art quantum simulators from IBM Quantum and Xanadu using a variety of standard ML datasets. The experimental results showed favorable characteristics of our proposed techniques compared to existing work with respect to a number of quantitative metrics such as the number of training parameters, cross-entropy loss, classification accuracy, circuit depth, and quantum gate count.

Artificial Intelligence (AI) and Machine Learning (ML) approaches that could learn from large data sources have been identified as useful tools to support clinicians in their decisional process; AI and ML implementations have had a rapid acceleration during the recent COVID-19 pandemic. However, many ML classifiers are “black box” to the final user, since their underlying reasoning process is often obscure. Additionally, the performance of such models suffer from poor generalization ability in presence of dataset shift. Here, we present a comparison between an explainable-by-design (“white box”) model (Bayesian Network (BN)) versus a black-box model (Random Forest), both studied with the aim to support clinicians of Policlinico San Matteo University Hospital in Pavia (Italy) during the triage of COVID-19 patients. Our aim is to evaluate whether the BN predictive performances are comparable with those of a widely used but less explainable ML model such as Random Forest and to test the generalization ability of the ML models across different waves of the pandemic.

Modal testing is a common step in aerostructure design, serving to validate the predicted natural frequencies and mode shapes obtained through computational methods. The strategic placement of sensors during testing is crucial to accurately measuring the intended natural frequencies. However, conventional methodologies for sensor placement are often time-consuming and involve iterative processes. This study explores the potential of machine learning techniques to enhance sensor selection methodologies. Three machine learning-based approaches are introduced and assessed, comparing their efficiency with established techniques. The evaluation of these methodologies is conducted using a numerical model of a beam to simulate real-world scenarios. The results offer insights into the efficacy of machine learning in optimizing sensor placement, presenting an innovative perspective on enhancing the efficiency and precision of modal testing procedures in aerostructure design.

Ensuring optimal performance and reliability in rotor-bearing systems is crucial for industrial applications. Imbalance and shaft bow in these systems can lead to decreased efficiency and increased vibrations. Early detection and mitigation of a rotor’s faults are essential, and model-based fault identification has gained much attention in the manufacturing industry for years. Over the past two decades, however, the development of fault diagnosis rules with data-driven and artificial intelligence (AI) has become a trend, and in the foreseeable future, AI combined with big data will become mainstream. Nevertheless, the critical role of rotating machinery in manufacturing introduces a challenge, as the availability of fault data is often insufficient. This limitation renders the establishment of diagnostic rules using data-driven methods and AI technologies impractical. In light of these challenges, this study proposes a novel hybrid approach, that combines a physical model with machine learning (ML) techniques for the diagnosis of multi-faults (imbalance and shaft-bow demonstrated) in a Jeffcott rotor. To overcome the lack of real-world faulted, labeled datasets, a physics-based Jeffcott rotor model is first derived and then used to generate abundant fault datasets for ML. Subsequently, simulated data are employed for the training of an artificial neural network (ANN), enabling the network to learn from and analyze the vast array of generated data. The results prove that a well-trained feed-forward neural network (FNN) can accurately isolate and diagnose the imbalance and shaft-bow faults using the simulated data and the real data from the Jeffcott rotor experiment. These physics-based and ML approaches prove effective particularly for multi-fault, offering new possibilities for advanced rotor system monitoring and maintenance strategies in industrial applications.

The value of artificial intelligence and machine learning applications for use in heritage research is increasingly appreciated [1]. In specific areas, notably remote sensing, data sets have increased in extent and resolution to the point that manual interpretation is problematic and availability of skilled interpreters to undertake such work is limited. Interpretation of geophysical data sets associated with prehistoric submerged landscapes is particularly challenging. Following the last glacial, sea levels rose 120 metres globally, and vast, habitable landscapes were lost to the sea. These landscapes were inaccessible until extensive remote sensing data sets were provided by the offshore energy sector. In this paper, we provide results of a research programme centred on AI applications using data from the southern North Sea. Here, an area of c.188,000 km2 of habitable terrestrial land was inundated between c. 20,000 BP and 7,0000 BP, along with the cultural heritage it contained [2]. As part of this project, machine learning tools were applied to detect and interpret features of archaeological significance from shallow seismic data. The output provides a proof-of-concept model demonstrating verifiable results and the potential for further, more complex leveraging of AI interpretation for the study of submarine palaeolandscapes. Image: Adobe Firefly Generative AI using keywords - marsh landscape deep underwater, auroch skull half-buried in peat

When dealing with limited sample sizes or missing values in time series data, achieving high accuracy in forecasting becomes challenging. This challenge is particularly common in wind energy forecasting, where many wind farms lack complete data. In this paper, we employ the widely-used ARIMA (Autoregressive Integrated Moving Average) model for time series forecasting. To address the difficulties posed by limited sample sizes and missing values, we adopt a unique approach by utilizing multiple ARIMA models for different datasets. A key distinction from other multiple models methods for time series forecasting lies in each model within our approach using its own dataset, making the fusion process more intricate. To overcome this, we incorporate neural networks and two techniques for model fusion: direct fusion with a learning mechanism and compensation for missing data through training. For each ARIMA model, we introduce a noise estimation method to circumvent the white noise assumptions inherent in ARIMA models. Finally, we apply these methods to wind energy prediction, and our experimental results showcase a significant enhancement in forecasting accuracy.