Machine performance modeling and optimization have emerged as crucial steps for process enhancement and efficiency. This study explored machine learning to model and optimize the cassava grating chamber of cassava grater for the quality production of gari. This domain remains unexplored thus far. A total of 196 graters were studied. Key variables studied included tooth diameter (TD), tooth height (TH), inter-tooth spacing (ITS), drum speed (DS), clearance (C), and moisture content of cassava (MC). Geometric mean diameter (GMD) represented mash quality. Feature importance rankings emphasized TH (0.488784), C (0.243284), TD (0.112682), ITS (0.103547), DS (0.036261), and MC (0.015442) in determining particle size (GMD) of grated mash. Machine learning models efficiently interpreted these attributes, including gradient boost regressor, linear regression, neural network, and random forest. The gradient boost regressor was the best predictive model, achieving 95.34% accuracy, RMSE (0.3291), and MAE (0.2303). The study provides a GMD predictive equation and optimized parameters for specific gari size production, offering valuable insights for tailored machinery in the cassava grating activity.

A crucial aspect in developing machine learning algorithms (or any type of predictive models) is the comparison of different algorithmic candidates based on evaluation criteria that measure their accuracy and practical value in terms of successfully capturing the complexity of the underlying problem and generalizing in a wide range of real-world scenarios. In the domain of diabetes mellitus machine learning techniques are widely employed in the prediction of future values of glucose concentration in the blood in order to assist the patient in avoiding deviations from the normo-glycemic value range and the consequences of hyper- and hypoglycemia. In the relative literature there is an apparent lack of a uniformly adopted evaluation metric which could combine the clarity and direct comparative nature of statistical mathematical formulas dealing with prediction error residuals (e.g., the RMSE) with the clinical insights and the visual-qualitative approach of clinical evaluation tools (e.g., Clarke's EGA). Mean Adjusted Exponent (MADEX) error metric, proposed in this paper, attempts to address this need by providing a validation tool based on an easy to implement mathematical formula, that incorporates adjustable parameters of clinical significance.

Type 2 diabetes mellitus (T2DM) is a chronic metabolic disorder characterized by elevated blood glucose levels. Despite the availability of pharmacological treatments, dietary plans, and exercise regimens, T2DM remains a significant global cause of mortality. Consequently, there is a growing interest in exploring lifestyle interventions, such as Intermittent Fasting (IF). This study aims to identify underlying patterns and principles for effectively improving T2DM risk parameters through IF. By analyzing data from multiple randomized clinical trials investigating various IF interventions in humans, a machine learning algorithm was employed to develop a personalized recommendation system. This system advises pre-diabetic and diabetic individuals on the most suitable IF interventions to improve T2DM risk parameters. With a success rate of 95%, this recommendation system offers highly tailored guidance, optimizing intermittent fasting's benefits for diverse population subgroups. The results of this study allow us to conclude that weight is the crucial feature for females, while age is the determining factor for males to reduce glucose levels in blood. By revealing patterns in diabetes risk parameters among individuals, this study not only provides practical guidance but also sheds light on the underlying mechanisms of T2DM, contributing to a deeper understanding of this complex metabolic disorder.

Stripe rust ​​(caused by Puccinia striiformis f. sp. tritici) is one of the most devastating diseases of wheat and causes large-scale epidemics and severe yield loss. Applying fungicides during early epidemic development is crucial to controlling the disease but is often challenged by resource-limited human visual scouting. Deep learning has the potential to process images and videos captured from affordable devices to empower high-throughput phenotyping for early detection of stripe rust for timely application of fungicides and improve control efficiency. Here, we developed RustNet, a neural network-based image classifier, for efficiently monitoring fields for stripe rust. RustNet was built on a ResNet-18 architecture pre-trained with ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) dataset using transfer learning. RGB images and videos of multiple wheat fields with different wheat types (winter and spring wheat), conditions (irrigated and non-irrigated), and locations were acquired using smartphones or unmanned aerial vehicles near the canopy. A semi-automated image labeling approach was conducted to improve labeling efficiency by combining automated machine labeling and human correction. Cross-validations across multiple categories (sensor platforms, wheat types, and locations) achieved Area Under Curve from 0.72 to 0.87. Independent validation on a published dataset from Germany achieved accuracies ranging from 0.79 to 0.86. The visualization of the last convolutional layer of RustNet demonstrated the identification of pixels with stripe rust. RustNet is freely available at https://zzlab.net/RustNet.

This article explores the application of machine learning techniques, specifically focusing on ensemble methods like Random Forests, for detecting fraudulent activities in digital financial transactions. Highlighting the evolution from traditional statistical approaches to modern machine learning models, it underscores the effectiveness of Random Forests in handling the inherent challenges of imbalanced datasets typical in fraud detection scenarios. Using a Kaggle dataset of credit card transactions, the study optimizes Random Forest parameters through rigorous parameter tuning, achieving significant improvements in model performance metrics such as Area Under the Curve (AUC). The findings underscore the critical role of machine learning in enhancing fraud detection capabilities, emphasizing the ongoing evolution and future potential of these methodologies in financial risk management.

Traffic accidents are among the most common causes of death worldwide. According to statistics from the World Health Organization (WHO), 50 million people are involved in traffic accidents every year. Canada, particularly Montreal, is not immune to this problem. Data from the Société de l’Assurance Automobile du Québec (SAAQ) shows that there were 392 deaths on Québec roads in 2022, 38 of them related to the city of Montreal. This value represents an increase of 29.3% for the city of Montreal compared to the average for the years 2017 to 2021. In this context, it is important to take concrete measures to improve traffic safety in the city of Montreal. In this article, we present a web-based solution based on machine learning that predicts the severity of traffic accidents in the city of Montreal. This solution uses dataset of traffic accidents that occurred in Montreal between 2012 and 2021. Classification algorithms such as eXtreme Gradient Boosting (XGBoost), Categorical Boosting (CatBoost), Random Forest (RF) and Gradient Boosting (GB) were used to develop the prediction model. When evaluating the prediction model, performance metrics such as precision, recall, F1 score, and accuracy are taken into account. The performance analysis shows an excellent accuracy of 96% for the prediction model based on the XGBoost classifier. The other models (CatBoost, RF, GB) achieved 95%, 93% and 89% accuracy, respectively. The prediction model based on the XGBoost classifier was deployed using a client-server web application managed by Swagger-UI and the Flask Python framework.

Applying the iterative methodology for dimensionality reduction/feature selection using categorical gradient boosted trees, as it has been defined in and has been successfully applied on similar datasets in and , on a dataset consisted of 12708 gene expressions coming from 5052 individuals from 105 studies, we classify whether a person has acute myeloid leukaemia (AML) or is healthy. A CatBoost model on a dataset with reduced dimensions of 72 genes reached a ROC-AUC score of 0.9973 using ten fold cross validation (10CV) and ROC-AUC: 0.9988 on an inference dataset. We further investigate the options of using less genes that potentially could be used in clinical practise and genes than have not been associated to AML yet, or to blood cancer in general. On the same folds of the 10CV and on the same inference dataset the performance of the tuned CatBoost models show that it could be the case that not all genes with an association to AML have been found yet and 19 genes could be enough to predict AML: CatBoost63 (ROC-AUC: 0.9941, Test: 0.9942), CatBoost19: (ROC-AUC: 0.9946, Test: 0.9941) and CatBoost15: (ROC-AUC: 0.9922, Test: 0.9900). In addition, our results verify that a gene diagnostic test for AML could be possible in the future as well as further research is needed on these 15 genes that it could lead to new and better drugs.

Tight gas, a category of Deep Green Energy Resources, rely on advanced intelligent monitoring methods for their extraction. Conventional logging for reservoir evaluation relies on logging data and the manual setting of evaluation criteria to classify reservoirs. However, the complexity and heterogeneity of tight reservoirs pose challenges in accurately identifying target layers by using traditional well-logging techniques. Machine learning may hold the key to solving this problem, as it enables computers to learn without being explicitly programmed and manually added rules. Therefore, it is possible to make reservoir evaluation via using machine learning methods. In this paper, the reservoir quality index (RQI) and porous geometric parameters obtained from the optimized inversion of the spherical-tubular model are adopted to evaluate the reservoir. Then, three different machine learning approaches, the random forest (RF) algorithm, support vector machine (SVM) algorithm, and extreme gradient boosting (XGB) algorithm, are utilized for reservoir classification. The selected dataset covers more than 7,000 samples from five wells. The data from four wells are arranged as the training dataset, and the data of the remaining one well is designed as the testing dataset to calculate the prediction accuracies of different machine learning algorithms. Among them, accuracies of RF, SVM, and XGB are all higher than 90%, and XGB owns the highest result by reaching 97%. Machine learning based approaches can greatly assist reservoir prediction by implementing the well-logging data. The research highlights the application of reservoir classification with a higher prediction accuracy by combining machine learning algorithms with NMR logging based pore structure characterization, which can provide a guideline for sweet spot identification within the tight formation. This not only optimizes resource extraction but also aligns with the global shift towards clean and renewable energy sources, promoting sustainability and reducing the carbon footprint associated with conventional energy production. In summary, the fusion of machine learning and NMR logging based reservoir evaluation plays a crucial role in advancing both energy efficiency and the transition to cleaner energy sources.

Cancer metastasis accounts for approximately 90% of cancer deaths, and elucidating markers in metastasis is the first step in its prevention. To characterize metastasis marker genes of breast cancer (MGs), XGBoost models that classify metastasis status were trained with gene expression profiles from TCGA. Then, a metastasis score (MS) was assigned to each gene by calculating the inner product between the feature importance and AUC performance of the models. As a result, the 54, 202, and 357 genes with the highest MS were characterized as MGs by empirical P-value cutoffs of 0.001, 0.005, and 0.01, respectively. The three sets of MGs were compared with those from existing metastasis marker databases, which provided significant results in most comparisons. We noticed that the set of MGs with the median EP cutoff showed better performance than the other two sets, suggesting the importance of the cutoff used in determining MGs. They were also significantly enriched in biological processes associated to breast cancer metastasis. The MGs that could not be identified by statistical analysis (e.g., GOLM1, ELAVL1, UBP1, and AZGP1) as well as the MGs with the highest MS (e.g., ZNF676, FAM163B, LDOC2, IRF1, and STK40) were verified via the literature. Additionally, we checked how close the MGs are located to each other in the protein–protein interaction networks. We expect that the characterized markers will help understand and prevent breast cancer metastasis.

The fusion of machine learning, biomedical, and bioengineering research offers novel ways to understand, diagnose, and treat various health conditions. However, the complexities of biomedical and bioengineering data, coupled with the intricate process of developing and deploying machine learning solutions, often pose significant challenges to researchers in these fields. We introduce a new Automatic Semantic Machine Learning Microservice Framework (AIMS) that addresses these challenges by automating key aspects of the machine learning pipeline, from data preprocessing to model evaluation. Our proposed framework emphasizes model interpretability, the integration of domain knowledge, and the efficient handling of biomedical data. Furthermore, it incorporates self-supervised knowledge learning strategies, enabling the automatic generation, optimization, and continuous adaptation of machine learning models in response to new tasks and data. We illustrate the potential of our framework through three case studies in biomedical research, showcasing its capacity to streamline research processes, improve scientific exploration quality, and provide a foundation for significant breakthroughs.

Unmanned Aerial Vehicles (UAV) are increasingly being used in a variety of domains and precision agriculture is no exception. Precision agriculture is the future of agriculture and will play a key role in long-term sustainability of agricultural practices. This paper presents a survey of how image data collected using UAVs has been used in conjunction with ma-chine learning techniques to support precision agriculture. Numerous agricultural applications including classification of crop types and trees, crops detection, weed detection, cropland cover, and segmentation of farming fields are discussed. A variety of supervised, semi-supervised and unsupervised machine learning techniques for image-based preci-sion agriculture are compared. The survey showed that for traditional machine learning approaches, Random Forests performed better than Support Vector Machines (SVM) and K-Nearest Neighbor Algorithm (KNN) for crop/weed classification. And, while Convolutional Neural Networks (CNN) have been used extensively, the U-Net-based models out-performed conventional CNN models for classification and segmentation tasks. Among the Single Stage Detectors (SSD), YOLO series performed relatively well. Two-Stage Detectors like R-CNN, FPN, and Mask R-CNN generally tended to outperform SSDs. Vision Trans-formers (ViT) showed promising results amongst transformer-based models which did not generally perform better than CNNs. Finally, Generative Adversarial Networks (GANs) have been used to address the problem of smaller datasets and unbalanced data

The cost to train a basic qualified U.S. Navy fighter aircraft pilot is nearly $10M. The training includes primary, intermediate, and advanced stages, with the advanced stage involving extensive flight training and being very expensive as a result. Despite the screening tests in place and early-stage attrition taking place, 4.5% of aviators undergo attrition in this most expensive stage. Key reasons for aviator attrition include poor flight scores, voluntary withdrawals, and medical causes. Reduction in late-stage attrition offers several financial and operational benefits to the U.S. Navy. To that end, this research leverages feature extraction and machine-learning techniques on the very sparse flight test grades of student aviators to identify those with a high risk of attrition early in training. Using about 10 years of historical U.S. Navy pilot training data, trained models accurately predicted 50% of attrition with a 4% false positive rate. Such models could help the U.S. Navy save nearly $20M a year in attrition costs. In addition, machine-learning models were trained that can recommend a suitable training aircraft type for each student aviator. These capabilities could help better answer the need for pilots and reduce the time and cost to train them.

Wearable sensors have the potential to enable comprehensive patient characterization and optimized clinical intervention. Critical to realizing this vision is accurate estimation of biomechanical time-series in daily-life, including joint, segment, and muscle kinetics and kinematics, from wearable sensor data. The use of physical models for estimation of these quantities often requires many wearable devices making practical implementation more difficult. However, regression techniques may provide a viable alternative by allowing the use of a reduced number of sensors for estimating biomechanical time-series. Herein, we review 46 articles that used regression algorithms to estimate joint, segment, and muscle kinematics and kinetics. We present a high-level comparison of the many different techniques identified and discuss the implications of our findings concerning practical implementation and further improving estimation accuracy. In particular, we found that several studies report the incorporation of domain knowledge often yielded superior performance. Further, most models were trained on small datasets in which case nonparametric regression often performed best. No models were open-sourced, and most were subject-specific and not validated on impaired populations. Future research should focus on developing open-source algorithms using complementary physics-based and machine learning techniques that are validated in clinically impaired populations. This approach may further improve estimation performance and reduce barriers to clinical adoption.

Medical brain image analysis is a necessary step in the Computers Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 documents we selected 38 articles that deal with the main objectives of this study. Based on the analysis and discussion of the revised documents, there is constant growth in the research and proposal of new models of deep learning to achieve the highest accuracy and reliability of the segmentation of ischemic and demyelinating lesions. Models with indicators (Dice Score, DSC: 0.99) were found, however with little practical application due to the uses of small datasets and lack of reproducibility. Therefore, the main conclusion is to establish multidisciplinary research groups to overcome the gap between CAD developments and their complete utilization in the clinical environment.

The valorization and dissolution of lignin using ionic liquids (ILs) is critical for developing sustainable biorefineries and a circular bioeconomy. This review aims to critically assess the current state of computational and machine learning methods for understanding and optimizing IL-based lignin dissolution and valorization processes reported since 2022. The paper examines various computational approaches, from quantum chemistry to machine learning, highlighting their strengths, limitations, and recent advances in predicting and optimizing lignin-IL interactions. Key themes include the challenges in accurately modeling lignin’s complex structure, the development of efficient screening methodologies for ionic liquids to enhance lignin dissolution and valorization processes, and the integration of machine learning with quantum calculations. These computational advances will drive progress in IL-based lignin valorization by providing deeper molecular-level insights and facilitating the rapid screening of novel IL-lignin systems.

Objective: Despite long simulation times, recently developed finite element analysis (FEA) models of knee joints have demonstrated their suitability for predicting individual risk of onset and progression of knee osteoarthritis. Therefore, the objective of this study was to assess the feasibility of machine learning (ML) to replicate outcomes obtained from FEA when simulating mechanical responses and predicting cartilage degeneration within knee joint. Design: Two ML models based on the Gaussian Process Regression (GPR) algorithms were developed. The first model (GPR1) utilized age, weight, and anatomical joint dimensions as predictor variables to predict tissue mechanical responses and cartilage degeneration based on FEA data. The second model (GPR2) utilized age, weight, height, and gender to predict anatomical joint dimensions, which were then used as inputs in the GPR1 model. Finally, the GPR1 and combined GPR1+GPR2 models were used to investigate the importance of clinical imaging when making personalized predictions for knees from healthy subjects with no history of knee injuries. Results: In the GPR1 model, R2 of 0.9 was exceeded for most of the predicted mechanical parameters. The GPR2 model was able to predict knee shape with R2 of 0.67 - 0.9. Both GPR1 and combined GPR1+GPR2 models offered equally good performance (AUC = 0.73 - 0.74) at classifying patients at high risk for the onset and development of knee osteoarthritis. Conclusions: In the future, real-time and easy-to-use GPR models may provide a rapid technology to evaluate mechanical responses within knee for researchers or clinicians who have no former knowledge from FEA.

Cardiovascular disease (CVD) and obesity are prevalent public health concerns with grave implications for morbidity and mortality, necessitating tailored interventions. This research explores the utility of fuzzy c-means clustering paired with principal component analysis (PCA) in detecting at-risk groups and personalizing health strategies for these conditions. Fuzzy c-means clustering allows for the dynamic classification of individuals into groups based on unique risk factors and intervention outcomes, while PCA aids in distilling complex data sets to uncover underlying patterns. The conjoined use of these methods has shown promise in identifying diverse risk profiles and in forecasting intervention success rates. The study acknowledges limitations, including possible biases stemming from data set composition and analytical parameter selection. Future research aims to refine these tools for clinical application. The results support implementing fuzzy c-means clustering and PCA for delineating specific target populations for health interventions, emphasizing careful use of these analytical approaches. Subsequent studies should focus on correlating these techniques with concrete clinical results to enhance public health measures.

Some optimal control problems need metaheuristics in searching for the optimal solution, especially when the process has certain characteristics like the Photobioreactor for Algae Growth (distributed parameter, nonlinearities, etc.). Particle Swarm Optimization (PSO) algorithms within control structures are a realistic approach; their task is often to predict the optimal control values working with a process model (PM). Owing to numerous numerical integrations, there is a big computational effort that is reflected in a large controller execution time. The authors propose to replace the PSO predictor with a machine learning model that has “learned” the quasi-optimal behavior of the couple (PSO, PM); the training data is obtained through closed-loop simulations over the control horizon. The new controller should preserve the process’s quasi-optimal control. In identical conditions, the process evolutions must also be quasi-optimal. The multiple Linear Regression and the Regression Neural Networks were considered as predicting models. The paper first proposes algorithms for collecting and aggregating data sets for the learning process. Algorithms for constructing the machine learning models, implementing the controllers, and closed-loop simulations are also proposed. The simulations prove that the two machine learning predictors have learned the PSO predictor’s behavior such that the process evolves almost identically. The resulting controllers’ execution time drastically decreased while keeping their optimality.

Myofascial Pain Syndrome (MPS) is a prevalent chronic pain disorder characterized by myofascial trigger points (MTrPs). Current diagnosis relies on manual detection of MTrPs, which has low inter-rater reliability. This study aims to enhance diagnosis through machine learning (ML) and a combination of texture-features extracted from B-mode ultrasound (B-mode-US) images. Four texture-features were investigated: statistical-features, and their combination with Gabor, local binary (LBP), and SEGL, LBP + gray-level-co-occurrence-matrices + Edge for the classification of MTrPs on the B-mode-US images. B-mode-US images of trapezius muscles (n=90) were examined for MTrPs and healthy muscle. Three methods of LBP, SEGL, and Gabor were separately calculated for each B-mode-US image. Then, the statistical-features (e.g., entropy) were calculated over the B-mode-US images and those three methods. Seven Machine learning (ML) classifiers (e.g., neural network) with the calculated statistical-features were applied to discriminate MTrPs from healthy muscle. Additionally, traditional statistical analysis (i.e., ANOVA) was calculated between statistical-features within each method. The results indicated that the combination of statistical-features effectively discriminated between MTrPs and healthy muscles, based on traditional statistical analysis. However, ML classifiers struggled due to high variation and similar mean values among them. This discrepancy between them prompts further exploration of US texture-based automated ML for MTrPs diagnosis.

The aim of this study was to create a novel machine learning (ML) algorithm for predicting the post-pubertal mandibular length and Y-axis in females. Cephalometric data from 176 females with Angle Class I occlusion were used to train and test 7 ML algorithms. For all ML methods tested, the mean absolute errors (MAEs) for the 2-year prediction ranged from 2.78-5.40 mm and 0.88-1.48 degrees, respectively. For the 4-year prediction, MAEs of mandibular length and Y-axis ranged from 3.21-4.00 mm and 1.19-5.12 degrees, respectively. The most predictive factors for post-pubertal mandibular length were mandibular length at previous timepoints, age, sagittal positions of the maxillary and mandibular skeletal bases, mandibular plane angle, and anterior and posterior face heights. The most predictive factors for post-pubertal Y-axis were Y-axis at previous timepoints, mandibular plane angle, and sagittal positions of the maxillary and mandibular skeletal bases. ML methods were identified as capable of predicting mandibular length within 3 mm, and Y-axis within 1 degree. Compared to each other, all of the ML algorithms were similarly accurate, with the exception of MLP regressor.

Fatigue cracks in a wide array of industrial components and structures pose a significant threat to their integrity. Detecting fatigue cracks using ultrasonic inspection techniques is a widespread activity for economic reasons but there are limitations to the techniques due to the morphology of fatigue cracks. In addition to detection there is a need to measure the size of the cracks which are often within the volume of the material. Ultrasonic techniques are well-suited to look inside the volume of the material but achieving sufficient sensitivity to the tip of the cracks in particular is practically difficult. Without an accurate knowledge of where the tip of the crack lies there can be significant uncertainty in sizing measurements. Machine Learning (ML) techniques are being developed to aid in the inspection and monitoring tasks but presenting the ultrasonic data in a suitable way for machine learning is very important. This paper presents a new approach to condition the ultrasonic data for machine learning settings so that they can be used effectively and confidently to detect and size fatigue cracks. The new approach, using images termed parameter-spaces, will also aid in conventional inspections as they are able to give information to human operators as to the existence or not of these very dangerous cracks.

Breast cancer is the leading cause of cancer deaths worldwide in women. This aggressive tumour can be categorized into two main groups: in situ and infiltrative, with the latter being the most common malignant lesions. The current use of Magnetic Resonance Imaging (MRI) was shown to provide highest sensitivity in the detection and discrimination between benign vs. malignant lesions, when interpreted by expert radiologists. In this article, we present the prototype of a Computer-Aided Detection/Diagnosis (CAD) system that could provide valuable assistance to the radiologist for the discrimination between in situ and infiltrating tumours. The system consists of two main processing levels: 1) Localization of possibly tumoral regions of interest (ROIs) through an iterative procedure based on intensity values (ROI Hunter) followed by a deep-feature extraction and classification method for false-positive rejection; 2) Characterization of the selected ROIs and discrimination between in situ and invasive tumour, consisting of Radiomics feature extraction and classification through a machine-learning algorithm. The CAD system was developed and evaluated using a DCE-MRI image database, containing at least one confirmed mass per image, as diagnosed by an expert radiologist. When evaluating the accuracy of the ROI Hunter procedure with respect to the radiologist-drawn boundaries, sensitivity to mass detection was found to be 75%. The AUC of the ROC curve for discrimination between in situ and infiltrative tumors was 0.70.

ABSTRACT Background It is important to be able to predict, for each individual patient, the likelihood of later metastatic occurrence, because the prediction can guide treatment plans tailored to a specific patient to prevent metastasis and to help avoid under- or over-treatment. Deep Neural Network (DNN) learning, commonly referred to as deep learning, has become popular due to its success in image detection and prediction, but questions such as whether deep learning outperforms other machine learning methods when using non-image clinical data remain unanswered. Grid search has been introduced to deep learning hyperparameter tunning for the purpose of improving its prediction performance, but the effect of grid search on other machine learning methods are under-studied. In this research, we take the empirical approach to study the performance of deep learning and other machine learning methods when using non-image clinical data to predict the occurrence of breast cancer metastasis (BCM) 5, 10, or 15-years after the initial treatment. We developed DNN models as well as models using 9 other machine learning methods including Naive Bayes (NB), Logistic Regression (LR), Support Vector Machine (SVM), LASSO, Decision Tree (DT), k-Nearest Neighbors (KNN), Random Forrest (RF), AdaBoost (ADB), and XGBoost (XGB). We used grid search to tune hyperparameters for all methods. We then compared the deep learning models to the models trained using the 9 other machine learning methods. Results Based on the mean test AUC results, DNN ranks 6th, 4th, and 3rd when predicting 5-year, 10-year, and 15-year BCM respectively, out of 10 machine learning methods. The top performing methods in predicting 5-year BCM are XGB(1^st), RF(2^nd), and KNN(3^rd). For predicting 10-year BCM the top performers are XGB (1^st), RF(2^nd), and NB(3^rd) . Finally, for 15-year BCM the top performers are SVM (1^st), LR and LASSO (tied for 2^nd), and DNN (3^rd). The ensemble methods RF and XGB outperform other methods when data are less balanced, while SVM, LR, LASSO, and DNN outperform other methods when data are more balanced. Our statistical testing results show that at a significance level of 0.05 DNN overall performs no worse than other machine learning methods when predicting 5-year, 10-year, and 15-year BCM. Conclusions Our results show that deep learning with grid search overall performs at least as well as other machine learning methods when using non-image clinical data. It is interesting to note that some of the other machine learning methods such as XGB, RF, and SVM are very strong competitors of DNN when incorporating grid search. It is also worth noting that the computation time required to do grid search with DNN is way more than that required to do grid search with the other 9 machine learning methods.

This paper presents a real-time eye blink detection system using computer vision techniques and machine learning. The system uti- lizes the MediaPipe face mesh model for facial landmark detection and calculates the Eye Aspect Ratio (EAR) to determine the eye state. Results demonstrate high accuracy and responsiveness, indicating po- tential applications in driver drowsiness detection, human-computer interaction, and medical diagnostics.

In the industrial sector, intelligent sensors in fault diagnosis are becoming more critical in recent technological improvements. The prediction accuracy can be enhanced in fault diagnosis using 3-dimensional, sequential, real-time, and image data. Sensors that capture the vibration, sound, and image data are more critical in predicting unbalancing, tool wear, crack, misalignment, etc, in the rotating machinery to increase productivity and to provide an effective maintenance management system. Due to the fast development of industry 4.0 techniques, monitoring of mechanical machinery is experiencing explosive growth and getting more attention in the area of fault diagnosis (FD). Machine learning and Deep learning methods give promising results and accuracy in predicting faults in rotating machinery on shop floors. The success of AI-based models is due to the availability of comprehensive labeled data. Federated Learning (FL) is the machine learning subfield aiming to train an algorithm with a heterogeneous dataset. Data transmission from local facilities to a central server in AI models creates data privacy and security issues. Heterogeneous data analysis is a complicated process in predicting the machine fault in the central server because of millions of data during real-time condition monitoring. Decentralized data handling and analysis is mandatory in condition monitoring because of heterogeneity in data processing, data privacy, and security advantages. The application of federated learning in fault diagnosis has been getting more attention in recent days, and this study is a review of FL applications that address fault diagnosis in rotating machinery in the first phase. A comparison between the types of FL approaches in FD and the use of aggregation algorithms and their applications will also be discussed in Phase 1. In phase 2, a novel methodology has been proposed using Federated learning to diagnose rotating machinery faults. The proposed method, FLOACOS, addresses how prediction challenges are solved using federated learning approaches by optimizing and standardizing the data at local facilities. This work will be helpful for future condition monitoring researchers and gives an overview of a novel method of the FL technique used in predicting faults and the progress made in the maintenance management of rotating machinery.

Machine learning and computer vision have proven to be valuable tools for farmers to streamline their resource utilization to lead to more sustainable and efficient agricultural production. These techniques have been applied to strawberry cultivation in the past with limited success. To build on this past work, in this study two separate sets of strawberry images, along with their associated diseases, were collected and subjected to, resizing, and augmentation. Subsequently, a combined dataset consisting of 9 classes was utilized to fine-tune three distinct pre-trained models: Vision Transformer (ViT), MobileNetV2, and ResNet18. To address the imbalanced class distribution in the dataset, each class was assigned weights to ensure nearly equal impact during the training process. To enhance the outcomes, new images were generated by removing backgrounds, reducing noise, and flipping them. The performances of ViT, MobileNetV2, and ResNet18 were compared after being selected. Customization specific to the task was applied to all three algorithms, and their performances were assessed. Throughout this experiment, none of the layers were frozen, ensuring all layers remained active during training. Attention heads were incorporated into the first 5 and last 5 layers of MobileNetV2 and ResNet18, while the architecture of ViT was modified. The results indicated accuracy factors of 98.4%, 98.1%, and 97.9% for ViT, MobileNetV2, and ResNet18, respectively. Despite the data being imbalanced, the precision, which indicates the proportion of correctly identified positive instances among all predicted positive instances, approached nearly 99% with the ViT. MobileNetV2 and ResNet18 demonstrated similar results. Overall, the analysis revealed that the Vision Transformer model exhibited superior performance in strawberry ripeness and disease classification. The inclusion of attention heads in the early layers of ResNet18 and MobileNet18, along with the inherent attention mechanism in ViT, improved the accuracy of image identification. These findings offer the potential for farmers to enhance strawberry cultivation through passive camera monitoring alone, promoting the health and well-being of the population.

With the exponential growth of machine learning and development of Artificial Neural Network (ANNs) in recent years, there is great opportunity to leverage this approach and accelarate bio-logical discoveries through applications on the analysis of bioinformatics data. Various types of datasets including for example protein or gene interaction networks, molecular structures and cellular signalling pathways, have already been used for machine learning by training ANNs for inference and pattern classification. However, unlike regular data structures that are commonly used in the computer science and engineering fields, bioinformatics datasets present challenges that require unique algorithmic approaches. The recent development of the geometric and deep learning approach within the machine learning field, is very promising towards accelerating analysis complex bioinformatics datasets. The principles of ANNs and their importance for bio-informatics machine learning is demonstrated herein, through presentation of the undelying mathematical and statistical foundations from group theory, symmetry, linear algebra. Further-more, the structure and functions of ANN algorithms that form the core principles of artificial intelligence are explained, in relation to the bioinformatics data domain. Overall, the manuscript provides guidance for researchers to understand the principles required for practicing machine learning and artificial intelligence, with the special considerations towards bioinformatics applications.

Detailed flow distributions in vascular systems are the key to identifying hemodynamic risk factors for the development and progression of vascular diseases. Although computational fluid dynamics (CFD) has been widely used in bioengineering research on hemodynamics predictions, not only are high-fidelity CFD simulations time-consuming and computing-expensive, but also not friendly to clinical applications due to the difficulty of comprehensive numerical calculations. Machine learning (ML) algorithums to estimate the flow field in vascular systems based on the angiographic images of the blood flow using existed diagnostic tools are emerging as a new pathway to facilitate the mapping of hemodynamics. In present work, the dye injection in a water flow was simulated as an analogy of the contrast perfusion in blood flow using CFD. In the simulation, the light passes through the flow field and generates projective images, as an analogy of X-ray imaging. The simulations provide both the ground truth velocity field and the projective images of the flow with dye patterns. A rough velocity field was estimated using the optical flow method (OFM) based on projective images. ML algorithums are then trained using the ground truth CFD data and the OFM velocity estimation as the input. Finally, the interpretable (logistic regression) and deep (neural networks, convolutional neural networks, long short term memory) machine learning models are validated by using parallel in vitro experiments on the same flow setup. The validation results showed that the employed ML model significantly reduced the error rate from 53.5% to 2.5% in average for the v-velocity estimation.

This paper reviews the multiple roles of machine learning in improving the resilience of power grids, especially in applying new energy storage technologies. Energy storage technologies, such as compressed air energy storage, flywheel energy storage, and superconducting coil energy storage, significantly improve the power grid's ability to respond to load fluctuations and emergencies through intelligent control and optimisation of machine learning algorithms. This not only helps to optimise energy dispatch and improve the operational efficiency and flexibility of the grid but also significantly improves the stability and reliability of the grid so that it is better able to meet future challenges and needs.

An important indicator of human-related pollution in watersheds is dissolved oxygen (DO). The DO is highly dependent on both space and time characteristics of the watershed and is directly linked to eutrophication, which impairs the development of both the aquatic fauna and flora, also negatively impacting the water quality. Aspiring to reach a more accurate and precise forecasting approach to predict levels of DO, the present work proposes new graph-based and transformer-based deep learning models. The models were trained and validated for the Credit River Watershed, and the results were compared with both benchmarking and literature-found approaches. The proposed Graph Neural Network Sample and Aggregate (GNN-SAGE) model was the best-performing approach, reaching coefficient of determination (R2) and Root Mean Squared Error (RMSE) values of 97% and 0.34 ppm, respectively. The findings from the Shapley additive explanations (SHAP) indicated that the GNN-SAGE benefited from spatiotemporal information from the surrounding stations, improving the model’s results, and that temperature is a major input attribute for determining future DO levels. The results established that the proposed GNN-SAGE model stands as a state-of-the-art solution for DO forecasting, with potential for real-time water quality applications.

The combination of wet-lab experimental data on multi-site combinatorial mutations and machine learning is an innovative method in protein engineering. In this study, we present an improved innovative sequence–activity relationship (innov'SAR) methodology based on novel descriptors and digital signal processing (DSP) to construct a predictive model. In this improved approach, 21 experimental (R)-selective amine transaminases from Aspergillus terreus (AT-ATA) were used as an input to predict higher thermostability than that predicted using the existing data. We successfully improved the determination coefficient (R2) of the model from 0.66 to 0.92. In addition, root mean square deviation (RMSD) and root mean square fluctuation (RMSF) were estimated and conformation analysis based on molecular dynamics simulations was performed to verify the enhanced thermal stability of the screened mutants. The improved innov'SAR algorithm enhanced the predictive accuracy, suggesting a method for modifying the stability of AT-ATA, which may help in directed evolutionary screening and open up new avenues for protein engineering.

ABSTRACT Background Ubiquitination plays an important role in protein post-translational processes and has been found to be involved in a number of regulatory functions including proteasome degradation, DNA repair, transcription, signal transduction, endocytosis, and sorting. As the identification of ubiquitination site is critical to furthering our understanding of the mechanism of ubiquitination, various experimental and machine learning methods have been used to conduct this task. It has been an important but challenging task to improve the accuracy of ubiquitination site prediction. In this research, we explore the possibility of improving the prediction performance of machine learning by incorporating grid search in the training process. Method We developed grid search procedures for each of six widely used machine learning methods including NB, LR, DT, SVM, LASSO, and KNN, and applied them to ubiquitination site prediction using the six PCP datasets that were previously developed. For each of the ML methods, we developed a set of values for each of the tunable hyperparameters available to the method. These sets of values then can be combined to form a large grid of hyperparameter settings, and each of these settings is used in the grid search. We integrated 5-fold cross-validation in grid search to train and test ML models and applied an additional independent validation procedure by conducting a pre-training 80-20 sample split. We evaluated the performance of the six methods by comparing them side by side for each of the six datasets. We also compared the grid search results with the results that were previously published without doing grid search. To optimize the prediction performance, we trained 1.1 million ML models in total through grid search. Results We compared the overall prediction performance of these six methods, as well as their prediction performance when working with balanced vs. imbalanced data, and large-scale vs. small-scale data. From the perspective of dataset, we find that the overall performance of every PCP dataset has been significantly improved in this study compared to the previous study, with the percentage increase of the average AUC of all six datasets ranging from 7.9% (PCP-4) up to 17.0% (PCP-1). From the perspective of method, we find that three out of four methods significantly benefit from grid search comparing to their previously published non-grid search results, with the maximum AUC improvement as high as 47% (LASSO on PCP-5), 43.3% (NB on PCP-1), and 33.7% (SVM on PCP-6). SVM overall ranks number one, followed by KNN as the number two performer based on their average AUCs on all datasets. But these two also ranked the top two (KNN 76 days and SVM 15 days) in terms of the total running time that they need to do grid search. We also find that SVM, KNN, and DT tend to handle small-scale and imbalanced datasets better, while LR, and LASSO are doing well with large-scale and balanced datasets. NB is more sensitive to data imbalance while less sensitive to the size of a dataset. Conclusions Our results show that using grid search has improved the performance of ubiquitination prediction significantly. We find that the performance of a method is closely related to its hyperparameter setting and the type of data it handles. Even though SVM is on average an outperformer, none of the methods can provide the best performance for all datasets. When sufficient computing resources are well accessible, grid search is an effective way to identify both a top performing model for a machine learning method and a suitable machine learning method for a particular dataset.

Early diagnosis, prioritization, screening, clustering and tracking of COVID-19 patients, and production of drugs and vaccines are some of the applications that have made it necessary to use a new style of technology to involve, to manage and deal with this epidemic. Strategies backed by artificial intelligence (AI) and the Internet of Things (IoT) have been undeniable to understand how the virus works and try to prevent it from spreading. Accordingly, the main aim of this survey article is to highlight the methods of ML, IoT and the integration of IoT and ML-based techniques in the applications related to COVID-19 from the diagnosis of the disease to the prediction of its outbreak. According to the main findings, IoT provided a prompt and efficient approach of following the disease spread. Most of the studies developed by ML-based techniques for handling COVID-19 based dataset provided performance criteria. The most popular performance criteria, is related to accuracy factor. It can be employed for comparing the ML-based methods with different datasets. According to the results, CNN with SVM classifier, Genetic CNN and pre-trained CNN followed by ResNet, provided highest accuracy values. On the other hand, the lowest accuracy was related to single CNN followed by XGboost and KNN methods.

Studies have shown that STK11 mutation plays a critical role in affecting the lung adenocarcinoma (LUAD) tumor immune environment. By training an Inception-Resnet-v2 deep convolutional neural network model, we were able to classify STK11-mutated and wild type LUAD tumor histopathology images with a promising accuracy (per slide AUROC=0.795). Dimensional reduction of the activation maps before the output layer of the test set images revealed that fewer immune cells were accumulated around cancer cells in STK11-mutation cases. Our study demonstrated that deep convolutional network model can automatically identify STK11 mutations based on histopathology slides and confirmed that the immune cell density was the main feature used by the model to distinguish STK11-mutated cases.

The violation of privacy, others people or personal, is a very current problem, which concerns not only on the web but also in private life. In the years 1990 it was expected that nowadays, that any routine operation was carried out "manually", and it would be performed through mobile phones or personal computers. The problem pertains the distribution network that allows to share and bring together information and as result the network becomes unsafe, if subjected to attacks. Nowaday we put personal information on web because otherwise we are seen as “weak”. This work aims to measure and analyze how much information are shared by users of a pre-established social network and it is carried out through a set of algorithms techniques of machine learning.

Artificial intelligence (AI), the wide spectrum of technologies aiming to give machines or computers the ability to perform human-like cognitive functions, began in the 40s with the first abstract models of intelligent machines. Soon later in the 50s and 60s machine learning algorithms such as neural networks and decision trees ignited large enthusiasm. More recent advancements include the refinement of learning algorithms, the development of convolutional neural networks to efficiently analyze images, and methods to synthesize new images. The renewed enthusiasm was also due to the increase in computational power with graphical processing units and the availability of large digital databases to be mined by neural networks. AI soon began to be applied in medicine, first through expert systems designed to support the clinician’s decision, and later with neural networks for the detection or classification of malignant lesions in medical images. More recently, the use of natural language processing, recurrent neural networks, transformers and generative models has both improved the capabilities of making an automated reading of medical images and moved AI to new domains, including text analysis of electronic health records, image self-labelling and self-reporting. Thanks to its versatility and impressive results and fueled by the availability of powerful computing resources and open-source libraries, AI is one of the most promising resources for frontier research and applications in medicine.

We assessed machine learning techniques (MLTs) for downscaling global climate model’s precipitation to local level in Bolivia. The skill, assumptions and uncertainty of the process are analyzed. Additionally, future projections are delivered. For that, an ensemble of 20 global climate models (GCMs) from CMIP6, with random forest (RF) and support vector machines (SVM), is used on four zones (highlands, Andean slopes, Amazon lowlands and Chaco lowlands). The downscaled series’ skill is evaluated in terms of relative errors. The uncertainty is analyzed through variance decomposition. MLTs’ skill is adequate in most cases, especially for the highlands and the Andean slopes. Moreover, RF tends to outperform SVM. Stationary assumptions are robust in the highlands and Andean slopes. Perfect prognosis assumption is poor in the highlands and Andean slopes; topographical complexity appears to be the reason. Regarding uncertainties, MLTs are the dominant source. In future projections, the highlands show shorter dry spell lengths with more frequent but less intense high rainfall events and higher annual rainfall. The Andean slopes exhibit an increased annual rainfall with a reduction in the high precipitation intensities but an increased frequency. The Amazon lowlands present a decrease in annual rainfall, and the Chaco lowlands an increase.

The combination of medical imaging and deep learning has significantly improved diagnostic and prognostic capabilities in the healthcare domain. Nevertheless, the inherent complexity of deep learning models poses challenges in understanding their decision-making processes. Interpretability and visualization techniques have emerged as crucial tools to unravel the black-box nature of these models, providing insights into their inner workings and enhancing trust in their predictions. This survey paper comprehensively examines various interpretation and visualization techniques applied to deep learning models in medical imaging. The paper reviews methodologies, discusses their applications, and evaluates their effectiveness in enhancing the interpretability, reliability, and clinical relevance of deep learning models in medical image analysis.

Temporomandibular disorders (TMDs) refer to a group of conditions that affect the temporomandibular joint, causing pain and dysfunction in the jaw joint and related muscles. The diagnosis of TMDs typically involved clinical assessment through operator-based physical examination, self-reported questionnaire and imaging studies. To objectivize the measurement of TMD, this study aims at investigating on the feasibility to use machine-learning algorithms fed with data gathered from low-cost and portable instruments to discriminate the presence of TMD in adult subjects. Through this aim, the experimental protocol involved fifty participants, equally distributed between TMD and healthy subjects, acting as control group. The diagnosis of TMD has been performed by a skilled operator through the typical clinical scale. Participants underwent to a baropodometric analysis by using a pressure matrix and the evaluation of the cervical mobility through inertial sensors. Nine machine-learning algorithms belonging to support vector machine, k-nearest neighbours and decision tree were compared. The k-nearest neighbours based on cosine distance was found as the best performing, achieving performance of 0.94, 0.94 and 0.08 for the accuracy, F1-score and G-index, respectively. These findings open the possibility to use such methodology to support the diagnosis of TMDs in clinical environments.

The aims of this paper can be traced back to goals number seven, twelve and thirteen introduced by Agenda 2030, namely "affordable and clean energy", “responsible consumption and production” and "climate action”, respectively. This is due to the fact that the present work supports decarbonization processes acting in a direct way on the electricity consumption achieved by plants pertaining to the waste industry; in fact, this study aims at the realization of a machine learning model for predicting the energy consumption achieved by a mechanical biological treatment (MBT) waste plant located in central Italy, given the distribution of the entering waste. This model is implemented in MATLAB. The model can be used to tune the distribution of the entering waste in order to adapt the plant energy consumption to the capability of the energy sources and can serve as a play-ground model for other energy transformation plants. The results of the study, which feed the literature on the application of artificial intelligence to real industrial plants, could be used to determine energy efficiency actions that could be incorporated into Property’s strategic planning.

The ridge line of the western Pacific subtropical high (WPSHRL) plays an important role in determining the shift of the summer rain belt in eastern China. In this study, we developed a forecast system for the June WPSHRL index based on the latest autumn and winter sea surface temperature (SST). Considering the adverse condition of the small observed sample size, a very simple neural network (NN) model was selected to extract the non-linear relationship between input predictors (SST) and target predictands (WPSHRL) in the forecast system. In addition, some techniques are used to deal with the adverse condition, enhance the stabilization of forecast skills, and analyze the interpretability of the forecast system. The forecast experiments show that the linear correlation coefficient between the predictions from the forecast system and their corresponding observations is around 0.6, and about three-fifths of the observed abnormal years (the years with an obviously high or low WPSHRL index) are successfully predicted. Furthermore, sensitivity experiments show that the forecast system is relatively stable in terms of forecast skill. The above evaluations suggest that the forecast system is valuable in a real application sense.

Estimating evapotranspiration at field scale is a major component of sustainable water management. Due to the difficulty to assess some major unknowns of the water cycle at that scale, including irrigation amounts, evapotranspiration is often computed as the residual of the instantaneous surface energy budget. One of the Surface Energy Bal-ance components with the largest uncertainties in their quantification over bare soils and sparse vegetation areas is the ground heat flux (G). Over the last decades, the es-timation of G with RS data has been mainly achieved with empirical equations, on the basis of the G and net radiation (Rn) ratio, G/Rn. G/Rn empirical equations generally require vegetation data (Type I empirical equations), in combination with surface tem-perature (Ts) and albedo (Type II empirical equations). In this article we aim to evalu-ate the estimation of G with RS. For the first time, we compare eight G/Rn empirical equations against two types of machine learning (ML) methods: an ensemble ML type, the Random Forest (RF), and the Neural Networks (NN). The comparison of each method is evaluated over dense dataset, including a wide range of climate and land covers, with data of Eddy-Covariance towers extended along the mid-latitude area that encompass the European and African continent. Our results have shown evidence that the driver of G in bare soils and sparse vegetation areas (Fraction of Vegetation, Fv <= 0.25) is Ts, instead of vegetation greenness indexes. On the other hand, the estimation of G with Rn, Ts or Fv decreases at dense vegetation areas (Fv >= 0.50). There are not significant differences between the most accurate type I and II empirical equations. For bare soils and sparse vegetation areas the empirical equation that better estimates G is E8, which combines the Leaf Area Index (LAI) and Ts. In dense vegetation areas (Fv >= 0.25), an exponential empirical equation based on Fv (E4), shows the best performance. However, ML better estimates G than the empirical equations, independently of the Fv ranges. A RF model with Rn, LAI and Ts as predictor variables shows the best accuracy and performance metrics, outperforming the NN model.

Accurate measurements of tree height and diameter at breast height (DBH) in forests to evaluate the growth rate of cultivars is still a significant challenge, even when using LiDAR and 3-D modeling. We propose an integrated pipeline methodology to measure the biomass of different tree cultivars in plantation forests with high crown density which that combines unmanned aerial vehicles (UAVs), hyperspectral image sensors, and data processing algorithms using machine learning. Using a planation of Cunninghamia lanceolate, commonly known as Chinese fir, in Fujian, China, images were collected using a hyperspectral camera and orthorectified in HiSpectral Stitcher. Vegetation indices and modeling were processed in Python using decision trees, random forests, support vector machine, and eXtreme Gradient Boosting (XGBoost) third-party libraries. Tree height and DBH of 2880 samples were measured manually and clustering into three groups: “fast growth,” “median,” growth and “normal” growth group, and 19 vegetation indices from 12,000 pixels were abstracted as the input of features for the modeling. After modeling and cross-validation, the classifier generated by random forests had the best prediction accuracy compare to other algorisms (75%). This framework can be applied to other tree species to make management and business decisions.

In recent years, computer-aided analysis techniques have emerged as valuable tools in assisting dermatologists by providing objective and efficient analysis of skin cancer images. This paper utilizes the combination of the Contourlet Transform (CT) and Local Binary Pattern (LBP) techniques for accurately recognizing borders, contrast changes, and shapes of skin cancer images. These results often contain many features, leading to high computational costs and potential over-fitting issues. Hence, we applied Particle Swarm Optimization (PSO) to select the most informative and discriminating features, reducing the dimensionality while retaining important information for accurate classification. After reducing the feature set with PSO, we applied these sets to Machine learning classification algorithms: Support Vector Machine (SVM), Random Forest (RF), and Neural Networks (NN). The results show that SVM has the lowest time complexity of 0.0458 seconds, followed by the Neural Network at 0.08730 seconds, and the Random Forest model has the highest time complexity of 0.1622 seconds. The SVM and Neural Network models are faster to train than the Random Forest model, making them more suitable for real-time or latency-sensitive applications. We also compared our proposed model with the state-of-the-art models and obtained the accuracy of 86.9%, which is the highest among the models.

We developed a novel machine learning (ML) algorithm with the goal of producing transparent models (i.e. understandable-by-humans) while also flexibly accounting for nonlinearity and interactions. Our method is based on ranked sparsity, and allows for flexibility and user-control in varying the shade of the opacity of black-box machine learning methods. The main tenet of ranked sparsity is that an algorithm should be more skeptical of higher-order polynomials and interactions \textit{a~priori} compared to main effects, and hence the inclusion of these more complex terms should require a higher level of evidence. In this work, we put our new ranked sparsity algorithm (as implemented in the open-source R package, `sparseR`) to the test in a predictive model "bakeoff" (i.e. a benchmarking study of ML algorithms applied "out-of-the-box," that is, with no special tuning). Algorithms were trained on a diverse set of simulated and real-world data sets from the Penn Machine Learning Benchmarks database, addressing both regression and binary classification problems. We evaluate the extent to which our human-centered algorithm can attain predictive accuracy that rivals popular black-box approaches such as neural networks, random forests, and support vector machines, while also producing more interpretable models. Using out-of-bag error as a meta-outcome, we describe the properties of data sets in which human-centered approaches can perform as well as or better than black-box approaches. We find that interpretable approaches predicted optimally or within 5% of the optimal method in most real-world data sets. We provide a more in-depth comparison of the performances of random forests to interpretable methods for several case studies, including exemplars in which algorithms performed similarly, and several cases when interpretable methods underperformed. This work provides a strong rationale for including human-centered transparent algorithms such as ours in predictive modeling applications.

Aerosol Optical Thickness (AOT) is one of the critical factors for global atmospheric conditions, climate change, and air pollution. AOT has been exposed as a major component of air pollution in Bangladesh. This paper aims to map the seasonal distribution of AOT from 2002-2022 and to explore the internal relationship between AOT and ten air pollutants using remote sensing and machine learning tools. These ten air pollutants are Particulate matter (PM2.5), Methane (CH4), Carbon monoxide (CO), Nitrogen dioxide (NO2), Formaldehyde (HCHO), Ozone (O3), Sulfur dioxide (SO2), Aerosol Particulate Radius (APR), Nitrogen oxide (NOx) and Black carbon (BC). The results show that the concentrations of AOT were higher in December-January-February (mean value 0.50) and March-April-May (mean value 0.50) seasons, mostly in the central, western, and southern parts of Dhaka, Narayanganj, and Munshiganj districts. AOT was a bit less in June-July-August (mean value 0.33) and September-October-November (mean value 0.37). This paper also revealed that the AOT was correlated positively with PM2.5 (0.60), CH4 (0.80), NO (0.76), and BC (0.83) while correlated negatively with CO (-0.66), HCHO (-0.16), SO2 (-0.41), APR (-0.48), and NOx (-0.20). From the machine learning, the Rational quadratic GPR (RME-0.0024, MAE-0.0015, R2-0.96), Matern 5/2 GPR (RMSE-0.0023, MAE-0.0015, R2-0.96), and Squared Exponential GPR (RMSE-0.0015, MAE-0.0015, R2-0.96) were found good classifiers to predict AOT. UN agencies, government line departments, and local and regional development councils for air pollution mitigation and long-term protective measures may use the paper's key results.

Background: the primary care service in Catalonia has operated an asynchronous teleconsulting service between GPs and patients since 2015 (eConsulta), which has generated some 500,000 messages. New developments in big data analysis tools, particularly those involving natural language, can be used to accurately and systematically evaluate the impact of the service. Objective: the study was intended to examine the predictive potential of eConsulta messages through different combinations of vector representation of text and machine learning algorithms and to evaluate their performance. Methodology: 20 machine learning algorithms (based on 5 types of algorithms and 4 text representation techniques)were trained using a sample of 3,559 messages (169,102 words) corresponding to 2,268 teleconsultations (1.57 messages per teleconsultation) in order to predict the three variables of interest (avoiding the need for a face-to-face visit, increased demand and type of use of the teleconsultation). The performance of the various combinations was measured in terms of precision, sensitivity, F-value and the ROC curve. Results: the best-trained algorithms are generally effective, proving themselves to be more robust when approximating the two binary variables "avoiding the need of a face-to-face visit" and "increased demand" (precision = 0.98 and 0.97, respectively) rather than the variable "type of query"(precision = 0.48). Conclusion: to the best of our knowledge, this study is the first to investigate a machine learning strategy for text classification using primary care teleconsultation datasets. The study illustrates the possible capacities of text analysis using artificial intelligence. The development of a robust text classification tool could be feasible by validating it with more data, making it potentially more useful for decision support for health professionals.

Prostate Cancer remains a prevalent health concern, emphasizing the critical need for early diagnosis and precise treatment strategies to mitigate mortality rates. Accurate prediction of cancer grade is paramount for timely interventions. This paper introduces an approach to prostate cancer grading, framing it as a classification problem. Leveraging ResNet models on multi-scale patch-level digital pathology and the Diagset dataset, the proposed method demonstrates notable success, achieving an accuracy of 0.999 in identifying clinically significant prostate cancer. The study contributes to the evolving landscape of cancer diagnostics, offering a promising avenue for improved grading accuracy and, consequently, more effective treatment planning. By integrating innovative deep-learning techniques with comprehensive datasets, our approach presents a step forward in the pursuit of personalized and targeted cancer care.

Flood Early Warning Systems (FEWSs) using Machine Learning (ML) has gained worldwide popularity. However, determining the most efficient ML technique is still a bottleneck. We assessed FEWSs with three river states, No-alert, Pre-alert, and Alert for flooding, for lead times between 1 to 12 hours using the most common ML techniques, such as Multi-Layer Perceptron (MLP), Logistic Regression (LR), K-Nearest Neighbors (KNN), Naive Bayes (NB), and Random Forest (RF). The Tomebamba catchment in the tropical Andes of Ecuador was selected as case study. For all lead times, MLP models achieve the highest performance followed by LR, with f1-macro (log-loss) scores of 0.82 (0.09) and 0.46 (0.20) for the 1- and 12-hour cases, respectively. The ranking was highly variable for the remaining ML techniques. According to the g-mean, LR models correctly forecast and show more stability at all states, while the MLP models perform better in the Pre-alert and Alert states. Future efforts are recommended to enhance the input data representation and develop communication applications to boost the awareness of the society for floods.

Automated machine learning (AutoML) has been heralded as the next wave in artificial intelligence with its promise to deliver high performance end-to-end machine learning pipelines with minimal effort from the user. However, despite AutoML showing great promise for computer vision tasks, to the best of our knowledge, no study has used AutoML for image-based plant phenotyping. To address this gap in knowledge, we examined the application of AutoML for image-based plant phenotyping using wheat lodging assessment with UAV imagery as an example. We compared the performance of an open-source AutoML framework, AutoKeras in image classification and regression tasks to transfer learning using modern convolutional neural network (CNN) architectures. For image classification which classified plot images as lodged or non-lodged, transfer learning with Xception and DenseNet-201 achieved best classification accuracy of 93.2%, whereas Autokeras had 92.4% accuracy. For image regression which predicted lodging scores from plot images, transfer learning with DenseNet-201 had the best performance (R2=0.8303, RMSE=9.55, MAE=7.03, MAPE=12.54%), followed closely by AutoKeras (R2=0.8273, RMSE=10.65, MAE=8.24, MAPE=13.87%). Interestingly, in both tasks, AutoKeras models had up to 40-fold faster inference times compared to the pretrained CNNs. The merits and drawbacks of AutoML compared to transfer learning for image-based plant phenotyping are discussed.

Disease detection and prediction have been one of the most frequent uses of machine learning models in the last decade, and Parkinson's disease is no exception. It is common for people in their old age to have one form of disease or another depending on the circumstances in which they find themselves. This study analyzed and evaluated various supervised machine learning models to detect the presence of Parkinson's disease in elderly individuals. An extreme gradient boosting model, along with other models, such as naïve Bayes, random forest, K-nearest neighbor, and support vector machine (SVM), was implemented to determine the best outcome. The extreme gradient boosting (XGBoost) model is a powerful boosting machine learning technique, particularly in terms of speed and accuracy. The results showed that the XGBoost model, which is an optimized version of the other boosting models, is capable of projecting the presence of Parkinson's disease with very high accuracy compared to other algorithms. The implemented classification algorithm extreme gradient boosting method achieved approximately 98 % accuracy, 97.5 % precision, 100.0 % recall, and 98.7% f1-score which are high compared with the results found in the existing literature.

The goal of this paper is the performance evaluation of a deep learning approach when deployed in fifth-generation (5G) millimeter wave (mmWave) multicellular networks. To this end, the optimum beamforming configuration is defined by two neural networks (NNs) that are properly trained, according to mean square error (MSE) minimization. The first network has as input the requested spectral efficiency (SE) per active sector, while the second network the corresponding energy efficiency (EE). Hence, channel and power variations can now be taken into consideration during adaptive beamforming. The performance of the proposed approach is evaluated with the help of a developed system level simulator via extensive Monte Carlo simulations. According to the presented results, machine learning (ML)-adaptive beamforming can significantly improve EE compared to the standard non-ML framework. Although this improvement comes at the cost of increased blocking probability (BP) and radiating elements (REs) for high data rate services, the corresponding increase ratios are significantly reduced compared to the EE improvement ratio. In particular, considering 21.6 Mbps per active user and ML adaptive beamforming, then EE can reach up to 5.3 Mbps/W, which is significantly improved compared to the non-ML case (0.9 Mbps/W). In this context, BP does not exceed 2.6%, which is slightly worse compared to 1.7% in the standard non-ML case. Moreover, approximately 20% additional REs are required, with respect to the non-ML framework.

Prediction of protein-ligand binding affinities is crucial for computational drug discovery. A number of deep learning approaches have been developed in recent years to improve the accuracy of such affinity prediction. While the predicting power of these systems have advanced to some degrees depending on the dataset used for model training and testing, the effects of the quality and quantity of the underlying data have not been thoroughly examined. In this study, we employed erroneous datasets and data subsets of different sizes, created from one of the largest databases of experimental binding affinities, to train and evaluate a deep learning system based on convolutional neural networks. Our results show that data quality and quantity do have significant impacts on the prediction performance of trained models. Depending on the variations in data quality and quantity, the performance discrepancies could be comparable to or even larger than those observed among different deep learning approaches. In particular, the presence of proteins during model training leads to a dramatic increase in prediction accuracy. This implies that continued accumulation of high-quality affinity data, especially for new protein targets, is indispensable for improving deep learning models to better predict protein-ligand binding affinities.

Raman Spectroscopy has long been anticipated to augment clinical decision making, such as classifying oncological samples. Unfortunately, the complexity of Raman data has thus far inhibited its routine use in clinical settings. Traditional machine learning models have been used to help exploit this information, but recent advances in deep learning have the potential to improve the field. However, there are a number of potential pitfalls with both traditional and deep learning models. We conduct a literature review to ascertain the recent machine learning methods used to classify cancers using Raman spectral data. We find that while deep learning models are popular, and ostensibly outperform traditional learning models, there are many methodological considerations which may be leading to an over-estimation of performance: primarily, small sample sizes which compound upon sub-optimal choices regarding sampling and validation strategies. Amongst several recommendations is a call to collate large benchmark Raman datasets, similar to those that have helped transform digital pathology, which researchers can use to develop and refine deep learning models.

Agriculture is a vital component of Egypt's economy; therefore, using Digital Elevation Models (DEMs) in agricultural planning in Egypt has significant benefits regarding water management, site appropriateness assessment, flood risk mitigation, and infrastructure construction. It is also essential for planners to make more informed decisions, optimize resource allocation, and support sustainable farming practices. This research paper investigates the accuracy of obtaining DEM data from four free global models (STRM30, ALOS30, COP30, and TanDEM-X90). The global DEM data has been compared to an actual GNSS-RTK DEM data surveyed onsite for two agricultural block areas in Aswan, the southern Government of Egypt. The two blocks are a part of a national project. For Block I and II, the RMSE of the Model STRM30 was 2.92 m and 3.59 m, respectively, indicating a poorer solution. Regarding accuracy, the ALOS30 model ranks third, reporting an RMSE of 2.58 m for block II and 3.30 m for block I. COP30 has an RMSE value of 1.06 m for blocks I and II and.91 m overall. TanDEM-X90 is the most accurate model in this investigation; block I provided an RMSE of 0.90 m with an SD of 0.58 m (SD95% = 0.38 m). After removing the anomalies, the model's stated RMSE for block II was 0.34 m, with an SD value of 0.62 m and 1.03 m. According to the classification using machine learning algorithms, with an accuracy of 84.7% for block I and 85% for block II, TanDEM-X90 is the best solution.

Background: Elexacaftor/Tezacaftor/Ivacaftor (ETI) is a CFTR modulator therapy approved for people with cystic fibrosis (pwCF) who have at least one phe508del mutation. However, its approval in the EU for pwCF with non-phe508del mutations is lacking, with limited data on treatment response in this subgroup. Methods: This retrospective study analyzed data from six pwCF (ages 6 to 66) with responsive CFTR mutations (M1101K, R347P, 2789+5G>A, G551D) undergoing off-label ETI therapy. Evaluations were conducted at 0, 3, 6, 9, and 12 months, assessing lung function (FEV1), sweat chloride levels, BMI, quality of life (CFQ-R), medication satisfaction (TSQM), ENT symptoms (SNOT-22), and physical performance. A control group of four pwCF with classic symptoms and no ETI treatment was included. Results: FEV1 improved significantly after 3 and 6 months (p<0.05) and stabilized by 12 months. Sweat chloride levels decreased significantly, with four pwCF achieving levels below 60 mmol/l. Improvements in ENT and respiratory symptoms, medication satisfaction, and increased BMI were noted. Conclusion: ETI demonstrates high efficacy in selected non-phe508del mutations, offering an effective treatment option that warrants further monitoring and evaluation.

Halide perovskite are known by their (1) organic inorganic hybrid and (2) inorganic halide perovskite. Having this in mind, monolithic perovskite/silicon tandem solar cell has already demonstrated extraordinarily high performance in the field of photovoltaic with current efficiency of 29.15%, breaking the efficiency limit for silicon solar cell. Currently, halide perovskites become successful not only in photovoltaic but also in many other related potential optoelectronic applications. Because of this reason, the origin of their multifunctional properties, remarkable energy harvesting and emitting efficiency and the corresponding potential applications in various optoelectronic devices become controversial issues and hot topics of academic research this time. In this review, nano-engineering strategies, microscopic origins and mechanisms are reviewed well to make clarity on what the origin of multifunctional properties such as tunability, ferroelasticity, piezoelectricity, pyroelectricity and thermoelectric properties of halide perovskites. Moreover, the coexistence of multiple properties makes halide provskites possible for synergistic applications and multifunctional perspectives such as emerging energy harvesting, conversion technologies, nano-plasmonic sensing and electromechanical applications, which are now open for the scientific community for further detail investigations. To successfully explore this field, advanced nanometer scale domain characterization tools are highly relevant to understand the microscopic origin of these electrical properties; aid the commercial enterprises and the research institutions. Not only the microscopic origin but also identifying factors and issues affecting the successful understanding and presence or absence of these electrical parameters should be primary task in this review. Finally, the big challenges for operation of halide perovskites owing to temperature, moisture, light, air, etc. induced material degradation and device deteriorations as well as lattice instability, nano scale defects, surface and bulk defects should be considered while dealing with these future research topics.

This paper presents a novel approach to decoding the Indus script, which was used by the Indus Valley Civilization (IVC) from approximately 3300 to 1900 BCE. The main focus of this research is the structural analysis of the signs within the Indus script. The central objective of the paper is to determine whether the Indus script can be classified as an alphabet, and it aims to provide compelling evidence regarding the number of primary signs. This includes establishing the actual count of Indus signs through the decomposition of compound signs, identifying diacritics and analyzing their consistent usage, as well as exploring the underlying concepts and implications associated with sign extraction. To comprehensively examine the Indus script, the paper analyzes over 400 signs, encompassing the entire script rather than a select subset of signs or texts. The visual decomposition of the signs employs a simple grid methodology. By summarizing the logical findings, the paper successfully identifies the primary signs and develops an understanding of their phonetic representation within the alphabet. The study recognizes the diverse writing styles used to combine the basic signs, The writing style of the Indus script incorporates variations in formation, composition, and combination, resulting in a significant number of signs. The research findings indicate that the Indus Script primarily consists of only 40 core signs.

Ubiquitous computing comprises scenarios where networks, devices within the network, and software components change frequently. Market demand and cost-effectiveness are forcing device manufacturers to introduce new-age devices. Also, the Internet of Things (IoT) is transitioning rapidly from the IoT to the Internet of Everything (IoE). Due to this enormous scale, effective management of these devices becomes vital to support trustworthy and high-quality applications. One of the key challenges of IoT device management is automatic device classification with the logically semantic type and using that as a parameter for device context management. This would enable smart security solutions. In this paper, a device classification approach is proposed for the context management of ubiquitous devices based on unsupervised machine learning. To classify unknown devices and to label them logically, a proactive device classification model is framed using a k-Means clustering algorithm. To group devices, it uses the information of network parameters such as Received Signal Strength Indicator (rssi), packet_size, number_of_nodes in the network, throughput, etc. Experimental analysis suggests that the well-formedness of clusters can be used to derive cluster labels as a logically semantic device type which would be a context for resource management and authorization of resources. This paper fulfills an identified need of proactive device classification for device management.

Implementing machine learning technologies in manufacturing environment relies heavily on human expertise in terms of domain and machine learning knowledge. Yet, the required machine learning knowledge is often not available in manufacturing companies. A possible solution to overcome this competence gap and let domain experts with limited machine learning programming skills build viable applications are digital assistance systems that support the implementation. At the present, there is no comprehensive overview over corresponding assistance systems. Thus, within this study a systematic literature review was conducted. Twenty-nine papers were identified and analyzed in depth regarding machine learning use case, required resources and research outlook. Six key findings as well as requirements for future developments are derived from the investigation. As such, the existing assistance systems basically focus on technical aspects whereas the integration of the users as well as validation in industrial environments lack behind. Future assistance systems should put more emphasis on the users and integrate them both in development and validation.

Generating executable code from natural language instructions using Large Language Models (LLMs) presents challenges such as semantic understanding and handling ambiguous input. This study focuses on the SantaCoder model and explores the impact of in-context learning on code generation using the MBPP and HumanEval datasets for evaluation. Our results demonstrate significant improvements in three key metrics (defined in the paper): correctness@k, similarity@k and pass@k. To address the problem of selecting optimal demonstrations to maximize correctness and pass rates, we investigate two methods: latent concept selection and random selection in this paper. These findings highlight the effectiveness of in-context learning and the critical role of demonstration selection in enhancing the accuracy, efficiency, and versatility of the SantaCoder model in code generation.

Heavy rains have created significant threats to human health and life. Floods and other natural disasters, which have a global impact annually, can be attributed to extended durations of intense precipitation. Accurate rainfall predictions are crucial in nations such as Bangladesh, where agriculture is the predominant occupation. The efficiency of machine learning (ML) methods is enhanced by the non-linearity of rainfall, surpassing the effectiveness of other alternative ways. Machine learning techniques show that individual classifiers exhibit worse accuracy than ensemble learning (EL) methodologies. Ensemble Learning techniques are utilized for rainfall prediction and estimating rainfall quantity and daily average temperature to enhance comprehension of the diverse Machine Learning algorithms. This research implements the machine learning techniques and ensemble-based classifier to predict the rainfall occurrence, along with the machine learning regressor models and ensemble-based regressor for the rainfall amount prediction and daily average temperature prediction, using Bangladesh Weather Dataset. The results of the machine learning and ensemble-based models are compared using the Accuracy and F1 score for rainfall occurrence prediction. In contrast, MAE and RMSE evaluation metrics are used for ensemble regressor and regression algorithms for the rainfall amount and daily average temperature prediction. With an accuracy of 83.41% and a recall of 78.17%, the Ensemble Classifier is the best at predicting when it will rain, but its precision of 51.16% stands in for the lowest. The Ensemble Regression model outperforms Linear Regression, Random Forest, and SVR in rainfall amount prediction, with the lowest MAE of 0.36 and RMSE of 0.90. The Ensemble Regression provides the most precise results for daily average temperature prediction with the lowest MAE 0.42 and RMSE 0.54 highlighting its superiority over the other regression models in forecasting temperature with less error. Ensemble approaches consistently lead task performance metrics.

The complexity and interconnection of smart cities provide huge political, technical, and socioeconomic challenges for the designers, integrators, and organisations who are responsible for the administration of these new entities. A growing number of studies are concentrating their attention on the safety, privacy, and potential dangers that exist within smart cities. These studies are drawing attention to the dangers that are associated with information security as well as the challenges that smart city infrastructure faces in the management and processing of personal data. This state of the art review of the literature analyses a number of issues pertaining to smart homes, offers a helpful synthesis of the important information found in the primary research, and creates a model for the interaction between smart cities. An overview of smart home research incorporating machine learning, including everything from definition to current research state. The state of art begins with a smart home definition, followed by descriptions of smart home elements, typical research projects, smart home network research status, smart home appliances, and difficulties. The term "smart home" refers to a subcategory of "everyday computing" that includes "smart technology" in order to improve a person's level of convenience, health, safety, and security while also reducing their When controlled by artificial intelligence, the applications for the smart home provide users with context-aware settings, services, and remote control, which significantly increases the level of user satisfaction.

Management approaches inspired by the variability of natural disturbances are expected to produce forests in the future that will be significantly more resilient and better adapted to local environmental conditions. Due to climate change, windstorms are becoming increasingly common resulting in the destruction not only of extensive forest areas but, quite often, of small-sized and scattered forest lands that can ultimately become home to insects and disease dissemination sites. In the present study, an attempt is made to identify and record areas in the northeastern forests of Greece covered by mixed stands of conifers and broadleaves that experienced massive windthrow following local storms. Based on tree-level data, local topographic features, forest characteristics and the mechanical properties of green wood, a reliable model, to be used for the prediction of similar disturbances in the future, has been created after a thorough comparative study of the most well-known intelligent machine learning algorithms.

Cardiovascular disease (CVD) may sometimes unexpected loss of life. It affects the heart and blood vessels of body. CVD plays an important factor of life since it may cause death of human. It is necessary to detect early of this disease for securing patients life. In this chpter two exclusively different methods are proposed for detection of heart disease. The first one is Pattern Recognition Approach with grammatical concept and the second one is machine learning approach. In the syntactic pattern recognition approach initially ECG wave from different leads is decomposed into pattern primitive based on diagnostic criteria. These primitives are then used as terminals of the proposed grammar. Pattern primitives are then input to the grammar. The parsing table is created in a tabular form. It finally indicates the patient with any disease or normal. Here five diseases beside normal are considered. Different Machine Learning (ML) approaches may be used for detecting patients with CVD and assisting health care systems also. These are useful for learning and utilizing the patterns discovered from large databases. It applies to a set of information in order to recognize underlying relationship patterns from the information set. It is basically a learning stage. Unknown incoming set of patterns can be tested using these methods. Due to its self-adaptive structure Deep Learning (DL) can process information with minimal processing time. DL exemplifies the use of neural network. A predictive model follows DL techniques for analyzing and assessing patients with heart disease. A hybrid approach based on Convolutional Layer and Gated-Recurrent Unit (GRU) are used in the paper for diagnosing the heart disease.

Artificial intelligence AI or machine learning has proven to be a potential activity in the health and biomedical sciences. Previous research it has found that AI can learn new data and transform it into the useful knowledge. In the field of pharmacology, the aim is to design more efficient and novel vaccines using this method which are also cost effective. The underlying fact is to predict the molecular mechanism and structure for increased likelihood of developing new drugs. Clinical, electronic and high resolution imaging datasets can be used as inputs to aid the drug development niche. Moreover, the use of comprehensive target activity has been performed for repurposing a drug molecule by extending target profiles of drugs which also include off targets with therapeutic potential providing a new indication.

Detection of the region of interest (ROI) is a critical step in laryngeal image analysis for the delineation of glottis contour. The process can improve both computational efficiency and accuracy of the image segmentation task, which will facilitate subsequent analysis and characterization of the vocal fold vibration as it correlates with voice quality and pathology. This study aims to develop machine learning based approaches for automatic detection of ROI for glottis image sequences captured by high-speed video-endoscopy (HSV), a clinical laryngeal imaging modality. In particular, we first applied the supporting vector machine (SVM) method using histogram of oriented gradients (HOG) feature descriptor, and second, trained a convolutional neural network (CNN) model for this task. Comparisons are made for both approaches in terms of accuracy of recognition and computation time.

In recent years, due to the detrimental impact of traditional gas-liquid refrigerants on the environment, the pursuit of solid-state refrigeration technology based on elastocaloric effect, as a promising sustainable alternative, has been promoted. However, the traditional trial-and-error method is inefficient and difficult to meet the material application requirements. In this work, machine learning (ML) was employed to accelerate the development of NiTi-based shape memory alloy (SMA) with excellent elastocaloric effect. By means of active learning, we identified 9 novel NiTi-based SMAs in four iterations, the phase transformation-induced entropy change (ΔS) of which are as high as over 90 J/kg·K-1. Moreover, the model exhibits good interpretability, allowing us to understand the relevance between the target and features from the aspect of mechanism.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

Tripping is the largest cause of falls and low swing foot ground clearance during the mid-swing phase, particularly at the critical gait event known as Minimum Foot Clearance (MFC) is the major risk factor for tripping-related falls. Intervention strategies to increase MFC height can be effective if applied in real-time based on feed-forward prediction. The current study investigated the capability of machine learning models to classify the MFC into various categories using toe-off kinematics data. Specifically, three MFC sub-categories (less than 1.5cm, between 1.5-2.0cm and higher than 2.0cm) were predicted applying machine learning approaches. A total of 18,490 swing phase gait cycles’ data were extracted from six healthy young adults, each walking for 5-minutes at a constant speed of 4km/h on a motorised treadmill. Both K-Nearest Neighbour (KNN) and Random-Forest were utilised for prediction based on the data from toe-off for five consecutive frames (0.025s duration). Foot kinematics data were obtained from inertial measurement unit attached to the mid-foot, recording tri-axial linear accelerations and angular velocities of the local coordinate. KNN and Random-Forest achieved 84% and 86% accuracy, respectively, in classifying MFC into the three sub-categories with run time of 0.39 seconds and 13.98 seconds respectively. The KNN-based model was found to be more effective if incorporated into an active exoskeleton as the intelligent system to control MFC based on the preceding gait event, toe-off due to its quicker computation time. The machine learning based prediction model shows promise for the prediction of critical MFC data indicating higher tripping risk.

Epilepsy is a chronic neurological disorder characterized by abnormal electrical activity in the brain, often leading to recurrent seizures. With approximately 50 million people worldwide affected by epilepsy, there is a pressing need for efficient and accurate methods to detect and diagnose seizures. Electroencephalogram (EEG) signals, which record the brain’s electrical activity, have emerged as a valuable tool in detecting epilepsy and other neurological disorders. Traditionally, the process of analyzing EEG signals for seizure detection has relied on manual inspection by experts, which is time-consuming, labor-intensive, and susceptible to human error. To address these limitations, researchers have turned to machine learning and deep learning techniques to automate the seizure detection process. In this work, we propose a novel method for epileptic seizure detection, leveraging the power of 1-D Convolutional layers in combination with Bidirectional Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) and Average pooling Layer as a unit. The performance of the proposed model is verified on the Bonn dataset. Our proposed model offers significant advancements over existing approaches for the detection of epileptic seizures, particularly for 2, 3, 4, and 5-class classification tasks. To assess the robustness and generalizability of our proposed architecture, we employ 5-fold cross-validation. By dividing the dataset into five subsets and iteratively training and testing the model on different combinations of these subsets, we obtain robust performance measures, including accuracy, sensitivity, and specificity. We demonstrate the effectiveness of the proposed architecture in accurately detecting epileptic seizures from EEG signals by using EEG signals of varying lengths. The results indicate its potential as a reliable and efficient tool for automated seizure detection, paving the way for improved diagnosis and management of epilepsy.

This work can be considered as a first step of designing a future competitive data-driven approach for remaining useful life prediction of aircraft engines. The proposed approach is an ensemble of serially connected extreme learning machines. The results of prediction of the first networks are scaled and fed to the next networks as an additive features to the original inputs. This feature mapping allows increasing the correlation of training inputs with their targets by holding new prior knowledge about the probable behavior of the target function. The proposed approach is evaluated under remaining useful estimation using a set of “time-varying” data retrieved from the public dataset C-MAPSS (Commercial Modular Aero Propulsion System Simulation) provided by NASA. The prediction performances are compared to basic extreme learning machine and proved the effectiveness of the proposed methodology.

Optical networks are prone to power jamming attacks intending service disruption. This paper presents a Machine Learning (ML) framework for detection and prevention of jamming attacks in optical networks. We evaluate various ML classifiers for detecting out-of-band jamming attacks with varying intensities. Numerical results show that artificial neural network is the fastest ($10^6$ detection per second) for inference and most accurate ($\approx 100 \%$) in detecting power jamming attacks as well as identifying the optical channels attacked. We also discuss and study a novel prevention mechanism when the system is under active jamming attacks. For this scenario, we propose a novel resource reallocation scheme that utilizes the statistical information of attack detection accuracy to lower the probability of successful jamming of lightpaths while minimizing lightpaths' reallocations. Simulation results show that the likelihood of jamming a lightpath reduces with increasing detection accuracy, and localization reduces the number of reallocations required.

Technological developments within the maritime sector are resulting in rapid progress that will see the commercial use of autonomous vessels, known as Maritime Autonomous Surface Ships (MASS). Such ships are equipped with a range of advanced technologies, such as IoT devices, artificial intelligence (AI) systems, machine learning (ML) based algorithms and augmented reality (AR) tools. Through such technologies, the autonomous vessels can be remotely controlled from Shore Control Centres (SCC) by using real-time data to optimise their operations, enhance safety and reduce the possibility of human error. Apart from the regulatory aspects, which are under definition by the International Maritime Organisation (IMO), cybersecurity aspects must be considered and properly addressed to prevent such complex systems from being tampered with. In this paper, we propose an approach to secure communication channels between the SCCs and the vessels using SECOM standard and the underlying digital infrastructure in charge of data collection, storage and processing by relying on a set of machine learning (ML) algorithms for anomaly detection. The proposed approach is validated against a real implementation of the SCC deployed at Livorno seaport premises. Finally, the experimental results and the performance evaluation are provided to assess its effectiveness accordingly.

Classical Arabic poetry is a form of Arabic literature, and almost every piece of Arabic poetry follows one of the 16 meters. The rhythmic framework of the poems or the verses is called meters. The deep learning (DL) model was implemented using TensorFlow in this work using a large dataset of Arabic poetry. The character level encoding was used to convert text to integers for classifying the full-verse and half-verse data. The study evaluates the data without removing diacritics from the text. The train-test-split method with a 70-15-15 split was employed for classification. 15% of the total data was considered unseen test data for all models. The work was conducted with multiple deep learning models, including the Long Short-Term Memory (LSTM), Gated Recurrent Units (GRU), and Bidirectional LSTM (Bi-LSTM). The Bi-LSTM model shows the best accuracy of all the models specified, with 97.53% for full-verse and 95.23% for half-verse without removing diacritic data.

Machine Learning (ML) has brought about a transformative era in reactor operations, reshaping monitoring, control, and optimization strategies. This survey comprehensively explores the diverse spectrum of ML applications in industrial reactors. From real-time sensor analysis ensuring reactor functionality to adaptive control algorithms ensuring stability, ML's impact is profound and multifaceted. The benefits of ML are equally evident in optimization, encompassing performance trend prediction, proactive maintenance, and fine-tuning of operations for enhanced efficiency. This review identifies dominant ML techniques, operations stages receptive to ML integration, core data sources, and critical input-output parameters. Aimed at both academics and practitioners, this exploration enriches reactor technologies, unlocking their full potential through insights driven by ML.

Software governance is a management structure that guides projects in terms of their accountability and responsibility. Prime motivation of this approach is to improve the skillset of the team members through software governance policies and increase the overall success rate of the software projects. The scope of skill development is across the pillars of governance, such as structure, people, and information. Primary focus of this paper is on the skillset development of the project team members through educational policies in software governance. As part of the governance process, educational policies are defined for the skillset development of project team members. The JIRA dataset was used to determine the skillset development of the team members. Machine learning techniques, such as J48, Random Forest, Decision Table, Logistics, and Naïve Bayes, were used in the JIRA dataset. These machine learning techniques were processed using WEKA open-source software. Based on these results, it was concluded that the J48 algorithm can be applied to multiple projects/programs to monitor and track the skill development process. Machine learning model such as J48 is required to use this model at an organizational level. The skillset development of project team members should be aligned with IT governance and educational policies. Overall upskilling and reskilling strategies are provided to demonstrate the impact of skillset development through software governance.

In this article, we investigate the applicability of quantum machine learning for classification tasks using two quantum classifiers from the Qiskit Python environment: the Variational Quantum Classifier (VQC) and the Quantum Kernel Estimator (QKE). We evaluate the performance of these classifiers on six widely known and publicly available benchmark datasets and analyze how their performance varies with the number of samples on two artificially generated test classification datasets. As quantum machine learning is based on unitary transformations, this paper explores data structures and application fields that could be particularly suitable for quantum advantages. Hereby, we developed a data set based on concepts from quantum mechanics using the exponential map of a Lie algebra. This dataset will be made publicly available and contributes a novel contribution to the empirical evaluation of quantum supremacy. We further compared the performance of VQC and QKE on six widely applicable datasets to contextualize our results.\\ Our results demonstrate that the VQC and QKE perform better than basic machine learning algorithms such as advanced linear regression models (Ridge and Lasso). They do not match the accuracy and runtime performance of sophisticated modern boosting classifiers like XGBoost, LightGBM, or CatBoost. Therefore, we conclude that while quantum machine learning algorithms have the potential to surpass classical machine learning methods in the future, especially when physical quantum infrastructure becomes widely available, they currently lag behind classical approaches. Our investigations also show that classical machine learning approaches have superior performance classifying datasets based on group structures, compared to quantum approaches that particularly use unitary processes.\\ Furthermore, our findings highlight the significant impact of different quantum simulators, feature maps, and quantum circuits on the performance of the employed quantum estimators. This observation emphasizes the need for researchers to provide detailed explanations of their hyperparameter choices for quantum machine learning algorithms, as this aspect is currently overlooked in many studies within the field.\\ To facilitate further research in this area and ensure the transparency of our study, we have made the complete code available in a linked GitHub repository.

It is a challenging problem that air-written Arabic letters has received a lot of attention in the past decades when compared to commonly spoken languages like English languages. To fill this gap, we propose a strong model that brings together machine learning (ML) and optical character recognition (OCR) methods. The model applied several ML methods, (i.e., Neural Networks (NN), Random Forest (RF), K-Nearest Neighbors (KNN), and Support Vector Machine (SVM), with deep convolutional neural networks (CNNs) such as VGG16, VGG19, and SqueezeNet for effective feature extraction. Our study utilizes the AHAWP dataset, which consists of varied writing styles and variations in hand signs, to train and evaluate the model. Preprocessing systems are applied to improve data quality by reduction bias. Besides, OCR methods are combined into our model to sequestrate individual letters from continuous air-written gestures and refine recognition results. Results of this study show that the proposed model has achieved the extreme accuracy of 88.8% using NN with VGG16. This study presents an inclusive approach that combines ML, deep CNNs, and OCR methods to address the issue of Arabic in air writing recognition research.

In cold-climate regions, road salt is used as a de-icer for winter road maintenance. The applied road salt melts ice and snow on roads, being washed off through storm sewer systems into nearby urban streams, harming the freshwater ecosystem. Addressing the gap in the knowledge regarding the use of deep learning approaches for urban stream water quality forecasting, the present work discusses our implementation of a “Graph Neural Network” - “Sample and Aggregate” (GNN-SAGE) model for forecasting chloride concentrations in the Credit River in Ontario, Canada. The proposed GNN-SAGE is compared to other models, including a Deep Neural Network based transformer (DNN-Transformer) and a benchmarking persistence model for 6 hours forecasting horizon. Ac-cording to the results, the GNN-SAGE model surpasses other models in providing accurate predic-tions of chloride concentrations within the assessed prediction window. Also, a SHAP analysis provides insight into the variables that influence the model’s forecasting, showing the impact of the spatiotemporal neighbouring data from the network and the seasonality variables on the model’s result. The GNN-SAGE model shows potential for use in real-time forecasting of water quality in urban streams, aiding in the development of regulatory policies to protect the vulnerable freshwater ecosystems in urban areas.

Cracking in a wide array of industrial components and structures pose a significant threat to their integrity. Detecting cracks using ultrasonic inspection techniques is a widespread activity for economic reasons but there are limitations to the techniques due to the morphology of cracks, such as fatigue cracks. In addition to detection there is a need to measure the size of the cracks which are often within the volume of the material. Ultrasonic techniques are well-suited to look inside the volume of the material but achieving sufficient sensitivity to the tip of the cracks in particular is practically difficult. Without an accurate knowledge of where the tip of the crack lies there can be significant uncertainty in sizing measurements. Machine Learning (ML) techniques are being developed to aid in the inspection and monitoring tasks but presenting the ultrasonic data in a suitable way for ML is very important. Following on from recent work presenting the development of the snooker algorithm to create images termed parameter-spaces, this paper presents how these images can be input into neural network based ML systems to automatically size these critical cracks.

We present a data-driven, in situ proximal multi-sensor digital soil mapping approach to develop digital twins for multiple agricultural fields. A novel Digital Soil CoreTM (DSC) Probe was engineered that contains seven sensors, each of a distinct modality, including sleeve friction, tip force, dielectric permittivity, electrical resistivity, soil imagery, acoustics, and visible and near-infrared spectroscopy. The DSC System integrates components the DSC Probe, DSC software, and deployment equipment to sense soil characteristics at a high vertical spatial resolution (mm scale) along in situ soil profiles up to a depth of 120 cm in about 60 sec. The DSC Probe in situ proximal data are harmonized into a data cube providing vertical high-density knowledge associated with physical-chemical-biological soil conditions. In contrast, conventional ex situ soil samples derived from soil cores, soil pits, or surface samples analyzed using laboratory and other methods are bound by substantially coarser spatial resolution and multiple compounding errors. Our objective was to investigate the effects of mismatched scale between high-resolution in situ proximal sensor data and coarser resolution ex situ soil laboratory measurements to develop soil prediction models. Our study was conducted in central California soil in almond orchards. We collected DSC sensor data and spatially co-located soil cores that were sliced into narrow layers for laboratory-based soil measurements. Partial Least Squares Regression (PLSR) cross-validation was used to compare results testing four data integration methods. Method A reduced the high-resolution sensor data to discrete values paired with layer-based soil laboratory measurements. Method B used stochastic distributions of sensor data paired with layer-based soil laboratory measurements. Method C allocated the same soil analytical data to each one of the high-resolution multi-sensor data within a soil layer. Method D linked the high-density multi-sensor soil data directly to crop responses (crop performance and behavior metrics) bypassing costly laboratory soil analysis. Overall, the soil models derived from Method C outperformed Methods A and B. Soil predictions derived using Method D were most cost-effective for directly assessing soil-crop relationships, making this method well-suited for industrial-scale precision agriculture applications.

Machine learning (ML) methods has recently contributed very well in the advancement of the prediction models used for energy consumption. Such models highly improve the accuracy, robustness, and precision and the generalization ability of the conventional time series forecasting tools. This article reviews the state of the art of machine learning models used in the general application of energy consumption. Through a novel search and taxonomy the most relevant literature in the field are classified according to the ML modeling technique, energy type, perdition type, and the application area. A comprehensive review of the literature identifies the major ML methods, their application and a discussion on the evaluation of their effectiveness in energy consumption prediction. This paper further makes a conclusion on the trend and the effectiveness of the ML models. As the result, this research reports an outstanding rise in the accuracy and an ever increasing performance of the prediction technologies using the novel hybrid and ensemble prediction models.

Solar energy is a renewable resources of energy which is broadly utilized and have the least pollution impact between the available alternatives of fossil fuels. In this investigation, machine leaening approaches of neural networks (NN), neuro-fuzzy and least squares support vector machine (LSSVM) are used to build the models for prediction of the thermal performance of a photovoltaic-thermal solar collector (PV/T) by estimating its efficiency as an output of the model while inlet temperature, flow rate, heat, solar radiation, and heat of sun are input of the designed model. Experimental measurements was prepared by designing a solar collector system and 100 data extracted. Different analyses are also performed to examine the credibility of the introduced approaches revealing great performance. The suggested LSSVM model represented the best performance regarding the mean squared error (MSE) of 0.003 and correlation coefficient (R²) value of 0.99, respectively.

In the era of digital advancements, the escalation of credit card fraud necessitates the development of robust and efficient fraud detection systems. This paper delves into the application of machine learning models, specifically focusing on ensemble methods, to enhance credit card fraud detection. Through an extensive review of existing literature, we identified limitations in current fraud detection technologies, including issues like data imbalance, concept drift, false positives/negatives, limited generalisability, and challenges in real-time processing. To address some of these shortcomings, we propose a novel ensemble model that integrates a Support Vector Machine (SVM), K-Nearest Neighbor (KNN), Random Forest (RF), Bagging, and Boosting classifiers. This ensemble model tackles the dataset imbalance problem associated with most credit card datasets by implementing under-sampling and the Synthetic Over-sampling Technique (SMOTE) on some machine learning algorithms. The evaluation of the model utilises a dataset comprising transaction records from European credit card holders, providing a realistic scenario for assessment. The methodology of the proposed model encompasses data pre-processing, feature engineering, model selection, and evaluation, with Google Colab computational capabilities facilitating efficient model training and testing. Comparative analysis between the proposed ensemble model, traditional machine learning methods, and individual classifiers reveals the superior performance of the ensemble in mitigating challenges associated with credit card fraud detection. Across accuracy, precision, recall, and F1-score metrics, the ensemble outperforms existing models. This paper underscores the efficacy of ensemble methods as a valuable tool in the battle against fraudulent transactions. The findings presented lay the groundwork for future advancements in the development of more resilient and adaptive fraud detection systems, crucial as credit card fraud techniques continue to evolve.

This study presents an optimized design for a Segmented Sinusoidal Parameter Winding with Magnetic Wedge Variable Reluctance Resolver (SSPWMW-VRR), addressing challenges like winding asymmetry and harmonic distortion in conventional designs. By integrating Particle Swarm Optimization (PSO) for winding design, Magnetic Equivalent Circuit (MEC) analysis for leakage flux, and machine learning techniques (XGBoost and Multi-Layer Perceptron), the stator slot shape was fine-tuned for improved accuracy. XGBoost outperformed MLP in prediction accuracy with a Mean Absolute Error (MAE) of 0.1172. Finite Element Analysis (FEA) simulations and experimental validation demonstrated a reduction in position errors from ±30’ in conventional VRRs to ±5’ in the optimized design, along with significant harmonic reduction.

Falls are a major public health problem among older adults, therefore predicting the risk of having falls in the near future is of great importance for health and social systems worldwide. Nowadays, prospective fall risk assessment relies on clinical and functional mobility assessment tools, such as the Timed Up and Go (TUG) test. Recently, wearable inertial measurement unit (IMU) sensors measurements have been proposed for fall detection. We hypothesize that the IMU readings captured during TUG test realizations can provide prospective fall risk prediction. In this study, analysis by deep learning convolutional neural networks (CNN) and recurrent neural networks (RNN) were used for fall prediction based on features extracted from IMU data acquired during TUG test realizations. Data is obtained from a cohort of 106 older adults wear-ing a wireless inertial sensor with a sampling frequency of 100 Hz while performing the TUG test. Prospective fall incidence was obtained in a six-month follow-up period and used as the ground truth for the supervised training and validations of the deep learning and competing machine learning approaches. Further data collection could lead to potential fall risk biomarker. A repeated hold out cross-validation process using 75 subjects for training and 31 subjects for testing was carried out. Best results were achieved by a bidirectional long short-term memory (BLSTM), obtaining an accuracy of 0.83 and AUC of 0.73 with good sensitivity and specificity values.

Measuring and predicting Carbon Emission (CE) is important to enabling the main culprit of various urgent environmental issues including global warming. However, prior studies did not fully incorporate the impact of micro-level urban streetscapes, which might lead to biased prediction of urban CE. To fill the gap, we developed an effective framework to predict residential CE in urban areas from widely existing and publicly available street-view images (SVI) using machine learning. First, we used a semantic segmentation algorithm to classify more than 30 streetscape elements from SVI images to describe the built environment whose features might affect residential and transportation CE. Second, based on the streetscapes quantified, we trained a 10-fold cross-validation method with various machine learning models to predict the CE at the 1KM grid level using CE data from the PlanetData. We found first, built environment features such as sidewalks, roads, fences, buildings, and walls are significantly correlated with the residential CE. Second, the presence of buildings and subtle streetscape features (e.g., walls, fences) indicates higher-density residential areas which are related to more residential CE. Third, vegetation (e.g., trees and grass) are reversely related to residential CE. Our findings shed light on the feasibility of using a single and open data source (i.e., the SVI) to effectively model neighborhood-level CE for regions across diverse urban forms. Our framework is useful for urban planners to inform new town development and urban regeneration towards the low CE goals.

Cyber-Physical Systems (CPS) play an essential role in today’s production processes, leveraging Artificial Intelligence (AI) to enhance operations such as optimization, anomaly detection, and predictive maintenance. This article reviews a cognitive architecture for artificial intelligence, which has been developed to establish a standard framework for integrating AI solutions into existing production processes. Given that machines in these processes continuously generate large streams of data, Online Machine Learning (OML) was identified as a crucial extension to the existing architecture. To substantiate this claim, real-world experiments using a slitting machine were conducted to compare the performance of OML with traditional Batch Machine Learning. The evaluations clearly indicate that OML adds significant value to CPS and is strongly recommeded as an extension of related architectures such as the cognitive architecture for AI discussed in this article. Additionally, surrogate model-based optimization is employed to determine the optimal hyperparameter settings for the corresponding OML algorithms, aiming to achieve peak performance in their respective tasks.

COVID-19 vaccine hesitancy is considered responsible for the lower rate of acceptance of vaccines in many parts of the world. However, sources of this hesitancy are rooted in many social, political, and economic factors. This paper strives to find the most important variables in predicting the COVID-19 vaccination uptake. We introduce an explainable machine learning (ML) framework to understand the COVID-19 vaccination uptake around the world. To predict vaccination uptake, we have trained a random forest (RF) regression model using a number of sociodemographic and socioeconomic data. The traditional decision tree (DT) regression model is also implemented as the baseline model. We found that the RF model performed better than the DT model since RF is more robust to handle nonlinearity and multi-collinearity. Also, we have presented feature importance based on impurity measure, permutation, and Shapley values to provide the most significant unbiased features. It is found that electrification coverage and Gross Domestic Product are the strongest predictors for higher vaccination uptake, whereas the Fragile state index (FI) contributed to lower vaccination uptake. These findings suggest addressing issues that are found responsible for lower vaccination uptake to combat any future public health crisis.

Hypergravity accelerators are a type of large machinery used for gravity training or medical research. A failure of such large equipment can be a serious problem in terms of safety or costs. This paper proposes a prediction model that can proactively prevent failures that may occur in a hy-pergravity accelerator. The method proposed in this paper was to convert vibration signals to spectograms and perform classification training using a deep learning model. An experiment was conducted to evaluate the performance of the method proposed in this paper. A 4-channel accel-erometer was attached to the bearing housing, which is a rotor, and time-amplitude data were obtained from the measured values by sampling. The data were converted to a two-dimensional spectrogram, and classification training was performed using a deep learning model for four conditions of the equipment: Unbalance, Misalignment, Shaft Rubbing, and Normal. The ex-perimental results showed that the proposed method had a 99.5% F1-Score, which was up to 23% higher than the 76.25% for existing feature-based learning models.

Vision-language-action (VLA) models represent a promising direction for developing general-purpose robotic systems, demonstrating the ability to combine visual understanding, language comprehension, and action generation. However, systematic evaluation of these models across diverse robotic tasks remains limited. In this work, we present a comprehensive evaluation framework and benchmark suite for assessing VLA models. We profile three state-of-the-art VLM and VLAs —GPT-4o, OpenVLA, and JAT—across 20 diverse datasets from the Open-X-Embodiment collection, evaluating their performance on various manipulation tasks. Our analysis reveals several key insights: (1) current VLA models show significant variation in performance across different tasks and robot platforms, with GPT-4o demonstrating the most consistent performance through sophisticated prompt engineering, (2) all models struggle with complex manipulation tasks requiring multi-step planning, and (3) model performance is notably sensitive to action space characteristics and environmental factors. We release our evaluation framework and findings to facilitate systematic assessment of future VLA models and identify critical areas for improvement in the development of general-purpose robotic systems.

Soil texture is key information in agriculture for improving soil knowledge and crop performance, so the accurate mapping of this crucial feature is imperative for rationally planning cultivations and for targeting interventions. We studied the relationship between radioelements and soil texture in the Mezzano Lowland (Italy), a 189 km² agricultural plain investigated through a dedicated airborne gamma-ray spectroscopy survey. The K and Th abundances were used to retrieve the clay and sand content by means of a multi-approach method. Linear (simple and multiple) and non-linear (machine learning algorithms with deep neural networks) predictive models were trained and tested adopting a 1:50,000 scale soil texture map. The comparison of these approaches highlighted that the non-linear model introduces significant improvements in the prediction of soil texture fractions. The predicted maps of the clay and of the sand content were compared with the regional soil maps. Although the macro-structures were equally present, the airborne gamma-ray data permits us shedding light on finer features. Map areas with higher clay content were coincident with paleo-channels crossing the Mezzano Lowland in Etruscan and Roman periods, confirmed by the hydrographic setting of historical maps and by the geo-morphological features of the study area.

The present paper explored the possibility of discriminating between different malignant degrees of Chondrosarcoma (CS), a diffused bone tumor, and Enchondroma (EC), its benign version, through an approach based on the coupling between Confocal Raman Microscopy (CRM) and Machine Learning (ML) techniques. Recently, Raman Spectroscopy has proven to be a powerful tool for a complete grading of CS by distinguishing between grade 1, 2 and 3, and to distinguish CS from EC. In this paper, we tested some models, belonging either to ML or to the sub-type called Deep Learning (DL), showing excellent classification performances, especially the DL algorithms, with classification accuracy approaching to 100%, making the models promising for future implementations of Raman spectroscopy when applied to oncology diagnosis. In turn, we highlighted how some proper ML models result in worse classification performances but better resolution of specific chemical target compounds, possible candidate to become malignant markers, with relevant implication for a correct diagnosis.

This paper presents a comprehensive study on applying machine learning (ML) techniques for real-time credit card fraud detection. With the increasing prevalence of credit card fraud, financial institutions face the challenge of detecting fraudulent transactions promptly and accurately. This research evaluates various ML models, including Logistic Regression, Decision Trees, Random Forests, XGBoost, and Deep Convolutional Neural Networks, for their effectiveness in identifying fraudulent activities. Utilizing PySpark for processing large-scale transaction data, the study highlights the importance of real-time analysis, adaptive learning, and handling imbalanced datasets. Key findings reveal that XgBoost, with its balance of accuracy and complexity, emerged as the most promising model, achieving an accuracy rate of 98% in detecting fraudulent transactions. The paper further discusses the potential of ensemble methods, graph-powered systems, and intelligent sampling in enhancing fraud detection capabilities. Challenges such as overfitting, data access, and the need for real-time analysis are addressed. Future research directions include implementing models in live transaction environments, expanding model applicability across financial platforms, and developing advanced anomaly detection methodologies. This study underscores the pivotal role of machine learning in safeguarding financial transactions against fraud, offering significant implications for consumers, financial institutions, and the broader financial ecosystem.

A major challenge of augmented and mixed reality applications is identifying the context and semantics of the real environment. Studies on object and action recognition were developed based on the improvement of machine learning techniques, allowing them to be annotated and recognized. This study aims to characterize current knowledge on the use of machine learning for recognizing objects and actions in augmented and mixed reality environments, increasing context awareness. Therefore, a systematic literature review of works related to these topics was made, using the Scopus and Web of Science knowledge bases. We searched articles and conference reviews or papers published between 2018 and 2022 and selected fifteen studies to be reviewed. The results indicate that there is a great demand for using machine learning to immersive technologies in factories, engineering, entertainment, education, health, among other application domains. However, these real-time interactive systems still have challenges and limitations to be solved, involving network communication, prediction time and the creation of a model that recognize objects and actions in broad contexts. Furthermore, additional research is needed to investigate how object and action recognition can increase context awareness in augmented reality applications.

Grapes are a globally popular fruit, with grape cultivation worldwide being second only to citrus. This article focuses on the low efficiency and accuracy of traditional manual grading of red grape external appearance and proposes a small-sample red grape external appearance grading model based on transfer learning with convolutional neural networks (CNNs). Initially, the CNN transfer learning method was used to transfer the pre-trained AlexNet, VGG16, GoogleNet, InceptionV3, and ResNet50 network models on the ImageNet image dataset to the red grape image grading task. By comparing the classification performance of the CNN models of these five different network depths with fine-tuning, ResNet50 with a learning rate of 0.001 and a loop number of 10 was determined to be the best feature extractor for red grape images. Moreover, given the small number of red grape image samples in this study, different convolutional layer features output by the ResNet50 feature extractor were analyzed layer by layer to determine the effect of deep features extracted by each convolutional layer on SVM classification performance. This analysis helped to obtain a ResNet50+SVM red grape external appearance grading model based on the optimal ResNet50 feature extraction strategy. Experimental data showed that the classification model constructed using the feature parameters extracted from the 10th node of the ResNet50 network achieved an accuracy rate of 95.08% for red grape grading. These research results provide a reference for the online grading of red grape clusters based on external appearance quality and have certain guiding significance for the quality and efficiency of grape industry circulation and production.

The alteration of natural land cover to impervious surfaces during development increases stormwater runoff. Stormwater Control Measures (SCMs) are used to manage water quantity and enhance water quality by restoring the hydrologic cycle altered by development. Often, SCMs have an outflow pipe to handle overflows or to manage the release of water detained when infiltration is not possible. Traditionally, these are static controls (e.g. a small orifice is used to restrict the volume of outflow), however, these systems can be improved by instituting real-time controls (RTC). RTC improve the functionality of SCMs by dynamically controlling outflows to adjust to environmental conditions. A major impediment to the widespread implementation of RTC is the high cost of installation and operation. This study utilized machine learning methods to develop a forecasting approach for the implementation of low-cost RTC that were implemented on a programmable gate of the outlet structure of a multi-stage basin in southeastern Pennsylvania. The goals were to decrease the peak flow exiting the basin during rain events, increase the volume of water detained, decrease the number of overtopping events, maintain healthy vegetation in the basin, and protect the downstream vegetation from erosion. Multiple popular data science algorithms were evaluated including multiple linear regression and long short-term memory. These algorithms were used with a dataset, which consisted of four years of historical sensor data, collected in 5-minute intervals, to train models to predict water levels to optimize operations. The accuracy of 30 models with three different methods of handling missing values were compared. A long short-term memory model configured with a 30-minute lead time produced the best results. Having an approximate same lag time of 30 minutes for the contributing drainage area of the SCM provided a sufficient RTC functioning period to improve the performance of the outlet structure.

Deep learning techniques are increasingly being recognized as effective image classifiers. Aside from their successful performance in past studies, the accuracies have varied in complex environments in comparison with the popularly applied machine learning classifiers. This study seeks to explore the feasibility for using a U-Net deep learning architecture to classify bi-temporal high resolution county scale aerial images to determine the spatial extent and changes of land cover classes that directly or indirectly impact tidal marsh. The image set used in the analysis is a collection of a 1-m resolution collection of National Agriculture Imagery Program (NAIP) tiles from 2009 and 2019 covering Beaufort County, South Carolina. The U-net CNN classification results were compared with two machine learning classifiers, the Random Trees (RT) and the Support Vector Machine (SVM). The results revealed a significant accuracy advantage in using the U-Net classifier (92.4%) as opposed to the SVM (81.6%) and RT (75.7%) classifiers for overall accuracy. From the perspective of a GIS analyst or coastal manager, the U-Net classifier is now an easily accessible nad powerful tool for mapping large areas. Change detection analysis indicated little areal change on marsh extent, though increased land development throughout the county has the potential to negatively impact the health of the marshes. Future work should explore applying the constructed U-Net classifier to coastal environments in large geographic areas, while also implementing other data sources (e.g., LIDAR, multispectral data) to enhance classification accuracy.

This paper deals with the characteristics of the cyclone separator from the Lagrangian perspective to design important dependent variables, develops a neural network model for predicting the separation performance parameter, and compares the predictive performance between the traditional surrogate model and the neural network model. In order to design the important parameters of the cyclone separator based on the particle separation theory, the force acting until the particles are separated was calculated using the Lagrangian-based CFD methodology. As a result, it was proved that the centrifugal force and drag acting on the critical diameter having a separation efficiency of 50% were similar, and the particle separation phenomenon in the cyclone occurred from the critical diameter, and it was set as an important dependent variable. For developing a critical diameter prediction model based on machine learning and multiple regression methods, Unsteady-RANS analyzes according to shape dimensions were performed. The input design variables for predicting the critical diameter were selected as four geometry parameters that affect the turbulent flow inside the cyclone. As a result of comparing the model prediction performances, the ML model showed the 32.5 % of improvement rate of R2 compared to the traditional MLR considering the nonlinear relationship between the cyclone design variable and the critical diameter. The proposed techniques have proven to be fast and practical tools for cyclone design.