In the dynamic landscape of online shopping, predicting user behaviors such as clicks, cart additions, and orders is crucial for optimizing sales strategies. Traditional recommendation systems often focus on a single objective, limiting their effectiveness in a multifaceted e-commerce environment. This article proposes a multi-objective recommendation system that leverages previous events in user sessions to forecast these key metrics, addressing challenges such as imbalanced positive and negative samples, varying session lengths, and the need for effective sampling techniques. Our approach integrates LightGBM, XgBoost, and Recbole GRU4Rec through ensemble learning, combining the strengths of these models to enhance prediction performance. Extensive evaluations demonstrate that our model outperforms existing methods, offering significant improvements in accuracy and robustness. This work provides a comprehensive solution for online retailers to better predict user behaviors and optimize their sales strategies, ultimately enhancing customer satisfaction and business outcomes.

From the various perspectives of Machine Learning (ML) and the multiple models used in this discipline, there is an approach aimed at training models for the Early Detection (ED) of anoma-lies. The early detection of anomalies is crucial in multiple areas of knowledge since identifying and classifying them allows for early decision-making and provides a better response to mitigate the negative effects caused by late detection in any system. This article presents a literature review to examine which machine learning models (MLM) operate with a focus on ED in a multidisci-plinary manner and specifically how these models work in the field of fraud detection. A variety of models were found, including Logistic Regression (LR), Support Vector Machines (SVM), De-cision Trees (DT), Random Forests (RF), Naive Bayesian Classifier (NB), K-Nearest Neighbors (KNN), Artificial Neural Networks (ANN), Extreme Gradient Boosting (XGB), among others. It was identified that MLMs operate as isolated models, categorized in this article as Single Base Models (SBM) and Stacking Ensemble Models (SEM). It was identified that MLMs for ED in multiple areas under SBM and SEM implementation achieved accuracies greater than 80% and 90%, respectively. n fraud detection, accuracies greater than 90% were reported by the authors. The article concludes that MLMs for ED in multiple applications, including fraud, offer a viable way to identify and classify anomalies robustly, with a high degree of accuracy and precision. MLMs for ED in fraud are useful as they can quickly process large amounts of data to detect and classify suspicious transactions or activities, helping to prevent financial losses.

This study has simulated the typical rainstorm on 20 July 2021 over central east China by using the first-generation Chinese Reanalysis datasets and Global Land Data Assimilation System datasets, and the Noah land surface model coupled with the advanced weather research and forecasting model. Based on this, the gridded planetary boundary layer (PBL) profiles and ensemble states within soil perturbations are collected to investigate the main land-atmosphere coupling characteristics during this modeled rainstorm by using various local coupling metrics and the introduced ensemble statistical metrics. Results have shown that (1) except for the stratospheric thermodynamics and surface thermal over mountain areas, the main characteristics of mid-low layers and surface have been well documented in this modeled rainstorm; (2) the typical coupling intensity is characterized by the dominant morning moistening, early noon weak PBL warming around 2, noontime buoyant mixing temperature deficit around 274 K, daytime PBL and surface latent flux contribution around 100 and 280 W/m2 respectively, and significant afternoon soil-surface latent flux coupling; (3) moist static energy is more significant than PBL height during the relation chains, which is consistent with the significance of surface moistening indicated by local coupling metrics. In general, wet soil contributes greatly to daytime moisture evaporation, which then increases the early noon PBL warming and enhances the noontime buoyant mixing within weak flux contribution. However, this has been suppressed by large-scale forcing such as the upper southwestern inflows of rainstorms, which has further significantly shaped the spatial distribution of statistical metrics in contrast. These quantitatively described local couplings have highlighted both the convection potential diagnoses usage for the local weather application and more applicable coupling threshold diagnoses within the finer spatial investigation.

The Internet of Things technology opens the horizon for a broader scope of intelligent applications in smart cities. However, the massive amount of traffic exchanged among devices may cause security risks, significantly when devices are compromised or vulnerable to cyber-attack. An intrusion detection system is the most powerful tool to detect unauthorized attempts to access smart systems. It identifies malicious and benign traffic by analyzing network traffic. In most cases, only a fraction of network traffic can be considered malicious. As a result, it is difficult for an intrusion detection system to detect attacks at high detection rates while maintaining a low false alarm rate. This work proposes an integrated framework to detect suspicious traffic to address secure data communication in smart cities. This paper presents an approach to developing an intrusion detection system to detect various attack types. It can be done by implementing a Principal Component Analysis method that eliminates redundancy and reduces system dimensionality. Furthermore, the proposed model shows how to improve intrusion detection system performance by implementing an ensemble model.

Chemical elements in space can be synthesized by stellar nuclear reactors. Studying the dynamics of processes occurring in the stars introduces a concept of the ensemble-averaged stellar reactor. For future interstellar missions, the terrestrial and solar abundances were compared with considerable number of stars allocated in the ~ 200 pc solar neighborhood. According to the value of the effective temperature, four stellar classes are distinguished, for which the correlation coefficients and standard deviation are calculated. The statement about the possibility of transferring heavy elements synthesized by stars over long distances in space has been completely refuted. There is no immutability of the distribution of elements on neighboring stars and in the Solar System. It is shown that chemical elements are mainly synthesized inside each stellar reactor. The theory of the buoyancy of elements is generalized to stars. It has been suggested that stars overheat due to a shift in the parameters of nuclear processes occurring inside stars, which leads to the synthesis of heavy elements.

Real-world optimization problems are often governed by one or more constraints. Over the last few decades, extensive research has been performed in Constrained Optimization Problems (COPs) fueled by advances in computational intelligence. In particular, Evolutionary Algorithms (EAs) are a preferred tool for practitioners for solving these COPs within practicable time limits. We propose an ensemble of multi- method hybrid EA framework with four mutation operators, two crossover operators, multi-search [Differential Evolution (DE) & Gaining Sharing Knowledge (GSK)] optimization algorithm, and ensemble of constraint handling techniques to solve global real- world constrained optimization problem. The proposed frame- work FEPEA has an ascendancy of multiple adaptation strategies concerning the control parameters, search mechanisms, two sub-populations as well as uses knowledge sharing mechanism between junior and senior phases. The algorithm also combines the power of four popular constraint handling techniques (CHT) and uses a voting mechanism to select any particular CHT. On top of that, this algorithm also uses both linear and non- linear population size reduction in every step of the evolutionary process. We test our method on 57 real-world problems provided as part of the CEC 2020 special session & competition on real- world constrained optimization benchmark suite. Experimental results indicate that FEPEA is able to achieve state-of-the- art performance on real-world constrained global optimization when compared against other well-known real-world constrained optimizers.

The classifier system proposed in this work combines the dissimilarity spaces produced by a set of Siamese neural networks (SNNs) designed using 4 different backbones, with different clustering techniques for training SVMs for automated animal audio classification. The system is evaluated on two animal audio datasets: one for cat and another for bird vocalizations. Different clustering methods reduce the spectrograms in the dataset to a set of centroids that generate (in both a supervised and unsupervised fashion) the dissimilarity space through the Siamese networks. In addition to feeding the SNNs with spectrograms, additional experiments process the spectrograms using the Heterogeneous Auto-Similarities of Characteristics. Once the similarity spaces are computed, a vector space representation of each pattern is generated that is then trained on a Support Vector Machine (SVM) to classify a spectrogram by its dissimilarity vector. Results demonstrate that the proposed approach performs competitively (without ad-hoc optimization of the clustering methods) on both animal vocalization datasets. To further demonstrate the power of the proposed system, the best stand-alone approach is also evaluated on the challenging Dataset for Environmental Sound Classification (ESC50) dataset. The MATLAB code used in this study is available at https://github.com/LorisNanni.

Colposcopy image classification is vital for early cervical cancer detection, yet it remains challenging due to the significant variation in lesion appearances. Although deep learning models have advanced medical image classification, few studies have explored combining different model architectures to enhance diagnostic accuracy in colposcopy. This study addresses this gap by proposing a lesion-specific, multi-branch architecture that integrates attention mechanisms, deep feature extraction, and ensemble learning. Multi-task learning is employed to manage multiple lesion-specific classification tasks, while an ensemble of classifiers—Logistic Regression, XGBoost, and CatBoost—enhances decision-making accuracy. The architecture includes deep learning branches using EfficientNetB0 and MobileNetV2 for rich feature extraction from colposcopy images, with their outputs combined through a soft voting ensemble. Hyperparameter tuning, k-fold cross-validation, PCA visualization, and AUC plots for multiclass performance were used to optimize and assess model effectiveness. Training and validation accuracy were tracked in two phases: after the training phase, training accuracy reached 97.85\% and validation accuracy was 97.33\%; after the final ensemble classification, training accuracy improved to 99.95\% and validation accuracy to 99.85\%, surpassing individual model performance and demonstrating enhanced generalization. This model shows substantial promise for improving colposcopy classification accuracy, providing a valuable tool for clinical decision support in cervical cancer diagnosis.

In the textile industry, cotton plays a significant role as the primary raw material. However, cotton farming often faces challenges from various diseases, resulting in reduced productivity and financial losses for farmers. To address this issue, this study proposes a new method for predicting cotton diseases in Internet of Things (IoT)-based applications. The proposed solution combines meta-heuristic techniques with deep learning (DL). The aim of the proposed method leverages IoT, deep learning, and meta-heuristic techniques to detect and classify cotton plant diseases, providing an accurate and efficient solution for farmers and the textile industry. The process begins with capturing high-resolution images of cotton leaves in agricultural fields using a camera. These images are then processed using IoT to identify potential diseases. Noise removal and quality enhancement are performed using a Probabilistic Hybrid Wiener Filter (PHWF). Next, the Modified Dilated U-Net (MDU-Net) model segments significant disease regions from the images. Effective features are extracted from these segments using Improved Local Binary Pattern (ILBP), Gray Level Co-Occurrence Matrix (GLCM), and Gray Level Run Length Matrix (GLRM). Feature dimensionality is reduced by selecting optimal features through a Binary Guided Whale-Dipper Throated Optimizer (BGW-DTO). Classification is carried out using a stacking ensemble model, which combines EfficientNet-B7, ResNet50, VGG19, DenseNet121, and InceptionV3 models. To optimize the ensemble, a Harris whale optimization algorithm determines optimal weight coefficients for each classifier. The optimized ensemble model classifies various diseases, including Army Worms, Powdery Mildew, Bacterial Blight, Aphids, and Target Spots. Using our dataset of cotton plant leaf images, the proposed technique achieves a high accuracy of 99.66%. By integrating IoT sensor data and DL, early detection of cotton plant leaf diseases is enabled.

The reliable operation of power systems depends on rapid fault detection to trigger protection mechanisms and prevent further damage. Machine Learning-based fault detection systems have gained prominence for their superior performance. These automated systems can assist operators by highlighting anomalies and faults, providing a robust framework for improving Situation Awareness. However, existing approaches predominantly rely on monolithic models, which struggle with adapting to changing data, handling imbalanced datasets, and capturing patterns in noisy environments. To overcome these challenges, this study explores the potential of Multiple Classifier System (MCS) approaches. The results demonstrate that ensemble methods generally outperform single models, with dynamic approaches like META-DES showing remarkable resilience to noise. These findings highlight the importance of model diversity and ensemble strategies in improving fault classification accuracy under real-world, noisy conditions. This research emphasizes the potential of MCS techniques as a robust solution for enhancing the reliability of fault detection systems.

This paper introduces a novel ensemble adjustment Kalman filter (EAKF) that integrates a machine-learning approach. The approach employs nonlinear variable relationships established by a deep neural network (DNN) during the analysis stage of the EAKF. This process nonlinearly projects observation increments into the state variable space. The newly developed DNN-EAKF algorithm can be applied to coupled data assimilation using coupled ocean-atmosphere models. It enhances cross-component updates in strongly coupled data assimilation (SCDA) by diminishing errors in estimating cross-component error covariance arising from insufficient ensemble members, thereby improving the SCDA analysis. This paper employs a conceptual model to conduct twin experiments, validating the DNN-EAKF’s capability to utilize cross-component observation information in SCDA effectively. The approach is anticipated to offer insights for future methodological integrations of machine learning and data assimilation and provide methods for SCDA applications in coupled general circulation models.

Due to the intermittency and fluctuation of photovoltaic (PV) output power, a high proportion of grid-connected PV power generation systems has a significant impact on power systems. Accurate PV power forecasting can alleviate the uncertainty of the PV power and is of great significance for the stable operation and scheduling of the power systems. Therefore, in this study, a feature rise-dimensional (FRD) two-layer ensemble learning (TLEL) model for short-term PV power deterministic forecasting and probability forecasting is proposed. First， based on the eXtreme Gradient Boosting (XGBoost), Random Forest (RF), CatBoost, and Long-short-term memory (LSTM) models, a TLEL model is constructed utilizing the ensemble learning algorithm. Meanwhile, the FRD method is introduced to construct the FRD-XGBoost-LSTM (R-XGBL), FRD-RF-LSTM(R-RFL), and FRD- CatBoost - LSTM (R-CatBL) models. Subsequently, the above models are combined to construct the FRD-TLEL model for deterministic forecasting, and perform probability interval forecasting based on quantile regression(QR). Finally, the performance of the proposed model is demonstrated with a real-world dataset. By comparing with other models, the proposed model displays better forecasting accuracy for deterministic forecasting and reliable forecasting intervals for probability forecasting, and good generalization ability in the datasets of different seasons and weather types.

Taiwan is highly susceptible to global warming, experiencing a 1.4°C increase in air temperatures from 1911-2005, which is twice the average for the Northern Hemisphere. This has led to higher rates of respiratory and cardiovascular mortality. Accurately predicting maximum temperatures during the summer season is crucial, but numerical weather models become less accurate and more uncertain beyond five days. To improve forecast reliability, statistical post-processing is needed to address systematic errors. In September 2020, NOAA NCEP implemented the Global Ensemble Forecast System version 12 (GEFSv12) to help manage climate risks. This study developed a Hybrid statistical post-processing method that combines Artificial Neural Networks (ANN) and Quantile mapping (QQ) approaches to predict daily maximum temperatures and extremes in Taiwan during the summer season. The Hybrid technique, utilizing deep learning techniques, was applied to the GEFSv12 reforecast data and evaluated against ERA5 reanalysis. The Hybrid technique was the most effective among the three techniques tested. It had the lowest bias, RMSE, and highest correlation coefficient. It successfully reduced the warm bias and overestimation of Tmax extreme days. This led to improved prediction skills for all forecast lead times. Compared to ANN and QQ, the Hybrid method was more effective in predicting summer daily Tmax and its extremes on an extended-range time scale deterministic and ensemble probabilistic forecasts over Taiwan.

Protein phosphorylation and ADP-ribosylation (ADPr), as two types of post-translational modifications (PTM), are the process of adding phosphate group and ADP-ribose moieties to proteins, respectively. Although both PTM types can occur on many amino acid types, serine is the most common. Serine phosphorylation (pS), serine ADPr (SADPr), and their in situ crosstalks (pSADPr) play essential roles in biological processes. Although in silico classifiers have been developed for predicting pS and SADPr sites, the classifier for predicting pSADPr sites is unavailable. In this study, we developed classifiers to predict pSADPr sites. Specifically, we collected 3250 human pSADPr, 7520 SADPr, 151,227 pS and 80,096 unmodified serine sites. Based on them, we investigated the characteristics of pSADPr sites and constructed three classifiers to predict pSADPr sites from the pS dataset, the SADPr dataset and the protein sequences separately. We built and evaluated five deep-learning classifiers in ten-fold cross-validation and independent test datasets. Three of them (e.g. Convolutional Neural Network with the One-Hot encoding, dubbed CNNOH) performed better than the rest two. For instance, CNNOH had the AUC values of 0.700, 0.914 and 0.954 for recognizing pSADPr sites from the SADPr, pS and unmodified serine sites.Therefore, it is challenging to distinguish pSADPr sites from SADPr sites compared to the other two. It is consistent with our observation that pSADPr's characteristics are more similar to those of SADPr than the rest. Furthermore, we used the classifiers as base classifiers to develop a few stacking-based ensemble classifiers to improve performance. However, none of the ensemble classifiers showed better performances, suggesting that the base classifiers have good enough performances. Finally, we developed an online tool for extensively predicting human pSADPr sites based on the CNNOH classifier, dubbed EdeepSADPr. It is freely available through http://edeepsadpr.bioinfogo.org/.

Although automated Acute Lymphoblastic Leukemia (ALL) detection is essential, it is challenging due to the morphological correlation between malignant and normal cells. The traditional ALL classification strategy is arduous, time-consuming, often suffers inter-observer variations, and necessitates experienced pathologists. This article has automated the ALL detection task, employing deep Convolutional Neural Networks (CNNs). We explore the weighted ensemble of deep CNNs to recommend a better ALL cell classifier. The weights are estimated from ensemble candidates' corresponding metrics, such as accuracy, F1-score, AUC, and kappa values. Various data augmentations and pre-processing are incorporated for achieving a better generalization of the network. We train and evaluate the proposed model utilizing the publicly available C-NMC-2019 ALL dataset. Our proposed weighted ensemble model has outputted a weighted F1-score of 88.6%, a balanced accuracy of 86.2%, and an AUC of 0.941 in the preliminary test set. The qualitative results displaying the gradient class activation maps confirm that the introduced model has a concentrated learned region. In contrast, the ensemble candidate models, such as Xception, VGG-16, DenseNet-121, MobileNet, and InceptionResNet-V2, separately produce coarse and scatter learned areas for most example cases. Since the proposed ensemble yields a better result for the aimed task, it can experiment in other domains of medical diagnostic applications.

One of the most basic pieces of information gained from dynamic electromyography is accurately defining muscle action and phase timing within the gait cycle. The human gait relies on selective timing and the intensity of appropriate muscle activations for stability, loading, and progression over the supporting foot during stance, and further to advance the limb in the swing phase. A common clinical practice is utilizing a low-pass filter to denoise integrated electromyogram (EMG) signals and to determine onset and cessation events using a predefined threshold. However, the accuracy of the defining period of significant muscle activations via EMG varies with the temporal shift involved in filtering the signals; thus, the low-pass filtering method with a fixed order and cut-off frequency will introduce a time delay depending on the frequency of the signal. In order to precisely identify muscle activation and to determine the onset and cessation times of the muscles, we have explored here onset and cessation epochs with denoised EMG signals using different filter banks: the wavelet method, empirical mode decomposition (EMD) method, and ensemble empirical mode decomposition (EEMD) method. In this study, gastrocnemius muscle onset and cessation were determined in sixteen participants within two different age groups and under two different walking conditions. Low-pass filtering of integrated EMG (iEMG) signals resulted in premature onset (28% stance duration) in younger and delayed onset (38% stance duration) in older participants, showing the time-delay problem involved in this filtering method. Comparatively, the wavelet denoising approach detected onset for normal walking events most precisely, whereas the EEMD method showed the smallest onset deviation. In addition, EEMD denoised signals could further detect pre-activation onsets during a fast walking condition. A comprehensive comparison is discussed on denoising EMG signals using EMD, EEMD, and wavelet denoising in order to accurately define an onset of muscle under different walking conditions.

Users of meteorological forecasts are often faced with the question of whether to make a decision now based on the current forecast or whether to wait for the next and hopefully more accurate forecast before making the decision. One would imagine that the answer to this question should depend on the extent to which there is a benefit in making the decision now rather than later, combined with an understanding of how the skill of the forecast improves, and information about the possible size and nature of forecast changes. We extend the well-known cost-loss model for forecast-based decision making to capture an idealized version of this situation. We find that within this extended cost-loss model, the question of whether to decide now or wait depends on two specific aspects of the forecast, both of which involve probabilities of probabilities. For the special case of weather and climate forecasts in the form of normal distributions we derive a simulation algorithm, and equivalent analytical expressions, for calculating these two probabilities. We apply the algorithm to forecasts of temperature and find that the algorithm leads to better decisions relative to three simpler alternative decision-making schemes. Similar problems have been studied in many other fields, and we explore some of the connections.

Muscle ultrasound quantification is a valuable complementary diagnostic tool for diabetic peripheral neuropathy (DPN). DPN significantly impacts the lives of individuals with diabetes, leading to pain, lower limb amputation, and disability, affecting patient quality of life. This work develops a computer-aided diagnostic (CAD) system based on muscle ultrasound that integrates the bag of features (BOF) and an ensemble subspace k-nearest neighbour (KNN) algorithm for DPN detection. The BOF creates a histogram of visual word occurrences to represent the muscle ultrasound images and trains an ensemble classifier through cross-validation, determining optimal parameters to improve classification accuracy for the ensemble diagnosis system. The dataset includes ultrasound images of six muscles from 53 subjects, consisting of 27 control and 26 patient cases. An empirical analysis was conducted for each binary classifier based on muscle type to select the best vocabulary tree properties or K values for BOF. The result indicates that ensemble subspace KNN classification, based on the bag of features, achieved an accuracy of 97.23%. This study suggests muscle ultrasound as a promising diagnostic tool with the potential for image recognition and interpretation. CAD systems can accurately diagnose muscle pathology, helping to overcome limitations and identify issues in individuals with diabetes.

We describe a forecast system based on the Weather Research and Forecasting (WRF) model for the prediction of high-impact weather events affecting power utilities, particularly conditions conducive to wildfires. The system was developed for Pacific Gas and Electric Corporation (PG&E) to operationally forecast conditions in Northern and Central California. It was established in 2014 and has been periodically improved. In the current configuration, WRF forecasts are routinely performed multiple times each day on a 2-km grid, and the results are used as input to wildfire fuel moisture, fire probability, and wildfire spread models. Components of the system include a stochastically perturbed ensemble; an annually updated reanalysis covering more than 30 years; and validation against PG&E’s extensive mesonet and other observing networks. We describe the development and validation of the next operational edition. Configurations tested include irrigation triggered by crop growing season and an ensemble-based approach with intelligently sub-selected Global Ensemble Forecast System (GEFS) members. The latter approach allows for enhanced uncertainty sampling in WRF forecasts and can greatly improve WRF forecasts when calibrated by observations.

Groundnut is an oil seed cash crop, that can be consumed directly by humans and animals. It is also used as an intelligence in the industrial production of butter and other products. However, Groundnut seeds can become infected with fungi, viruses, pests, physical damage, and high heat, which can negatively impact crop yield, quality, and economic value, and pose health hazards. To address these challenges, computer vision technology detects and classifies defects. This study introduced an ensemble deep learning defected classification model that combines VGG16 and InceptionV3 using seed images. To enhance model performance, collected images are preprocessed using novel techniques tailored to different image types. Preprocessing techniques are chosen based on image-quality evaluation metrics. Watershed segmentation is applied followed by detecting the region of interest in the image using YOLOv3. The image dataset is augmented and balanced using a Generative Adversarial Network (GAN). The model development involves a combination of classical and deep-based features, comparing features extracted with (HOG and GLCM) to those extracted with InceptionV3 and VGG16. The ensemble model achieves an accuracy of 96.25% with a split ratio of 10% for testing, 10% for validation, and 80% for training set. This research benefits farmers looking to improve yield, consumers of groundnut products, and researchers studying seed defects. The work provides valid insights for future researchers regarding dataset creation, augmentation, methods, and feature selection for modeling. However, the model experienced misclassifications due to the similar appearance of sample images in different classes. Future researchers should address these challenges and consider factors such as oil content and defect grading.

In response to increasing urbanization and the need for infrastructure resilient to natural hazards, this study introduces an AI-driven predictive model designed to assess the risk of soil liquefaction. Utilizing advanced ensemble machine learning techniques, the model integrates geotechnical and geographical data to accurately predict the potential for soil liquefaction in urban areas, with a specific focus on Yokohama, Japan. This methodology leverages comprehensive datasets from geological surveys and seismic activity to enhance urban planning and infrastructure development in smart cities. The primary outputs include detailed soil liquefaction risk maps that are essential for effective urban risk management. These maps support urban planners and engineers in making informed decisions, prioritizing safety, and promoting sustainability. The model employs a robust combination of neural networks and gradient boosting decision trees to analyze and predict data points, assessing soil susceptibility to liquefaction during seismic events. Notably, the model achieves high accuracy in predicting soil classifications and N-values, which are critical for evaluating soil liquefaction risk. Validation against an extensive dataset from geotechnical surveys confirms the model’s practical effectiveness. Moreover, the results highlight the transformative potential of AI in enhancing geotechnical risk assessments and improving the resilience of urban areas against natural hazards.

This paper presents our approaches for the SMM4H’24 Shared Task 5 on the binary classification of English tweets reporting children’s medical disorders. Our first approach involves fine-tuning a single RoBERTa-large model, while the second approach entails ensembling the results of three fine-tuned BERTweet-large models. We demonstrate that although both approaches exhibit identical performance on validation data, the BERTweet-large ensemble excels on test data. Our best-performing system achieves an F1-score of 0.938 on test data, outperforming the benchmark classifier by 1.18%.

In order to solve the problem of fault diagnosis for CNC machine feed system under the condition of variable speed conditions, an intelligent fault diagnosis method based on multi-domain feature extraction and ensemble learning model is proposed. First, various monitoring signals including vibration signal, noise signal and current signal are collected. Then, the monitoring signals are preprocessed and the time-domain, frequency-domain and time-frequency domain feature indexes are extracted to construct a multi-dimensional mixed domain feature set. Finally, the feature set is putting into the constructed DoubleEnsemble-LightGBM model to realize the fault diagnosis of the feed system. The experimental results show that the model can achieve good diagnosis results under different working conditions for both the public data set and the feed system test bench data set, and the average overall accuracy is 91.07% and 98.06% respectively. Compared with XGBoost and other advanced ensemble learning models, the method has better accuracy. It provides technical support for the stable operation and intelligent of CNC machine tools..

The redox properties of quinones underlie their unique characteristics as organic battery components that outperform the conventional inorganic ones. Furthermore, the redox properties could be precisely shaped by using different substituent groups. Machine learning and statistics, onthe other hand, have proven to be very powerful approaches for efficient in silico design of novel materials. Herein, we demonstrated the machine learning approach for the prediction of the redox activity of quinones that potentially can serve as organic battery components. For the needs of the present study, a database of small quinone-derived molecules was created. A large number of quantum chemical and chemometrics descriptors was generated for each molecule and subsequently different statistical approaches were applied to select the descriptors that most prominently characterize the relationship between structure and redox-potential. Various machine-learning methods for screening of prospective organic battery electrode materials were deployed to select the most trustworthy strategy for machine learning aided design of organic redox materials. It was found that ridge regression models perform better than regression decision tree and decision tree based ensemble algorithms.

This paper presents a two-stage hierarchical neural network using image classification and object detection algorithms as key building blocks for a system that automatically detects a potential design right infringement. This neural network is trained to return the Top-N original design right records that highly resemble the input image of a counterfeit. Design rights specify the unique aesthetic characteristics of a product. Due to the rapid change of trends, new design rights are continuously generated. This work proposes an Ensemble Neural Network (ENN), an artificial neural network model that aims to deal with a large amount of counterfeit data and design right records that are frequently added and deleted. At first, we performed image classification and objection detection learning per design right using the existing models with a proven track record of high accuracy. The distributed models form the backbone of the ENN and yield intermediate results aggregated at a master neural network. This master neural network is a deep residual network paired with a fully connected network. This ensemble layer is trained to determine the sub-models that return the best result for a given input image of a product. In the final stage, the ENN model multiples the inferred similarity coefficients to the weighted input vectors produced by the individual sub-models to assess the similarity between the test input image and the existing product design rights to see any sign of violation. Given 84 design rights and the sample product images taken meticulously under various conditions, our ENN model achieved average Top-1 and Top-3 accuracies of 98.409% and 99.460%, respectively. Upon introducing new design rights data, a partial update of the inference model was done an order of magnitude faster than the single model. ENN maintained a high level of accuracy as it scaled out to handle more design rights. Therefore, the ENN model is expected to offer practical help to the inspectors in the field, such as the customs at the border that deal with a swarm of products.

The potential impacts of climate change on the distribution of tuna in Pacific Island Countries’ Exclusive Economic Zones have yet to be investigated rigorously, and so their persistence and abundance in these areas remain uncertain. Here, we estimate optimal fisheries areas for four tuna species; Albacore (Thunnus alalunga), Bigeye (Thunnus obesus), Skipjack (Katsuwonus pelamis), and Yellowfin (Thunnus albacares). We consider different climate change scenarios, RCP 2.6, RCP 4.5, RCP 6.0 and RCP 8.5, within a set of tuna catch records in the Exclusive Economic Zone of Tonga. Using environmental and CPUE datasets, species distribution modelling estimated and predicted these fisheries areas in the current and future climatic scenarios. Our projections indicate an expansion in area and a shift of productive areas to the southern part of this Exclusive Economic Zone of Tonga. This is an indication that future climatic scenarios might be suitable for the species under study however, changes in trophic layers, ocean currents and ocean chemistry might alter this finding. Information provided here will be relevant in planning future national actions towards proper management of these species.

The current study aims to apply and compare the performance of six machine learning algorithms, including three basic classifiers: random forest (RF), gradient boosting decision tree (GBDT), and extreme gradient boosting (XGB), as well as their hybrid classifiers, using the logistic regression (LR) method (RF+LR, GBDT+LR, and XGB+LR), in order to map the landslide susceptibility of Zhangjiajie City, Hunan Province, China. First, a landslide inventory map was created with 206 historical landslide points and 412 non-landslide points, which was randomly divided into two datasets for model training (80%) and model testing (20%). Second, 15 landslide conditioning factors (i.e., altitude, slope, aspect, plane curvature, profile curvature, relief, roughness, rainfall, topographic wetness index (TWI), normalized difference vegetative index (NDVI), distance to roads, distance to rivers, land use/land cover (LULC), soil texture, and lithology) were initially selected to establish a landslide factor database. Thereafter, the multicollinearity test and information gain ratio (IGR) technique were applied to rank the importance of the factors. Subsequently, we used a series of metrics (e.g., accuracy, precision, recall, f-measure, area under the ROC (receiver operating characteristic) curve (AUC), kappa index, mean absolute error (MAE), and root mean square error (RMSE)) to evaluate the accuracy and performance of the six models. Based on the AUC values derived from the models, the GBDT+LR model with the highest AUC value (0.8168) was identified as the most efficient model for mapping landslide susceptibility, followed by the XGB+LR, XGB, RF+LR, GBDT, and RF models, which achieved AUC values of 0.8124, 0.8118, 0.8060, 0.7927, and 0.7883, respectively. The results from this study suggest that the stacking ensemble machine learning method is promising for use in landslide susceptibility mapping in the Zhangjiajie area and is capable of targeting the areas prone to landslides.

Photovoltaic (PV) generation is potentially uncertain. Probabilistic PV generation forecasting methods have been proposed with prediction intervals (PIs). However, several studies have dealt with geographically distributed PVs in a certain area. In this study, a two-step probabilistic forecast scheme is proposed for geographically distributed PV generation forecasting. Each step of the proposed scheme adopts ensemble forecasting based on three different machine-learning methods. In this case study, the proposed scheme was compared with conventional non-multistep forecasting. The proposed scheme improved the reliability of the PIs and deterministic PV forecasting results through 30 days of continuous operation with real data in Japan.

Freezing of Gait (FOG) is an impairment that affects the majority of patients in the advanced stages of Parkinson’s Disease (PD). FOG can lead to sudden falls and injuries, negatively impacting the quality of life for the patients and their families. Rhythmic Auditory Stimulation (RAS) can be used to help patients recover from FOG and resume normal gait. RAS might be ineffective due to the latency between the start of a FOG event, it’s detection and initialization of RAS. We propose a system capable of both FOG prediction and detection using signals from tri-axial accelerometer sensors that will be useful in initializing RAS with minimal latency. We compared the performance of several time frequency analysis techniques, including moving windows extracted from the signals, handcrafted features, Recurrence Plots (RP), Short Time Fourier Transform (STFT), Discreet Wavelet Transform (DWT) and Pseudo Wigner Ville Distribution (PWVD) with Deep Learning (DL) based Long Short Term Memory (LSTM) and Convolutional Neural Networks (CNN). We also propose three Ensemble Network Architectures that combine all the time frequency representations and DL architectures. Experimental results show that our ensemble architectures significantly improve the performance compared with existing techniques. We also present the results of applying our method trained on publicly available dataset to data collected from patients using wearable sensors in collaboration with A.T. Still University.

Autonomous Underwater Vehicles (AUVs) are highly efficient tools for underwater exploration, capable of carrying various payloads to perform specific missions as needed. To ensure the success of these missions and the spatiotemporal accuracy of sampled data, integrated navigation systems and appropriate filtering algorithms are essential. These systems process and merge motion data to provide accurate positioning information. The most commonly used algorithms in integrated navigation systems are Kalman filter and its nonlinear derivatives. Of these, the ensemble Kalman filter (EnKF) is particularly notable for its ability to handle nonlinear systems by incorporating Monte Carlo methods. This study proposes an enhanced adaptive EnKF algorithm to improve the smoothness and accuracy of the filtering process. Instead of the conventional Gaussian distribution, this algorithm employs a Laplace distribution to construct the system state vector and observation vector ensembles, enhancing stability against non-Gaussian noise. Additionally, the algorithm dynamically adjusts the number of vector members in the ensemble using adaptive mechanism by specifying thresholds during filtering, to adapt the requirements of real-world observational settings. Using measured data from field trials, including DVL, GPS, and electronic compass data, we examine the effects of various parameter settings on the algorithm's performance. Optimal parameter settings are identified to fine-tune and verify the filtering algorithm as well as its adaptive capability. The results demonstrate that the enhanced adaptive EnKF algorithm exhibits superior filtering performance in terms of both accuracy and smoothness compared to the conventional EnKF and EKF algorithms. This indicates the significant advantages of our proposed algorithm for AUV navigation.

Machine-learning methods used for classification are challenged by the class imbalance problem, where a certain class is underrepresented. Over/under-sampling the majority/minority class observations or model selection for ensemble methods alone might not be effective if the class imbalance ratio is very high. To address this concern, a novel method is presented for generating synthetic data for minority class observations in conjunction with an optimal tree ensemble classifier (OTEC). This novel synthetic method first generates minority class instances to balance the training data. Then it applies OTEC, where models are selected based on their performance using out-of-bag observations and training subsamples. A total of 20 benchmark problems on binary classification with moderate to extreme class imbalance are used to assess the efficacy of the proposed method against other well-known methods, including optimal tree ensemble, smote random forest, under-sampling random forest, oversampling random forest, k-nearest-neighbor, support vector machine, tree, and artificial neural network, using classification error rate, sensitivity, specificity, precision, recall and F1-score as performance metrics to assess the efficacy of the proposed method. The analyses presented in this study revealed that the proposed method based on data balancing and model selection yielded better results than other methods.

Cancer diagnosis and classification are pivotal for effective patient management and treatment planning. In this study, we present a comprehensive approach utilizing ensemble deep learning techniques to analyze breast cancer histopathology images. Our datasets are based on two widely employed datasets from different centers for two different tasks: BACH and BreakHis. Within the BACH Dataset, we deployed an ensemble strategy incorporating VGG16 and ResNet50 architec-tures to achieve precise classification of breast cancer histopathology images. Introducing a novel image patching technique, to preprocess a high-resolution image, which facilitates focused analysis of localized regions of interest. The annotated BACH dataset encompasses 400 WSIs across four distinct classes: Normal, Benign, In Situ Carcinoma, and Invasive Carcinoma. In addition, we employed the BreakHis dataset, utilizing VGG16, ResNet34, and ResNet50 models to classify mi-croscopic images into eight distinct categories (four benign and four malignant). For both models we leveraged a five-fold cross-validation approach for rigorous training and testing. Preliminary ex-perimental results indicate a Patch classification accuracy of 95.31% (on BACH dataset) and WSI image classification accuracy of 98.43% (BreakHis). This research significantly contributes to on-going endeavors in harnessing artificial intelligence to advance breast cancer diagnosis, potentially fostering improved patient outcomes and alleviating healthcare burdens.

Body-centered cubic bismuth (Bi) is considered an enticing pressure marker, and therefore it is highly desirable to command its accurate equation of state (EOS). However, significant discrepancies are noted among the previous experimental EOSs. In the present work, the EOS up to 300 GPa is theoretically obtained by direct solving the partition function via a direct integral approach (DIA). The calculated results nearly reproduce the hydrostatic experimental measurements below 75 GPa, and the deviations from the measurements gradually get larger with increasing pressure. Based on the ensemble theory of equilibrium state, DIA works with high precision particularly in high-pressure conditions, so the hydrostatic EOS presented in this work is expected to be a reliable pressure standard.

The efficient recognition and classification of personal protective equipment are essential for en-suring the safety of personnel in complex industrial settings. Using the existing methods, manually performing macro-level classification and identification of personnel in intricate spheres is tedious, time-consuming, and inefficient. The availability of several artificial intelligence models in recent times presents a new paradigm shift in object classification and tracking in complex settings. In this study, several compact and efficient deep learning model architectures are explored, and a new efficient model is constructed by fusing the learning capabilities of the individual, efficient models for better object feature learning and optimal inferencing. The new model construct follows the contributory learning theory whereby each fussed model brings its learned features, which are then combined to obtain a more accurate and rapid model using normalized quantization-aware learning. During the investigation, a separable convolutional driven model was constructed as a base model, and then the various efficient architectures combined for the rapid identification and classification of the various hardhat classes used in complex industrial settings. A remarkable rapid classification and accuracy were recorded with the new resultant model.

Wearable assistant devices play an important role in daily life for people with disabilities. Those who are hearing impaired may face dangers while walking or driving on the road. The major danger is their inability to hear warning sounds from cars or ambulances. Thus, the goal of this study is to develop a wearable assistant device for the hearing impaired to recognize emergency vehicle sirens on the road using edge computing. An EfficientNet-based fuzzy rank-based ensemble model was proposed to classify seven audio sounds, including human vocalizations and emergency vehicle sirens. This model was embedded in an Arduino Nano 33 BLE Sense development board. The audio files were respectively obtained from the CREMA-D dataset and Large Scale Audio dataset of emergency vehicle sirens on the road, with a total number of 8756 files. The seven audio sounds included neutral vocalization, anger vocalization, fear vocalization, happy vocalization, car horn sound, siren sound, and ambulance siren sound. The audio signal was converted into a spectrogram by the short-time Fourier transform as the feature. When one of the car horns, sirens, or ambulance sirens was detected, the wearable assistant device presented alarms through vibration and messages on the OLED panel. The performances of the EfficientNet-based fuzzy rank-based ensemble model in offline computing achieved an accuracy of 97.1%, precision of 97.79%, sensitivity of 96.8%, and specificity of 97.04%. In edge computing, the results were an accuracy of 95.2%, precision of 93.2%, sensitivity of 95.3%, and specificity of 95.1%. Thus, the proposed wearable assistant device has the potential benefit of helping the hearing impaired avoid traffic accidents.

A concept of ensemble averaged stellar reactors is developed to study the dynamics of processes occurring in stars, allocated in the ~ 200 pc solar neighborhood. According to the effective temperature value, four stellar classes are identified, for which the correlation coefficients and standard deviation are counted. The theory of the buoyancy terrestrial elements is generalized to stellar systems. It was suggested that stars are over-heated due to the shift parameters of the nuclear processes occurring inside the stars, which leads to the synthesis of transuranium elements until the achievement of a critical nuclear mass and star explosion. The heavy transuranium elements sink downward and are concentrated in the stellar depth layers. The physical explanation of the existence of the critical Chandrasekhar star limit has been offered. Based on the spatial analysis of overheated stars, it was suggested that the withdrawal of the stellar reactor from the equilibrium state is a consequence of extragalactic compression inside the galaxy arm due to the arm spirality (not to be confused with the spirality of the galaxy itself).

Computers have evolved over the years and as the evolution continues, we have been ushered into an era where high-speed internet has made it possible for devices in our homes, hospital, energy and industry to communicate with each other. This era is what is known as the Internet of Things (IoT). IoT has several benefits in the health, energy, transportation and agriculture sectors of a country’s economy. These enormous benefits coupled with the computational constraint of IoT devices which makes it difficult to deploy enhanced security protocols on them make IoT devices a target of cyber-attacks. One approach that has been used in traditional computing over the years to fight cyber-attacks is Intrusion Detection System (IDS). However, it is practically impossible to deploy IDS meant for traditional computers in IoT environments because of the computational constraint of these devices. In this regard, this study proposes a lightweight IDS for IoT devices using an incremental ensemble learning technique. We used Gaussian Naive Bayes and Hoeffding tree to build our incremental ensemble model. The model was then evaluated on the TON IoT dataset. Our proposed model was compared with other state-of-the-art methods proposed and evaluated using the same dataset. The experimental results show that the proposed model achieved an average accuracy of 99.98\%. We also evaluated the memory consumption of our model which showed that our model achieved a lightweight model status of 650.11KB as the highest memory consumption and 122.38KB as the lowest memory consumption.

Ensembles of Species Distribution Models (SDMs) represent the geographic ranges of pathogen vectors by combining alternative analytical approaches and merging information on vector occurrences with more extensive environmental data. Biased collection data impact SDMs, regardless of the target species but no studies have compared the differences in the distributions predicted by the ensemble models when different sampling frameworks are used for the same species. We compared Ensemble SDMs for two important Ixodid tick vectors, Amblyomma americanum and Ixodes scapularis in mainland Florida, USA, when inputs were either convenience samples of ticks, or collections obtained using the standard protocols promulgated by the U.S. Centers for Disease Control and Prevention. The Ensemble SDMs for the convenience samples and standard surveys showed only a slight agreement (Kappa = 0.060, A. americanum; 0.053, I. scapularis). Convenience sample SDMs indicated A. americanum and I. scapularis should be absent from 34.5% and 30.9% of the state where standard surveys predicted the highest likelihood of occurrence of the respective vectors. Ensemble models from standard surveys predicted 81.4% and 72.5% (A. americanum and I. scapularis) of convenience sample sites. Omission errors by standard survey SDMs, of the convenience collections, frequently were associated with adjacency to at least one SDM or errors in geocoding algorithms that failed to correctly locate convenience samples. These geocoding errors emphasize commonly overlooked needs to explicitly evaluate and improve data quality for vector survey data used in spatial models.

In this work, we investigate the ability of a data assimilation technique and space-borne observations to quantify and monitor changes in nitrogen oxides (NOx) emissions over North-Western Greece for the summers of 2018 and 2019. In this region, four lignite-burning power plants are located. The data assimilation technique, based on the Ensemble Kalman Filter method, is employed to combine space-borne atmospheric observations from the high spatial resolution Sentinel-5 Precursor (S5P) Tropospheric Monitoring Instrument (TROPOMI) and simulations using the LOTOS-EUROS Chemical Transport model. The Copernicus Atmosphere Monitoring Service-Regional European emissions (CAMS-REG, version 4.2) inventory based on year 2015 is used as the a priori in the simulations. Surface measurements of nitrogen dioxide (NO2) from air quality stations operating in the region are compared with the model surface NO2 output using either the a priori (base run) or the a posteriori (assimilated run) NOx emissions. The high biases found between the in situ NO2 measurements and the base run surface NO2 decrease in the assimilated run in most cases. The bias in the station near the largest power plant decreases to 2.0 μg/m3 (2.83 μg/m3) from 10.5 μg/m3 (8.46 μg/m3) in 2019 (2018 respectively). Concerning the estimated annual a posteriori NOx emissions it was found that, for the pixels hosting the two largest power plants, the assimilated run results in emissions decreased by ~40-50% for 2018 compared to 2015, whereas a larger decrease, of ~70% for both power plants, was found for 2019, after assimilating the space-born observations. For the same power plants, the European Pollutant Release and Transfer Register (E-PRTR) reports decreased emissions in 2018 and 2019 compared to 2015 (-35% and -38% in 2018, -62% and -72% in 2019), in good agreement with the estimated emissions. We further compare the a posteriori emissions to the reported energy production of the power plants during the summer of 2018 and 2019. Mean decreases of about -35% and-63% in NOx emissions are estimated for the two larger power plants in summer of 2018 and 2019, respectively, which are supported by similar decreases in the reported energy production of the power plants (~-30% and -70%, respectively).

Local binary pattern is one of the visual descriptors and can be used as a powerful feature extractor for texture classification. In this paper, a novel representation for face recognition is proposed, called it Bilateral Line Local Binary Patterns (BL-LBP). This scheme is an extension of Line Local Binary Patterns descriptors in the statistical learning subspace. The present bilateral descriptors are fused with an ensemble learning of calibrated SVM models. The performance of this scheme is evaluated using 5 standard face databases. It is found that it is robust against illumination variation, diverse facial expressions and head pose variations and its recognition accuracy reaches 98 percent, running on a mobile device with a processing speed of 63 ms per face. Results suggest that our proposed method can be very useful for the vision systems that have limited resources where the computational cost is critical.

Molecular dynamics simulation is currently the theoretical technique eligible to simulate a wide range of systems from soft condensed matter to biological systems. However, of the excellent results that the technique has arrogated, this approach remains computationally expensive, but with the emergence of the new supercomputing technologies bases on graphics processing units graphical processing units-based systems GPUs, the perspective has changed. The GPUs allow performing large and complex simulations at a significantly reduced time. In this work, we present recent innovations in the acceleration of molecular dynamics in GPUs to simulate non-Hamiltonian systems. In particular, we show the performance of measure-preserving geometric integrator in the canonical ensemble, that is, at constant temperature. We provide a validation and performance evaluation of the code by calculating the thermodynamic properties of a Lennard-Jones fluid. Our results are in excellent agreement with reported data reported from literature, which were calculated with CPUs. The scope and limitations for performing simulations of high-throughput MD under rigorous statistical thermodynamics in the canonical ensemble are discussed and analyzed.

Software fault prediction is the very consequent research topic for software quality assurance. Data driven approaches provide robust mechanisms to deal with software fault prediction. However, the prediction performance of the model highly depends on the quality of dataset. Many software datasets suffers from the problem of class imbalance. In this regard, under-sampling is a popular data pre-processing method in dealing with class imbalance problem, Easy Ensemble (EE) present a robust approach to achieve a high classification rate and address the biasness towards majority class samples. However, imbalance class is not the only issue that harms performance of classifiers. Some noisy examples and irrelevant features may additionally reduce the rate of predictive accuracy of the classifier. In this paper, we proposed two-stage data pre-processing which incorporates feature selection and a new Rough set Easy Ensemble scheme. In feature selection stage, we eliminate the irrelevant features by feature ranking algorithm. In the second stage of a new Rough set Easy Ensemble by incorporating Rough K nearest neighbor rule filter (RK) afore executing Easy Ensemble (EE), named RKEE for short. RK can remove noisy examples from both minority and majority class. Experimental evaluation on real-world software projects, such as NASA and Eclipse dataset, is performed in order to demonstrate the effectiveness of our proposed approach. Furthermore, this paper comprehensively investigates the influencing factor in our approach. Such as, the impact of Rough set theory on noise-filter, the relationship between model performance and imbalance ratio etc. comprehensive experiments indicate that the proposed approach shows outstanding performance with significance in terms of area-under-the-curve (AUC).

Heart disease is a global health concern of paramount importance, causing a significant number of fatalities and disabilities. Precise and timely diagnosis of heart disease is pivotal in pre-venting adverse outcomes and improving patient well-being, thereby creating a growing demand for intelligent approaches to predict heart disease effectively. This paper introduces an Ensemble Heuristic-Metaheuristic Feature Fusion Learning (EHMFFL) algorithm for heart disease diagnosis. Within the EHMFFL algorithm, a diverse ensemble learning model is crafted, featuring different feature subsets for each heterogeneous base learner, including support vector machine, K-nearest neighbors, logistic regression, random forest, naive bayes, decision tree, and XGBoost. The primary objective is to identify the most pertinent features for each base learner, leveraging a combined heuristic-metaheuristic approach that integrates the heuristic knowledge of Pearson correlation coefficient with the metaheuristic-driven grey wolf optimizer. The second objective is to aggregate the decision outcomes of the various base learners through ensemble learning, aimed at constructing a robust prediction model. The performance of the EHMFFL algorithm is rigorously assessed using the Cleveland and Statlog datasets yielding remarkable results with an accuracy of 91.8% and 88.9%, respectively, surpassing state-of-the-art machine learning, ensemble learning, and feature selection techniques in heart disease diagnosis. These findings underscore the potential of the EHMFFL algorithm in enhancing diagnostic accuracy for heart disease and providing valuable support to clinicians in making more informed decisions regarding patient care.

A morphological feature estimation method is presented, that can be used to monitor fish from low contrast underwater images and videos. The fish orientation is classified in order to apply a shape alignment technique that is based on the Ensemble of Regression Trees machine learning method. Shape alignment allows the estimation of fish dimensions (length, height, mass) and the location of fish body parts of particular interest such as the eyes and gills. The developed system can be exploited both for fish monitoring in open sea as well as aquacultures where non-invasive, low cost morphological feature extraction is essential. Fish health can be assessed from malformations in body shape, the color of the eyes or the gills as well as the fish behavior. The proposed method can estimate the position of 18 landmarks with an accuracy of about 95% from low resolution and low contrast underwater images where the fish can be hardly distinguished from its background. Hardware acceleration can be applied at various stages of the proposed method for real time video processing. As a case study, the developed system has been trained and tested with several Mediterranean fish species in the category of seabream or similar: diplodous sargus annularis (white seabream), diplodus annularis seabream (spawn), oblada melanura (saddled seabream), pagrus pagrus (common seabream), etc. A large dataset with low resolution underwater videos and images has been created in the context of this work.

This paper presents ensemble learning of multi-source satellite sensors dataset to obtain better predictive performance of the forest biomass. Spectral, spectral-indices, and spectral-textural features were generated from two optical satellite sensors, Landsat 8 Operational Land Imager (OLI) and Sentinel-2 Multispectral Instrument (MSI). In addition, two radar satellite sensors, Sentinel-1 C-band Synthetic Aperture Radar (CSAR), and Advanced Land Observing Satellite (ALOS-2) Phased Array type L-band Synthetic Aperture Radar (PALSAR-2) were utilized to generate backscattering and backscattering-textural features. The plot-wise above ground biomass data available from five forests in New England region were utilized. Ensemble learning of multi-source satellite sensors dataset was carried out by employing four machine learning regressors namely, Support Vector Machines (SVM), Random Forests (RF), Gradient Boosting (GB), and Multilayer Perceptron (MLP). A five-fold cross-validation method was used to evaluate predictive performance of the multi-source satellite sensors. The integration of multi-source satellite features, comprising of spectral, spectral-indices, backscattering, spectral-textural, and backscattering-textural information, through ensemble learning and cross-validation approach implemented in the research showed promising results (R² = 0.81, RMSE = 46.2 Mg/ha) for the estimation of plots-level forest biomass in New England region.

The progressive impairment analysis in gait from neurological diseases patients such as Hereditary Ataxias (HA) has been carried out using gait data collected with movement sensors. This research is focused on finding the minimum amount required of gait features to recognize efficiently and less intrusive way, HA patients based on data collected with iPhone movement sensors placed on the ankles from 14 HA patients and 14 healthy people. A twofold proposal is made , first a local minimum prominent peak criterion to find out the starting point of each stride, to get 10-stride window about which 56 spatial-temporal features are derived; second a search strategy based on Hill Climbing algorithm to reduce the number of gait features and sensors. The main results were the findings that with two gait patterns a 96% of classification accuracy was achieved by using K-Nearest Neighbors (KNN) and Multi-Layer Perceptron (MLP) algorithms, but in addition, MLP only right ankle sensor patterns were required which also allows to reduce the intrusion.

Automated medical diagnosis is one of the important machine learning applications in the domain of healthcare. In this regard, most of the approaches primarily focus on optimizing the accuracy of classification models. In this research, we argue that unlike general-purpose classification problems, medical applications, such as chronic kidney disease (CKD) diagnosis, require special treatment. In the case of CKD, apart from model performance, other factors such as the cost of data acquisition may also be taken into account to enhance the applicability of the automated diagnosis system. In this research, we have proposed two techniques for cost-sensitive feature ranking. An ensemble of decision tree models is employed in both the techniques for computing the worth of a feature in the CKD dataset. An automatic threshold selection heuristic is also introduced which is based on the intersection of features’ worth and their accumulated cost. A set of experiments are conducted to evaluate the efficacy of the proposed techniques on both tree-based and non-tree based classification models. The proposed approaches are also evaluated against several comparative techniques. Furthermore, it is demonstrated that the proposed techniques select around 1/4^th of the original CKD features while reducing the cost by a factor of 7.42 of the original feature set. Based on the extensive experimentation it is concluded that the proposed techniques employing feature-cost interaction heuristic tend to select feature subsets that are both useful and cost-effective.

To understand functions of biomolecules such as proteins, not only structures but their conformational change and kinetics are important to be characterized but its atomistic details are hard to obtain both experimentally and computationally. We review our recent computational studies using novel enhanced sampling techniques for conformational sampling of biomolecules and calculations of their kinetics. For efficiently characterizing the free energy landscape of a biomolecule, we introduce the multiscale enhanced sampling method, which uses a combined system of atomistic and coarse-grained models. Based on the idea of Hamiltonian replica exchange, we can recover the statistical properties of the atomistic model without any biases. We next introduce the string method as a path search method to calculate the minimum free energy pathways along a multidimensional curve in high dimensional space. Finally we introduce novel methods to calculate kinetics of biomolecules based on the ideas of path sampling: One is the Onsager-Machlup action method, and the other is the weighted ensemble method. Some applications of above methods to biomolecular systems are also discussed and illustrated.

This study comprehensively investigates the stress distribution and aging effects in Ethylene Propylene Diene Monomer (EPDM) and Liquid Silicone Rubber (LSR) gasket materials through a novel integration of hyperelastic modeling and advanced machine learning techniques. By employing the Mooney-Rivlin, Ogden, and Yeoh hyperelastic models, we evaluate the mechanical behavior of EPDM and LSR under conditions of no aging, heat aging, and combined heat and sulfuric acid exposure. Each model reveals distinct sensitivities to stress distribution and material deformation, providing unique insights into material degradation processes. Additionally, we utilize machine learning for predictive analysis, enhancing our understanding of stress responses and identifying critical aging effects. The findings offer practical implications for selecting suitable gasket materials and developing predictive maintenance strategies in industrial applications, such as fuel cells, where material integrity under stress and aging is paramount. This dual approach highlights the mechanical resilience and vulnerabilities of EPDM and LSR and opens avenues for real-time predictive analytics and material performance optimization.

Non-Destructive Testing (NDT) is an appealing technique for confirming the welding quality and ensuring structural integrity without causing damage. It assists in regulatory compliance, risk mitigation, and process optimization for improved industrial reliability. This study reviews potential NDT approaches. Through a rigorous analysis of existing surveys, we aim to decipher the current landscape and highlight the significant advancements in the field. Because of the potential of artificial intelligence (AI) assistive X-ray imaging-based NDT, we particularly examine the integration of AI algorithms and X-ray imaging in the NDT of welds. This convergence represents a paradigm shift, redefining traditional methods and ushering in a new era of precision, automation, and efficiency. As we navigate through potential X-ray imaging datasets, delve into crucial image processing techniques, examine feature extraction methods, and explore AI algorithms, our survey reveals the intricate interplay of technologies that drive automated weld defect categorization. The review broadens its focus by including various practical applications, highlighting the adaptable utility of AI-assistive X-ray imaging for weld defect detection in potential industrial applications. Moreover, the promising opportunities and nuanced challenges associated with integrating X-ray imaging and AI in weld integrity assessment are highlighted. It provides a comprehensive perspective on this rapidly evolving field.

Machine learning models are increasingly being used in critical domains, but their complexity, lack of transparency, and poor interpretability remain problematic. Decision trees (DTs) and rule-based approaches are well-known examples of interpretable models, and numerous studies have investigated techniques for approximating tree ensembles using DTs or rule sets; however, tree ensemble approximators do not consider interpretability. These methods are known to generate three main types of rule sets: DT-based, unordered-based, and decision list-based. However, no known metric has been devised to distinguish and compare these rule sets. Therefore, the present study proposes an interpretability metric to allow comparisons of interpretability between different rule sets, such as decision list- and DT-based rule sets, and investigates the interpretability of the rules generated by the tree ensemble approximators. To provide new insights into the reasons why decision list-based and inspired classifiers do not work well for categorical datasets consisting of mainly nominal attributes, we compare objective metrics and rule sets generated by the tree ensemble approximators and the \textit{Recursive-Rule eXtraction algorithm (Re-RX) with J48graft}. The results indicated that \textit{Re-RX with J48graft} can handle categorical and numerical attributes separately, has simple rules, and achieves high interpretability, even when the number of rules is large.

Multilabel learning goes beyond standard supervised learning models by associating a sample with more than one class label. Among the many techniques developed in the last decade to handle multilabel learning best approaches are those harnessing the power of ensembles and deep learners. This work proposes merging both methods by combining a set of gated recurrent units, temporal convolutional neural networks, and long short-term memory networks trained with variants of the Adam optimization approach. We examine many Adam variants, each fundamentally based on the difference between present and past gradients, with step size adjusted for each parameter. We also combine Incorporating Multiple Clustering Centers and a bootstrap-aggregated decision trees ensemble, which is shown to further boost classification performance. In addition, we provide an ablation study for assessing the performance improvement that each module of our ensemble produces. Multiple experiments on a large set of datasets representing a wide variety of multilabel tasks demonstrate the robustness of our best ensemble, which is shown to outperform the state-of-the-art. The MATLAB code for generating the best ensembles in the experimental section will be made available at https://github.com/LorisNanni.

Soil temperature is a fundamental parameter in water resources and engineering. A cost-effective model which can forecast soil temperature accurately is extensively needed. Recently, many studies have applied artificial intelligence (AI) at both surface and underground levels for soil temperature prediction. However, there is no comprehensive and detailed assessment of the performance of different AI approaches in soil temperature estimation, and primarily limited atmospheric variables are used as input data for AI models. In the present study, great varieties of various land and atmospheric variables are applied to evaluate the performance of a wide range of AI methods on soil temperature prediction. Herein, thirteen approaches, from classic regressions to well-established methods of random forest and gradient boosting to advanced AI techniques like multi-layer perceptron and deep learning are taken into account. The results show that AI is a promising approach in climate parameter forecast and deep learning demonstrates the best performance among other models. It has the highest R-squared ranging from 0.957 to 0.980, the lowest NRMSE ranging from 2.237% to 3.287% and the lowest MAE, ranging from 0.510 to 0.743 in predicting soil temperature. The prediction is repeated for different sizes of data, and prediction outcomes confirm the conclusion mentioned above.

This paper explores how smart cities can cope with land subsidence and liquefaction in the context of rapid urbanization in Japan. Since the 1960s, liquefaction has become an important topic in geotechnical engineering, and great efforts have been made to evaluate the resistance of soil to liquefaction. There is currently a lack of machine learning applications specifically for smart cities in areas such as geological hazards. This study uses two machine learning techniques, artificial neural networks and ensemble learning, to obtain a prediction model with high performance in predicting the bearing layer depth to improve the accuracy of geo-engineering surveys. The model was developed by analyzing actual survey data from 433 locations in Setegaya, Tokyo, by using artificial neural networks (ANNs) and bagging, respectively. The results show that machine learning has great advantages in predicting the bearing layer depth. In addition, compared with a single model such as artificial neural networks, the prediction performance of ensemble learning can be improved by about 20%. Both interdisciplinary approaches can help predict address risks and thus promote sustainable urban development, highlighting the potential of smart cities in the future.

We extend Ziv and Lempel's model of finite-state encoders to the realm of lossy compression of individual sequences. In particular, the model of the encoder includes a finite-state reconstruction codebook followed by an information lossless finite-state encoder that compresses the reconstruction codeword with no additional distortion. We first derive two different lower bounds to the compression ratio that depend on the number of states of the lossless encoder. Both bounds are asymptotically achievable by conceptually simple coding schemes. We then show that when the number of states of the lossless encoder is large enough in terms of the reconstruction block-length, the performance can be improved, sometimes significantly so. In particular, the improved performance is achievable using a random-coding ensemble that is universal, not only in terms of the source sequence, but also in terms of the distortion measure.

Wearable devices have become ubiquitous, collecting rich temporal data that offers valuable insights into human activities, health monitoring, and behavior analysis. Leveraging this data, researchers have developed innovative approaches to classify and predict time-based patterns and events in human life. Time-based techniques allow the capture of intricate temporal dependencies, which is the nature of the data coming from wearable devices. This paper focuses on predicting well-being factors, such as stress, anxiety, positive and negative affect, on the Tesserae dataset collected from office workers. We examine the performance of different methodologies, including deep learning architectures, LSTM, ensemble techniques, Random Forest (RF) and XGBoost and compare their performances for time-based and non-time-based versions. In time-based versions, we investigate the effect of previous records of well-being factors on the upcoming ones. The overall results show that time-based LSTM performs the best among conventional (non-time-based) RF, XGBoost, and LSTM. The performance even increases when we consider a more extended previous period, in this case, 3 past-days rather than 1 past-day to predict the next day. Furthermore, we explore the corresponding biomarkers for each well-being factor using feature ranking. The obtained rankings are compatible with the psychological literature. In this work, we validated them based on device measurements rather than subjective survey responses.

A machine learning method for classifying Lung UltraSound is here proposed to pro- vide a point of care tool for supporting a safe, fast and accurate diagnosis, that can also be useful during a pandemic like as SARS-CoV-2. Given the advantages (e.g. safety, rapidity, portability, cost-effectiveness) provided by the ultrasound technology over other methods (e.g. X-ray, computer tomography, magnetic resonance imaging), our method was validated on the largest LUS public dataset. Focusing on both accuracy and efficiency, our solution is based on an efficient adaptive ensembling of two EfficientNet-b0 models reaching 100% of accuracy, which, to our knowledge, outperforms the previous state-of-the-art. The complexity of this solution keeps the number of parameters in the same order as an EfficientNet-b0 by adopting specific design choices that are adaptive ensembling with a combination layer, ensembling performed on the deep features, minimal ensemble only two weak models. Moreover, a visual analysis of the saliency maps on sample images of all the classes of the dataset reveals where the focus is on an inaccurate weak model versus an accurate model.

Automated lying-posture tracking is important in preventing bed-related disorders such as pressure injuries, sleep apnea, and lower-back pain. Prior research studied in-bed lying posture tracking using sensors of different modalities (e.g., accelerometer and pressure sensors). However, there remain significant gaps in research about how to design efficient in-bed lying posture tracking systems. These gaps can be articulated through several research questions as follows. First, can we design a single-sensor, pervasive, and inexpensive system that can accurately detect lying postures? Second, what computational models are most effective in the accurate detection of lying postures? Finally, what physical configuration of the sensor system is most effective for lying posture tracking? To answer these important research questions, in this article, we propose a comprehensive approach to design a sensor system that uses a single accelerometer along with machine learning algorithms for in-bed lying posture classification. We design two categories of machine learning algorithms based on deep learning and traditional classification with handcrafted features to detect lying postures. We also investigate what wearing sites are most effective in accurate detection of lying postures. We extensively evaluate the performance of the proposed algorithms on nine different body locations and four human lying postures using two datasets. Our results show that a system with a single accelerometer can be used with either deep learning or traditional classifiers to accurately detect lying postures. The best models in our approach achieve an F-Score that ranges from 95.2% to 97.8% with a coefficient of variation from 0.03 to 0.05. The results also identify the thighs and chest as the most salient body sites for lying posture tracking. Our findings in this article suggest that because accelerometers are ubiquitous and inexpensive sensors, they can be a viable source of information for pervasive monitoring of in-bed postures.

Mobile devices (MD) are used by mobile cloud computing (MCC) customers users because of their 11 portability and robust connectivity and the ability to house and operate third-party applications 12 (apps). However, the apps installed on a MD may pose data security risks to the MD owner and to 13 other MCC users, especially when the requested permissions include access to sensitive data (e.g., 14 user’s location and contacts). Calculating the risk score of an app or quantifying its potential 15 harmfulness based on user input or on data gathered while the app is actually running may not 16 provide reliable and sufficiently accurate results to avoid harmful consequences. This study 17 develops and evaluates a risk assessment framework for Android-based MDs that does not depend 18 on user input or on actual app behaviour. Rather, an app risk evaluator assigns a risk category to 19 reach resident app based on the app’s classification (benign or malicious) and the app’s risk score. 20 The app classifier (a trained machine learning model) considers the permissions and the intents 21 requested by the app. The apps risk score is calculated by a probabilistic function based on the 22 app’s use of a set of selected dangerous permissions. The results from the testing of an instance of 23 the framework on a MD with real-life resident apps indicated that the proposed security solution 24 was effective and feasible.

The increasing prevalence of Metabolic Syndrome (MetS), a serious condition associated with elevated risks of cardiovascular diseases, stroke, and type 2 diabetes, underscores the urgent need for effective diagnostic tools. This research carefully examines the effectiveness of 16 diverse machine learning (ML) models in predicting MetS, a multifaceted health condition linked to increased risks of heart disease and other serious health complications. Utilizing a comprehensive, unpublished dataset of imbalanced blood test results, spanning from 2017 to 2022, from the Laboratory Information System of the General Hospital of Amfissa, Greece, our study embarks on a novel approach to enhance MetS diagnosis. By harnessing the power of advanced ML techniques, we aim to predict MetS with greater accuracy using non-invasive blood test data, thereby reducing the reliance on more invasive diagnostic methods. Central to our methodology is the application of the Borda count method, an innovative technique employed to refine the dataset. This process prioritizes the most relevant variables, as determined by the performance of the leading ML models, ensuring a more focused and effective analysis. Our selection of models, encompassing a wide array of ML techniques, allows for a comprehensive comparison of their individual predictive capabilities in identifying MetS. This study not only illuminates the unique strengths of each ML model in predicting MetS but also reveals the expansive potential of these methods in the broader landscape of health diagnostics. The insights gleaned from our analysis are pivotal in shaping more efficient strategies for the management and prevention of Metabolic Syndrome, thereby addressing a significant concern in public health.

Antisense oligonucleotide (ASO)-mediated exon skipping has become a valuable tool for investigating gene function and developing gene therapy. Machine learning-based computational methods such as eSkip-Finder have been developed to predict the efficacy of ASOs via exon skipping. However, these methods are computationally demanding, and the accuracy of predictions remains suboptimal. In this study, we propose a new approach to reduce computational burden and improve prediction performance by using feature selection within machine learning algorithms and ensemble learning techniques. We evaluated our approach using a dataset of experimentally validated exon skipping events, dividing it into training and testing sets. Our results demonstrate that using a 3-way voting approach with random forest, gradient boosting, and XGBoost can significantly reduce computation time to under ten seconds while improving prediction performance, as measured by R2 for both 2’-O-methyl nucleotides (2OMe) and phosphorodiamidate morpholino oligomers (PMOs). Additionally, the feature importance ranking derived from our approach is in good agreement with previously published results. Our findings suggest that our approach has the potential to enhance the accuracy and efficiency of predicting ASO efficacy via exon skipping. It could also facilitate the development of novel therapeutic strategies. This study could contribute to the ongoing efforts to improve ASO design and optimize gene therapy approaches.

Antisense oligonucleotide (ASO)-mediated exon skipping has emerged as a powerful tool for examining the function of genes and exons in basic research, as well as gene therapy. Computational methods, such as eSkip-Finder, have been developed to predict the efficacy of ASOs via exon skipping using machine learning. However, these methods can be computationally demanding and the prediction accuracy of the tool is not yet optimal. In this study, we propose an approach to reduce computational burden and improve prediction performance by utilizing feature selection within machine learning algorithms and employing ensemble learning techniques. The method was evaluated using a dataset of genes with experimentally validated exon skipping events. The dataset was divided into training and testing sets to assess the accuracy of the algorithm. Our results demonstrate that using a 3-way voting approach with random forest, gradient boosting, and XGBoost can significantly reduce computation time to under ten seconds while improving prediction performance, as measured by R2 for both 2’-O-methyl nucleotides (2OMe) and phosphorodiamidate morpholino oligomers (PMOs). Additionally, the feature importance ranking derived from our approach is in good agreement with previously published results. These findings suggest that this approach has the potential to enhance the efficiency and accuracy of predicting ASO efficacy via exon skipping, facilitating the development of novel therapeutic strategies.

Labelling techniques such as electron paramagnetic resonance spectroscopy and single-molecule fluorescence resonance energy transfer, allow access to distances in the range of tens of angstroms, corresponding to the size of proteins and small to medium-sized protein complexes. Such measurements do not require long-range ordering and are therefore applicable to systems with partial disorder. Data from spin-label-based measurements can be processed into distance distributions that provide information about the extent of such disorder. Using such information in modelling presents several challenges, including a small number of restraints, the influence of the label itself on the measured distance and distribution width, and balancing the fitting quality of the long-range restraints with the fitting quality of other restraint subsets. Starting with general considerations about integrative and hybrid structural modelling, this review provides an overview of recent approaches to these problems and identifies where further progress is needed.

The rate of technical innovation, system interconnection, and advanced communications undoubtedly boost distributed energy networks' efficiency. However, when an additional attack surface is made available, the possibility of an increase in attacks is an unavoidable result. The energy ecosystem's significant variety draws attackers with various goals, making any critical infrastructure a threat, regardless of scale. Outdated technology and other antiquated countermeasures that worked years ago cannot address the complexity of current threats. As a result, robust artificial intelligence cyber-defense solutions are more important than ever. Based on the above challenge, this paper proposes an ensemble transfer learning spiking immune system for adaptive smart grid protection. It is an innovative Artificial Immune System (AIS) that uses a swarm of Evolving Izhikevich Neural Networks (EINN) in an Ensemble architecture, which optimally integrates Transfer Learning methodologies. The effectiveness of the proposed innovative system is demonstrated experimentally in multiple complex scenarios that optimally simulate the modern energy environment. In this way, the proposed system fully automates the strategic security planning of energy networks with computational intelligence methods. It allows the complete control of the digital strategies of the potential infrastructure that frames it, thus contributing to the timely and valid decision-making during cyber-attacks.

Three significant changes have occurred in the winter climate in Europe recently: increased UK flooding; Iberian drought; and warmer temperatures north of the Alps. The literature links all three to a persistent, significant increase in sea level pressure over Southern Europe, the Mediterranean, Iberia and the Eastern Atlantic (SEMIEA) which changes the atmospheric circulation system: forcing cold fronts to the north away from Iberia; and creating a south westerly flow around the northern perimeter of the high-pressure region bringing warmer, moist air from the subtropical Atlantic to the UK and Europe which increases precipitation in the UK and raises the temperature in Europe. I use the Last Millennium Ensemble, MERRA-2 and Terra-NCEP data to demonstrate that the extreme, anthropogenic, West African aerosol Plume (WAP) which only exists from December to April perturbs the northern, regional Hadley Circulation creating the high pressure in the SEMIEA. I also show that the anthropogenic WAP has only existed in its extreme form in recent decades as the two major sources of the WAP aerosols: biomass burning; and gas flaring have both increased significantly since 1950 due to: a four-fold increase in population; and gas flaring rising from zero to 7.4 billion m3/annum and note that this time span coincides with the changes in the three elements of the winter climate of Europe. I also suggest that it may be possible to eliminate the WAP and return the winter climate of Europe to its natural state after the crucial first step of recognising the cause of the changes is taken.

Climate analogues provide forestry practice empirical evidence of how forests are managed in “twin” regions, i.e. regions where the current climate is comparable to the expected future climate at a site of interest. But the uncertain future climate creates uncertainty in how to adapt the forests. We therefore investigate how the uncertainty in future climate affects tree species suitability and whether there is a common underlying pattern. Like most studies we employ different ensemble variants of RCP 4.5 and 8.5. But instead of focusing on a single point in future time, we resolve each variant in a climate trajectory from 2000 to 2100. We calculate climatic distances between the climate trajectories of our site of interest and the current climate in Europe, generating maps with twin regions from 2000 to 2100. Forest inventories from the twin regions allow us to trace the changes in the prevalence of 23 major tree species. We find that it is not the direction but rather the velocity of the change that differs between the scenarios. We use this pattern to propose a tree species suitability concept that integrates the uncertainty in future climate. Twin regions provide further information on silvicultural practices, pest management, product chains etc.

During extreme space weather events, transient geomagnetic disturbances initiated by solar eruptive activities can induce geomagnetically induced currents (GICs), which have severe impacts on power grid systems and oil/gas pipelines. Observations indicate that GICs in power grids are characterized by large fluctuation amplitudes, broad frequency ranges, and significant randomness. Their behavior is influenced by several factors, including the sources of space weather disturbance, Earth's electrical conductivity distribution, the structural integrity and performance of power grid equipment, and so on. Consequently, predicting local grid GICs has been a highly challenging task. This paper presents a hybrid prediction approach using actual GIC data from power grids and deep learning techniques. We employ various technical methods, including Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN), Convolutional Neural Networks (CNN), Long Short-Term Memory Networks (LSTM), and Attention mechanisms, to investigate short-term prediction methods for local grid GICs. The study uses GIC monitoring samples from November 8th to November 10th, 2004, for model training and testing. The results are evaluated using the coefficient of determination R^2 , root mean square error (RMSE), and mean absolute error (MAE). Preliminary research suggests that the CEEMDAN-CNN-LSTM-Attention combined model significantly improves prediction accuracy and reduces the time delay in GIC prediction during geomagnetic storms compared to using LSTM neural networks alone.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. In contemporary times, the transition from conventional electricity grids to Smart Grids constitutes an area where extensive research is conducted on a global scale. Among the research challenges, the investigation of Deep Transfer Learning (DTL) in the field of electricity load forecasting represents a fundamental effort that imparts generality to Artificial Intelligence applications, due to new capabilities, such as knowledge transfer and computational power reduction. In this paper a comprehensive study is conducted for day-ahead electricity load forecasting. For this purpose, three Sequence-to-Sequence (Seq2seq) Deep Learning (DL) models are used, namely the Multilayer Perceptron (MLP), the Convolutional Neural Network (CNN) and the Ensemble Learning Model (ELM), which is consisted of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL and emphasizing the way the datasets are trained and fine-tuning for higher forecasting accuracy. In order to implement the forecasting strategies using Deep Learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1-24 hours) for each month of the year for Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. After several trials, four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) contains the training of the DL models using Lesvos dataset, and the testing period performed directly on the Chios dataset without fine-tuning. The fourth strategy is a Multi-task Deep Learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. In this paper, we explore the performance of DTL and compare the results with those produced with MTDL. The results demonstrated that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, the two cases with fine-tuning (DTL Case 1 and 2) outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it has been concluded that the MLP model presents best monthly forecasts with a MAPE of 6.24% and 6.01% for the first two cases, the CNN model presents best monthly forecasts with a MAPE of 5.57% and 5.60% respectively and the ELM model achieves best monthly forecasts with a MAPE of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

Accurate short-term solar irradiance forecasting is crucial for the efficient operation of solar energy driven photovoltaic (PV) power plants. In this research, we introduce a novel hybrid ensemble forecasting model that amalgamates the strengths of machine learning tree-based models and deep learning neuron-based models. The hybrid ensemble model integrates the interpretability of tree-based models with the capacity of neuron-based models to capture complex temporal dependencies within solar irradiance data. Furthermore, stacking and voting ensemble strategies are employed to harness the collective strengths of these models, significantly enhancing prediction accuracy. This integrated methodology is enhanced by incorporating pixels from satellite images provided by the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT). These pixels are converted into structured data arrays and employed as exogenous inputs in the algorithm. The primary objective of this study is to improve the accuracy of short-term solar irradiance predictions, spanning a forecast horizon up to 6 hours ahead. The incorporation of EUMETSAT satellite image pixels data enables the model to extract valuable spatial and temporal information, thus enhancing the overall forecasting precision. This research also includes detailed analysis of the derivation of GHI using satellite images. The study was carried out and the models tested across three distinct locations in Austria. A detailed comparative analysis was carried out for traditional Satellite (SAT) and Numerical Weather Prediction (NWP) models with hybrid models. Our findings demonstrate a higher skill score for all of the approaches compared to smart persistent model and consistently highlight the superiority of the hybrid ensemble model for short-term prediction window of 1 to 6 hours. This research underscores the potential for enhanced accuracy of the hybrid approach to advance short-term solar irradiance forecasting, emphasizing its effectiveness at understanding the intricate interplay of the meteorological variables affecting solar energy generation worldwide. The results of this investigation carry noteworthy implications for advancing solar energy systems, thereby supporting the sustainable integration of renewable energy sources into the electrical grid.

This paper briefly reviews the state of the art in artificial intelligence including inductive and deductive methods. Deep learning and ensemble machine learning lie in inductive methods while automated reasoning implemented in deductive computer languages (Prolog, Otter, and Z3) is based on deductive methods. In the inductive methods, intelligence is inferred by pseudorandom number for creating the sophisticated decision trees in Go (game), Shogi (game), and quiz bowl questions. This paper demonstrates how to wisely use the pseudorandom number for solving coin-weighing puzzles with the deductive method. Monte Carlo approach is a general purpose problem-solving method using random number. The proposed method using pseudorandom number lies in one of Monte Carlo methods. In the proposed method, pseudorandom number plays a key role in generating constrained solution candidates for coin-weighing puzzles. This may be the first attempt that every solution candidate is solely generated by pseudorandom number while deductive rules are used for verifying solution candidates. In this paper, the performance of the proposed method was measured by comparing with the existing open source codes by solving 12-coin and 24-coin puzzles respectively.

The radar sensor described realizes healthcare monitoring capable of detecting subject chest-wall movement caused by cardiopulmonary activities, and wirelessly estimating the respiration and heartbeat rates of the subject without attaching any devices to the body. Conventional single-tone Doppler radar can only capture Doppler signatures because of a lack of bandwidth information with noncontact sensors. In contrast, we take full advantage of impulse radio ultra-wideband (IR-UWB) radar to achieve low power consumption and convenient portability, with a flexible detection range and desirable accuracy. A noise reduction method based on improved ensemble empirical mode decomposition (EEMD) and a vital sign separation method based on the continuous-wavelet transform (CWT) are proposed jointly to improve the signal-to-noise ratio (SNR) in order to acquire accurate respiration and heartbeat rates. Experimental results illustrate that respiration and heartbeat signals can be extracted accurately under different conditions. This noncontact healthcare sensor system proves the commercial feasibility and considerable accessibility of using compact IR-UWB radar for emerging biomedical applications.

Macromolecular assemblies, such as protein complexes, undergo continuous structural dynamics, including global reconfigurations critical for their function. Two fast analytical methods are widely used to study these global dynamics, namely elastic network model normal mode analysis and principal component analysis of ensembles of structures. These approaches have found wide use in various computational studies, driving the development of complex pipelines in several software packages. One common one has been conformational sampling through hybrid simulations incorporating all-atom molecular dynamics and global modes of motion. However, wide functionality is only available for experienced programmers with limited capabilities for other users. We have, therefore, integrated one popular and extensively developed software for such analyses, the ProDy Python application programming interface, into the Scipion workflow engine. This enables a wider range of users to access a complete range of macromolecular dynamics pipelines beyond the core functionalities available in its command-line applications and the normal mode wizard in VMD. The new protocols and pipelines can be further expanded and integrated into larger workflows together with other software packages for cryo-electron microscopy image analysis and molecular simulations. We present the resulting plugin, Scipion-EM-ProDy, in detail, highlighting the rich functionality made available by its development.

Semi-supervised consensus clustering is a promising strategy to compensate for the subjectivity of clustering and its sensitivity to design factors, with various techniques being recently proposed to integrate domain knowledge and multiple clustering partitions. In this article we present a new approach that makes double use of domain knowledge, namely to build the initial partitions as well as to combine them. In particular, we show how to model and integrate must-link and cannot-link constraints into the objective function of a generic consensus clustering (??) framework that maximizes the similarity between the consensus partition and the input partitions, which have, in turn, been enriched with the same constraints. In addition, borrowing from the theory of functional dependencies, the integrated framework exploits the notions of deductive closure and minimal cover to take full advantage of the logical implication between constraints. Using standard UCI benchmarks, we found that the resulting algorithm, termed ??? (double-Constrained Consensus Clustering), was more effective than plain ?? at combining base constrained partitions. We then argue that ??? is especially well-suited to profiling counterfeit e-commerce websites, because constraints can be acquired by leveraging specific domain features, and demonstrate its potential for detecting affiliate marketing programs. Taken together, our experiments suggest that ??? makes the process of clustering more robust and able to withstand changes in clustering algorithms, datasets, and features, with a remarkable improvement of average performance.

Nowadays, according to spectacular improvement in health care and biomedical level, a tremendous amount of data is recorded by hospitals. In addition, the most effective approach to reduce disease mortality is to diagnose it as soon as possible. As a result, data mining by applying machine learning in the field of diseases provides good opportunities to examine the hidden patterns of this collection. An exact forecast of the mortality after heart surgery will cause Successful medical treatment and fewer costs. This research wants to recommend a new stacking predictive model after utilizing the random forest feature importance method to foresee the mortality after heart surgery on a highly unbalanced dataset by using the most practical features. To solve the unbalanced data problem, a combination of the SVM-SMOTE over-sampling algorithm and the Edited-Nearest-Neighbor under-sampling algorithm is used. This research compares the introduced model with some other machine learning classifiers to ensure efficiency through shuffle hold-out and 10-fold cross-validation strategies. In order to validate the performance of the implemented machine learning methods in this research, both shuffle hold-out, and 10-fold cross-validation results indicated that our model had the highest efficiency compared to the other models. Furthermore, the Friedman statistical test is applied to survey the differences between models. The result demonstrates that the introduced stacking model reached the most accurate predicting performance after Logistic Regression.

In the dynamic landscape of the telecommunications industry, understanding and mitigating customer churn is paramount for maintaining competitive advantage and sustaining revenue streams. This comprehensive literature review delves into the intricacies of customer churn prediction, a crucial aspect in fortifying the bond between telecom businesses and their customers. The review methodically analyzes 11 articles published between 2000 and March 2024, spotlighting the strategic role of Customer Relationship Management and the prevalence of high churn rates that necessitate a shift from customer acquisition to retention strategies. Furthermore, the review navigates through the challenges inherent in churn prediction, including the complexities of managing large, imbalanced, and noisy datasets and the intricacies involved in model selection and optimization. Despite these challenges, the paper highlights the superior capability of machine learning techniques in handling complex datasets to provide accurate predictions, albeit acknowledging their practical complexities. The main aim of the study is to provide an overview, serving as a knowledge base for researchers interested in machine learning techniques within the realm of telecommunications.

The construction of different roads, such as freeways, highways, major roads or minor roads must be accompanied by constant monitoring and evaluation of service delivery. Pavements are generally assessed by engineers in terms of the smoothness, surface condition, structural condition and surface safety. Pavement assessment is often conducted using the qualitative indices such as international roughness index (IRI), pavement condition index (PCI), structural condition index (SCI) and skid resistance value (SRV), which are used for smoothness assessment, surface condition assessment, structural condition assessment, and surface safety assessment, respectively. In this paper, Tehran-Qom Freeway in Iran has been selected as the case study and its smoothness and pavement surface conditions are assessed. At 2-km intervals, a 100-meter sample unit is selected in the slow-speed lane (totally, 118 sample units). In these sample units, the PCI is calculated after a visual inspection of the pavement and the recording of distresses. Then, in each sample unit, the average IRI is computed. The purpose of this study is to provide a method for estimating PCI based on IRI. The proposed theory was developed by Random Forest (RF), and Random Forest optimized by Genetic Algorithm (RF-GA) methods and these methods were validated using correlation coefficient (CC), scattered index (SI), and Willmott’s index of agreement (WI) criteria. The proposed method reduces costs, saves time and eliminates the safety risks.

The classical Rotational Isomeric State (RIS) model, originally proposed by Flory, has been used to rationalize a wide range of physicochemical properties of neutral polymers. However, many weak polyelectrolytes of interest are able to regulate their charge depending on the conformational state of the bonds. Recently, it has been shown that the RIS model can be coupled with the Site Binding (SB) model, for which the ionizable sites can adopt two states: protonated or deprotonated. The resulting combined scheme, the SBRIS model, allows to analyse ionization and conformational equilibria on the same foot. In the present work this approach is extended to include pH-dependent electrostatic Long Range (LR) interactions, ubiquitous in weak polyelectrolytes at moderate and low ionic strengths. With this aim the original LR interactions are taken into account by defining effective Short Range (SR) and pH-dependent parameters, such as effective microscopic protonation constants and rotational bond energies. The new parameters are systematically calculated using variational methods. The machinery of statistical mechanics for SR interactions, including the powerful and fast transfer matrix methods, can then be applied. The resulting technique, to which we will refer as Local Effective Interaction Parameters (LEIP) method, is illustrated with a minimal model of a flexible linear polyelectrolyte containing only one type of rotating bonds. LEIP reproduces very well the pH dependence of the degree of protonation and bond probabilities obtained by semi-grand canonical Monte Carlo simulations, where LR interactions are taken explicitly into account. The reduction in the computational time in several orders of magnitude suggests that the LEIP technique could be useful in a range of areas involving linear weak polyelectrolytes, allowing direct fitting of the relevant physical parameters to the experimental quantities.

This work addresses the role of charge regulation (CR) and the associated fluctuations in the conformational and mechanical properties of weak polyelectrolytes. Due to CR, changes in the pH-value modifies the average macromolecular charge and conformational equilibria. A second effect is that, for a given average charge per site, fluctuations can alter the intensity of the interactions by means of correlation between binding sites. We investigate both effects by means of Monte Carlo simulations at constant pH-value, so that the charge is a fluctuating quantity. Once the average charge per site is available, we turn off the fluctuations by assigning the same average charge to every site. A constant charge MC simulation is then performed. We make use of a model which accounts for the main fundamental aspects of a linear flexible polyelectrolyte i.e. proton binding, angle internal rotation, bond stretching and bending. Steric excluded volume and differentiated treatment for short-range and long-range interactions are also included in the model. It can be regarded as a kind of "minimal'' model in the sense that contains a minimum number of parameters but still preserving the atomistic detail. It is shown that, if fluctuations are activated, gauche state bond probabilities increase, and the persistence length decreases, so that the polymer becomes more folded. Macromolecular stretching is also analyzed in presence of CR (the charge depends on the applied force) and without CR (the charge is fixed to the value at zero force). The analysis of the low force scaling behavior concludes that Pincus exponent becomes pH-dependent. Both with and without CR, a transition from 1/2 at high pH-values (phantom chain) to 3/5 to low pH-values (Pincus regime), is observed. Finally, the intermediate force stretching regime is investigated. It is found that CR induces a moderate influence in the force-extension curves and persistence length (which in this force regime becomes force-dependent). It is thus concluded that the effect of CR on the stretching curves is mainly due to changes in the average charge at zero force. It is also found that, for the cases studied, the effect of steric excluded volume is almost irrelevant compared to electrostatic interactions.

The need to increase the energy efficiency of buildings as well as the use of local renewable heat sources has caused that heat meters are used not only to calculate the consumed energy but also for the active management of central heating systems. Increasing the reading frequency and the use of measurement data to control the heating system expands the requirements for the reliability of heat meters. The aim of the research is to analyse a large set of meters in the real network and predict their faults to avoid inaccurate readings, incorrect billing, heating system disruption and unnecessary maintenance. The reliability analysis of heat metres, based on historical data collected over several years, shows some regularities which cannot be easily described by physics-based models. The failure rate is almost constant and does depend on the past but is a non-linear combination of state variables. To predict meters' failures in the next settlement period, three independent machine learning models are implemented and compared with selected metrics because even the high performance of a single model (87\% True Positive for Neural Network) may be insufficient to make a maintenance decision. Additionally, performing hyperparameters optimisation boosts models' performance by a few percent. Finally, three improved models are used to build an ensemble classifier which outperforms the individual models. The proposed procedure ensures the high efficiency of fault detection (>95\%), while maintaining overfitting at the minimum level. The methodology is universal and can be utilised to study the reliability and predict faults of other types of meters and different objects with the constant failure rate.

Pathogenicity is unknown for the majority of human gene variants. For prioritization of sequenced somatic and germline mutation variants, in silico approaches can be utilized. In this study, 84 million non-synonymous Single Nucleotide Variants (SNVs) in the human coding genome were annotated using consensus Variant Effect Prediction (cVEP) method. An algorithm, implemented as a stacked ensemble of supervised learners, performed combination of the 39 functional, conservation mutation impact scores from dbNSFP4.0. Adding gene indispensability score, accounting for differences in the pathogenicities of the variants in the essential and the mutation-tolerant genes, improved the predictions. For each SNV the consensus combination gives either a continuous-value pathogenicity score, or a categorical score in five classes: pathogenic, likely pathogenic, uncertain significance, likely benign, benign. The provided class database is aimed for direct use in clinical practice. The trained prediction models were 5-fold cross-validated on the evidence-based categorical annotations from the ClinVar database. The rankings of the scores based on their ability to predict pathogenicity were obtained. A two-step strategy using the rankings, scores and class annotations is suggested for filtering and prioritization of the human exome mutations in clinical and biological applications of NGS technology.

Software project estimating (SPE) is a powerful but necessary step in the production of projects for software. Software project estimating includes several components, estimating software time, software resources, software costs, and software effort estimation (SEE). SEE seeks to estimate the number of "hours-person" and "months-person" of work required for developing or managing a software program. During the initial phase of the development of software, future efforts are impossible to predict. To estimate effort, many deep learning (DL) and machine learning (ML) models were previously created. For estimate, single-model techniques and ensemble methods were investigated in this research. Ensemble methods involve a combination of multiple separate models. Bagging, boosting, and voting were the ensemble methods looked into for estimation. Datasets considered for estimation were COCOMO81, COCOMONasa I, COCOMONasa II, Albrecht, Maxwell, China, Desharnais, Desharnais_1_1, Kitchenham, Boehm, and Belady. The evaluation criteria used MAE, RAE, RMSE, RRSE, and CC. The result from previous studies is that the total size of the set of data utilized is small in predicting the effort, as the largest size of the set of data used is the China dataset containing only 499 projects. So, in this study, the dataset has been merged to increase the total size of the set of data and increase the accuracy of prediction. The results indicated that the suggested merged dataset increased effort estimation accuracy.

Keywords: Electrical power systems, Support vector machines, Random Forest, Machine learning, Wavelet transform, Transmission lines fault, Electrical power quality, Short circuit, Classification of faults, Localization of faults, Decision trees, Ensemble learning, K-nearest neighbors.

Electricity demand prediction is vital for energy production management and proper exploitation of the present resources. Recently, several novel machine learning (ML) models have been employed for electricity demand prediction to estimate the future prospects of the energy requirements. The main objective of this study is to review the various ML models applied for electricity demand prediction. Through a novel search and taxonomy, the most relevant original research articles in the field are identified and further classified according to the ML modeling technique, perdition type, and the application area. A comprehensive review of the literature identifies the major ML models, their applications and a discussion on the evaluation of their performance. This paper further makes a discussion on the trend and the performance of the ML models. As the result, this research reports an outstanding rise in the accuracy, robustness, precision and the generalization ability of the prediction models using the hybrid and ensemble ML algorithms.

Traffic Inspection (TI) work in this article is positioned as a specific module of road traffic with its primary function oriented towards monitoring and controlling safe traffic and the execution of significant events within a particular geographic area. Exploratory research on the significance of event execution in simple, complicated and complex traffic flow and process situations is related to the activities of monitoring and controlling functional states and performance of categorical variables, which include objects and locations of road infrastructure, communication infrastructure and networks of traffic inspection resources. It is emphasized that the words “work” and “traffic” have the semantic status as synonyms (in one world language), which is explained in the design of the Agent-based model of the complexity of content and contextual structure of TI work at the singular and plural level with 12 points of interest (POI) in the thematic research. An Event Execution Log (EEL) was created for on-site data collection with eight variables, seven of which are independent (event type, activities, objects, locations, host, duration-period and periodicity of the event) and one dependent (significance of the event) variable. The structured data set includes 10,994 input-output vectors in 970 categories collected in the EEL created by 32 human agents (traffic inspectors) over a 30-day period. An algorithmic presentation of the methodological research procedure for preprocessing and final data processing in the ensemble of machine learning models for classification and selection of TI tasks is given. Data cleaning was performed on the available dataset to increase data consistency for further processing. Vector elimination was carried out based on the Location variable, such that the total number of vectors equals the number of unique categories of this variable, which is 636. The main result of this research is the Classification modeling of the significance of events in TI work based on machine learning techniques and the Stacking ensemble. The created machine learning models for event significance classification modeling have high accuracy values. To evaluate the performance metrics of the Stacking ensemble of models, the confusion matrix, Precision, Recall, ND F1-score are used.