The main objective of this work was to evaluate the application of individual and ensemble machine learning models to classify malignant and benign breast masses using features from two-dimensional (2D) correlated spectroscopy spectra extracted from five-dimensional Echo Planar-Correlated Spectroscopic Imaging (5D EP-COSI) and Diffusion-weighted imaging (DWI). Twenty-four different metabolite and lipid ratios with respect to 2D diagonal peaks at 1.4ppm and 5.4ppm, and water from one-dimensional non-water-suppressed (NWS) spectra were used as the features. Additionally, water fraction, fat fraction and water-to-fat ratios from NWS spectra and apparent diffusion coefficients (ADC) from DWI were included. Nine most important features were identified using recursive feature elimination. XGBoost (AUC:93.0%, Accuracy:85.7%, F1-score:87.6%), GradientBoost (AUC:94.4%, Accuracy:87.0%, F1-score:89.4%), CatBoost (AUC:95.2%, Accuracy:86.9%, F1-score:88.4%) and RandomForest (AUC:92.2%, Accuracy:85.3%, F1-score:87.6%) were the best performing models. While the conventional biomarkers like choline, myo-Inositol, and glycine were statistically significant predictors, the key features contributing to the classification were ADC, 2D diagonal peaks at 0.9ppm, 2.1ppm and 2.3ppm, cross peaks between 1.4 and 0.9ppm, 4.3 and 4.1ppm, 2.1 and 1.4ppm and the triglyceryl-fat cross peak. The results highlight the contribution of the 2D spectral peaks to the model, and they demonstrate the potential of 5D EP-COSI for early breast cancer detection.

United Nations Framework Convention on Climate Change (UNFCCC) has recently established the Reducing Emissions from Deforestation and forest Degradation (REDD+) program that requires countries to report their carbon emissions and sink estimates through national greenhouse gas inventories (NGHGI). Thus, developing automatic systems capable of estimating the carbon absorbed by forests without in-situ observation becomes essential. To support this important need, in this work we introduce ReUse, a simple but effective deep-learning approach to estimate the carbon absorbed by forest areas based on remote sensing. The novelty of the proposed method is in the use of the public above-ground biomass (AGB) data from the European Space Agency's Climate Change Initiative Biomass project as ground truth to estimate the carbon sequestration capacity of any portion of land on Earth using Sentinel-2 images and a pixel-wise Regressive UNet. The approach has been compared to two literature proposals, using a private dataset and human-engineered features. The results show a greater generalization ability of the proposed approach, with a decrease in Mean Absolute Error and Root Mean Squared Error, respectively, of 16.9 and 14.3 in the area of Vietnam and 4.7 and 5.1 in the area of Myanmar over the runner-up. Finally, as a case study, we reported an analysis made for the Astroni area, a nature reserve located near the metropolitan area of Naples in southern Italy, struck by a large fire, producing predictions consistent with values found by experts in the field. These results further support the use of such an approach for the early detection of AGB variations, both in urban and rural areas.

The importance of antibodies in health care and the biotechnology research and development demands not only knowledge of their experimental structures at high resolution, but also practical implementation of this knowledge for both effective and efficient design and production of antibody for its use in both medical and research applications. While the experimental wet-lab approach is usually costly, laborious and time-consuming, computational (dry-lab) approaches, in spite of their intrinsic limitations in comparison with its experimental (wet-lab) counterpart, provide a cheaper and faster alternative option. For the first time, this article reports a comprehensive set of structural electrostatic features extracted from experimentally determined antigen-antibody-related structures, including especially those structural electrostatic features at the interfaces of all experimentally determined antigen-antibody complex structures as of February 29, 2020, to facilitate effective and efficient machine learning-based computational antibody design using currently available experimental structures inside Protein Data Bank.

Natural calamities observation, study and simulation has always been a prime concern for disaster management agencies. Billions of dollars are spent annually to explore geo-seismic movements especially earthquakes but it has always been a unique accident. The real-time study of seismic waves, ground motions, and earthquakes always needed a programmable mechanical structure capable of physically producing the identical geo-seismic motions with seismology domain definitions. A programmable multi-parametric five degrees of freedom electromechanical seismic wave events simulation platform to study and experiment seismic waves and earthquakes realization in the form of geo-mechanic ground motions is exhibited in this work. The proposed platform was programmed and interfaced through an IoT cloud-based Web application. The geo-mechanics was tested in the range of i) frequencies of extreme seismic waves from 0.1Hz to 178Hz; ii) terrestrial inclinations from -10.000° to 10.000°; iii) velocities of 1km/s to 25km/s iv) variable arrival times 1us to 3000ms; v) magnitudes M1.0 to M10.0 earthquake; vi) epi-central and hypo-central distances of 290+ and 350+ kilometers. Wadati and triangulation methods have been used for entire platform dynamics design and implementation as one of key contributions in this work. This platform is as an enabler for a variety of applications such as training self-balancing and calibrating seismic-resistant designs and structures in addition to studying and testing seismic detection devices as well as motion detection sensors. Nevertheless, it serves as an adequate training colossus for machine learning algorithms and event management expert systems.

Objective: Radiomics and deep transfer learning are two popular technologies used to develop computer-aided detection and diadnosis (CAD) schemes of medical images. This study aims to investigate and compare advantages and potential limitations of applying these two technologies in developing CAD schemes. Methods: A relatively large and diverse retrospective dataset including 3,000 digital mammograms is assembled in which 1,496 images depict malignant lesions and 1,054 images depict benign lesions. Two CAD schemes are developed to classify breast lesions. The first scheme is developed using four steps namely, applying an adaptive multi-layer topographic region growing algorithm to segment lesions, computing initial radiomics features, applying a principal component algorithm to generate an optimal feature vector, and building a support vector machine classifier. The second CAD scheme is built based a pre-trained residual net architecture (ResNet50) as a transfer learning model to classify breast lesions. Both CAD schemes are trained and tested using a 10-fold cross-validation method. Several score fusion methods are also investigated to classify breast lesions. CAD classification performance is evaluated by the area under ROC curve (AUC). Results: ResNet50 model-based CAD scheme yields AUC = 0.85±0.02, which is significantly higher than radiomics feature-based CAD scheme with AUC = 0.77±0.02 (p < 0.01). Additionally, fusion of classification scores generated by two CAD schemes does not further improve classification performance. Conclusion: This study indicates that using deep transfer learning is more efficient to develop CAD schemes and enables to yield higher lesion classification performance than CAD schemes developed using radiomics-based technology.

Apathy in patients with Parkinson's disease (PD) is one of the least studied manifestations of a wide range of neuropsychiatric disorders (PND). The frequency of apathy in PD, according to various researchers, is 17–80%. Structural and neurochemical changes associated with PD are considered as the leading pathophysiological factors of apathy. Possible general pathophysiological mechanisms of apathy and hypokinesia, depression, executive (frontal) cognitive functions, sleep disorders in PD are discussed. The basis of the pathophysiological commonality of apathy, hypokinesia, and executive functions is probably bilateral disturbances in the functional connections of the stratum and dorsolateral, medial parts of the prefrontal cortex. The combination of apathy and depression in PD may be due to dysfunction of the structures of the limbic system and the medial orbital prefrontal cortex responsible for motivational determined behavior. The variability of the relationship between apathy and hypokinesia, depression, cognitive impairments, sleep disorders at different stages of PD may be associated with the phenomenological heterogeneity of apathy.Apathy worsens the quality of life, makes a significant contribution to disorders of both household and social adaptation of PD patients. It is promising to study the possibility of correcting apathy using dopaminergic therapy. Against the background of the appointment of pramipexole (1.5-3.0 mg / day) to 20 patients with PD (middle stage, according to Hen-Yar-2.5) to correct movement disorders after 4-6 weeks of therapy, a statistically significant positive dynamics of apathy were noted. According to the total assessment of the scale of apathy SE Starkstein (AS). As a result of the study, no statistically significant correlation was found between the dynamics of the total apathy indicator and the dynamics of motor symptoms of PD according to the unified rating scale for assessing PD (“Motor functions”), which, we believe, indicates an independent effect of pramipexole therapy in relation to motivational disorders.

Reservoir computers (RCs) are a biology inspired computational framework for signal processing typically implemented using recurrent neural networks. Recent work has shown that Boolean networks (BN) can also be used as reservoirs. We analyze the performance of BN RCs, measuring their flexibility and identifying factors that determine effective approximation of Boolean functions that are applied in a sliding-window fashion over a binary signal, either non-recursively or recursively. We train and test BN RCs of different sizes, signal connectivity, and in-degree to approximate 3-bit, 5-bit and 3-bit recursive binary functions. We analyze how BN RC parameters and function average sensitivity, a measure of function smoothness, affect approximation accuracy as well as the spread of accuracies for a single reservoir. We found that approximation accuracy and reservoir flexibility are highly dependent on RC parameters. Overall, our results indicate that not all reservoirs are equally flexible and RC instantiation and training can be more efficient if this is taken into account. The optimum range of RC parameters opens up an angle of exploration for understanding how biological systems might be tuned to balance system restraints with processing capacity.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&amp;E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&amp;E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&amp;E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

Breast cancer is the most common cause of death for women worldwide. Thus, the ability of artificial intelligence systems to predict and classify breast cancer is very important. In this paper, a hybrid ensemble method classification mechanism is proposed based on a majority voting mechanism. First, the performance of different state-of-the-art machine learning classification algorithms for the Wisconsin Breast Cancer Dataset (WBCD) were evaluated. The three best classifiers were then selected based on their F3 score. F3 score is used to emphasize the importance of false negatives (recall) in breast cancer classification. Then, these three classifiers, simple logistic Regression learning, stochastic gradient descent learning and multilayer perceptron network, are used for ensemble classification using a voting mechanism. We also evaluated the performance of hard and soft voting mechanism. For hard voting, majority-based voting mechanism was used and for soft voting we used average of probabilities, product of probabilities, maximum of probabilities and minimum of probabilities-based voting methods. The hard voting (majority-based voting) mechanism shows better performance with 99.42% as compared to the state-of-the-art algorithm for WBCD.

Hate Speech Detection in Arabic presents a multifaceted challenge due to the broad and diverse linguistic terrain. With its multiple dialects and rich cultural subtleties, Arabic requires particular measures to address hate speech online successfully. To address this issue, academics and developers have used natural language processing (NLP) methods and machine learning algorithms adapted to the complexities of Arabic text. However, many proposed methods were hampered by a lack of a comprehensive dataset/corpus of Arabic hate speech. In this research, we propose a novel multi-class public Arabic dataset comprised of 403,688 annotated tweets categorized as extremely positive, positive, neutral, or negative based on the presence of hate speech. Using our developed dataset, we additionally characterize the performance of multiple machine learning models for Hate speech identification in Arabic Jordanian dialect tweets. Specifically, the Word2Vec, TF-IDF, and AraBert text representation models have been applied to produce word vectors. With the help of these models, we can provide classification models with vectors representing text. After that, seven Machine learning classifiers have been evaluated: Support Vector Machine (SVM), Logistic Regression (LR), Naive Bays (NB), Random Forest (RF), AdaBoost (Ada), XGBoost (XGB), and CatBoost (CatB). In light of this, the experimental evaluation revealed that, in this challenging and unstructured setting, our gathered and annotated datasets were rather efficient and generated encouraging assessment outcomes. This will enable academics to delve further into this crucial field of study.

The Ames/quantitative structure-activity relationship (QSAR) International Challenge Projects held during 2014–2017 and 2020–2022, evaluated the performance of various predictive models. Despite the significant insights gained, the rules allowing participants to select prediction targets introduced ambiguity in model performance evaluation. This reanalysis identified the highest-performing prediction model, assuming a 100% coverage rate (COV) for all prediction target compounds and an estimated performance variation due to changes in COV. All models from both projects were evaluated using balance accuracy (BA), Matthews correlation coefficient (MCC), F1 Score (F1), and the first principal component (PC1). After normalizing the COV, a correlation analysis with these indicators was conducted, and the evaluation index for all prediction models in terms of the COV was estimated. In total, 109 models, the highest estimated BA (76.9) at 100% COV was MMI-VOTE1, reported by Meiji Pharmaceutical University (MPU). The best models for MCC, F1, and PC1 were all MMI-STK1, also reported by MPU. All models reported by MPU ranked in the top four. MMI-STK1 was estimated to have F1 scores of 59.2, 61.5, and 63.1 at COV levels of 90%, 60%, and 30%, respectively. These findings highlight the current state and potential of the Ames prediction technology.

Use of fingerprints found at a crime scene is a common practice for identifying suspects in criminal investigations. Over the past two decades, attempts have been made to obtain additional information from fingerprints, beyond locating suspects as part of an investigation. This includes gender, age and nationality. Researchers demonstrated 75%-90% accuracy in gender classification based on fingerprint images. Nonetheless, despite promising results, these studies have several significant shortcomings with respect to their practical feasibility. First, they ignore the low quality and quantity of fingerprints collected from the crime scene since typically the scene of a crime has only one fingerprint collected, and the fingerprint might be partially or of poor quality as well. Second, as most results are based on a single database, public or private, it is difficult to generalize the most suitable method. Third, studies miss the untapped potential of Data-Centric AI (DCAI) approaches for improving results. The aim of this study was to compare, for the first time, the gender classification from a fingerprint using several datasets and with varying fingerprint image quality. The results from four databases are compared, three public and one internal private database. In addition, we utilize the latest Data-Centric AI (DCAI) approaches for improving classification results. The results demonstrate that a conservative Convolutional Neural Networks (CNN) such as VGG is sufficient for this task. Classification accuracy ranges from 80% to 95% depending on the quality of the fingerprint, with DCAI approaches adding 1%-4% improvement. For partially or low-quality fingerprint images, the periphery of a fingerprint is the most significant area for determining gender. The source code is also provided here for practical application.

In recent times, the process control network (PCN) of oil and gas installation has been subjected to amorphous cyber-attacks which include Denial-of-Service (DoS), Distributed-Denial-of-Service (DDoS), Man-in-the-Middle (MitM) attacks, and this may have been caused majorly by the integration of open network to Operation Technology (OT) as a result of low-cost network expansion. The connection of the OT to the internet for firmware updates, third-party support, or vendor interventions, has exposed the industry to attacks. The inability to detect these unpredictable cyber-attacks exposes the PCN and a successful attack can lead to devastating effects. This paper reviews the different forms of cyber-attacks in PCN of oil and gas installations and proposes the use of machine learning algorithms to monitor data exchanges between the sensors, controllers, processes, and the final control elements on the network so as to detect anomalies in such data exchanges. Python 3.0 Libraries, Deep-Learning Toolkit, MATLAB, and Allen Bradley RSLogic 5000 PLC Emulator software were used in the simulation of process control. The outcome of the experiments shows the reliability and functionality of the different machine-learning algorithms in detecting these anomalies with significant precise attack detections identified using a coarse tree algorithm.

Background: The Stability Index estimation algorithm was derived and applied to develop and implement a balance ability diagnosis system that can be used at daily life. Methods: The system integrated an approach based on sensory function interaction, called the clinical test of sensory interaction with balance (CTSIB). The piezo-resistive force mat was fabricated, and a Stability Index prediction algorithm was developed and applied using the center of pressure (CoP) variables. The Stability Index prediction algorithm derived a CoP variable for 103 elderly people by Nintendo Wii Balance Board (WBB) to predict the Stability Index of the Balance System (Biodex SD). And, the accuracy was confirmed through the correlation between the real and predicted value. Results: As a result of testing with the test-set, the linear regression model confirmed that the r value ranged between 0.943 to 0.983. To confirm the similarity between the WBB and flexible force mat, each measured CoP value was input and calculated into the developed regression model, and the result of the correlation coefficient validation ​​confirmed an r value of 0.96. Conclusion: The system developed in this study will be applicable to the daily life of the home in the form of a floor mat.

The emergence of cloud computing, big data analytics, and machine learning has catalysed the use of remote sensing technologies to enable more timely land management of sustainability indicators such as ground cover and grassland biomass, given the uncertainty of future climate and drought conditions. Here, we examine the potential of “regenerative agriculture”, as an adaptive grazing management strategy to minimise bare ground exposure while maximising pasture biomass productivity. High-intensity sheep grazing treatments were conducted in small fields (less than 1 hectare) for short durations (typically less than 1 day). Paddocks were subsequently spelled to allow pasture biomass recovery (treatments comprising 3, 6, 9, 12, and 15 months) with each compared with control treatments with lighter stocking rates for longer periods (2,000 DSE). Pastures were composed of wallaby grass (Austrodanthonia species), kangaroo grass (Themeda triandra), Phalaris (Phalaris aquatica, and cocksfoot (Dactylis glomerata) were destructively sampled to estimate total standing dry matter (TSDM), standing green biomass, standing dry biomass and trampled biomass. We then invoked a machine learning model using Sentinel-2 imagery to quantify TSDM, standing green biomass and standing dry biomass. Faced with La Nina conditions, regenerative grazing did not significantly impact pasture productivity, with all treatments showing similar TSDM and green biomass. However, regenerative treatments significantly impacted litter fall and trampled material, with the high intensity grazing treatments causing more dry matter trampling, increasing litter, enhancing decomposition rates and surface organic matter. Pasture digestibility was greatest for treatments with minimal spelling (3 months), whereas both standing senescent and trampled material were significantly greater for the treatment with 15-month spell periods. Estimates of TSDM using machine learning with Sentinel-2 imagery underestimated TSDM in treatment plots but explained spatiotemporal variability associated within and across treatments. The root mean square error between the measured and modelled TSDM was 903 kg DM/ha, which was less than the variability measured in the field. We conclude that regenerative grazing with short recovery periods (3-6 months) are most conducive to increasing pasture production under high rainfall conditions, and we speculate that high intensity grazing is likely to positively impact on soil organic carbon through increased litterfall and trampling. Our study paves the way forward for using machine learning with satellite imagery to quantify pasture biomass at small scales, enabling management of pastures from afar.

Scanning electron microscopy (SEM) is a powerful tool in the domain of material science, mining, and geology, owing to its enormous potential to provide unique insights into the micro and nanoscale worlds. This comprehensive review discusses the background development of SEM, basic SEM operation including the specimen preparation and imaging process, and fundamental theoretical calculations underlying the SEM operation. It provides foundational understanding to the engineers and scientists, who never got a chance to dig in-depth into the SEM, to understand the working and development of this robust analytical technique. The present review covers how SEM has been serving as a crucial tool in mineral characterization, with specific discussions on the working and research fronts of SEM-EDX, SEM-AM, SEM-MLA, and QEMSCAN. With automation gaining pace in the development of all spheres of technology, the understanding of uncertainties in SEM measurements is very important. The constraints in mineral phase identification by EDS spectra and sample preparation are conferred. In the end, future research directions for SEM are analyzed with the possible incorporation of machine learning, deep learning, and artificial intelligence tools, for automating the process of mineral identification, quantification, and efficient communication with the researchers, so that the analytical process robustness and objectivity can be improved, and the analysis time and the involved costs can be brought down. This review also discusses the idea of integrating robotics with SEM, to make the equipment portable, so that further mineral characterization insights can be gained not only on earth but also on other terrestrial grounds.

The use of Geographical Information Systems (GIS) for biodiversity monitoring and conservation, shortened to Conservation GIS, is an influential tool that has revolutionized conservation efforts by providing spatially explicit data to inform conservation decision-making. However, Conservation GIS also faces challenges related to data quality and availability, technical limitations, as well as policy and governance issues. The diverse and rising uses of GIS for conservation has resulted in a need for continued research and development of Conservation GIS, including advancements in technology and data collection, integration with other fields such as machine learning and artificial intelligence, and collaborative approaches to Conservation GIS. Conservation GIS has the potential to make a significant impact on conservation efforts, and this article emphasizes the importance of its implementation to achieve the broader goal of biodiversity conservation for planetary health. In this review, we discuss the various applications of Conservation GIS, including biodiversity conservation and monitoring, habitat mapping and restoration, climate change mitigation and adaptation, wildlife tracking and management, and protected area management. We highlight some of the key knowledge gaps or research questions that need to be addressed in the future to further advance the field of Conservation GIS. By addressing these challenges and knowledge gaps, Conservation GIS can become a powerful tool for addressing the challenges facing biodiversity and ecosystems worldwide, and for promoting sustainable land-use practices.

Classical methods for inverse problems are mainly based on regularization theory. In particular those which are based on optimization of a criterion with two parts: a data-model matching and a regularization term. Different choices for these two terms and great number of optimization algorithms have been proposed. When these two terms are distance or divergence measures, they can have a Bayesian Maximum A Posteriori (MAP) interpretation where these two terms correspond, respectively, to the likelihood and prior probability models.

Eating Disorders (ED) constitute a serious public health issue affecting predominantly women and appearing typically in adolescence or early adulthood. EDs are extremely difficult to treat as these disorders are ego-syntonic and many patients do not seek treatment. It is vital to focus on the development of successful early-intervention programs for individuals presenting at-risk and are on a trajectory towards developing EDs. This study is a randomized controlled trial evalu-ating an innovative digital gamified Acceptance and Commitment early-intervention program (AcceptME) for young females showing signs and symptoms of an ED and at high-risk for an ED. Participants (N=92; Mage=15.30 years, SD=2.15) received either AcceptME (N=62) or a waitlist control (N=30). Analyses indicated that the AcceptME program effectively reduced weight and shape concerns, with large effects when compared to waitlist controls. Most participants scored below the at-risk cut-off (WCS score<52) in the AcceptME at end-of-intervention (57.1%) com-pared to controls (7.1%) with odds of falling into the at-risk group being 14.5 times higher for participants in the control group. At follow-up, 72% of completers reported scores below the at-risk cut-off in the AcceptME group. The intervention also resulted in a decrease in ED symp-tomatology and increased body image flexibility. Overall, results suggest that the AcceptME program holds promise for early-intervention of young women at-risk for developing an ED.

Precision medicine emphasizes fine-grained diagnostics, taking individual variability into account to enhance treatment effectiveness. Parkinson's Disease (PD) heterogeneity among individuals is a proof that disease subtypes exist, and assigning individuals to subgroups is necessary for a better understanding of disease mechanisms and designing precise treatment approaches. The purpose of this study was to identify PD subtypes using RNA-Seq data in a combined pipeline including unsupervised machine learning, bioinformatics, and network analysis. 210 post mortem brain RNA-Seq samples from PD (n = 115) and Normal Controls (NC, n = 95) were obtained with a systematic data retrieval following PRISMA statements and a fully data-driven clustering pipeline was performed to identify PD subtypes. Bioinformatics and Network analyses were performed to characterize the disease mechanisms of the identified PD subtypes and to identify target genes for drug repurposing. Two PD clusters were identified and 42 DEGs were found (p.adjusted ≤ 0.01). PD clusters had significantly different gene network structures (p &lt; 0.0001) and phenotype-specific disease mechanisms, highlighting the differential involvement of the Wnt/β-catenin pathway regulating adult neurogenesis. NEUROD1 was identified as a key regulator of gene networks and ISX9 and PD98059 were identified as NEUROD1-interacting compounds with disease-modifying potential, reducing the effects of dopaminergic neurodegeneration. This hybrid data analysis approach could enable precision medicine applications by providing insights for the identification and characterization of pathological subtypes. This workflow has proven useful on PD brain RNA-Seq, but its application to other neurodegenerative diseases is encouraged.

The timely diagnosis of defects at their incipient stage of formation is crucial to extend the life-cycle of technical appliances. This is the case of mechanical-related stress, either due to long aging degradation processes (e.g., corrosion) or in-operation forces (e.g., impact events), which might provoke detrimental damages, such as cracks, disbonding or delaminations, most commonly followed by the release of acoustic energy. The localization of these sources can be successfully fulfilled via adoption of Acoustic Emission (AE)-based inspection techniques through the computation of the Time of Arrival (ToA), namely the time at which the induced mechanical wave released at the occurrence of the acoustic event arrives to the acquisition unit. However, the accurate estimation of the ToA may be hampered by poor Signal-to-Noise ratios (SNRs). In these conditions, standard statistical methods typically fail. In this work, two alternative Deep Learning methods are proposed for ToA retrieval, namely a Dilated Convolutional Neural Network (DilCNN) and a Capsule Neural Network for ToA (CapsToA). These methods have the additional benefit of being portable on resource-constrained microprocessors. Their performance has been extensively studied on both synthetic and experimental data, focusing on the problem of ToA identification for the case of a metallic plate. Results show that the two novel methods can achieve localization errors which are up to 70% more precise than those yielded by conventional strategies, even when the SNR is severely compromised (i.e., down to 2 dB). Moreover, DilCNN and CapsNet have been implemented in a tiny machine learning environment and then deployed on microcontroller units, showing a negligible loss of performance with respect to offline realizations.

We present a data-driven, in situ proximal multi-sensor digital soil mapping approach to develop digital twins for multiple agricultural fields. A novel Digital Soil CoreTM (DSC) Probe was engineered that contains seven sensors, each of a distinct modality, including sleeve friction, tip force, dielectric permittivity, electrical resistivity, soil imagery, acoustics, and visible and near-infrared spectroscopy. The DSC System integrates components the DSC Probe, DSC software, and deployment equipment to sense soil characteristics at a high vertical spatial resolution (mm scale) along in situ soil profiles up to a depth of 120 cm in about 60 sec. The DSC Probe in situ proximal data are harmonized into a data cube providing vertical high-density knowledge associated with physical-chemical-biological soil conditions. In contrast, conventional ex situ soil samples derived from soil cores, soil pits, or surface samples analyzed using laboratory and other methods are bound by substantially coarser spatial resolution and multiple compounding errors. Our objective was to investigate the effects of mismatched scale between high-resolution in situ proximal sensor data and coarser resolution ex situ soil laboratory measurements to develop soil prediction models. Our study was conducted in central California soil in almond orchards. We collected DSC sensor data and spatially co-located soil cores that were sliced into narrow layers for laboratory-based soil measurements. Partial Least Squares Regression (PLSR) cross-validation was used to compare results testing four data integration methods. Method A reduced the high-resolution sensor data to discrete values paired with layer-based soil laboratory measurements. Method B used stochastic distributions of sensor data paired with layer-based soil laboratory measurements. Method C allocated the same soil analytical data to each one of the high-resolution multi-sensor data within a soil layer. Method D linked the high-density multi-sensor soil data directly to crop responses (crop performance and behavior metrics) bypassing costly laboratory soil analysis. Overall, the soil models derived from Method C outperformed Methods A and B. Soil predictions derived using Method D were most cost-effective for directly assessing soil-crop relationships, making this method well-suited for industrial-scale precision agriculture applications.

Education is one of the most important tools available to policymakers and non-governmental bodies to promote a change in the behavior of society and to address the climate crisis, in line with the 4^th and 13^th Sustainable Development Goals of the United Nations 2030 Agenda. Project-based learning (PBL) addresses real and global challenges and allows the academic and professional formation of students. As part of the reflection stage of the educational action research method using the Business Canvas Model (BMC), pedagogic deficiencies were identified in the PBL and a didactic proposal was elaborated to emulate the interaction of students with the ecosystems of society. A prototype for improving the management of organic manures as soil amendments was initially developed, to provide the students with a quick start on the first steps of the proposed project. In the 10 sessions designed for the PBL (Make it happen!), the students elaborate a more sophisticated artifact in response to the demands of potential clients, as per the outcomes of the primary market research (5^th session). Active teaching methods and tools, such as a modified template of the BMC with the Rumsfeld’s matrix, aid the metacognition of students and their competences development. In a double session of the PBL, the primary market research is organized with key stakeholders of the agroindustry to enquire about the feasibility of the implementation of the technological solution and the logistics at farm level. Finally, the evaluation relies on the suitability of the upgraded prototype to respond customers’ demands.

Artificial intelligence systems are increasingly becoming a component of security-critical applications. The protection of such systems from various types of destructive influences is thus a relevant area of research. The vast majority of previously published works are aimed at reducing vulnerability to certain types of disturbances or implementing certain resilience properties. At the same time, the authors either do not consider the concept of resilience as such, or their understanding varies greatly. This work presents a formalized definition of resilience and its characteristics for artificial intelligence systems from a systemic point of view. It systematizes ideas and approaches to building resilience to various types of disturbances. Taxonomy of resilience of artificial intelligence systems to destructive disturbances is proposed. Approaches and technologies for complex protection of intelligent systems, issues of their resource efficiency and other open research issues are considered. Approaches of resilience assessment for artificial intelligence system are also analyzed and recommendations are provided for their implementation.

The objective of this research is to evaluate four distinct models for multi-population mortality projection in order to ascertain the most effective approach for forecasting the impact of COVID-19 pandemic on mortality. Utilising data from the Human Mortality Database for five countries Finland, Germany, Italy, the Netherlands, and the United States, the study identifies the generalized additive model (GAM) within the age-period-cohort (APC) analytical framework as the most promising for precise mortality forecasts. Consequently, this model serves as the basis for projecting the impact of the COVID-19 pandemic on future mortality rates. By examining various pandemic scenarios, ranging from mild to severe, the study concludes that projections assuming a diminishing impact of the pandemic over time are most consistent, especially for middle-aged and elderly populations. Projections derived from the superior GAM-APC model offer guidance for strategic planning and decision-making within sectors facing the challenges posed by extreme historical mortality events and the uncertain future mortality trajectories.

Foundational and state-of-the-art anomaly detection methods through power system state estimation are reviewed. The traditional components for bad data detection such as chi-square testing, residual-based methods, and hypothesis testing are discussed to explain the motivations for recent anomaly detection methods given the increasing complexity of power grids, energy management systems, and cyber-threats. In particular, state estimation anomaly detection based on data-driven quickest change detection and artificial intelligence are discussed and directions for research are suggested with particular emphasis on considerations of the future smart grid.

Automated controlling the harvesting systems can significantly increase the efficiency of the agricultural practices and prevent food wastes. Modeling and improvement of the combine harvester can increase the overall performance. Machine learning methods provide the opportunity of advanced modeling for accurate prediction of the highest performance of the machine. In this study, the modeling of combine harvesting id performed using radial basis function (RBF) and the hybrid machine learning method of adaptive neuro-fuzzy inference system (ANFIS) to predict various variables of the combine harvester for the optimal performance. Response surface methodology (RSM) is also used to optimize the models. The comparative study shows that the ANFIS method outperforms the RBF method.

High-tech augmentative and alternative communication (AAC) methods are on a constant rise; however, the interaction between the user and the assistive technology is still challenged for an optimal user experience centered around the desired activity. This review presents a range of signal sensing and acquisition methods utilized in conjunction with the existing high-tech AAC platforms for speech disabled individuals, including imaging methods, touch-enabled systems, mechanical and electro-mechanical access, breath-activated methods, and brain computer interfaces (BCI). The listed AAC sensing modalities are compared in terms of ease of access, affordability, complexity, portability, and typical conversational speeds. A revelation of the associated AAC signal processing, encoding, and retrieval highlights the roles of machine learning (ML) and deep learning (DL) in the development of intelligent AAC solutions. The demands and the affordability of most systems were found to hinder the scale of usage of high-tech AAC. Further research is indeed needed for the development of intelligent AAC applications reducing the associated costs and enhancing the portability of the solutions for a real user’s environment. The consolidation of natural language processing with current solutions also needs to be further explored for the amelioration of the conversational speeds. The recommendations for prospective advances in coming high-tech AAC are addressed in terms of developments to support mobile health communicative applications.

In this paper, we conduct a comprehensive analysis of the RounD dataset to enhance the understanding of motion forecasting for autonomous vehicles in complex roundabout environments. We implement a trajectory prediction framework that combines Long Short-Term Memory (LSTM) networks with graph-based modules to model vehicle interactions. Our primary objective is to assess the generalizability of a standard trajectory prediction model across diverse training and testing datasets. Through extensive experiments, we analyze how varying data distributions, including different road configurations and recording times, influence the model’s prediction accuracy and robustness. This study provides key insights into the challenges of domain generalization in autonomous vehicle trajectory prediction.

In this study, we introduce an innovative framework for multimodal learning that leverages enhanced fusion gate units within gated neural network architectures. The proposed Fusion Gate Unit (FGU) serves as a pivotal component in neural network designs, aiming to derive a comprehensive intermediate representation by amalgamating data from diverse modalities. The FGU is adept at determining the extent to which each modality influences the unit's activation through the utilization of multiplicative gating mechanisms. We conducted evaluations on a multilabel genre classification task for movies, utilizing both plot summaries and poster images as input modalities. The results demonstrate that the FGU significantly elevates the macro F-score compared to single-modality approaches and surpasses existing fusion techniques, including mixture of experts models. Additionally, we present the MM-IMDb dataset alongside this publication, which, to our knowledge, represents the most extensive publicly accessible multimodal dataset for movie genre prediction to date. This dataset is expected to facilitate further research and development in the field of multimodal information processing.

We assessed machine learning techniques (MLTs) for downscaling global climate model’s precipitation to local level in Bolivia. The skill, assumptions and uncertainty of the process are analyzed. Additionally, future projections are delivered. For that, an ensemble of 20 global climate models (GCMs) from CMIP6, with random forest (RF) and support vector machines (SVM), is used on four zones (highlands, Andean slopes, Amazon lowlands and Chaco lowlands). The downscaled series’ skill is evaluated in terms of relative errors. The uncertainty is analyzed through variance decomposition. MLTs’ skill is adequate in most cases, especially for the highlands and the Andean slopes. Moreover, RF tends to outperform SVM. Stationary assumptions are robust in the highlands and Andean slopes. Perfect prognosis assumption is poor in the highlands and Andean slopes; topographical complexity appears to be the reason. Regarding uncertainties, MLTs are the dominant source. In future projections, the highlands show shorter dry spell lengths with more frequent but less intense high rainfall events and higher annual rainfall. The Andean slopes exhibit an increased annual rainfall with a reduction in the high precipitation intensities but an increased frequency. The Amazon lowlands present a decrease in annual rainfall, and the Chaco lowlands an increase.

Two-dimensional ultrasound (2D US) is commonly used in clinical settings for its cost-effectiveness and non-invasiveness, but it is limited by spatial orientation and operator dependency. Three-dimensional ultrasound (3D US) overcomes these limitations by adding a third dimension and enhancing integration with other imaging modalities. Advances in deep learning (DL) have further propelled the viability of freehand image-based 3D reconstruction, broadening clinical applications in intraoperative and point-of-care (POC) settings. This review evaluates state-of-the-art freehand 3D US reconstruction methods that eliminate the need for external tracking devices, focusing on experimental setups, data acquisition strategies, and reconstruction methodologies. PubMed, Scopus, and IEEE Xplore were searched for studies since 2014 following PRISMA guidelines, excluding those using additional imaging or tracking systems other than inertial measurement units (IMUs). Fourteen eligible studies were analyzed, showing a shift from traditional speckle decorrelation towards DL-based methods, particularly Convolutional Neural Networks (CNNs). Variability in datasets and evaluation methods hindered a comprehensive quantitative comparison, but notable accuracy improvements were observed with IMUs and integration of contextual and temporal information within CNNs. These advancements enhance freehand 3D US reconstruction feasibility, though variability limits definitive conclusions about the most effective methods. Future research should focus on improving precision in complex trajectories and adaptability across clinical scenarios.

In addressing the multifaceted problem of multiple-input multiple-output (MIMO) detection in wireless communication systems, this work highlights the pressing need for enhanced detection reliability under variable channel conditions and MIMO antenna configurations. We propose a novel method that sets a new standard for deep unfolding approaches to MIMO detection by integrating the iterative conjugate gradient method with Tikhonov regularization, combining the adaptability of modern deep learning techniques with the robustness of classical regularization. Unlike conventional techniques, our strategy treats the regularization parameter of Tikhonov regularization as well as step size values and search direction coefficients of conjugate gradient (CG) method as trainable parameters within the deep learning framework, allowing for dynamic modification according to channel conditions and MIMO antenna configurations. Detection performance is significantly improved by the proposed approach in variety of conditions. In different MIMO settings, the suggested method consistently shows better bit error rate (BER) and normalized minimum mean square error (NMSE) performance. Across a range of MIMO configurations and channel conditions, the proposed method exhibits significantly lower BER and NMSE values than well-known techniques such as DetNet and CG. The proposed method has superior performance over CG and other model-oriented methods, especially in small number of iterations. Consequently, the simulation results demonstrate the flexibility of the proposed approach, making it a viable choice for MIMO systems with a range of antenna configurations and different channnel conditions.

Explainable Artificial Intelligence (XAI) plays a vital role in increasing transparency and trust in machine learning models, particularly when applied to tabular data which is used in domains such as finance, healthcare, and marketing. This paper presents an extensive survey of XAI techniques used with tabular data and aims to analyze recent research developments since 2021. The survey classes and describes several XAI techniques pertinent to tabular data, it identifies challenges specific to this domain, and explores potential applications and emerging trends. Future research directions are outlined, concentrating on the need for clear definitions of terminology used, data security, user-centric explanations, enhanced interaction, robust evaluation metrics, and advancements in adversarial example-based analysis. The aim is to contribute to the evolving field of XAI, and provide insights for effective, trustworthy, and transparent decision-making using tabular data.

Machine Learning (ML) has revolutionized healthcare by enhancing diagnostic capabilities because of its ability to analyze large datasets and detect minor patterns often overlooked by humans. This is beneficial, especially in pain recognition, where patient communication may be limited. However, ML models often face challenges such as memorization and sensitivity to adversarial examples. Regularization techniques like mixup, which trains models on convex combinations of data pairs, address these issues by enhancing model generalization. While mixup has proven effective in image, speech, and text datasets, its application to time-series signals like electrodermal activity (EDA) is less explored. This research uses ML for pain recognition with EDA signals from the BioVid Heat Pain Database to distinguish pain by applying mixup regularization to manually extracted EDA features and using a Support Vector Machine (SVM) for classification. Results showed that this approach achieved an average accuracy of 75.87% using leave-one-subject-out cross-validation (LOSOCV) compared to 74.61% without mixup. This demonstrates the mixup’s efficacy in improving ML model accuracy for pain recognition from EDA signals. This study highlights the potential of mixup in ML as a promising approach to enhance pain assessment in healthcare.

Procedural and reporting guidelines frame the process of scientific practices and communications among researchers and the community at large. In the pursuit of fostering reproducibility, several methodological frameworks have been proposed by several initiatives. Nevertheless, recent studies indicate that data leakage and reproducibility are still prominent challenges. Recent studies have shown the transforming potential of incorporating the FAIR (Findable, Accessible, Interoperable and Reusable) principles in the work-flow of different context such as software and machine learning model development stages to cultivate open science. In this work, we introduce a framework to calibrate reporting guidelines against the FAIR principles in order to foster reproducibility and open science. We adapted the “Best fit” framework synthesis approach to develop the calibration framework. We propose a series of defined workflows to calibrate reporting guidelines with FAIR principles and a use case to demonstrate the process. By integrating FAIR principles with established reporting guidelines, the proposed framework bridges the gap in accommodating both FAIR metrics and reporting guidelines and benefits from advantages of these major integrated components.

Credit business is a vital part of the bank's core business, which has an extremely important impact on the bank's income and development. In the operation of credit business, credit risk assessment is particularly crucial, and accurate risk assessment can minimize risks while maximizing the bank's returns. We propose a method to optimize credit risk assessment using machine learning techniques. In this work, we employ a random forest machine learning model to process and analyze large amounts of loan application data. By using correlation analysis, information enrichment, etc., the characteristics that have the most impact on credit risk assessment are screened. Subsequently, the model was constructed using a random forest algorithm. Random forests improve the generalization ability and accuracy of the model by building multiple decision trees and introducing randomness between these trees. In the experimental analysis part, we compare the performance of various models on the German credit dataset, and the results show that the deep learning model outperforms the traditional machine learning model in most indicators, verifying the effectiveness of our method.

In Kenya, reports of Rift Valley fever (RVF), one of the worst climate-sensitive zoonosis, have been common. Despite the fact that several empirical studies have demonstrated that Machine learning techniques perform better than time series models in forecasting time series data, there is little evidence of their use in predicting disease outbreaks in Africa. Recently, the literature has mentioned a number of other uses of machine learning to support intelligent decision-making in the healthcare industry and public health but there is limited knowledge on the use of the XGBoost model in the prediction of disease outbreaks. Among the Kenyan provinces, Rift valley fever cases were more pronounced in Rift valley (26.80%) and Eastern (20.60%) regions. The study explored the relationship be-tween RVF incidence and various climatic factors, such as humidity, clay content, elevation, slope, and rainfall. The strongest correlation, a meager 0.02903 for rainfall, was found in the correlation matrix, which showed weak linear relationships between various climatic factors and RVF cases. These climate variables were used to train the XGBoost model, which showed remark-able performance with an AUC of 0.8908, accuracy of 99.74%, precision of 99.75%, and recall of 99.99%. Rainfall was found to be the most important predictor in the feature importance analysis. These findings are consistent with other research showing how important weather conditions are to RVF outbreaks. According to the study's findings, the use of sophisticated machine learning models that take a variety of climatic factors into account can greatly improve RVF outbreak prediction and control.

NMR spectroscopy, which is based on the phenomenon of nuclear magnetic resonance, has been widely popularized by its application in medical imaging under the name of MRI. In the organic laboratory, the 13C NMR spectrum of a newly synthetized compound remains an essential step in elucidating its structure. For the chemist, the interpretation of such a spectrum, which is a set of chemical shift values, is made easier if he has a tool capable of predicting with sufficient accuracy the carbon shift values from the structure he intends to prepare. As there are few open source methods for accurately estimating this property, we applied our graph machine approach to build models capable of predicting the chemical shifts of carbons. For this study, we have focused on benzene compounds building an optimized model derived from training a database of 10577 chemical shifts originating from 2026 structures which contain up to ten types of atoms other than carbon, namely H, O, N, S, P, Si and halogens. It provides a training root mean squared relative error (RMSRE) of 0.5 %, i.e. a root mean squared error (RMSE) of 0.6 ppm, and a mean absolute error (MAE) of 0.4 ppm for estimating the chemical shifts of the 10k carbons. The predictive capability of the graph machine model is also compared with that of three commercial software on a data set of 171 original benzenic structures (1012 chemical shifts). The graph machine model proves very efficient in predicting chemical shifts with an RMSE of 0.9 ppm, and compares favorably with the RMSEs of 3.4, 1.8 and 1.9 ppm computed with ChemDraw, ACD and MestReNova softwares respectively. Finally, a Docker-based tool is proposed to predict the carbon chemical shifts of benzenic compounds solely from their SMILES codes.

Target recognition and fine-grained ship classification in remote sensing face the challenges of high inter-class similarity and sample scarcity. A transfer fusion-based ship image harmonization algorithm is proposed to overcome these challenges. This algorithm designs a feature transfer fusion strategy based on the combination of region aware instantiation and attention mechanism. Implement adversarial learning through image harmony generator and discriminator module to generate realistic remote sensing ship harmony images. Furthermore, the do-main encoder and domain discriminator modules are responsible for extracting feature representations of foreground and background, and further aligning ship foreground with remote sensing ocean background features through feature discrimination. Compared with other advanced image conversion techniques, our algorithm delivers more realistic visuals, improving classification accuracy for six ship types by 3% and twelve types by 2.94%, outperforming Sim2RealNet. Finally, a mixed dataset containing data augmentation and harmonizing samples and real data was proposed for the fine-grained classification task of remote sensing ships. Evaluation experiments were conducted on 8 typical fine-grained classification algorithms, and the accuracy of fine-grained classification for all categories of ships was analyzed. The experimental results show that the mixed dataset proposed in this paper effectively alleviates the long tail problem in real datasets, and the proposed remote sensing ship data augmentation framework performs better than state-of-the-art data augmentation methods in fine-grained ship classification tasks.

In high-risk railway construction, personal protective equipment monitoring is critical but challenging due to small and frequently obstructed targets. We propose YOLO-EA, an innovative model that enhances safety measure detection by integrating ECA into its backbone's convolutional layers, improving discernment of minuscule objects like hardhats. YOLO-EA further refines target recognition under occlusion by replacing GIoU with EIoU loss. YOLO-EA's effectiveness was empirically substantiated using a dataset derived from real-world railway construction site surveillance footage. It outperforms YOLOv5, achieving 98.9% precision and 94.7% recall, up 2.5% and 0.5% respectively, while maintaining real-time performance at 70.774 fps. This highly efficient and precise YOLO-EA holds great promise for practical application in intricate construction scenarios, enforcing stringent safety compliance during complex railway construction projects.

Fault detection in transmission lines plays a role in maintaining the dependability and steadiness of power networks. Traditional methods for identifying faults often struggle to handle the diverse nature of real world fault situations. Machine learning (ML) algorithms offer a data centered approach that can adjust and learn from datasets potentially overcoming the limitations of traditional approaches. This document presents a review of progress in using ML for detecting faults in transmission lines. By drawing insights from a variety of studies we explore how ML algorithms have evolved in fault detection, including techniques like networks, recurrent neural networks featuring Long Short Term Memory and convolutional neural networks. We delve into the spectrum of applications where ML is used for fault detection across fault scenarios and operational settings. Additionally we discuss the obstacles and prospects linked to putting ML based fault detection systems into practice such as challenges with data quality, model interpretability and integration with existing grid monitoring systems. Lastly we outline future research paths focused on pushing forward the boundaries of fault detection, in power transmission systems through approaches and collaborative endeavors involving academia, industry players and policymakers. In general, this review highlights how machine learning has the power to revolutionize fault detection methods enhancing the resilience and dependability of power systems.

In this paper we propose a module that uses features learned by a deep convolutional neural network to infer areas of corrosion and segment pixels to corrosion areas of inspection interest. Our segmentation module is based on eigen tree decomposition and information based decision criteria. To interrogate performance we use several state-of-the-art deep learning architectures and compare to our approach. The results indicate that our method produces better results in terms of accuracy and precision, whilst maintaining good (f-score) significance over the entire dataset.

Identification and segmentation of rock particles is very important in geology, mining, engineering construction, and environmental monitoring. Traditional methods for recognizing the rock particle characteristics are time-consuming, labor-intensive, and limited by the geographical scope of the sampling sites, which makes it more difficult to represent the spatial distribution of the rock particles accurately. Recent advancements in deep learning techniques offer promising solutions to automate this process. This study aims at utilizing state-of-the-art (SOTA) Mask R-CNN deep learning algorithm from the Detectron2 framework, to capture global features of rocks that will enable the recognition of rock particles more efficiently, just from having the rock images. These images are subject to image processing techniques such as a Gaussian filter, to denoise and smoothen the image, and an Illumination Adaptive Transformer (IAT) framework, to adjust the lighting exposure; all of which add to improve the quality of the image dataset. Afterward, the Mask R-CNN and Detectron2 models are utilized in training the images using transfer learning. Experimental results from evaluating the performance of the proposed algorithms showcase the effectiveness of the approach, thereby highlighting its potential to revolutionize rock particle segmentation across various domains.

The IEEE 802.11ah standard is introduced to address the growing scale of Internet of Things (IoT) applications. To reduce contention and enhance energy efficiency within the system, the restricted access window (RAW) mechanism is introduced at the medium access control (MAC) layer to manage the significant number of stations accessing the network. However, the RAW parameters need to be appropriately determined to achieve optimal network performance. In this paper, we optimize the configuration of RAW parameters in the IEEE 802.11ah-based IoT network. We analyze and propose an RAW parameters optimization problem with the objective of improving network throughput and formulate it as a Markov decision process. To cope with the complex and dynamic network conditions, we propose a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm to find the optimal RAW parameters. We construct network environments with periodic and random traffic in the NS-3 simulator to validate the performance of the proposed PPO-based RAW parameters optimization algorithm. Simulation results reveal that using the PPO-based DRL algorithm, optimal RAW parameters can be obtained under different network conditions, thereby significantly improving network throughput.

Evolutionary algorithms and swarm intelligence algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using these algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1, 2 and 3, the author previously reported experimental evaluations on Evolution Strategy, Genetic Algorithm, and Differential Evolution for reinforcement learning of neural networks, utilizing the Acrobot control task. This article constitutes Part4 of the series of comparative research. In this study, Particle Swarm Optimization is adopted as an instance of major swarm intelligence algorithms. The experimental result shows that PSO performed worse than all of DE, GA and ES. The difference between PSO and DE was statistically significant (p<.01). In addition, PSO exhibited lower capability in exploring solutions in high-dimensional search spaces than DE, GA, and ES did. A larger swarm size compensated for the weakness of PSO in global exploration, thus making itself more beneficial than a larger number of swarm search iterations.

A compositional data vector is a special type of multivariate observation in which the elements of the vector are non-negative and sum to a constant, usually taken to be unity. A compositional data does not have zero and only retains relative information. Furthermore, comparisons can only be made between compositional data of the same component. The relevant sample space is the standard simplex. A simplex space is a space that is a generalized form of a triangle. For compositional data, many of the operations defined in Euclidean space are meaningless. Microbiome analyzes have become popular in recent years. Operational Taxonomic Units (OTU) and Amplicon Sequence Variants (ASVs) used in microbiome analysis are one type of compositional data. The microbiome data are counts of different species within a sample and it is compositional. Although there is an order of bacterial abundance within a sample, there is no order of bacterial abundance between samples. Firmicutes and Bacteroidetes, the major phyla in the colon, have been observed in humans worldwide. Gut microbiome analyses often use the Firmicutes/Bacteroidetes ratio and principal coordinates analysis (PCoA). Alpha and beta diversities are used as indicators of bacterial flora diversity. However, misinformation is pervasive in the human microbiome literature and analysis. There is a lot of misunderstanding regarding compositional data and its analysis. An attempt was made to demonstrate how to analyze using the “National Institutes of Biomedical Innovation, Health and Nutrition (NIBIOHN JMD) (Public Data).” The results showed that PCoA did not work, and principal component analysis (PCA) was useful for analyzing the gut microbiome relative diversity.

In this review paper, we discuss the use of BERT, one of the most well-liked deep learning-based language models. The model's operation mechanism, key areas of applicability to text analytics tasks, comparisons with related models for each activity, and a description of certain proprietary models are all covered in this work. The data from several dozen original scientific studies that have been published in the last few years and have garnered the greatest interest from the scientific community were systematized in order to prepare this review. All researchers and students who wish to learn about the most recent developments in the field of natural language text analysis may find this survey helpful. Bidirectional Encoder Representations from Transformers, or BERT for short, is the subject of a thorough investigation that we present. The area of natural language processing holds significant importance in the creation of intelligent systems. To do a variety of activities, one must comprehend the sentence's correct meaning in order to produce the desired result. Computers have a hard time understanding languages because of how context constantly changes. The main challenge in natural language processing tasks is getting computers to understand text context, and BERT is seen as a revolution in this regard. It picks up the language and its meaning in a manner that is quite similar to how the human brain processes meaning from sentences. Its capacity to identify a word from both the left and right contexts of a sentence makes it special. A new era in the perception and comprehension of natural languages has been ushered in with the development of BERT, which could help computers understand natural languages more fully. This study aims to provide readers with a deeper knowledge of the BERT language model and how it is applied to different NLP tasks.

Background: The growth of arthroplasty procedures requires innovative strategies to reduce inpatients Length of Stay (LOS). This study aims to develop a machine learning prediction model that may aid to predict LOS after hip or knee arthroplasties. Methods: A collection of all the clinical notes of patients undergoing elective primary or revision arthroplasty from 1 January 2019 to 31 December 2019 was performed. The hospitalization has been classified as “Short LOS” if it was less than or equal to 6 days and “Long LOS” if it was greater than 7 days. Clinical data coming from pre-operative laboratory analysis, vital parameters, demographic characteristics of patients were screened. Final data have been used to train a Logistic Regression model with the aim of predicting short or long LOS. Results: Final dataset was composed of 1517 patients (795 “LONG”, 722 “SHORT”, p = 0.3196) with a total of 1541 admissions (729 “LONG”, 812 “SHORT”, p &lt; 0.000). Complete model had a prediction efficacy of 78,99% (AUC 0.7899). Conclusions: Machine learning may facilitate day-by-day clinical practice predicting which patients are suitable for a shorter LOS, from those with a longer LOS in which a cautious approach could be recommended.

Machine learning (ML) based on neural network (NN) facilitates data-driven techniques for handling large amounts of data, either obtained through experiments or simulations at multiple spatio-temporal scales, thereby finding the hidden patterns underlying these data and promoting efficient research methods. The main purpose of this paper is to extend the capabilities of a new solver, called realFluidReactingNNFoam, under development at University of Perugia in OpenFOAM with NN algorithm for replacing complex real-fluid thermophysical property evaluations, using the approach of coupling OpenFOAM and Python-trained NN models. Currently, NN models are trained against data generated using the Peng-Robinson equation of state (PR-EoS) assuming mixture frozen temperature. The OpenFOAM solver, where needed, calls the NN models in each grid-cell with appropriate inputs, and the returned results are used and stored in suitable OpenFOAM data structures. Such inference for the thermophysical properties is achieved via the “Neural Network Inference in C made Easy” (NNICE) library, which proved to be very efficient and robust. The overall model is validated considering a liquid-rocket benchmark comprised of liquid-oxygen (LOX) and gaseous-hydrogen (GH2) streams. The model accounts for real-fluid thermodynamics and transport properties, making use of the PR-EoS and the Chung transport models. First, the development of a real-fluid model (RFM) with artificial neural network is described in detail. Then, the numerical results of the transcritical mixing layer (LOX/GH2) benchmark are presented and analyzed in terms of accuracy and computational ef-ficiency. Results of the overall implementation indicate that the combined OpenFOAM and ML approach provides a speed-up factor higher than seven, while preserving the original solver accuracy.

Convolutional neural networks (CNNs) have proven to be a very efficient class of machine learning (ML) architectures for handling multidimensional data by maintaining data locality, especially in the field of computer vision. Data pooling, a major component of CNNs, plays a crucial role for extracting important features of the input data and downsampling its dimensionality. Multidimensional pooling, however, is not efficiently implemented in existing ML algorithms. In particular, quantum machine learning (QML) algorithms have a tendency to ignore data locality for higher dimensions by representing/flattening multidimensional data as simple one-dimensional data. In this work, we propose using the quantum Haar transform (QHT) and quantum partial measurement for performing generalized pooling operations on multidimensional data. We present the corresponding decoherence-optimized quantum circuits for the proposed techniques along with their theoretical circuit depth analysis. Our experimental work was conducted using multidimensional data, ranging from 1-D audio data, to 2-D image data, to 3-D hyperspectral data, to demonstrate the scalability of the proposed methods. In our experiments, we utilized both noisy and noise-free quantum simulations on a state-of-the-art quantum simulator from IBM Quantum. We also show the efficiency of our proposed techniques for multidimensional data by reporting the fidelity of results.

The author previously reported an experimental result of evolutionary reinforcement learning of neural network controllers for the pendulum task. In the previous work, a conventional multilayer perceptron was employed in which connection weights were real numbers. In this study, the author experimentally applies an evolutionary algorithm to the reinforcement training of binary neural networks. In both studies, the same task and the same evolutionary algorithm are utilized, i.e. the pendulum control problem and Evolution Strategy respectively. The only differences lie in the memory size per connection weight and the model size of the neural network. The findings from this study are (1) the performance of the binary MLP with 32 hidden units was inferior to that of the real-valued MLP with 16 hidden units; however, this difference was not statistically significant (p >.05); (2) the trained binary MLP successfully swung the pendulum swiftly into an inverted position and maintained its stability after inversion, as the real-valued MLP had done; and (3) the memory size required to record the binary MLP with 32 hidden units is 3.1% or 6.2% of the memory size required to record the real-valued MLP with 16 hidden units.

Background: Genome-wide association studies (GWAS) have shed light on various complex diseases and traits, by detecting more than 400,000 associated genetic loci. This number is expected to drastically increase because of the use of novel artificial intelligence methods offering new ways to study the effects of variants. Deep learning using artificial neural networks (ANN) is a sub-field of artificial intelligence, which simulates how the human brain learns. We aimed at assessing the potential of deep learning in human genetic studies of Alzheimer’s Disease (AD) and how these compare to the traditional statistical methods used in GWAS, by simultaneously testing the two approaches on the same dataset, while discovering new genetic loci associated to AD. Methods: To address this aim, phenotypic and genome-wide SNP data from the UK Biobank was analysed on a binary outcome, AD diagnosis, in two different data balance options, of one-to-one and one-to-two case-control datasets, using 2,764 cases vs 2,764 controls and 5,528 controls respectively matched on gender, age, ethnicity, PC1-20 and genotyping array. Genetic data handling and GWAS were performed using PLINK, whereas neural networks were trained using GenNet, a new ANN tool, with the same datasets, separated into training (60%), validation (20%) and test (20%) sets. Neural network layers were determined using biological knowledge, by annotating SNPs to genes and genes to AD related pathways, using ANNOVAR annotations followed by GeneSCF and KEGG. Results: Significant associations were detected between four SNPs linked to two different genes and AD for the 1 to 1 case-control study design and six SNPs linked to four different genes for the 1 to 2 case-control study design by using PLINK. All identified regions have been previously associated to AD. GenNet identified twelve SNPs on seven genes to be associated with AD, all with biological plausibility, achieving an AUC of 0.80 when using three biologically determined layers and 0.73 when using two layers at the neural networks. No common top SNPs were identified between the machine learning and GWAS models. Conclusion: This is one of the first studies attempting to compare the traditional GWAS to more sophisticated state-of-art methods for understanding the genetic architecture of complex phenotypes using the same dataset. More systematic comparisons with such approaches on real data are needed to enable best practises for machine learning in the analysis of genome-wide genetic data.

Audio classification using deep learning models, essential for applications like voice assistants and music analysis, faces challenges when deployed on edge devices due to their limited computational resources and memory. Achieving a balance between performance, efficiency, and accuracy is a significant obstacle in optimizing these models for such constrained environments. In this investigation, we evaluate diverse deep learning architectures, including Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM), for audio classification tasks on the ESC 50, UrbanSound8k, and Audio Set datasets. Our empirical findings indicate that Mel Spectrograms outperform raw audio data, attributing this enhancement to their synergistic alignment with advanced image classification algorithms and their congruence with human auditory perception. To address the constraints of model size, we apply model compression techniques, notably magnitude pruning, Taylor Pruning, and 8-bit quantization. The research demonstrates that a hybrid pruned model achieves a commendable accuracy rate of 89 percent, which, although marginally lower than the 92 percent accuracy of the uncompressed CNN, strikingly illustrates an equilibrium between efficiency and performance. Subsequently, we deploy the optimized model on Raspberry Pi 4 and NVIDIA Jetson Nano platforms for audio classification tasks. These findings highlight the significant potential of model compression strategies in enabling effective deep learning applications on resource-limited devices, with minimal compromise on accuracy.

Capsizing accidents are regarded as marine accidents with a high rate of casualties per accident. Approximately 89% of all such accidents occur in small ships (vessels with gross tonnage less than 10 tons). Stability calculations are critical for assessing the risk of capsizing incidents and evaluating a ship's seaworthiness. Despite the high frequency of capsizing accidents involving small ships, they are generally exempt from adhering to stability regulations, thus remaining systemically exposed to the risk of capsizing. Moreover, the absence of essential design documents complicates direct ship stability calculations. This study utilizes hull form feature data—obtained from the general arrangement of small ships—as input for a deep learning model. The model is structured as a multilayer neural network and aims to infer hydrostatic curves, which is required data for stability calculations.

Due to the recent trend of unmanned economy, retail stores have gradually reduced their service and cashier manpower. The retail product recognition becomes one of key issues for unmanned shopping. Although the success of deep neural networks has made object recognition feasible in a variety of applications, it still struggles to perform well on a large number of classes of retail products. In this paper, we propose an improved ensemble learning-based approach for retail product recognition. In the proposed approach, the object classification network is first improved through feature extraction and block attention. An ensemble model is then built by integrating multiple network models and using loss selection as model weights. In the experiments, the feasibility of our ensemble learning-based approach has been evaluated through many production items. The results demonstrate the effectiveness of the proposed approach compared with previous retail product recognition methods.

Academic researchers publish their work in various formats, such as papers, patents, and research reports, on different academic sites. When searching for a particular researcher's work, it can be challenging to pinpoint the right individual, especially when there are multiple researchers with the same name. In order to handle this issue, we propose a name disambiguation scheme of researchers with the same name based on heterogeneous academic sites. The proposed scheme collects and integrates research results from these varied academic sites, focusing on attributes crucial for disambiguation. It then employs clustering techniques to identify individuals who share the same name. Additionally, the proposed rule-based algorithm name disambiguation method and the existing deep learning-based identification method. This approach allows for the selection of the most accurate disambiguation scheme, taking into account the metadata available in the academic sites, using a multiclass classification approach. To demonstrate the effectiveness of the proposed method, we conduct various performance evaluations, measuring accuracy, recall, and the F1-measure, highlighting the scheme's superior performance in the name disambiguation.

There is a significant risk of injury in sports and intense competition due to the demanding physical and psychological requirements. Hamstring strain injuries (HSI) are the most prevalent type of injury among professional soccer players and are the leading cause of missed days in the sport. These injuries stem from a combination of factors, making it challenging to pinpoint the most crucial risk factors and their interactions, let alone find effective prevention strategies. Recently, there has been a growing recognition of the potential of tools provided by artificial intelligence (AI). However, current studies primarily concentrate on enhancing the performance of complex machine learning models, often overlooking their explanatory capabilities. Consequently, medical teams encounter difficulty interpreting these models and are hesitant to trust them fully. In light of this, there is an increasing need for advanced injury detection and prediction models that can aid doctors in diagnosing or detecting injuries earlier and with greater accuracy. Accordingly, this study aims to identify biomarkers of muscle injuries in professional soccer players through a biomechanical analysis, employing several ML algorithms, such as Decision tree (DT) methods, Discriminant methods, Logistic regression, Naive Bayes, Support vector machine (SVM), K-nearest neighbor (KNN), Ensemble methods, Boosted and bagged trees, Artificial Neural Networks (ANN), and XGBoost. In particular, XGBoost was also used to obtain the most important features. The findings highlight that the variables that most effectively differentiate the groups and could serve as reliable predictors for injury prevention are the maximum muscle strength of the hamstrings and the stiffness of the same muscle. With regards to the 35 techniques employed, a precision of up to 78% was achieved with XGBoost, indicating that by considering scientific evidence, suggestions based on various data sources, and expert opinions, it is possible to attain good precision, thus enhancing the reliability of the results for doctors and trainers. Furthermore, the obtained results strongly align with the existing literature, although further specific studies about this sport are necessary to draw a definitive conclusion.

The aims of this paper can be traced back to goals number seven, twelve and thirteen introduced by Agenda 2030, namely "affordable and clean energy", “responsible consumption and production” and "climate action”, respectively. This is due to the fact that the present work supports decarbonization processes acting in a direct way on the electricity consumption achieved by plants pertaining to the waste industry; in fact, this study aims at the realization of a machine learning model for predicting the energy consumption achieved by a mechanical biological treatment (MBT) waste plant located in central Italy, given the distribution of the entering waste. This model is implemented in MATLAB. The model can be used to tune the distribution of the entering waste in order to adapt the plant energy consumption to the capability of the energy sources and can serve as a play-ground model for other energy transformation plants. The results of the study, which feed the literature on the application of artificial intelligence to real industrial plants, could be used to determine energy efficiency actions that could be incorporated into Property’s strategic planning.

Global Earth Observation (EO) is becoming increasingly important in understanding and addressing critical aspects of life on our planet about environmental issues, natural disasters, sustainable development and others. EO plays a key role in making informed decisions on applying or reforming land use, responding to disasters, shaping climate adaptation policies etc. EO is also becoming a useful tool for helping professionals make the most profitable decisions, e.g., in real estate or the investment sector. Finding similarities in landscapes may provide useful information regarding applying contiguous policies, taking alike decisions or learning from best practices on events and happenings that have already occurred in similar landscapes in the past. However, current applications of similar landscape retrieval are limited by moderate performance and the need for time-consuming and costly annotations. We propose splitting the similar landscape retrieval task into a set of smaller tasks that aim at identifying individual concepts inherent to satellite images. Our approach relies on several models trained with Unsupervised Representation Learning (URL) on Google Earth images to identify these concepts. We show the efficacy of matching individual concepts for tackling the task of retrieving similar landscape(s) to a user-selected satellite image with a proof-of-concept application of the proposed approach on the geographical territory of the Republic of Cyprus. Our results demonstrate the efficacy of breaking up the landscape similarity task into individual concepts closely related to remote sensing instead of trying to capture all concepts and image semantics with a single model like a single RGB semantics model.

The rising number of unknown-type attacks on the Internet emphasizes the significance of developing efficient intrusion detection systems, even if machine learning-based techniques can detect unknown types of attacks. The necessity for innovative techniques is highlighted by the possibility that traditional machine learning techniques will not be sufficient for identifying these unknown types of attacks. In this research, we address this difficulty by proposing a deep learning-based solution: the log-cosh variational autoencoder (LVAE). When it comes to understanding intricate data distributions and creating freshly reconstructed data, LVAE inherits the strong modeling skills of the variational autoencoder (VAE). To better imitate discrete features of actual attacks and generate unknown types of attacks, this study develops an effective reconstruction loss term employing the logarithmic hyperbolic cosine (log-cosh) function in the log-cosh variational autoencoder (LVAE). When compared to conventional VAEs, LVAE exhibits promising potential for effectively generating data that closely resembles an unknown attack, a crucial capability for increasing the unknown attack detection rate. To categorize the generated unknown-type data, eight feature extraction and classification techniques were used. Using the most recent CICIDS2017 dataset, numerous experiments were carried out, training under varying amounts of real and unknown-type attacks. Our optimal experimental results outperformed several state-of-the-art techniques with accuracy and average F1 scores of 99.89% and 99.83%, respectively. Outstanding results were also shown by the suggested LVAE strategy for producing unknown attack data. In general, our work sets a strong basis for the accurate and efficient identification of unknown types of attacks and contributes to the development of intrusion detection techniques.

This study utilizes the Random Forest technique to investigate risk management practices and concerns in Islamic banks using survey data from 2016 to 2021. Findings reveal that larger banks provide more consistent survey responses, driven by their confidence and larger survey budgets. Moreover, a positive link is established between a country's development, characterized by high GDPs and low inflation and interest rates, and the precision of Islamic banks' survey responses. Analyzing risk-related concerns, the study notes a significant reduction in credit portfolio risk, attributed to improved risk management practices, global economic growth, stricter regulations, and diversified asset portfolios. Concerns related to terrorism financing and cybersecurity risks have also decreased due to better enforcement of anti-money laundering regulations and investments in cybersecurity infrastructure and education. This research enhances our understanding of risk management in Islamic banks, highlighting the impact of bank size and country development. Additionally, it emphasizes the need for ongoing analysis beyond 2021 to account for potential COVID-19 effects and evolving risk management and regulatory practices in Islamic banking.

Diabetes is one of the fatal diseases that play a vital role in the growth of other diseases in the human body. Controlling and curing diabetes in its early stages is the most significant technique to avoid its effects of diabetes. However, lack of awareness and expensive clinical tests are the primary reasons to skip clinical diagnosis and take preventive methods in lower-income countries like Bangladesh, Pakistan, and India. From this perspective, the study aims to build an automated machine learning (ML) model, which will predict diabetes at an early stage using socio-demographic characteristics rather than clinical attributes. Because clinical features are not always known to all people from lower-income countries. To find the best fit supervised ML classifier of the model, we applied six classification algorithms and found that RF outperformed with an accuracy of 99.36%. In addition, the most significant risk factors were found based on the SHAP value by all the applied classifiers. The study reveals that polyuria, polydipsia, and delayed healing are the most significant risk factors for growing diabetes. The findings indicate that the proposed model is highly capable of predicting diabetes in the early stages.

Human Action Recognition is widely used in multiple fields to recognize activities and extract spatial and temporal information. This paper focuses on analyzing various methods as well as provides extensive knowledge of the foundational concepts of the HAR. A dataset is also very crucial for any research study so we discussed the popular dataset and its features in this paper.

Deep networks-based hashing has gained significant popularity in recent years, particularly in the field of image retrieval. However, most existing methods only focus on extracting semantic information from the final layer, disregarding valuable structural information that contains important semantic details crucial for effective hash learning. To address this limitation and improve image retrieval accuracy, we propose a novel deep hashing method called Deep Supervised Hashing by Fusing Multiscale Deep Features (DSHFMDF). Our approach involves extracting multiscale features from multiple convolutional layers and fusing them to generate more robust representations for efficient image retrieval. Experimental results on CIFAR10 and NUS-WIDE datasets demonstrate that our method surpasses the performance of state-of-the-art hashing techniques.

In recent years, applying deep learning to solve physics problems has attracted much attention. Data-driven deep learning methods produce operators that can learn solutions to the whole system of partial differential equations. However, the existing methods are only evaluated on simple flow equations (e.g., Burger's equation), and only consider the generalization ability on different initial conditions. In this paper, we construct CFDBench, a benchmark with four classic problems in computational fluid dynamics (CFD): lid-driven cavity flow, laminar boundary layer flow in circular tubes, dam flows through the steps, and periodic Karman vortex street. Each flow problem includes data with various boundary conditions, fluid physical properties, and domain geometries. Compared to existing datasets, the advantages of CFDBench are (1) comprehensive. It contains common physical parameters such as velocity, pressure, and cavity fraction. (2) realistic. It is very suitable for deep learning solutions of fluid mechanics equations. (3) challenging. It has a certain learning difficulty, prompting to find models with strong learning ability. (4) standardized. CFDBench facilitates a comprehensive and fair comparison of different deep learning methods for CFD. We make appropriate modifications to popular deep neural networks to apply them to CFDBench and enable the accommodation of more changing inputs. The evaluation on CFDBench reveals some new shortcomings of existing works and we propose possible directions for solving such problems.

Facial emotion detection is a challenging task that deals with emotion recognition. It has applications in various domains, such as behavior analysis, surveillance systems and human-computer interaction (HCI). Numerous studies have been implemented to detect emotions, including classical machine learning algorithms and advanced deep learning algorithms. For the machine learning algorithm, the hand-crafted feature needs to be extracted, which is a tiring task and requires human effort. Whereas in deep learning models, automated feature extraction is employed from samples. Therefore, in this study, we have proposed a novel and efficient deep learning model based on Neural Architecture Search Network utilizing superior artificial networks such as RNN and child networks. We performed the training utilizing the FER 2013 dataset comprising seven classes: happy, angry, neutral, sad, surprise, fear, and disgust. Furthermore, we analyzed the robustness of the proposed model on CK+ datasets and comparing with existing techniques. Due to the implication of reinforcement learning in the network, most representative features are extracted from the sample network. It extracts all key features without losing the key information. Our proposed model is based on one stage classifier and performs efficient classification. Our technique outperformed the existing models attaining an accuracy of 98.14%, recall of 97.57%, and precision of 97.84%.

The prevalence of chronic diseases is dramatically increasing demand for emergency healthcare. Existing systems rely on patients self-identifying symptoms, causing dangerous delays. This study develops an AI and IoT-powered “digital twin” solution to enable continuous real-time monitoring and timely prediction of diverse medical emergencies. A digital twin is a virtual representation of an individual, modeled using multidimensional physiological data from wearable sensors. Machine learning techniques analyze patterns in this data to identify anomalies and predict emergencies like heart attacks or falls. A key contribution is an optimized ensemble algorithm combining gradient boosted trees, neural networks, and other techniques to accurately detect emergency events. Evaluation on a dataset of 9158 samples shows the digital twin identifies key emergencies with over 90% recall, enabling prevention and rapid response. It allows risk stratification and personalized interventions based on early warnings, circumventing over 2 million avoidable emergency room visits annually. This study demonstrates the feasibility of an integrated, predictive, patient-centric emergency response system enabled by digital twin technology.

Computational Fluid Dynamics (CFD)-based simulation has been the traditional way to model complex industrial systems and processes. One very large and complex industrial system that has benefited from CFD-based simulations is the steel blast furnace. The problem with the CFD-based simulation approach is that it tends to be very slow to generate data. The CFD-only approach may not be fast enough for use in real-time decision-making. To address this issue, in this work, the authors propose the use of machine learning techniques to train and test models based on data generated via CFD simulation. Regression models based on neural networks are compared to tree boosting models. In particular, several areas (tuyere, raceway, and shaft) of the blast furnace are modeled using these approaches. The results of the model training and testing are presented and discussed. The obtained R2 metrics are, in general, very high. The results look promising and may help to improve the efficiency of operator and process engineer decision-making when running a blast furnace.

With the rise of the Internet of Things (IOT), mobile devices and Location-Based Social Network (LBSN), an abundant amount of trajectory data has made research on location prediction more popular. The check-in data shared through LBSN hides information related to life patterns, obtaining this information is helpful for location prediction. However, the trajectory data recorded by mobile devices is different from check-in data that has semantic information. In order to obtain the user’s semantic, relevant studies match the stay point to the nearest Point of Interest (POI), but location error may lead to wrong semantic matching. Therefore, we propose A Self-Attention for Next Location Prediction based on Semantic Mining to predict the next location. When calculating the semantic feature of a stay point, the first step is to search for the k nearest POI, then use the reciprocal of the distance from the stay point to the k nearest POI and the number of categories as weights. Finally, we use the probability to express semantic without losing other important semantic information. Furthermore, this research combined with sequential pattern mining can bring richer semantic features. In order to better perceive the trajectory, temporal features learn periodicity of time series by sine function. In terms of location features, we build a directed weighted graph and regard the frequency of users visiting locations as the weight, so the location features are rich in contextual information. We then adopt the Self-Attention model to capture long-term dependencies in long trajectory sequences. Experiments in Geolife show that the semantic matching of this study improved by 45.78% in TOP@1 compared with the closest distance search for POI. Compared with the baseline, the model proposed in this study improved by 2.5% in TOP@1.

With the continuous development of network technology, complex network systems generate massive unbalanced attack traffic. Due to the severe imbalance in the quantities of normal samples and attack samples, as well as among different types of attack samples, intrusion detection systems suffer from low detection rates for rare class attack data. In this paper, we propose a geometric synthetic minority oversampling technique based on optimized kernel density estimation algorithm. This method can generate diverse rare class attack data by learning the distribution of rare class attack data while maintaining similarity with the original sample features. Meanwhile, the balanced data is input to a feature extraction module built upon multiple denoising autoencoders, reducing information redundancy in high-dimensional data and improving the detection performance for unknown attacks. Subsequently, a soft voting ensemble learning technique is utilized for multi-class anomaly detection on the balanced and dimensionally reduced data. Finally, an intrusion detection system is constructed based on data preprocessing, imbalance handling, feature extraction, and anomaly detection modules, and validated on the NSL-KDD and N-BaIoT datasets. Comparative experiments with baseline models and other state-of-the-art methods demonstrate that the proposed system improves the detection rate of rare class attack data. Furthermore, it achieves a good overall detection rate on the Internet of Things dataset (N-BaIoT), indicating its strong applicability.

Generative artificial intelligence (AI), in particular large language models such as ChatGPT have reached public consciousness with a wide-ranging discussion of their capabilities and suitability for various professions. The extant literature on the ethics of generative AI revolves around its usage and application, rather than the ethical framework of the responses provided. In the education sector, concerns have been raised with regard to the ability of these language models to aid in student assignment writing with the potentially concomitant student misconduct of such work is submitted for assessment. Based on a series of ‘conversations’ with multiple replicates, using a range of discussion prompts, this paper examines the capability of ChatGPT to provide advice on how to cheat in assessments. Since its public release in November 2022, numerous authors have developed ‘jailbreaking’ techniques to trick ChatGPT into answering questions in ways other than the default mode. While the default mode activates a safety awareness mechanism that prevents ChatGPT from providing unethical advice, other modes partially or fully bypass the this mechanism and elicit answers that are outside expected ethical boundaries. ChatGPT provided a wide range of suggestions on how to best cheat in university assignments, with some solutions common to most replicates (‘plausible deniability,’ language adjustment of contract written text’). Some of ChatGPT’s solutions to avoid cheating being detected were cunning, if not slightly devious. The implications of these findings are discussed.

In cold-climate regions, road salt is used as a de-icer for winter road maintenance. The applied road salt melts ice and snow on roads, being washed off through storm sewer systems into nearby urban streams, harming the freshwater ecosystem. Addressing the gap in the knowledge regarding the use of deep learning approaches for urban stream water quality forecasting, the present work discusses our implementation of a “Graph Neural Network” - “Sample and Aggregate” (GNN-SAGE) model for forecasting chloride concentrations in the Credit River in Ontario, Canada. The proposed GNN-SAGE is compared to other models, including a Deep Neural Network based transformer (DNN-Transformer) and a benchmarking persistence model for 6 hours forecasting horizon. Ac-cording to the results, the GNN-SAGE model surpasses other models in providing accurate predic-tions of chloride concentrations within the assessed prediction window. Also, a SHAP analysis provides insight into the variables that influence the model’s forecasting, showing the impact of the spatiotemporal neighbouring data from the network and the seasonality variables on the model’s result. The GNN-SAGE model shows potential for use in real-time forecasting of water quality in urban streams, aiding in the development of regulatory policies to protect the vulnerable freshwater ecosystems in urban areas.

Olive Anthracnose (OA) is the most important fungal disease of olive fruits worldwide. In the context of integrated pest management, the development of predictive models could be used for early diagnosis and control. In the current study, a dataset representing 58 cases (6 locations with 12 olive cultivars) was used to study the relationship between ΟΑ incidence (OAI) and 35 heterogeneous variables, including orchard characteristics, olive fruit parameters, foliar and soil nutrients, soil parameters and soil texture classes. The Random Forest-Recursive Feature Elimination with Cross Validation (RF-RFECV) feature selection method identified Location, Water Content, P, Ca, Mg, Exchangeable Mg, Trace Zn, Trace Cu as possible new indicators associated with OAI. Six different classification algorithms, namely Decision Tree (DT), Gradient Boosting (GB), Logistic Regression (LR), Random Forest (RF), K-Nearest Neighbors (KNN) and Support Vector Machine (SVM), were developed for predicting conditions leading to OAI >0% and 10%. Hyperparameter optimization using grid search was used to optimize the parameters of the models and finally the best parameters were applied to predict the OAI. The final models were evaluated in terms of several standard metrics, such as accuracy, sensitivity, specificity and ROC AUC score. Findings suggested that GB performance was superior compared to the other models for the prediction of the occurrence of OA disease (OAI>0%) with an accuracy of 86.7%, a sensitivity of 100%, a specificity of 75% and a ROC-AUC score of 93%, while for the prediction of the spread of the disease (OAI>10%), DT stood out with an accuracy of 86.7%, a sensitivity of 81.8%, a specificity of 100% and a ROC-AUC score of 91%. RF classifier performed very well in both cases, with an accuracy of 80%, a sensitivity of 85.7%, a specificity of 75% and a ROC-AUC score of 93% for the prediction of the occurrence of the disease (OAI>0%), and an accuracy of 86.7%, a sensitivity of 90.9%, a specificity of 75% and a ROC-AUC score of 84% for the prediction of the spread of the disease (OAI>10%).

Target recognition mainly includes three approaches: optical image-based, echo detection-based, and passive signal analysis-based methods. Among them, the passive signal-based method is closely integrated with practical applications due to its strong environmental adaptability. Based on passive radar signal analysis, we design an "end-to-end" model that cascades a noise estimation network with a recognition network to identify working modes in noise environment. The noise estimation network is implemented based on U-Net, which adopts a method of feature extraction and reconstruction to adaptively estimate the noise mapping level of the sample, which can help the recognition network to reduce noise interference. Focusing on the characteristics of radar signal, the recognition network is realized based on Multi-Scale Convolutional Attention Network (MSCANet). Firstly, the deep group convolution is used to isolate the channel interaction in the shallow network. Then, through the multi-scale convolution module, finer-grained features of the signal are extracted without increasing the complexity of the model. Finally, the self-attention mechanism is used to suppress the influence of low-correlation and negative-correlation channels and spaces. This method overcomes the problem that the conventional method is seriously disturbed by noise. We validated the proposed method in 81 kinds of noise environments, achieving an average accuracy of 94.65%. Additionally, we discussed the performance of six machine learning algorithms and four deep learning algorithms. Compared to these methods, proposed MSCANet achieved an accuracy improvement of approximately 17%. Our method demonstrates better generalization and robustness.

Modern power system integrates more and more new energy and use a large number of power electronic equipment. This makes it face more challenges in online optimization and real-time control. Deep reinforcement learning(DRL) has the ability of processing big data and high-dimensional features, as well as the ability of independently learning and optimizing decision-making in complex environments. In this paper, we explore DRL based online combination optimization method of grid section for large complex power system. In our method, to improve the convergence speed of the model, we propose to discretize the output action of the unit and simplify the action space. We also design a reinforcement learning loss function with strong constraints to further improve the convergence speed of the model and facilitate the algorithm to obtain the stable solution. Moreover, to avoid the local optimal solution problem caused by the discretization of the output action, we propose to use the annealing optimization algorithm to make the granularity of the unit output finer. We verify our method on IEEE 118-bus system. The experimental results show that our model has fast convergence speed and better performance, and can obtain stable solutions.

With the continuous progress of remote sensing image object detection tasks in recent years, researchers in this field have gradually shifted the focus of their research from horizontal object detection to the study of object detection in arbitrary directions. It is worth noting that some properties are different from the horizontal object detection during oriented object detection that researchers have yet to notice much. This article presents the design of a straightforward and efficient arbitrary-oriented detection system, leveraging the inherent properties of the orientation task, including the rotation angle and box aspect ratio. In the detection of low aspect ratio objects, the angle is of little importance to the orientation bounding box, and it is even difficult to define the angle information in extreme categories. Conversely, in the detection of objects with high aspect ratios, the angle information plays a crucial role and can have a decisive impact on the quality of the detection results. By exploiting the aspect ratio of different targets, this letter proposes a ratio-balanced angle loss that allows the model to make a better trade-off between low-aspect ratio objects and high-aspect ratio objects. The rotation angle of each oriented object, which we naturally embed into a two-dimensional Euclidean space for regression, thus avoiding an overly redundant design and preserving the topological properties of the circular space. The performance of the UCAS-AOD, HRSC2016, and DLR-3K datasets show that the proposed model in this paper achieves a leading level in terms of both accuracy and speed. The code is released at https://github.com/minghuicode/Periodic-Pseudo-Domain.

Artificial Intelligence (AI) has many advantages over humans in that it can detect incredibly subtle patterns within large quantities of data. This study suggests using AI algorithms in user research tasks for mining variables ranging from the tone of voice, image banks, historical records, and product use to determine where brands sit and where there could be competitive advantages. This study reviews the current design processes of User Experience (UX) designers and the advancements in Deep Learning (DL). It identifies potential areas of automation in the Preparation, Incubation and Illumination stages of the design process. It recognises the possibility of using Long Short-Term Memory (LSTM) models to automate design feedback and the creation of alternate designs with Generative Adversarial Networks (GANs).

Digital images have become an important carrier for people to access information in the information age. However, with the development of the technology, digital images are vulnerable to illegal access and tampering, to the extent that they pose a serious threat to personal privacy, social order and national security. Therefore, image forensic techniques have become an important research topic in the field of multimedia information security. In recent years, deep learning technology has been widely applied in the field of image forensics and the performance achieved has significantly exceeded the conventional forensic algorithms. This survey compares the state-of-the-art image forensic techniques based on deep learning in recent years. The image forensic techniques are divided into passive and active forensics. In passive forensics, forgery detection techniques are reviewed, and the basic framework, evaluation metrics and commonly used datasets for forgery detection are presented. The performance, advantages and disadvantages of existing methods are also compared and analyzed according to different types of detection. In active forensics, robust image watermarking techniques are overviewed, the evaluation metrics and basic framework of robust watermarking techniques are presented. The technical characteristics and performance of existing methods are analyzed based on the different types of attacks on images. Finally, future research directions and conclusions are given to provide useful suggestions for people in image forensics and related research fields.

Diabetes becomes a life threatening non-communicable disease in the world, according to International Diabetic Federation (IDF) in 2023, an estimated 537 million adults (20-79 years) are living with diabetes, which is equivalent to 9.3% of the global adult population. This number is predicted to rise to 643 million by 2030 and 783 million by 2045. Over 3 in 4 adults with diabetes live in low- and middle-income countries. Diabetes is a persistent metabolic condition marked by increased levels of glucose in the bloodstream. It is a significant global health concern, affecting millions of individuals worldwide. It having the symptoms of drowsiness for the whole day if not properly examined or treated well. It is targeted to spread over the younger age community and the number is growing in the exponential fashion. Even day to day many advancements have come from the researcher to diagnose, to find solutions to prevent from newer entry. Authors have taken a dataset with 57 non diabetic and 20 diabetic patients with the total 28735 micro array gene to undergone pre-processing process and reduced up to 22960 gene data using Dimensionality Reduction (DR) such as Detrend Fluctuation Analysis (DFA), Chi square probability density function (Chi2PDF), Firefly algorithm Cuckoo search were used in this research. Meta heuristic algorithms like Particle swarm Optimization (PSO) and Harmonic Search (HS) are used for feature selection. Further seven classification techniques such as Non-Linear Regression (NLR), Linear Regression (LR), Logistics Regression (LoR), Gaussian Mixture Model (GMM), Bayesian Linear Discriminant Classifier (BLDC), Softmax Discriminant Classifier (SDC), Support Vector Machine – Radial Basis Function (SVM-RBF) are using to make a decision, predictive analysis and segregate the data according to the level of blood glucose as Diabetic Patient (DP) and Non-Diabetic Patient (NDP).

With the advent of deep learning, significant progress has been made in low-light image enhancement methods. However, deep learning requires enormous paired training data, which is challenging to capture in real-world scenarios.To address this limitation, this paper presents a novel unsupervised low-light image enhancement method, which first introduces the frequency domain features of images in low-light image enhancement tasks. Our work is inspired by imagining a digital image as a spatially varying metaphoric “field of light”, then subjecting the influence of physical processes such as diffraction and coherent detection back onto the original image space via a frequency-domain to spatial-domain transformation (inverse Fourier transform). However, the mathematical model created by this physical process still requires complex manual tuning of the parameters for different scene conditions to achieve the best adjustment. Therefore, we proposed a dual-branch convolution network to estimate pixel-wise and high-order spatial interactions for dynamic range adjustment of the frequency feature of the given low-light image. Guided by the frequency feature from the “field of light” and parameter estimation networks, our method enables dynamic enhancement of low-light images. Extensive experiments have shown that our method performs well compared to state-of-the-art unsupervised, and its performance approximates the level of the state-of-the-art supervised methods qualitatively and quantitatively. At the same time, the light network structure design allows the proposed method to have an extremely fast inference speed(nearly 150 FPS on an NVIDIA 3090 Ti GPU for an image of size 600×400×3 ). Furthermore, the potential benefits of our method to object detection in the dark are discussed.

With the growing popularity of smartphones, user identification has become an essential component of maintaining security and privacy. This study investigates how smartphone accelerometer data can be used to identify users, and it makes recommendations for the ideal application parts. Accelerometer data from the HMOG public dataset was used to train deep learning, conventional classifiers, and voting classifiers, which were then utilized to identify users. To enhance performance, feature selection and pre-processing techniques were researched. The results show that RFE feature selection outperforms other approaches and that LSTM followed by XGBoost has the best identification performance as indicated by a relatively large number of machine learning performance measures. The proposed identification system nevertheless performed well and outperformed existing methods, which were principally created and tested on the same HMOG public smartphone dataset, even with a larger number of users. Further work would be necessary for such an application to reach its full potential, though.

Soccer is type of sport that carries a high risk of injury. Injury is not only cause in the unlucky soccer carrier and also team performance as well as financial effects can be worse since soccer is a team-based game. The duration of recovery from a soccer injury typically relies on its type and severity. Therefore, we conduct this research in order to predict the probability of players injury type using machine learning technologies in this paper. Furthermore, we compare different machine learning models to find the best fit model. Supervised classification machine learning models are applied in this paper. We gathered information about 54 professional soccer players who are playing in the top five European leagues based on their career history.

This study aimed to determine clinical instructors’ perceptions of the assessments used to evaluate the clinical knowledge of undergraduate nursing students. This study uses a descriptive phenomenological approach. Purposive sampling was used to recruit sixteen clinical instructors for semi-structured interviews between August to December 2019. All interviews were audio-recorded and transcribed verbatim. Data were analyzed using Colaizzi’s seven-step method. Four criteria were used to ensure the study’s validity: credibility, transferability, dependability, and confirmability. Three themes were identified in the clinical instructors’ views on evaluating the clinical performance of student nurses: familiarity with students, patchwork clinical learning, and differing perceptions of the same scoring system. Study results suggest the need for a reliable, valid, and consistent approach to evaluating students’ clinical knowledge. If the use of patchwork clinical internships for student nurses is unavoidable, a method for assessing student nurses’ clinical performance that requires instructor consensus is necessary.

Grain yield prediction affects policy making in various aspects such as agricultural production planning, food security assurance, and adjustment of foreign trade. Accurately predicting grain yield is of great significance in ensuring global food security. This paper is based on the MODIS remote sensing image data products from 2010 to 2020, and adds band information such as vegetation index and temperature to form composite remote sensing data as a data set. Aiming at the lack of models for large-scale forecasting and the need for human intervention in traditional models, this paper proposes a grain production estimation model based on deep learning. First, image cropping and yield mapping techniques are used to process the data to generate training samples. Then the channel and spatial attention mechanism (Convolutional Block Attention Module, CBAM) is added for extracting spatial information in different remote sensing bands to improve the efficiency of the model. Long Short-Term Memory (LSTM) neural networks is also added to obtain feature information in the time dimension. Finally, a national-scale grain yield prediction model is constructed. The proposed model was tested on data from 2018 to 2020 showing an average R2 of 0.940 and an average RMSE of 80,020 tons, indicating that it can predict Chinese grain yield better. The model proposed in this paper extracts grain yield information directly from the composite remote sensing data, and solves the problem of small-scale research and imprecise yield prediction in an end-to-end manner.

Forest fires are one of the world's deadliest natural disasters. Early detection of forest fires can help minimize the damage to ecosystems and forest life. In this paper, we propose an improved fire detection method YOLOv5-IFFDM for YOLOv5. Firstly, the fire and smoke detection accuracy and the network perception accuracy of small targets are improved by adding attention mechanism in the backbone network. Secondly, the loss function is improved and the SoftPool pyramid pooling structure is used to improve the regression accuracy and detection effect of the model and the robustness of the model. In addition, random Mosaic augmentation technique is used to enhance the data to increase the generalization ability of the model, and re-clustering of flame and smoke detection a priori frames are used to improve the accuracy and speed. Finally, the parameters of the convolutional and normalization layers of the trained model are homogeneously merged to further reduce the model responsibility to improve the detection speed. Experimental results on homemade forest fire and smoke datasets show that this algorithm has high detection accuracy and fast detection speed, with average accuracy of fire up to 90.5% and smoke up to 84.3%, and detection speed up to 75 FPS (frames per second transmission), which can meet the requirements of real-time and efficient fire detection.

Plants have a natural protective process of altering their genetic molecules in response to changing environments. To uncover the genetic potential of plants, it is crucial to understand how they adapt to adverse conditions by analyzing their genetic molecules. In the study, we focused on understanding the responsive genes of tomatoes under drought conditions. We analyzed RNASeq data from different Tomato genotypes, tissue types, and different drought durations. We used a time series scale to identify early and late drought-responsive gene modules and applied a machine learning method to identify the best responsive genes. We found six candidate genes of Tomato (ASCT, FLA2, BAG5, DCL2b, NFP7.3, and ADC1) that were responsive to drought. We further constructed their protein-protein interaction network to identify their potential interactors and found them drought responsive proteins. The candidate genes can help to explore the adaptation of tomato plants under drought conditions. The identification of these candidate genes and modules can have far-reaching implications for molecular breeding and genome editing in Tomato, providing insights into the molecular mechanisms that underlie drought adaptation. This research underscores the importance of the genetic basis of plant adaptation, particularly in changing climates and growing populations.

This research investigates the potential benefits of integrating machine learning algorithms and IoT sensors in modern agriculture. The focus is on optimizing crop production and reducing waste through informed decisions about planting, watering, and harvesting crops. The paper discusses the current state of machine learning and IoT in agriculture, highlighting key challenges and opportunities. It also presents experimental results that demonstrate the impact of changing labels on the accuracy of data analysis algorithms. The findings recommend that by analyzing wide-ranging data collected from farms, including real-time data from IoT sensors, farmers can make more informed verdicts about factors that affect crop growth. Eventually, the integration of these technologies can transform modern agriculture by increasing crop yields while minimizing waste. In our studies, we achieve a classification accuracy of 99.59% using the Bayes Net algorithm and 99. 46% using Naïve Bayes Classifier, and Hoeffding Tree algorithms. Our results indicate that we achieved high accuracy results in our experiments in order to increase crop growth.

Background: Functional Movement Screening (FMS) allows for rapid assessment of an individual’s physical activity level and timely detection of sports injury risk. However, traditional functional movement screening often requires on-site assessment by experts, which is time-consuming and prone to subjective bias. Therefore, the study of automated functional movement screening has become increasingly important. Methods: In this study, we propose an automated assessment method for FMS based on the improved Gaussian Mixture Model (GMM). First, the oversampling of minority samples is conducted, the movement features are manually extracted from the FMS dataset collected with two Azure Kinect depth sensors, then we train the Gaussian mixture model with different scores (1 point, 2 points, 3 points) of feature data separately, finally, we conducted FMS assessment by the Maximum Likelihood estimation. Results: The improved GMM has a higher scoring accuracy (Improved GMM:0.8) compared to other models (Traditional GMM=0.38, Adaboost.M1=0.7, Naïve-Bayes=0.75), and the scoring results of improved GMM have a high level of agreement with the expert scoring (kappa=0.67). Conclusions: The results show that the proposed method based on the improved Gaussian mixture model can effectively perform the FMS assessment task and it is potentially feasible to use depth cameras for FMS assessment.

In foggy weather scenarios, the scattering and absorption of light by water droplets and particulate matter cause object features in images to become blurred or lost, presenting a significant challenge for target detection in autonomous driving vehicles. To tackle this problem, this study proposes a foggy weather detection method, YOLOv5s-Fog, based on the YOLOv5s framework. The model enhances the feature extraction and expression capabilities of YOLOv5s by introducing a novel target detection layer, SwinFocus. Additionally, this research incorporates decoupled head into the model and replaces the conventional non-maximum suppression method with Soft-NMS. Experimental results demonstrate that these improvements effectively enhance the detection performance for blurry objects and small targets in foggy weather conditions. Compared to the baseline model YOLOv5s, YOLOv5s-Fog achieves a 5.4% increase in mAP on the RTTS dataset, reaching 73.4%. This method provides technical support for rapid and accurate target detection in adverse weather conditions, such as foggy weather, for autonomous driving vehicles.

In recent years, there has been a rise in the prevalence of autism spectrum disorder (ASD). The diagnosis of ASD requires behavioral observation and standardized testing completed by highly trained experts. Early intervention for ASD can begin as early as 1-2 years of age, but ASD diagnoses are not typically made until ages 2-5 years, thus delaying the start of intervention. There is an urgent need for non-invasive biomarkers to detect ASD in infancy. While previous research using physiological recordings has focused on brain-based biomarkers of ASD, this study investigated the potential of electrocardiogram (ECG) recordings as an ASD biomarker in 3-6-month-old infants. We recorded heart activity of infants at typical and elevated familial likelihood for ASD during naturalistic interactions with objects and caregivers. After obtaining the ECG signals, features such as heart rate variability (HRV) and sympathetic and parasympathetic activities were extracted from them. Then we evaluated the effectiveness of multiple machine learning classifiers for the classification of ASD likelihood. Our findings support our hypothesis that infant ECG signals contain a significant amount of information about ASD familial likelihood. Among the various machine learning algorithms tested, XGBoost performed best according to sensitivity (0.76±0.12), f1-score (0.75±0.12), precision (0.79±0. 12), classification accuracy (0.77±0.12, p-value = 0.01) and AUC (0.76±0.12, p-value = 0.02). These results suggest that ECG signals contains relevant information about the likelihood of an infant to develop ASD. Future studies should consider the potential of information contained in ECG, and other indices of autonomic control, for the development of biomarkers of ASD in infancy.

Machine learning has seen enormous growth in the last decade, with healthcare being a prime application for advanced diagnostics and improved patient care. The application of machine learning for healthcare is particularly pertinent in Africa, where many countries are resource-scarce. However, it is unclear how much research on this topic is arising from African institutes themselves, which is a crucial aspect for applications of machine learning to unique contexts and challenges on the continent. Here, we conduct a bibliometric study of African contributions to research publications related to machine learning for healthcare, as indexed in Scopus, between 1993 and 2022. We identified 3,772 research outputs, with most of these published since 2020. North African countries currently lead the way with 64.5% of publications for the reported period, yet Sub-Saharan Africa is rapidly increasing its output. We found that international support in the form of funding and collaborations is correlated with research output generally for the continent, with local support garnering less attention. Understanding African research contributions to machine learning for healthcare is a crucial first step in surveying the broader academic landscape, forming stronger research communities, and providing advanced and contextually aware biomedical access to Africa.

Respiratory rate is an important biomarker that indicates changes in the clinical condition of critically ill patients, so a surveillance tool that can accurately monitor the changing respiratory rate in real time is needed. Through investigating various pairs of machine learning models, we proposed new machine learning model for real-time respiratory rate estimation using photoplethysmogram. New photoplethysmogram-driven respiratory rate dataset(StMary) was collected from surgical intensive care unit of a tertiary referral hospital, using photoplethysmogram signal collector. For 50patients and 50healthy volunteers, 2-minute photoplethysmogram was collected for each subject twice. To evaluate the respiratory rate of subject, it was inputted into the deep neural network model we built, and dataset was splitted into training, validation, testing dataset, then 4-fold cross validation was exploited. Our deep neural network model trained with StMary and two public datasets(BIDMC and CapnoBase) individually, or selectively merged dataset had shown a low error rate in respiration rate measurements. Our model trained with StMary showed low mean absolute error score(1.0273±0.8965), and trained with 3 datasets(CapnoBase, BIDMC and StMary) showed a lower error rate(1.7359±1.6724) than the model trained with CapnoBase and BIDMC(1.9480±1.6751). We could verify the performance of model evaluating respiratory rate from photoplethysmogram, and our dataset could contribute as the clinical research data that supports artificial intelligence models evaluating respiratory rate and surveillance tools to test whether their monitoring function works properly.

Augmented reality (AR) offers an accessible, inexpensive, and rich user experience that has the potential to engage end-users in an immersive environment. Along with vivid visualizations coupled with virtual agents, this technology further develops learning interest in end-users, guides them in various tasks, and boosts motivation and productivity. In this study, we leverage the deep penetration of mobile phones in daily lives and their advanced features to design, develop and demonstrate an AR application (CirculAR) that offers unique user-environment interaction in a gamified way. CirculAR combines learning with enjoyment to help end-users understand fundamental sustainability and circular economy principles. The application has been showcased in a controlled environment to heterogenous audiences and has been shown to improve end-user engagement and motivation. First, participants older than 18 were recruited to showcase the technology acceptance and engagement towards circular economy principles through AR. Then, students aged 5 to 15 years old, along with their parents and educators, were invited to a treasure hunt game where our virtual agent ARis guided them through a map full of virtual experiences. Assessment and evaluation were performed through a survey and a questionnaire. The outcome of their analysis showcased an increase in the dedication and enjoyment of the performed activities, engagement and learning attributes given the AR virtual agent supporting functionalities. Observations during showcasing reported a need for more commitment from the younger audience compared to the older one. This application contributes to the discourse on mobile AR as a tool for the education of novel concepts with a high impact on our daily lives and decisions and aims to shed light on the design principles of educative tools.

This paper presents an improved SOC estimation method for lithium ion batteries in Electric Vehicles using Bayesian optimized feedforward network. This innovative bayesian optimized neural network method attempts to minimize a scalar objective function by extracting hyperpa-rameters (hidden neurons in both layers) using a surrogate model. Furthemore, the hyperparameters are built and data samples are trained and validated. The performance of the proposed deep learning neural network is evaluated. Two reasonable size data samples are ex-tracted from Panasonic 18650PF Li-ion Mendeley datasets that are used for training and valida-tion. RNN and LSTM neural network algorithms offer the common core property of retaining past information and/or hidden states for better SOC estimation. However, the feature of this pro-posed method is the inclusion of Bayesian optimization that chooses optimal double layer hidden neurons. Analysis of results shows that Bayesian optimized feedforward algorithm with average MAPE (0.20%) is the lowest and is the best selection compared with average MAPE for other five deep learning algorithms. In the last quarter of fuel gauge, where fuel anxiety is severe, feed-forward with Bayesian Optimization algorithm is still the best selection (with MAPE of 0.64%).

In this paper we use quantum machine learning to detect and classify ocular diseases across age related macular degradation, cataract, diabetic, glaucoma, hypertension, and patological myopia categories versus a control group. We analyze fundus imagery from 1000 patients. Early findings indicate there may be benefit in terms of accuracy and loss function minimization of 2.07% and 1.979x respectively compared to a similar method implemented using traditional computers.

This qualitative study explores the implementation and conformation process of digital devices in teaching and learning before, during, and after the COVID-19 pandemic in Nepal. Using Rogers' Diffusion of Innovation Theory as a framework, the study examines the adoption and adaptation of digital devices by in-service secondary mathematics teachers (n=62) and their perceptions and preferences towards instructional modality. The findings suggest that despite the increased reliance on digital devices during the pandemic, there is a less likelihood of using them in face-to-face classrooms in developing countries like Nepal. The adoption of online learning has not yet reached the confirmation stage, even after the onset of the COVID-19 pandemic. Prior to the pandemic, online learning was not widely implemented or confirmed by teachers in developing countries societies. The study also provides important insights into the challenges and opportunities of using digital devices in post-COVID-19 classrooms, and its implications for policymakers and educators in Nepal.

The digital era offers many opportunities to the wind energy industry and research community. Digitalisation is one of the key drivers for reducing costs and risks over the whole wind energy project life cycle. One of the largest challenges in successfully implementing digitalisation is the lack of data sharing and collaboration between organisations in the sector. In order to overcome this challenge, a new collaboration method called WeDoWind was developed in recent work. The main innovation of this method is the way it creates tangible incentives to motivate and empower different types of people from all over the world to actually share data and knowledge in practice. In this present paper, the challenges related to comparing and evaluating different SCADA data based wind turbine fault detection models are investigated by carrying out a new case study, the "WinJi Gearbox Fault Detection Challenge", based on the WeDoWind Method. Six new solutions were submitted to the challenge, and a comparison and evaluation of the results show that, in general, some of the approaches (Particle Swarm Optimisation algorithm for constructing health indicators, performance monitoring using Deep Neural Networks, Combined Ward Hierarchical Clustering and Novelty Detection with Local Outlier Factor and Time-to-failure prediction using Random Forest Regression) appear to have a high potential to reach the goals of the Challenge. However, there are a number of concrete things that would have to have been done by the Challenge providers and the Challenge moderators in order to ensure success. This includes enabling access to more details of the different failure types, access to multiple data sets from more wind turbines experiencing gearbox failure, provision of a model or rule relating fault detection times or a remaining useful lifetime to the estimated costs for repairs, replacements and inspections, provision of a clear strategy for training and test periods in advance, as well as provision of a pre-defined template or requirements for the results. These learning outcomes are used directly to define a set of best practice data sharing guidelines for wind turbine fault detection model evaluation. They can be used by the sector in order to improve model evaluation and data sharing in the future.

Deep learning (DL) models have been recently widely used to extract task-oriented patterns from large scale of datasets, and to improve the data image understanding and analysis accuracy in many different decision-making processes for tasks such as image classification, segmentation, detection, and so on. However, in practice, the performances of DL models are easily affected by environmental illumination conditions. Conversely, DL models can also be utilized for extracting the illumination hints from the images, and these hints are critically useful for improving the model robustness, classifying the environmental scenes, estimating scene depth information, and rendering 3D objects. In this study, an extensive and exhaustive review is carried out for DL based color constancy, indoor and outdoor illumination estimation, and image depth estimations with the considerations of strengths and weaknesses of DL models. This study also explores the different network designs and the paradoxes in parameter optimization during the model training. Current technology barriers involved in implementing these models and recommendations to overcome these barriers are also suggested in the review.

A detailed literature review is performed in this study to address solutions for the full-body design and control of an aerial manipulator. Deep Reinforcement Learning methods are growing to be utilized recently to cope with various uncertainties. The pros and cons of these theories will be explained as well as introducing the advantages of Fuzzy Reinforcement Learning methods. State-of-the-Art, possible challenges, potential approaches, and a summary of desired precision devices are discussed in this study.