Although working memory (WM) is crucial for intellectual abilities, not much is known about its brain underpinnings, especially the structural connectivity. We used diffusion tensor imaging (DTI) to look across the whole brain for the white matter integrity correlates of the individual differences in the reading span (verbal WM capacity during reading) in healthy adults. Right-handed healthy native Russian speakers (N = 67) underwent DTI on a 3T Philips Ingenia scanner. Verbal WM was assessed with the Daneman-Carpenter reading span test (Russian version). Fractional anisotropy maps from each participant were entered into the group tract-based spatial statistics analysis with the reading span as a covariate; the results were TFCE-corrected. After taking into account effects of age, sex, education and handedness, reading span positively correlated with the white matter integrity in multiple sites: the body, the genu and the splenium of corpus callosum; bilateral corona radiata (anterior, posterior, and superior); bilateral superior longitudinal fasciculus; several tracts in the right hemisphere only, including the internal and external capsule; bilateral superior parietal and frontal white matter. Although the left hemisphere is central for verbal processing, we revealed the important role of the right hemisphere white matter for the verbal WM capacity. Our finding indicates that larger verbal working memory span may originate from additional processing resources of the right hemisphere.

This study investigates the application of deep residual networks for predicting the dynamics of interacting three-dimensional rigid bodies. We present a framework combining a 3D physics simulator implemented in C++ with a deep learning model constructed using PyTorch. The simulator generates training data encompassing linear and angular motion, elastic collisions, fluid friction, gravitational effects, and damping. Our deep residual network, consisting of an input layer, multiple residual blocks, and an output layer, is designed to handle the complexities of 3D dynamics. We evaluate the network's performance using a dataset of 10,000 simulated scenarios, each involving 3-5 interacting rigid bodies. The model achieves a mean squared error of 0.015 for position predictions and 0.022 for orientation predictions, representing a 25% improvement over baseline methods. Our results demonstrate the network's ability to capture intricate physical interactions, with particular success in predicting elastic collisions and rotational dynamics. This work significantly contributes to physics-informed machine learning by showcasing the immense potential of deep residual networks in modeling complex 3D physical systems. We discuss our approach's limitations and propose future directions for improving generalization to more diverse object shapes and materials.

Improper lifting measures of long-span spatial steel structures during construction process may delay the construction period and even cause safety accidents. Few studies on long-span spatial steel structures considered time-varying mechanical characteristic during construction process. In order to achieve safe and efficient installation in a long-span spatial steel structure, this research presents a time-varying mechanical analysis of the synchronous and asynchronous integral lifting and a single and interlaced point’s asynchronous integral lifting analysis method of a long-span spatial steel structure. The results showed that in the case of asynchronous lifting of single point, the displacement influence on other members is related to the distance. The closer the distance from the lifting point, the greater the influence. In asynchronous integral lifting, the lifting point with large lifting force is first installed to the specified position, and the lifting point with small lifting force is installed to the specified position.

As Chronic Non-Communicable Diseases (CNCD) increase, preventive approaches become more crucial. In this review, Calorie Restriction (CR) effects on human beings were evaluated, comparing benefits and risks of different CR diets: classic CR vs ketosis-inducing diets, including Intermittent Fasting (IF), Classic Ketogenic Diet (CKD), Fasting Mimicking Diet (FMD), Very-Low-Calorie Ketogenic Diet (VLCKD) and Spanish Ketogenic Mediterranean Diet (SKMD). Special emphasis on Insulin Resistance (IR) was placed, as it mediates Metabolic Syndrome (MS), a risk factor for CNCD, and predicts MS diagnosis. CR is the most robust intervention known to increase lifespan and health span, with high evidence and known biochemical mechanisms. CR improves cardiometabolic risk parameters, boosts exercise insulin sensitivity response, and there may be benefits of implementing moderate CR on healthy young and middle-aged individuals. However, there is insufficient evidence to support long-term CR. CKD is effective for weight and MS management, and may have additional benefits such as prevention of muscle loss and appetite control. SKMD has extreme significance benefits for all the metabolic parameters studied. Studies show inconsistent benefits of IF compared to classic CR. More studies are required to study biochemical parameters, reinforce evidence, identify risks, and seek effective and safe nutritional CR approaches.

Epoxy asphalt (EA) concrete is widely used in constructing long-span steel bridge pavements (SBDPs). This study aims to derive a fatigue damage evolution law, conducting an experimental investigation of SBDP. First, a general theoretical form of the fatigue damage evolution law of materials is established based on the thermal motion of atoms. Then, fatigue experiments demonstrate that this evolution law well represents the known damage–life relationships of SBDP. Taking into account the experimental relationships between damage and fatigue life under symmetrical cyclic loadings with different overload amplitudes and temperature variations, a detailed damage evolution law is deduced. Finally, the role of damage accumulation is discussed on the basis of the proposed damage evolution law for the extreme situation of heavy overload and severe environments. The results show that both heavy loading and falling temperatures increase the fatigue damage of SBDP considerably; therefore, SBDP should avoid heavy loading combined with winter temperatures. EA shows a fatigue life two to three times longer than that of modified matrix asphalt (SMA) or guss asphalt (GA). For the same thickness, EA pavement is demonstrated to be more suitable for an anti-fatigue design of large-span SBDP under high traffic flows and low temperatures.

The automotive industry has witnessed a significant push towards increased fuel efficiency and reduced carbon emissions. Among many factors influencing overall vehicle efficiency, aerodynamic drag is a critical consideration, accounting for a substantial portion of fuel consumption. Our investigation focused on the drag coefficients of three prominent 2023 passenger car models – the Toyota Corolla, Hyundai Elantra, and Kia Soul. Using ANSYS Fluent to perform computational fluid dynamics, we demonstrated an inverse correlation between drag force and gas mileage, underlining the significance of aerodynamic design in fuel efficiency. Notably, the Hyundai Elantra emerged as the most aerodynamically efficient of the three vehicles, followed closely by the Toyota Corolla. In contrast, the boxier-designed Kia Soul exhibited significantly higher drag coefficients and drag forces, rendering it the least efficient of the trio. These findings emphasize the importance of environmental factors in car design. Shaping aerodynamic profiles directly impacts fuel efficiency, stability, and overall performance.

As modern systems are becoming more complex their control strategy cannot longer relay only on measurement information that usually comes from probes but also from mathematical models. Those systems models can lead to unbearable computation times due to their own complexity, turning the control process non-viable, which leads to the implementation of surrogate models that enable to achieve estimates within acceptable time to take decisions. A control trained with Deep Reinforcement Learning algorithm, using a Physics-Informed Neural Network to obtain the temperature map on the following time step, replaces the need of running Direct Numerical Simulations. On this work we considered an 1D heat conduction problem, which temperature distribution feeds a control system to activate a heat source aiming to obtain a constant, previously defined, temperature value. With this approach, control training becomes much faster without the need of performing numerical simulations or laboratory measurements, as well the control is taken based on Neural Network enabling its implementation on simple processors to edge computing.

In recent years, applying deep learning to solve physics problems has attracted much attention. Data-driven deep learning methods produce operators that can learn solutions to the whole system of partial differential equations. However, the existing methods are only evaluated on simple flow equations (e.g., Burger's equation), and only consider the generalization ability on different initial conditions. In this paper, we construct CFDBench, a benchmark with four classic problems in computational fluid dynamics (CFD): lid-driven cavity flow, laminar boundary layer flow in circular tubes, dam flows through the steps, and periodic Karman vortex street. Each flow problem includes data with various boundary conditions, fluid physical properties, and domain geometries. Compared to existing datasets, the advantages of CFDBench are (1) comprehensive. It contains common physical parameters such as velocity, pressure, and cavity fraction. (2) realistic. It is very suitable for deep learning solutions of fluid mechanics equations. (3) challenging. It has a certain learning difficulty, prompting to find models with strong learning ability. (4) standardized. CFDBench facilitates a comprehensive and fair comparison of different deep learning methods for CFD. We make appropriate modifications to popular deep neural networks to apply them to CFDBench and enable the accommodation of more changing inputs. The evaluation on CFDBench reveals some new shortcomings of existing works and we propose possible directions for solving such problems.

We will apply Pascal’s hydrostatic pressure law to black holes and also to the Hubble sphere. Haug has recently demonstrated how hydrostatic pressure in water can be utilized to determine the Planck length. One can conceptualize the energy in the Hubble sphere as a type of superfluid, and if this is correct, then Blaise Pascal’s hydrostatic pressure formula may also be applicable to such a superfluid, even within the Hubble sphere. By employing the same method on the Hubble sphere and considering it as a Schwarzschild black hole with the critical Friedmann mass, we can estimate the Planck length based on its hypothetical hydrostatic pressure.

As the global population faces an increasing prevalence of physical disabilities, the challenge of motor rehabilitation has become increasingly urgent. Considering that approximately 15% of the global population lives with some form of disability, with a significant number having motor disa-bilities that greatly impact their quality of life, the integration of robotic technologies into rehabili-tation processes offers an opportunity for significant improvement in functional recovery and pa-tient autonomy. This analysis aims to evaluate the progress and challenges encountered in imple-menting robotic technology for the rehabilitation of patients with physical disabilities, highlighting the potential of emerging technologies such as exoskeletons, assisted training devices, and brain-computer interface systems in facilitating motor recovery. By examining relevant clinical studies, the analysis demonstrates the varied effectiveness of robotic therapies compared to traditional re-habilitation methods, while also highlighting the need for ongoing research to optimize care prac-tices and address challenges related to cost, accessibility, and treatment personalization. In con-clusion, robotic technologies represent a promising direction in motor rehabilitation, with the po-tential to revolutionize the care of patients with physical disabilities, significantly improving quali-ty of life and social integration.

The Physics-Informed Neural Networks (PINNs) improve the efficiency of data utilization by combining physical principles with neural network algorithms and ensure that the predictions are consistent and stable with the physical laws. PINNs opens up a new approach to address inverse problems in fluid mechanics. Based on the single-relaxation-time lattice Boltzmann method (SRT-LBM) with the Bhatnagar-Gross-Krook (BGK) collision operator, the PINN-SRT-LBM model is proposed in this paper for solving the inverse problem in fluid mechanics. The PINN-SRT-LBM model consists of three components. The first component involves a deep neural network that predicts the equilibrium control equations in different discrete velocity directions within SRT-LBM. The second component employs another deep neural network to predict non-equilibrium control equations, enabling inference of the fluid's non-equilibrium characteristics. The third component, a physics informed function translates the outputs of the first two networks into physical infor-mation. By minimizing the residuals of the physical partial differential equations (PDEs), the physics informed function infers relevant macroscopic quantities of the flow. The model evolves two sub-models applicable to different dimensions, named PINN-SRT-LBM-I and PINN-SRT-LBM-II models according to the construction of the physical informed function. The innovation of this work is the introduction of SRT-LBM and discrete velocity models as physical drivers into the neural network through the interpretation function. Therefore, PINN-SRT-LBM allows the neural network to handle inverse problems of various dimensions and focus on problem-specific solving. Experimental results confirm the accurate prediction of flow infor-mation at different Reynolds numbers within the computational domain. Relying on the PINN-SRT-LBM models, inverse problems in fluid mechanics can be solved efficiently.

Deep Neutral Networks (DNNs) were initially proposed towards the midst of the 20th century, motivated by the neural structure and mechanism of the human brain. Thanks to major ad-vancements in computational resources, during the past decade DNN-based systems have demonstrated unprecedented performance in terms of accuracy and speed. However, recent work has shown that such models may not be sufficiently robust during the inference process. Furthermore, due to the data-driven learning nature of DNNs, designing interpretable and gen-eralizable networks is a major challenge, especially in critical applications, such as medical Computer Aided Diagnostics (CAD) and other medical imaging tasks, including classification, regression and reconstruction. Within this context, a line of physics-driven approaches for deep learning has recently emerged, aimed at improving the stability and generalization capacity of DNNs for medical imaging applications. In this paper, we review recent work focused on phys-ics-driven or prior-information learning for a variety of imaging modalities and medical applica-tions. We discuss how the inclusion of domain-related knowledge into the learning process and networks’ design supports their stability and generalization capability. In addition, we highlight current and future challenges within this scope.

High-power laser facilities necessitate predicting incremental damage to final optics to identify evolving damage trends. In this study, we propose a surface damage detection method utilizing image segmentation employing ResNet-18, and a damage area estimation network employing U-Net++. Paired sets of online and offline images of optics obtained from a large laser facility is used to train the network. The trends of varying damage could be identified by incorporating additional experimental parameters. A key advantage of the proposed method is that the network can be trained end-to-end on small samples, eliminating the need for manual labeling or feature extraction. The software developed based on these models can facilitate the daily inspection and maintenance of optics in large laser facilities.

This paper presents a comprehensive investigation into the applicability and performance of two prominent growth models, namely the Verhulst model and the Montroll model, in the context of modeling tumor cell growth dynamics. Leveraging the power of Physics-Informed Neural Networks (PINNs), we aim to assess and compare the predictive capabilities of these models against experimental data obtained from the growth patterns of tumor cells. We employ a dataset comprising detailed measurements of tumor cell growth to train and evaluate the Verhulst and Montroll models. By integrating PINNs, we not only account for experimental noise but also embed physical insights into the learning process, enabling the models to capture the underlying mechanisms governing tumor cell growth. Our findings reveal the strengths and limitations of each growth model in accurately representing tumor cell proliferation dynamics. Furthermore, the study sheds light on the impact of incorporating physics-informed constraints on the model predictions. The insights gained from this comparative analysis contribute to advancing our understanding of growth models and their applications in predicting complex biological phenomena, particularly in the realm of tumor cell proliferation.

Deep learning machines are computational models composed of multiple processing layers of adaptive weights to learn representations of data with multiple levels of abstraction. Their structure is mainly reflecting the intuitive plausibility of decomposing a problem into multiple levels of computation and representation since it is believed that higher layers of representation allow a system to learn complex functions. Surprisingly, after decades of research, from learning and design perspectives these models are still deployed in a heuristic manner. In this paper, deep learning feed-forward machines are modeled from a statistical mechanics point of view as disordered physical systems where its macroscopic behavior is determined in terms of the interactions defined between the basic constituent of these models, namely, the artificial neuron. They are viewed as the equilibrium states of a theoretical body that is subject to the law of increase of the entropy. The study of the changes in energy of the body when passing from one equilibrium state to another is used to understand the structure and role of the phase space of the system, the stability of the equilibrium states, and the resulting degree of disorder. It is shown that the topology of these models is strongly linked to their stability and resulting level of disorder. Furthermore, the proposed theoretical characterization permit to assess the thermodynamic efficiency with which information can be processed by these models, and to provide a practical methodology to quantitatively estimate and compare their expected learning and generalization capabilities. These theoretical results provides new insights to the theory of deep learning and their implications are shown to be consistent through a set of benchmarks designed to experimentally assess their validity.

Manual visual inspections typically conducted after an earthquake are high-risk, subjective, and time-consuming. Delays from inspections often exacerbate the social and economic impact of the disaster on affected communities. Rapid and autonomous inspection using images acquired from unmanned aerial vehicles offer the potential to reduce such delays. Indeed, a vast amount of re-search has been conducted toward developing automated vision-based methods to assess the health of infrastructure at the component and structure level. Most proposed methods typically rely on images of the damaged structure, but seldom consider how the images were acquired. To achieve autonomous inspections, methods must be evaluated in a comprehensive end-to-end manner, incorporating both data acquisition and data processing. In this paper, we leverage recent advances in computer generated imagery (CGI) to construct a 3D synthetic environment for simulation of post-earthquake inspections that allows for comprehensive evaluation and valida-tion of autonomous inspection strategies. A critical issue is how to simulate and subsequently render the damage in the structure after an earthquake. To this end, a high-fidelity nonlinear finite element model is incorporated in the synthetic environment to provide a representation of earthquake-induced damage; this finite element model, combined with photo-realistic rendering of the damage, is termed herein a physics-based graphics models (PBGM). The 3D synthetic en-vironment with PBGMs provide a comprehensive end-to-end approach for development and validation of autonomous post-earthquake strategies using UAVs, including: (i) simulation of path planning of virtual UAVs and image capture under different environmental conditions; (ii) au-tomatic labeling of captured images, potentially providing an infinite amount of data for training deep neural networks; (iii) availability of the ground truth damage state from the results of the finite-element simulation; and (iv) direct comparison of different approaches to autonomous as-sessments. Moreover, the synthetic data generated has the potential to be used to augment field datasets. To demonstrate the efficacy of PBGMs, models of reinforced concrete moment-frame buildings with masonry infill walls are examined. The 3D synthetic environment employing PBGMs is shown to provide an effective testbed for development and validation of autonomous vision-based post-earthquake inspections that can serve as an important building block for ad-vancing autonomous data to decision frameworks.

Prostate cancer is the second most frequent malignancy (after lung cancer) in men worldwide. Prostate tissue biopsies are usually graded using scores according to the Gleason grading system. This Gleason score is the most popular prognostic marker that reveals the potential aggressiveness of the disease. However, inter-observer variability in rating by human assessors is a major limiting factor. Such variability could lead to missing a severe case or suggesting unnecessary treatments. This study explores the discriminative ability of artificial intelligence (deep learning models) for Gleason score assessment. The study was designed to use whole-slide images of digitized H&E-stained biopsies of prostate tissues to automate the grading process and provide a remotely accessible clinical decision support system. Custom convolutional neural network architectures were trained on 10,616 images of prostate tissues. Gaussian filters were applied to pre-process the images and improve model performance. Transfer learning was applied to train eight machine learning architectures namely: Xception, VGG16 & 19, ResNet101, MobileNet, DenseNet121, EfficientNetB5 & B7. Efficient NetB7 had the best performance 85.2% compared with ground-truth classification by experts. Performance improves as more data is available. The model was deployed and hosted as a web application API on Google cloud service to ensure remote access. Tissue biopsy images can be uploaded and the corresponding Gleason score recovered immediately. This system reduces diagnostics turnaround time, increase throughput, and compensate for limited skills, especially in low resource settings.

Investigation of functional magnetic resonance imaging (fMRI) data with machine learning (ML) techniques, including also deep learning (DL) methods, have been widely used to study Autism Spectrum Disorder (ASD). This disorder is characterized by symptoms that affect the individual’s behavioral aspects and social relationships. Early diagnosis is crucial for intervention, but the complexity of ASD poses challenges for treatment development. This study compares traditional ML techniques with deep learning (DL) methods in the analysis of functional connectivity measures obtained from the time series of multicentric ABIDE dataset. Specifically, Support Vector Machines (SVM) classifiers, with both linear and Radial Basis Function (RBF) kernels, as well as eXtreme Gradient Boosting (XGBoost) classifiers, are compared against the TabNet classifier, which is a DL architecture customized for tabular data analysis and a Multi Layer Perceptron (MLP). The findings suggest that DL classifiers may not be optimal for the type of data analyzed, as their performance trails behind that of standard classifiers. SVMs achieve performances, in terms of AUC, around 75%, compared to the best TabNet and MLP results, which are 65% and 71%, respectively. Additionally, this work investigates the brain regions that contribute most to the classification task, which are found to be those primarily responsible for sensory and spatial perception, as well as attention modulation, known to be altered in ASD.

In this paper, we investigate the proftability of investing in movies for retail investors, focusing on the return on investment (ROI) metric, which is calculated as revenue divided by budget. Our analysis encompasses 5000 movies from the movie database TMDB, examining factors such as production scale, genres, key actors, directors, and more. Additionally, we employ textual analysis techniques like Latent Semantic Analysis (LSA) on movie overviews and tags to incorporate movie themes. We then evaluate various supervised classifcation models including Logistic Regression, Random Forest, and Light Gradient Boosting (LightGBM), comparing their performance. Our fndings highlight the signifcance of production scale, team structure, and movie themes in identifying potential high-return opportunities for investors.

Presence detection is essential in many applications, including smart homes, office automation, and public space management. Traditional technologies like infrared sensors and cameras frequently encounter obstacles due to privacy concerns, high costs, and complexity. The study provides a novel way to detect presence based on Wi-Fi signals and machine learning algorithms, utilizing the ESP8266 microcontroller. The suggested system attempts to reliably detect the presence of people in a given place by evaluating fluctuations in Wi-Fi signal strength and patterns. The theoretical basis of this strategy is investigated, including the ESP8266’s capabilities for Wi-Fi data gathering and the use of machine learning methods for data analysis. The methodology includes data collecting with the ESP8266, preprocessing, feature extraction, and training and evaluating machine learning models. This system’s potential uses include smart home automation, office occupancy tracking, and crowd management in public settings. The paper also discusses potential issues such as signal interference, data privacy concerns, and the limitations of Wi-Fi detection. Future work is also mentioned, including the suggested system’s installation and testing and enhancement proposals to improve accuracy and scalability. This research aims to provide a cost-effective, non-intrusive, and scalable presence detection system by harnessing the power of Wi-Fi signals and machine learning, enhancing intelligent environments

This paper presents MADS (Multi-Agents for Data Science), an innovative and simple open-source multi-agent framework designed for systemic pipeline execution in applied supervised machine learning. By leveraging the capabilities of multi-agent systems (MAS), we introduce a universal approach to optimize and streamline machine learning pipelines. Our framework highlights the differences between various types of agents, such as reinforcement learning (RL) agents and large language model (LLM) agents, and their distinct contributions to the process. While we currently employ LLM agents to automate and enhance machine learning tasks, we acknowledge the potential of incorporating RL agents in future iterations to further improve performance and adaptability. The primary objective is to enhance the efficiency, scalability, and adaptability of supervised learning applications across various domains. This integration addresses the complexity and manual effort typically associated with machine learning workflows, paving the way for more automated, robust, and scalable solutions. Our approach demonstrates significant improvements in task automation, reduced human intervention, and enhanced model performance. The MADS framework, which will soon be available as an open-source implementation, represents a pivotal contribution to the field of machine learning, promising to facilitate broader adoption and collaborative advancement.

A new data processing method based on Machine Learning (ML) algorithms has been developed and tested in clinical environments during COVID-19 trials at the Medical University of South Carolina (MUSC). Breath samples have been collected in 2020–2021 from 100 participants using gas chromatography combined with ion mobility spectrometry (GC-IMS, G.A.S. mbH). Polymerase chain reaction (PCR) tests combined with clinical diagnostics were used as a reference method. Once the ML training-testing cycle is completed, the diagnostics of a single data set may be completed in as little as a few seconds. A convincing difference in the Volatile Organic Compounds (VOS) breath biomarker signature with COVID-19 positive and negative participants has been found. This approach is a generic method that can be applied to data sets collected with other types of hardware, e.g., different settings of GC, GC-MS, GC-GC, or other methods providing high information density in 2-dimensional data sets.

This paper explores the application of machine learning in financial time series analysis, focusing on predicting trends in financial enterprise stocks and economic data. It begins by distinguishing stocks from stocks and elucidates risk management strategies in the stock market. Traditional statistical methods such as ARIMA and exponential smoothing are discussed in terms of their advantages and limitations in economic forecasting. Subsequently, the effectiveness of machine learning techniques, particularly LSTM and CNN-BiLSTM hybrid models, in financial market prediction is detailed, highlighting their capability to capture nonlinear patterns in dynamic markets. The study demonstrates the advancements in predictive accuracy and robustness achieved by deep learning methods through empirical analysis and model validation. The findings contribute significantly to academic discourse and offer practical insights for investors, financial analysts, and policymakers navigating market volatility and optimizing investment strategies. Finally, the paper outlines prospects for machine learning in financial forecasting, laying a theoretical foundation and methodological framework for achieving more precise and reliable economic predictions.

This study delves into the intricate interplay between cosmology and gravity in dilaton-based models, enhancing our understanding. Exploring boundary theories coupled to gravity, we derive a four-dimensional effective theory from the cosmological constant. Dilaton gravity is then scrutinized, revealing elegant solutions and insights into brane embedding. The analysis extends to probe scalar fields, employing the WKB approximation in both conformal and non-conformal cases. In summary, this work contributes to a nuanced understanding of the complex relationship between cosmology and gravity in dilaton-based frameworks.

Diabetes mellitus is a popular life-threatening disease and patients may gradually have started suffering from other diabetes-causing diseases such as heart attacks, stroke, hypertension, blurry vision, blindness, foot ulcer, amputation, kidney damage and other organ failures before diagnosis. Early detection can help reduce the fatality of this disease. Deep learning models have proven very useful in disease detection and computer-aided diagnosis. In this work, we proposed a deep unsupervised machine learning model for early detection of diabetes using voting ensemble feature selection and deep belief neural networks (DBN). Dataset was obtained from an online repository containing responses of prediagnosed patients to direct questionnaires administered in Sylhet Diabetes Hospital in Sylhet, Bangladesh. The dataset was preprocessed and preprocessed. Features were reduced using the ensemble feature selector. The DBN model was pretrained and tuned to obtain optimal performance. The model was also compared with other models with no multiple hidden layers. The DBN performed at its relative best with F1-measure, precision and recall of 1.00, 0.92 and 1.00 respectively. We conclude that DBN is a useful tool for an unsupervised early prediction of Type II diabetes mellitus.

Domestic crime, conflict, and instability pose a significant threat to many contemporary governments. These challenges have proven to be particularly acute within modern-day Mexico. While there have been significant developments in predicting intrastate armed and electoral conflict in various contemporary settings, such efforts have thus far been limited in their use of spatial as well as temporal correlations, as well as in the features they have consid- ered. Machine learning, especially deep learning, has been proven to be highly effective in predicting future conflicts using word embeddings in Convolutional Neural Networks (CNN) but lacks the spatial structure and, due to the black box nature, cannot explain the importance of predictors. We develop a novel methodology using machine learning that can accurately classify future anti-government violence in Mexico. We further demonstrate that our approach can identify important leading predictors of such violence. This can help policymakers make informed decisions and can also help governments and NGOs better allocate security and humanitarian resources, which could prove beneficial in tackling this problem. Using a variety of political event aggregations from the ICEWS database alongside other textual and demographic features, we trained various classical machine learning algorithms, including but not limited to Logistic Regression, Random Forest, XGBoost, and a Voting classifier. We considered a mix of CNN + Long Short Term Memory (LSTM) networks to decode the spatial and temporal relationship in the data. The performance of all the black box deep learning models was not at par with the classical machine learning models. We also evaluated the temporal relationships in the data to identify important predictors that fuel anti-government violence along with their directions using Shapley additive values. The voting classifier, utilizing a subset of features derived from LASSO across 100 simulations, consistently surpasses alternative models in performance and demonstrates efficacy in accu- rately classifying future anti-government conflicts. Notably, Random Forest feature importance indicates that some features, including but not limited to homicides, accidents, material conflicts, and positive worded citizen information sentiments emerge as pivotal predictors in the classification of anti-government conflicts. Finally, we conclude the research by analysing the spatial structure of the data using Moran’s I index extended version for spatiotemporal data to identify the global spatial dependency and local clusters followed by modelling the data spatially and evaluating the same using Gaussian Process Boost(GPBoost). The global spatial autocorrelation is minimal, characterized by local- ized conflicts cluster within the region. Furthermore, in Phase 3, the Voting Classifier method demonstrates superior performance over GPBoost, leading to the inference that no substantial spatial dependency exists among the various locations.

Accurate cloud quantification is essential in climate change research. In this work, we construct an automated computer vision framework by synergistically incorporating deep neural networks and finite sector clustering to achieve robust whole sky image-based cloud classification, adaptive segmentation, and recognition under intricate illumination dynamics. A bespoke YOLOv8 architecture attains over 95% categorical precision across four archetypal cloud varieties curated from extensive annual observations (2020) at a Tibetan highland station. Tailor-made segmentation strategies adapted to distinct cloud configurations, allied with illumination-invariant image enhancement algorithms, effectively eliminate solar interference and substantially boost quantitative performance even in illumination-adverse analysis scenarios. Compared with the traditional threshold analysis method, the cloud quantification accuracy calculated within the framework of this paper is significantly improved. Collectively, the methodological innovations provide an advanced solution to markedly escalate cloud quantification precision levels imperative for climate change research, while offering a paradigm for cloud analytics transferable to various meteorological stations.

Unsupervised physics-informed deep learning can be used to solve computational physics problems by training neural networks to satisfy the underlying equations and boundary conditions without labeled data. Parameters such as network architecture and training method determine the training success. However, the best choice is unknown a priori as it is case specific. Here, we investigated network shapes, sizes, and types for unsupervised physics-informed deep learning of the two-dimensional Reynolds-averaged flow around cylinders. We trained mixed-variable networks and compared them to traditional models. Several network architectures with different shape factors and sizes were evaluated. The models were trained to solve the Reynolds-averaged Navier-Stokes equations incorporating Prandtl's mixing length turbulence model. No training data were deployed to train the models. The superiority of the mixed-variable approach was confirmed for the investigated high Reynolds number flow. The mixed-variable models were sensitive to the network shape. For the two cylinders, differently deep networks showed superior performance. The best fitting models were able to capture important flow phenomena such as stagnation regions, boundary layers, flow separation, and recirculation. We also encountered difficulties when predicting high Reynolds number flows without training data

In the global carbon cycle, atmospheric carbon emissions, both ‘natural’ and anthropogenic, are balanced by carbon uptake (i.e. sequestration) that mostly occurs via photosynthesis, plus a much smaller proportion via geological processes. Since the formation of the Earth about 4.54 billion years ago the ratio between emitted and sequestered carbon has varied considerably with atmospheric CO₂ levels ranging from 100,000 ppm to a mere 100 ppm. Over this time, a huge amount of carbon has been sequestered due to photosynthesis and essentially removed from the cycle, being buried as fossil deposits of coal, oil and gas. Relatively low atmospheric CO₂ levels were the norm for the past 10 million years, and during the past million years they averaged about 220 ppm. More recently, the Holocene epoch, starting ~11,700 years ago, has been a period of unusual climatic stability with relatively warm, moist conditions and low atmospheric CO₂ levels of between 260 and 280 ppm. During the Holocene, stable conditions facilitated a social revolution with domestication of crops and livestock leading to urbanisation and development of complex technologies. As part of the latter process, immense quantities of sequestered fossil carbon have recently been used as energy sources, resulting in a particularly rapid increase in CO₂ emissions after 1950 CE to the current value of 424 ppm, with further rises to >800 ppm predicted by 2100. This is already perturbing the previously stable Holocene climate and threatening future food production and social stability. Today, the global carbon cycle has been shifted such that carbon sequestration is no longer keeping up with recent anthropogenic emissions. In order to address this imbalance it is important to understand the roles of high-capacity carbon sequestration systems, such as natural forests and tropical croplands, and to devise strategies to facilitate net CO₂ uptake.

It is a challenging problem that air-written Arabic letters has received a lot of attention in the past decades when compared to commonly spoken languages like English languages. To fill this gap, we propose a strong model that brings together machine learning (ML) and optical character recognition (OCR) methods. The model applied several ML methods, (i.e., Neural Networks (NN), Random Forest (RF), K-Nearest Neighbors (KNN), and Support Vector Machine (SVM), with deep convolutional neural networks (CNNs) such as VGG16, VGG19, and SqueezeNet for effective feature extraction. Our study utilizes the AHAWP dataset, which consists of varied writing styles and variations in hand signs, to train and evaluate the model. Preprocessing systems are applied to improve data quality by reduction bias. Besides, OCR methods are combined into our model to sequestrate individual letters from continuous air-written gestures and refine recognition results. Results of this study show that the proposed model has achieved the extreme accuracy of 88.8% using NN with VGG16. This study presents an inclusive approach that combines ML, deep CNNs, and OCR methods to address the issue of Arabic in air writing recognition research.

Single Image Super Resolution (SSIR) is a problem in computer vision where the goal is 1 to create high-resolution images from low-resolution ones. It has important applications in fields 2 such as medical imaging and security surveillance. While traditional methods such as interpolation 3 and reconstruction-based models have been used in the past, deep learning techniques have recently 4 gained attention due to their superior performance and computational efficiency. This article proposes 5 an Autoencoder based Deep Learning Model for SSIR, in particular, a light model that uses fewer 6 parameters without compromising performance. The down-sampling part of the Autoencoder 7 mainly uses 3 by 3 convolution and has no subsampling layers. The up-sampling part uses transpose 8 convolution and residual connections from the down sampling part. The model is trained using a 9 subset of the VILRC ImageNet database. The model is evaluated using quantitative metrics PSNR, 10 SSIM as well as qualitative measures such as perceptual quality. PSNR and SSIM figures as high as 11 76.06 and 0.93 are reported.

In our recent publications, based on strong and electroweak interactions, we have developed a completely new formula for estimating nuclear binding energy. With reference to currently believed Semi Empirical Mass Formula (SEMF), we call our formula as ‘Strong and Electroweak Mass Formula’ (SEWMF). Our formula constitutes 4 simple terms and only one energy coefficient of magnitude 10.1 MeV. First term is a volume term, second term seems to be a representation of free nucleons associated with electroweak interaction, third term is a radial term and fourth one is an asymmetry term about the mean stable mass number. In this paper, we make an attempt to understand and estimate the maximum binding energy associated with any mass number. It can be expressed as, for A > 4, $\left(BE\right)_A\cong \left[A-0.000935A^2-A^{1/3}-A^{-1/2}\right]$ MeV. We are working on refining the 4^th term with even-odd corrections, shell corrections and other microscopic corrections. Proceeding further, stable mass numbers and super heavy mass numbers can be understood with a relation of the form, $\left[\textrm{RoundOff}\left(\left(Z+2.9464\right)^{1.2}-1.7165\right)\right]\pm\left[0,1\right]\pm\left(2n\right)$ where $n \cong 0,1,2$. It needs a review with respect to even-odd proton numbers and other microscopic corrections.

Seismic vulnerability assessment in urban areas would in principle require the detailed modeling of each single building and the implementation of complex numerical calculations. This procedure is clearly difficult to apply at urban scale where many buildings have to be considered and therefore it is essential to have simplified, but at the same time reliable, approaches to vulnerability assessment. Among the proposed strategies, one of the most interesting concerns the application of machine learning algorithms, able to classify buildings according to their vulnerability on the basis of training procedures applied to existing datasets. In this paper machine learning algorithms will be applied to a dataset which collects and catalogs the structural characteristics of a large number of buildings and reports the damage observed in L’Aquila territory during the intense seismic activity occurred in 2009. A combination of a trained neural network and a random forest algorithm allows to identify an opportune “a-posteriori” vulnerability score, deduced from the observed damage, which is compared to an “a-priori” vulnerability one, evaluated taking into account characteristic indexes for building’s typologies. By means of this comparison an inverse approach to seismic vulnerability assessment, which can be extended to different urban centers, is proposed.

Artificial intelligence provides a new research concept for digital image processing. However, at present, artificial intelligence is rarely introduced into the teaching of digital image processing in colleges and universities, and there are problems such as obsolete teaching content, single teaching methods, and simple course experiments, which affect the teaching effect and are not conducive to the cultivation of comprehensive and innovative talents. Digital image processing technology brings more possibilities to communication engineering and makes communication more convenient. For example, video calls and photo transmission make people's communication methods in daily life more and more diversified. Time and space limitations allow people to meet online, creating more communication possibilities. However, there are still many problems and methods worthy of in-depth exploration. Therefore, this paper has a comprehensive understanding and mastery of the traditional and deep learning methods of digital image processing to improve the relevant project practice and scientific research exploration ability and refer for similar research conclusions.

Efficient triaging and referral assessment are critical in ensuring prompt medical intervention in the Community Health Care (CHC) system. However, the existing triaging systems in many Community Health Services are an intensive, time-consuming process and often lack accuracy, particularly for various symptoms that might represent heart failure or other health-threatening conditions. There is a noticeable limit of research papers describing AI technologies for triaging patients. This paper proposes a novel quantitative data-driven approach using machine learning (ML) modelling to improve the community clinical triaging process. Furthermore, this study aims to employ the feature selection process and machine learning power to reduce the triaging process’s waiting time and increase accuracy in clinical decision-making. The model was trained on medical records of “Heart Failure” patients’ dataset, which included demographics, past medical history, vital signs, medications, and clinical symptoms. A comparative study was conducted using the list of machine learning algorithms where XGBoost demonstrated the best performance among other ML models. The triage levels of 2,35,982 patients achieved an accuracy of 99.94%, precision of 0.9986, recall of 0.9958, and f1-score of 0.9972 within 0.059 seconds. The proposed diagnostic model can be implemented for the CHC decision system and be developed further for other medical conditions.

This paper reviews the multiple roles of machine learning in improving the resilience of power grids, especially in applying new energy storage technologies. Energy storage technologies, such as compressed air energy storage, flywheel energy storage, and superconducting coil energy storage, significantly improve the power grid's ability to respond to load fluctuations and emergencies through intelligent control and optimisation of machine learning algorithms. This not only helps to optimise energy dispatch and improve the operational efficiency and flexibility of the grid but also significantly improves the stability and reliability of the grid so that it is better able to meet future challenges and needs.

Physics-informed neural networks can be trained to serve as surrogate models by learning how spatial physical fields develop with change of parameters. This is an advantage over traditional numerical methods that can only be used to calculate a single solution field for a single discrete setting of a parameter. While many studies report accurate results of physics-informed deep learning of laminar flows, evaluations of surrogate modeling of high Reynolds number flows remain sparse. To contribute to this question, we here explore the capabilities and limits of physics-informed deep learning to solve the Reynolds-averaged Navier-Stokes equations for the flow around two airfoils under variable angles of attack. No labeled training data were provided and a single network was trained to simultaneously learn several solution fields in a single training run. The network captured essential flow features such as boundary layers and high and low pressure regions. Moreover, the qualitative correlations of lift and drag with the angle of attack and the higher drag of the thicker airfoil were captured. However, comparisons with reference simulations revealed an underestimation of the shear layer gradients as well as deviations of the fields' extrema. Thus, we also debate potential future improvements to increase the accuracy of the predicted flow. This work offers a prospect on the capabilities and current limitations of physics-informed neural networks for surrogate modeling of high Reynolds number flows. We argue that the method is promising and this work is aimed to encourage further research and development of the method when applied to Reynolds-averaged flows at high Reynolds numbers.

This article explores the application of machine learning techniques, specifically focusing on ensemble methods like Random Forests, for detecting fraudulent activities in digital financial transactions. Highlighting the evolution from traditional statistical approaches to modern machine learning models, it underscores the effectiveness of Random Forests in handling the inherent challenges of imbalanced datasets typical in fraud detection scenarios. Using a Kaggle dataset of credit card transactions, the study optimizes Random Forest parameters through rigorous parameter tuning, achieving significant improvements in model performance metrics such as Area Under the Curve (AUC). The findings underscore the critical role of machine learning in enhancing fraud detection capabilities, emphasizing the ongoing evolution and future potential of these methodologies in financial risk management.

Skin disease is a very common disease for humans. In the medical industry detecting skin disease and recognizing its type is a very challenging task. Due to the complexity of human skin texture and the visual closeness effect of the diseases, sometimes it is really difficult to detect the exact type. Therefore, it is necessary to detect and recognize the skin disease at its very first observation. In today's era, artificial intelligence (AI) is rapidly growing in medical fields. Different machine learning (ML) and deep learning(DL) algorithms are used for diagnostic purposes. These methods drastically improve the diagnosis process and also speed up the process. In this paper, a brief comparison between the machine learning process and the deep learning process was discussed. In both processes, three different and popular algorithms are used. For the machine Learning process Bagged Tree Ensemble, K-Nearest Neighbor (KNN), and Support Vector Machine(SVM) algorithms were used. For the deep learning process three pre-trained deep neural network models

Deep learning techniques, such as convolutional neural networks (CNN), generative adversarial networks (GAN), and graph neural networks (GNN), have over the past decade changed the ac-curacy of prediction in many diverse fields. In recent years, the application of deep learning tech-niques in computer vision tasks in pathology demonstrated extraordinary potential in assisting clinicians, automating diagnosis, and reducing costs for patients. Formerly unknown pathologi-cal evidence, such as morphological features related to specific biomarkers, copy number varia-tions, and other molecular features, were also able to be captured by deep learning models. In this paper, we review popular deep learning methods and some recent publications about their appli-cations in pathology.

The exponential growth of biomedical data in recent years urged the application of numerous machine learning techniques to address emerging problems in biology and clinical research. By enabling automatic feature extraction, selection and generation of predictive models, these methods can be used to efficiently study complex biological systems. Machine learning techniques are frequently integrated with bioinformatic methods, as well as curated databases and biological networks, to enhance training and validation, identify the best interpretable features, and enable feature and model investigation. Here, we review recently developed methods that incorporate machine learning within the same framework with techniques from molecular evolution, protein structure analysis, systems biology and disease genomics. We outline the challenges posed for machine learning, and in particular, deep learning in biomedicine and suggest unique opportunities for machine learning techniques integrated with established bioinformatics approaches to overcome some of these challenges.

: Cybersecurity has become a critical area in the digital field in recent years. The expansion of networks has revolutionised the way network structures are organised and managed. However, with increased connectivity and the growing complexity of modern networks, the threat of cyber-attacks has become more intense. As technology continues to advance, it brings both opportunities and challenges. One of the major challenges is the need to secure networks and sensitive data from various malicious activities. Traditional networks have evolved to include Software Defined Network (SDN), which offers a more flexible and programmable framework. Researchers should focus on detecting attacks in SDN because SDN networks are becoming more popular and attractive targets for clients due to their programmability and dynamic nature. The centralised controller, known as the backbone of an SDN, becomes a single point of failure and a potential target for attackers if not properly secured. Researchers need to emphasise the detection of attacks in SDN in order to mitigate these risks. By understanding the potential vulnerabilities and attack methods specific to SDN, researchers can develop effective detection approaches and propose countermeasures. This methodology helps protect the network from potential threats and minimises the impact of successful attacks. Therefore, this survey paper provides a review of Intrusion Detection Systems (IDSs) in Software-Defined Networks (SDN) to provide a thorough understanding of SDN security issues.

The importance of energy systems and its role in economics and politics is not hidden for anyone. This issue is not only important for the advanced industrialized countries, which are major energy consumers, but is also important for oil-rich countries. In addition to the nature of these fuels which contains polluting substances, the issue of their ending up has aggravated the growing concern. Biofuels can be used in different fields for energy production like electricity production, power production or for transportation. Various scenarios have been written about the estimated biofuels from different sources in the future energy system. The availability of biofuels for the electricity market, heating and liquid fuels is very important. Accordingly, the need for handling, modelling, decision making and future forecasting for biofuels can be one of the main challenges for scientists. Recently, machine learning and deep learning techniques have been popular in modeling, optimizing and handling the biodiesel production, consumption and its environmental impacts. The main aim of this study is to evaluate the ML and DL techniques developed for handling biofuels production, consumption and environmental impacts, both for modeling and optimization purposes. This will help for sustainable biofuel production for the future generations.

Conventional text style transfer (TST) methodologies primarily utilize style classifiers to segregate the content and stylistic elements of text for effective style transformation. Despite the pivotal role of these classifiers, their influence on TST techniques remains largely unexplored. This study embarks on a detailed exploration of the limitations inherent in style classifiers within current TST frameworks. We reveal that these classifiers often inadequately comprehend sentence syntax, leading to diminished performance in TST models. In response, we introduce the Syntax-Enhanced Style Transfer (SEST) model, a groundbreaking approach incorporating a syntax-sensitive style classifier. This classifier ensures that the extracted style representations robustly encapsulate syntax nuances, enhancing TST effectiveness. Rigorous evaluations across diverse TST benchmarks demonstrate that SEST significantly surpasses contemporary models in performance. Additionally, our case studies highlight SEST's proficiency in producing syntactically coherent sentences that aptly retain original content.

In this work, several random Boolean networks (RBN) are generated and analyzed from two characteristics: their time evolution diagram and their transition diagram. To do this, its randomness is estimated using three metrics, of which algorithmic complexity is the only one capable of revealing both transitions towards the chaotic regime and the algorithmic contribution of certain states to the transition diagram and their relationship with the order they occupy in the temporal evolution of the respective RBN.

COVID-19 was a terrible worldwide pandemic that caused a global public health crisis, with numerous deaths and a severe economic depression. To suppress the spread of COVID-19 and initiate patient isolation and contact tracing to reduce its effect, early diagnosis was required, with real-time reverse transcriptase polymerase chain reaction (RT-PCR) swab test being the most widely used. However, the RT-PCR test was sometimes found to be lengthy and inaccurate and; for that reason, in many cases of severe complications of COVID-19 pneumonia, chest screening with radiography imaging was preferred. In this paper, we carried out a study for COVID-19 detection from computed tomography images, and compared the obtained results using deep learning (DL) and support vector machine (SVM). The findings showed that, despite the excellent results shown by deep learning, the accuracy in predicting COVID-19 using SVM, in the presence of small databases, was slightly higher than DL. The execution time using SVM was also shorter

This study presents a novel approach for automating the body condition scoring of dairy cows, leveraging advancements in 3D imaging technology and deep neural networks. The primary objective was to design and implement a system capable of accurately and efficiently assessing the body condition of dairy cows, a critical metric in livestock management for optimizing health and productivity. To achieve this, a 3D camera was employed to capture detailed point cloud data, reconstructing the three-dimensional morphology of individual cows. The obtained data were then fed into a deep neural network, specifically tailored for the task of ranking body condition. The neural network was trained on a diverse dataset of annotated body condition score representing varying degrees of body condition, ensuring robust performance across different physiological states. The results demonstrate the efficacy of the proposed system in automatically and objectively scoring the body condition of dairy cows. The automated process not only expedites the assessment but also reduces the subjectivity associated with manual scoring methods. This innovative approach holds promise for improving the efficiency of dairy farm management by providing timely and accurate body condition assessments. The integration of 3D imaging and deep learning techniques paves the way for future advancements in precision livestock farming, contributing to enhanced animal welfare, optimized production, and sustainable agriculture practices.

Molecular docking, a computational method predicting how molecules bind to target proteins, is employed in this study to explore Polydatin's interactions with Ras-related protein Rab (Rab) proteins using the Mcule Database. This database validates the docking results and offers insights into the pharmacological properties of Polydatin. Notably, specific Rab proteins like Rab-5A, HRas, and Rab-18 exhibit robust interactions with Polydatin, indicated by favorable binding energies.These findings illuminate the potential roles of Polydatin in therapeutic and biological contexts, emphasizing its interaction with Rab proteins. The Mcule Database enhances the credibility of the study, providing additional perspectives on Polydatin's applications. The observed interactions, particularly with key proteins like HRas, present a promising avenue for modulating cellular signaling pathways. This modulation holds therapeutic potential, potentially addressing conditions associated with pathway overactivity, including specific cancer types.

Properties of spatially explicit data are often ignored or inadequately handled in machine learning for spatial domains of application. At the same time, resources that would identify these properties and investigate their influence and methods to handle them in machine learning applications are lagging behind. In this survey of the literature, we seek to identify and discuss spatial properties of data that influence the performance of machine learning. We review some of the best practices in handling such properties in spatial domains and discuss their advantages and disadvantages. We recognize two broad strands in this literature. In the first, the properties of spatial data are developed in the spatial observation matrix without amending the substance of the learning algorithm; in the other, spatial data properties are handled in the learning algorithm itself. While the latter have been far less explored, we argue they offer the most promising prospects for the future of spatial machine learning.

Tremendous progress has been witnessed in artificial intelligence within the domain of neural network backed deep learning systems and its applications. As we approach the post Moore’s Law era, the limit of semiconductor fabrication technology along with a rapid increase in data generation rates have lead to an impending growing challenge of tackling newer and more modern machine learning problems. In parallel, quantum computing has exhibited rapid development in recent years. Due to the potential of a quantum speedup, quantum based learning applications have become an area of significant interest, in hopes that we can leverage quantum systems to solve classical problems. In this work, we propose a quantum deep learning architecture; we demonstrate our quantum neural network architecture on tasks ranging from binary and multi-class classification to generative modelling. Powered by a modified quantum differentiation function along with a hybrid quantum-classic design, our architecture encodes the data with a reduced number of qubits and generates a quantum circuit, loading it onto a quantum platform where the model learns the optimal states iteratively. We conduct intensive experiments on both the local computing environment and IBM-Q quantum platform. The evaluation results demonstrate that our architecture is able to outperform Tensorflow-Quantum by up to 12.51% and 11.71% for a comparable classic deep neural network on the task of classification trained with the same network settings. Furthermore, our GAN architecture runs the discriminator and the generator purely on quantum hardware and utilizes the swap test on qubits to calculate the values of loss functions. In comparing our quantum GAN, we note our architecture is able to achieve similar performance with 98.5% reduction on the parameter set when compared to classical GANs. With the same number of parameters, additionally, QuGAN outperforms other quantum based GANs in the literature for up to 125.0% in terms of similarity between generated distributions and original data sets.

In this paper is proposed an analytical technique which can be used to obtain the forced response of a cantilevered tube conveying fluid. Considering the pipe subjected to an arbitrary harmonic force either distributed or concentrated, an analytical solution is found using Green’s function method. The solution obtained of the closed form satisfies the differential equations in a classical sense. The presented method giving the exact solutions is more precise than the classical eigenfunction expansion or Galerkin’s method with no need to the eigenfunctions or eigenvalues.

Biofuels construct an essential pillar of energy systems. Biofuels are considered as a popular resource for electricity production, heating, household, and industrial usage, liquid fuels, and mobility around the world. Thus, the need for handling, modeling, decision-making, demand, and forecasting for biofuels are of utmost importance. Recently, machine learning (ML) and deep learning (DL) techniques have been accessible in modeling, optimizing, and handling biofuels production, consumption, and environmental impacts. The main aim of this study is to review and evaluate ML and DL techniques and their applications in handling biofuels production, consumption, and environmental impacts, both for modeling and optimization purposes. Hybrid and ensemble ML methods, as well as DL methods, have found to provide higher performance and accuracy in modeling the biofuels.

Machine learning is a fundamental aspect of artificial intelligence that involves the development of algorithms and models that allow computers to learn and make predictions or decisions without explicit programming. With the development of neural networks, back-propagation algorithms and deep learning, machine learning has made breakthroughs in the fields of image recognition, natural language processing and handwriting recognition using machine learning techniques. The advent of deep learning has revolutionized the field of handwriting recognition, using convolutional neural networks, recurrent neural networks, and sequence-to-sequence models to provide solutions that go beyond machine learning methods and significantly improve the accuracy and robustness of handwriting recognition systems. But challenges remain, including the need for large labelled datasets, computational resources and addressing potential biases. As research in deep learning techniques continues to drive handwriting recognition closer towards realisability, machine learning approaches remain at the forefront.

This is an article or technical note which is intended to provides an insight journey of Machine Learning Systems (MLS) testing, its evolution, current paradigm and future work. Machine Learning Models, used in critical applications such as healthcare industry[1], Automobile [2], [3] and Air Traffic control, Share Trading etc., and failure of ML Model can lead to severe consequences in terms of loss of life or property. To remediate this, developers, scientists, and ML community around the world, must build a highly reliable test architecture for critical ML application. At the very foundation layer, any test model must satisfy the core testing attributes such as test properties and its components. This attribute comes from the software engineering [5], [6], but the same cannot be applied in as-is form to the ML testing and we will tell you “why”.

Nanoindentation load-depth (P-h) plots is the basis for determination of mechanical properties of the samples and is especially vital for thin coatings deposited on substrates of various mechanical makeup from amorphous-brittle (borosilicate glass) to Silicon (having different crystallographic texture) to ductile substrates like stainless steel as well other aspects like indenter tip shape. The elastic-plastic response by simulated P-h plots as per modified empirical relations have been presented. The outcomes of this computational studies enlighten the database on the P-h plots for various coating/substrate systems and shall aid in the analysis of experimental P-h plots obtained,

The necessity for effective intrusion detection systems (IDS) in big data environments has grown critical due to the rising prevalence of big data systems and the rising amount of security threats. Applying conventional intrusion detection methods to the enormous and intricate data produced by big data ecosystems presents difficulties. Deep learning, has proven to be exceptionally adept at deciphering complex, large-scale data. This study proposes a Deep Learning-based Intrusion Detection System (IDS) created specifically for the Big Data environment. Traditional intrusion detection systems struggle to efficiently identify and prevent cyber threats due to the ever-increasing volume and complexity of data in current networks. We suggest an IDS that makes use of Deep Learning (CNN, LSTM, GAN, etc.), to address this problem. These cutting-edge neural network topologies give the system the ability to process and analyze massive amounts of data for precise intrusion detection. Data collection, data preprocessing, feature engineering, DL model training, intrusion detection, warning generation, and reaction are some of the crucial parts of the suggested IDS. The data collection module mines the Big Data environment for network traffic, system logs, and security event information. To make sure the data is suitable for analysis, it is preprocessed. To improve the detection abilities of the DL models, important features are extracted from the data using feature engineering approaches.

Machine learning (ML) has emerged as a critical tool for making sense of the growing amount of genetic and genomic data available because of its ability to find complex patterns in high dimensional and heterogeneous data. While the complexity of ML models is what makes them powerful, it also makes them difficult to interpret. Fortunately, recent efforts to develop approaches that make the inner workings of ML models understandable to humans have improved our ability to make novel biological insights using ML. Here we discuss the importance of interpretable ML, different strategies for interpreting ML models, and examples of how these strategies have been applied. Finally, we identify challenges and promising future directions for interpretable ML in genetics and genomics.

To identify objects in images, a complex set of skills is needed that includes understanding the context and being able to determine the borders of objects. In computer vision, this task is known as semantic segmentation and it involves categorizing each pixel in an image. It is crucial in many real-world situations: for autonomous vehicles, it enables the identification of objects in the surrounding area; in medical diagnosis, it enhances the ability to detect dangerous pathologies early, thereby reducing the risk of serious consequences. In this study, we compare the performance of various ensembles of convolutional and transformer neural networks. Ensembles can be created, e.g, by varying the loss function, data augmentation method or the learning rate strategy. Our proposed ensemble, which is based on the simple average rule, demonstrates exceptional performance on several datasets. All the resources used in this study are available online at the following GitHub repository: https://github.com/LorisNanni.

The conventional machine learning (ML) algorithms are continuously advancing and evolving at a fast-paced by introducing the novel learning algorithms. ML models are continually improving using hybridization and ensemble techniques to empower computation, functionality, robustness, and accuracy aspects of modeling. Currently, numerous hybrid and ensemble ML models have been introduced. However, they have not been surveyed in a comprehensive manner. This paper presents the state of the art of novel ML models and their performance and application domains through a novel taxonomy.

The small satellite market continues to grow year after year. A compound annual growth rate of 17% is estimated during the period between 2020 and 2025. Low-cost satellites can send a vast amount of images to be post-processed at the ground to improve the quality and extract detailed information. In this domain lies the resolution enhancement task, where a low-resolution image is converted to a higher resolution automatically. Deep learning approaches to Super-Resolution (SR) reached the state-of-the-art in multiple benchmarks; however, most of them were studied in a single-frame fashion. With satellite imagery, multi-frame images can be obtained at different conditions giving the possibility to add more information per image and improve the final analysis. In this context, we developed and applied to the PROBA-V dataset of multi-frame satellite images a model that recently topped the European Space Agency’s Multi-frame Super Resolution (MFSR) competition. The model is based on proven methods that worked on 2D images tweaked to work on 3D: the Wide Activation Super Resolution (WDSR) family. We show that with a simple 3D CNN residual architecture with WDSR blocks and a frame permutation technique as data augmentation better scores can be achieved than with more complex models. Moreover, the model requires few hardware resources, both for training and evaluation, so it can be applied directly from a personal laptop.

A long time has passed since COVID-19 was discovered and widely disseminated. Both machine learning and deep learning have moved towards the research of diagnosing COVID-19. Compared to deep learning, traditional machine learning-based methods can also achieve good diagnostic results if they are improved based on innovative points. And deep learning remains a more popular research object. Based on the deep neural network in the field of deep learning, the convolutional neural network, recurrent neural network, long and short-term memory network, and Transformer model have been extended. These models improve the performance and processing power of neural networks by introducing new structures and algorithms. This paper will introduce the basic concepts of machine learning and deep learning, as well as the details of using the relevant methods of both to help diagnose COVID-19.

Beyond semantic segmentation,3D instance segmentation(a process to delineate objects of interest and also classifying the objects into a set of categories) is gaining more and more interest among researchers since numerous computer vision applications need accurate segmentation processes(autonomous driving, indoor navigation, and even virtual or augmented reality systems…) This paper gives an overview and a technical comparison of the existing deep learning architectures in handling unstructured Euclidean data for the rapidly developing 3D instance segmentation. First, the authors divide the 3D point clouds based instance segmentation techniques into two major categories which are proposal based methods and proposal free methods. Then, they also introduce and compare the most used datasets with regard to 3D instance segmentation. Furthermore, they compare and analyze these techniques performance (speed, accuracy, response to noise…). Finally, this paper provides a review of the possible future directions of deep learning for 3D sensor-based information and provides insight into the most promising areas for prospective research.

This study discusses the application of deep learning technology in network intrusion detection systems (IDS) and focuses on a new model named CNN-Focal. First, through the review of traditional IDS technology, it analyzes its limitations in dealing with complex network traffic. Then, the design principle of the CNN-Focal model is described in detail, which uses threshold convolution and SoftMax multi-class classification technology to effectively improve abnormal traffic detection's accuracy and efficiency. The experimental results show that CNN-Focal performs well on the open data set, demonstrating the potential and advantages of its application in the natural network environment and providing a new perspective and method for further research of deep learning in the field of network security in the future.

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs have not yet achieved high output for their well-established two-dimensional (2D) equivalents in still photographs. Board 3D Convolutional Memory and Spatiotemporal fusion face training difficulty preventing 3D CNN from accomplishing remarkable evaluation. In this paper, we implement Hybrid Deep Learning Architecture that combines STIP and 3D CNN features to enhance the performance of 3D videos effectively. After implementation, the more detailed and deeper charting for training in each circle of space-time fusion. The training model further enhances the results after handling complicated evaluations of models. The video classification model is used in this implemented model. Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning is introduced to further understand space-time association in human endeavors. In the implementation of the result, the well-known dataset, i.e., UCF101 to, evaluates the performance of the proposed hybrid technique. The results beat the proposed hybrid technique that substantially beats the initial 3D CNNs. The results are compared with state-of-the-art frameworks from literature for action recognition on UCF101 with an accuracy of 95%.

Layer-wise 3D surface morphology information is critical for the quality monitoring and control of additive manufacturing (AM) processes. However, most of the existing 3D scan technologies are either contact or time consuming, which are not capable of obtaining the 3D surface morphology data in a real-time manner during the process. Therefore, the objective of this study is to achieve real-time 3D surface data acquisition in AM, which is achieved by a supervised deep learning-based image analysis approach. The key idea of this proposed method is to capture the correlation between 2D image and 3D point cloud, and then quantify this relationship by using a deep learning algorithm, namely, convolutional neural network (CNN). To validate the effectiveness and efficiency of the proposed method, both simulation and real-world case studies were performed. The results demonstrate that this method has strong potential to be applied for real-time surface morphology measurement in AM, as well as other advanced manufacturing processes.

With the evolution of computing technology in many application like human robot interaction, human computer interaction and health-care system, 3D human body models and their dynamic motions has gained popularity. Human performance accompanies human body shapes and their relative motions. Research on human activity recognition is structured around how the complex movement of a human body is identified and analyzed. Vision based action recognition from video is such kind of tasks where actions are inferred by observing the complete set of action sequence performed by human. Many techniques have been revised over the recent decades in order to develop a robust as well as effective framework for action recognition. In this survey, we summarize recent advances in human action recognition, namely the machine learning approach, deep learning approach and evaluation of these approaches.

The betatron tune in the Large Hadron Collider (LHC) is measured using a Base-Band Tune (BBQ) system. The processing of these BBQ signals is often perturbed by 50 Hz noise harmonics present in the beam. This causes the tune measurement algorithm, currently based on peak detection, to provide incorrect tune estimates during the acceleration cycle with values that oscillate between neighbouring harmonics. The LHC tune feedback (QFB) cannot be used to its full extent in these conditions as it relies on stable and reliable tune estimates. In this work we propose new tune estimation algorithms, designed to mitigate this problem through different techniques. As ground-truth of the real tune measurement does not exist, we developed a surrogate model, which allowed us to perform a comparative analysis of a simple weighted moving average, Gaussian Processes and different deep learning techniques. The simulated dataset used to train the deep models was also improved using a variant of Generative Adversarial Networks (GANs) called SimGAN. In addition we demonstrate how these methods perform with respect to the present tune estimation algorithm.

Today, specific CNN models assigned to specific tasks are often used. In this article, the authors have investigated three models MobileNet, EfficientNetB0 and InceptionV3. Artificial intelligence methods for deep networks will be presented but implemented in a limited computer resource. Three types of training bases were investigated, starting with a simple base verifying five colors, followed by recognition of two different orthogonal elements, and then more complex images discriminating between elements. The research aimed to demonstrate the models' capabilities based on training base parameters such as the number of images and epoch types. The architectures proposed by the authors in these cases were chosen based on simulation studies conducted on a virtual machine with limited hardware parameters. The proposals present the advantages and disadvantages of different models based on TensorFlow, Keras libraries in the Jupiter environment written based on the Python language. The authors' proposal of the selected AI model enables further work on e.g. image classification, but in a limited computer resource for industrial implementation e.g. on a PLC.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

The integration of deep learning models into financial risk prediction and analysis has significantly transformed traditional approaches. While conventional quantitative methods often rely on simplistic metrics like maximum drawdown, the advent of deep learning necessitates a more nuanced evaluation, emphasizing the model's generalization ability, especially during market crises such as stock market crashes. This paper explores the critical aspects of evaluating deep learning models' risk control capabilities in finance, underscoring the importance of understanding both statistical metrics and generalization abilities, particularly in adverse market conditions. By examining deep learning models' performance in scenarios like stock market crashes and highlighting the significance of cross-validation techniques, this study aims to offer practitioners insights into constructing robust risk management systems. It advocates for a comprehensive approach integrating quantitative analysis with macroeconomic factors to enhance financial risk prediction and analysis in volatile markets. The experimentation reveals that different deep generative models excel in various aspects of financial time series analysis, with generative adversarial networks (GANs) demonstrating superior performance in predicting Value at Risk (VaR) and variational autoencoders (VAEs) excelling in return rate prediction. Moreover, integrating multiple models further enhances predictive performance, leveraging the strengths of each model to compensate for individual weaknesses. Overall, this paper underscores the potential and significance of deep generative models in financial time series analysis, offering a roadmap for improved risk management and decision-making in financial markets.

During the development of new medicines mutually exclusive specificity appears to be required but hitherto is most often included at the late clinical trial stage. Here, I describe the use of Hedgehog signalling in Drosophila as a model to represent a mutually exclusive relationship within the context and report the identification of CG43658, a putative Rho guanine nucleotide exchange factor and orthologue of the Charcot-Marie-Tooth disease associated gene ARHGEF10. Furthermore, a Computer that is able to consider the whole and describe the sum of everything in it absolutely in unambiguous terms is a useful tool. Here I describe such a computer with a suggestion for an application to examine any component in the context where a medicine is sought. Taken, together I would like to propose this method as a fundamental necessity and improvement upon current existing methods related not only to Hedgehog signalling but plausibly to life science research and the search for medicines in general.

Artificial Intelligence (AI) is becoming increasingly important, especially in the medical field. While AI has been used in medicine for some time, its growth in the last decade has been remarkable. Specifically, Machine Learning (ML) and Deep Learning (DL) techniques in medicine have been increasingly adopted thanks to the growing abundance of health-related data, improved suitability of such techniques for managing large data-sets, and more computational power. The Italian scientific community has been instrumental in advancing this research area. This article aims to conduct a comprehensive investigation of the ML and DL methodologies and applications used in medicine by the Italian research community in the last five years.

3D reconstruction from a single 2D input is a classic problem in the field of computer vision. With the advancements in deep learning, the performance of 3D reconstruction has also significantly improved. The reconstruction task is more difficult for objects with no textures or complex deformations. This paper serves as a review of recent literature on 3D reconstruction from a single view, with a focus on deep learning methods from 2018 to 2021. Due to lack of standard datasets or 3D shape representation methods, it is hard make direct comparisons between all reviewed methods. However, this paper reviews different approaches for reconstructing 3d shape as depth maps, surface normals, point clouds and meshes; along with various loss functions and evaluation metrics used to train and evaluate these methods.

In this article, we propose a machine learning based fine-grained vehicle classification method VehiClassNet, which effectively solves the challenges of precise vehicle recognition and classification in intelligent transportation systems by combining multi-scale feature extraction, cross modal fusion, and attention mechanisms. Our model demonstrated excellent performance on the Stanford Cars-196 dataset. The innovation of this study lies in its advanced multi-scale feature extraction, cross modal fusion, and attention mechanism. It not only improves classification accuracy, but also lays the foundation for further research on intelligent transportation systems and autonomous vehicle technology.

Pilots can be one of the factors in many air traffic accidents. When one or both pilots are impaired (e.g. fatigue, drunk), disabled, capable but wrong-headed, don’t have sufficient training, distracted, miscommunicate with the air traffic controller, or follow wrong instructions from the air traffic controller, the risk of accident will increase dramatically. In some of these cases, the risk can be mitigated by using big data and machine learning. The system will collect and analyze large amount of data about the state of the aircraft, e.g., the flight path, the immediate environment around the aircraft, the weather and terrain information, and the pilots’ input to control the aircraft. Additional sensors such as eye tracking devices and biological monitor can also be added to determine the condition of the pilots. If the pilots’ input do not match proper reaction to the situation or the pilots are impaired, the learning machine will first provide an advisory to the pilots. If both pilots are impaired or incapable, a warning will be sent to the flight attendants and air traffic controllers so that they can take appropriate actions. The learning machine will be trained by both accident database and an automatic training system.

This paper provides the state of the art of data science in economics. Through a novel taxonomy of applications and methods advances in data science are investigated. The data science advances are investigated in three individual classes of deep learning models, ensemble models, and hybrid models. Application domains include stock market, marketing, E-commerce, corporate banking, and cryptocurrency. Prisma method, a systematic literature review methodology is used to ensure the quality of the survey. The findings revealed that the trends are on advancement of hybrid models as more than 51% of the reviewed articles applied hybrid model. On the other hand, it is found that based on the RMSE accuracy metric, hybrid models had higher prediction accuracy than other algorithms. While it is expected the trends go toward the advancements of deep learning models.

The article evaluates the use of machine learning methods to predict valve plate failures in hydraulic pumps. To conduct this assessment, a laboratory setup was developed that allowed the creation of a training dataset containing both the normal operating state of the pump and the operating state with three different valve plate damages. Five different predictive models were evaluated, including three composite models based on decision trees: Random Forest, Gradient-Boosted Trees, and Rotation Forest, as well as the kNN algorithm and a neural network. The analysis showed that neural networks achieved the highest prediction accuracy, enabling a prediction accuracy level of 89%. The kNN algorithm ranked second, and tree-based algorithms performed 4% worse than the neural network. Additionally, the attribute importance analysis revealed that leak flow, pressure output together with output flow, are the most important parameters for accurate prediction.

Fruit quality is a critical factor in the produce industry, affecting producers, distributors, consumers, and the economy. High-quality fruits are more appealing, nutritious, and safe, boosting consumer satisfaction and revenue for producers. Artificial Intelligence can aid in assessing the quality of the fruit using images. This paper presents a general machine-learning model for assessing fruit quality using deep image features. The model leverages the learning capabilities of the recent successful networks for image classification called Vision Transformers (ViT). The ViT model is built and trained with a combination of various fruit datasets and learned to distinguish between good and rotten fruit images. The general model demonstrated impressive results in accurately identifying the quality of various fruits such as Apples (with a 99.50% accuracy), Cucumbers (99%), Grapes (100%), Kakis (99.50%), Oranges (99.50%), Papayas (98%), Peaches (98%), Tomatoes (99.50%), and Watermelons (98%). However, it showed slightly lower performance in identifying Guavas (97%), Lemons (97%), Limes (97.50%), mangoes (97.50%), Pears (97%), and Pomegranates (97%).

Computed tomography (CT) offers detailed insights into the internal anatomy of patients, partic-ularly for spinal vertebrae examination. However, CT scans are associated with higher radiation exposure and cost compared to conventional X-ray imaging. In this study, we applied a Genera-tive Adversarial Network (GAN) framework to reconstruct 3D spinal vertebrae structures from synthetic biplanar X-ray images, specifically focusing on anterior and lateral views. The synthetic X-ray images were generated using the DRRGenerator module in 3D Slicer, by incorporating segmentations of spinal vertebrae in CT scans for the region of interest focussing. The approach leverages a novel feature fusion technique based on X2CT-GAN to combine information from both views and employs a combination of Mean Squared Error (MSE) loss and adversarial loss to train the generator, resulting in high-quality synthetic 3D spinal vertebrae CTs. A total of n=440 CT data were processed. We evaluated the performance of our model using multiple metrics, in-cluding Mean Absolute Error (MAE) (for each slice of the 3D volume [MAE0] and for the entire 3D volume [MAE]), Cosine Similarity, Peak Signal-to-Noise Ratio (PSNR), 3D Peak Sig-nal-to-Noise Ratio (PSNR-3D), and Structural Similarity Index (SSIM). The average PSNR was 28.394 dB, PSNR-3D was 27.432, SSIM was 0.468, cosine similarity was 0.484, MAE0 was 0.034, and MAE was 85.359. The results demonstrated the effectiveness of the approach in reconstruct-ing 3D spinal vertebrae structures from biplanar X-rays, although some limitations in accurately capturing the fine bone structures and maintaining the precise morphology of the vertebrae were present. This technique has the potential to enhance the diagnostic capabilities of low-cost X-ray machines while reducing radiation exposure and cost associated with CT scans, paving the way for future applications in spinal imaging and diagnosis.

The application of machine learning techniques to satellite imagery has been the subject of interest in recent years. The increase in quality and quantity of images, made available by Earth observation programs, such as the Copernicus program, led to the generation of large amounts of data. Among the various applications of this data is the creation of land cover maps. The present work aimed to create machine learning models capable of accurately segment and classify satellite images, to automatically generate a land cover map of the Portuguese territory. Several experiments were carried out with the spectral bands of the Sentinel-2 satellite, with vegetation indices, and with several sets of land cover classes. Three machine learning architectures were evaluated, which adopt two different techniques for image classification. One of the classification techniques follows an object-oriented approach, and in this case the architecture adopted in our models was a U-Net artificial neural network. The other classification technique is pixel-oriented, and the machine learning models tested were random forest and support vector machine. The overall accuracy of the results obtained ranged from 68.6% to 94.75%, depending strongly on the number of classes into which the land cover is classified. The result of 94.75% was obtained when classifying the land cover only into 5 classes. However, a very interesting accuracy of 92.37% was achieved by the model when trained to classify 8 classes. These results are superior to those reported in the related bibliography.

The Eurasian grapevine (Vitis vinifera L.) is the most widely grown horticultural crop in the world and is important for the economy of many countries. In the wine production chain, grape varieties play an important role as they directly influence the authenticity and classification of the product. Identifying the different grape varieties is therefore fundamental for quality control and inspection activities, as well as for regulating production. Currently, ampelography and molecular analysis are the main approaches to identifying grape varieties. However, both methods have limitations. Ampelography is subjective and prone to errors and is experiencing enormous difficulties as ampelographers are increasingly scarce. On the other hand, molecular analyses are very demanding in terms of cost and time. In this scenario, Deep Learning (DL) and Machine Learning (ML) methods have emerged as a classification alternative to deal with the scarcity of ampelographs and avoid molecular analyses. In this study, the most recent and current methods for identifying grapevine varieties using DL classification-based approaches are presented through a systematic literature review. The classification pipeline of the 31 studies found in the literature was described, highlighting its pros and cons. Most of the studies used DL-based models trained with leaf images acquired in a controlled environment at a maximum distance of 1.2 metres to classify grape varieties. In addition, there is a large gap between practical applications and the datasets used: a great lack of varieties, limited data acquired in the field and a lack of tests on plants under adverse conditions. Potential directions for improving this area of research were also presented.

The use of credit cards and online banking is expanding exponentially. As more individuals use debit cards, credit cards, and internet banking, the likelihood of falling victim to various forms of fraud also rises. Due to ignorance, credit card company customers have provided their card details, personal information, and one-time password to an unknown bogus caller on several occasions in the recent past. One of the biggest issues facing financial institutions and customers alike is credit card theft. It may result in large financial losses and harm to the financial institution's image. While there are several ways to identify credit card fraud, one of the best is machine learning.By using past data, machine learning algorithms may be trained to recognize trends and abnormalities that point to fraud. The state-of-the-art in machine learning for credit card fraud detection is reviewed in this study. Numerous research on the same subject have been conducted in the past with a variety of well-known machine-learning techniques. However, with a grasp of the notion of hybrid machine learning, we will now examine how well hybrid machine learning performs on the same problem statement.

Electromyographic (EMG) signals provide information about a person's muscle activity. For hand movements, in particular, the execution of each gesture involves the activation of different combinations of the forearm muscles, which generate distinct electrical patterns. Conversely, the analysis of these muscle activation patterns, represented by EMG signals, allows recognizing which gesture is being performed. In this study, we aimed to implement an automatic identification system of hand or wrist gestures based on supervised Machine Learning (ML) techniques. We trained different computational models and determined which of these showed the best capacity to identify six hand or wrist gestures and generalize between different subjects. We used an open access database containing recordings of EMG signals from 36 subjects. Among the results obtained, we highlight the performance of the Random Forest model, with an accuracy of 95.39%, and the performance of a convolutional neural network with an accuracy of 94.77%.

This article presents a review of current advances and future prospects in the field of forecasting renewable energy generation using machine learning (ML) and deep learning (DL) techniques. With the increasing penetration of renewable energy sources (RES) into the electricity grid, accurate forecasting of their generation becomes crucial for efficient grid operation and energy management. Traditional forecasting methods have limitations, and thus ML and DL algorithms have gained popularity due to their ability to learn complex relationships from data and provide accurate predictions. This paper reviews the different approaches and models that have been used for renewable energy forecasting and discusses their strengths and limitations. It also highlights the challenges and future research directions in the field, such as dealing with uncertainty and variability in renewable energy generation, data availability, and model interpretability. Finally, this paper emphasizes the importance of developing robust and accurate renewable energy forecasting models to enable the integration of RES into the electricity grid and facilitate the transition towards a sustainable energy future.

In the intersection of the Internet of Things (IoT) and Machine Learning (ML), the choice between high-level and low-level programming libraries presents a significant dilemma for developers, impacting not only the efficiency and effectiveness of ML models but also their environmental footprint. We have proposed a comprehensive framework to aid in this decision-making process, underpinned by a detailed comparative analysis of both types of libraries on one of the key IoT ML task; image classification. We have introduced a novel algorithm designed to calculate the green footprint of ML model training, factoring in execution time, memory utilization, power consumption, and CPU temperature, addressing the urgent need for sustainable ML practices. Through an empirical evaluation of popular libraries such as PyTorch for high-level and Libtorch for low-level development, we have assessed their performance, development efficiency, and hardware compatibility. The culmination of our research is a decision support system that synthesizes the experimental findings to guide developers toward choices that harmonize model performance with environmental sustainability.

3D human pose estimation has made significant advancements through the integration of deep learning techniques. This survey provides a comprehensive review of recent 3D human pose estimation methods, with a focus on monocular images, videos, and multi-view cameras. Our approach stands out through a systematic literature review methodology, ensuring an up-to-date and meticulous overview. Unlike many existing surveys that categorize approaches based on learning paradigms, our survey offers a fresh perspective, delving deeper into the subject. For image-based approaches, we not only follow existing categorizations but also introduce and compare significant 2D models. Additionally, we provide a comparative analysis of these methods, enhancing the understanding of image-based pose estimation techniques. In the realm of video-based approaches, we categorize them based on the types of models used to capture inter-frame information. Furthermore, in the context of multi-person pose estimation, our survey uniquely differentiates between approaches focusing on relative poses and those addressing absolute poses. Our survey aims to serve as a pivotal resource for researchers, highlighting state-of-the-art deep learning strategies and identifying promising directions for future exploration in 3D human pose estimation.

Power disaggregation aims at determining the appliance-by-appliance electricity consumption leveraging upon a single meter only, which measures the entire power demand. Data-driven procedures based on Factorial Hidden Markov Models have been proven remarkable results on energy disaggregation. Nevertheless, those procedures have various weaknesses: there is a scalability problem as the number of devices to observe raises and the algorithmic complexity of the inference step is severe. DNN architectures, such as Convolutional Neural Networks, have demonstrated to be a viable solution to deal with FHMMs shortcomings. Nonetheless, there are two significant limitations: a complicated and time-consuming training system based on back-propagation has to be employed to estimates the neural architecture parameters, and large amounts of training data covering as many operation conditions as possible need to be collected to attain top performances. In this work, we aim to overcome those limitations by leveraging upon the unique and useful characteristics of the extreme learning machine technique, which is based on a collection of randomly chosen hidden units and analytically defined output weights. Experiment evaluation has been conducted using the UK-DALE corpus. We find that the suggested approach achieves similar performances to recently proposed ANN-based methods and outperforms FHMMs. Besides, our solution generalises well to unseen houses.

The rapid infiltration of fake news is a flaw to the otherwise valuable internet, a virtually global network that allows for the simultaneous exchange of information. While a common, and normally effective, approach to such classification tasks is designing a deep learning-based model, the subjectivity behind the writing and production of misleading news invalidates this technique. Deep learning models are unexplainable in nature, making the contextualization of results impossible because it lacks explicit features used in traditional machine learning. This paper emphasizes the need for feature engineering to effectively address this problem: containing the spread of fake news at the source, not after it has become globally prevalent. Insights from extracted features were used to manipulate the text, which was then tested on deep learning models. The original unknown yet substantial impact that the original features had on deep learning models was successfully depicted in this study.

In the field of low power wireless networks, one of the techniques on which many researchers are putting their efforts is related to positioning methodologies such as fingerprinting in dense urban areas. This paper presents an experimental study aimed at quantifying the mean location estimation error in densely urbanized areas.Using a dataset made available by the University of Antwerp, a neural network was implemented with the aim of providing the position of the end-devices. In this way it was possible to measure the mean location estimation error in an area with high urban density. The results obtained show an accuracy in the localization of the end-device of less than 150 meters.This result would make it possible to use the fingerprint instead of alternative, energy consuming, methodologies such as GPS in IoT (Internet of Things) applications where battery life is the primary requirement to be met.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

State-of-the-art remote sensing scene classification methods employ different Convolutional Neural Network architectures for achieving very high classification performance. A trait shared by the majority of these methods is that the class associated with each example is ascertained by examining the activations of the last fully connected layer, and the networks are trained to minimize the cross-entropy between predictions extracted from this layer and ground-truth annotations. In this work, we extend this paradigm by introducing an additional output branch which maps the inputs to low dimensional representations, effectively extracting additional feature representations of the inputs. The proposed model imposes additional distance constrains on these representations with respect to identified class representatives, in addition to the traditional categorical cross-entropy between predictions and ground-truth. By extending the typical cross-entropy loss function with a distance learning function, our proposed approach achieves significant gains across a wide set of benchmark datasets in terms of classification, while providing additional evidence related to class membership and classification confidence.

Introduction: Prostate cancer (PCa) is one of the deadliest and most common causes of malignancy and death in men worldwide, more specifically with higher prevalence and mortality in developing countries. Factors such as age, family history, race and certain genetic mutations are some of the factors contributing to the occurrence of PCa in men. The recent advances in technology and algorithms gave rise to the computer-aided diagnosis (CAD) of PCa. With the availability of medical image datasets and emerging trends in state-of-the-art machine and deep learning techniques, there is a growth in recent related publications. Materials and Methods: In this study, we present a systematic review of PCa diagnosis with medical images using machine learning and deep learning techniques. We conducted a thorough review through relevant studies indexed in four databases (IEEE, PubMed, Springer and ScienceDirect) using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. With well-defined search terms, a total of 608 articles were identified and 77 met the final inclusion criteria. Key elements in the included papers were presented and conclusions were drawn from them. Results: Findings showed that the United States has the most research in PCa diagnosis with machine learning, Magnetic Resonance Images are the most used datasets and transfer learning is the most used method of diagnosing PCa in recent times. In addition, some available PCa datasets and some key considerations for choice of loss function in the deep learning models were presented. The limitations and lessons learnt were discussed and some key recommendations were made. Conclusion: The discoveries and the conclusions of this work have been organized so as to enable researchers in the same domain to use this work and make crucial implementation decisions.

In this report we describe the case of a healthy, young, athletic woman who developed acute lymphoblastic leukaemia (ALL)/lymphoblastic lymphoma (LBL) after receiving the second dose of the Pfizer/BioNTech modified mRNA (modRNA) COVID-19 genetic vaccine (marketed as Comirnaty^®). The first dose of the genetic vaccine did not appear to illicit any noticeable side effects, but within 24 hours of the second dose the patient suffered widespread and intensifying bone pain, fever, vomiting, and general malaise. Due to the persistence of the symptoms, the patient underwent a series of tests and examinations including a full laboratory workup, a consult with a clinical immunologist and rheumatologist, a Positron Emission Tomography (PET) imaging, as well as an osteomedullary biopsy. These together led to a definitive diagnosis of ALL. A time interval of 16 weeks from the second vaccination to the diagnosis of cancer was noted. Several similar cases with identical pathology which developed after the modRNA COVID-19 vaccination, are described in case reports in the scientific literature. The massive and indiscriminate use of genetic vaccines to fight COVID-19 is raising serious concerns about their safety and about the technology platform as a whole for this purpose. Growing evidence is accumulating regarding the biodistribution and persistence of the modRNA which can reach, thanks to the lipid nanoparticles, a multitude of tissues and organs of the body, including the bone marrow and other blood-forming organs and tissues. Moreover, there is evidence that the modRNA vaccines display a particular tropism for the bone marrow, influencing the immune system at multiple levels and being able to trigger not only autoimmune-based pathologies, but also neoplastic mechanisms. The aim of this article is to assess, on the basis of the available scientific literature, the risk of developing haematopoietic cancers after modRNA vaccination, and to investigate the potential genetic mechanisms involved in the pathogenesis of disease.

Now when the whole world is still under COVID-19 pandemic, many schools have transferred the teaching from physical classroom to online platforms. It is highly important for schools and online learning platforms to investigate the feedback to get valuable insights about online teaching process so that both platforms and teachers are able to learn which aspect they can improve to achieve better teaching performance. But handling reviews expressed by students would be a pretty laborious work if they were handled manually as well as it is unrealistic to handle large-scale feedback from e-learning platform. In order to address this problem, both machine learning algorithms and deep learning models are used in recent research to automatically process students' review getting the opinion, sentiment and attitudes expressed by the students. Such studies may play a crucial role in improving various interactive online learning platforms by incorporating automatic analysis of feedback. Therefore, we conduct an overview study of sentiment analysis in educational field presented in recent research, to help people grasp an overall understanding of the sentiment analysis research. Besides, according to the literature review, we identify three future directions that researchers can focus on in automatically feedback processing: high-level entity extraction, multi-lingual sentiment analysis, and handling of figurative language.

Abstract: The main contribution of this paper is to introduce a new iterative training algorithm for restricted Boltzmann machines. The proposed learning path is inspired from online sequential extreme learning machine one of extreme learning machine variants which deals with time accumulated sequences of data with fixed or varied sizes. Recursive least squares rules are integrated for weights adaptation to avoid learning rate tuning and local minimum issues. The proposed approach is compared to one of the well known training algorithms for Boltzmann machines named “contrastive divergence”, in term of time, accuracy and algorithmic complexity under the same conditions. Results strongly encourage the new given rules during data reconstruction.

With the widespread application of artificial intelligence technology in various industries, users' attention to privacy and data security has increased significantly. Federated learning, as a new technology paradigm combining privacy-enhanced computing and artificial intelligence, resolves the contradiction between data security and open sharing. This paper presents the benefits of federated learning in terms of privacy, real-time processing, model robustness, compliance and cross-industry applications. At the same time, when combined with Edge AI technology, federated learning promotes the decentralisation of intelligent systems, improving data privacy protection and model accuracy. This paper also discusses the application cases of federated learning in the medical field, through local data processing and model training, effectively protecting user privacy, realizing medical data sharing and model optimization, and promoting the development of artificial intelligence.

This paper systematically discusses the application and development of federated learning in data privacy protection and data value sharing. With the rapid development of global information technology, especially the explosive growth of data from Internet of Things devices, data security and privacy protection are facing unprecedented challenges. This paper first analyzes the growth trend of global data volume and its importance to next generation technologies such as artificial intelligence technologies such as deep learning. Second, the paper provides an in-depth look at the impact of current data privacy regulations on data flows and value creation, particularly the EU's GDPR and China's Data Security and Personal Information Protection Law. Then, this paper introduces in detail federated learning, as a new distributed machine learning paradigm, which effectively solves the contradiction between existing data sharing and privacy protection by protecting individual data privacy and realizing global model collaborative construction. Finally, this paper discusses the combination of blockchain technology and federated learning, and proposes BeFL architecture as a new secure, decentralized and trusted federated learning system, which is expected to provide a comprehensive solution for large-scale data processing and value creation in multi-party scenarios. The research in this paper not only deepens the understanding of federation learning in theory, but also provides important reference and enlightenment for future research and application in related fields.

In this study, we explored the application of deep learning techniques for credit card fraud detection, aiming to improve the performance and reliability of anomaly detection methods in financial transactions. We first utilized the Isolation Forest algorithm, achieving a detection accuracy of 26% for the top 1000 transactions. Subsequently, we experimented with the Autoencoder algorithm, an unsupervised deep neural network model, which enhanced the detection accuracy to 33.6% in the best case despite some fluctuations. The results demonstrate deep learning models' strong feature extraction capability and adaptability, highlighting their potential to surpass traditional methods. However, the high imbalance in the dataset, with only 0.17% of transactions being fraudulent, poses a significant challenge. This study underscores the necessity for further experimentation and optimization of network structures and hyperparameters to achieve more stable and efficient fraud detection. The findings provide valuable insights and reference points for future research in financial fraud detection using deep learning methodologies.

In the current age of the Fourth Industrial Revolution ($4IR$ or Industry $4.0$), the digital world has a wealth of data, such as Internet of Things (IoT) data, cybersecurity data, mobile data, business data, social media data, health data, etc. To intelligently analyze these data and develop the corresponding real-world applications, the knowledge of artificial intelligence (AI), particularly, machine learning (ML) is the key. Various types of machine learning algorithms such as supervised, unsupervised, semi-supervised, and reinforcement learning exist in the area. Besides, the deep learning, which is part of a broader family of machine learning methods, can intelligently analyze the data on a large scale. In this paper, we present a comprehensive view on these machine learning algorithms that can be applied to enhance the intelligence and the capabilities of an application. Thus, this study's key contribution is explaining the principles of different machine learning techniques and their applicability in various real-world applications areas, such as cybersecurity, smart cities, healthcare, business, agriculture, and many more. We also highlight the challenges and potential research directions based on our study. Overall, this paper aims to serve as a reference point for not only the application developers but also the decision-makers and researchers in various real-world application areas, particularly from the technical point of view.

Clients are increasingly looking for fast and effective means to quickly and frequently survey and communicate the condition of their buildings so that essential repairs and maintenance work can be done in a proactive and timely manner before it becomes too dangerous and expensive. Traditional methods for this type of work commonly comprise of engaging building surveyors to undertake a condition assessment which involves a lengthy site inspection to produce a systematic recording of the physical condition of the building elements, including cost estimates of immediate and projected long-term costs of renewal, repair and maintenance of the building. Current asset condition assessment procedures are extensively time consuming, laborious, and expensive and pose health and safety threats to surveyors, particularly at height and roof levels which are difficult to access. We propose a method for automated detection and localisation of key building defects from images using deep learning and convolution neural networks. The proposed model is based on a pre-trained VGG-16 classifier with Class Activation Mapping (CAM) for object localisation. The model has proven to be robust and able to accurately detect and localise mould growth, stains, and paint deterioration defects arising from dampness in buildings. The approach is being developed with potentials to scale-up to support automated detection of defects and deterioration of buildings in real-time using mobile devices and drones.