Under optimal conditions, just 3–6 ms of visual stimulation suffices for humans to see motion. Motion perception on this time scale implies that the visual system under these conditions reliably encodes, transmits, and processes neural signals with near-millisecond precision. Motivated by in vitro evidence for high temporal precision of motion signals in the primate retina, we investigated how neuronal and perceptual limits of motion encoding relate. Specifically, we examined the correspondence between the time scale at which cat retinal ganglion cells in vivo represent motion information and temporal thresholds for human motion discrimination. The time scale for motion encoding by ganglion cells ranged from 4.6–91 ms, depended nonlinearly on temporal frequency but not on contrast. Human psychophysics revealed that minimal stimulus durations required for perceiving motion direction were similarly brief, 5.6–65 ms, similarly depended on temporal frequency but, above ~10%, not on contrast. Notably, physiological and psychophysical measurements corresponded closely throughout (r = 0.99), despite more than a 20-fold variation in both human thresholds and optimal time scales for motion encoding in the retina. These results demonstrate that neural circuits for motion vision in cortex can maintain and make use of the high temporal fidelity of the retinal output signals.

Non-invasive, electroencephalography (EEG)-based brain-computer interfaces (BCIs) on motor imagery movements translate the subject’s motor intention into control signals through classifying the EEG patterns caused by different imagination tasks, e.g. hand movements. This type of BCI has been widely studied and used as an alternative mode of communication and environmental control for disabled patients, such as those suffering from a brainstem stroke or a spinal cord injury (SCI). Notwithstanding the success of traditional machine learning methods in classifying EEG signals, these methods still rely on hand-crafted features. The extraction of such features is a difficult task due to the high non-stationarity of EEG signals, which is a major cause for the stagnating progress in classification performance. Remarkable advances in deep learning methods allow end-to-end learning without any feature engineering, which could benefit BCI motor imagery applications. We developed three deep learning models: 1) a long short-term memory (LSTM); 2) a proposed spectrogram-based convolutional neural network model (pCNN); and 3) a recurrent convolutional neural network (RCNN), for decoding motor imagery movements directly from raw EEG signals without (manual) feature engineering. Results were evaluated on our own, publicly available, EEG data collected from 20 subjects and on an existing dataset known as 2b EEG dataset from "BCI Competition IV". Overall, better classification performance was achieved with deep learning models compared to state-of-the art machine learning techniques, which could chart a route ahead for developing new robust techniques for EEG signal decoding. We underpin this point by demonstrating the successful real-time control of a robotic arm using our CNN based BCI.

Vibration measurement serves as the basis for various engineering practices such as natural frequency or resonant frequency estimation. As image acquisition devices become cheaper and faster, vibration measurement and frequency estimation through image sequence analysis continue to receive increasing attention. In the conventional photogrammetry and optical methods of frequency measurement, vibration signals are first extracted before implementing the vibration frequency analysis algorithm. In this work, we demonstrated that frequency prediction can be achieved using a single feed-forward convolutional neural network. The proposed method is verified using a vibration signal generator and excitation system, and the result obtained was compared with that of an industrial contact vibrometer in a real application. Our experimental results demonstrate that the proposed method can achieve acceptable prediction accuracy even in unfavorable field conditions.

Smart buildings concept aims at the use of the smart technology to reduce energy consumption as well as improvement of the comfort conditions and users’ satisfaction. It is based on the use of smart sensors to follow both outdoor and indoor conditions as well as software for the control of comfort and security devices. The optimal control of the energy devices requires software for indoor temperature forecasting. This paper presents an ANN – based model for the indoor temperature forecasting. The model is developed using data recoded in an old building of the engineering school Polytech’Lille. Data covered both indoor and outdoor conditions. Analysis of the relevance of the input parameters allowed to develop a simplified forecasting model of the indoor temperature that uses only the outdoor temperature as well as the history of the façade temperature as input parameters. The paper presents successively, data collection, the ANN concept used in the temperature forecasting, and finally the ANN model developed for the façade and indoor forecasting. It shows that an ANN-based model using outdoor and façade temperature sensors provides a good forecasting of the indoor temperature. This model could be used for the optimal control of buildings energy devices.

This paper attempts at applying adaptive network-based fuzzy inference system (ANFIS) for analysis of the resonant frequency of a microstrip rectangular patch antenna with two equal size slots which are placed on the patch vertically. The resonant frequency is calculated as the position of slots is shifted to the right and left sides on the patch. As a result , the antenna resonates at more than one frequency . Commonly, machine algorithms based on artificial neural networks are employed to recognize the whole resonant frequencies. However ,they fail to estimate the resonant frequencies correctly as in some cases variations are not very sensible and the resonant frequencies overlap each other . It can be concluded that artificial neural networks could be replaced in such designs by the adaptive network-based fuzzy Inference system due to its high approximation capability and much faster convergence rate.

Recent advances in nanomaterials have been heavily influenced by low-dimensional nanocarbon allotropes. In particular, carbyne has attracted attention for its potential as a true one-dimensional carbon chain with sp1 hybridization. To maximize the capabilities of this material, we employ a focused data-driven inverse design approach based on the carbon nanomaterials genome concept. This involves using deep learning neural network models to identify key descriptors tied to desired properties, enabling property prediction and reverse engineering of nanocarbons. Our iterative approach entails: (i) gathering growth/property data on nanostructures; (ii) identifying informative numerical/categorical predictors; (iii) developing deep learning models mapping descriptors to properties; (iv) refining models with new insights; (v) determining required descriptors/conditions for target properties via inverse mapping; (vi) validating models by synthesizing predicted nanostructures; and (vii) enhancing models with validation data. This allows uncovering hidden growth-property connections, precisely tuning nanocarbons for desired attributes. We introduce new methodologies including exciting synergistic effects, synchronizing atomic vibrations, active screen plasma, energy-driven transformations, surface acoustic micro/nano-manipulation, doping and directed self-assembly to expose relationships and integrate insights into the inverse design flow. This research promises to accelerate discovery of next-generation low-dimensional nanocarbons with exceptional properties and applications.

While paresthesia-based spinal cord stimulation (SCS) has been proven effective to treat chronic neuropathic pain, initial benefits may lead to the development of “Failed SCS Syndrome’ (FSCSS) defined as decrease over time related to Loss of Efficacy (LoE) with or without Loss of Coverage (LoC). Development of technologies associating new paresthesia-free stimulation waveforms and implanted pulse generator adapters provide opportunities to manage patients with LoE. The main goal of our study was to investigate salvage procedures, through neu-rostimulation adapters, in patients already implanted with SCS and experienced LoE. We retro-spectively analyzed a cohort of patients who were offered new SCS programs/waveforms through an implanted adapter between 2018 and 2021. Patients were evaluated before, and at 1, 3, 6 and 12-month follow-up. Outcomes included pain intensity rating with Visual Analog Scale (VAS), pain/coverage mappings and stimulation preferences. Last follow-up evaluations (N=27) showed significant improvement in VAS (p = 0.0001), ODI (p = 0.021) and Quality of Life (p=0.023). In the 11/27 patients with LoC, SCS efficacy on pain intensity (36.89%) was accompa-nied by paresthesia coverage recovery (55.57%) and pain surface decrease (47.01%). At 12-month follow-up, 81.3% preferred to keep tonic stimulation in their waveform portfolio. SCS conver-sion using adapters appears promising as a salvage solution, with an emphasis on paresthesia recapturing enabled by spatial retargeting. In light of these results, adapters could be integrated to SCS rescue algorithms or should be considered in SCS rescue.

This study presents the development of a Recurrent Neural Network (RNN) model for classifying smart home device data. Utilizing a dataset sourced from Kaggle, the study explored the processes of data gathering, loading, normalization, and model construction. The RNN, equipped with Long Short-Term Memory (LSTM), was trained and evaluated, demonstrating significant improvements in training and validation accuracy over 10 epochs, culminating in a test accuracy of 83.25%, and only 35.4% loss. The evaluation of the model on the test set provides a test accuracy result, accompanied by an in-depth analysis of ROC curves and Area Under the Curve (AUC) scores for multi-class classification, along with a confusion matrix. The AUC score of 0.9896 indicates outstanding performance in accurately classifying IoT device categories. These findings indicate that the RNN with LSTM exhibits superior learning efficiency and generalization capabilities, making it more suitable for IoT device classification tasks. This article emphasizes the concept of IoT and reviews recent studies on the application of deep learning models across various IoT domains, including smart homes, industrial systems, and healthcare. Future research could focus on improving real-time processing capabilities, and scalability, and incorporating diverse IoT data types to enhance and broaden the model's practical applications.

In this paper, we review and advance the application of deep learning algorithms for anomaly detection in Software Defined Networks (SDN). As SDN environments become more prevalent in modern networking infrastructures, their centralized control and dynamic nature make them susceptible to various security threats, including Distributed Denial of Service (DDoS) attacks, data breaches, and unauthorized access. Traditional anomaly detection techniques often fall short in adapting to these evolving threats, necessitating more robust, adaptive solutions. This study evaluates three prominent deep learning architectures—Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Autoencoders—for their effectiveness in detecting anomalous behavior in SDN environments. Through extensive experimentation, we compare these models in terms of accuracy, precision, recall, F1-score, and ROC-AUC, highlighting their strengths and limitations. Our results show that CNNs excel in detecting spatial anomalies, RNNs are wellsuited for temporal anomaly detection, and Autoencoders provide robust detection for previously unseen anomalies. Additionally, we examine the sensitivity of threshold settings in Autoencoders and assess the real-time feasibility of these models by measuring their inference times. The findings suggest that deep learning-based anomaly detection significantly enhances the security of SDNs, providing both accuracy and speed suitable for real-time applications. Finally, we propose future directions for optimizing deep learning models to handle large-scale, dynamic SDN deployments more effectively. This work contributes to the growing body of research focused on utilizing deep learning for improving the security and resilience of SDN-based infrastructures.

In this paper, we review metaheuristic optimization techniques for machine learning with Graph Neural Networks (GNNs), focusing on two major categories: single-solution-based and population-based metaheuristics. We provide an in-depth analysis of Genetic Algorithms (GA) and Particle Swarm Optimization (PSO), highlighting their effectiveness in optimizing GNN hyperparameters. By exploring the strengths and weaknesses of these methods, we aim to provide insights into their application and performance in enhancing the efficiency and accuracy of GNN models. We will also review the similarities of supervised learning and metaheuristic solutions.

With the urgent need of precise positioning faced by internet of things (IoT) applications, the universality and cost of indoor positioning devices become key factors. Since the 5G network has been widely deployed, new opportunity is brought by tightly fusing the traditional low-cost sensors, i.e., the magnetometer. In this study, using 5G channel state information (CSI) and geomagnetic data, a multi-input convolutional neural network (CNN) localization system was proposed. First, to generate a data tensor that is easy for CNN processing, the raw data was reconstructed individually. Then, to comprehensively incorporate the features of 5G CSI and geomagnetic strength data, the ReLU function was chosen as the activation function of the convolutional layer. After that, a multi-input CNN was trained using the incorporated geomagnetic strength and CSI amplitude in the off-line side, and the trained CNN was recorded as a location fingerprint, which can be used for the user position prediction. Finally, in the online side and using a multi-input CNN, the 2-D coordinates are estimated and tested indoors in a typical conference room scenario. The results showed that longer sampling time of fingerprint data result in better uniqueness of the reference point, while the data collection time of locating points does not need to be long. Taking the positioning efficiency and accuracy into consideration, a sampling time of 3s at the reference point and 0.2s at the locating point are recommended. The positioning accuracy using the proposed method was 1.41 m, with an improvement of 22.9% compared with the 5G positioning, and an improvement of 18.0% compared with the 5G and geomagnetic fusing positioning using single CNN.

There are considerable benefits in applying Artificial Intelligence to automation in modern industries including Oil and Gas Industries. Oil and Gas Industries have many complex systems in their production and flow line. The failure of gas equipment will have serious consequences including financial and environmental issues. Condition monitoring of oil and gas equipment provides the condition of components, machines, systems, equipment, data hardware, and even software. The predictive maintenance and industry 4.0 applications have more advantages in petrochemical industries to make a safer economic environment and this paper addresses the Artificial Intelligence (AI) application of condition monitoring for Oil and Gas Industries. To understand the effectiveness of AI in condition monitoring for oil and gas industries, a case study related to the condition monitoring of drilling machine is conducted and applied Artificial Neural Network (ANN) algorithm to analyze and predict the potential failures. The novelty of this work is the proposal of an approach for tool wear monitoring in drilling using acoustic emission sensors for feature extraction and considering wavelet packet decomposition for further analysis. The extracted features from WPD are given as input for ANN to identify the healthiness of the drill bit and machine. This work aims to find the effectiveness of AI-based condition monitoring in enhancing effectiveness of monitoring and the safety of equipment in Oil and Gas Industries.

Software is increasingly vital, with automated systems regulating critical functions. As development demands grow, manual code review becomes more challenging, often making testing more time-consuming than development. A promising approach to improving defect detection at the source code level is the use of artificial intelligence combined with natural language processing (NLP). Source code analysis, leveraging machine-readable instructions, is an effective method for enhancing defect detection and error prevention. This work explores source code analysis through NLP and machine learning, comparing classical and emerging error detection methods. To optimize classifier performance, metaheuristic optimizers are used, and a modified algorithm is introduced to meet the study’s specific needs. The proposed two-tier framework uses a convolutional neural network (CNN) in the first layer to handle large feature spaces, with AdaBoost and XGBoost classifiers in the second layer to improve error identification. Additional experiments using Term Frequency-Inverse Document Frequency (TF-IDF) encoding in the second layer demonstrate the framework’s versatility. Across five experiments with public datasets, the CNN achieved an accuracy of 0.768799. The second layer, using AdaBoost and XGBoost, further improved these results to 0.772166 and 0.771044, respectively. Applying NLP techniques yielded exceptional accuracies of 0.979781 and 0.983893 from the AdaBoost and XGBoost optimizers.

Countless disasters have resulted from climate change, causing severe damage to infrastructure and the economy. These disasters have significant societal impacts, necessitating mental health services for the millions affected. To prepare for and respond effectively to such events, it is crucial to understand people's emotions and the life incidents they experience both before and after a disaster strikes. In this case study, we mined the emotions and life incidents expressed on Twitter during the 2017 Hurricane Harvey. Between August 20 and August 30, we collected a dataset of approximately 400,000 public tweets related to the storm. Using a BERT-based model, we predicted the emotions associated with each tweet. Following emotion prediction, we applied various natural language processing techniques to analyze the content of the tweets, aiming to uncover the 'topics' discussed alongside specific 'emotions.' To efficiently identify these topics, we utilized the Latent Dirichlet Allocation (LDA) technique for topic modeling, which allowed us to bypass manual content analysis and extract meaningful patterns from the data. However, rather than stopping at topic identification, we further refined our analysis by integrating Graph Neural Networks (GNN) and Large Language Models (LLM). The GNN was employed to generate embeddings and construct a similarity graph of the tweets, which was then used to optimize clustering. This step ensured that related tweets were accurately grouped together based on their content and context. Subsequently, we used an LLM to automatically generate descriptive names for each event cluster. This advanced approach allowed us to identify and label life incidents automatically, providing a nuanced understanding of the key issues faced by the community during the hurricane. The results revealed significant emotional shifts as the hurricane reached its most devastating phase. These shifts coincided with pressing concerns and demands from the population, such as evacuation plans, animal safety, safety updates, public policy, help requests, flood impacts, and the spread of fake news. By combining GNN and LLM for automatic event name prediction, our study not only mapped out the emotions but also accurately categorized the specific life incidents that were most relevant during the disaster, offering critical insights for disaster preparedness and response strategies.

In this study a novel approach of designing automatic control systems with the help of AI tools is proposed. Given plant dynamics, expected references, and expected disturbances, design of optimal neural-network based controller is done automatically. Several common reference types are studied including step, square, sine, sawtooth and trapezoid functions. Expected reference-disturbance pairs are used to train the system for finding optimal neural-network controller parameters. A separate test set is used to test the system for unexpected reference-disturbance pairs to show the generalization performance of the proposed system. Parameters of a real DC motor are used to test the proposed approach. Real DC motor’s parameters are estimated using particle swarm optimization (PSO) algorithm. Initially, a proportional-integral (PI) controller is designed using PSO algorithm for finding simple controller’s parameters optimally and automatically. Starting with neural-network equivalent of optimal PI controller, optimal neural-network controller is designed using PSO algorithm for training again. Simulations are conducted with estimated parameters for diverse set of training and test patterns. Results are compared with optimal PI controller’s performance and reported in the corresponding section. Encouraging results are obtained suggesting further research in the proposed direction.

With prosperous development and successful application of deep learning technologies in the field of remote sensing, numerous deep-learning based methods have emerged for synthetic aperture radar (SAR) automatic target recognition (ATR) tasks over the past few years. Generally, most deep-learning based methods can achieve outstanding recognition performance in condition that an abundant of labeled samples are available to train the model. However, in real application scenarios, it is difficult and costly to acquire and to annotate abundant SAR images due to the imaging mechanism of SAR, which poses a big challenge to existing SAR ATR methods. Thereby, SAR target recognition under the situation of few-shot, where only a scarcely few of labeled samples are available, is a fundamental problem that needs to be solved. In this paper, we put forward a new method named enhanced prototypical network with customized region-aware convolution (CRCEPN) to specially tackle the few-shot SAR ATR tasks. To be specific, We first develop a feature extraction network based on a customized and region-aware convolution, which can adaptively adjust convolutional kernels and their receptive fields according to each SAR image’s own characteristics as well as the semantical similarity among spatial regions, thus augmenting its capability to extract more informative and discriminative features. To achieve accurate and robust target identity prediction under the few-shot condition, we then propose an enhanced prototypical network which can improve the representation ability of the class prototype by properly making use of training and test samples together, thus effectively raising the classification accuracy. Meanwhile, a new hybrid loss is designed to learn a feature space with both inter-class separability and intra-class tightness as much as possible, which can further upgrade the recognition performance of the proposed method. Experiments performed on the moving and stationary target acquisition and recognition (MSTAR) dataset and the OpenSARShip dataset demonstrate that the proposed method is competitive with some state-of-the-art methods for few-shot SAR ATR tasks.

Machine-learning methods used for classification are challenged by the class imbalance problem, where a certain class is underrepresented. Over/under-sampling the majority/minority class observations or model selection for ensemble methods alone might not be effective if the class imbalance ratio is very high. To address this concern, a novel method is presented for generating synthetic data for minority class observations in conjunction with an optimal tree ensemble classifier (OTEC). This novel synthetic method first generates minority class instances to balance the training data. Then it applies OTEC, where models are selected based on their performance using out-of-bag observations and training subsamples. A total of 20 benchmark problems on binary classification with moderate to extreme class imbalance are used to assess the efficacy of the proposed method against other well-known methods, including optimal tree ensemble, smote random forest, under-sampling random forest, oversampling random forest, k-nearest-neighbor, support vector machine, tree, and artificial neural network, using classification error rate, sensitivity, specificity, precision, recall and F1-score as performance metrics to assess the efficacy of the proposed method. The analyses presented in this study revealed that the proposed method based on data balancing and model selection yielded better results than other methods.

Aiming at solving difficulties related to aero-engine classification and identification, the infrared spectra of aero-engine hot jets are measured by telemetry Fourier transform infrared spectrometer, and a six types aero-engine hot jet spectrum data set is generated. The spectrum data set were randomly sampled at a ratio of 8:1:1 to generate training set, validation set and prediction set. In this paper, a Peak Finding Siamese Convolutional Neural Network (PF-SCNN) is designed to match and classify spectrum data. In the first place, the matching pairs of training set and validation set are made independently with the labels of positive and negative samples creating. The spectrum feature extraction and distance similarity calculation are carried out by the Siamese convolutional neural network (SCNN). When entering the prediction phase, the prediction set and training set are integrated to predict in the trained model. The prediction set labels are ultimately determined by matching them with the training set labels having the highest similarities to ensure accurate predictions. To improve the operation efficiency of the SCNN, a peak finding method is introduced to extract the spectrum peaks. Peak positions of high frequency are counted, while the peak data are extracted. The peak data are used to take the place of the original data for training and prediction. The performance measures are defined as Accuracy, Precision, Recall, Confusion matrix and F1-score, and the prediction accuracy was up to 99%. The experimental results indicate that the proposed PF-SCNN is suitable for our spectral dataset and can complete the task of infrared spectrum classification of aero-engine hot jets.

Popular geo-computer vision works make use of aerial imager with sizes ranging from 64 × 64 to 1024 × 1024 pixels without any overlap, although the learning process of deep learning models can be affected by the reduced semantic context or the lack of information near image boundaries. In this work, the impact of three image sizes (256 × 256, 512 × 512, and 1024 × 1024 pixels) and two image overlap levels (no overlap and 12.5% overlap) on the performance of road classification models was statistically evaluated. For this, two convolutional neural networks used in various tasks of geospatial object extraction were trained (using the same hyperparameters) on a large dataset (containing aerial image data covering 8650 km² of the Spanish territory that was labelled with binary road information) under twelve different scenarios, each scenario featuring a different combination of tile size and overlap. To assess their generalisation capacity, the performance of all resulting models was evaluated on a data from novel areas covering approximately 825 km². The performance metrics obtained were analysed using appropriate descriptive and inferential statistical techniques to evaluate the impact of the performance at distinct levels of the fixed factors (tile size, tile overlap, neural network architecture). Statistical tests were applied to study the main and interaction effects of the fixed factors on the performance. A significance level of 0.05 was applied to all the null hypothesis tests. The results were highly significant for the main effects (p-values lower than 0.001), while the two-way and three-way interaction effects among them had different levels of significance. The results indicate that the training of road classification models on images with a higher tile size (more semantic context) and tile overlap (additional border context and continuity) significantly impacts their performance. The best model was trained on a dataset featuring tiles with a size of 1024 × 1024 pixels and a 12.5% overlap and achieved a loss value of 0.0984, an F1 score of 0.8728, and an ROC-AUC score of 0.9766, together with an error rate of 3.5% on the test set.

Neuromorphic computing, a brain inspired non-Von Neumann computing system, addresses the challenges posed by the Moore’s law memory wall phenomenon. It has the capability to increasingly enhance performance while maintaining power efficiency. Neuromorphic chip architecture requirements vary depending on the application and optimizing it for large-scale applications remains to be a challenge. Neuromorphic chips are programmed using spiking neural networks which provide them with important properties such as parallelism, asynchronism, and on-device learning. Widely used spiking neuron models include the Hodgkin-Huxley Model, Izhikevich model, integrate-and-fire model and spike response model. Hardware implementation platforms of the chip follow three approaches: analog, digital, or a combination of both. Each platform can be implemented using various memory topologies which interconnects with the learning mechanism. Current neuromorphic computing systems typically use the unsupervised learning spike timing-dependent plasticity algorithms. However, algorithms such as voltage-dependent synaptic plasticity have the potential to enhance performance. This review summarizes the potential neuromorphic chip architecture specifications and highlights which applications they are suitable for.

Monitoring the integrity of aeronautical structures is fundamental for safety. Structural Health Monitoring Systems (SHMS) perform real-time monitoring functions, but their performances must be carefully assessed. In this work the damage detection performances of a strain-based SHMS, were evaluated on a composite helicopter rotor blade root. The SHMS monitored the bonding between the central core and the surrounding antitorsional layer. A damage detection algorithm was trained through Finite Element analyses performed on the component. The effects of the loads variability and of damages were decoupled by including a load recognition step in the algorithm. Load recognition was accomplished in different ways: version#1 adopted an Artificial Neural Network (ANN) trained on blades in pristine condition; version#2 was trained also on damaged blades; version#3 adopted a calibration matrix method. Anomaly detection, damage assessment, and localization were performed by using an ANN. Results showed a higher load identification and anomaly detection accuracy for version#1 and version#2 compared to version#3. Gaussian noise reduced anomaly detection and damage assessment performances, and reduced damage localization accuracy for bigger damages. The damage detection performance were obtained for a fibre optic based-SHMS, including the trade-off between probability of detection and false alarm rate for different damage sizes.

In the ambitiously evolving construction industry of Kuwait, characterized by its vision 2035 and rapid technological integration, there exists a pressing need for advanced analytical frameworks. This research paper introduces a groundbreaking deep learning approach utilising an autoencoder neural network to analyse the complexities of the Kuwait Construction Market and identify data irregularities. The construction sector’s significant investment influx and project expansion make it an ideal candidate for deploying sophisticated analytical techniques to detect anomalous patterns indicating inefficiencies or unveiling potential opportunities. Our approach leverages the capabilities of autoencoder architectures to delve into and understand the prevalent patterns in market behaviours. This meticulous analysis allows for the detection of deviations that may lead to operational or financial consequences. We elucidate the mathematical foundations of autoencoders, highlighting their proficiency in managing the complex, multidimensional data typical of the construction industry. Through training on an extensive dataset—comprising variables like market sizes, investment distributions, and project completions—our model demonstrates its ability to pinpoint subtle yet significant anomalies. The outcomes of this study enhance our understanding of deep learning’s pivotal role in construction and building management. Additionally, our findings proactively sketch the future market trajectory and facilitate anomaly detection, thereby contributing substantially to the academic discussion on integrating machine learning into construction management. This research offers valuable insights for professionals within Kuwait, aiming to harness deep learning techniques to boost operational efficiency and strategic foresight in the construction sector.

The rapid advancement of artificial intelligence (AI) and robotics has led to significant progress in various medical fields, including interventional radiology (IR). This review focuses on the research progress and applications of AI and robotics in IR, including deep learning (DL), machine learning (ML), and convolutional neural networks (CNNs) across specialties such as oncology, neurology, and cardiology. To ensure the breadth and depth of this review, we implemented a systematic literature search strategy, selecting research published within the last five years. We conducted searches in databases such as PubMed and Google Scholar to find relevant literature. Special emphasis was placed on selecting large-scale studies to ensure comprehensiveness and reliability of the results. We discuss the role of AI techniques used before, during, and after intervention treatments and the advantages of robotics in achieving precise operations and reducing intra-operative risks. Challenges faced in the implementation of these techniques are also addressed. Finally, we explore the future trends and potential applications of AI and robotics in interventional therapy, highlighting their potential to improve patient treatment outcomes and quality of life.

The paper describes the new method for image compression based on coordinated group signal transformation. The algorithm is a type of difference coding. Coordinated processing significantly simplifies the difference signal conversion scheme using a single group codec for all signals. The described method considers color channels as correlated signals of a multi-channel communication system. The specifics of the processed data required modification of the coordinated group processing algorithm. First, we changed how to calculate the difference signals to prevent data loss. Secondly, the group codec was supplemented with a neural network to improve the quality of reconstructed images. We considered the following types of neural networks: fully connected, recurrent, convolution, and convolution in the Fourier space. Based on the simulation results, it is best to use fully connected neural networks if the goal is to minimize processing delay time. These networks have a response time of 13 ms. On the other hand, if the priority is to improve quality in cases where delays are not critical, then convolution neural networks in the Fourier space should be used. These networks have a response time of 140 ms and are of significant interest.

Deep Neural Network (DNN) inference demands substantial computing power, resulting in significant energy consumption. A large number of negative output activations in convolution layers are rendered zero due to the invocation of the ReLU activation function. This results in a substantial number of unnecessary computations that consume significant amounts of energy. This paper presents ECHO: Energy-efficient Computation Harnessing Onilne Arithmetic - A MSDF-based accelerator for DNN inference, designed for computation pruning, utilizing an unconventional arithmetic paradigm known as online/ most-significant digit first (MSDF) arithmetic which performs computations in a digit-serial manner. The MSDF digital serial computation of online arithmetic enables overlapped computation of successive operations leading to substantial performance improvements. The online arithmetic, coupled with a negative output detection scheme, facilitates early and precise recognition of negative outputs. This, in turn, allows for the timely termination of unnecessary computations, resulting in a reduction of energy consumption. The implemented design has been realized on the Xilinx Virtex-7 VU3P FPGA and subjected to a comprehensive evaluation through a rigorous comparative analysis involving widely used performance metrics. Experimental results demonstrate promising power and throughput improvements compared to contemporary methods. In particular, the proposed design achieved an average improvement in power consumption of up to 81%, 82.9%, and 40.6% for VGG-16, ResNet-18, and ResNet-50 workloads compared to the conventional bit-serial design, respectively. Furthermore, significant average speedups of 2.39×, 2.6×, and 2.42 were observed when comparing the proposed design to conventional bit-serial designs for VGG-16, ResNet-18, and ResNet-50 models respectively.

This study explores the prediction of concrete compressive strength using machine learning models, aiming to overcome the time-consuming and complex nature of conventional methods. Four models—Artificial Neural Network, Multiple Linear Regression, Support Vector Machine, and Regression Tree—are employed and compared for performance. Evaluation metrics such as Mean Absolute Deviation, Root Mean Square Error, Coefficient of Correlation, and Mean Absolute Percentage Error are used. After preprocessing 1030 samples, the dataset is split into 70% for training and 30% for testing. The ANN model, further divided into training, validation (15%), and testing (15%), outperforms others in accuracy and efficiency. This outcome streamlines compressive strength determination in the construction industry, saving time and simplifying the process.

Lead optimization in drug discovery is a crucial phase where initial hits are refined into compounds with improved pharmacological properties. While traditional methods rely on manual experimentation and modifications, AI-driven techniques have revolutionized this process by leveraging big data and predictive modeling. This review explores how AI-driven approaches accelerate lead optimization, showcasing examples like deep neural networks and reinforcement learning. Integration of multi-omic data and experimental validation further enhances AI-driven strategies. The future lies in refining these AI methods, democratizing tools, and interdisciplinary collaboration to streamline drug discovery and address medical needs efficiently.

Recurrent neural networks (RNNs) transmit information over time through recurrent connections. In contrast, biological neural networks use many other temporal processing mechanisms. One of these mechanisms is the inter-neuron delays caused by varying axon properties. Recently, this feature was implemented in echo state networks (ESNs), a type of RNN, by assigning spatial locations to neurons and introducing distance-dependent inter-neuron delays. These delays were shown to significantly improve ESN task performance. However, thus far it is still unclear why distance-based delay networks (DDNs) perform bettern than ESNs. In this paper, we show that by optimizing inter-node delays, the memory capacity of the network matches the memory requirements of the task. As such, networks concentrate their memory capabilities to the points in the past which contain the most information for the task at hand. Moreover, we show that DDNs have more total linear memory capacity, with the same amount of non-linear processing power.

There are several challenges on how to attain energy efficiency while maintaining balance among factors affecting energy consumption such as power rating and temperature setpoints of cooling units, room temperature and humidity, and indoor air quality (IAQ). A real-time energy and IAQ monitoring system were installed in an educational building to profile the operational power consumption of inverter-based air condition unit (ACU) installed in each room. Polynomial curve and neural fitting regression analysis were applied to the real-time power consumption, indoor temperature and humidity, and carbon dioxide (CO2) level data. The derived models were able to provide the stabilizing indoor thermal and air conditions of the room to reach steady state ACU power consumption. These collected data and calculated parameters can be used to define rules in automating control of cooling appliances for an efficient energy utilization. The regression approaches, using real-time data, have determined the influence of indoor heat conditions and carbon dioxide levels on ACU power consumption. These parameters were utilized to establish consistent values for temperature, humidity, and carbon dioxide levels under stable settings of inverter-based air conditioning units.

Memristors are state-of-the-art, nano-sized, two-terminal, passive electronic elements with very good switching and memory characteristics. Owing to their very low power usage and a good compatibility to the existing CMOS ultra-high-density integrated circuits and chips, they are po-tentially applicable in artificial and spiking neural networks, memory arrays, and many other de-vices and circuits for artificial intelligence. In this paper, a complete electronic realization of ana-log circuit model of modified neural net with memristor-based synapses and transfer function with memristors and MOS transistors in LTSPICE is offered. Each synaptic weight is realized by only one memristor, providing enormously reduced circuit complexity. The summing and scaling implementation is founded on op-amps and memristors. The logarithmic-sigmoidal activation function is based on a simple scheme with MOS transistors and memristors. The functioning of the suggested memristor-based neural network for pulse input signals is evaluated both analytically in MATLAB-SIMULINK and in LTSPICE environment. The obtained results are compared one to another and are successfully verified. The realized memristor-based neural network is an im-portant step towards the forthcoming design of complex memristor-based neural networks for ar-tificial intelligence, for implementation in very high-density integrated circuits and chips.

The intricate functionality of the vertebrate retina relies on the interplay between neurotransmitter activity and calcium dynamics, offering important insights into de-velopmental processes, physiological functioning, and disease progression. Neuro-transmitters orchestrate cellular processes to shape the behavior of the retina under diverse circumstances. Despite research to elucidate the roles of individual neuro-transmitters in the visual system, there remains a gap in our understanding of the holistic integration of their interplay with calcium dynamics in the broader context of neuronal development, health, and disease. To address this gap, the present review explores the mechanisms used by the neurotransmitters glutamate, GABA, glycine, dopamine, and acetylcholine and their interplay with calcium dynamics. This con-ceptual outline is intended to inform and guide future research, underpinning novel therapeutic avenues for retinal-associated disorders.

In this paper, we propose a method for assessing the effectiveness of entropy features using several chaotic mappings. We anlyze fuzzy entropy (FuzzyEn) and neural network entropy (NNetEn) on four discrete mappings: the logistic map, the sine map, the Planck map, and the two-memristor-based map, with a base length time series of 300 elements. FuzzyEn is shown to have improved global efficiency (GEFMCC) in the classification task compared to NNetEn. At the same time, there are local areas of the time series dynamics in which the classification efficiency NNetEn is higher than FuzzyEn. The results of using horizontal visibility graphs (HVG) instead of the raw time series are also shown. GEFMCC decreases after HVG time series transformation, but there are local areas of the time series dynamics in which the classification efficiency increases after including the HVG. The scientific community can use the results to explore the efficiency of entropy-based classification of time series.

This work studies the discontinuities features of sedimentary flysch materials in a 100 km2 area belonging to the Basque Arc. Such materials are common in this Spanish Alpine region located in the north of the Iberian Peninsula. A total of 33 outcrops are investigated by an intensive geotechnical investigation including geomechanical stations, boreholes and mechanical laboratory tests. Two flysch units are characterized: the Upper Aguinaga Formation or siliciclastic flysch, and the Lower Itziar Formation or calcareous flysch. Differences between both flysch formation are found. Joints in the siliciclastic flysch formation present an undulated roughness, with a spacing narrower and a persistence lower than in the calcareous flysch formation, which exhibits higher friction angles, although roughness is essentially planar. In addition, the potential of using Artificial Intelligence (AI) techniques, particularly Artificial Neural Networks and Support Vector Machine, to estimate the Geological Strength Index (GSI) from the Rock Quality Design (RQD) and some discontinuities features (spacing, persistence, aperture and roughness) is investigated. AI techniques are found to be satisfactory, being the Support Vector Machine with a linear kernel the technique which achieves the best performance.

Skin cancer is one of the widespread diseases that typically develop on the skin due to continuous exposure to sunlight. Although cancer can appear on any part of the human body, skin cancer reports account for over half of all cancer occurrences worldwide. There are substantial obstacles to the precise diagnosis and classification of skin lesions because of the morphological variety and indistinguishable characteristics across skin malignancies. Recently, Deep Learning models have been used in the field of image-based lesion diagnosis, and it has demonstrated diagnostic efficiency on par with that of dermatologists. To increase classification efficiency and accuracy for skin lesions, a cutting-edge multi-layer deep Convolutional Neural Network (CNN) termed SkinLesNet has been built in this study. The ResNetV50 and VGG16 models have been carefully compared to review the performance of the proposed model. The dataset used in this study, PAD-UFES-20, contains 1314 samples in total and includes three common forms of skin lesions. The proposed approach, SkinLesNet, significantly outperforms the well-known compared models in the given conditions

The models of partial least squares (PLS) regression and artificial neural network (ANN) for evaluation of texture properties of cooked germinated brown rice (GBR) using the Fourier transform near infrared (NIR) spectra of uncooked whole grain combined with data separation methods, spectral pretreatment methods were investigated in this study. The ANN was outperformed in evaluation of hardness by back extrusion test of cooked GBR using the smoothing combined with standard normal variate pretreated NIR spectra in the range of 12,500-4,000 cm−1 of 188 whole grain samples where the calibration sample set was separated from prediction set by Kennard-Stone method where the best ANN model for hardness from hidden layers of 25 and 8 iteration time provided R2, r2, RMSEC, RMSEP, Bias and RPD of 0.9987, 0.9447, 0.1021 N, 0.7699 N, 0.0216 N and 4.3 respectively. The PLS regression of 64 sample KDML GBR group and 64 sample various variety GBR group, provided models for the hardness of the former and the toughness of the latter which developed by using 7506−5446.3, 4605.4−4242.9 cm−1 which included the amylose vibration band of 6834 cm−1 while toughness model was from 9403.8-6094.3 cm−1 where included 6834 and 8316 cm−1 vibration bands of amylose which influenced the texture of cooked rice. The PLS regression models for hardness and toughness were with the r2 of 0.85 and 0.82, and the RPD of 2.9 and 2.4, respectively. The ANN model for hardness of cooked GBR should be implemented to the practical use in GBR production factories for the quality assurance and further updating using more samples and several brands to obtain the robust models.

India ranks among the top ten nations in the world for grape production. Fungal pathogens inflict damage to crop plants in turn making cultivators bear huge economical losses. With an output of 1.21 million tons (about 2% of 57.40 million tons produced globally). 1.2% of the nation’s total fruit cropland is covered by grapes. But due to fungal diseases the effect of the yield produced ranges from 5-80% depending on the severity of diseases which will affect the yield of grape vineyard. In precision agriculture, new sensing technologies and artificial intelligence could be used to automatically identify grapevine and disease pest symptoms. Traditional manual disease-monitoring methods are inefficient, labor-intensive, and ineffective. Timely effective and precise evaluation of grape diseases is admitted as a critical step in the field management. In this paper, we are explaining about different optical sensing methods applied for RGB, Multispectral and Thermal cameras. Section-wise we will be describing environmental set up for image-aquation, data-preprocessing, different modelling methods, evaluation matrix, result, and reviewer’s comment.

Accurate climate data at fine spatial resolution are essential for scientific research and the development and planning of crucial social systems, such as energy and agriculture. Among them, sea surface temperature plays a critical role as the associated El Niño-Southern Oscillation (ENSO) is considered a significant signal of global interannual climate system. In this paper, we propose an implicit neural representation-based interpolation method with temporal information (T_INRI) to reconstruct climate data of high spatial resolution, with sea surface temperature as the research object. Traditional deep learning models for generating high-resolution climate data are only applicable to fixed resolution enhancement scales. In contrast, the proposed T_INRI method is not limited to the enhancement scale provided during the training process and its results indicate that it can enhance low-resolution input by arbitrary scale. Additionally, we discuss the impact of temporal information on the generation of high-resolution climate data, specifically, which month the low-resolution sea surface temperature data is from. Our experimental results indicate that T_INRI is advantageous over traditional interpolation methods under different enhancement scales, and the temporal information can improve T_INRI performance for a different calendar month. We also examined the potential capability of T_INRI in recovering missing grid value. These results demonstrate that the proposed T_INRI is a promising method for generating high-resolution climate data and has significant implications for climate research and related applications.

Deep Neutral Networks (DNNs) were initially proposed towards the midst of the 20th century, motivated by the neural structure and mechanism of the human brain. Thanks to major ad-vancements in computational resources, during the past decade DNN-based systems have demonstrated unprecedented performance in terms of accuracy and speed. However, recent work has shown that such models may not be sufficiently robust during the inference process. Furthermore, due to the data-driven learning nature of DNNs, designing interpretable and gen-eralizable networks is a major challenge, especially in critical applications, such as medical Computer Aided Diagnostics (CAD) and other medical imaging tasks, including classification, regression and reconstruction. Within this context, a line of physics-driven approaches for deep learning has recently emerged, aimed at improving the stability and generalization capacity of DNNs for medical imaging applications. In this paper, we review recent work focused on phys-ics-driven or prior-information learning for a variety of imaging modalities and medical applica-tions. We discuss how the inclusion of domain-related knowledge into the learning process and networks’ design supports their stability and generalization capability. In addition, we highlight current and future challenges within this scope.

Melanoma is widely recognized as one of the most lethal forms of skin cancer, with its incidence showing an upward trend in recent years. Nonetheless, the timely detection of this malignancy substantially enhances the likelihood of patients’ long-term survival. Several computer-based methods have recently been proposed in the pursuit of diagnosing skin lesions at their early stages. Despite achieving some level of success, there still remains a margin of error that the machine learning community considers to be an unresolved research challenge. This study presents a novel framework for the classification of skin lesions. The framework incorporates deep features to generate a highly discriminant feature vector, while also maintaining the integrity of the original feature space. Recent deep models including Darknet53, DenseNet201, InceptionV3, and InceptionResNetV2 are employed in our study for the purpose of feature extraction. Additionally, transfer learning is leveraged to enhance the performance of our approach. In the subsequent phase, the extracted feature information from the chosen pre-existing models is combined, with the aim of preserving maximum information, prior to undergoing the process of feature selection using a novel entropy-controlled grey wolf optimization (ECGWO) algorithm. The integration of fusion and selection techniques is employed to initially incorporate the feature vector with a high level of information and subsequently eliminate redundant and irrelevant feature information. The efficacy of our design is substantiated through the evaluation on three benchmark dermoscopic datasets, namely PH2, ISIC-MSK, and ISIC-UDA. In order to validate the proposed methodology, a comprehensive evaluation is conducted, including a rigorous comparison with established techniques in the field.

An automatic recognizing system of white blood cells can assist hematologists in the diagnosis of many diseases, where accuracy and efficiency are paramount for computer-based system. In this paper, we present a new image processing system to recognize the five types of white blood cells in peripheral blood with marked improvement in efficiency when juxtaposed against mainstream methods. The prevailing deep learning segmentation solutions often utilize millions of parameters to extract high-level image features and neglect the incorporation of prior domain knowledge, which consequently consume substantial computational resources and increase the risk of overfitting, especially when limited medical image samples are available for training. To address these challenges, we propose a novel memory-efficient strategy that exploits graph structures derived from the images. Specifically, we introduce a lightweight superpixel-based Graph Neural Network (GNN) and break new ground by introducing superpixel metric learning to segment nucles and cytoplasm. Remarkably, our proposed segmentation model (SMGNN) achieves state-of-the-art segmentation performance while utilizing at most 10000$\times$ less than the parameters compared to existing approaches. The subsequent segmentation-based cell type classification processes show satisfactory results that such automatic recognizing algorithms are accurate and efficient to execeute in hematological laboratories.

Environmental monitoring systems play a crucial role in assessing environmental quality, detecting limits exceedances, and predicting potential ecological episodes. These systems rely on the measurement of various variables at specific locations and time intervals over an extended period. The concept of environmental monitoring encompasses the assessment of health and safety issues for public and environmental health purposes. Pollution of the atmosphere and water, climate change, and natural disasters are among the consequences of continuous industrial and municipal development and human interference in natural ecosystems. To address these challenges and to protect human lives and the environment, with a special concern on mitigating the ecological effects of industrial development, advanced technical solutions, including the technologies associated with artificial intelligence (artificial neural networks ANNs, machine learning ML) have been developed. These technologies offer powerful tools for analysing the vast amount of data collected by monitoring systems and extracting valuable insights. By applying ANNs and machine learning algorithms, environmental monitoring systems can effectively process and interpret the measured variables to assess environmental quality. Despite challenges and limitations, such as data quality and interpretability of AI models, ongoing research and interdisciplinary collaboration are paving the way for the successful implementation of AI in environmental monitoring, ultimately supporting informed decision-making and sustainable resource management.While several review papers have explored the theory of artificial intelligence (AI), here I aim to review the application of ANNs and ML, in environmental aspects, specifically in automotive and industrial emissions toxicity measurements, as well as atmospheric pollution prevention. By examining the potential of AI in these domains, the paper contributes to understanding the role of advanced technologies in environmental monitoring and protection.

Ageing may be characterized by progressive loss of cognitive function as well as decrease in physical activities, in addition to change in appearance. Previously, we reported that intracerebroventricular transplantation of a human neural stem cell (NSC) line (F3) over-expressing choline acetyltransferase (F3.ChAT) gene, an enzyme responsible for acetylcholine synthesis, markedly improved cognitive function and physical activity of aged animals by enhancing acetylcholine and growth factors (GFs) and neurotrophic factors (NFs). In the present study, 10-month-old F344 rats were intravenously transplanted with F3 or F3.ChAT NSCs (1 x 106 cells) once a month to 21st month of age when the cumulative mortality reached 20%, and physical activity and learning/memory function were investigated, in addition to the analyses of brain acetylcholine concentration, and cholinergic and dopaminergic system restoration. Neuroprotective and neuroregenerative activities of stem cells were also confirmed by analyzing oxidative damages, neuronal skeletal protein, angiogenesis, brain and muscle weights, and proliferating host stem cells. Stem cells markedly improved both the cognitive (passive avoidance and water-maze performances) and physical (locomotor and rota-rod activities) functions, in parallel with the elevation of acetylcholine levels in cerebrospinal fluid and in muscles, in which F3.ChAT cells were superior to F3 parental cells. Stem cell transplantation down-regulated CCL11, leading to restoration of microtubule-associated protein 2 as well as functional markers of cholinergic and dopaminergic systems, and preserved brain and muscular capillaries, recovering muscle mass. In addition, stem cells enhanced antioxidative capacity, attenuating oxidative damage of multiple organs including muscles and the brain. The results indicate that NSCs over-expressing ChAT gene improve cognitive function and physical activity of ageing animals by protecting and recovering functions of multiple organs including cholinergic and dopaminergic systems as well as muscles from oxidative injuries through secretion of acetylcholine and GFs/NFs, increased antioxidant elements, and enhanced blood flow.

An approach to the implementation of neural network for real-time cryptographic data protection with symmetric keys oriented on embedded systems is presented. This approach is valuable especially for onboard communication systems in unmanned aerial vehicles (UAV) because of suitability to hardware implementation. In this study we evaluate the possibility to build such a system in hardware implementation at FPGA. The proposed integrated neural network approach for real-time cryptographic data protection was based on theoretical foundations of neural network cryptographic data protection, new algorithms and structures of neural network data encryption and decryption, modern hardware components with programmable structure. The development and implementation of the on-board neural network system for cryptographic data protection in real-time are based on the following principles: variable composition of equipment; modularity; conveyorization and spatial parallelism; hardware and software modification and making them suitable for data encryption and decryption. The tabular-algorithmic method for calculation of the scalar product has been improved that makes it possible to perform fast calculation of the scalar product of fixed-point and floating-point input data by bringing them to the largest common order of weights and forming tables of macro-partial products. Components of neural network cryptographic data encryption and decryption have been developed on the processor core supplemented by specialized scalar product calculation modules. The specialized hardware for neural network cryptographic data encryption was developed using VHDL for equipment programming in the Quartus II development environment ver. 13.1 and the appropriate libraries, and implemented on the basis of the FPGA EP3C16F484C6 Cyclone III family.

This comprehensive review unfolds a detailed narrative of Artificial Intelligence (AI) making its foray into radiology, a move that is catalysing transformational shifts in the healthcare landscape. It sheds light on the journey of radiology, from the pioneering discovery of X-rays to today’s intricate imaging technologies, infused with machine learning and deep learning in medical image analysis. At the crux of this review lies an in-depth study of AI applications in radiology, elucidating its seminal roles in image segmentation, computer-aided diagnosis, predictive analytics, and workflow optimisation. A spotlight is cast on the profound impact of AI on diagnostic processes, personalised medicine, and clinical workflows, with empirical evidence derived from a series of case studies across multiple medical disciplines. However, the integration of AI in radiology is not devoid of challenges. The review ventures into the labyrinth of obstacles that are inherent to AI-driven radiology — data quality, the ’black box’ enigma, infrastructural and technical complexities, as well as ethical implications. Peering into the future, the review contends that the road ahead for AI in radiology is paved with promising opportunities. It advocates for continuous research, embracing avant-garde imaging technologies, and fostering robust collaborations between radiologists and AI developers. It concludes by firmly cementing the role of AI as a catalyst for change in radiology, a stance that is firmly rooted in sustained innovation, dynamic partnerships, and a steadfast commitment to ethical responsibility.

The prompt and accurate diagnosis of breast lesions, including the distinction between cancer, non-cancer, and suspicious cancer, plays a crucial role in the prognosis of breast cancer. In this paper, we introduce a novel method based on feature extraction and reduction for detection of breast cancer in mammography images. First, we extract features from multiple pre-trained convolutional neural network (CNN) models, and then concatenate them. The most informative features are selected based on their mutual information with the target variable. Subsequently, the selected features can be classified using a machine learning algorithm. We evaluate our approach using four different machine learning algorithms, and our results demonstrate that the neural network-based classifier yields an accuracy as high as 92% for the RSNA dataset which is a new dataset that provides two views and additional features such as age. We compare our proposed algorithm with state-of-the-art methods and demonstrate its superiority, particularly in terms of accuracy and sensitivity. For the MIAS dataset, we achieve an accuracy as high as 94.5%, and for the DDSM dataset, an accuracy of 96% is attained. These results highlight the effectiveness of our method in accurately diagnosing breast lesions and surpassing existing approaches.

The main goal of the paper is to use a generalized proportional Riemann-Liouville fractional derivative (GPRLFD) to model BAM neural networks and to study some stability properties of the equilibrium. Initially, several properties of the GPRLFD are proved such as the fractional derivative of a squared function. Also some comparison results for GPRLFD are provided. Two types of equilibrium of the BAM model with GPRLFD are defined. In connection with the applied fractional derivative and its singularity at the initial time the Mittag-Leffler exponential stability in time of the equilibrium is introduced and studied. An example is given illustrating the meaning of the equilibrium as well as its stability properties.

Geometrical assessments of human skull have been done based on the anatomical landmarks. Automatic detection of the landmarks, if developed, will be a great help not only medically, but also anthropologically. An automated system with multi-phased deep learning networks to predict three-dimensional coordinate values of cranio-facial landmarks, was developed. From a publicly available database, computed tomography images of craniofacial area were obtained. They were digitally reconstructed into three-dimensional models. Sixteen anatomical landmarks were plotted on each of the models and coordinate values of them were recorded. Three-phased regression deep learning networks were trained respectively with 90 training datasets. For evaluation, 30 testing datasets were employed. Three-dimensional error for the first phase, testing 30 data, was 11.60 pixels in average. (1 pixel = 500 / 512 mm) For the second phase, it was significantly improved to 4.66 pixels. For the third phase, it was significantly progressed to 2.88. This was comparable to the gaps between the landmarks, plotted by two experienced practitioners. Our proposing method of multi-phased prediction, coarse detection first and narrowing down the detection area, may be a possible solution, within the physical limitation of memory and computation.

Deepfakes are manipulated or altered images, or video, that are created using deep learning models with high levels of photorealism. The two popular methods of producing a deepfake are based on either convolutional neural networks (CNN), or autoencoders. Deepfakes created using CNN comparatively show higher qualities of realism, yet oftentimes leave artifacts and distortions in the generated media that can be detected using machine learning and deep learning algorithms. In recent years, there has been an influx of periocular image and video data because of the increase usage of face masks. By wearing masks, much of what is used for facial recognition is hidden, leaving only the periocular region visible to an observer. This loss of vital information leads to easier misidentification of media, allowing deepfakes to less likely be identified as fake. In this work, feature extraction methods, such as Scale-Invariant Feature Transform (SIFT), Histogram of Oriented Gradients (HOG), and CNN, are used to train an ensemble deep learning model to detect deepfakes in videos on a frame-by-frame level based on the periocular region. Our proposed model is able to distinguish original and manipulated images with accuracies around 98.9 percent, which is an improvement to previous works by combining SIFT and HOG for deepfake detection in convolutional neural networks.

Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. In this study, we developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to analyze relevant free-text colonoscopy reports, including indications, pathology, and findings notes. The Bio-Bi-LSTM-CRF framework was developed using Bidirectional Long Short-term Memory (Bi-LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free-text reports, including indications for the colonoscopy, findings during the colonoscopy, and pathology of the resected material. We then trained the Bio-Bi-LSTM-CRF and existing Bi-LSTM-CRF models on 80% of 4,000 manually annotated notes obtained from the colonoscopy reports of 3,867 patients. The clinical notes were from a group of patients aged over 40 years old enrolled in four Veterans Affairs Medical Centers. A total of 10% of the remaining annotated notes were used to train hyperparameter, while the remaining 10% were used to evaluate the accuracy of our model (Bio-Bi-LSTM-CRF) and to compare the results with the outcomes obtained using Bi-LSTM-CRF. The results of our experiments showed that the bidirectional encoder representations by integrating dictionary function vector from Bio-Bi-LSTM-CRF and strategies character sequence embedding approach is an effective way to identify colonoscopy features from EHR-extracted clinical notes. Therefore, the Bio-Bi-LSTM-CRF model is concluded to be capable of creating new opportunities to identify patients at risk for colon cancer and to study their health outcomes.

A phenotype is the composite of an observable expression of a genome for traits in a given environment. The trajectories of phenotypes computed from an image sequence and timing of important events in a plant’s life cycle can be viewed as temporal phenotypes and indicative of the plant’s growth pattern and vigor. In this paper, we introduce a novel method called FlowerPhenoNet which uses deep neural networks for detecting flowers from multiview image sequences for high throughput temporal plant phenotyping analysis. Following flower detection, a set of novel flower-based phenotypes are computed, e.g., the day of emergence of the first flower in a plant’s life cycle, the total number of flowers present in the plant at a given time, the highest number of flowers bloomed in the plant, growth trajectory of a flower and the blooming trajectory of a plant. To develop a new algorithm and facilitate performance evaluation based on experimental analysis, a benchmark dataset is indispensable. Thus, we introduce a benchmark dataset called FlowerPheno which comprises image sequences of three flowering plant species, e.g., sunflower, coleus, and canna, captured by a visible light camera in a high throughput plant phenotyping platform from multiple view angles. The experimental analyses on the FlowerPheno dataset demonstrate the efficacy of the FlowerPhenoNet.

The environmental issues we are currently facing require long-term prospective efforts for sustainable growth. Renewable energy sources seem to be one of the most practical and efficient alternatives in this regard. Understanding a nation's pattern of energy use and renewable energy production is crucial for developing strategic plans. No previous study has been performed to explore the dynamics of power consumption with the change in renewable energy production on a country-wide scale. In contrast, a number of deep learning algorithms demonstrated acceptable performance while handling sequential data in the era of data-driven predictions. In this study, we developed a scheme to investigate and predict total power consumption and renewable energy production time series for eleven years of data using a Recurrent Neural Network (RNN). The dynamics of the interaction between the total annual power consumption and renewable energy production are investigated through extensive Exploratory Data Analysis (EDA) and a feature engineering framework. The performance of the model is found satisfactory through the comparison of the predicted data with the observed data, visualization of the distribution of the errors and Root Mean Squared Error (RMSE) value of 0.084. Higher performance is achieved through the increase in the number of epochs and hyperparameter tuning. The proposed framework can be used and transferred to investigate the trend of renewable energy production and power consumption and predict the future scenarios for different communities. Incorporation of the cloud-based platform into the proposed pipeline may lead to real-time forecasting.

Deep neural networks (DNN) have successfully delivered a cutting-edge performance in several fields. With the broader deployment of DNN models on critical applications, the security of DNNs becomes an active and yet nascent area. Attacks against DNNs can have catastrophic results, according to recent studies. Poisoning attacks, including backdoor and Trojan attacks, are one of the growing threats against DNNs. Having a wide-angle view of these evolving threats is essential to better understand the security issues. In this regard, creating a semantic model and a knowledge graph for poisoning attacks can reveal the relationships between attacks across intricate data to enhance the security knowledge landscape. In this paper, we propose a DNN Poisoning Attacks Ontology (DNNPAO) that would enhance knowledge sharing and enable further advancements in the field. To do so, we have performed a systematic review of the relevant literature to identify the current state. We collected 28,469 papers from IEEE, ScienceDirect, Web of Science, and Scopus databases, and from these papers, 712 research papers were screened in a rigorous process, and 55 poisoning attacks in DNNs were identified and classified. We extracted a taxonomy of the poisoning attacks as a scheme to develop DNNPAO. Subsequently, we used DNNPAO as a framework to create a knowledge base. Our findings open new lines of research within the field of AI security.

Free-space communication is a leading component in global communications. Its advantages relate to a broader signal spread, no wiring, and ease of engagement. Satellite communication services became recently attractive to mega-companies that foresee an excellent opportunity to connect disconnected remote regions, serve emerging machine-to-machine communication, Internet-of-things connectivity, and more. Satellite communication links suffer from arbitrary weather phenomena such as clouds, rain, snow, fog, and dust. In addition, when signals approach the ground station, it has to overcome buildings blocking the direct access to the ground station. Therefore, satellites commonly use redundant signal strength to ensure constant and continuous signal transmission, resulting in excess energy consumption, challenging the limited power capacity generated by solar energy or the fixed amount of fuel. This research proposes LTSM, an artificial recurrent neural network technology that provides a time-dependent prediction of the expected attenuation level due to rain and fog and the signal strength that remained after crossing physical obstacles surrounding the ground station. The satellite transmitter is calibrated accordingly. The satellite outgoing signal strength is based on the predicted signal strength to ensure it will remain strong enough for the ground station to process it. The instant calibration eliminates the excess use of energy resulting in energy savings.

The aim of this study was to build a tool to analyze, using artificial intelligence, the sentiment perception of users who answered two questions from the CSQ – 8 questionnaires with raw Spanish free-text. Their responses are related to mindfulness, which is a novel technique used to control stress and anxiety caused by different factors in daily life. As such, we proposed an online course where this method was applied in order to improve the quality of life of health care professionals in COVID 19 pandemic times. We also carried out an evaluation of the satis-faction level of the participants involved, with a view to establishing strategies to improve fu-ture experiences. To automatically perform this task, we used Natural Language Processing (NLP) models such as swivel embedding, neural networks and transfer learning, so as to classify the inputs into the following 3 categories: negative, neutral and positive. Due to the lim-ited amount of data available - 86 registers for the first and 68 for the second - transfer learning techniques were required. The length of the text had no limit from the user’s standpoint, and our approach attained a maximum accuracy of 93.02 % and 90.53 % respectively based on ground truth labeled by 3 experts. Finally, we proposed a complementary analysis, using com-puter graphic text representation based on word frequency, to help researchers identify relevant information about the opinions with an objective approach to sentiment. The main conclusion drawn from this work is that the application of NLP techniques in small amounts of data using transfer learning is able to obtain enough accuracy in sentiment analysis and text classification stages

Pervasive and wide-ranging cognitive deficits are a core feature of schizophrenia and an important determinant of long-term functional outcome. The lack of sufficiently effective treatments for cognitive impairment associated with schizophrenia (CIAS) represents a major unmet need and a central roadblock towards recovery. This is partly due to the current therapeutic focus on clinical symptoms, and the relative neglect of cognitive impairments despite their functionally disabling effects. Furthermore, effective treatment is impeded by our limited knowledge of the complex pathophysiology, which gives rise to perturbed information processing. Here, we review mechanisms and effectiveness of available pharmacological and non-pharmacological treatments for CIAS. Current evidence indicates, that while techniques which broadly enhance neural plasticity show the greatest therapeutic potential, effect sizes are at best moderate. Among other reasons, this is due to a considerable heterogeneity of responses to individual interventions. Furthermore, we discuss how recent conceptual advances in operationalizing cognitive impairments based on cognitive neuroscience have the potential to address these issues and facilitate the development of novel treatment strategies for CIAS. This includes more clearly elucidating pathophysiological mechanisms in both humans and animal models, identifying new treatment targets as well as establishing biomarkers for a better prediction of treatment responses.

This review covers some of the central relationships between artificial intelligence, psychology, and economics through the lens of information theory, specifically focusing on formal models of decision-theory. In doing so we look at a particular approach that each field has adopted and how information theory has informed the development of the ideas of each field. A key theme is expected utility theory, its connection to information theory, and the Bayesian approach to decision-making and forms of (bounded) rationality. What emerges from this review is a broadly unified formal perspective derived from three very different starting points that reflect the unique principles of each field. Each of the three approaches reviewed can, in principle at least, be implemented in a computational model in such a way that, with sufficient computational power, they could be compared with human abilities in complex tasks. However, a central critique that can be applied to all three approaches was first put forward by Savage in {\it The Foundations of Statistics} and recently brought to the fore by the economist Binmore: Bayesian approaches to decision-making work in what Savage called `small worlds' but cannot work in `large worlds'. This point, in various different guises, is central to some of the current debates about the power of artificial intelligence and its relationship to human-like learning and decision-making. Recent work on artificial intelligence has gone some way to bridging this gap but significant questions still need to be answered in all three fields in order to make progress on these problems.

Automated machine learning (AutoML) has been heralded as the next wave in artificial intelligence with its promise to deliver high performance end-to-end machine learning pipelines with minimal effort from the user. However, despite AutoML showing great promise for computer vision tasks, to the best of our knowledge, no study has used AutoML for image-based plant phenotyping. To address this gap in knowledge, we examined the application of AutoML for image-based plant phenotyping using wheat lodging assessment with UAV imagery as an example. We compared the performance of an open-source AutoML framework, AutoKeras in image classification and regression tasks to transfer learning using modern convolutional neural network (CNN) architectures. For image classification which classified plot images as lodged or non-lodged, transfer learning with Xception and DenseNet-201 achieved best classification accuracy of 93.2%, whereas Autokeras had 92.4% accuracy. For image regression which predicted lodging scores from plot images, transfer learning with DenseNet-201 had the best performance (R2=0.8303, RMSE=9.55, MAE=7.03, MAPE=12.54%), followed closely by AutoKeras (R2=0.8273, RMSE=10.65, MAE=8.24, MAPE=13.87%). Interestingly, in both tasks, AutoKeras models had up to 40-fold faster inference times compared to the pretrained CNNs. The merits and drawbacks of AutoML compared to transfer learning for image-based plant phenotyping are discussed.

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current Neural Network (NN) powered AI-KWS pipelines has remained ever present. This paper evaluates KWS utilizing a learning automata powered machine learning algorithm called the Tsetlin Machine (TM). Through significant reduction in parameter requirements and choosing logic over arithmetic based processing, the TM offers new opportunities for low-power KWS while maintaining high learning efficacy. In this paper we explore a TM based keyword spotting (KWS) pipeline to demonstrate low complexity with faster rate of convergence compared to NNs. Further, we investigate the scalability with increasing keywords and explore the potential for enabling low-power on-chip KWS.

Cold chain logistics of Agricultural Products demand forecasting can provide the scientific basis for the country to formulate logistics strategy, which further promotes the development of social economy and the improvement of living standards in China. In this paper, a new mathematical combined model is proposed to Agricultural Products Demand. Shandong, one of a China’s province, serves as the main producer and distributor of agricultural products. Based on the index system created from multiple related factors influencing cold chain logistics demand of agricultural products in Shandong, this paper employs principal component analysis to reduce the dimension of various indexes and predicts principal components with time series. Thereafter, multiple linear regression model and neural network model were constructed to forecast the cold chain logistics demand of agricultural products in Shandong, and their combined forecast models were compared. What's more, the paper provides insight for reference and decision-making concerning the development of cold chain logistics industry of agricultural products in Shandong province.

New experimental and clinical findings question the historic view of hydrocephalus and its 100-year-old classification. In particular, real-time MRI evaluation of CSF flow and detailed insights into brain water regulation on the molecular scale indicate the existence of at least three main mechanisms that determine the dynamics of neurofluids. (i) Inspiration is a major driving force (ii) Adequate filling of brain ventricles by balanced cerebrospinal fluid upsurge is sensed by cilia (iii) The perivascular glial network connects the ependymal surface to the pericapillary Virchow-Robin spaces. Hitherto, these aspects have not been considered a common physiologic framework improving knowledge and therapy for severe disorders of normal-pressure and post-haemorrhagic hydrocephalus, spontaneous intracranial hypotension and spaceflight disease.

We present and benchmark FilterNet, a flexible deep learning architecture for time series classification tasks, such as activity recognition via multichannel sensor data. It adapts popular CNN and CNN-LSTM motifs which have excelled in activity recognition benchmarks, implementing them in a many-to-many architecture to markedly improve frame-by-frame accuracy, event segmentation accuracy, model size, and computational efficiency. We propose several model variants, evaluate them alongside other published models using the Opportunity benchmark dataset, demonstrate the effect of model ensembling and of altering key parameters, and quantify the quality of the models’ segmentation of discrete events. We also offer recommendations for use and suggest potential model extensions. FilterNet advances the state of the art in all measured accuracy and speed metrics on the benchmarked dataset, and it can be extensively customized for other applications.

Cognitive deterioration caused by illness or aging often occurs before symptoms arise, and their timely diagnosis is crucial to reducing its medical, personal, and societal impacts. Brain-Computer Interfaces (BCIs) stimulate and analyze key cerebral rhythms, enabling reliable cognitive assessment that can accelerate diagnosis. The BCI system presented analyzes Steady-State Visually Evoked Potentials (SSVEPs) elicited in subjects of varying age to detect cognitive aging, predict its magnitude, and identify its relationship with SSVEP features (band power and frequency detection accuracy), which were hypothesized to indicate cognitive decline due to aging. The BCI system was tested with subjects of varying age to assess its ability to detect aging-induced cognitive deterioration. Rectangular stimuli flickering at theta, alpha, and beta frequencies were presented to subjects, and frontal and occipital EEG responses were recorded. These were processed to calculate detection accuracy for each subject and calculate SSVEP band power. A neural network was trained using the features to predict cognitive age. The results showed potential cognitive deterioration through age-related variations in SSVEP features. Frequency detection accuracy declined after age group 20–40 and band power, throughout all age groups. SSVEPs generated at theta and alpha frequencies, especially 7.5 Hz, were the best indicators of cognitive deterioration. Here, frequency detection accuracy consistently declined after age group 20-40 from an average of 96.64% to 69.23%. The presented system can be used as an effective diagnosis tool for age related cognitive decline.

Reemergence of deep Neural Networks (CNNs) has lead to high-performance supervised learning algorithms for the Electro-Optical (EO) domain classification and detection problems. This success is possible because generating huge labeled datasets has become possible using modern crowdsourcing labeling platforms such as Amazon Mechanical Turk that recruit ordinary people to label data. Unlike the EO domain, labeling the Synthetic Aperture Radar (SAR) domain data can be a lot more challenging and for various reasons using crowdsourcing platforms is not feasible for labeling the SAR domain data. As a result, training deep networks using supervised learning is more challenging in the SAR domain. In the paper,we present a new framework to train a deep neural network for classifying Synthetic Aperture Radar (SAR) images by eliminating the need for huge labeled dataset. Our idea is based on transferring knowledge from a related EO domain problem, where labeled data is easy to obtain. We transfer knowledge from the EO domain through learning a shared invariant cross-domain embedding space that is also discriminative for classification. To this end, we train two deep encoders that are coupled through their last year to map data points from the EO and the SAR domains to the shared embedding space such that the distance between the distributions of the two domains is minimized in the latent embedding space. We use the Sliced Wasserstein Distance (SWD) to measure and minimize the distance between these two distributions and use a limited number of SAR label data points to match the distributions class-conditionally. As a result of this training procedure, a classifier trained from the embedding space to the label space using mostly the EO data would generalize well on the SAR domain. We provide theoretical analysis to demonstrate why our approach is effective and validate our algorithm on the problem of ship classification in the SAR domain by comparing against several other learning competing approaches.

In the current natural environment, due to the complexity of the background and the high similarity of the color between immature green tomato and plant, the occlusion of the key organs (flower and fruit) by the leaves and stems will lead to low recognition rate and poor generalization of the detection model. Therefore, an improved tomato organ detection method based on convolutional neural network has been proposed in this paper. Based on the original Faster R-CNN algorithm, Resnet-50 with residual blocks was used to replace the traditional vgg16 feature extraction network, and K-means clustering method was used to adjust more appropriate anchor size than manual setting to improve detection accuracy. A variety of data augmentation techniques were used to train the network. The test results showed that compared with the traditional Faster R-CNN model, the mean average precision (mAP) of the optimal model was improved from 85.2% to 90.7%, the memory requirement decreased from 546.9MB to 115.9 MB, and the average detection time was shortened to 0.073S/sheet. As the performance greatly improved, the training model can be transplanted to the embedded system, which lays a theoretical foundation for the development of precise targeting pesticide application system and automatic picking device.

To build a representation of what we see, the human brain recruits regions throughout the visual cortex in cascading sequence. Recently, an approach was proposed to evaluate the dynamics of visual perception in high spatiotemporal resolution at the scale of the whole brain. This method combined functional magnetic resonance imaging (fMRI) data with magnetoencephalography (MEG) data using representational similarity analysis and revealed a hierarchical progression from primary visual cortex through the dorsal and ventral streams. To assess the replicability of this method, here we present results of a visual recognition neuro-imaging fusion experiment, and compare them within and across experimental settings. We evaluated the reliability of this method by assessing the consistency of the results under similar test conditions, showing high agreement within participants. We then generalized these results to a separate group of individuals and visual input by comparing them to the fMRI-MEG fusion data of Cichy et al. (2016), revealing a highly similar temporal progression recruiting both the dorsal and ventral streams. Together these results are a testament to the reproducibility of the fMRI-MEG fusion approach and allows for the interpretation of these spatiotemporal dynamic in a broader context.

We introduce a modelling framework for the investigation of on-line machine learning processes in non-stationary environments. We exemplify the approach in terms of two specific model situations: In the first, we consider the learning of a classification scheme from clustered data by means of prototype-based Learning Vector Quantization (LVQ). In the second, we study the training of layered neural networks with sigmoidal activations for the purpose of regression. In both cases, the target, i.e. the classification or regression scheme, is considered to change continuously while the system is trained from a stream of labeled data. We extend and apply methods borrowed from statistical physics which have been used frequently for the exact description of training dynamics in stationary environments. Extensions of the approach allow for the computation of typical learning curves in the presence of concept drift in a variety of model situations. First results are presented and discussed for stochastic drift processes in classification and regression problems. They indicate that LVQ is capable of tracking a classification scheme under drift to a non-trivial extent. Furthermore, we show that concept drift can cause the persistence of sub-optimal plateau states in gradient based training of layered neural networks for regression.

Parmigiano Reggiano cheese is one of the most appreciated and consumed food worldwide, especially in Italy, for its high content of nutrients and for its taste. However, these characteristics make this product subject to counterfeiting in different forms. In this study, a novel method based on an electronic nose has been developed in order to investigate the potentiality of this tool to distinguish rind percentage in grated Parmigiano Reggiano packages that should be lower than 18%. Different samples in terms of percentage, seasoning and rind working process were considered to tackle the problem at 360°. In parallel, GC-MS technique was used to give a name to the compounds that characterize Parmigiano and to relate them with sensors responses. Data analysis consisted of two stages: multivariate analysis (PLS) and classification made in a hierarchical way with PLS-DA ad ANNs. Results are promising in terms of correct classification of the samples. The classification rate is higher for ANNs than PLS-DA, reaching also 100% values.

Object segmentation on remotely-sensed images: aerial (or very high resolution, VHS) images and satellite (or high resolution, HR) images, has been applied to many application domains, especially road extraction in which the segmented objects are served as a mandatory layer in geospatial databases. Several attempts in applying deep convolutional neural network (DCNN) to extract roads from remote sensing images have been made; however, the accuracy is still limited. In this paper, we present an enhanced DCNN framework specifically tailored for road extraction on remote sensing images by applying landscape metrics (LMs) and conditional random fields (CRFs). To improve DCNN, a modern activation function, called exponential linear unit (ELU), is employed in our network resulting in a higher number of and yet more accurate extracted roads. To further reduce falsely classified road objects, a solution based on an adoption of LMs is proposed. Finally, to sharpen the extracted roads, a CRF method is added to our framework. The experiments were conducted on Massachusetts road aerial imagery as well as THEOS satellite imagery data sets. The results showed that our proposed framework outperformed Segnet, the state-of-the-art object segmentation technique on any kinds of remote sensing imagery, in most of the cases in terms of precision, recall, and F1.

In this article, the research team has systematically developed a method to model the kinematics and dynamics of a 3-wheeled robot subjected to external disturbances and sideways wheel sliding. These models will be used to design control laws that compensate for wheel slippage, model uncertainties, and external disturbances. These are control algorithms developed based on Dynamic Surface Control (DSC). Adaptive trajectory tracking DSC algorithm using fuzzy logic system (AFDSC) and radial neural network (RBFNN) with fuzzy logic system to overcome the disadvantages of DSC and expand the application domain for wheeled Mobile Robots (WMR). However, this Adaptive Fuzzy Neural Network Dynamic Surface Control (AFNNDSC) adaptive controller ensures the closed system is stable and follows the preset trajectory in the presence of wheel slippage model uncertainty and is affected by significant amplitude disturbances. The stability and convergence of the closed-loop system are guaranteed based on the Lyapunov analysis. The AFNNDSC adaptive controller is evaluated by simulation on MATLAB/Simulink software and in a steady state. The maximum position error on the right wheel and left wheel is 0.000572 (m) and 0.000523 (m), and the angular velocity tracking error in the right and left wheels of the control method is 0.000394 (rad/s). The experimental results show the correctness of the theoretical analysis, the effectiveness of the proposed controller, and the possibility of practical application.

This paper provides an in-depth comparative analysis of three prominent machine learning techniques: decision trees, neural networks, and Bayesian networks. Each method is explored in terms of its theoretical foundations, algorithmic structure, strengths, limitations, and real-world applications. Decision trees are celebrated for their simplicity and interpretability, making them ideal for decision-making systems, but they often struggle with overfitting and poor performance on high-dimensional data. Neural networks, while capable of achieving high accuracy and effectively handling complex, non-linear patterns, are criticized for their "black-box" nature and computational intensity. Bayesian networks distinguish themselves through their ability to model uncertainty and incorporate prior knowledge, making them highly applicable in scenarios requiring probabilistic reasoning, yet they are challenging to scale for complex, high-dimensional data sets. This comparative analysis highlights the distinctive advantages of each method, their performance across various domains such as healthcare, finance, and risk assessment, and the growing potential of hybrid models that combine the strengths of these techniques. The paper concludes by discussing future research opportunities, particularly in enhancing model interpretability and scalability while addressing domain-specific challenges.

You Only Look One (YOLO) and its variants have emerged as the most popular real-time object detection algorithms. They have been widely used in real-time smart transportation applications due to their low-latency detection and high accuracy. However, because of the diverse characteristics of YOLO models, choosing selecting the optimal model according to various applications and environments in smart transportation is critical. In this article, we conduct an empirical evaluation and analysis study for most YOLO versions to assess their performance in smart transportation. To achieve this, we first measure the average precision of YOLO models across multiple datasets (e.g., COCO, PASCAL VOC). Second, we analyze the performance of YOLO models on multiple object categories within each dataset, focusing on classes relevant to road transportation such as those commonly used in smart transportation applications. Third, multiple intersection-over-union (IoU) thresholds are considered in our performance measurement and analysis. By examining the performance of various YOLO models across datasets, IoU thresholds, and object classes, we make six observations on these three aspects while aiming to identify optimal models for road transportation scenarios. Thus, YOLOv5 and YOLOv8 outperform other models in all three aspects due to their novel performance features. For instance, YOLOv5 achieves stable performance thanks to its cross-stage partial darknet-53 (CSPDarknet53) backbone, auto-anchor mechanism, and efficient loss functions including IoU loss, complete IoU loss, focal loss, gradient harmonizing mechanism loss. Similarly, YOLOv8 outperforms others with its upgraded CSPDarknet53 backbone, anchor-free mechanism, and efficient loss functions like complete IoU loss and distribution focal loss.

Electric vehicles are in focus and growing, with new adoptions every day. Its wide use represents a new scenario and challenge for the electrical power system due to the high charge storage requirements. Predicting these loads using artificial neural networks proves to be a very efficient tool for solving time series. This work uses a multilayer perceptron network through supervised backpropagation training with Bayesian regularization to improve generalization, reducing overfit- ting errors. In this research, the aggregation of the actual consumption of 200 homes and 348 plug-in electric vehicles is used in the training and forecasting process, and to validate the method developed, MAPE was used. Short-term forecasts were made considering the year’s four seasons, predicting the next 24 hours of total aggregate demand from homes and vehicles. The methodology presented significant and relevant results using hybrid training for the problem, with the potential to be applied in the real world.

A contemporary technique for calculating seismic risk is earthquake nowcasting (EN), which analyzes the progression of the earthquake (EQ) cycle in fault systems. 'Natural time' is a novel idea of time that serves as the foundation for EN assessment. The earthquake potential score (EPS), which has been discovered to have useful uses regionally and worldwide, is a unique tool EN uses to predict seismic risk. For the estimation of the EPS for the occurrences with the highest magnitude among these applications, we have since 2021 concentrated on Greece territory, applying sophisticated Artificial Intelligence (AI) algorithms, both wise (semi)supervised and unsupervised models, along with a customized dynamic sliding window technique that performs as a stochastic filter able to fine-tune the geo seismic occurrences. Long short-term memory (LSTM) neural networks, random forests, and clustering (geospatial) models are three machine learning techniques that are particularly good at finding patterns in vast databases and may be used to enhance earthquake prediction performance. In this study, we attempt to forecast whether practical Machine-learning and AI/Game-theoretic-based approaches can help predict big earthquakes and the normal future seismic cycle for 6-12 months. Specifically, we focus on answering two questions for a given region: (1) Is there a chance that a significant earthquake—say, one with a magnitude of M ≥ 6.0 will happen in the upcoming year? (2) What is the largest earthquake magnitude predicted in the upcoming year, and with which exact geographic coordinates (GCS)? Our results are quite promising and project a high precision accuracy score (≥ 98%) for seismic nowcasting in terms of four predictive parameters: the approximate (a) latitude, (b) longitude, (c) focal depth, and (d) magnitude of the phenomena.

Deep learning neural networks require an immense amount of computation, especially in the training phase of the network when networks with multiple layers of intermediate neurons need to be built. In this paper, we will focus on the PSO algorithm with the aim of significantly accelerating the DLNN training phase by taking advantage of the GPGPU architecture and the Apache Spark analytics engine for large-scale data processing tasks. PSO is a bio-inspired stochastic optimization method whose goal is to iteratively improve the solution to a (usually complex) problem by attempting to approximate a given objective. However, parallelizing an efficient PSO is not a straightforward process due to the complexity of the computations performed on the swarm of particles and the iterative execution of the algorithm until a solution close to the objective with minimal error is achieved. In the present work, two parallelizations of the PSO algorithm have been implemented , both designed for a distributed execution environment. The synchronous parallel PSO implementation ensures consistency at the cost of potential idle time due to global synchronization, while the asynchronous parallel PSO approach improves execution time by reducing the need for global synchronization, making it more suitable for large datasets and distributed environments such as Apache Spark. Both variants of PSO have been implemented to distribute the computational load supported by this algorithm –due to the costly fitness evaluation and updating of particle positions– across the different Spark cluster executor nodes to effectively achieve coarse-grained parallelism, resulting in a significant performance increase over current sequential variants of PSO.

Gastric cancer is the fifth most common and fourth deadliest cancer worldwide, with a bleak 5-year survival rate of about 20%. Despite significant research into its pathobiology, prognostic predictability remains insufficient due to pathologists’ heavy workloads and the potential for diagnostic errors. Consequently, there is a pressing need for automated and precise histopathological diagnostic tools. This study leverages Machine Learning and Deep Learning techniques to classify histopathological images into healthy and cancerous categories. By utilizing both handcrafted and deep features and shallow learning classifiers on the GasHisSDB dataset, we conduct a comparative analysis to identify the most effective combinations of features and classifiers for differentiating normal from abnormal histopathological images without employing fine-tuning strategies. Our methodology achieves an accuracy of 95% with the SVM classifier, underscoring the effectiveness of feature fusion strategies. Additionally, cross-magnification experiments produced promising results with accuracies close to 80% and 90% when testing the models on unseen testing images with different resolutions.

A significant challenge encountered in mmWave and Sub-terahertz systems used in 5G and 1 the upcoming 6G networks is the rapid fluctuation in signal quality across various beam directions. Extremely high-frequency waves are highly vulnerable to obstruction, making even slight adjustments in device orientation or the presence of blockers capable of causing substantial fluctuations in link quality along a designated path. This issue poses a major obstacle because numerous applications with low-latency requirements necessitate precise forecasting of network quality from many directions and cells. The method that is proposed in this research demonstrates an avant-garde approach for assessing the quality of multi-directional connections in mmWave systems by utilizing the Liquid Time Constant network (LTC) instead of the conventionally used Long Short-Term Memory (LSTM) technique. The method’s validity was tested through an optimistic simulation involving the monitoring of multi-cell connections at 28 GHz in a scenario where humans and various obstructions were moving arbitrarily. The results with LTC are significantly better than those obtained by conventional approaches such as LSTM. The latter resulted in a test Root Mean Squared Error (RMSE) of 3.44 dB, while the former, 0.25 dB, demonstrating a 13-fold improvement. For better interpretability and to illustrate the complexity of prediction, an approximate mathematical expression is also fitted to the simulated signal data using Symbolic Regression.

Power quality (PQ) plays an important role in ensuring the smooth operation of power systems. PQ disturbances may cause significant consequences, impacting the reliability and efficiency of power networks. This paper presents a comprehensive review of PQ within smart grids and the integration of renewable energy sources. Methods of detecting, classifying, optimizing, and mitigating PQ events are reviewed with providing a brief theoretical explanation for each technique. Related work done in the past two decades, was conducted, presenting a clear view of the development of research in a chronological order serving as a guide for future investigations in this field of study.

An innovative concrete that incorporates the advantages of self-compacting concrete with geopolymer is called self-compacting geopolymer concrete. The objective of this study was the Manufacturing of M30-grade self-compacting geopolymer concrete by adding industrial materials like fly ash (FA), ultrafine ground granulated blast furnace slag (UFGGBS), and silica fume (SF) as minerals. The disposal of these industrial wastes can be substantially overcome, as they lead to land pollution. The fixed powder content was 500 kg/m³. A mixture of sodium silicate (Na₂SiO₃) and sodium hydroxide (NaOH) created an alkaline solution that activated the cementitious binders. In this study, slump flow, L-box, V Funnel, T50 V Funnel, and J ring tests were carried out to determine the fresh qualities of the concrete. These tests were conducted under the regulations for self-compacting concrete provided by EFNARC (2005). To improve the flexural strength of the SCGC, 1.5 % glass fibre was added. This study illustrates how an artificial neural network (ANN) model can determine the concrete mix proportion. The characteristics of SCGC, both fresh and hardened properties test were investigated for molarities of 8, 10, and 12. The microstructural outcomes were determined using Fourier-transform infrared spectroscopy (FT-IR), scanning electron microscopy (SEM), and X-ray diffraction (XRD).

ABSTRACT Purpose: Tongue image analysis for disease diagnosis is an ancient traditional non-invasive diagnosis technique widely used by traditional medicine practitioners. Deep Learning based multi-label disease detection models offer tremendous potential to clinical decision support systems, by facilitating preliminary diagnosis. Methods: In this work, we propose a multi-label disease detection pipeline, where in observation and analysis of tongue images captured and received via smartphones assist in predicting the health status of an individual. All images are voluntarily given by subjects consulting collaborating physicians. Images thus acquired are first and foremost classified either into a diseased or a normal category by a 5-fold cross-validation algorithm using a convolution neural network (MobileNetV2) model for binary classification. Once the diseased label is predicted, the image is used to diagnose multiple diseases using the prediction algorithm based on DenseNet121. Results: Average accuracy of 93 % was achieved in classifying diseased from normal healthy tongue by detection model with MobileNetV2 architecture. Multilabel disease classification produced more than 90% accurate results for the seven class labels considered. Conclusion: AI based image analysis shows promising results and an extensive dataset could provide further improvements to this approach. Rather than employing high-cost sophisticated image capturing setup, experimenting with smartphone images opens opportunity to provide preliminary health status to individuals on smartphone prior to further line of treatment and diagnosis.

The objective of this study is to determine the relationship between body condition score (BCS) and body carcass fat (BCF) of ewes at two key stages of the production cycle. Data were collected from 88 Coopworth ewes including BCS measurements manually evaluated by the farm manager, BCF measurements determined by computerized tomography (CT) and body parameter measurements automatically determined by an image processing application. Artificial neural network (ANN) statistical analysis method was used to develop a relationship between the body parameters and the BCF with an r2=0.96 and RMSE=1.01 using all top and side variables.

Deep learning (DL) algorithms used for DOTATATE PET lesion detection typically require large, well-annotated training datasets. These are difficult to obtain due to low incidence of gastroenteopancreatic neuroendocrine tumors (GEP-NETs), and the high cost of manual annotation. Furthermore, networks trained and tested with data acquired from site specific PET/CT instrumentation, acquisition and processing protocols have reduced performance when tested with offsite data. This lack of generalizability requires even larger, more diverse training datasets. The objective of this study is to investigate the feasibility of improving DL algorithm performance by better matching the background noise in training datasets to higher noise, out-of-domain testing datasets. 68Ga-DOTATATE PET/CT datasets were obtained from two scanners: Scanner1, a state-of-the-art digital PET/CT (GE DMI PET/CT; n=83 subjects), and Scanner2, an older-generation analog PET/CT (GE STE; n=123 subjects). Set1, the data set from Scanner1 was reconstructed with standard clinical parameters (5 minutes; Q.Clear) and list-mode reconstructions (VPFXS 2, 3, 4, and 5-minutes). Set2, data from Scanner2, representing out-of-domain clinical scans, used standard iterative reconstruction (5 minutes; OSEM). Reconstructed datasets were divided into training, validation, and testing datasets in a 60%, 20%, 20% proportion, and a deep neural network was trained with each: Network1 for Scanner1 and Network2 for Scanner2. DL performance (Network1) was tested with out-of-domain test data (Set2). To evaluate the effect of training sample size, we tested DL model performance using a fraction (25%, 50%, and 75%) of Set1 for training. Scanner1, list-mode 2-minute reconstructed data demonstrated the most similar noise level compared that of Set2, resulting in the best performance (F1=0.713). This was not significantly different compared to the highest performance, upper-bound limit using in-domain training for Network2 (F1=0.755; p-value=0.103). Regarding sample size, the F1 score significantly increased from 25% training data (F1=0.478) to 100% training data (F1=0.713; p<0.001). List-mode data from modern PET scanners can be reconstructed to better match the noise properties of older scanners. Using existing data and their associated annotations dramatically reduces the cost and effort in generating these datasets, and significantly improves the performance of existing DL algorithms. List-mode reconstructions can provide an efficient, low-cost method to improve DL algorithm generalizability.

High-rise building machines (HBMs) play a critical role in the successful construction of super-high skyscrapers, providing essential support and ensuring safety. The HBM’s climbing system relies on a jacking mechanism consisting of several independent jacking cylinders. A reliable control system is imperative to maintain a smooth posture of the construction steel platform (SP) under the action of the jacking mechanism. This research introduces three multivariate time series neural network models—namely, Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Temporal Convolutional Network (TCN)—to predict the posture of HBM. The models take pressure and stroke measurements from the jacking cylinders as inputs, and their outputs determine the levelness of the SP and the posture of the HBM at various climbing stages. The development and training of these neural networks are based on historical on-site data, with the predictions subjected to thorough comparative analysis. All proposed neural network models exhibit the capability to dynamically predict the posture of the HBM during the climbing process, using data from sensors. Notably, the GRU model shows better predictive performance.

The automated transcription of handwritten characters into a legible output is a multi-faceted process with diverse applications. In this paper, a novel approach to optical character recognition (OCR) for handwritten digits is proposed that, in certain components, exceeds current architectures in terms of accuracy, effectiveness, adjustability, temporal efficiency, and/or computational simplicity. This model succeeds in the adoption and enhancement of deprecated or obsolete algorithms across eight steps of image pre-processing—normalization, grayscaling, thresholding/binarization, noise removal, skew-correction, skeletonization/thinning, line separation, and character segmentation. The aforementioned model is evaluated with the use of a Convolutional Neural Network (CNN) leveraging the Balanced eMNIST dataset for training and testing. By suggesting contour-based feature extraction methods as alternatives to pixel-by-pixel iteration, the proposed paradigm demonstrates its capacity to serve as a suitable alternative to current, commonly used algorithms and computational techniques for textual image classification.

Today, there is a time series analysis that has gained significant popularity across various industries to provide effective solutions for any specific challenges. Artificial intelligence logic is generally used to solve time-series problems with the help of various frameworks that are available for the development of AI-based applications. Currently, there is a significant framework in Python that is driven by its comprehensive libraries and their practical implementations. Time series analysis can be built with the help of some specific models that give results to differentiate the efficiency and domains of great work. This paper focuses on three diverse libraries of Python to predict the Gulf stock exchange market. These libraries are prediction models that are helpful in predicting future values. These models utilized include SARIMA (Seasonal Auto-Regressive Integrated Moving Average), Neural Prophet Model, and Fb Prophet model. Each model is trained using the provided datasets, which are followed by evaluation parameters such as MSE, RMSE, recall, MDAPE, accuracy, precision, etc. The main purpose of using these three models for stock market prediction is to find the better-suited models. In the past few decades, the stock market industry has seemed to have promising growth after 2022 onwards. This paper will help us make a significant decision about model usage for addressing such complex challenges. Especially, the research findings indicate that all three models demonstrate in different domains. SARIMA can perform well in overall prediction tasks, while the Prophet model works great with smaller datasets that contain seasonality trends.

Single Image Super Resolution (SSIR) is a problem in computer vision where the goal is 1 to create high-resolution images from low-resolution ones. It has important applications in fields 2 such as medical imaging and security surveillance. While traditional methods such as interpolation 3 and reconstruction-based models have been used in the past, deep learning techniques have recently 4 gained attention due to their superior performance and computational efficiency. This article proposes 5 an Autoencoder based Deep Learning Model for SSIR, in particular, a light model that uses fewer 6 parameters without compromising performance. The down-sampling part of the Autoencoder 7 mainly uses 3 by 3 convolution and has no subsampling layers. The up-sampling part uses transpose 8 convolution and residual connections from the down sampling part. The model is trained using a 9 subset of the VILRC ImageNet database. The model is evaluated using quantitative metrics PSNR, 10 SSIM as well as qualitative measures such as perceptual quality. PSNR and SSIM figures as high as 11 76.06 and 0.93 are reported.

This systematic literature review explores the burgeoning use of Artificial Intelligence (AI) in manufacturing systems, in line with the principles of Industry 4.0 and the growth of smart factories. In this landscape, AI is crucial in addressing the complexity and dynamism of contemporary manufacturing processes, including machine breakdowns, fluctuating orders and unpredictable job arrivals. This systematic literature review, conducted using the Scopus database and bibliometric tools, pursues two primary objectives. First, it identifies the prevailing trends in solving scheduling problems with AI and identifies the most commonly used AI techniques in the literature. Secondly, it analyses how authors have successfully employed AI to address production scheduling challenges in real-world industrial settings and assesses the benefits obtained by companies. The dynamic nature of manufacturing systems requires adaptive scheduling paradigms. AI, including Particle Swarm Optimization, Neural Networks, and Reinforcement Learning, is applied to optimize production processes, predict machine failures, and achieve substantial benefits. In real-world applications, these AI-driven solutions have led to reduced production costs, enhanced energy efficiency, and more efficient scheduling processes. AI is increasingly recognized as an essential tool in addressing the evolving challenges of modern manufacturing environments.

This paper presents preliminary research that investigates the relationship between the flow of a group of jazz musicians, quantified through multi-person pose synchronization, and their collective emotions. Building upon previous studies that measured the physical synchronicity of team members by tracking their body movements and measuring the difference in arm, leg, and head movements, we introduce a novel metric termed "team entanglement". We employ facial expression recognition to evaluate the musicians’ collective emotions. Through correlation and regression analysis, we establish that higher levels of synchronized body and head movements correspond to lower levels of disgust, anger, sadness and higher levels of joy among the musicians. Furthermore, we utilize a Convolutional Neural Network (CNN) based deep learning model to predict the collective emotions of the musicians. This model leverages 17 body synchrony keypoint vectors as features, resulting in a training accuracy of 61.47% and a test accuracy of 66.17%.

Electroencephalography (EEG) signals are the primary source for discriminating the preictal from the interictal stage, enabling early warnings before the seizure onset. The epileptic seizure prediction models face significant challenges due to data scarcity, diversity, and privacy. This paper proposes a three-tier architecture for epileptic seizure prediction associated with the Federated Learning (FL) model that enhances the capability by utilizing the significant amount of seizure patterns from globally distributed patients with data privacy. The determination of the preictal state is influenced by global and local model-assisted decision-making by modeling the two-level edge layer. Integrating the Spiking Encoder (SE) with Graph Convolutional Neural Network (Spiking-GCNN) works as the local model trained using the bi-timescale approach. Each local model utilizes the aggregated seizure knowledge from the different medical centers through FL and determines the preictal probability in the coarse-grained personalization. The Adaptive Neuro-Fuzzy Inference System (ANFIS) is utilized in fine-grained personalization to recognize epileptic seizure patients by examining the outcomes of the FL model, heart rate variability features, and patient-specific clinical features. The proposed seizure prediction is evaluated using benchmark datasets by comparing them with the existing works to demonstrate the potential results.

In this article, a method for the moisture mapping of the soil surface of agrophytocenosis was proposed using neural network based on synchronized radar and multispectral optoelectronic data of Sentinel-1,2. To verify the developed method, data from two experimental plots were used. These plots were located two on irrigated soybean crops. The first of them was located on the right bank (1st plot) and the second one on the left bank (2nd plot) of the down part of Volga River. Two experimental soil moisture geo-datasets were done by measurements and geo-referencing points using gravimetric method (1st plot) and with proximal sensing method (2nd plot) using Soil Moisture Sensor ML3-KIT (THETAKIT, Delta). The soil moisture retrieval algorithm was based on the use of a neural network to predict reflection coefficient of an electromagnetic wave from the soil surface, followed by inversion into soil moisture using a dielectric model that takes into account the soil texture. The input parameter of the neural network was the ratio of the microwave radar vegetation index (calculated on the basis of Sentinel-1 data) to the index (calculated on the basis of data of multispectral optoelectronic channels 8 and 11 of Sentinel-2). Such way calculated index reveals showed a significantly greater dependence on soil moisture than on vegetation height that was been used in previous studies. The retrieved values of soil moisture were compared with the soil moisture measured in-situ. The proposed method with a determination coefficient of 0.44-0.65 and a standard deviation of 2.4%-4.2% for the 1st plot as well as with and of the same metrics for the 2nd allows predicting the soil moisture of both a test plots covered by soybean plants, relative to soil moisture measured in-situ. The conducted research created the scientific basis for a new technology for remote sensing the moisture content of the soil surface of agrophytocenosis as an element of the precision farming system and agroecology.

Advancements in technology have revolutionized communication on social media platforms, where reviews and comments greatly influence product selection. Current opinion mining methods predominantly focus on textual content, overlooking the rich information within customer-posted images, termed here as Multus-Medium. This research introduces an innovative deep learning approach, Multus Medium Opinion Mining (MMOM), capitalizing on both text and image data for comprehensive product review analysis. MMOM employs an integrated model of Bidirectional Long Short-Term Memory (BiLSTM) and embedded Convolutional Neural Network (CNN), incorporating architectures of GoogleNet and VGGNet, thus enabling efficient extraction and fusion of textual and visual features. This synergistic approach enables data collection, preprocessing, feature extraction, fusion strategy-based feature vector generation, and subsequent product recommendation. Performance evaluation on two diverse real-world datasets name as “flicker8k” and “t4sa”. These datasets show substantial improvement over existing methods. MMOM outperforms standard benchmark models, achieving an accuracy, F1 score and ROC over fliker8k are 90.38%, 88.75% and 93.08%, whereas for twitter dataset are 88.54%, 86.34%, and 92.26% respectively, the accuracy of purposed model is 7.34% and 9.54% higher than the other two mentioned techniques. These statistics highlight the robustness and applicability of MMOM across various domains. The compelling results underscore the potential of MMOM, providing a more holistic and precise approach to opinion mining in the era of social media product reviews. This research, product recommendation helps the customer to make purchasing decision. Last but not the least, the purposed scheme can further be expanded in any other sentiment task like hospital recommendation system, crop farming recommendation and medical diagnostic system etc.

(1) Background: Artificial intelligence (AI) has existed in some form for decades, but recent rapid advances in a subset called machine learning (ML) — and more specifically deep learning (DL), a neural network-based approach — have made headlines for the potential to revolutionize and automate multiple large sectors of society, including scientific research and the healthcare field. Furthermore, large language models (LLMs) — which are built on DL — could lead to a more seamless, natural interaction between humans and computers. (2) Methods: We reviewed numerous publications on this subject from recent years. (3) Results: We found these studies collectively show that AI is positively disrupting both biomedical research and medical practice, such as optical imaging in surgery guidance. (4) Conclusions: However, we recommend caution in over-reliance on AI in the laboratory or the clinic due to anticipated risks and current limitations.

Electrical power quality is one of the main elements in power generation systems. At the same time, it is one of the most significant challenges regarding stability and reliability. Due to different switching devices in this type of architecture, different kinds of power generators, and non-linear loads are used for different industrial processes. As a result of this, the need to classify and analyze Power quality disturbance (PQD) to prevent and analyze the degradation of the system reliability affected by the non-linear and non-stationary oscillatory nature. This paper presents A Novel Mul-titasking Deep Neural Network (MDL) for the Classification and Analysis of Multiple Electrical Disturbances. The characteristics are extracted with a specialized and adaptive methodology for non-stationary signals, Empirical Mode Decomposition (EMD). The methodology’s design, devel-opment, and various performance tests are carried out with 28 different difficulty levels, such as severity, disturbance duration time, and noise in the 20 dB to 60 dB signal range. MDL was devel-oped with a diverse data set in difficulty and noise, with a quantity of 4500 records of different samples of multiple electrical disturbances. The analysis and classification methodology has an average accuracy percentage of 95% with multiple disturbances. In addition, an average accuracy percentage of 90% in analyzing important signal aspects for studying electrical power quality such as crest factor, Per Unit voltage analysis, Short Term Flicker Perceptibility (Pst), and Total Harmonic Distortion (THD), among others.

The integration of deep learning methods, especially Convolutional Neural Networks (CNN), and Synthetic Aperture Radar Automatic Target Recognition (SAR ATR) has been widely deployed in the field of radar signal processing. Nevertheless, these methods are frequently regarded as black-box models due to the limited visual interpretation of their internal feature representation and parameter organization. In this paper, we propose an innovative approach named C-RISE, which builds upon the RISE algorithm to provide a post-hoc interpretation technique for black-box models used in SAR Images Target Recognition. C-RISE generates saliency maps that effectively visualize the significance of each pixel. Our algorithm outperforms RISE by clustering masks that capture similar fusion features into distinct groups, enabling more appropriate weight distribution and increased focus on the target area. Furthermore, we employ Gaussian blur to process the masked area, preserving the original image structure with optimal consistency and integrity. C-RISE has been extensively evaluated through experiments, and the results demonstrate superior performance over other interpretation methods based on perturbation when applied to neural networks for SAR image target recognition. Furthermore, our approach is highly robust and transferable compared to other interpretable algorithms, including white-box methods.

Many problems in the fields of finance and actuarial science can be transformed into the problem of solving backward stochastic differential equations (BSDE) and partial differential equations (PDE) with jumps, which are often difficult to solve in high-dimensional cases. To solve this problem, this paper applies the deep learning algorithm to solve a class of high-dimensional nonlinear partial differential equations with jump terms and their corresponding backward stochastic differential equations (BSDE) with jump terms. Using the nonlinear Feynman-Kac formula, the problem of solving this kind of PDE is transformed into the problem of solving the corresponding backward stochastic differential equations with jump terms, and the numerical solution problem is turned into a stochastic control problem. At the same time, the gradient and jump process of the unknown solution are separately regarded as the strategy function and they are approximated respectively by using two multilayer neural networks as function approximators. Thus, deep learning-based method is used to overcome the “curse of dimensionality” caused by high-dimensional PDE with jump, and the numerical solution is obtained. In addition, this paper proposes a new optimization algorithm based on the existing neural network random optimization algorithm, and compares the results with the traditional optimization algorithm, and achieves good results. Finally, the proposed method is applied to three practical high-dimensional problems: Hamilton-Jacobi-Bellman equation, bond pricing under the jump Vasicek model and high-dimensional option pricing model with default risk. The proposed numerical method has obtained satisfactory accuracy and efficiency. The method has important application value and practical significance in investment decision-making, option pricing, insurance and other fields.

Early-season crop-type data are required for a variety of agricultural monitoring and decision-making applications. The early season in this study referred to the prophase and middle of a growth season. Early-season detection of crop types remains challenging because of limited discriminative features, especially for landscapes that are characterized by complex cropping patterns. In fact, different remote-sensing satellites can increase the frequency of data acquisition, which can provide more information in the early season. Moreover, optical and radar sensors have different degrees of sensitivity to crop parameters. Therefore, the integration and application of two types of multitemporal data are of great significance to improve the accuracy and timeliness of crop type detection.In deep learning (DL), convolutional neural network (CNN) and recurrent neural network (RNN) models have great potential for temporal feature extraction. Compared with RNNs, CNNs usually have fewer parameters and are more conducive to determining early-season detection dates of different crop types, which requires a lot of training because of the need to model on different dates. Nevertheless, revisit dates and temporal intervals of different satellites are usually different, resulting in different data acquisition time series; these data cannot be directly used as input for the same convolutional layer. To address this challenge, a Dual-1DCNN was bulit based on the CNN model in this study. Moreover, an incremental training method was used to attain the network on each data acquisition date and obtained the best detection date for each crop type in the early season. A case study for Hengshui City in China was conducted using time series of Sentinel-1A (S1A) and Sentinel-2 (S2). To verify this method, classical methods support vector machine (SVM) and random forest (RF) were implemented. The results demonstrated the following: (1) the Dual-1DCNN extracted discriminative features from S1A and S2 time series at the early season by producing the highest overall accuracy (OA: 87.23%); (2) for summer maize, cotton, and common yam rhizome, the Dual-1DCNN achieved F1 values of 92.39%, 87.71%, and 84.38%, respectively, at the early season (moreover, the early seasons were almost 40, 70, and 80 days before the end of the growth seasons, respectively). These findings suggested that the Dual-1DCNN is promising for the accurate and timely detection of crop types.

Background: MR image classification in datasets collected from multiple sources is complicated by inconsistent and missing DICOM metadata. Therefore, we aimed to establish a method for the efficient automatic classification of MR brain sequences. Methods: Deep convolutional neural networks (DCNN) were trained as one-vs-all classifiers to differentiate between six classes, T1 weighted (w), contrast-enhanced T1w, T2w, T2w-FLAIR, ADC, and SWI. Each classifier yields a probability, allowing threshold-based and relative probability assignment while excluding images with low probability (label: unknown, open-set recognition problem). Data from three high-grade glioma (HGG) cohorts was assessed; C1 (320 patients, 20101 MRI images) was used for training, while C2 (197, 11333) and C3 (256, 3522) were for testing. Two raters manually checked images through an interactive labeling tool. Finally, MR-Class' added value was evaluated via radiomics models' performance for progression-free survival (PFS) prediction in C2, utilizing the concordance index (C-I). Results: Approximately 10% of annotation errors were observed in each cohort between the DICOM series descriptions and the derived labels. MR-Class accuracy was 96.7% [95%-Cl: 95.8, 97.3] for C2 and 94.4% [93.6, 96.1] for C3. 620 images were misclassified; Manual assessment of those frequently showed motion artifacts or alterations of anatomy by large tumors. Implementation of MR-Class increased on average the PFS model C-I by 14.6% compared to a model trained without MR-Class. Conclusions: We provide a DCNN-based method for sequence classification of brain MR images and demonstrate its usability in two independent HGG datasets.

Lung cancer is the leading cause of cancer mortality worldwide, and it is urgently necessary to diagnose it as early as possible. Usually, the diagnostic process begins with a radiological examination which, when a possible tumour is present, is followed by a biopsy to extract tissue samples from the patient's lungs. Therefore, the purpose of this study is the development of an artificial intelligence algorithm that will analyse the Whole Slide Image (WSI) generated by the digitisation of the glass slides obtained from the extracted samples and detect if there is a tumour. The developed learning algorithms as well as the tested neural networks (NNs) were trained on a dataset composed of previously annotated WSI tiles, classified as Tumour or Non-Tumour. From these, four developed convolutional neural networks stood out and were selected to be compared with each other and with the tested NNs. When the best result of each of the developed architectures was compared to the highest result of the tested NNs, it was possible to denote that version 4 of CancerDetecNN achieved an average accuracy of 89.749 \% and an average loss of 0.220. Furthermore, the results for the four selected versions are in agreement with the results reported in the literature, however, the limited size of the given dataset must be considered. Given the results obtained, the fourth version has the potential to optimise the lung cancer diagnosis process.

The steep rise in reinforcement learning (RL) in various applications in energy as well as the penetration of home automation in recent years are the motivation for this article. It surveys the use of RL in various home energy management system (HEMS) applications. There is a focus on deep neural network (DNN) models in RL. The article provides an overview of reinforcement learning. This is followed with discussions on state-of-the-art methods for value, policy, and actor–critic methods in deep reinforcement learning (DRL). In order to make the published literature in reinforcement learning more accessible to the HEMS community, verbal descriptions are accompanied with explanatory figures as well as mathematical expressions using standard machine learning terminology. Next, a detailed survey of how reinforcement learning is used in different HEMS domains is described. The survey also considers what kind of reinforcement learning algorithms are used in each HEMS application. It suggests that research in this direction is still in its infancy. Lastly, the article proposes four performance metrics to evaluate RL methods.

While thunderstorms can pose severe risks to property and life, forecasting remains challenging, even at short lead times, as these often arise in meta-stable atmospheric conditions. In this paper, we examine the question of how well we could perform short-term (up to 180min) forecasts using exclusively multi-spectral satellite images and past lighting events as data. We employ representation learning based on deep convolutional neural networks in an “end-to-end” fashion. Here, a crucial problem is handling the imbalance of the positive and negative classes appropriately in order to be able to obtain predictive results (which is not addressed by many previous machine-learning-based approaches). The resulting network outperforms previous methods based on physically-based features and optical flow methods (similar to operational prediction models) and generalizes across different years. A closer examination of the classifier performance over time and under masking of input data indicates that the learned model actually draws most information from structures in the visible spectrum, with infrared imaging sustaining some classification performance during the night.

A correct system design can be systematically obtained from a specification model of a real-time system that integrates hybrid measurements in a realistic industrial environment, this has been carried out through complete Matlab / Simulink / Stateflow models. However, there is a widespread interest in carrying out that modeling by resorting to Machine Learning models, which can be understood as Automated Machine Learning for Real-time systems that present some degree of hybridization. An induction motor controller which must be able to maintain a constant air flow through a filter is one of these systems and it is discussed in the paper as a study case of closed-loop control system. The article discusses a practical application of ML methods that demonstrates how to replace such closed loop in industrial control systems with a Simulink block generated from neural networks to show how the proposed procedure can be applied to derive complete hybrid system designs with artificial neural networks (ANN). In the proposed ANN-based method to design a real-time hybrid system with continuous and discrete components, we use a typical design of a neural network, in which we define the usual phases: training, validation, and testing. The generated output of the model is made up of reference variables values of the cyber-physical system, which represent the functional and dynamic aspects of model. They are used to feed Simulink/Stateflow blocks in the real target system.