The present study aims to examine the role the social and digital infrastructures might have during the building process of the Smart Regions in the Italian context. Within this framework, it is possible to identify some essential research questions, such as why the same regions are growing faster than the other and which type of effects could be generated from the different connectivity between the regions. Since the Smart Region concept is still composed of technical reports, pilot projects and experiences from a limited number of cities on the international stage, this work it is tried to use a new approach, applying either a neuronal model, the Self-Organizing Maps, and the multivariate regression approach, to extrapolate the existence of possible future conditions for the rising of Smart Regions in Italy, studying the evolution of the used database during the period 2005 – 2016. From the analysis what emerged is that the only bridging social capital dimension, empirically speaking, feed the regional innovation growth because the structure of social relationship facilitates interactions across social, political and economic agents; but there are institutional deficits, most pronounced in Italy and other European countries.

Evaporation from surface water plays a key role in water accounting of basins, water resources management, and irrigation systems management, so simulating evaporation with high accuracy is very important. In this study, two methods for simulating pan evaporation under different climatic conditions in Iran were developed. In the first method, six experimental relationships (linear, quadratic, and cubic, with two input combinations) were determined for Iran’s six climate types, inspired by a multilayer perceptron neural network (MLP-NN) neuron and optimized with the genetic algorithm. The best relationship of the six was selected for each climate type, and the results were presented in a three-dimensional graph. In the second method, the best overall relationship obtained in the first method was used as the basic relationship, and climatic correction coefficients were determined for other climate types using the genetic algorithm optimization model. Finally, the accuracy of the two methods was validated using data from 32 synoptic weather stations throughout Iran. For the first method, error tolerance diagrams and statistical coefficients showed that a quadratic experimental relationship performed best under all climatic conditions. To simplify the method, two graphs were created based on the quadratic relationship for the different climate types, with the axes of the graphs showing relative humidity and temperature, and with pan evaporation was drawn as contours. For the second method, the quadratic relationship for semi-dry conditions was selected as the basic relationship. The estimated climatic correction coefficients for other climate types lay between 0.8 and 1 for dry, semi-dry, semi-humid, Mediterranean climates, and between 0.4 and 0.6 for humid and very humid climates, indicating that one single relationship cannot be used to simulate pan evaporation for all climatic conditions in Iran. The validation results confirmed the accuracy of the two methods in simulating pan evaporation under different climatic conditions in Iran.

Formaldehyde (HCHO) is one of the most important carcinogenic air contaminants. However, the lack of global surface concentration of HCHO monitoring is currently hindering research on outdoor HCHO pollution. Traditional methods are either restricted to small areas or data- demanding for a global scale of research. To alleviate this issue, we adopted neural networks to estimate surface HCHO concentration with confidence intervals in 2019, where HCHO vertical column density data from TROPOMI, in-situ data from HAPs (harmful air pollutants) monitoring network and ATom mission are utilized. Our result shows that the global surface HCHO average concentration is 2.30 μg/m3. Furthermore, in terms of regions, the concentration in Amazon Basin, Northern China, South-east Asia, Bay of Bengal, Central and Western Africa are among the highest. The results from our study provides a first dataset of the global surface HCHO concentration. In addition, the derived confidence interval of surface HCHO concentration adds an extra layer for the confidence to our results. As a pioneer work in adopting confidence interval estimation into AI-driven atmospheric pollutant research and the first global HCHO surface distribution dataset, our paper will pave the way for the rigorous study on global ambient HCHO health risk and economic loss, thus providing a basis for pollutant controlling policies worldwide.

Deep neural networks (DNNs) have made a huge impact in the field of machine learning by providing unbeatable humanlike performance to solve real-world problems such as image processing and natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN) are two typical architectures that are widely used to solve such problems. Time sequence-dependent problems are generally very challenging, and RNN architectures have made an enormous improvement in a wide range of machine learning problems with sequential input involved. In this paper, different types of RNN architectures are compared. Special focus is put on two well-known gated-RNN’s Long Term Short Memory (LSTM) and Gated Recurrent Unit (GRU). We evaluated these models on the task of force estimation system in pouring. In this study, four different models including multi-layers LSTM, multi-layers GRU, single-layer LSTM and single-layer GRU) were created and trained. The result suggests that multi-layer GRU outperformed other three models.

Laboratory medicine has evolved from a mainly manual profession, providing few selected test results to a highly automated and standardized medical discipline, generating millions of test results per year. As next inevitable evolutional step, artificial intelligence (AI) algorithms will need to assist us in structuring and making sense of the masses of diagnostic data collected today. Such systems will be able to connect clinical and diagnostic data and to provide valuable suggestions in diagnosis, prognosis or therapeutic options. They will merge the often so separated worlds of the laboratory and the clinics. When used correctly, it will be a tool, capable of freeing the physicians time so that he/she can refocus on the patient. In this narrative review I therefore aim to provide an overview of what AI is, what applications currently are available in healthcare and in laboratory medicine in particular. I will discuss the challenges and pitfalls of applying AI algorithms and I will elaborate on the question if healthcare workers will be replaced by such systems in the near future.

This study presents the consecutive modification of orange peel (OP) by NaOH and sodium dodecyl sulfate (SDS) for simultaneous elimination of basic dyes from the binary system and modeling the adsorption process using an intelligent tool. The natural and modified biosorbents were characterized by variety of analyses such as: field emission scanning electron microscopy with energy dispersive X-ray, N2 physisorption and Fourier transform infrared spectroscopy techniques. The influence of various variables on dye removal like pH, the quantity of biosorbents, dyes concentration, contact time, and temperature in the binary system were investigated and optimized by an artificial neural network (ANN) model as an intelligent tool. The optimum quantity of the sorbent was found to be 0.30 g for orange peel (OP) and 0.25 g for NaOH-treated OP (NOP) and SDS-decorated NOP (SNOP) at pH = 7. The kinetics and thermodynamics investigations showed that the removal of dyes obeyed the pseudo-second-order kinetic model and were spontaneous and exothermic in nature. Moreover, in order to describe the mechanism of sorption process, desorption studies of dyes were carried out. The desorption percentages of methylene blue (MB) in water and HCl were found to be in the range of 1.93%–4.76% and 18.87%–28.76%, respectively; in addition, the desorption percentages of crystal violet (CV) in water and HCl were obtained to be in the range of 4.11%–7.41% and 32.84%–43.00%, respectively; which could be a recommendation ion exchange or electrostatic attachment of dyes onto biosorbents. The ANN predictions matched with the experimental data very well (0.95308 < R2 < 0.99191 and 0.98335 < R2 < 0.99773 for MB and CV, respectively) which indicated high accuracy of the ANN model. In addition, the relative importance of each parameter was calculated by Garson’s equation.

Emotion recognition defined as identifying human emotion and is directly related to different fields such as human-computer interfaces, human emotional processing, irrational analysis, medical diagnostics, data-driven animation, human-robot communi- cation and many more. The purpose of this study is to propose a new facial emotional recognition model using convolutional neural network. Our proposed model, “ConvNet”, detects seven specific emotions from image data including anger, disgust, fear, happiness, neutrality, sadness, and surprise. This research focuses on the model’s training accuracy in a short number of epoch which the authors can develop a real-time schema that can easily fit the model and sense emotions. Furthermore, this work focuses on the mental or emotional stuff of a man or woman using the behavioral aspects. To complete the training of the CNN network model, we use the FER2013 databases, and we test the system’s success by identifying facial expressions in the real-time. ConvNet consists of four layers of convolution together with two fully connected layers. The experimental results show that the ConvNet is able to achieve 96% training accuracy which is much better than current existing models. ConvNet also achieved validation accuracy of 65% to 70% (considering different datasets used for experiments), resulting in a higher classification accuracy compared to other existing models. We also made all the materials publicly accessible for the research community at: https://github.com/Tanoy004/Emotion-recognition-through-CNN.

Recent advancement of deep learning has been elevated the multifaceted nature in various applications of this field. Artificial neural networks are now turning into a genuinely old procedure in the vast area of computer science; the principal thoughts and models are more than fifty years of age. However, in this modern computing era, 3rd generation intelligent models are introduced by scientists. In the biological neuron, actual film channels control the progression of particles over the layer by opening and shutting in light of voltage changes because of inborn current flows and remotely led to signals. A comprehensive 3rd generation, Spiking Neural Network (SNN) is diminishing the distance between deep learning, machine learning, and neuroscience in a biologically-inspired manner. It also connects neuroscience and machine learning to establish high-level efficient computing. Spiking Neural Networks initiate utilizing spikes, which are discrete functions that happen at focuses as expected, as opposed to constant values. This paper is a review of the biological-inspired spiking neural network and its applications in different areas. The author aims to present a brief introduction to SNN, which incorporates the mathematical structure, applications, and implementation of SNN. This paper also represents an overview of machine learning, deep learning, and reinforcement learning. This review paper can help advanced artificial intelligence researchers to get a compact brief intuition of spiking neural networks.

Machine Learning has completely transformed health care system, which transmits medical data through IOT sensors. So it is very important to encrypt them to protect patient data. encrypting medical images from a performance perspective consumes time; hence the use of an auto encoder is essential. An auto encoder is used in this work to compress the image as a vector prior to the encryption process. The digital image passes across description function and a decoder to get back the image in the proposed work; various experiments are carried out on hyper parameters to achieve the highest outcome of the classification. The findings demonstrate that the combination of Mean Square Logarithmic Error as the loss function, ADA grad as an optimizer, two layers for the encoder, and another reverse for the decoder, RELU as the activation function generates the best auto encoder results. The combination of Mean square error (lose function), RMS prop (optimizer), three layers for the encoder and another reverse for the decoder, and RELU (activation function) has the best classification result. All the experiments with different hyper parameter has run almost very close to each other even when changing the number of layers. The running time is between 9 and 16 second for each epoch.

This paper presents a new framework to classify floor plan elements and represent them in a vector format. Unlike existing approaches using image-based learning frameworks as the first step to segment the image pixels, we first convert the input floor plan image into vector data and utilize graph neural network. Our framework consists of three steps. (1) image pre-processing and vectorization of the floor plan image. (2) region adjacency graph conversion. (3) graph neural network on converted floor plan graphs. Our approach is able to capture different types of indoor elements including basic elements such as walls, doors, and symbols as well as spatial elements such as rooms and corridors. In addition, the proposed method can also detect element shapes. Experimental results show that our framework can classify indoor elements with an F1 score of 95%, with scale and rotation invariance. Furthermore, we propose a new graph neural network model that takes the distance between nodes into account, which is a valuable feature of spatial network data.

Early prediction of thermal loads plays an essential role in analyzing energy-efficient buildings' energy performance. On the other hand, stochastic algorithms have recently shown high proficiency in dealing with this issue. These are the reasons that this work is dedicated to evaluating an innovative hybrid method for predicting the cooling load (CL) in buildings with residential usage. The proposed model is a combination of artificial neural networks and stochastic fractal search (SFS-ANN). Two benchmark algorithms, namely the grasshopper optimization algorithm (GOA) and firefly algorithm (FA), are also considered to be compared with the SFS. The non-linear effect of eight independent factors on the CL is analyzed using each model's optimal structure. Evaluation of the results outlined that all three metaheuristic algorithms (with more than 90 % correlation) can adequately optimize the ANN. In this regard, this tool's prediction error declined by nearly 23, 18, and 36 % by applying the GOA, FA, and SFS techniques. Also, all used accuracy criteria indicated the superiority of the SFS over the benchmark schemes. Therefore, it is inferred that utilizing the SFS along with ANN provides a reliable hybrid model for the early prediction of CL.

Landslides impact on human activities and socio-economic development especially in mountainous areas. This study focuses on the comparison of the prediction capability of advanced machine learning techniques for rainfall-induced shallow landslide susceptibility of Deokjeokri catchment and Karisanri catchment in South Korea. The influencing factors for landslides i.e. topographic, hydrologic, soil, forest, and geologic factors are prepared from various sources based on availability and a multicollinearity test is also performed to select relevant causative factors. The landslide inventory maps of both catchments are obtained from historical information, aerial photographs and performing field survey. In this study, Deokjeokri catchment is considered as a training area and Karisanri catchment as a testing area. The landslide inventories content 748 landslide points in training and 219 points in testing areas. Three landslide susceptibility maps using machine learning models i.e. Random Forest (RF), Extreme Gradient Boosting (XGBoost) and Deep Neural Network (DNN) are prepared and compared. The outcomes of the analyses are validated using the landslide inventory data. A receiver operating characteristic curve (ROC) method is used to verify the results of the models. The results of this study show that the training accuracy of RF is 0.757 and the testing accuracy is 0.74. Similarly, training accuracy of XGBoost is 0.756 and testing accuracy is 0.703. The prediction of DNN revealed acceptable agreement between susceptibility map and the existing landslides with training and testing accuracy of 0.855 and 0.802, respectively. The results showed that, the DNN model achieved lower prediction error and higher accuracy results than other models for shallow landslide modeling in the study area

Online transactions are becoming more popular in present situation where the globe is facing an unknown disease COVID-19. Now authorities of Countries requested peoples to use cashless transaction as far as possible. Practically it is not always possible to use it in all transactions. Since number of such cashless transactions have been increasing during lockdown period due to COVID-19, fraudulent transactions are also increasing in a rapid way. Fraud can be analysed by viewing a series of customer transactions data that was done in his/her previous transactions. Normally banks or other transaction authorities warned their customers about the transaction If any deviation is noticed by them from available patterns. These authorities think that it is possibly of fraudulent transaction. For detection of fraud during COVID-19, banks and credit card companies are applying various methods such as data mining , decision tree, rule based mining, neural network, fuzzy clustering approach and machine learning methods. These approaches is try to find out normal usage pattern of customers based on their past activities. The objective of this paper is to find out such fraud transactions during such unmanageable situation.Digital payment schemes are often threatened by fraudulent activities. Detecting fraud transaction in during money transfer may save customers from financial loss. Mobile based money transactions are focused in this paper for fraud detection. A Deep Learning (DL) framework is suggested in this paper that monitors and detects fraudulent activities. Implementing and applying recurrent neural network on PaySim generated synthetic financial dataset, deceptive transactions are identified. The proposed method is capable to detect deceptive transactions with an accuracy of 99.87%, F1-Score of 0.99 and MSE of 0.01.

In this paper, the fixed-time stabilization problem for a class of uncertain chained system is addressed by using a novel nonsingular recursive terminal sliding mode control approach. A fixed-time controller and an adaptive law are designed to guarantee the uncertain chained form system both Lyapunov stable and fixed-time convergent within the settling time. The advantage of the controller based on the sliding mode is that the settling time does not depend on the system initial state. Furthermore, we use RBF neural network to estimate the uncertainty of the system. Finally, the simulation results demonstrate the performance of the control laws.

Nowadays industrial dryers are used instead of traditional methods for drying. In designing dryers suitable for controlling the process of drying and reaching a high quality product, it is necessary to predict the instantaneous moisture loss during drying. For this purpose, ten mathematical-experimental models with a neural network model based on the kinetic data of pistachio drying are studied. The data obtained from the cabinet dryer will be evaluated at four temperatures of inlet air and different air velocities. The pistachio seeds will be placed in a thin layer on an aluminum sheet on a drying tray and weighed by a scale attached to the computer at different times. In the neural network, data are divided into three parts: educational (60%), validation (20%) and test (20%). Finally, the best mathematical-experimental model using genetic algorithm and the best neural network structure for predicting instantaneous moisture are selected based on the least squared error and the highest correlation coefficient.

In this effort we propose a data-driven learning framework for reduced order modeling of fluid dynamics. Designing accurate and efficient reduced order models for nonlinear fluid dynamic problems is challenging for many practical engineering applications. Classical projection-based model reduction methods generate reduced systems by projecting full-order differential operators into low-dimensional subspaces. However, these techniques usually lead to severe instabilities in the presence of highly nonlinear dynamics, which dramatically deteriorates the accuracy of the reduced-order models. In contrast, our new framework exploits linear multistep networks, based on implicit Adams-Moulton schemes, to construct the reduced system. The advantage is that the method optimally approximates the full order model in the low-dimensional space with a given supervised learning task. Moreover, our approach is non-intrusive, such that it can be applied to other complex nonlinear dynamical systems with sophisticated legacy codes. We demonstrate the performance of our method through the numerical simulation of a two-dimensional flow past a circular cylinder with Reynolds number Re = 100. The results reveal that the new data-driven model is significantly more accurate than standard projection-based approaches

This paper presents a novel approach for semantic segmentation of building roof in dense urban environment with Deep Convolution Neural Network (DCNN) using imagery acquired by a Chinese Very High Resolution (VHR) satellite mission, i.e. GaoFen-2 (GF-2). To provide an operational end-to-end work flow for accurate build roof mapping with feature extraction as well as image segmentation, a fully convolutional DCNN with both convolutional and deconvolutional layers is designed to perform the VHR image analysis for labeling pixels. Since the diverse urban patterns and building styles in large areas, sample image data sets of building roof and non-building roof are collected over different metropolitan regions in China. We selected typical cities with dense urban environment in each metropolitan region as study areas for collecting training and test samples. High performance cluster with GPU-mounted workstations is employed to perform the model training and optimization. With the building roof samples collected over different cities, the predictive model with multiple NN layers is developed for building roof labeling. The validation of the building roof map shows that the overall accuracy(OA) and the mean Intersection Over Union( mIOU) of DCNN based segmentation are 94.67%, 0.85 respectively, while CRF-refined segmentation achieved OA of 94.69% and mIOU of 0.83. The results suggest that the proposed approach is a promising solution for building roof mapping with VHR images over large areas across different urban and building patterns. With the operational acquisition of GF2 VHR imagery, it is expected to develop an automated pipeline for operational built-up area monitoring and timely update of building roof map over large areas.

This paper introduces a model-free, "on-the-fly" learning control strategy for arrays of energy converters with adjustable generator damping. The devices are arranged so that they are affected simultaneously by the energy medium. Each device uses a different control strategy, of which at least one has to be the machine learning approach presented in this paper. During operation all energy converters record the absorbed power and control output; the machine learning device gets the data from the converter with the highest power absorption and so learns the best performing control strategy for each state. Consequently, the overall network has a better overall performance than each individual strategy. This concept is evaluated for wave energy converter (WEC) with numerical simulations and experiments with physical scale models in a wave tank. In the first of two numerical simulations, the learnable WEC works in an array with four WECs applying a constant damping factor. In the second simulation, two learnable WECs were learning with each other. It showed that in the first test the WEC was able to absorb as much as the best constant damping WEC, while in the second run it could absorb even slightly more. During the physical model test, the ANN showed its ability to select the better of two possible damping coefficients based on real world input data.

With the emergence of Advance Logistics, the logistics industry has witnessed significant advancements, leading to a greater reliance on intelligent technologies. These technologies play a crucial role in gathering and transmitting logistics data, but they also introduce security and privacy risks to logistics management systems. The sharing of customer-sensitive information among stakeholders for efficient operations becomes vulnerable to unauthorized access, thus compromising privacy. This, amongst others, is a critical problem that needs to be addressed. The unique features of a cryptographic hash function, including immutability, efficient verification, and anonymity, make it a transformative technology that has the potential to address the mentioned challenges in various sectors. This disruptive technology offers solutions by ensuring data integrity, enabling quick verification, and preserving privacy. The findings suggest that employing Cryptographic Hash Functions to share customer data among logistics partners offers robust protection against cyber-attacks. The proposed system guarantees asset security, and as demonstrated by the case study evaluation, exhibits strong resilience in safeguarding against various security and privacy threats. Although this study is significant, it does have limitations. One of these limitations is the considerable overlap between logistics research and supply chain management (SCM). While our focus was on logistics tasks, we did not extensively delve into the broader context of SCM

Given the high number of vehicle-crash victims, it has been established as a priority to reduce this figure in the transportation sector. For this reason, many of the recent researches are focused on including control systems in existing vehicles, to improve their stability, comfort and handling. These systems need to know in every moment the behavior of the vehicle (state variables), among others, when the different maneuvers are performed, to actuate by means of the systems in the vehicle (brakes, steering, suspension) and, in this way, to achieve a good behavior. The main problem arises from the lack of ability to directly capture several required dynamic vehicle variables, such as roll angle, from low-cost sensors. Previous studies demonstrate that low-cost sensors can provide data in real-time with the required precision and reliability. Even more, other research works indicate that neural networks are efficient mechanisms to estimate roll angle. Nevertheless, it is necessary to assess that the fusion of data coming from low-cost devices and estimations provided by neural networks can fulfill the reliability and appropriateness requirements for using these technologies to improve overall safety in production vehicles. Because of the increasing of computing power, the reduction of consumption and electric devices size, along with the high variety of communication technologies and networking protocols using Internet have yield to Internet of Things (IoT) development. In order to address this issue, this study has two main goals: 1) Determine the appropriateness and performance of neural networks embedded in low-cost sensors kits to estimate roll angle required to evaluate rollover risk situations. 2) Compare the low-cost control unit devices (Intel Edison and Raspberry Pi 3 Model B), to provide the roll angle estimation with this artificial neural network-based approach. To fulfil these objectives an experimental environment has been set up composed of a van with two set of low-cost kits, one including a Raspberry Pi 3 Model B, low cost Inertial Measurement Unit (BNO055 - 37€) and GPS (Mtk3339 - 53€) and the other having an Intel Edison System on Chip linked to a SparkFun 9 Degrees of Freedom module. This experimental environment will be tested in different maneuvers for comparison purposes. Neural networks embedded in low-cost sensor kits provide roll angle estimations very approximated to real values. Even more, Intel Edison and Raspberry Pi 3 Model B have enough computing capabilities to successfully run roll angle estimation based on neural networks to determine rollover risks situation fulfilling real-time operation restrictions stated for this problem.

The ever-evolving ways attacker continues to im prove their phishing techniques to bypass existing state-of-the-art phishing detection methods pose a mountain of challenges to researchers in both industry and academia research due to the inability of current approaches to detect complex phishing attack. Thus, current anti-phishing methods remain vulnerable to complex phishing because of the increasingly sophistication tactics adopted by attacker coupled with the rate at which new tactics are being developed to evade detection. In this research, we proposed an adaptable framework that combines Deep learning and Randon Forest to read images, synthesize speech from deep-fake videos, and natural language processing at various predictions layered to significantly increase the performance of machine learning models for phishing attack detection.

Investigating the network response to node removal and the efficacy of the node removal strategies are related and fundamental questions in network science. Research studies proposed many node centralities based on the network structure ranking node to remove. The random walk (RW) on networks describes a stochastic process in which a walker travels among nodes. RW can be a model of transport, diffusion, and search on networks, and an essential tool for studying the importance of network nodes. In this manuscript, we propose four new measures of node centrality based on RW. Then, we compare the efficacy of the new RW node removal strategies to network dismantle with effective node removal strategies from the literature, such as betweenness and closeness node removal over synthetic and real-world networks. We evaluate the network dismantle along node removal using the size of the largest connected component (LCC). We find that, hence the betweenness nodes attack is the best strategy overall, the new node removal strategies based on RW show the highest efficacy in peculiar network topology. Specifically, RW strategies based on covering times emerge as the most effective strategy on a synthetic lattice network and two real-world road networks. Our results may be useful in selecting the best node attack strategies in a specific class of networks and in building more robust network structures.

The main purpose of this article is to identify brain diseases such as Alzheimer's and Parkinson's in an intelligent way using Python software and processing the function of neurons in the neural network areas of the brain, which are classified into different components, and the data is based on the information obtained from FMRI images using algorithms artificial intelligence can intelligently diagnose the type of disease. Therefore, by using spatial clustering based on the deep learning method with noise algorithm (DBSCAN), fMRI brain image and fMRI brain surface complexity are classified, and then image preprocessing will be applied to fMRI images by using artificial intelligence neural networks (ANN) algorithm. became. Then, by using the ANN algorithm and Deep CNN topology of the brain neural network, the type of disease in the brain can be diagnosed by simulating the performance of an artificial neural network (ANN) in Python software. Deep machine learning-based methods, especially algorithms based on neural networks, have shown great success in medical image analysis for various tasks including brain tumor detection, segmentation, and classification, and Alzheimer's and epilepsy. In this research, we propose an integrated model based on a convolutional neural network for simultaneous recognition and classification of brain diseases for intelligent diagnosis of tumors and epilepsy. The average accuracy obtained from our proposed model is 97.89 percent accuracy and 91.66 percent specificity.

Deep learning has taken over - both in problems beyond the realm of traditional, hand-crafted machine learning paradigms as well as in capturing the imagination of the practitioner sitting on top of petabytes of data. While the public perception about the efficacy of deep neural architectures in complex pattern recognition tasks grows, sequentially up-to-date primers on the current state of affairs must follow. In this review, we seek to present a refresher of the many different stacked, connectionist networks that make up the deep learning architectures followed by automatic architecture optimization protocols using multi-agent approaches. Further, since guaranteeing system uptime is fast becoming an indispensable asset across multiple industrial modalities, we include an investigative section on testing neural networks for fault detection and subsequent mitigation. This is followed by an exploratory survey of several application areas where deep learning has emerged as a game-changing technology - be it anomalous behavior detection in financial applications or financial time-series forecasting, predictive and prescriptive analytics, medical imaging, natural language processing or power systems research. The thrust of this review is on outlining emerging areas of application-oriented research within the deep learning community as well as to provide a handy reference to researchers seeking to embrace deep learning in their work for what it is: statistical pattern recognizers with unparalleled hierarchical structure learning capacity with the ability to scale with information.

This comprehensive study looks at how operational conditions affect the performance of a novel seven-channel titania ceramic ultrafiltration membrane for the treatment of produced water. A Full factorial design experiment (23) was conducted to study the effect of the cross-flow operating factors on the membrane permeate flux decline and the overall permeate volume. Eleven experimental runs were performed for three important process operating variables: Transmembrane Pressure (TMP), Crossflow Velocity (CFV), and Filtration Time (FT). Steady final membrane fluxes and permeate volumes were recorded for each experimental run. Under the optimized conditions (1.5 bar, 1 m/s, and 2 hours), the membrane performance index demonstrated an oil rejection rate of 99%, a flux of 297 liters/m2·hr (LMH), a 38% overall initial flux decline, and a total permeate volume of 8.14 L. The regression models used for the steady-state membrane permeate flux decline and overall permeate volume led to the highest goodness of fit to the experimental data with a correlation coefficient of 0.999. A Multiple Linear Regression method and an Artificial Neural Network approach were also employed to model the experimental membrane permeate flux decline and analyze the impact of the operating conditions on membrane performance. The predictions of the Gaussian regression and the Levenberg-Marquardt backpropagation method were validated with a determination coefficient of 99 % and a mean square error of 0.07.

COVID-19 is a severe global problem, and AI can play a significant role in preventing losses by monitoring and detecting infected persons in early-stage. This paper aims to propose a high-speed and accurate fully-automated method to detect COVID-19 from the patient's CT scan images. We introduce a new dataset that contains 48260 CT scan images from 282 normal persons and 15589 images from 95 patients with COVID-19 infections. At the first stage, this system runs our proposed image processing algorithm to discard those CT images that inside the lung is not properly visible in them. This action helps to reduce the processing time and false detections. At the next stage, we introduce a novel method for increasing the classification accuracy of convolutional networks. We implemented our method using the ResNet50V2 network and a modified feature pyramid network alongside our designed architecture for classifying the selected CT images into COVID-19 or normal with higher accuracy than other models. After running these two phases, the system determines the condition of the patient using a selected threshold. We are the first to evaluate our system in two different ways. In the single image classification stage, our model achieved 98.49% accuracy on more than 7996 test images. At the patient identification phase, the system correctly identified almost 234 of 245 patients with high speed. We also investigate the classified images with the Grad-CAM algorithm to indicate the area of infections in images and evaluate our model classification correctness.

An abdominal aortic aneurysm (AAA) is usually asymptomatic until rupture, which is associated with extremely high mortality. Consequently, early detection of AAAs is of paramount importance in reducing mortality; however, most AAAs are detected by medical imaging incidentally. The aim of this study was to investigate the feasibility of machine learning-based pulse wave (PW) analysis for the early detection of AAAs using a database of in silico PWs. PWs in the large systemic arteries were simulated using one-dimensional blood flow modelling. A database of in silico PWs representative of subjects (aged 55, 65 and 75 years) with different AAA sizes was created by varying the AAA-related parameters with major impacts on PWs – identified by parameter sensitivity analysis – in an existing database of in silico PWs representative of subjects without AAA. Then, a machine learning architecture for early detection of AAAs was proposed, which was trained and tested using the new in silico PW database. The parameter sensitivity analysis revealed that the AAA maximum diameter and stiffness of the large systemic arteries were the dominant AAA-related biophysical properties that significantly influence the PW. The simulated PW indexes extracted from the database showed that the PW was not only influenced by the presence of an AAA but was also significantly affected by multiple cardiovascular parameters that compromised the detection of AAAs by using individual PW indexes. Alternatively, the trained machine learning model performed well in classifying normal and AAA conditions using digital photoplethysmogram PWs from the database. These findings suggest that machine learning-based PW analysis is a promising approach for AAA screening using PW signals acquired by wearable devices.

This research investigates the implementation of complex exponential-based neurons in FPGA, which can pave the way for implementing bio-inspired spiking neural networks to compensate for the existing computational constraints in conventional artificial neural networks. The increasing use of extensive neural networks and the complexity of models in handling big data lead to higher power consumption and delays. Hence, finding solutions to reduce computational complexity is crucial for addressing power consumption challenges. The complex exponential form effectively encodes oscillating features like frequency, amplitude, and phase shift, streamlining the demanding calculations typical of conventional artificial neurons through levering simple phase addition of complex exponential functions. The article implements such a two-neuron and a multi-neuron neural model using Xilinx system generator and Vivado design suite, employing 8-bit, 16-bit, and 32-bit fixed-point data format representations. The study evaluates the accuracy of the proposed neuron model across different FPGA implementations while also providing a detailed analysis of operating frequency, power consumption, and resource usage for the hardware implementations. BRAM-based Vivado designs outperformed Simulink regarding speed, power, and resource efficiency. Specifically, the Vivado BRAM-based approach supported up to 128 neurons, showcasing optimal LUT and FF resource utilization. Such outcomes accommodate choosing the optimal design procedure for implementing spiking neural networks on FPGAs.

Image captioning aims at generating meaningful verbal descriptions of a digital image. Our paper focuses on the classic encoder-decoder deep learning model that consists of several components – sub-networks, each performing a separate task that, combined, form an effective caption generator. We investigate image feature extractors, recurrent neural networks, word embedding models, and word generation layers and discuss how each component influences the captioning model’s overall performance. Our experiments are performed on the MS COCO 2014 dataset. The results help design efficient models with optimal combinations of their components.

Detecting cracks in structural health monitoring is crucial for ensuring infrastructure safety and longevity. Using drones to obtain crack images and automate processing can improve the efficiency of crack detection. To address the challenges posed by the limited computing resources of edge devices in practical applications, we propose CrackScopeNet, a lightweight segmentation network model that simultaneously considers local and global crack features, suitable for deployment on drone platforms with limited computational power and memory. CrackScopeNet features a multi-scale branch to improve sensitivity to cracks of varying sizes without substantial computational overhead and a stripe-wise context attention mechanism to enhance the capture of long-range contextual information, mitigating the interference from complex backgrounds. Experimental results on CrackSeg9k dataset demonstrate that CrackScopeNet leads to a significant improvement in prediction performance, with the highest mean intersection over union (mIoU) scores reaching 82.12%, while maintaining a lightweight architecture with only 1.05M parameters and 1.58G floating point operations (FLOPs). Besides, CrackScopeNet excels in inference speed on edge devices without GPU because of its low FLOPs. CrackScopeNet contributes to the development of efficient and effective crack segmentation networks, suitable for practical structural health monitoring applications using drone platforms.

Training artificial intelligence (AI) for reasoning presents significant challenges due to the lack of clear objectives and reward functions. In structured environments such as chess and Go, objectives are well-defined, and the optimal moves can be determined through search algorithms that maximize the reward function. This clarity enables AI to learn and improve autonomously through random trials and recursive calculation of rewards, mirroring human learning processes that depend on prior experiences and state-dependent actions. However, in real-world applications, AI lacks access to direct interaction and feedback, making it difficult to define proper reward functions. This limitation is particularly evident in the training of large language models (LLMs), where the quality of the output is constrained by the training data and the absence of a dynamic reward system. Simulated environments offer some utility but are inherently limited by their design and scope. Achieving artificial general intelligence (AGI) requires AI to function and receive feedback in real-world settings, similar to human cognitive and strategic development through interactive experiences. This paper explores the critical role of clear objectives and reward functions in AI training, the limitations posed by the current lack of real-world interaction, and the implications for future advancements in AI reasoning capabilities.

Rice has become the second major food among rural people. It is one of the most nutrient and low-cost food available in Asia. Rice is composed of two major subspecies as Japonica and Indica and it belongs to the Poaceae family. The World Bank predicts that rice demand will grow 51% faster than population growth in 2025. It is high time to develop a model which predicts the type of infected paddy leaf and avoids the loss of grains. In this paper, the proposed hybrid CNN model, three CNN networks with different layer properties are trained parallel. The extracted feature from these CNN networks is combined to provide the classification of the type of infected leaf. Fieldwork was carried and about 340 samples are collected from five different types of classes. The proposed hybrid model was tested with both the fieldwork dataset and also with an available dataset on the internet. The experimental results show that the proposed model outperforms the other CNN network and yields an accuracy value of 98%, a precision value of 95%, and a misclassification rate of 4% respectively.

Real time condition monitoring and precision health assessment system is a mandatory need for effective maintenance program in industrial sector. Rapid advancement in the information technology and other engineering technologies have invited more proactive attention from research and development in industrial sectors and particularly in condition monitoring of machines and related Industrial processes. In this work, the drill bit condition monitoring techniques have been developed based on the wavelet analysis and artificial neural network (ANN) as automatic drill bit fault detection and classification. An experimental work has been conducted to capture the vibration signals for analysis. In this experiment, the CNC drill machine is used with high carbon steel drill bit and mild steel material as work piece. The cutting condition parameters are kept constant and the wear level is changed. The Data Acquisition system (DAQ) with Lab VIEW software is used to capture the vibration signals for drill bit with different wear conditions. The captured vibrations data are analyzed using continuous wavelet transform (CWT) with Morlet wavelet and Daubechies wavelet as a prime function. In general, the CWT coefficient is used to generate the inputs features to ANN for automatic tool condition classification, with two outputs (0, 1) for healthy and (1, 0) for faulty. The results show the effectiveness of the combed WT and ANN for automatic classification of tool wear conditions with high success rate.

Accurately predicting drug-drug interactions (DDIs) is crucial for preventing adverse drug events in clinical settings. However, existing methodologies often rely on complex models built from diverse data sources, posing challenges in computational drug discovery. To address the need for precise computational methods in predicting unknown DDIs, this study introduces a novel Deep Neural Network (DNN)-based approach. By leveraging a wide range of drug-related information, including substructure, targets, side effects, pathways, and indications, our method calculates multiple drug similarities. These similarities are then synthesized using a nonlinear fusion method to extract high-level features. Subsequently, a tailored neural network is deployed for interaction prediction. Comparative evaluation against three prominent machine learning classifiers—Extreme Gradient Boosting (XGBoost), Adaptive Gradient Boosting (AdaBoost), and Light Gradient-Boosting Machine (LGBM)—using three benchmark datasets demonstrates the superior performance of DNN. It achieves outstanding accuracy, precision, recall, and F1-score metrics, all reaching 94.6% in cross-validation. Additionally, case studies involving numerous drug pairs confirm the reliability of DNN in accurately predicting unknown DDIs. These findings underscore DNN as a potent and reliable method for DDI prediction, with promising implications for drug discovery and healthcare applications.

The volume of fluid (VOF) method is a popular technique for the direct numerical simulations of flows involving immiscible fluids. A discrete volume fraction field evolving in time represents the interface, in particular, to compute its geometric properties. The height function method (HF) is based on the volume fraction field, and its estimate of the interface curvature converges with second-order accuracy with grid refinement. Data-driven methods have been recently proposed as an alternative to computing the curvature, with particular consideration for a well-balanced input data set generation and symmetry preservation. In the present work, a two-layer feed-forward neural network is trained on an input data set generated from the height function data instead of the volume fraction field. The symmetries for rotations, reflections, and the anti-symmetry for the phase swapping have been considered to reduce the number of input parameters. The neural network, establishing a correlation between curvature and height function values, can efficiently predict the local interface curvature. We compare the trained neural network to the standard Height Function method to assess its performance and robustness.

Artificial intelligence (AI) is a current trend in computer science, which extends itself its amazing capacities to other technologies such as mechatronics and robotics. Going beyond technological applications, the philosophy behind AI is that there is a vague and potential convergence of artificial manufacture and natural world although the limiting approach may be still very far away, but why? The implicit problem is that Darwin theory of evolution focuses on natural world where breeding conservation is the cornerstone of the existence of creature world but there is no similar concept of breeding conservation in artificial world whose things are created by human. However, after developing for a long time until now, AI issues an interesting concept of generation in which artifacts created by computer science can derive their new generations inheriting their aspects / characteristics. Such generated artifacts make us look back on offsprings by the process of breeding conservation in natural world. Therefore, it is possible to think that AI generation, which is a recent subject of AI, is a significant development in computer science as well as high-tech domain. AI generation does not help us to reach near biological evolution even in the case that AI can combine with biological technology but, AI generation can help us to extend our viewpoint about Darwin theory of evolution as well as there may exist some uncertain relationship between man-made world and natural world. Anyhow AI generation is a current important subject in AI and there are two main generative models in computer science: 1) generative model that applies large language model into generating natural language texts understandable by human and 2) generative model that applies deep neural network into generating digital content such as sound, image, and video. This technical report focuses on deep generative model (DGM) for digital content generation, which is a short summary of approaches to implement DGMs. Researchers can read this work as an introduction to DGM with easily understandable explanations.

With the advancement of technology, signal modulation types are becoming increasingly diverse and complex. The phenomenon of signal time-frequency overlap during transmission poses significant challenges for the classification and recognition of mixed signals, including poor recognition capabilities and low generality. This paper presents a recognition model for fine-grained analysis of mixed signal characteristics, proposing a Geometry Coordinate attention mechanism and introducing a low-rank bilinear pooling module to more effectively extract signal features for classification. The model employs a residual neural network as its backbone architecture and utilizes the Geometry Coordinate attention mechanism for time-frequency weighted analysis based on information geometry theory. This analysis targets multiple-scale features within the architecture, producing time-frequency weighted features of the signal. These weighted features are further analyzed through a low-rank bilinear pooling module, combined with the backbone features, to achieve fine-grained feature fusion. This results in a fused feature vector for mixed signal classification. Experiments were conducted on a simulated dataset comprising 39,600 mixed signal time-frequency plots. The model was benchmarked against a baseline using a residual neural network. The experimental outcomes demonstrated an improvement of 9% in the exact match ratio and 5% in the Hamming score. These results indicate that the proposed model significantly enhances the recognition capability and generalizability of mixed signal classification.

Ensuring optimal performance and reliability in rotor-bearing systems is crucial for industrial applications. Imbalance and shaft bow in these systems can lead to decreased efficiency and increased vibrations. Early detection and mitigation of a rotor’s faults are essential, and model-based fault identification has gained much attention in the manufacturing industry for years. Over the past two decades, however, the development of fault diagnosis rules with data-driven and artificial intelligence (AI) has become a trend, and in the foreseeable future, AI combined with big data will become mainstream. Nevertheless, the critical role of rotating machinery in manufacturing introduces a challenge, as the availability of fault data is often insufficient. This limitation renders the establishment of diagnostic rules using data-driven methods and AI technologies impractical. In light of these challenges, this study proposes a novel hybrid approach, that combines a physical model with machine learning (ML) techniques for the diagnosis of multi-faults (imbalance and shaft-bow demonstrated) in a Jeffcott rotor. To overcome the lack of real-world faulted, labeled datasets, a physics-based Jeffcott rotor model is first derived and then used to generate abundant fault datasets for ML. Subsequently, simulated data are employed for the training of an artificial neural network (ANN), enabling the network to learn from and analyze the vast array of generated data. The results prove that a well-trained feed-forward neural network (FNN) can accurately isolate and diagnose the imbalance and shaft-bow faults using the simulated data and the real data from the Jeffcott rotor experiment. These physics-based and ML approaches prove effective particularly for multi-fault, offering new possibilities for advanced rotor system monitoring and maintenance strategies in industrial applications.

The speed-density or flow-density relationship is a fundamental aspect of traffic flow theory. Single-regime models often face challenges in consistently fitting empirical data under diverse traffic conditions. This paper addresses the inaccuracies of single-regime models, attributing them not only to their functional forms but also to data dispersion and sample selection bias. To mitigate these issues, the data is segmented into day and night periods, leading to the creation of separate models for each. Calibration results, conducted on data from two freeways, Tehran-Karaj and Tehran-Qom, reveal distinct challenges, with the former exhibiting high dispersion and the latter showing low dispersion. Surprisingly, single-regime models demonstrate notable effectiveness when applied to distinct day and night data. Further analysis, categorizing data into day and night, results in reduced errors (20-60% improvement in R-Square), emphasizing the potential for enhanced accuracy by considering distinct regimes. Overall, the study underscores the significance of regime-specific considerations for accurate traffic flow modeling. Upon thorough evaluation, the study highlights the superiority of the neural network Multi-layer Perceptron (MLP) over traditional models. The research discusses the implications of incorporating day and night parameters into the models, emphasizing their potential for accuracy enhancement.

Considering that cryptocurrencies are now present in practically every financial transaction because they are widely accepted as an alternate means of making payments and exchanging currencies, academics and economists have more opportunities to study cryptocurrency prices. Over the years, investors, traders and investment banks have found it difficult to predict the closing daily price of Ethereum due to its rapid price fluctuation. The daily closing price of cryptocurrency is essential to consider when trading or investing in Ethereum. This report focuses on carrying out a comparative study of the predictive capabilities of deep machine learning algorithms with a stacking ensemble modelling framework using daily historical observations of the price of Ethereum obtained from Coindesk, tweets extracted from Twitter ranging from the 1st of August 2022 to the 8th of August 2022 and other five covariates (closing price lag1, closing price lag2, noltrend, daytype and month) engineered from the closing price of Ethereum. Seven models are used to compute the forecasts for the daily closing price of Ethereum; these are the recurrent neural network, ensemble stacked recurrent neural network, gradient boosting machine, generalized linear model, distributed random forest, deep neural networks and stacked ensemble for gradient boosting machine, generalized linear model, distributed random forest and deep neural networks. The main evaluation metric used is the mean absolute error. According to MAE, RNN forecasts outperform the other model’s forecasts in this study, producing an MAE of 0.0309.

The implementation of neural networks (NN) on edge devices enables local processing of wireless data but faces challenges such as high computational complexity and memory requirements when deep neural networks (DNN) are used. Shallow neural networks customized for specific problems are more efficient, requiring fewer resources, and resulting in a lower latency solution. An additional benefit of the smaller network size is that it is suitable for real-time processing on edge devices. The main concern with shallow neural networks is their accuracy performance compared to DNNs. In this paper, we demonstrate that a customized adaptive activation function (AAF) can meet the accuracy of a DNN. We designed an efficient FPGA implementation for a customized segmented spline curve neural network (SSCNN) structure to replace the traditional fixed activation function with an AAF. We compared our SSCNN with different neural network structures such as real-valued time delay neural network (RVTDNN), augmented real-valued time delay neural network (ARVTDNN), and deep neural networks with different parameters. Our proposed SSCNN implementation uses 40% fewer hardware resources and no Block RAMS compared to the DNN with similar accuracy. We experimentally validate this computationally efficient and memory-saving FPGA implementation of SSCNN for digital predistortion of RF power amplifiers using the AMD/Xilinx RFSoC ZCU111. The implemented solution uses less than 3% of the available resources. The solution also enables an increase of the clock frequency to 221.12 MHz, allowing the transmission of wide bandwidth signals.

This paper presents a customized adaptive cascaded deep learning (ACDL) model for the design and performance prediction of metasurface absorbers. A multi-resonant metasurface absorber structure is introduced, with 10 target-driven design parameters. The proposed deep learning model takes advantage of cascading several sub-deep neural network (DNN) layers with forward noise mitigation capability. The inherent appearance of sparse data is completely dealt with in this work by proposing a trained adaptive selection technique. On the basis of the findings, the prediction response is quite fast and accurate enough to retrieve the design parameters of the studied metasurface absorber and with two sized patches of 4000 and 7000 datasets. The training loss taken form the second DNN of our proposed model shows logarithmic mean squared errors of 0.039 and 0.033 when using Keras and the adaptive method, respectively, with a dataset split of 4000. On the contrary, for a dataset split of 7000, the errors are 0.049 with Keras and 0.045 with the adaptive method. On the other hand, the validation loss is evaluated using the mean square error method, which results in a loss with 4000 datasets split with the Keras method of 0.044, while it is 0.020 with the adaptive method. When extending the dataset to 7000, the validation loss with the keras splitting method is 0.0073, while it is improved, reaching 0.006 with the proposed adaptive method, and achieving a prediction accuracy of 94%. This proposed deep learning model can be deployed in the design process and synthesis of multi-resonant metasurface absorber structures. The proposed model shows its advantages of making the design process more efficient in sparse dataset handling, efficient approach in multi-resonance metasurface data pre-processing, less time consuming, and computationally valuable.

Seawater density is an important physical property in oceanography that affects the accuracy of calculations such as gravity fields and tidal potentials, and the calibration of acoustic and optical oceanographic sensors. In related studies, constant density values are frequently used, which can introduce significant errors. Therefore, this study employs a basic convolutional neural network model to construct a comprehensive model showing the seawater density distribution across the globe. The model takes into account depth, latitude, longitude, and month as inputs. Numerous real seawater datasets were used to train the model, and it has been shown that the model has an absolute mean error and root mean square error of less than 2 kg/m3 in 99% of the test set samples. The model effectively demonstrates the influence of input parameters on the distribution of seawater density. In this paper, we present a newly developed global model for distributing seawater density which is both comprehensive and accurate, surpassing previous models. The utilization of the model presented in this paper for estimating seawater density can minimize errors in theoretical ocean models and serve as a foundation for designing and analyzing ocean exploration systems.

Photovoltaic systems and wind energy systems are generally used in distributed system. However, zero-sequence and harmonic currents occur due to photovoltaic systems, and positive-sequence harmonic currents occur due to wind turbines. Thus, the sheath current in high voltage cables increases due to these currents and poor power quality in distributed generation plants. Metal parts of the cable are grounded to prevent the negative effects of sheath currents. When long high voltage cable lines are grounded with the method in the literature, high sheath current and voltage occur on the cable sheath. Therefore, the SSBLR method is designed as a new method for the distributed generation system. The SSBLR method has been optimized with prediction methods and multi-objective optimization methods to prevent negative effects of the sheath current. Pareto optimal method is used as multi-objective optimization method, and artificial neural network, hybrid artificial neural network and regression methods are used as prediction method. The most dominant result is searched using different estimation and optimization methods in pareto optimal method. When the artificial neural network-genetic algorithm hybrid method is used as a prediction method, and genetic algorithm used as optimization method, significant decreases are observed in sheath current and voltage.

This proposed research explores a novel approach to image classification by deploying a complex-valued neural network (CVNN) on a field-programmable gate array (FPGA), specifically for classifying 2D images transformed into polar form. The aim of this research is to address the limitations of existing neural network models in terms of energy and resource efficiency, by exploring the potential of FPGA-based hardware acceleration in conjunction with advanced neural network architectures like CVNNs. The methodological innovation of this research lies in the Cartesian to polar transformation of 2D images, effectively reducing the input data volume required for neural network processing. Subsequent efforts focused on constructing a CVNN model optimized for FPGA implementation, emphasizing the enhancement of computational efficiency and overall performance. The experimental findings provide empirical evidence supporting the efficacy of the image classification system developed in this study. One of the developed models, CVNN_128, achieves an accuracy of 88.3% with an inference time of just 1.6ms and a power consumption of 4.66mW for the classification of the MNIST test dataset consists of 10,000 frames. While there is a slight concession in accuracy compared to recent FPGA implementations that achieve 94.43%, our model significantly excels in classification speed and power efficiency—surpassing existing models by more than a factor of 100. In conclusion, the paper demonstrates the substantial advantages of FPGA-implementation of CVNNs for image classification tasks, particularly in scenarios where speed, resource, and power consumption are critical. The study’s reproducible results and corresponding code are available on GitHub at the following link: https://github.com/mahmad2005/CVNNonFPGA

Seismic velocity inversion is one of the most critical issues in the field of seismic exploration and has long been the focus of numerous experts and scholars. In recent years, the advancement of machine learning technologies has infused new vitality into the research of seismic velocity inversion and yielded a wealth of research outcomes. Typically, seismic velocity inversion based on machine learning lacks control over physical processes and interpretability. Starting from wave theory and the physical processes of seismic data acquisition, this paper proposes a method for seismic velocity model inversion based on Physical Embedding Recurrent Neural Networks. Firstly, the wave equation is a mathematical representation of the physical process of acoustic waves propagating through a medium, and the finite difference method is an effective approach to solving the wave equation. With this in mind, we introduce the architecture of recurrent neural networks to describe the finite difference solution of the wave equation, realizing the embedding of physical processes into machine learning. Secondly, in seismic data acquisition, the propagation of acoustic waves from multiple sources through the medium represents a high-dimensional causal time series (wavefield snapshots), where the influential variable is the velocity model, and the received signals are the observations of the wavefield. This forms a forward modeling process as the forward simulation of the wavefield equation, and the use of error back-propagation between observations and calculations as the velocity inversion process. Through time-lapse inversion and incorporating the causal information of wavefield propagation, the non-uniqueness issue in velocity inversion is mitigated. Through mathematical derivations and theoretical model analyses, the effectiveness and rationality of the method are demonstrated. In conjunction with simulation results for complex models, the method proposed in this paper can achieve velocity inversion in complex geological structures.

Applications of gradient method for nonlinear optimization in development of Gradient Neural Network (GNN) and Zhang Neural Network (ZNN) are investigated. Particularly, the solution of the matrix equation AXB=D which changes over time is studied using the novel GNN model, termed as GGNN(A,B,D). The GGNN model is developed applying GNN dynamics on the gradient of the error matrix used in the development of the GNN model. The convergence analysis shows that the neural state matrix of the GGNN(A,B,D) design converges asymptotically to the solution of the matrix equation AXB=D, for any initial state matrix. It is also shown that the convergence result is the least square solution which is defined depending on the selected initial matrix. A hybridization of GGNN with analogous modification GZNN of the ZNN dynamics is considered. The Simulink implementation of presented GGNN models is carried out on the set of real matrices.

We aim to map the ESG patterns of emerging-market companies from 2018 to 2021 in order to determine whether the COVID-19 pandemic exerted any influence on sustainable corporate behavior. Thus, the ESG performances were assessed by applying the Kohonen neural network for clustering purposes at three main levels: i) ESG overall, including country and sectoral perspectives; ii) ESG thematic; and iii) ESG four-folded (stakeholder, perspective, management level, and focus strategic views). Our results show that emerging-market companies focus their ESG efforts on social and governance issues rather than on environmental. However, environmental, and social behavior differ more acutely than governance behavior across clusters. The ESG pillars country-level and eleven market-based economic sectors analysis corroborate the geographic and sector dependence of ESG performance. The thematic-level analysis indicate that operational activities and community issues received more attention, which suggests that emerging-market companies address distinct ESG topics according to their particularities and competitiveness. Furthermore, our empirical findings provide evidence that the ESG behavior of companies has changed over the course of the COVID-19 pandemic. Thus, our findings are relevant to policymakers involved in regulating ESG disclosure practices, investors focused on enhancing their sustainable investment strategies, and firms engaged in improving their ESG involvement.

The cities of the future are places of sustainable mobility and a continuous reduction in the amount of harmful substances entering the surrounding environment. Current emission models are mainly dedicated to fully combustion vehicles and do not fully reflect the actual emissions of vehicles in the fleet, which is becoming increasingly diverse. The increasing share of hybrid and electric vehicles is generating the need to measure emissions and energy consumption from these vehicles and to develop new emission models that are accurate. This problem mainly concerns low-emission zones in cities, where mobility planning should be based on simulation models that are based on a continuously updated database. This work concerns the proposal of a two-dimensional model of emissions from hybrid vehicles using artificial neural networks for low-emission zones. The results can be used to further develop such emission models.

Landslide is one of the most common geological disasters in China, which is characterized by suddenness and uncertainty, and it is difficult to realize accurate identification, early warning and forecasting of landslide disaster by conventional means. With the development of high-resolution remote sensing satellites and InSAR surface deformation monitoring technology, the traditional means of landslide monitoring data sources are limited, and there is a lack of effective methods to excavate the characteristics of the spatial distribution of landslide hazards and their triggering factors and other issues. In this paper, the area extending 10 km outside the VII isobar of the Gengma earthquake is taken as the study area, and 13 evaluation factors are screened out by integrating the factors of InSAR surface deformation, topography and geological environment, and the Bayesian Optimized Convolutional Neural Network (BO-CNN) is used for the evaluation of landslide susceptibility, and the BO-RF and PSO-SVM models are selected for the comparative analysis. The model accuracy evaluation was carried out by three indexes: ROC curve, AUC value and FR value, in which the ROC curves of PSO-SVM, BO-RF and BO-CNN were all close to the upper-left corner of the corner, and the AUC values were 0.9388, 0.9529, and 0.9535, respectively, and the FR value of landslide in the high susceptibility area of BO-CNN was as high as 14.9, and was higher than that of PSO-SVM and BO-RF, respectively. SVM and BO-RF model is 4.55 and 3.69 higher, the experimental results show that the BO-CNN model used in this paper has a better effect in landslide susceptibility evaluation, and the research results of the local government's disaster prevention and mitigation measures are of great significance.

Recently, deep learning models have been widely applied to modulation recognition, which have become a hot topic due to their excellent end-to-end learning capabilities. However, current methods are mostly based on uni-modal inputs, which suffer from incomplete information and local optimization. To complement the advantages of different modalities, we focus on the multi-modal fusion method. Therefore, we introduce an iterative dual-scale attentional fusion (iDAF) method to integrate multimodal data. Firstly, two feature maps with different receptive field sizes are constructed using local and global embedding layers. Secondly, the feature inputs are iterated into the Iterative Dual Scale Attention Module (iDCAM), where the two branches capture the details of high-level features and the global weights of each modal channel, respectively. The iDAF not only extracts the recognition characteristics of each specific domains, but also complements the strengths of different modalities to obtain a fruitful view. Our iDAF achieves a recognition accuracy of 93.5\% at 10dB and 0.6232 at full SNR. The comparative experiments and ablation studies effectively demonstrate the effectiveness and superiority of the iDAF.

This study addresses the challenge of assessing the carcinogenic potential of hazardous chemical mixtures, such as PFAS, which are known to contribute significantly to cancer development. Here, we propose a novel framework called HNNMixCancer that utilizes a Hybrid Neural Network (HNN) integrated into a machine-learning framework. This framework incorporates a mathematical model to simulate chemical mixtures and enables the creation of classification models for binary and multiclass classification and regression. Through extensive experimentation, we demonstrate that our HNN model outperforms other methodologies, including Random Forest, Bootstrap Aggregating, Adaptive Boosting, Support Vector Regressor, Gradient Boosting, Kernel Ridge, Decision Tree with AdaBoost, and KNeighbors, achieving a superior accuracy of 92.7% in binary classification. To address the limited availability of experimental data and enrich the training data, we generate an assumption-based virtual library of chemical mixtures using a known carcinogenic and non-carcinogenic single chemical for all the classification models. Remarkably, in this case, all methods achieve accuracies exceeding 98% for binary classification. In external validation tests, our HNN method achieves the highest accuracy of 80.5%. Furthermore, in multiclass classification, the HNN demonstrates an overall accuracy of 96.3%, outperforming RF, Bagging, and AdaBoost, which achieved 91.4%, 91.7%, and 80.2%, respectively. In regression models, HNN, RF, SVR, GB, KR, DT with AdaBoost, and KN achieve average R2 values of 0.96, 0.90, 0.77, 0.94, 0.96, 0.96, and 0.97, respectively, showcasing their effectiveness in predicting the concentration at which a chemical mixture becomes carcinogenic. Our method exhibits exceptional predictive power in prioritizing carcinogenic chemical mixtures, even when relying on assumption-based mixtures. This capability is particularly valuable for toxicology studies that lack experimental data on the carcinogenicity and toxicity of chemical mixtures. To our knowledge, this study introduces the first method for predicting the carcinogenic potential of chemical mixtures. The HNNMixCancer framework offers a novel alternative for dose-dependent carcinogen prediction. Ongoing efforts involve implementing the HNN method to predict mixture toxicity and expanding the application of HNNMixCancer to include multi-mixtures.

Over the last several decades, large wildfires are increasingly common across the United States causing disproportionate impact on forest health and function, human well-being, and economy. Here, we examine the severity of large wildfires across the Contiguous United States over the past decade (2011-2020) using a wide array of meteorological, vegetational, and topographical features in the Deep Neural Network model. A total of 4,538 wildfire incidents were used in the analysis covering 87,305 square miles of burned area. We observed the highest number of large wildfires in California, Texas, and Idaho, with lightning causing 43 % of these incidents. Importantly, results indicate that the severity of wildfire occurrences is highly correlated with the climatological forcings, land cover, location, and elevation of the ecosystem. Overall, results may serve useful guide in managing landscapes under changing climate and disturbance regimes.

For W-band long-range mm-wave wireless transmission systems, nonlinearity issues resulting from photoelectric devices, optical fiber, and wireless power amplifiers can be handled by deep learning equalization algorithms. Besides, the PS technique is considered an effective measure to further increase the capacity of the modulation-constraint channel. However, since the proba-bilistic distribution of m-QAM varies with the amplitude, there have been difficulties in learning valuable information from the minority class. This limits the gain of nonlinear equalization. To overcome the imbalanced machine learning problem, we propose a novel two-lane DNN (TLD) equalizer with the random over-sampling (ROS) technique in this paper. The combination of PS at the transmitter and ROS at the receiver improves the overall performance of the W-band wireless transmission system, and our 4.6-km ROF delivery experiment verifies its effectiveness for the W-band mm-wave PS-16QAM system. Based on our proposed equalization scheme, we realize single-channel 10-Gbaud W-band PS-16QAM wireless transmission over 100 m optical fiber link and 4.6-km wireless air-free distance. The results show that compared with the typical TLD without ROS, the TLD-ROS can improve the receiver sensitivity by 1dB. Furthermore, a reduction of 45.6% in complexity is realized, and training samples can be reduced by 15.5%. Considering the actual wireless physical layer with its requirements, there is much to be gained from the joint use of deep learning and balanced data pre-processing techniques.

Time series data having low signal-to-noise ratio, non-stationarity and non-linearity are commonly seen in high-frequency stock trading, where the objective is to increase the likelihood of profit by taking advantage of tiny discrepancies in prices and trading on them quickly and in huge quantities. For this purpose, it is essential to apply a trading method that is capable of fast and accurate prediction from such time series data. In this paper, we develop an online time series forecasting method for high-frequency trading (HFT) by integrating three neural network deep learning models, i.e., Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) and Transformer; and we abbreviate the new method to online LGT or O-LGT. The key innovation underlying our method is its efficient storage management, which enables super-fast computing. Specifically, when computing the forecast for the immediate future time, we use only the output calculated from the previous trading data (rather than the previous trading data themselves) together with the current trading data. Thus, the computing involves updating only the current data into the process. We evaluate the performance of O-LGT by analyzing the high-frequency Limit Order Book (LOB) data from the China market. It shows that our model in most cases achieves similar speed with much higher accuracy than the conventional fast supervised learning models for HFT. However, with a slight sacrifice in accuracy, O-LGT is approximately 40 times faster than the existing high-accuracy neural network models for the LOB data in China market.

Structure–function relationships in proteins have been one of the crucial scientific topics. Heme proteins have diverse and pivotal biological functions. Therefore, clarifying their structure–function correlation is significant to understand their functional mechanism and is informative for various fields of science. In this study, we constructed convolutional neural network models for predicting protein functions from the tertiary structures of heme-binding sites (active sites) of heme proteins to examine the structure–function correlation. As a result, we succeeded in the classification of oxygen-binding protein (OB), oxidoreductase (OR), proteins with both functions (OB–OR), and electron transport protein (ET) with high accuracy. Although the misclassification rate for OR and ET was high, the rates between OB and ET and between OB and OR were almost zero, indicating that the prediction model works well between protein groups with very different functions. However, predicting the function of proteins modified with amino acid mutation(s) remains a challenge. Our findings indicate a structure–function correlation in the active site of heme proteins. This study is expected to be applied to the prediction of more detailed protein functions such as catalytic reactions.

Ultrasound (US) is commonly used for the diagnosis of liver masses. Ensemble learning has been widely used for image classification, but its methods have not been fully optimized. This study was performed to investigate the usefulness of ensemble learning and compare a number of ensemble learning techniques using multiple convolutional neural network (CNN)-trained models for image classification of liver masses in US images. The US imaging data set was classified into four categories: benign liver tumor (BLT, 6320 images), liver cyst (LCY, 2320 images), metastatic liver cancer (MLC, 9720 images), and primary liver cancer (PLC, 7840 images). In this study, 250 test images were randomly selected for each class, for a total of 1000 images, and the remaining images were used for training. Sixteen different CNNs were used for to train and test the US images. All four types of ensemble learning—soft voting (SV), stacking (ST), weighted average voting (WAV), and weighted hard voting (WHV)—showed greater accuracy than the single CNN. All four types also showed significantly better deep learning performance than ResNeXt101 alone. For image classification of liver masses using US images, ensemble learning improved the performance of deep learning over a single CNN.

Convolutional neural network (CNN), a class of artificial neural network (ANN) is attracting interests of researchers in all research domain. CNN was invented for computer vision. They have also shown to be useful for semantic parsing, sentence modeling and other natural language processing related tasks. Here in this paper we discuss the basics of CNN models and their scope to provide a reference/baseline to the researchers interested in using CNN models in their research.

This article introduces new method using ANN to control SVC in order to correct the source power factor of low voltage network. Two ANN approaches are investigated to design accurate and fast power factor correction (PFC) controller. First approach uses simple ANN (SANNA). Second approach uses cascaded ANN (CANNA). ANN regression, performance and the calculated error for both approaches are investigated to select between the two approaches. CANNA is selected as a better solution and it used to build the ANN PFFC controller using database, generated by MATLAB-Simulink, for standard three low voltage levels (240V, 220V and 110V). Nine test cases are carried out to validate the performance of proposed ANN PFC controller with a network has variable loads and low power factor (0.6 approximately). In order to extend the use of the controller to other voltage levels not included in the training process of the cascaded ANN, only the SVC is resized. Another nine cases are carried out with the same loads using the same ANN controller, as it is, to test its performance with the extended voltage level range (415V, 230V and 120V). The results show accurate and fast response in all test cases.

Defect detection and identification from fruits and vegetables are particularly challenging for Indian agriculture. Defect Detection is a process to identify the defects or damages in vegetables and fruits, based on the shapes, colors and textures. The local market finds it difficult to cope with the defects and other infections in fruits and vegetables as quality evaluations and classification of vegetables and fruits have become tedious process. Recently, several approaches based on Image processing, Machine Learning and Artificial Intelligence methods have been proposed for the purpose of defect detection. On the basis of classifying the types of defects, related pathogens, and physical and morphological characteristics descriptors, we review the different approaches based on a corpus of 57 articles between 2016 and 2021. In the process of describing the defect analysis, steps from the target articles, algorithms, and methods including qualitative and quantitative evaluation are mainly summarized. The aim of this current review work is to present-day novel images and collects recent defective area calculation methods to detect surface defects of fruits and vegetables using RGB images and to classify whether the fruit is defected or fresh. A rigorous evaluation of many new algorithms provided for quality assurance by researcher’s probes of vegetables and fruits have been conducted in this work. This review work conveys that using the recent identification features will help to decrease the disadvantages in fruit storeroom owing to storage of the affected vegetables and fruits, ie. Preventing the spread of defects and other infections from the infected fruits and vegetables to the fresh ones.

Missing observations constitute one of the most important issues in data analysis in applied research studies. The magnitude and their structure impact parameters estimation in the modeling with important consequences for decision-making. This study aims to evaluate the efficiency of imputation methods combined with the backpropagation algorithm in a nonlinear regression context. The evaluation is conducted through a simulation study including sample sizes (50, 100, 200, 300 and 400) with different missing data rates (10, 20, 30 40 and 50%) and three missingness mechanisms (MCAR, MAR and MNAR). Four imputation methods (Last Observation Carried Forward, Random Forest, Amelia and MICE) were used to impute datasets before making prediction with backpropagation. 3-MLP model was used by varying the activation functions (Logistic-Linear, Logistic-Exponential, TanH-Linear and TanH-Exponentiel), the number of nodes in the hidden layer (3 - 15) and the learning rate (20 - 70%). Analysis of the performance criteria (R2, r and RMSE) of the network revealed good performances when it is trained with TanH-Linear functions, 11 nodes in the hidden layer and a learning rate of 50%. MICE and Random Forest were the most appropriate for data imputation. These methods can support up to 50% of missing rate with an optimal sample size of 200.

Great Malang region is developing rapidly with the population increase and inhabitant`s activity, like migration and urbanization. Other activities like agricultural expansion as well as an uncontrolled residential development need to be monitored to avoid any negative impact in the future. The availability of free and open-source software, spatial high-resolution satellite imagery datasets, and powerful algorithms open the possibilities to map, monitor, and predict the future trend of land use land cover (LULC) changes. However, the accuracy and precision of this model is still in doubt, especially in the Great Malang region. Research is needed to provide a foundational basis and documentation on how the changes occur, where did the changes occur, and the accuracy of the predicted model. This study tries to answer those questions using the high spatial resolution of Sentinel-2 imageries. Combination of the fuzzy algorithm, artificial neural network, and cellular automata was utilized to process the datasets. We analysed four different scenarios of simulation and the result then compared. The different number of hidden layers and iteration was used and evaluated to understand the effect of different parameters in the prediction result. The best scenario was then used to predict future land use changes. This study has successfully produced the future LULC model of Great Malang region with high accuracy level (87%). The study also found that the land use transformation from agriculture to urban built-up area is relatively low, where changes of the built-up area over three periods of analysis are below than 5%. This is due to the physical condition of Great Malang region where mountainous areas are dominated.

Deep learning has achieved lots of successes in many fields, but when trainable sample are extremely limited, deep learning often under or overfitting to few samples. Meta-learning was proposed to solve difficulties in few-shot learning and fast adaptive areas. Meta-learner learns to remember some common knowledge by training on large scale tasks sampled from a certain data distribution to equip generalization when facing unseen new tasks. Due to the limitation of samples, most approaches only use shallow neural network to avoid overfitting and reduce the difficulty of training process, that causes the waste of many extra information when adapting to unseen tasks. Euclidean space-based gradient descent also make meta-learner's update inaccurate. These issues cause many meta-learning model hard to extract feature from samples and update network parameters. In this paper, we propose a novel method by using multi-stage joint training approach to post the bottleneck during adapting process. To accelerate adapt procedure, we also constraint network to Stiefel manifold, thus meta-learner could perform more stable gradient descent in limited steps. Experiment on mini-ImageNet shows that our method reaches better accuracy under 5-way 1-shot and 5-way 5-shot conditions.

Various empirical models are available to evaluate the temperature effects on relative permeability of the different rock and fluid systems. However, the implementation of limited experimental data points may hinder the applicability of such models to other systems. This study aims to develop new predictive models for k_ro estimation based on multilayer perceptron artificial neural network (MLP-ANN), adaptive neuro-fuzzy inference system (ANFIS), and least squares support vector machine (LSSVM) approaches. A database comprising of 626 data points applied to the model development. The independent variables are temperature, oil viscosity, water viscosity, water saturation ( ), and the absolute permeability. Each variable covers a wide range of variations which increases models’ potential to be applied in various systems with different characteristics. The doubtful experimental data points excluded using a leverage value approach and a sensitivity analysis carried out to determine the quantitative impact of every individual independent variable on the k_ro. Statistical error analyses demonstrated the coefficient of determination (R²) values of 0.985, 0.975, and 0.999 for MLP-ANN, ANFIS, and LSSVM, respectively. The comparative study indicated that the LSSVM had the best performance regarding both graphical and statistical error analyses among the newly proposed models and previously reported models in the literature.

A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through "factors" that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a data-set of nouns. We provide an estimate of the number of concepts that can be stored and retrieved by a large-scale cortical network, the Potts network, which is perhaps approximately 10⁷ with human cortical parameters. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.

Maximum hardness and hardened depth are the responses of interest in relation to the laser hardening process. These values define heat treatment quality and have a direct impact on mechanical performance. This paper aims to develop models capable of predicting the shape of the hardness profile depending on laser process parameters for controlling laser hardening quality (LHQ), or rather the response values. An experimental study was conducted to highlight hardened profile sensitivity to process input parameters such as laser power (P_L), beam scanning speed (V_S) and initial hardness in the core (H_C). LHQ modeling was conducted by modeling attributes extracted from the hardness profile curve using two effective techniques based on the punctual and geometrical approaches. The process parameters with the most influence on the responses were laser power, beam velocity and initial hardness in the core. The obtained results demonstrate that the geometrical approach is more accurate and credible than the punctual approach according to performance assessment criteria.

In recent years, the unmanned aerial vehicle (UAV) synthetic aperture radar (SAR) has become a highly sought-after topic for its wide applications in the field of target recognition, detection, and tracking. However, SAR automatic target recognition (ATR) models based on deep neural networks (DNN) are suffering from adversarial examples. Generally, non-cooperators rarely disclose any information about SAR-ATR models, making adversarial attacks challenging. In this situation, we propose Transferable Adversarial Network (TAN) to attack these models with highly transferable adversarial examples. The proposed method improves the transferability via a two-player game, in which we simultaneously train two encoder-decoder models: a generator that crafts malicious samples through a one-step forward mapping from original data, and an attenuator that weakens the effectiveness of malicious samples by capturing the most harmful deformations. In particular, compared to traditional iterative methods, our approach is able to one-step map original samples to adversarial examples, thus enabling real-time attacks. Experimental results indicate that the proposed approach achieves state-of-the-art transferability with acceptable adversarial perturbations and minimum time costs compared to existing attack methods, i.e., it excellently realizes real-time transferable adversarial attacks.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

In this paper, a special recurrent neural network (RNN) called \emph{Long Short-Term Memory (LSTM)} is used to design a virtual load sensor that estimates the mass of heavy vehicles. The estimation algorithm consists of a two-layer LSTM network, with the two layers based on sequence-to-sequence and sequence-to-one logic, respectively. The network estimates the vehicle mass based on the vehicle speed, longitudinal acceleration, engine speed, engine torque, and the accelerator pedal position. The network is trained and tested with a data set collected in a high-fidelity simulation environment called Truckmaker. Training data is generated in acceleration maneuvers in a range of speeds whereas test data is obtained by simulating the vehicle in a Worldwide harmonized light vehicles test cycle (WLTC). Preliminary results show that, with the proposed approach, the heavy-vehicle mass can be estimated as accurately as commercial load sensors in a range of load mass as wide as four tons.

This work addresses the challenge of EEG visual multiclass classification into 40 classes for Brain-Computer interface applications, by using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage, since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, performing multiclassifiers based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and Minimum-Norm Estimate algorithms are implemented to select discriminant channels and enhance EEG data. Hence, deep EEGNet and Convolutional-recurrent neural networks are implemented separately to classify EEG data of image visualization into 40 labels. By using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures, respectively. Satisfactory results obtained with this method offer a new implementation opportunity for multi-task BCI applications by utilizing a reduced number of channels (&lt;50%), compared to those presented in the related literature where the whole set of channels is used.

Image denoising has been one of the important problems in the field of computer vision, and it has a wide range of practical value in many applications, such as medical image processing, image enhancement, and computational photography. Traditional image denoising methods are usually based on hand-designed features and filters, but these methods perform poorly under complex noise and image structures. In recent years, the rapid development of neural network technology has revolutionized the image-denoising task. This paper introduces the knowledge about neural networks and image denoising, explores the impact of neural networks on image denoising, and how is it possible to denoise images by neural networks. It also summarises other image-denoising methods and finally points out the challenges and problems faced by image-denoising at present. Some possible new development directions are proposed to provide new solutions for image-denoising researchers and to promote the development of the field.

In recent years, advancements in brain science and neuroscience have significantly influenced the field of computer science, particularly in the domain of reinforcement learning (RL). Drawing insights from neurobiology and neuropsychology, researchers have leveraged these findings to develop novel mechanisms for understanding intelligent decision-making processes in the brain. Concurrently, the emergence of quantum computing has opened new frontiers in artificial intelligence, leading to the development of quantum machine learning (QML). This study introduces a novel model that integrates Quantum Spiking Neural Networks (QSNN) and Quantum Long Short-Term Memory (QLSTM) architectures, inspired by the complex workings of the human brain. Specifically designed for reinforcement learning tasks in energy-efficient environments, our approach progresses through two distinct stages mirroring sensory and memory systems. In the initial stage, analogous to the brain’s hypothalamus, low-level information is extracted to emulate sensory data processing patterns. Subsequently, resembling the hippocampus, this information is processed at a higher level, capturing and memorizing correlated patterns. We conduct a comparative analysis of our model against existing quantum models such as Quantum Neural Networks and their classical counterparts, elucidating its unique contributions. Through empirical results, we aim to underscore the effectiveness of our approach in optimizing energy consumption in practical scenarios.

The paper concludes the first research on mouth-based Emotion Recognition (ER), adopting a Transfer Learning (TL) approach. Transfer Learning results paramount for mouth-based emotion ER, because a few data sets are available, and most of them include emotional expressions simulated by actors, instead of adopting a real-world categorization. Using TL we can use fewer training data than training a whole network from scratch, thus more efficiently fine-tuning the network with emotional data and improving the convolutional neural network accuracy in the desired domain. The proposed approach aims at improving the Emotion Recognition dynamically, taking into account not only new scenarios but also modified situations with respect to the initial training phase, because the image of the mouth can be available even when the whole face is visible only in an unfavourable perspective. Typical applications include automated supervision of bedridden critical patients in an healthcare management environment, or portable applications supporting disabled users having difficulties in seeing or recognizing facial emotions. This work takes advantage from previous preliminary works on mouth-based emotion recognition using CNN deep-learning, and has the further benefit of testing and comparing a set of networks on large data sets for face-based emotion recognition well known in literature. The final result is not directly comparable with works on full-face ER, but valorizes the significance of mouth in emotion recognition, obtaining consistent performances on the visual emotion recognition domain.

Selecting road networks in cartographic generalization has consistently posed formidable challenges, driving research towards the application of intelligent models. Despite previous efforts, the accuracy and connectivity preservation in these studies, particularly when dealing with road types of similar sample sizes, still warrant improvement. To address these shortcomings, we introduce a Heterogeneous Graph Attention Network (HAN) for road selection, where feature masking method is initially utilized to assess the significance of road features. Concentrating on the most relevant features, two meta-paths are introduced within the HAN framework: one for aggregating features of the same road type within the first-order neighborhood, emphasizing local connectivity, and another extending this aggregation to the second-order neighborhood, capturing a broader spatial context. For a comprehensive evaluation, we introduce a set of metrics considering both quantitative and qualitative aspects of the road network. Compared to traditional neural networks, our HAN model demonstrates superior accuracy and F1-score, particularly for road types with comparable samples. Additionally, it enhances the overall connectivity of the selected network. In summary, our HAN-based method provides an advanced solution for road network selection, surpassing previous approaches in terms of accuracy and connectivity preservation.

Dyslipidemia (Dys) is a disease characterised by abnormally high levels of lipids in the 1 blood. It causes the deposits of lipids on the arterial wall, leading to the insurgence of atherosclerosis, 2 i.e. the increased thickness of arterial walls, which finally increases the risk of cardiovascular diseases. 3 Dyslipidemia is as comorbidity of Type 2 Diabetes Mellitus (T2DM). A set of genes has been associated 4 with dyslipidemia, but examining the regulation of such genes in age and sex is still an open research 5 field. In this study, starting from publicly available databases, we select genes associated with 6 dyslipidemia and we analyse their basal level changes by means of age and sex. Also studying the 7 networks associated to the genes, we identify the rewiring changes showing that there exists a set of 8 genes whose expression changes with age in: artery tibial, artery aorta and blood. Finally, we report 9 about changes associated to gender atributes in the extracted data

Dyslipidemia (Dys) is a disease characterised by abnormally high levels of lipids in the blood. It causes the deposits of lipids on the arterial wall leading to the insurgence of atherosclerosis, i.e. the increased thickness of arterial walls, which finally increases the risk of cardiovascular diseases. Dyslipidemia is a comorbidity of Type 2 Diabetes Mellitus (T2DM). A set of genes has been associated with dyslipidemia, but examining the regulation of such genes in age and sex is still an open research field. In this study, we select from publicly available databases the genes associated with dyslipidemia and analyse changes in the basal level of such genes by age and sex. Moreover, we also distinct differential rewiring of the related gene association network in males and females. Our results show that there exist a set of genes whose expression changes with age in artery tibial, artery aorta and blood. Moreover, there exist significant differences between sex.

Deep learning methods have been widely used in PolSAR image classification. To learn the polarimetric information, many deep learning methods expect to learn high-level semantic features from original PolSAR data. However, only original data cannot learn multiple scattering features and complex structures for extremely heterogeneous terrain objects. In addition, deep learning methods always cause edge confusion due to the high-level features. To overcome these shortages, we propose a double-channel CNN network combined with an edge-preserving MRF model(DCCNN-MRF) for PolSAR image classification. Firstly, to combine complex matrix data and multiple scattering features together, a double-channel convolution network(DCCNN) is developed, which consists of a Wishart-based complex matrix and multi-feature subnetworks. The Wishart-based complex matrix network can learn the statistical characteristics and channel correlation well, and the multi-feature network can learn high-level semantic features well. Then, a unified network framework is designed to fuse two kinds of features to enhance advantageous features and reduce redundant ones. Finally, an edge preserving MRF model is designed to combine with the DCCNN network. In the MRF model, a sketch map-based edge energy function is designed by defining adaptive weighted neighborhood for edge pixels. Experiments are conducted on four real PolSAR data sets with different sensors and bands. Experimental results demonstrate the effectiveness of the proposed DCCNN-MRF method.

Remote sensing technology is crucial for accurate rooftop detection, benefiting urban planning, disaster management, and solar resource estimation. This study employs Efficient Interactive Segmentation (EISEG) to enhance the efficiency of remote sensing image labeling, with a particular focus on rooftop detection. It is necessary to use modern technology because traditional manual labelling methods are labor-intensive and complicated. The study introduces a novel framework on deep learning semantic segmentation models, facilitating an efficient approach to rooftop identification using high-resolution UAV remote sensing datasets. Large dataset of labeled UAV rooftop building images, in which each superpixel region is assigned a binary label indicating rooftop presence. Advanced methods including Asymmetric Neural Network (ANN), Dual At-tention Network (DANet), PP-LiteSeg, and Deeplab3 are implemented for automatic rooftop detection due to their higher performance and advanced architectures. These models are executed on the Baidu deep learning platform PaddlePaddle, generating initial rooftop segmentation maps crucial for estimating photovoltaic resources. The ANN model emerges with the highest accuracy at 96%, followed by DANet at 95.09%, PP-LiteSeg at 94.54%, and Deeplab3 at 81.61%. The outcomes presenting efficient models for automated rooftop identification, and demonstrating the continuous need for improving deep learning techniques in smart and sustainable cities.

Despite numerous studies in statistical downscaling methodology, there remains a lack of methods that can downscale from precipitation modeled in global climate models to regional level high resolution gridded precipitation. This paper reports a novel downscaling method using a Generative Adversarial Network (GAN), CliGAN, which can downscale large-scale annual maximum precipitation given by simulation of multiple atmosphere-ocean global climate models (AOGCM) from Coupled Model Inter-comparison Project 6 (CMIP6) to regional-level gridded annual maximum precipitation data. This framework utilizes a convolution encoder-dense decoder network to create a generative network and a similar network to create a critic network. The model is trained using an adversarial training approach. The critic uses the Wasserstein distance loss function and the generator is trained using a combination of adversarial loss Wasserstein distance, structural loss with the multi-scale structural similarity index (MSSIM), and content loss with the Nash-Sutcliff Model Efficiency (NS). The MSSIM index allowed us to gain insight into the model’s regional characteristics and shows that relying exclusively on point-based error functions, widely used in statistical downscaling, may not be enough to reliably simulate regional precipitation characteristics. Further use of structural loss functions within CNN-based downscaling methods may lead to higher quality downscaled climate model products.

In the trend of transforming existing systems and services into non-face-to-face models, the concert industry is also showing movements toward transitioning to virtual formats. Physical concerts in the real world require venues that can accommodate hundreds to tens of thousands of spectators, but non-face-to-face methods that can accommodate large audiences face various limitations. Moreover, to elevate the satisfaction level of virtual concert attendees to that of real-world concerts, it's important to implement interaction between performers and audiences. Modern metaverse platforms apply cutting-edge network technologies to accommodate numerous users within a single channel. Many researchers are adopting network technologies such as SDN (Software Defined Networking) and CDN (Content Delivery Network) to set up a virtual concert that can accommodate large audiences. In this paper, we propose a network framework to be designed for the composition of virtual concerts. In particular, we separate a channel dedicated to interaction in order to provide an immersive experience of exchanging interactions between performers and audiences. As massive audiences transmitting interaction data to the performer in a 1:N format can lead to problems with acceptance and latency, this study introduces a concept of a channel form called 'Zone' and proposes an interaction data channel network framework that does not compromise immersion. The proposed framework supports tasks for effectively transmitting interaction data using network technologies for metaverse platforms like XDN and clustering algorithms like fuzzy c-means. We also suggest a CDN-based architecture that can ensure low latency for performers to transmit interaction data to the audience.

In several emergency situations, during natural or human-caused disasters, frontline responders need to be able to communicate and collaborate to properly carry out the relief mission. Some countries are building their national Public Safety Mobile Broadband based on cellular LTE technology to provide fast, safe, and secure emergency services. Otherwise, in several emergency situations, the cellular antennas can be overloaded or partially damaged in manner to affect the group communication services. Since few last years, direct device-to-device (D2D) communications have been proposed by 3GPP as an underlay to Long Term Evolution (LTE) networks based on proximity, reuse, and hop gains. This paper focuses on the loosely coupled model based on D2D direct communication for Public Safety context. Many scenarios related to user membership and network management are detailed. Both “less cost” and “optimized tree” approaches are proposed, implemented, and their performance evaluated in terms of network updates number and resulting average Channel Quality Indicator (CQI). Other optimization approaches with different CQI threshold and optimization interval values have been implemented, simulated and their performance are compared with the “optimized tree”.

One of the significant challenges today in the brain-machine interface using invasive methods is the stability of the chronic record. In recent years, polymer-based electrodes have gained notoriety for achieving mechanical strength values close to that of brain tissue, promoting a lower immune response to the implant. In this work, we fabricated fully polymeric electrodes based on PEDOT:PSS for neural recording in Wistar rats. We characterized the electrical properties and both in-vitro and in-vivo functionality of the electrodes. Also, we employed histological processing and microscopical visualization to evaluate tecidual immune response in 7, 14, and 21 days post-implant days. Electrodes with 400-micrometer channels showed a 12dB signal-to-noise ratio. Local field potentials were characterized under two conditions: anesthetized and free-moving. There was a proliferation of microglia to the tissue-electrode interface in the first days, with a decrease after 14 days. Astrocytes also migrated to the interface, but there was no continuous recruitment of these cells in the tissue, showing inflammatory stability at 21 days. The signal was not affected by this inflammatory action, demonstrating that fully polymeric electrodes can be an alternative to prolong the valuable time of neural recordings.

This work describes and compares the backpropagation algorithm with the Extended Kalman filter, a second-order training method which can be applied to the problem of learning neural network parameters and is known to converge in only a few iterations. The algorithms are compared with respect to their effectiveness and speed of convergence using simulated data for both, a regression and a classification task.

Optical neural networks (ONNs), or optical neuromorphic hardware accelerators, have the potential to dramatically enhance the computing power and energy efficiency of mainstream electronic processors, due to their ultra-large bandwidths of up to 10’s of terahertz together with their analog architecture that avoids the need for reading and writing data back-and-forth. Different multiplexing techniques have been demonstrated to demonstrate ONNs, amongst which wavelength-division multiplexing (WDM) techniques make sufficient use of the unique advantages of optics in terms of broad bandwidths. Here, we review recent advances in WDM-based ONNs, focusing on methods that use integrated microcombs to implement ONNs. We present results for human image processing using an optical convolution accelerator operating at 11 Tera operations per second. The open challenges and limitations of ONNs that need to be addressed for future applications are also discussed.

Relay protection service is the most crucial service carried by the electric power communication network, which is directly linked to the safe operation of the power grid. In the route planning of power services, a route planning architecture for the power communication network is constructed in this paper, considering the operation and maintenance requirements, such as relay protection service overload (RPSO) and dual route. To minimize network risk variance, the problem of single-service route allocation is formulated by taking the factors into account such as service delay, link bandwidth utilization, and RPSO constraints. Based on $k$ shortest paths algorithm, a route planning scheme for the power services is proposed, which considers RPSO and risk balance, and a strategy for implementing multi-service route planning of the communication network is studied. The simulation results show that the proposed route planning strategy can effectively avoid relay protection service overload, reduce network risk variance, and balance network risk.

Recent studies have proven that synthetic aperture radar (SAR) automatic target recognition (ATR) models based on deep neural networks (DNN) are vulnerable to adversarial examples. However, existing attacks are easily failed in the case where adversarial perturbations cannot be fully fed to victim models. We call this situation perturbation offset. Moreover, since background clutter takes up most of the areas in SAR images and has low relevance to recognition results, fooling models with global perturbations is quite inefficient. This paper proposes a semi-whitebox attack network, called Universal Local Adversarial Network (ULAN), to generate universal adversarial perturbations (UAP) for the target regions of SAR images. In the proposed network, we calculate the model’s attention heatmaps through layer-wise relevance propagation (LRP), which is used to locate the target regions of SAR images that have high relevance to recognition results. In particular, we utilize a generator based on the U-Net to learn the mapping from noise to UAPs and craft adversarial examples by adding the generated local perturbations to target regions. Experiments indicate that the proposed method fundamentally prevents perturbation offset and achieves comparable attack performance to conventional global UAPs by perturbing only a quarter or less of SAR image areas.

Vermicomposting is one of the most important waste management techniques in the process of vermiculture. In this study, a Neural Network-assisted novel paradigm is proposed to predict waste from vermicomposting. The proposed Neural Network Skeleton is based on a Gallium Arsenide Processing Schema, which is used to separate wastes. By comparing the proposed sys-tem with existing methods, it was found that the proposed approach had the highest average prediction ratio of 91.32%, outperforming other techniques like ERD, RNN, and Deep LSTM. The separation ratio analysis also demonstrated the effectiveness of the proposed method, with a range of 45-94%. Furthermore, the study emphasizes the importance of chemical equilibrium and the effectiveness of our proposed Gallium Arsenide Processing Schema in achieving high prediction and separation accuracies, showcasing its potential for practical application in waste management processes. Lastly, the prediction of the process evolution stages is detailed, indicating the efficiency of the proposed system in achieving various levels of waste separation. Overall, the study provides valuable insights into the potential of the proposed methods in op-timizing wastewater management processes, paving the way for more effective and sustainable vermicomposting practices.

Temperature and pressure sensors currently encounter challenges such as slow response times, large sizes, and insufficient sensitivity. To address these issues, we developed tetraphenylethylene (TPE)-doped polyvinylidene fluoride (PVDF) nanofiber membranes using electrospinning, with process parameters optimized through a convolutional neural network (CNN). We systematically analyzed the effects of PVDF concentration, spinning voltage, tip-to-collector distance, and flow rate on fiber morphology and diameter. The CNN model achieved high predictive accuracy, resulting in uniform and smooth nanofibers under optimal conditions. Incorporating TPE enhanced the hydrophobicity and mechanical properties of the nanofibers. Additionally, the fluorescent properties of the TPE-doped nanofibers remained stable under UV exposure and exhibited significant linear responses to temperature and pressure variations. The nanofibers demonstrated a temperature sensitivity of -0.976 gray value/°C and pressure sensitivity with an increase in fluorescence intensity from 537 a.u. to 649 a.u. under 600 g pressure. These findings highlight the potential of TPE-doped PVDF nanofiber membranes for advanced temperature and pressure sensing applications.

As modern systems are becoming more complex their control strategy cannot longer relay only on measurement information that usually comes from probes but also from mathematical models. Those systems models can lead to unbearable computation times due to their own complexity, turning the control process non-viable, which leads to the implementation of surrogate models that enable to achieve estimates within acceptable time to take decisions. A control trained with Deep Reinforcement Learning algorithm, using a Physics-Informed Neural Network to obtain the temperature map on the following time step, replaces the need of running Direct Numerical Simulations. On this work we considered an 1D heat conduction problem, which temperature distribution feeds a control system to activate a heat source aiming to obtain a constant, previously defined, temperature value. With this approach, control training becomes much faster without the need of performing numerical simulations or laboratory measurements, as well the control is taken based on Neural Network enabling its implementation on simple processors to edge computing.

Securing the structural safety of blades has become crucial, owing to the increasing size and weight of blades resulting from the recent development of large wind turbines. Composites are primarily used for blade manufacturing because of their high specific strength and specific stiff-ness. However, in composite blades, joints may experience fractures from the loads generated during wind turbine operation, leading to deformation caused by changes in the structural stiff-ness. In this study, 7,132 debonding damage data, classified by damage type, position, and size, are selected to predict debonding damage based on natural frequency. The change in the natural frequency caused by debonding damage is acquired through finite element (FE) modeling and modal analysis. Synchronization between the FE analysis model and manufactured blades is achieved through modal testing and data analysis. Finally, the relationship between the debond-ing damage and the change in natural frequency is examined using artificial neural network techniques

Sparse training (ST) aims to ameliorate deep learning by replacing fully connected artificial neural networks (ANNs) with sparse or ultra-sparse ones, such as brain networks are, therefore it might benefit to borrow brain-inspired learning paradigms from complex network intelligence theory. Here, we launch the ultra-sparse advantage challenge, whose goal is to offer evidence on the extent to which ultra-sparse (around 1% connection retained) topologies can achieve any leaning advantage against fully connected. Epitopological learning is a field of network science and complex network intelligence that studies how to implement learning on complex networks by changing the shape of their connectivity structure (epitopological plasticity). One way to implement Epitopological (epi- means new) Learning is via link prediction: predicting the likelihood of non-observed links to appear in the network. Cannistraci-Hebb learning theory inspired the CH3-L3 network automata rule for link prediction which is effective for general-purpose link prediction. Here, starting from CH3-L3 we propose Epitopological Sparse Meta-deep Learning (ESML) to apply Epitopological Learning to sparse training. In empirical experiments, we find that ESML learns ANNs with ultra-sparse hyperbolic (epi-)topology in which emerges a community layer organization that is meta-deep (meaning that each layer also has an internal depth due to power-law node hierarchy). Furthermore, we discover that ESML can in many cases automatically sparse the neurons during training (arriving even to 30% neurons left in hidden layers), this process of node dynamic removal is called percolation. Starting from this network science evidence, we design Cannistraci-Hebb training (CHT), a 4-step training methodology that puts ESML at its heart. We conduct experiments on 7 datasets and 5 network structures comparing CHT to dynamic sparse training SOTA algorithms and the fully connected counterparts. The results indicate that, with a mere 1% of links retained during training, CHT surpasses fully connected networks on VGG16, GoogLeNet, ResNet50, and ResNet152. This key finding is an evidence for ultra-sparse advantage and signs a milestone in deep learning. CHT acts akin to a gradient-free oracle that adopts CH3-L3-based epitopological learning to guide the placement of new links in the ultra-sparse network topology to facilitate sparse-weight gradient learning, and this in turn reduces the convergence time of ultra-sparse training. Finally, CHT offers the first examples of parsimony dynamic sparse training because, in many datasets, it can retain network performance by percolating and significantly reducing the node network size. Our code is available at: https://github.com/biomedical-cybernetics/Cannistraci-Hebb-training.

Facial Emotion Recognition (FER) is crucial across psychology, neuroscience, computer vision, and machine learning due to the diversified and subjective nature of emotions, varying considerably across individuals, cultures, and contexts. This paper investigates the impact of histogram equalization, data augmentation and model optimization strategies on three well-known FER datasets using pre-trained VGG models. Additionally, this paper showcases the effectiveness of different regularization techniques, callbacks, and learning schedulers in enhancing model performance by conducting extensive experiments. The model evaluation is discussed in terms of the following metrics: Accuracy, Area Under the Receiver Operating Characteristic Curve (AUC-ROC), Area Under the Precision-Recall Curve (AUC-PRC), and Weighted F1 score. Notably, the fine-tuned VGG models exhibit state-of-the-art performance compared to more complex conventional transfer learning models resulting in accuracies of 100%, 95.92%, and 69.65% on the CK+, KDEF, and FER2013 datasets, respectively.

In this paper, a class of coupled competitive neural networks, which subject to disturbance and discontinuous activation functions, is concerned. To realize the fixed-time quasi-bipartite synchronization, an aperiodic intermittent controller is initially designed. Subsequently, by combining the fixed-time stability theory and nonsmooth analysis, several criteria are established to ensure the bipartite synchronization in fixed time. Moreover, synchronization error bounds and settling time estimates are provided. Finally, numerical simulations are presented to verify the main results.

The Spiking Neural Network (SNN) has attracted more and more attention recently. It adopts binary spike signals to transmit information. Benefitting from the information passing paradigm of SNNs, the multiplications of activations and weights can be replaced by additions, which are more energy-efficient. However, its ``Hard Reset" mechanism for the firing activity would ignore the difference among membrane potentials when the membrane potential is above the firing threshold, causing information loss. Meanwhile, quantifying the membrane potential to 0/1 spikes at the firing instants will inevitably introduce the quantization error thus bringing about information loss too. To address these problems, we propose to use the ``Soft Reset" mechanism for the supervised training-based SNNs, which will drive the membrane potential to a dynamic reset potential according to its magnitude, and Membrane Potential Rectifier (MPR) to reduce the quantization error via redistributing the membrane potential to a range close to the spikes. Results show that the SNNs with the ``Soft Reset" mechanism and MPR outperform their vanilla counterparts on both static and dynamic datasets.

During geomagnetic storms, which are a result of solar wind interaction with the Earth’s magnetosphere, geomagnetically induced currents (GICs) begin to flow in the long-distance high-voltage power grids on the Earth’s surface. It causes a number of negative phenomena that affect the normal operation of the entire electric power system. To investigate the nature of the phenomenon and its possible effects on transformers, a GIC monitoring system was created in 2011, the devices of which were installed at five substations of the Kola-Karelian power transit in northwestern Russia. Over 12 years of operating the system a large amount of data has been accumulated, which cannot be analyzed manually within a reasonable amount of time. To analyze the constantly growing volume of recorded data effectively, a method for automatic classification of GIC in autotransformer neutral was proposed. The method is based on a continuous wavelet transform of the neutral current data combined with a convolutional neural network (CNN) to classify the obtained scalogram images. As the result of comparing four CNNs with different architectures, a model that showed excellent GIC classification performance on the validation set (100.00% accuracy and loss of 0.0115) was chosen.

In this paper, we demonstrate that fixed-weight layers, generated from random distribution or logistic functions, can effectively extract significant features from input data, resulting in high accuracy on a variety of tasks, including Fisher’s iris, Wisconsin Breast Cancer, and MNIST datasets. We have observed that logistic functions yield high accuracy with less dispersion in results. We have also assessed the precision of our approach under conditions of minimizing spikes number generated in the network, it is a practically useful for reducing energy consumption in spiking neural networks. Our findings reveal that the proposed method demonstrates a highest accuracy on Fisher’s iris and MNIST datasets with logistic regression. Furthermore, they surpass the accuracy of the conventional (non-spiking) approach using logistic regression in the case of Wisconsin Breast Cancer. We have also investigated the impact of non-stochastic spike generation on accuracy.

Keywords: Аrtificial neural network, electric drive system, database, stability, training algorithm, technological mechanisms.

In Holter monitoring, the precise detection of standard heartbeats and Ventricular Premature Contractions (PVCs) is paramount for accurate cardiac rhythm assessment. This study introduces a novel application of the 1D U-Net neural network architecture aimed at enhancing PVC detection in Holter recordings. Training data comprised the Icentia11k, INCART DB, and our custom dataset. The model’s efficacy was subsequently validated against traditional Holter analysis methodologies across multiple databases, including AHA DB, MIT 11 DB, NST, and another custom dataset encompassing challenging real-world examples. The results underscored the 1D U-Net model’s prowess in QRS complex detection, achieving near-perfect balanced accuracy scores across all databases. PVC detection exhibited variability, with balanced accuracy scores ranging from 0.909 to 0.986. Despite some databases, like the AHA DB, showcasing lower sensitivity metrics, their robust balanced accuracy accentuates the model’s equitable performance in discerning both false positives and negatives. In conclusion, while the 1D U-Net architecture is a formidable tool for QRS detection, there’s a clear avenue for further refinement in its PVC detection capability, given the inherent complexities and noise challenges in real-world PVC occurrences.

In South Korea, demolition waste (DW) management has become increasingly significant owing to the rising number of old buildings. Effective DW management requires an efficient approach that accurately quantifies and predicts the generation of DW (DWG) of various types, which necessitates access to the required information or technology capable of achieving this. Hence, we developed an artificial intelligence-based model that predicts the generation of ten DW types, specifically from buildings in redevelopment areas. We used an artificial neural network algorithm with < 10 neurons in the hidden layer to derive individual input variables and optimal hyperparameters for each DW type. All DWG prediction models achieved an average validation and test prediction performance (R²) of 0.970 and 0.952, respectively, with their ratios of percent deviation ≥ 2.5, ver-ifying them as excellent models. Moreover, a Shapley additive explanations analysis revealed that DWG was most impacted by the floor area for all the DW types, with a positive correlation with DWG. Conversely, other factors showed either a positive or negative correlation with DWG de-pending on the DW type. The study findings will enable demolition companies and local gov-ernments in making informed decisions for efficient DW management and resource allocation by accurately predicting the generation of various types of DW.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.