Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1 and Part2, the author previously reported experimental evaluations on Genetic Algorithm and Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. This article constitutes Part3 of the series of comparative research. In this study, Differential Evolution is adopted as the third instance of major evolutionary algorithms. The experimental results show a statistically significant superiority of DE over both GA and ES (p < .01). In addition, DE exhibits its robustness to variations in hyperparameter configurations (the number of offsprings and generations). In the previous experiments, both ES and GA showed significant performance differences depending on the configurations, whereas in the experiment reported in this article, such differences are not detected for DE.

Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. The author previously reported experimental evaluations on Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. In this study, Genetic Algorithm is adopted as another instance of major evolutionary algorithms. Experimental results demonstrate that there was no statistically significant difference between the experimental performances of GA and ES, but the priority of generations and offsprings was different; GA performed better with a greater number of generations while ES performed better with a greater number of offsprings. Eight hidden units were the best among four variations (4, 8, 16 or 32 units), which aligns with previous study using ES.

Evolutionary algorithms find applicability in the reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. The author previously reported experimental evaluations on Evolution Strategy for reinforcement learning of neural networks, utilizing the pendulum control task. In this study, the Acrobot control task is adopted as another task. Experimental results demonstrate that ES successfully trained a Multi-Layer Perceptron to achieve a remarkable height of 99.85% concerning the maximum height. However, the trained MLP failed to maintain the chain end in an upright position throughout an episode. In this study, it was observed that employing 8 hidden units in the neural network yielded better results with statistical significance compared to using 4, 16, or 32 hidden units. Furthermore, the findings indicate that a larger population size in ES led to a more extensive exploration of potential solutions over a greater number of generations, which aligns with the previous study.

Evolutionary algorithms and swarm intelligence algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using these algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1, 2 and 3, the author previously reported experimental evaluations on Evolution Strategy, Genetic Algorithm, and Differential Evolution for reinforcement learning of neural networks, utilizing the Acrobot control task. This article constitutes Part4 of the series of comparative research. In this study, Particle Swarm Optimization is adopted as an instance of major swarm intelligence algorithms. The experimental result shows that PSO performed worse than all of DE, GA and ES. The difference between PSO and DE was statistically significant (p<.01). In addition, PSO exhibited lower capability in exploring solutions in high-dimensional search spaces than DE, GA, and ES did. A larger swarm size compensated for the weakness of PSO in global exploration, thus making itself more beneficial than a larger number of swarm search iterations.

In this study a novel approach of designing automatic control systems with the help of AI tools is proposed. Given plant dynamics, expected references, and expected disturbances, design of optimal neural-network based controller is done automatically. Several common reference types are studied including step, square, sine, sawtooth and trapezoid functions. Expected reference-disturbance pairs are used to train the system for finding optimal neural-network controller parameters. A separate test set is used to test the system for unexpected reference-disturbance pairs to show the generalization performance of the proposed system. Parameters of a real DC motor are used to test the proposed approach. Real DC motor’s parameters are estimated using particle swarm optimization (PSO) algorithm. Initially, a proportional-integral (PI) controller is designed using PSO algorithm for finding simple controller’s parameters optimally and automatically. Starting with neural-network equivalent of optimal PI controller, optimal neural-network controller is designed using PSO algorithm for training again. Simulations are conducted with estimated parameters for diverse set of training and test patterns. Results are compared with optimal PI controller’s performance and reported in the corresponding section. Encouraging results are obtained suggesting further research in the proposed direction.

Optical artificial neural networks (ONNs) — analog computing hardware tailored for machine learning [1,2] — have significant potential for ultra-high computing speed and energy efficiency [3]. We propose a new approach to architectures for ONNs based on integrated Kerr micro-comb sources [4] that is programmable, highly scalable and capable of reaching ultra-high speeds. We experimentally demonstrate the building block of the ONN — a single neuron perceptron — by mapping synapses onto 49 wavelengths of a micro-comb to achieve a high single-unit throughput of 11.9 Giga-FLOPS at 8 bits per FLOP, corresponding to 95.2 Gbps. We test the perceptron on simple standard benchmark datasets — handwritten-digit recognition and cancer-cell detection — achieving over 90% and 85% accuracy, respectively. This performance is a direct result of the record small wavelength spacing (49GHz) for a coherent integrated microcomb source, which results in an unprecedented number of wavelengths for neuromorphic optics. Finally, we propose an approach to scaling the perceptron to a deep learning network using the same single micro-comb device and standard off-the-shelf telecommunications technology, for high-throughput operation involving full matrix multiplication for applications such as real-time massive data processing for unmanned vehicle and aircraft tracking.

Model understanding is critical in many domains, particularly those involved in high-stakes decisions, i.e., medicine, criminal justice, and autonomous driving. Explainable AI (XAI) methods are essential for working with black-box models such as Convolutional Neural Networks. This paper evaluates the traffic sign classifier of Deep Neural Network (DNN) from the Programmable Systems for Intelligence in Automobiles (PRYSTINE) project for explainability. The results of explanations were further used for the CNN PRYSTINE classifier vague kernels` compression. After all, the precision of the classifier was evaluated in different pruning scenarios. The proposed classifier performance methodology was realised by creating the original traffic sign and traffic light classification and explanation code. First, the status of the kernels of the network was evaluated for explainability. For this task, the post-hoc, local, meaningful perturbation-based forward explainable method was integrated into the model to evaluate each kernel status of the network. This method enabled distinguishing high and low-impact kernels in the CNN. Second, the vague kernels of the classifier of the last layer before the fully connected layer were excluded by withdrawing them from the network. Third, the network's precision was evaluated in different kernel compression levels. It is shown that by using the XAI approach for network kernel compression, the pruning of 5% of kernels leads only to a 1% loss in traffic sign and traffic light classification precision. The proposed methodology is crucial where execution time and processing capacity prevail.

Forest fire identification is important for forest resource protection. Effective monitoring of forest fires requires the deployment of multiple monitors with different viewpoints, while most traditional recognition models can only recognize images from a single source. By ignoring the information from images with different viewpoints, these models produce high rates of missed and false alarms. In this paper, we propose a graph neural network model based on the similarity of dynamic features of multi-view images to improve the accuracy of forest fire recognition. The input features of the nodes on the graph are converted into relational features of different gallery pairs by establishing pairs (nodes) representing different viewpoint images and gallery images. The new feature library relationship is used to update the image gallery with dynamic features in order to achieve the estimation of similarity between images and improve the image recognition rate of the model. In addition, to reduce the complexity of image pre-processing process and extract key features in images effectively, this paper also proposes a dynamic feature extraction method for fire regions based on image segment ability. By setting the threshold value of HSV color space, the fire region is segmented from the image, and the dynamic features of successive frames of the fire region are extracted. The experimental results show that, compared with the baseline method Resnet, this paper's method is more effective in identifying forest fires, and its recognition accuracy is improved by 2%. And the scheme of this paper can adapt to different forest fire scenes, with better generalization ability and anti-interference ability.

The application of artificial intelligence to point-of-care testing (POCT) disease detection has become a hot research field, in which breath detection which detects the patient's exhaled VOCs combined with sensor arrays of Convolutional Neural Network (CNN) algorithms as a new lung cancer detection is attracting more researchers' attention. However, due to low accuracy, high complexity computation and large number of parameters make the CNN algorithms difficult transplant to the embedded system of POCT devices. A lightweight neural network (LTNet) in this work is proposed to deal with this problem, and meanwhile, achieve high-precision classification of acetone and ethanol gases, which are respiratory markers for lung cancer patients. Compared to currently popular lightweight CNN models such as EfficientNet, LTNet has fewer parameters (32K) and its training weight size is only 0.155 MB. LTNet achieved an overall classification accuracy of 99.06% and 99.14% in the own mixed gas dataset and the University of California (UCI) dataset, which are both higher than that of the five existing models’, and it also offers the shortest training (844.38s and 584.67s) and inference time (23s and 14s) in the same validation set. Compared to the existing CNN models, LTNet is more suitable for resource-limited POCT devices.

Efficient traffic flow management at intersections is vital for optimizing urban transportation networks. This paper presents a comprehensive approach to refining traffic flow by analyzing the capacity of roads and integrating fuzzy logic-based traffic light control systems. We were examining the capacity of roads connecting intersections, considering factors such as road vehicle capacity, vehicle speed, and traffic flow volume, through detailed mathematical modelling and analysis. Control is determined by the maximum capacity of each road segment, providing valuable insights into traffic flow dynamics. Building upon this capacity and flow analysis, the research introduces a novel Intelligent Traffic Light Controller (ITLC) system based on fuzzy logic principles. By incorporating real-time traffic data and lever-aging fuzzy logic algorithms, our ITLC system dynamically adjusts traffic light timings to optimize vehicle flow at two intersections. The paper discusses the de-sign and implementation of the ITLC system, highlighting its adaptive capabilities in response to changing traffic conditions. Simulation results are presented, demonstrating effectiveness of the ITLC system in improving traffic flow and re-ducing congestion at intersections. Furthermore, this research provides an analysis of the mathematical models used to calculate road capacity, offering insights into the underlying principles of traffic flow optimization. Through the simulation, we have validated accuracy and reliability of our controller.

The Station logo is a way for a TV station to claim copyright, which can realize the analysis and understanding of the video by the identification of the station logo, so as to ensure that the broadcasted TV signal will not be illegally interfered. In this paper, we design a station logo detection method based on Convolutional Neural Network by the characteristics of the station, such as small scale-to-height ratio change and relatively fixed position. Firstly, in order to realize the preprocessing and feature extraction of the station data, the video samples are collected, filtered, framed, labeled and processed. Then, the training sample data and the test sample data are divided proportionally to train the station detection model. Finally, the sample is tested to evaluate the effect of the training model in practice. The simulation experiments prove its validity.

This paper introduces a novel architecture—bidirectional optical neural network (BONN)—for providing backward connections alongside forward connections in artificial neural networks (ANNs). BONN incorporates laser diodes and photodiodes and exploits the properties of Köhler illumination to establish optical channels for backward directions. Thus, it has bidirectional functionality that is crucial for algorithms such as the backpropagation algorithm. BONN has a scaling limit of 96 × 96 for input and output arrays, and a throughput of 8.5 × 1015 MAC/s. While BONN's throughput may rise with additional layers for continuous input, limitations emerge in the backpropagation algorithm as its throughput doesn't scale with layer count. Successful BONN-based implementation of the backpropagation algorithm requires the development of fast spatial light modulator to accommodate frequent data flow changes. A two-mirror-like BONN and its cascaded extension are alternatives for multilayer emulation, and they help save hardware space and increase the parallel throughput for inference. An investigation into the application of the clustering technique to BONN revealed its potential to help overcome scaling limits and to provide full interconnections for backward directions between doubled input and output ports. BONN's bidirectional nature holds promise for enhancing supervised learning in ANNs and increasing hardware compactness.

A scalable optical convolutional neural network (SOCNN) based on free-space optics and Koehler illumination was proposed to address the limitations of the previous 4f correlator system. Unlike Abbe illumination, Koehler illumination provides more uniform illumination and reduces crosstalk. SOCNN allows for scaling up of the input array and the use of incoherent light sources. Hence, the problems associated with 4f correlator systems can be avoided. We analyzed the limitations in scaling the kernel size and parallel throughput and found that SOCNN can offer a multilayer convolutional neural network with massive optical parallelism.

Using smartphone especially android platform has already got eighty percent market shares, due to aforementioned report, it becomes attacker’s primary goal. There is a growing number of private data onto smart phones and low safety defense measure, attackers can use multiple way to launch and to attack user’s smartphones.(e.g. Using different coding style to confuse the software of detecting malware). Existing android malware detection methods use multiple features, like safety sensor API, system call, control flow structure and data information flow, then using machine learning to check whether its malware or not. These feature provide app’s unique property and limitation, that is to say, from some perspectives it might suit for some specific attack, but wouldn’t suit for others. Nowadays most malware detection methods use only one aforementioned feature, and these methods mostly analysis to detect code, but facing the influence of malware’s code confusion and zero-day attack, aforementioned feature extraction method may cause wrong judge. So, it’s necessary to design an effective technique analysis to prevent malware. In this paper, we use the importance of word from apk, because of code confusion, some malware attackers only rename variables, if using general static analysis wouldn’t judge correctly, then use these importance value to go through our proposed method to generate picture, finally using convolutional neural network to see whether the apk file is malware or not.

There is a considerable amount of research in online social networks, most of which focuses on the structural analysis of social graphs. The interpersonal relationships of social networks, especially friend circle, can solve the cold start and sparsity problems, and through the relationship between social networks can effectively recommend users' favorite items (items), such as music , videos, brands/products, preferred tags, location, services, etc. User relationships in social networks are diverse and there are many different perspectives on different social networks. Associations among users can form multi-layered composite networks, and multi-layered social networks present new challenges and opportunities. Different relationships can influence users' preferences to different degrees, which in turn affects their behavior. Therefore, fusing multiple social networks is an effective way to improve recommendation. Although some studies have started to address multiple social network recommendations, simple linear superposition cannot reflect the coupling and nonlinear association between multiple social networks. In this paper, we propose a graph neural network recommendation model under social relationships based on this background. We first propose to compute the 2nd order collaborative signals and their intensities directly from the neighboring matrix for updating the node embedding of the graph convolution layer. Secondly by embedding historical evaluations, various social networks constituting different dimensions, the attention integration of user preferences by different social networks is achieved, and its effectiveness and scalability are demonstrated in theoretical derivation and experimental validation. The theoretical derivation and experimental validation demonstrate its effectiveness and scalability.

Augmented reality (AR) provides an opportunity for mobile fitness applications to show users real-time feedback on their current fitness activity. For such applications, it is essential to accurately track the user’s current fitness activity using available mobile sensors, such as inertial measurement units (IMUs). Convolutional neural networks (CNNs) have been shown to produce strong results in different time series classification tasks, including the recognition of activities of daily living. However, fitness activities can present unique challenges to the human activity recognition task (HAR), including greater similarity between individual activities and fewer available data for model training. In this paper, we evaluate the applicability of CNNs to the fitness activity recognition task (FAR) using IMU data and determine the impact of input data size and sensor count on performance. For this purpose, we adapted three existing CNN architectures to the FAR task and designed a fourth CNN variant, which we call the scaling fully convolutional network (Scaling-FCN). We designed a preprocessing pipeline and recorded a running exercise data set with 20 participants, in which we evaluated the respective recognition performances of the four networks, comparing them with three traditional machine learning methods commonly used in HAR. On our data set, all CNN architectures significantly outperformed traditional machine learning methods, reaching up to 97.14±1.36% classification accuracy on the test set for ResNet. Whereas a reduced input data size invariably led to a performance loss, removing specific sensors improved the performance of all CNN architectures, with our Scaling-FCN reaching the highest accuracy of 99.86±0.11%. Our results suggest that CNNs are generally well suited for fitness activity recognition, and noticeable performance improvements can be achieved if sensors are dropped selectively.

Identifying fake news on the media has been an important issue. This is especially true considering the wide spread of rumors on the popular social networks such as Twitter. Various kinds of techniques have been proposed for automatic rumor detection. In this work, we study the application of graph neural networks for rumor classification at a lower level, instead of applying existing neural network architectures to detect rumors. The responses to true rumors and false rumors display distinct characteristics. This suggests that it is essential to capture such interactions in an effective manner for a deep learning network to achieve better rumor detection performance. To this end we present a simplified aggregation graph neural network architecture. Experiments on publicly available Twitter datasets demonstrate that the proposed network has performance on a par with or even better than that of state-of-the-art graph convolutional networks, while significantly reducing the computational complexity.

The recent worldwide outbreak of the novel corona-virus (COVID-19) opened up new challenges to the research community. Artificial intelligence (AI) driven methods can be useful to predict the parameters, risks, and effects of such an epidemic. Such predictions can be helpful to control and prevent the spread of such diseases. The main challenges of applying AI is the small volume of data and the uncertain nature. Here, we propose a shallow Long short-term memory (LSTM) based neural network to predict the risk category of a country. We have used a Bayesian optimization framework to optimized and automatically design country-specific networks. We have combined the trend data and weather data together for the prediction. The results show that the proposed pipeline outperforms against state-of-the-art methods for 170 countries data and can be a useful tool for such risk categorization. The tool can be used to predict long-duration outbreak of such an epidemic such that we can take preventive steps earlier.

Most systems that are the subject of control engineering studies have some non-linearity. An example of this is the horizontal cylindrical tank, commonly used in process industries. To deal with cases like this, several control theories have been developed over time, each one presenting better results in certain systems. This work presents an alternative for the control of nonlinear systems, without necessary modeling or previous information about the system, based on a new optimization law for the artificial neural network training in real time.

This work presents a novel approach for the study of the movement of droplets on inclined surfaces under the influence of gravity and chemical heterogeneities. The developed numerical methodology uses data-driven modeling to extend the applicability limits of an analytically derived reduced-order model for the contact line velocity. More specifically, while the reduced-order model is able to capture the effects of the chemical heterogeneities to a satisfactory degree, it does not account for gravity. To alleviate this shortcoming, datasets generated from direct numerical simulations are used to train a data-driven model for the contact line velocity, which is based on the Fourier neural operator and corrects the reduced-order model predictions to match the reference solutions. This hybrid surrogate model, which comprises of both analytical and data-driven components, is then integrated in time to simulate the droplet movement, offering a speedup of five orders of magnitude compared to direct numerical simulations. The performance of this hybrid model is quantified and assessed in different wetting scenarios, by considering various inclination angles and values for the Bond number, demonstrating the accuracy of the predictions as long as the adopted parameters lie within the ranges considered in the training dataset.

An advanced driver-assistance system (ADAS) is critical to driver-vehicle-interaction systems. Driving behaviour modelling and control significantly improves the global performance of ADAS. A haptic assistive system assists the driver by providing a specific torque on the steering wheel according to the driving-vehicle-road profile to improve the steering control. However, the main problem is designing a compensator dealing with the high-level uncertainties in different driving scenarios with haptic driver assistance, where different personalities and diverse perceptions of drivers are considered. If not properly accounted for, these differences can lead to poor driving performance. This paper focuses on designing a data-driven model-free compensator considering various driving behaviours with a haptic feedback system. A back propagation neural network (BPNN) models driving behaviour based on real driving data (speed, acceleration, vehicle orientation, and current steering angle). Then using the genetic algorithm (GA) and the integral time absolute error (ITEA) criterion to optimize multiple PID compensation parameters for various driving behaviour (such as speeding/braking, lane-keeping and turning), which are then be combined by the fuzzy logic to provide different driving commands. An experiment was conducted with 5 participants in a driving simulator. During the second experiment, seven participants drove in the simulator to evaluate the robustness of the proposed combined GA-PID offline and the Fuzzy-PID controller applied online. The experiment results evaluated the ITAE of lateral displacement and yaw angle, during various driving behaviour. The results validated the proposed method by significantly enhancing the driving performance.

This paper presents a novel real time control strategy on four-wheel independent steering system for electric vehicle with stepper motors using neural networks combined with fuzzy logic. The control of the four wheels is based on a variation of Hopfield Neural Network (VHNN) method, in which the input is the error of each steering motor and the output is processed by a hyperbolic tangent function (HTF) feeding the fuzzy logic controller (FLC), which ultimately drives the stepper motor. The whole system is made up of the four aforementioned blocks where they work in sync and inseparable from each other with the common goal of driving all the steering stepper motors at the same time. Simulation results demonstrate that the proposed control method has strong robustness and practicability under different angles and speeds.

This study aimed at exploring what role artificial intelligence techniques could play in the futural numerical analysis. In this paper, a convolutional neural network techniques based on modified loss function is proposed as a surrogate of finite element method(FEM). Several surrogate-based physics-informed neural networks(PINNs) are developed to solve representative boundary value problems based on elliptic partial differential equations (PDEs). Results from the proposed surrogate-based approach are in good agreement with ones from conventional FEM. It is found that modification of the loss function could improve the prediction accuracy of the neural network. It is indicated that to some extent the artificial intelligence technique could replace conventional numerical analysis as a great surrogate model.

Three-phase motors are commonly adopted in several industrial contexts and their failures can result in costly downtime causing undesired service outages; this way, motor diagnostics is an issue that assumes great importance. To prevent their failures and timely face the considered service outages, a non-invasive method to identify electrical and mechanical faults in three-phase asynchronous electric motors is proposed in the paper. In particular, a measurement strategy along with a machine learning algorithm based on Artificial Neural Network is exploited to properly classify failures. In particular, digitized current samples of each motor phase are first processed by means of FFT and PSD in order to estimate the associated spectrum. Suitable features (in terms of frequency and amplitude of the spectral components) are then singled out to either train or feed a neural network acting as a classifier. The method is preliminary validated on a set of 28 electric motors, and its performance is compared with common state-of-art machine learning techniques. The obtained results show that the proposed methodology is able to reach accuracy levels greater than 98\% in identifying anomalous conditions of three-phase asynchronous motors.

This article presents a novel computational approach to visualizing memristor dynamics within a simulated neural network. Memristors, known for their ability to emulate synaptic plasticity due to their variable resistance characteristics, are key components in neuromorphic computing and hold potential for advancing our understanding of neural processes. Our study introduces a sophisticated memristor model that incorporates non-linear resistance changes, simulating the complex behavior of synaptic connections in a neural network.The neural network, consisting of multiple interconnected neurons with memristor-based synapses, is subjected to a series of electrical stimuli. Each memristor's resistance is modulated in response to the applied voltage, mimicking the synaptic weight adjustments that occur during learning and memory formation in biological neural networks. To effectively illustrate these changes, we employ a high-contrast color mapping scheme, where the varying resistance of each memristor is represented by distinct colors, providing a clear and intuitive visualization of synaptic modifications over time.Our simulation runs through multiple iterations, demonstrating how synaptic weights evolve in response to different input patterns. The use of an extended voltage range and increased scaling factors ensures pronounced changes in memristance, enhancing the visibility of synaptic adaptations. The resulting visualizations offer a compelling representation of how memristors can mimic the dynamic nature of biological synapses, contributing to the field of neuromorphic engineering and deepening our comprehension of neural mechanisms underlying learning and memory.This work not only showcases the potential of memristors in simulating neural behavior but also provides a valuable educational tool for illustrating complex concepts in neuroscience and neuromorphic computing. The insights gained from this study pave the way for further exploration into the development of advanced neural network models and the design of memristor-based computing systems.

Aimed for the difficulty and complexity of detecting the piston error for segmented telescope, this paper proposed a new piston error measurement method based on a hybrid artificial neural net-work. Firstly, we use Resnet network to learn the mapping relationship between the focal plane degradation image and the signs of the piston error. Then, based on the established theoretical re-lationship between modulation transfer function and the piston error, BP neural network is used here to learn the mapping relationship between the MTF and the absolute value of the piston error. After the training of the hybrid network is completed, a wide-range and high-precision detection of the piston error of the sub-mirrors can be achieved using the combined output of the two net-works only a focal plane image of a point source with broadband illumination is used as input. The detection range can reach the whole coherent length of the input broadband light, and the detec-tion accuracy can reach 10nm. The method proposed in this paper has the advantages of high de-tection accuracy, wide detection range, low hardware cost, small network scale and low training difficult.

Topology optimization is a pioneering design method that can provide various candidates with high mechanical properties. However, the high-resolution for the optimum structures is highly desired, normally in turn leading to computationally intractable puzzle, especially for the famous Solid Isotropic Material with Penalization (SIMP) method. In this paper, an efficient and high-resolution topology optimization method is proposed based on the Super-Resolution Convolutional Neural Network (SRCNN) technique in the framework of SIMP. The SRCNN includes four processes, i.e. refining, path extraction & representation, non-linear mapping, and reconstruction. The high computational efficiency is achieved by a pooling strategy, which can balance the number of finite element analysis (FEA) and the output mesh in optimization process. To further reduce the high computational cost of 3D topology optimization problems, a combined treatment method using 2D SRCNN is built as another speeding-up strategy. A number of typical examples justify that the high-resolution topology optimization method adopting SRCNN has excellent applicability and high efficiency for 2D and 3D problems with arbitrary boundary conditions, any design domain shape, and varied load.

We propose a neural-network-based watermarking method that introduces the quantized activation function that approximates the quantization of JPEG compression. Many neural-network-based watermarking methods have been proposed. Conventional methods have acquired robustness against various attacks by introducing an attack simulation layer between the embedding network and the extraction network. The quantization process of JPEG compression was replaced by the noise addition process in the attack layer of the conventional methods. In this paper, we propose a quantized activation function that can simulate the JPEG quantization standard as it is in order to improve the robustness against the JPEG compression. Our quantized activation function consists of several hyperbolic tangent functions and is applied as an activation function for neural networks. Our network was introduced in the attack layer of ReDMark proposed by Ahmadi et al. to compare it with their method. That is, the embedding and extraction networks had the same structure. We compared the usual JPEG compressed images and the images applying the quantized activation function. The results showed that a network with quantized activation functions can approximate JPEG compression with high accuracy. We also compared the bit error rate (BER) of estimated watermarks generated by our network with those generated by ReDMark. We found that our network was able to produce estimated watermarks with lower BERs than those of ReDMark. Therefore, our network outperformed the conventional method with respect to image quality and BER.

Communication is a key method of expressing one's thoughts and opinions. Amongst many modalities, speech and writing are the most powerful and common forms of human communication. Analysing what and how people think has inherently been an interesting and progressive research domain. This includes bimodal sentiment analysis which is an emerging area in natural language processing (NLP) and has received a great deal of attention in recent years in a variety of areas including social opinion mining, health care, banking, and so on. At present, there are limited studies on bimodal conversational sentiment analysis as it proves to be a challenging area given the complex nature of the way humans express sentiment cues across various modalities. To address this gap, a comparison of the performance of multiple data modality models has been conducted on the MELD dataset, a widely-used dataset for benchmarking sentiment analysis within the research community. Our work then demonstrates the results of combining acoustic and linguistic representations. Lastly, our proposed neural network-based ensemble learning technique is employed over six transformer and deep learning-based models, achieving a State-Of-The-Art (SOTA) accuracy.

Surrogate model based optimization method is widely-used to accelerate the design and optimization process~\cite{marler2004survey}. The input of regression model used in the surrogate model are numbers, which requires users to parametrize the geometries. In this paper, a new parameterization-free surrogate model is introduced and its corresponding uncertainty quantification and sensitivity analysis method are discussed. The input of new surrogate model methods is surface mesh of simulation domain. \Gls{gnns} is used to extract geometric information, and \Gls{cnns} is used to predict contours. This framework bypasses parameterization,as a consequence, uncertainties introduced by manual parameterization is reduced. However, such changes compared with conventional surrogate model methods impose great challenge on uncertainties quantification and sensitivity analysis. Uncertainties quantification in this paper means the error bar of prediction results, which is calculated by Gaussian Process Regression method in current surrogate method. In this paper, a new quantification method achieved by Kullback-Leibler divergence (KLD) is introduced. And the sensitivity analysis is conducted by Automatic Differentiation, which gives a Jacobian matrix of inputs. The method and analysis mentioned above are demonstrated by a low-pressure steam turbine rotator and its exhaust system.

Corona virus disease (COVID-19) has infected over more than 10 million people around the globe and killed at least 500K worldwide by the end of June 2020. As this disease continues to evolve and scientists and researchers around the world now trying to find out the way to combat this disease in most effective way. Chest X-rays are widely available modality for immediate care in diagnosing COVID-19. Precise detection and diagnosis of COVID-19 from these chest X-rays would be practical for the current situation. This paper proposes one shot cluster based approach for the accurate detection of COVID-19 chest x-rays. The main objective of one shot learning (OSL) is to mimic the way humans learn in order to make classification or prediction on a wide range of similar but novel problems. The core constraint of this type of task is that the algorithm should decide on the class of a test instance after seeing just one test example. For this purpose we have experimented with widely known Generalized Regression and Probabilistic Neural Networks. Experiments conducted with publicly available chest x-ray images demonstrate that the method can detect COVID-19 accurately with high precision. The obtained results have outperformed many of the convolutional neural network based existing methods proposed in the literature.

With the development of deep learning technology, various structures and research methods for super-resolution restoration of natural images and document images have been introduced. In particular, a number of recent studies have been conducted and developed in image restoration using generative adversarial network. Super-resolution restoration is ill-posed problem because of some complex restraints such as a lot of high-resolution images being restored for the same low-resolution image and also difficulty in restoring noises like edges, light smudging, and blurring. In this study, we utilized the spatially adaptive de-normalization (SPADE) structure for document image restoration to solve previous problems such as edge unclearness, hardness to catch features of texts, and the image color transition. Consequently, it can be confirmed that the edge of the character and the ambiguous stroke are restored more clearly when contrasting with the other previously suggested methods. Also, the proposed method’s PSNR and SSIM scores are geting 8% and 15% higher, respectively, compared to the previous methods.

An earthquake is a natural event by its general definition. This natural event is a disaster that causes significant damage, loss of life, and other economic effects that will damage the state. The possibility of predicting a natural event such as an earthquake will minimize the reasons mentioned. Data collection, data processing, and data evaluation were carried out in this study. Earthquake forecasting was performed using the data and the RNN (Recurrent Neural Network) method. The study was carried out on seismic data with a magnitude of 3.0 and above belonging to Düzce Province between 1990 and 2022. In order to increase the learning potential of the method, the b and d values of the earthquake were calculated and included in the data set, except for the earthquake magnitude. The determination of earthquakes in a specific time interval in regions of Turkey, the classification of earthquake-related seismic data using artificial neural networks, and the production of predictions for the future reveal the importance of this study.

Link prediction is to complete the missing links in the network or to predict the generation of new links according to the current network structure information, which is very important for mining and analyzing the evolution of the network such for construction and analysis of logical architecture in 6G network. Link prediction algorithms based on node similarity need predefined similarity functions, which is highly hypothetical and only applies to specific network structures without generality. To solve this problem, this paper proposes a link prediction algorithm based on the subgraph of the target node pair. In order to automatically learn the graph structure characteristics, the algorithm firstly extracts the h-hop subgraph of the target node pair, and then predicts whether the target node pair will be linked according to the subgraph. Experiments on seven real data sets show that the link prediction algorithm based on target node pair subgraph is suitable for various network structures and superior to other link prediction algorithms.

Water quality forecasting is increasingly significant for agricultural management and environmental protection. Enormous amounts of water quality data are increasingly being collected by advanced sensors, which leads to an interest in using data-driven models for predicting trends in water quality. However, the unpredictable background noises introduced during water quality monitoring seriously degrade the performance of those models. Meanwhile, artificial neural networks (ANN) with feed-forward architecture lack the capability of maintaining and utilizing the accumulated temporal information, which leads to biased predictions in processing time series data. Hence, we propose a water quality predictive model based on a combination of Kernal Principal Component Analysis (kPCA) and Recurrent Neural Network (RNN) to forecast the trend of dissolved oxygen. Water quality variables are reconstructed based on kPCA method, which aims to reduce the noise from the raw sensory data and preserve actionable information. With the RNN's recurrent connections, our model can make use of the previous information in predicting the trend in the future. Data collected from Burnett River, Australia was applied to evaluate our kPCA-RNN model. The kPCA-RNN model achieved R2 scores up to 0.908, 0.823 and 0.671 for predicting the concentration of dissolved oxygen in the upcoming 1, 2 and 3 hours, respectively. Compared to current data-driven methods like ANN and SVR, the predictive accuracy of the kPCA-RNN model was at least 8 %, 17 % and 21 % better than the comparative models in these 3 cases. The study demonstrates the effectiveness of the kPAC-RNN modeling technique in predicting water quality variables with noisy sensory data.

The popularity and development of social media has made it more and more convenient to spread rumors, and it has become especially important to detect rumor information from massive amounts of information. Most of the traditional rumor detection methods use content characteristics or propagation structure to mine rumor characteristics, ignoring the fusion characteristics of content and structure and their interaction characteristics. Therefore, a novel rumor detection method based on heterogeneous convolutional networks is proposed. Firstly, this paper constructs a heterogeneous map of joint rumor content and propagation structure to explore the interaction between content and propagation structure during rumor propagation and obtain rumor representation. On that basis, this paper uses the deep residual graph convolutional neural network to construct the content and structure interaction information of the current network propagation model. Finally, this paper uses the two datasets of Twitter15 and Twitter16 to verify the proposed method. Experimental results show that the proposed method has higher detection accuracy than the traditional rumor detection method.

An appearance model plays a crucial rule in multi-target tracking. In traditional approaches, the two steps of appearance modeling i.e visual representation and statistically similarity measure are modeled separately. Visual representation is achieved either through hand-crafted features or deep features and statically similarity is measure through a cross entropy loss function. A loss function based on cross-entropy (KL-divergence, mutual information) find closely related probability distribution for the targets. However, if the targets have similar visual representation, it ends up mixing the targets. To tackle this problem, we come up with a synergetic appearance model named Single Shot Appearance Model based on Siamese neural network. The network is trained with a contrastive loss function for finding the similarity between different targets in a single shot. The input to the network is two target patches and based on their similarity, a contrastive score is output by the network. The proposed model is evaluated on accumulative dissimilarity metric on three datasets. Quantitatively, promising results are achieved against three baseline methods.

The traditional standards employed for pain assessment have many limitations. One such limitation is reliability because of inter-observer variability. Therefore, there have been many approaches to automate the task of pain recognition. Recently, deep-learning methods have appeared to solve many challenges, such as feature selection and cases with a small number of data sets. This study provides a systematic review of pain-recognition systems that are based on deep-learning models for the last two years only. Furthermore, it presents the major deep-learning methods that were used in review papers. Finally, it provides a discussion of the challenges and open issues.

This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLME-Resnet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial and spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3\%) and Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and adjustment of treatment, by providing physicians with insights into the underlying pathological organization of gliomas.

Capability assessment plays a crucial role in the demonstration and construction of equipment. To improve the accuracy and stability of capability assessment, we study the neural network learning algorithms in the field of capability assessment and index sensitivity. Aiming at the problem of over-fitting and parameter optimization in neural network learning, the paper proposes an improved machine learning algorithm—the Ensemble Learning Based on Policy Optimization Neural Networks (ELPONN) algorithm with the policy optimization and ensemble learning. This algorithm presents optimized neural network learning algorithm through different strategies evolution, and builds an ensemble learning model of multi-intelligent algorithms to assessment the capability and analyze the sensitivity of the indexes. Through the assessment of capabilities, the algorithm effectively avoids parameter optimization from entering the minimum point in performance to improve the accuracy of equipment capability assessment, which is significantly better than previous neural network assessment methods. The experimental results show that the mean relative error is 4.10%, which is better than BP, GABP, and early stopping. The ELPONN algorithm has better accuracy and stability performance, and meets the requirements of capability assessment.

Recently, various relations and criteria have been presented to establish a proper relationship between control systems and control Global Positioning System (GPS)-intelligent buoy system. Given the importance of controlling the position of buoys and the construction of intelligent systems, in this paper, dynamic system modeling is applied to position marine buoys through the improved neural network with a backstepping technique. This study aims at developing a novel controller based on adaptive fuzzy neural network to optimally track the dynamically positioned vehicle on water with unavailable velocities and unidentified control parameters. In order to model the network with the proposed technique, uncertainties and the unwanted disturbances are studied in the neural network. The presented study aims at developing a neural controlling which applies the vectorial back-stepping technique to the surface ships, which have been dynamically positioned with undetermined disturbances and ambivalences. Moreover, the objective function is to minimize the output error for the neural network (NN) based on closed-loop system. The most important feature of the proposed model for the positioning buoys is its independence from comparative knowledge or information on the dynamics and the unwanted disturbances of ships. The numerical and obtained consequences demonstrate that the controller system can adjust the routes and the position of the buoys to the desired objective with relatively few position errors.

Recent neuroscience research results show that the nerve information in the brain is not only encoded by the spatial information. Spiking neural network based on pulse frequency coding plays a very important role in dealing with the problem of brain signal, especially complicated space-time information. In this paper, an unsupervised learning algorithm for bilayer feedforward spiking neural networks based on spike-timing dependent plasticity (STDP) competitiveness is proposed and applied to SAR image classification on MSTAR for the first time. The SNN learns autonomously from the input value without any labeled signal and the overall classification accuracy of SAR targets reached 80.8%. The experimental results show that the algorithm adopts the synaptic neurons and network structure with stronger biological rationality, and has the ability to classify targets on SAR image. Meanwhile, the feature map extraction ability of neurons is visualized by the generative property of SNN, which is a beneficial attempt to apply the brain-like neural network into SAR image interpretation.

Abstract: The Hanqu Joint Station of the Dingbian Oil Production Plant of Yanchang Oilfield Co., Ltd is located at the edge of the desert in northern China. the bad field conditions and strong sandstorm, the hardware of computer monitoring system of Joint Station is often damaged. At the same time, the core equipment of the joint station three-phase separator oil chamber liquid level is hard to achieve high precision constant value control, the general control algorithm is difficult to meet the control requirements.This paper proposed a design scheme of a oilfield joint station computer monitoring system based on the Siemens S7-300 PLC, the hardware of the monitoring system adopts the redundancy scheme of dual monitoring computers, dual programmable logic controllers (PLCs), and dual industrial Ethernet. The BP neural network PID control algorithm was used to realize constant value control of the oil chamber liquid level of the three-phase separator of the core equipment of the joint station，and realized high control precision. The monitoring system could well adapt to the harsh environment of the scene, and showed high reliability and efficiency.

Bearings are widely used in various types of electrical machinery and equipment. As their core components, failures will often cause serious consequences . At present, most methods of parameter adjustment are still manual adjustment of parameters. This adjustment method is susceptible to prior knowledge and easy to fall into the local optimal solution, failing to obtain the global optimal solution and requires a lot of resources.Therefore, this paper proposes a new method of bearing fault diagnosis based on wavelet packet transform and convolutional neural network optimized by simulated annealing algorithm.The experimental results show that the method proposed in this paper has a more accurate effect in feature extraction and fault classification compared with traditional bearing fault diagnosis methods. At the same time, compared with the traditional artificial neural network parameter adjustment, this paper introduces the simulated annealing algorithm to automatically adjust the parameters of the neural network, thereby obtaining an adaptive bearing fault diagnosis method. To verify the effectiveness of the method, the Case Western Reserve University bearing database was used for testing, and the traditional intelligent bearing fault diagnosis method was compared. The results show that the method proposed in this paper has good results in bearing fault diagnosis. Provides a new way of thinking in the field of bearing fault diagnosis in parameter adjustment and fault classification algorithms

Session-based recommendations which aim to predict subsequent user-item interaction based on historical user behavior during anonymous sessions can be challenging tasks. Two main challenges need to be addressed and improved: (1) How to analyze these sessions to accurately and completely capture users’ preferences, and (2) how to identify and eliminate any interference caused by noisy behavior. Existing methods have not adequately addressed these issues since they either neglected the valuable insight that can be gained from analyzing consecutive groups of items or failed to take these noisy data in sessions seriously and handled them properly, which can jointly impede recommendation systems from capturing users’ real intentions. To address these two problems, we designed a multi-order semantic denoising (MSD) model for session-based recommendations. Specifically, we grouped items of different lengths as varying multi-order semantic units to mine the user’s primary intention from multiple dimensions. Meanwhile, a novel denoising network was designed to alleviate the interference of noisy behavior and provide a more precise session representation. The result of extensive experiments on three real-world datasets demonstrated that the proposed MSD model exhibited improved performance compared with existing state-of-the-art methods in session-based recommendation.

The monocular structured light measurement system has low cost, simple algorithms, and a wide measurement range, making it widely applicable in multiple fields. However, in practical applications, the system may be affected by various factors including noise, non-linear intensity, changes in the reflectivity of the object being measured, and the calibration method and accuracy of the system, thereby reducing the measurement accuracy. In order to solve these issues, this paper proposes a new monocular structured light measurement method, mainly comprises the following two points: (a) A denoising algorithm for phase images based on DAE is proposed, which calculates the wrapped phase of the phase-shifted fringes after initial denoising by DAE. Then, a new phase-shifted fringe pattern is generated and input into DAE for iterative denoising, achieving high-performance image denoising and high-precision wrapped phase solution. (b) A new absolute phase height calibration algorithm is proposed, which introduces camera internal and external parameters and uses a two-layer feedforward network to directly establish the relationship between phase and the 3D coordinate system. Without the need for high-precision motion platforms, high-precision phase height calibration is attainable. In general, compared to conventional methods, the experimental results indicate the effectiveness of the proposed method for low-quality phase-shifted fringe 3D reconstruction. In addition, the measurement method described in this article also demonstrates effectiveness in high-dynamic scenes.

Due to the recent trend of unmanned economy, retail stores have gradually reduced their service and cashier manpower. The retail product recognition becomes one of key issues for unmanned shopping. Although the success of deep neural networks has made object recognition feasible in a variety of applications, it still struggles to perform well on a large number of classes of retail products. In this paper, we propose an improved ensemble learning-based approach for retail product recognition. In the proposed approach, the object classification network is first improved through feature extraction and block attention. An ensemble model is then built by integrating multiple network models and using loss selection as model weights. In the experiments, the feasibility of our ensemble learning-based approach has been evaluated through many production items. The results demonstrate the effectiveness of the proposed approach compared with previous retail product recognition methods.

Currently, foam mixers are predominantly categorized into two types: low-pressure and high-pressure. Low-pressure mixers primarily use agitator rotation to mix materials. However, they face challenges such as difficulty in cleaning and complex structures. High-pressure mixers, widely adopted for their structural simplicity and lack of need for cleaning devices, effectively mitigate issues associated with low-pressure mixers. Nonetheless, they encounter problems with uneven mixing when processing high-viscosity materials. Historically, the primary solution to this issue was increasing the working pressure. However, the capacity to increase pressure is finite, and higher pressure demands higher quality materials for the mixers. To address the issues high-pressure mixers face when dealing with high-viscosity materials, this study focuses on the polyimide high-pressure mixer. After reviewing previous studies, four design variables were selected: the mixer's impingement angle, inlet diameter, outlet diameter, and impingement pressure. Using a Full Factorial Design of Experiments (DOE), the significance of the impact exerted by these four variables on Mixing Unevenness was analyzed, determining the extent of their influence. Optimal Latin Hypercube Sampling generated several random sample points, followed by the establishment of both a Back Propagation (BP) Neural Network approximation model and a Kriging approximation model. A Genetic Algorithm was then applied to optimize these two approximation models, resulting in the optimal combination of design variables. The research findings indicate that the BP Neural Network exhibits higher predictive accuracy compared to the Kriging prediction model. The optimal combination of parameters, optimized through the Genetic Algorithm (GA), reduced the Mixing Unevenness by 69.1%, effectively decreasing the Mixing Unevenness of the mixer head.

The intrinsic non-linearity and complexity of suspended sediment dynamics, which are impacted by the geographical variability of basin parameters and temporal climatic patterns, make it difficult to estimate suspended sediment concentration (SSC) accurately in hydrological processes. Deep neural networks (DNNs), a cutting-edge modeling method that can capture the innate non-linearity in hydrological systems, have emerged as a solution to this problem. Using primary data on discharge, SSC, and turbidity, the long short-term memory method of DNNs was employed in this study to simulate the discharge-suspended sediment connection for the Esopus Creek, NY, USA as the first objective. To develop effective modeling strategies, multiple scenarios of feature selection, including combinations of discharge, turbidity and SSC for preceding days, were considered. Secondly, the variations in SSC and discharge between the three USGS gages along Esopus Creek that were upper stream, lower stream, and downstream, adjacent to the pourpoint were analyzed. Statistical metrics and scenarios of feature importance were used to evaluate the effectiveness of the DNN-based models. The study shows that among 24 DNN approaches feature selection is crucial in simulating the daily SSC, and discharge and presenting novel research directions for utilizing machine learning algorithms in water quality.

This study explores the use of Bayesian Neural Networks (BNNs) for estimating chlorophyll-a concentration ([CHL-a]) from remotely sensed data. The BNN model enables uncertainty quantification, offering additional layers of information compared to traditional ocean colour models. An extensive in situ bio-optical dataset is utilized, generated by merging 27 data sources across the world’s oceans. The BNN model demonstrates remarkable capability in capturing mesoscale features and ocean circulation patterns, providing comprehensive insights into spatial and temporal variations in [CHL-a] across diverse marine ecosystems. In comparison to established ocean colour algorithms, such as Ocean Colour 4 (OC4), the BNN shows comparable performance in terms of correlation coefficients, errors, and biases when compared with the in situ data. The BNN, however, further provides critical information about the distribution of [CHL-a], which can be used to assess uncertainties in the prediction. Moreover, the BNN model’s ability to provide more information for coastal waters, especially with higher spatial resolution imagery, offers valuable advantages for marine research and management. By quantifying uncertainty, the model builds confidence in [CHL-a] predictions, even in regions with limited data coverage. This is reflected by the spread in the model predictions, where the BNN can detect a range of uncertainty bounds that reflect confidence in the retrievals. Introducing BNNs as probabilistic ocean colour models represents a significant advancement, enabling more accurate and reliable predictions of [CHL-a] in the global oceans.

In the pursuit of energy-efficient spiking neural network (SNN) hardware, synaptic devices lev-eraging emerging memory technologies hold significant promise. This study investigates the ap-plication of the recently proposed HfO2/SiO2-based interface dipole modulation (IDM) memory for synaptic spike timing-dependent plasticity (STDP) learning. Firstly, through pulse measure-ments of IDM metal-oxide-semiconductor (MOS) capacitors, we demonstrate that IDM exhibits an inherently nonlinear and near-symmetric response. Secondly, we discuss the drain current re-sponse of a field-effect transistor (FET) incorporating a multi-stack IDM structure, revealing its nonlinear and asymmetric pulse response, and suggest that the degree of the asymmetry depends on the modulation current ratio. Thirdly, to emulate synaptic STDP behavior, we implement dou-ble-pulse-controlled drain current modulation of IDMFET using a simple bipolar rectangular pulse. Additionally, we propose a double-pulse-controlled synaptic depression that is valuable for optimizing STDP-based unsupervised learning. Integrating the pulse response characteristics of IDMFETs into a two-layer SNN system for synaptic weight updates, we assess training and classification performance on handwritten digits. Our results demonstrate that ID-MFET-based synaptic devices can achieve classification accuracy comparable to previously re-ported simulation-based results.

It is important to reduce the computation complexity while maintaining the accuracy of convolution neural networks. We deem it is possible to further reduce the network complexity while ensuring the accuracy. In this paper, we propose a novel feature extraction network called DSRNet which is lightweight but effective. DSRNet follows the basic ideas of stacking modules and short connection, introduces Depthwise Separable convolution and utilizes the Dilated convolution. The proposed network has fewer parameters and achieves outstanding speed. We conducted comprehensive experiments on CIFAR10, CIFAR100 and STL10 datasets, and the results showed the DSRNet has great performance improvement in terms of accuracy and speed.

Network Embedding (NE) is an important method to learn the representations of network via a low-dimensional space. Conventional NE models focus on capturing the structure information and semantic information of vertices while neglecting such information for edges. In this work, we propose a novel NE model named BimoNet to capture both the structure and semantic information of edges. BimoNet is composed of two parts, i.e., the bi-mode embedding part and the deep neural network part. For bi-mode embedding part, the first mode named add-mode is used to express the entity-shared features of edges and the second mode named subtract-mode is employed to represent the entity-specific features of edges. These features actually reflect the semantic information. For deep neural network part, we firstly regard the edges in a network as nodes, and the vertices as links, which will not change the overall structure of the whole network. Then we take the nodes' adjacent matrix as the input of the deep neural network as it can obtain similar representations for nodes with similar structure. Afterwards, by jointly optimizing the objective function of these two parts, BimoNet could preserve both the semantic and structure information of edges. In experiments, we evaluate BimoNet on three real-world datasets and task of relation extraction, and BimoNet is demonstrated to outperform state-of-the-art baseline models consistently and significantly.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

Numerous image processing techniques (IPTs) have been employed to detect crack defects, offering an alternative to human-conducted onsite inspections. These IPTs manipulate images to extract defect features, particularly cracks in surfaces produced through Additive Manufacturing (AM). This article presents a vision-based approach that utilizes deep convolutional neural networks (CNNs) for crack detection in AM surfaces. Traditional image processing techniques face challenges with diverse real-world scenarios and varying crack types. To overcome these challenges, our proposed method leverages CNNs, eliminating the need for extensive feature extraction. Annotation for CNN training is facilitated by LabelImg without the requirement for additional IPTs. The trained CNN, enhanced by OpenCV preprocessing techniques, achieves an outstanding 99.54% accuracy on a dataset of 14,982 annotated images with resolutions of 1536 × 1103 pixels. Evaluation metrics exceeding 96% precision, 98% recall, and a 97% F1-score highlight the precision and effectiveness of the entire process.

Glaucoma, a global leading cause of blindness, necessitates accurate segmentation of the optic disc (OD) and optic cup (OC) for effective screening. However, existing segmentation methods based on convolutional neural networks (CNNs) suffer from high computational complexity and long inference times. In this paper, we propose an end-to-end segmentation method for the OD and OC using a lightweight MobileNetv3 as the feature extraction network. Our approach incorporates boundary branches and an adversarial learning network to achieve multi-label segmentation of the OD and OC. We evaluate the proposed method on three publicly available datasets: Drishti-GS, RIM-ONE-r3, and REFUGE. The experimental results demonstrate segmentation accuracies of 0.974/0.900, 0.966/0.875, and 0.962/0.880 for the OD and OC on the respective datasets, while significantly reducing inference time.

This paper assesses the behaviour of active distribution networks with high penetration of renewable energy sources when the control is performed in a centralised manner. The control assets are the on-load tap changers of transformers at the primary substation, the reactive power injections of the renewable energy sources and the active and reactive power exchanged between adjacent feeders when they are interconnected through a DC link. A scaled-down distribution network is used as testbed to emulate the behaviour of an active distribution system with massive penetration of renewable energy resources. The laboratory testbed involves hardware devices, real-time control, and communication infrastructure. Several key performance indices are adopted to assess the effects of the different control actions on the system operation. The experimental results demonstrate that the combination of control actions enables the optimal integration of a massive penetration of renewable energy.

Mineral identification is an important part of geological analysis. Traditional identification methods rely on either the experiences of the appraisers or the various measuring instruments and the methods are either easily influenced by the experiences or need too much work. To solve the above problems, there have been studies using image recognition and intelligent algorithms to identify minerals. But the current studies can not identify many minerals, and the accuracy is low. To increase the number of identified mineral categories and the accuracy, we proposed the method that uses both the mineral images and the Mohs hardness in the deep neural networks to identify the minerals. The experimental results showed that the method can reach 94.0% Top-1 accuracy and 99.9% Top-5 accuracy for 28 common minerals. The model that combines image and Mohs hardness together can identify more minerals and increase the accuracy using less training data.

Speech recognition, or automatic speech recognition (ASR), is a technology designed to convert spoken language into text using software. However, conventional ASR methods involve several distinct components, including language, acoustic, and pronunciation models with dictionaries. This modular approach can be time-consuming and may influence performance. In this study, we propose a method that streamlines the speech recognition process by incorporating a unified recurrent neural network (RNN) architecture. Our architecture integrates a convolutional neural network (CNN) with an RNN and employs a connectionist temporal classification (CTC) loss function. Key experiments were carried out using a dataset comprising 576,656 valid sentences, using erosion techniques. Evaluation of the model performance, measured by the word error rate (WER) metric, demonstrated remarkable results, achieving a WER of 2%. This approach has significant implications for the realm of speech recognition, as it alleviates the need for labor-intensive dictionary creation, enhancing the efficiency and accuracy of ASR systems, and making them more applicable to real-world scenarios. For future enhancements, we recommend the inclusion of dialectal and spontaneous data in the dataset to broaden the model's adaptability. Additionally, fine-tuning the model for specific tasks can optimize its performance for targeted objectives or domains, further enhancing its effectiveness in those areas.

Data-driven models based on artificial intelligence are efficiently used to solve complex problems. The quality of groundwater is of utmost importance, as it directly impacts human health and the environment. In major parts of the world groundwater is the main source of drinking water, it is essential to periodically monitor water quality. Conventional water quality monitoring techniques involve periodical collection of water samples and analysis in the laboratory. This process is expensive, time consuming and involves lot of manual labor. The aim of our study is to build an ant colony optimized neural network for predicting groundwater quality parameters. We have proposed artificial neural network comprising of six hidden layers. The approach was validated using our groundwater quality dataset of a hard rock region in the northern part of Karnataka, India. Groundwater samples were collected by us periodically from March 2014 to October 2020 from 50 wells in this region. These samples where analysed for measuring the pH, Electrical Conductivity, Na+, Ca+, Na+, K+, Mg2+, F-, Cl- and U+. The temporal dataset was split for training, testing and validation of our model. Metrics such as R2 (Coefficient of Determination), RMSE (Root Mean Squared Error), NSE (Nash–Sutcliffe efficiencies) and MAE (Mean Absolute Error) were used to evaluate the prediction error and model performance. These performance evaluation metrics indicated the efficiency of our model in predicting the temporal variation in groundwater quality parameters. The method proposed by us can be used for prediction and the temporal frequency of sample collection can be reduced to save time and cost. The results also confirm that the combination of artificial neural network with ACO is a promising tool to optimize weights while training the network, and hence will help in reasonable prediction of groundwater quality parameters.

Conducting computational stress-strain analysis using finite element methods (FEM) is a common approach when dealing with the complex geometries of atherosclerosis, which is a leading cause of global mortality and complex cardiovascular disease. The considerable expense linked to FEM analysis encourages the substitution of FEM with a considerably faster data-driven machine learning (ML) approach. This study investigated the potential of end-to-end deep learning tools as a more effective substitute for FEM in predicting stress-strain fields within 2D cross sections of arterial wall. We first proposed a U-Net based fully convolutional neural network (CNN) to predict the von Mises stress and strain distribution based on the spatial arrangement of calcification within arterial wall cross-sections. Further, we developed a conditional generative adversarial network (cGAN) to enhance, particularly from the perceptual perspective, the prediction accuracy of stress and strain field maps for arterial walls with various calcification quantities and spatial configurations. On top of U-Net and cGAN, we also proposed their ensemble approaches to further improve the prediction accuracy of field maps. Our dataset, consisting of input and output images, was generated by implementing boundary conditions and extracting stress-strain field maps. The trained U-Net models can accurately predict von Mises stress and strain fields, with structural similarity index scores (SSIM) of 0.854 and 0.830 and mean squared errors of 0.017 and 0.018 for stress and strain, respectively, on a reserved test set. Meanwhile, the cGAN models in a combination of ensemble and transfer learning techniques demonstrate high accuracy in predicting von Mises stress and strain fields, as evidenced by SSIM scores of 0.890 for stress and 0.803 for strain. Additionally, mean squared errors of 0.008 for stress and 0.017 for strain further support the model's performance on a designated test set. Overall, this study developed a surrogate model for finite element analysis, which can accurately and efficiently predict stress-strain fields of arterial walls regardless of complex geometries and boundary conditions.

Computer-aided image diagnostics (CAD) have been used in many fields of diagnostic medicine. It relies heavily on classical computer vision and artificial intelligence. Quantum neural network (QNN) has been introduced by many researchers around the world and presented recently by research corporations such as Microsoft, Google, and IBM. In this paper, the investigation of the validity of using the QNN algorithm for machine-based breast cancer detection was performed. To validate the learnability of the QNN, a series of learnability tests were performed alongside with classical convolutional neural network (CCNN). QNN is built using the Cirq library to perform the assimilation of quantum computation on classical computers. Series of investigations were performed to study the learnability characteristics of QNN and CCNN under the same computational conditions. The comparison was performed for real Mammogram data sets. The investigations showed success in terms of recognizing the data and training. Our work shows better performance of QNN in terms of successfully training and producing a valid model for smaller data set compared to CCNN.

The BP neural network and PSO algorithm are applied into analyzing the reliability of long-span Concrete Filled Steel Tubular (CFST) arch bridges. Firstly, using BP neural network to fit the structural performance function. And then the PSO method was used to calculate the reliability index. A long-span Concrete Filled Steel Tubular arch bridges reliability indices were calculated whether considering the geometric nonlinearity or not. The calculation and analysis results showed that the BP neural network and PSO algorithm compensated the deficiency of the traditional reliability analysis methods, improved the calculation accuracy, provided a new thought and means for the research on the reliability of long-span bridge structure, and well applied to the reliability analysis of long-span Concrete Filled Steel Tubular arch bridges. Additionally, the reliability analysis of long-span Concrete Filled Steel Tubular arch bridges on service limit state must consider the geometric nonlinearity effect, or the results will tend to be unsafe.

Making sustainable business models, especially in manufacturing, is a key approach for organizations to adopt in order to create more sustainable processes. New technologies are needed to implement new policies that can minimize the economic, environmental, and social consequences of industrial activity. Sustainable maintenance is decisive to guarantee the availability, reliability, and safety of assets, surpassing traditional maintenance policies and embracing the principles of the circular economy. The main objective of Maintenance 4.0 is to increase the lifespan and availability of the equipment by preventing unplanned downtime, reducing planned shutdowns, and improving safety. This research focuses on the integration of advanced Industry 4.0 tools with conventional monitoring and control techniques in process industries. The article suggests that while complex neural networks might provide good predictions, simpler solutions can generalize well and have lower prediction errors because they can capture the underlying relationships between variables in a specific asset better. The combination of maintenance function, Industry 4.0 tools, and advanced statistical solutions to obtain sustainable processes can facilitate organizational change and aid decision-making in equipment management. These solutions seek to reduce interruptions and expenses through the unnecessary utilization of labor and spare parts. All these considerations improve communication and data processing, resulting in improved maintenance of a hydrogen compressor in the petrochemical industry.

Amid escalating urbanization, devising rational commercial space layouts is a critical challenge. Leveraging machine learning, this study uses a Back-propagation (BP) neural network to optimize commercial spaces in Weinan City's central urban area. The results indicate an increased number of commercial facilities with a trend of multi-centered agglomeration and outward expansion. Based on these findings, we propose a strategic framework for rational commercial space development emphasizing aggregation centers, development axes, and spatial guidelines. This strategy provides valuable insights for urban planners in small and medium-sized cities in the Yellow River Basin and metropolitan areas, ultimately showcasing the power of machine learning in enhancing urban planning.

Military medical service is an important component of the Armed Forces of any country [1]. In wartime, healthcare performs critical functions of medical support for military operations, providing effective and qualified care to the wounded and sick. Consequently, it is imperative to equip military hospitals with state-of-the-art materials and technical resources commensurate with the predefined requirements. In this study, we examine a series of enhancements applied to the TurtleBot 3 Waffle Pi-based medical assistant robot, tailored for deployment in military hospital settings.

This paper presents a novel approach for the recognition of multiple sclerosis (MS) using wavelet entropy and a Particle Swarm Optimization (PSO)-based neural network. MS is a complex neurological disorder with diverse clinical manifestations, often challenging to diagnose accurately. In this study, we leverage wavelet entropy (WE) as a feature extraction method to capture intricate patterns within brain imaging data. These extracted features are then employed to train a neural network model optimized through PSO to enhance classification accuracy. Experimental results on a dataset comprising MS and healthy control subjects demonstrate the effectiveness of our proposed approach, viz., WE-PSONN, which achieves a sensitivity of 91.95±1.15, a specificity of 92.36±0.88, a precision of 92.28±0.88, an accuracy of 92.16±0.90. The combination of advanced signal processing techniques and machine learning optimization holds promise for improving the early diagnosis and management of MS, offering potential benefits to both patients and healthcare providers.

Computer network attacks are evolving in parallel with the evolution of hardware and neural network architecture. Despite major advancements in Network Intrusion Detection System (NIDS) technology, most implementations still depend on signature-based intrusion detection systems, which can’t identify unknown attacks. Deep learning can help NIDS to detect novel threats since it has a strong generalization ability. The deep neural network’s architecture has a significant impact on the model’s results. We propose a genetic algorithm based model to find the optimal number of hidden layers and the number of neurons in each layer of the deep neural network (DNN) architecture for the network intrusion detection binary classification problem. Experimental results demonstrate that the proposed DNN architecture shows better performance than classical machine learning algorithms at a lower computational cost.

Parametric form findings of free-form space structures and qualitative assessment of their aesthetics are among the concerns of architects. This study aims to evaluate the aesthetic aspect of these structures using ML algorithms based on the expert's experiences. First, various datasets of forms were produced using a parametric algorithm of free-form space structures written in Grasshopper. Then, three multilayer perceptron ANN models were adjusted in their most optimal modes using the results of the preference test based on the aesthetic criteria including simplicity, complexity, and practicality. The results indicate that the ANN models can quantitatively evaluate the aesthetic value of free-form space structures.

Convolutional Neural Networks (CNNs) are largely hand-crafted, which leads to inefficiency in the constructed network. Various other algorithms have been proposed to address this issue, but the inefficiencies resulting from human intervention have not been addressed. Our proposed EvolveNet algorithm is a task-agnostic evolutionary search algorithm that can find optimal depth and width scales automatically in an efficient way. The optimal configurations are not found using grid search, instead evolved from an existing network. This eliminates inefficiencies that emanate from hand-crafting, thus reducing the drop in accuracy. The proposed algorithm is a framework to search through a large search space of subnetworks until a suitable configuration is found. Extensive experiments on the ImageNet dataset demonstrate the superiority of the proposed method by outperforming the state-of-the-art methods.

Flexible manipulators have been widely used in industrial production. However, due to the poor rigidity of the flexible manipulator, it is easy to generate vibration. It will reduce the working accuracy and service life of the flexible manipulator. It is necessary to suppress the vibration during the operation of the flexible manipulator. Based on the energy method and Hamilton principle, the partial differential equations of the flexible manipulator are established. Secondly, an improved radial basis function (RBF) neural network is combined with the fuzzy backstepping method to identify and suppress the random vibration during the operation of the flexible manipulator, and the Lyapunov function and control law are designed. Finally, Simulink was used to build a simulation platform, three different external disturbances were set up, and the effect of vibration suppression was observed through the change curves of the final velocity error and displacement error. Compared with RBF neural network boundary control method and RBF neural network inversion method, the simulation results show that the effect of RBF neural network fuzzy inversion method is better than the previous two control methods, the system convergence is faster, and the equilibrium position error is smaller.

The main parameters for calculation of relative humidity are the wet-bulb depression and dry bulb temperature. In this work, easy-to-used predictive tools based on statistical learning concepts, i.e., the Adaptive Network-Based Fuzzy Inference System (ANFIS) and Least Square Support Vector Machine (LSSVM) are developed for calculating relative humidity in terms of wet bulb depression and dry bulb temperature. To evaluate the aforementioned models, some statistical analyses have been done between the actual and estimated data points. Results obtained from the present models showed their capabilities to calculate relative humidity for divers values of dry bulb temperatures and also wet-bulb depression. The obtained values of MSE and MRE were 0.132 and 0.931, 0.193 and 1.291 for the LSSVM and ANFIS approaches respectively. These developed tools are user-friend and can be of massive value for scientists especially, those dealing with air conditioning and wet cooling towers systems to have a noble check of the relative humidity in terms of wet bulb depression and dry bulb temperatures.

In order to assess the degradation state of rolling bearings and accurately grasp the remaining life information of rolling bearings, a bearing remaining life prediction method based on the grey wolf optimization algorithm to improve the BP neural network model is proposed. The method consists of two steps, firstly, using the craggy value and root mean square value to determine the first failure time of rolling bearings so as to approximate the input features, and secondly, using the Grey Wolf optimization algorithm to optimize the BP neural network to construct the degradation model of the bearings through machine learning. The method reduces the prediction error compared with conventional techniques, indicating that the method can effectively simulate the bearing degradation process and predict the remaining useful life (RUL) of the bearing.

In this paper, PEN3 electronic nose was used to detect and recognize fresh and moldy apples (inoculated with Penicillium expansum and Aspergillusniger) taken Golden Delicious apples as model subject. Firstly, the apples were divided into two groups: apples only inoculated with different molds (Group A) and mixed apples of inoculated apples with fresh apples (Group B). Then the characteristic gas sensors of the PEN3 electronic nose that were most closely correlated with the flavor information of the moldy apples were optimized and determined, which can simplify the analysis process and improve the accuracy of results. Four pattern recognition methods, including linear discriminant analysis (LDA), backpropagation neural network (BPNN), support vector machines (SVM) and radial basis function neural network (RBFNN), were then applied to analyze the data obtained from the characteristic sensors, respectively, aiming at establishing the prediction model of flavor information and fresh/moldy apples. The results showed that only the gas sensors of W1S, W2S, W5S, W1W and W2W in the PEN3 electronic nose exhibited strong signal response to the flavor information, indicating were most closely correlated with the characteristic flavor of apples and thus the data obtained from these characteristic sensors was used for modeling. The results of the four pattern recognition methods showed that BPNN presented the best prediction performance for the training and validation sets for both the Group A and Group B, with prediction accuracies of 96.29% and 90.00% (Group A), 77.70% and 72.00% (Group B), respectively. Therefore, it first demonstrated that PEN3 electronic nose can not only effectively detect and recognize the fresh and moldy apples, but also can distinguish apples inoculated with different molds.

The exceptional performance advantages of the fiber optic gyroscope (FOG) position it as a dominant player in middle and high-end inertial navigation systems. To prevent the loss of sensor precision caused by algorithm design and simplify the complex modeling strategy in traditional methods. We gradually demonstrate the significant role of Convolutional Neural Network (CNN) in the navigation system based on FOG, and utilize the particle swarm optimization algorithm (PSO) to expedite the convergence of the network. The experimental results demonstrate that the initial alignment method based on deep learning is more accurate than the traditional method. The attitude angle error is reduced by 81.25%, 92.54% and 36.53% respectively. The research provides support for the future application of deep learning in optical navigation systems.

This paper investigates the use of Physics-Informed Neural Networks (PINNs) in active learning cycles. We defined two scenarios: one semi-supervised and the other fully supervised. PINNs emphasize the integration of physical laws into neural networks to improve the predictive performance of vanilla neural networks and to enhance the efficiency of traditional methods for solving partial differential equations (PDEs). Key contributions include adapting existing computational frameworks to enable the use of Graph Neural Networks for solving problems that require the calculation of gradients on unstructured triangle meshes, a query strategy focusing on the physical loss, and a comparative analysis of this strategy against random sampling across both defined scenarios. This work establishes a foundation for future research aimed at expanding the application of Physics-Informed Graph Neural Networks (PIGNN) using active learning and addressing real-world problems in fluid dynamics and electrodynamics.

River bed materials serve multiple environmental functions as a habitat for aquatic invertebrates and fishes. At the same time, the particle size of the bed material reflects the tractive force of the flow regime in a flood and provides useful information for flood control. The traditional river bed particle size surveys, such as sieving, require time and labor to investigate river bed materials. The authors proposed a method to classify aerial images taken by unmanned aerial vehicle (UAV) using convolutional neural networks (CNN), our previous study showed that terrestrial riverbed material could be classified with high accuracy. In this study, we attempted to classify riverbed materials distributed in shallow waters where the bottom can be seen from UAVs. After training the CNN to classify the images with the same grain size as being in the same class even if the surface flow types taken overlapping the riverbed material were different, the total accuracy reached 90.3%. Moreover, the proposed method was applied to the wide-ranging area to determine the distribution of the particle size. In parallel, the microtopography was surveyed using Lidar-UAV, and the relationship between the microtopography and particle size distribution was discussed. In the steep section, coarse particles were distributed and formed a rapid. Fine particles were deposited on the upstream side of those rapids, where the slope had become gentler due to the damming. There was good agreement between the microtopographical trends and the grain size distribution.

Convolutional neural networks (CNNs) face challenges in capturing long-distance text correlations, and Bidirectional Long Short-Term Memory (BiLSTM) networks exhibit limited feature extraction capabilities for text classification of work order. To address the abovementioned problems, this work utilizes an ensemble learning approach to integrate model elements efficiently. This study presents a method for classifying work order texts using a hybrid neural network model called BERT-BiLSTM-CNN. First, use Bert for preprocessing to obtain text vector representations. Then, capture context and process sequence information through BiLSTM. Next, capture local features in the text through CNN. Finally, obtain classification results through Softmax. Through comparative analysis, the method of fusing these three models is superior to other hybrid neural network model architectures in multiple classification tasks. It has a significant effect on work order classification.

In recent years, intelligent fault diagnosis algorithms using deep learning method have achieved much success. However, the signals collected by sensors contain a lot of noise, which will have a great impact on the accuracy of the diagnostic model. To address this problem, we propose a one-dimensional convolutional neural network with multi-scale kernels (MSK-1DCNN) and apply this method to bearing fault diagnosis. We use a multi-scale convolution structure to extract different fault features in the original signal, and use the ELU activation function instead of the ReLU function in the multi-scale convolution structure to improve the anti-noise ability of MSK-1DCNN; then we use the training set with pepper noise to train the network to suppress overfitting. We use the Western Reserve University bearing data to verify the effectiveness of the algorithm and compare it with other fault diagnosis algorithms. Experimental results show that the improvements we proposed have effectively improved the diagnosis performers of MSK-1DCNN under strong noise and the diagnosis accuracy is higher than other comparison algorithms.

This study introduces a cybernetic control and architectural framework for a robotic fish avatar operated by a human. The behavior of the robot fish is influenced by the electromyographic (EMG) signals of the human operator, triggered by stimuli from the surrounding objects and scenery. An deep artificial neural network (ANN) with perceptrons classifies EMG signals, discerning the type of muscular stimuli generated. The research unveils a fuzzy-based oscillation patterns generator (OPG) designed to emulate functions akin to a neural central pattern generator, producing coordinated fish undulations. The OPG generates swimming behavior as an oscillation function, decoupled into coordinated step signals, right and left, for a dual electromagnetic oscillator in the fish propulsion system. Furthermore, the research presents an underactuated biorobotic mechanism of the subcarangiform type, comprising a two-solenoid electromagnetic oscillator, an antagonistic musculoskeletal elastic system of tendons, and a multi-link caudal spine composed of helical springs. The biomechanics dynamic model and control for swimming, as well as the ballasting system for submersion and buoyancy, are deduced. Experimental results encompass EMG pattern recognition, OPG, and coordinated fish locomotion, with additional topics illustrated through numerical simulations.

An autonomous concrete crack inspection system is necessary for preventing hazardous incidents arising from deteriorated concrete surfaces. In this paper, we represent a concrete crack detection framework to aid the process of automated inspection. The proposed approach employs a deep convolutional neural network architecture for crack segmentation from concrete image. The proposed network alleviates the effect of gradient vanishing problem present in deep neural network architectures. A feature silencing module is incorporated in the crack detection framework, for eliminating unnecessary feature maps from the network. The overall performance of the network significantly improves as a result. Experimental results support the benefit of incorporating feature silencing within a convolutional neural network architecture for improving the network’s robustness, sensitivity, and specificity. An added benefit of the proposed architecture is its ability to accommodate for the trade-off between specificity (positive class detection accuracy) and sensitivity (negative class detection accuracy) with respect to the target application. Furthermore, the proposed framework achieves a high precision rate and processing time than crack detection architectures present in literature.

Regarding the high efficiency of metaheuristic techniques in energy performance analysis, this paper scrutinizes and compares five novel optimizers, namely biogeography-based optimization (BBO), invasive weed optimization (IWO), social spider algorithm (SOSA), shuffled frog leaping algorithm (SFLA), and harmony search algorithm (HSA) for the early prediction of cooling load in residential buildings. The algorithms are coupled with a multi-layer perceptron (MLP) to adjust the neural parameters that connect the CL with the influential factors. The complexity of the models is optimized by means of a trial-and-error effort, and it was shown that the BBO and IWO need more crowded spaces for fulfilling the optimization. The results revealed that the internal parameters (i.e., biases and weights) suggested by the BBO generate the most reliable MLP for both analyzing and generalizing the CL pattern (with nearly 93 and 92% correlations, respectively). Followed by this, the IWO emerged as the second powerful optimizer with mean absolute errors of 1.8632 and 1.9110 in the training and testing phases. Therefore, the BBO-MLP and IWO-MLP can be reliably used for accurate analysis of the CL in future projects.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&amp;E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&amp;E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&amp;E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

The study aims to analyze the characteristic parameters of rooftop photovoltaic (PV) power generation on industrial plant buildings in the Ningxia region of China, in order to evaluate the impact of passive design characteristic parameters on the benefits of PV power generation and determine the degree of impact of different passive design characteristic parameters. The methodology involves analyzing the characteristics of existing industrial plant buildings in Ningxia, China, and conducting a series of regional studies on the parameters of plant PV power generation influencing factors. The simulation results revealed that five features, including roof form, PV panel laying pattern, PV panel laying area, azimuth angle, and PV module material, have a significant impact on PV power generation benefits of industrial plant buildings.The study further uses MATLAB 2022b to build a backpropagation neural network model with 5 neurons in the implicit layer to predict the PV power generation benefits. The model calculates the whole-life cycle power generation benefits and the whole-life cycle reduction of carbon emissions as output data. Finally, the Mean Impact Value (MIV) method is employed to select the feature parameter values one by one within their range, and the passive design feature parameters that have the greatest influence on the prediction results are identified as the PV panel laying method, the PV panel tilt angle, and the PV material parameters, respectively.

The core of eLoran ground-based timing navigation system is the accurate measurement of groundwave propagation delay. However, meteorological changes will disturb the conductive characteristic factors along the groundwave propagation path, especially for complex terrestrial propagation environment, and may even lead to microsecond-level propagation delay fluctuation, seriously affecting the timing accuracy of the system. Aiming at this problem, this paper proposes a propagation delay prediction model based on Back-Propagation neural network (BPNN) for complex meteorological environment, which realizes the function of directly mapping propaga-tion delay fluctuation through meteorological factors. Firstly, the theoretical influence of meteoro-logical factors on each component of propagation delay is analyzed based on calculation parame-ters. Then, through the correlation analysis of the measured data, the complex relationship be-tween the seven main meteorological factors and the propagation delay, as well as their regional differences are demonstrated. Finally, a BPNN prediction model considering regional changes of multiple meteorological factors is proposed, and the validity of the model is verified by long-term collected data. Experimental results show that the proposed model can effectively predict the propagation delay fluctuation in the next few days, and its overall performance is significantly improved compared with the existing linear model and simple neural network model. eLoran; meteorological factor; propagation delay prediction model; Back-Propagation neural network;

This study investigates anomaly detection of IoT device traffic using Convolutional Neural Networks (CNN) and Variational Autoencoders (VAE) to enhance the detection capability of security threats in IoT environments. A series of hardware configurations, software environments, and hyperparameters were utilized to optimize the training and testing processes of the models. The CNN model demonstrates robust classification performance, achieving an accuracy rate of 95.85% on the test dataset, effectively distinguishing between different types of IoT device traffic. Meanwhile, the VAE model exhibits proficient anomaly detection capabilities by effectively capturing abnormal patterns in the data using reconstruction loss and KL divergence. The combined use of CNN and VAE models offers a comprehensive solution to cybersecurity challenges in IoT environments. Future research directions include exploring diverse IoT traffic data, practical deployment for validation, and further optimization of model structures and parameters to improve performance and applicability.

In the field of maneuvering target tracking, the combined observations of azimuth and Doppler may cause weak observation or non-observation in the application of traditional target tracking algorithms. Additionally, traditional target-tracking algorithms require pre-defined multiple mathematical models to accurately capture the complex motion states of targets, while model mismatch and unavoidable measurement noise lead to significant errors in target state prediction. To address those above challenges, in recent years, the target-tracking algorithms based on neural networks, such as recurrent neural networks (RNNs), long short-term memory (LSTM) networks, and Transformer architectures, have been widely used for their unique advantages to achieve accurate predictions. To better model the nonlinear relationship between the observation time series and the target state time series, as well as the contextual relationship among time series points, we present a deep learning algorithm called recursive downsample-convolve-interact neural network (RDCINN) based on convolutional neural network (CNN) that downsamples time series into sub-sequences and extracts multi-resolution features to enable the modeling of complex relationships between time series, which overcomes the shortcomings of traditional target-tracking algorithms in using observation information inefficiently due to weak observation or non-observation. The experimental results show that our algorithm outperforms other existing algorithms in the scenario of strong maneuvering target tracking with the combined observations of azimuth and Doppler.

An effective process monitoring strategy is a requirement for meeting the challenges posed by increasingly complex products and manufacturing processes. To address these needs, this study investigates a comprehensive scheme based on classical machine learning methods, deep learning algorithms, and feature extraction and selection techniques. In a first step, a novel deep learning architecture based on convolutional neural networks (CNN) and gated recurrent units (GRU) is introduced to predict the local weld quality based on mid-wave infrared (MWIR) and near-infrared (NIR) image data. The developed technology is used to discover critical welding defects including lack of fusion (false friends), sagging and lack of penetration, and geometric deviations of the weld seam. Additional work is conducted to investigate the significance of various geometrical, statistical, and spatio-temporal features extracted from the keyhole and weld pool regions. Furthermore, the performance of the proposed deep learning architecture is compared to that of classical supervised machine learning algorithms, such as multi-layer perceptron (MLP), logistic regression (LogReg), support vector machines (SVM), decision trees (DT), random forest (RF) and k-Nearest Neighbors (kNN). Optimal hyperparameters for each algorithm are determined by an extensive grid search. Ultimately, the three best classification models are combined into an ensemble classifier that yields the highest detection rates and achieves the most robust estimation of welding defects among all classifiers studied, which is validated on previously unknown welding trials.

Deep underground laboratories offer advantages for conducting high-precision observations of weak geophysical signals, benefitting from a low background noise level. It is both valuable and feasible to enhance strong, noisy ground electromagnetic (EM) field data using synchronously recorded underground EM signals, which typically exhibit a high signal-to-noise ratio. In this study, we propose an EM field reconstruction method employing a Long Short-Term Memory (LSTM) recurrent neural network with referenced deep underground EM observations. Initially, a deep learning model was developed to capture the time-varying features of underground multi-component EM fields using the LSTM recurrent neural network. Subsequently, this model was applied to process synchronously observed strong, noisy data from other conventional observation systems, such as those at surface, to achieve noise suppression through signal reconstructions. Both theoretical analysis and practical observational data suggest that the proposed method effectively suppresses noise and reconstructs clean EM signals. This method is efficient and time-saving, representing an effective approach to fully utilizing the advantages of deep underground observation data. Furthermore, this method could be extended to the processing and analysis of other geophysical data.

This paper proposed an optimal tracking control scheme through adaptive dynamic programming(ADP) for a class of partially unknown discrete-time nonlinear systems based on radial basis function neural network(RBF-NN). In order to acquire the unknown system dynamics, we use two RBF-NNs, the one is used to construct the identifier, and the another is used to directly approximate the steady-state control input, where a novel adaptive law is proposed to update neural network weights. While the optimal feedback control and the cost function are derived via feedforward neural networks approximating, it is proposed to regulate the tracking error, the critic network and the actor network are then trained online to obtain the solution of the associated Hamilton–Jacobi–Bellman (HJB) equation being built under the ADP framework. Simulations verify the effectiveness of the optimal tracking control technique using the neural networks.

In this research, the application of the Physics-Informed Neural Network (PINN) model is explored to solve transport equation-based Partial Differential Equations (PDEs). The primary objective is to analyze the impact of different activation functions incorporated within the PINN model on its predictive performance, specifically assessing the Mean Squared Error (MSE) and Mean Absolute Error (MAE). The dataset used in the study consists of a varied set of input parameters related to strut diameter, unit cell size, and the corresponding yield stress values. Through this investigation, the aim is to understand the effectiveness of the PINN model and the significance of choosing appropriate activation functions for solving complex PDEs in real-world applications. The outcomes suggest that the choice of activation function may have minimal influence on the model's predictive accuracy for this particular problem. The PINN model showcases exceptional generalization capabilities, indicating its capacity to avoid overfitting with the provided dataset. The research underscores the importance of striking a balance between performance and computational efficiency while selecting an activation function for specific real-world applications. These valuable findings contribute to advancing the understanding and potential adoption of PINN as an effective tool for solving challenging PDEs in diverse scientific and engineering domains.

Drowsiness detection is an important task in road safety and other areas that require sustained attention. In this article, an approach to detect drowsiness in drivers is presented, focusing on the eye region, since eye fatigue is one of the first symptoms of drowsiness. The method used for the extraction of the eye region is Mediapipe, chosen for its high accuracy and robustness. Three neural networks were analyzed based on: InceptionV3, VGG16 and ResNet50V2 that implement deep learning. The database used is NITYMED, which contains videos of drivers with different levels of drowsiness. The three networks were evaluated in terms of accuracy, precision and recall in detecting drowsiness in the eye region. The results of the study show that all three convolutional neural networks have high accuracy in detecting drowsiness in the eye region. In particular, the Resnet50V2 network achieved the highest accuracy, with a rate of 99.71% on average. For better visualization of the data, the Grad-CAM technique is used, with which we get a better understanding of the performance of the algorithms in the classification process.

The paper illustrates a general framework in which a neural network application can be easily integrated and proposes a traffic forecasting approach that uses neural networks based on graphs. The method minimizes the communication network (between vehicles and the database servers) load and represents a reasonable trade-off between communication network load and forecasting accuracy. Traffic prediction leads to the choice of less congested routes and therefore to the reduction of energy consumption. The traffic is forecasting using a LTSM neural network with a regression layer. The inputs of the neural network are sequences - obtained from graph that represent the road network - at specific moments of time that are read from traffic sensors or the outputs of neural network (forecasting sequences). The input sequences can be filtered to improve the forecasting accuracy. This general framework is based on Contiki IoT operating system that ensure support for wireless communication and efficient implementation of processes in a resource constrained system and it is particularized to implement a graph neural network. Two cases are studied: one case in which the traffic sensors are periodically read and the other case in which the traffic sensors are read when their values changes are detected. A comparison between the cases is made and the influence of filtering is evaluated. The obtained accuracy is very good, very close to the accuracy obtained in infinite precision simulation, and the computation time is low enough and the system can work in real time.

Artificial Intelligence (AI) made its first appearance in 1956, and since then it has progressively introduced itself in healthcare system and patients’ information and care. AI functions can be grouped under the following headings: Machine Learning (ML), Deep Learning (DL), Artificial Neural Network (ANN), Convolutional Neural Network (CNN), Computer Vision (CV). Chronic limb-threatening ischemia (CLTI) represents the last stage of peripheral artery disease (PAD), and has increased over recent years, together with the rise in prevalence of diabetes and population ageing. Nowadays AI grants the possibility of developing new diagnostic and treatment solutions in the vascular field, given the possibility of accessing clinical, biological, and imaging data. By assessing the vascular anatomy in every patient, as well as the burden of atherosclerosis, and classifying the level and degree of disease, sizing and planning the best endovascular treatment, defining the perioperative complications risk, integrating experiences and resources between different specialties, identifying latent PAD, thus offering evidence-based solutions and guiding surgeons in the choice of the best surgical technique, AI challenges the role of the physician’s experience in PAD treatment.

Human activity recognition (HAR) using wearable sensors is gaining popularity in the healthcare domain, enabling continuous monitoring and timely interventions. The conventional HAR systems are centralised and need data sharing with a server for processing and model training. However, this data sharing leads to various challenges, such as privacy concerns, increased communication and storage costs, inefficient computational algorithms, data scarcity due to unwillingness to share, and difficulty achieving high accuracy and personalised models simultaneously. To overcome these challenges, this paper introduces a privacy and energy-aware federated learning (FL) framework for model training without data sharing. The proposed scheme incorporates spiking neural networks (SNNs), which are particularly suited for resource-constrained devices due to their event-driven information processing. The key idea is to synergise the strengths of SNNs and long short-term memory (LSTM) to create a hybrid model for robust HAR. The proposed hybrid spiking LSTM (S-LSTM) model uses the LSTM as an input layer to capture temporal dependencies efficiently, followed by spiking layers that replace the typical activation using leaky integrate-and-fire neurons. We employ the combination of surrogate gradient learning and backpropagation through time (BPTT) to update the weights of SNN layers in a supervised manner. The performance of the proposed model is evaluated using two publicly available datasets for both indoor and outdoor scenarios. The results show that the proposed S-LSTM performs much better than spike convolutional neural networks (S-CNN) and simple CNN, achieving the accuracy of 97% and 87% for indoor and outdoor datasets, respectively. Personalisation, also known as fine-tuning the global model using local data, is crucial in HAR. It allows the model to adapt to individual behaviour and preferences, making predictions more accurate. The results also show that personalisation improves the performance of participants up to 9% on average. Additionally, analysis with 50% random client participation reduces communication costs by 50% with minimal impact on accuracy.

During the 1950s, the Gros Michel species of bananas were nearly wiped out by the incurable Fusarium Wilt, also known as Panama Disease. Originating in Southeast Asia, Fusarium Wilt is a banana pandemic that has been threatening the multi-billion-dollar banana industry worldwide. The disease is caused by a fungus that spreads rapidly throughout the soil and into the roots of banana plants. Currently, the only way to stop the spread of this disease is for farmers to manually inspect and remove infected plants as quickly as possible, whereas it is a time-consuming process. The main purpose of this study is to build a deep Convolutional Neural Network (CNN) using a transfer learning approach to rapidly identify fusarium wilt infections on banana crop leaves. We chose to use the ResNet50 architecture as the base CNN model for our transfer learning approach owing to its remarkable performance in image classification, which was demonstrated through its victory in the ImageNet competition. After its initial training and fine-tuning on a data set consisting of 300 healthy and diseased images, the CNN model achieved near-perfect accuracy of 0.99 and was fine-tuned to adapt the ResNet base model. ResNet50’s distinctive residual block structure could be the reason behind these results. To evaluate this CNN model, 500 test images, consisting of 250 diseased and healthy banana leaf images, were classified by the model. The deep CNN model was able to achieve an accuracy of 0.98 and an F-1 score of 0.98 by correctly identifying the class of 492 of the 500 images. These results show that this DCNN model outperforms existing models such as Sangeetha et al., 2023’s deep CNN model by at least 0.07 in accuracy and is a viable option for identifying Fusarium Wilt in banana crops.

We observed and studied the phenomenon of the redox front propagation in different polyaniline (PAni) deposited samples interfaced with liquid or solid polymeric electrolyte. The front of electrochemical conversion, in which the insulator and the conductor parts of PAni are interfaced, is studied observing the temporal evolution of the conductivity of PAni samples. The propagation of redox front was studied in electrochemically obtained thick (2 µm) and in thin (50 nm) poly-aniline films, obtained using Langmuir-Blodgett (LB) method. In the configuration that we tested, the speed of the red-ox front propagation for the thin LB films was found to be 200 micron/sec opening the way for the manufacturing large neural networks, realized using PAni based memristive devices, in which the memristance can be quickly changed in the programmable manner. The prototypes of the spiking neuron connections were manufactured on the basis of lithographically developed gold contacts, bridged by electrochemically grown polyaniline and placed under polymer electrolyte layer with only one counter electrode (gate) for the whole manifold of pseudo-two-terminal memristor bridges. The spike propagation was studied in such gold-polyaniline systems. The research opens the possibility of miniature spike or rate-based neural network circuits manufacture, based on metal pads and polyaniline.

Marine oil spills seriously threaten the coastal environment, challenge the safety of marine eco-system, and cause huge economic losses to marine fishery, aquaculture, and tourism industries. Timely and accurate oil spill monitoring and early warning can not only make the oil spill acci-dent be handled timely and effectively but also provide key information for investigating the re-sponsibility of the polluters. Polarimetric synthetic aperture radar (SAR) has shown its great po-tential in oil spill classification for its capacity to distinguish mineral oil and biogenic look-alikes. Traditional oil spill classification approaches rely on the scattering matrix elements or pre-designed scattering mechanism-based polarimetric SAR features, which limits its robustness and generalization in large-scale marine surveillance tasks. The recent development of deep learning frameworks, especially the convolutional neural network (CNN) provides a powerful tool for remote sensing image classification. However, conventional CNN only accepts re-al-valued input, which cannot efficiently analyze the polarimetric information carried by com-plex-valued SAR data. In this study, a new framework that employs the complex-valued neural network was proposed for marine oil spill detection. Sophisticated studies were designed to evaluate the contribution of the physical scattering mechanism-based features, complex-valued framework, and convolutional feature extraction structures respectively. Comparative studies were conducted on four study cases using Radarsat-2 and SIR-C fully polarimetric SAR data. The outcome of the proposed study may shed light on the development of an end-to-end marine spill classification system and enlarge its application in practical marine surveillance operations.

To digital grade the color fastness of fabrics after rubbing, an automatic grading method based on spectral reconstruction technology and BP neural network was proposed. Firstly, the modeling samples are prepared by rubbing the fabrics according to the ISO standard of 105-X12. Then, to comply with visual rating standards for color fastness, the modeling samples are professionally graded to obtain the visual rating result. After that, a digital camera is used to capture digital images of the modeling samples inside a closed and uniform lighting box, and the color data values of the modeling samples are obtained through spectral reconstruction technology. Finally, the color fastness prediction model for rubbing was constructed using the modeling samples data and BP neural network. The color fastness level of the testing samples was predicted using the prediction model, and the prediction results were compared with the existing color difference conversion method and curve fitting method. Experimental show that the prediction model of fabric color fastness can be better constructed using the BP neural network, where the root-mean-square error of the prediction for the training sample is 0.30, and the root-mean-square error of the prediction for the test sample is 0.25. The overall performance of the method is slightly better than the color difference conversion method, and it is significantly outperforming the curve fitting method. It can be seen that the digital rating method of fabric color fastness to rubbing based on spectral reconstruction and BP neural network has a high consistency with the visual evaluation, which will help for the automatic color fastness grading.

The deaf-mute and individuals with hearing disabilities who communicate through sign language should not be overlooked or excluded. It is a social responsibility to strive for an inclusive world without inequality. Advances in technology offer various solutions to address the communication gap, one of which is the use of computer-based sign language recognition systems. This project proposes a Malaysian Sign Language recognition model utilizing MobileNetV1, a convolutional neural network-based algorithm, to interpret sign language in real-time settings through a website application using Streamlit. The outcome of the model test shows that it has achieved a recognition rate of 96 percent. Although the proposed model has demonstrated the ability to recognize sign language, it is suggested that further improvement can be achieved by enhancing the quality and diversity of the dataset. The implementation of a more comprehensive dataset would lead to improved performance and increased accuracy of the model. This project underscores the importance of considering and accommodating the needs of the deaf-mute and individuals with hearing disabilities and highlights the potential of technology to bridge communication barriers and achieve a more inclusive society.