All kinds of vessels consist of dozens of complex machineries with rotating parts and electric motors that operate continuously in a harsh environment with excess temperature and humidity, vibration, fatigue and load. A breakdown or malfunction in one of these machineries can significantly impact the vessel’s operation and safety and consequently, the safety of the crew and the environment. To maintain operational efficiency and seaworthiness, the shipping industry invests substantial resources in preventive maintenance and repairs. This research presents the economic and technical benefits of predictive maintenance over to traditional preventive maintenance, and repair by replacement approaches in the maritime domain. By leveraging modern technology and Artificial Intelligence, we can analyze real-time operating conditions of machinery, enabling early detection of potential damages and allowing for effective planning of future maintenance and repair activities. In this paper, we propose and develop a Convolutional Neural Network that is fed with raw vibration measurements acquired in a laboratory environment from the ball bearings of a motor. Then, we investigate whether the proposed network can accurately detect the functional state of ball bearings and categorize any possible failures present, contributing to improved maintenance practices in the shipping industry.

Bundle recommendation is provided to users by combining related items into a bundle, enhancing the user's shopping experience and increase the merchant's sales revenue. Despite the success of existing solutions based on Graph Neural Networks(GNN), there are still some significant challenges: (1)It is demanding to explicitly model multiple complex associations using standard graph neural networks. (2)Numerous additional nodes and edges are introduced to approximate higher-order associations. (3)The user-bundle historical interaction data is highly sparse. In this work, we propose a Global Structural Hypergraph Convolution model for Bundle Recommendation (SHCBR) to address the above problems. Specifically, we jointly incorporate multiple complex interactions between users, items, and bundles(three entities) into a relational hypergraph without introducing additional nodes and edges. Higher-order associations are already involved in the hypergraph structure which alleviate the training burden of neural networks and the dilemma of scarce data. In addition, we design a special matrix propagation rule that captures non-pairwise complex relationships between entities. Using item nodes as links, hypergraph convolution propagation between user and bundle nodes generates the learned representations. Experimental results on two real-world datasets demonstrate that SHCBR outperforms the state-of-the-art baselines by 11.07%-25.66\% on Recall and 16.81%-33.53% on NDCG. We publicly release the codes and datasets at https://github.com/Lxtdzh/SHCBR-master/.

Speaker recognition methods based on convolutional neural networks (CNN) have been widely used in the security field and smart wearable devices. However, the traditional CNN has a large number of hyperparameters that are difficult to be determined, which makes the model easy to fall into local optimum or even fail to converge during the training process. Intelligent algorithms such as particle swarm optimization and genetic algorithm are used to solve the above problems. However, these algorithms have poor performance compared with the current emerging meta-heuristic algorithms. In this study, the dung beetle optimized convolution neural network (DBO-CNN) is proposed to identify the speakers, which is helpful in finding suitable hyperparameters for training. By testing the dataset of 50 people, it was demonstrated that the accuracy of the model was significantly improved by using this approach. Compared with the traditional CNN and CNN optimized by other intelligent algorithms, the accuracy of DBO-CNN has increased by 0.6%~4.8%, and reached 98.3%.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

Teachability has been extensively studied under the context of making industrial robots to be programmable and reprogrammable. However, it is only recently that the artificial intelligence (AI) research community is accelerating the research works with the objective of making humanoid robots and many other robots to be teachable under the context of using natural languages. We human beings spend many years to learn knowledge and skills despite our extraordinary mental capabilities of being teachable with the use of natural languages. Therefore, if we would like to develop human-like robots such as humanoid robots, it is inevitable for us to face the issue of making future humanoid robots to be teachable with the use of natural languages as well. In this paper, we present the key details of a top-down design for achieving a teachable mind which consists of two major processes: the first one is the process which enables humanoid robots to gain innate mental capabilities of transforming incoming signals into meaningful crisp data, and the second one is the process which enables humanoid robots to gain innate mental capabilities of undertaking incremental and deep learning with the main focus of associating conceptual labels in a natural language to meaningful crisp data. These two processes consist of the two necessary and sufficient conditions for future humanoid robots to be teachable with the use of natural languages. In addition, this paper outlines a very likely new finding underlying human brain’s neural systems as well as the obvious mathematics underlying artificial deep neural networks. These outlines provide us the strong reason to separate the study of mind from the study of brain. Hopefully, the content discussed in this paper will help the AI research community to venture into the right direction which is to make future humanoid robots, non-humanoid robots, and many other systems to achieve human-like self-intelligence at cognitive level with the use of natural languages.

To effectively preserve marine environments and manage endangered species, it is necessary to employ efficient, precise, and scalable solutions for environmental monitoring. Ecoacoustics provides several benefits as it enables non-intrusive, prolonged sampling of environmental sounds, making it a promising tool for conducting biodiversity surveys. However, analyzing and interpreting acoustic data can be time-consuming and often demands substantial human supervision. This challenge can be addressed by harnessing contemporary methods for automated audio signal analysis, which have exhibited remarkable performance due to advancements in deep learning research. This paper introduces a research investigation into developing an automatic computerized system to detect dolphin whistles. The proposed method utilizes a fusion of various resnet50 networks integrated with data augmentation techniques. Through extensive experiments conducted on a publically available benchmark, our findings demonstrate that our ensemble yields significant performance enhancements across all evaluated metrics. The MATLAB/PyTorch source code is freely available at: https://github.com/LorisNanni/

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

We present a Deep Learning generative model specialized to work with graphs with a regular geometry. It is build on a Variational Autoencoder framework and employs Graph convolutional layers in both encoding and decoding phases. We also introduce a pooling technique (ReNN-Pool), used in the encoder, that allows to downsample graph nodes in a spatially uniform and highly interpretable way. In the decoder, a symmetrical un-pooling technique is used to retrieve the original dimensionality of graphs. Performance of the model are tested on the standard Sprite benchmark dataset, a set of 2D images of video game characters, adequately transforming images data into graphs, and on the more realistic use-case of a dataset of cylindrical-shaped graph data that describe the distributions of the energy deposited by a particle beam in a medium.

A correctly obtained Land-use/land-cover (LULC) prediction map is essential to under-standing and assessing future patterns. In the study, the LULC map of Urmia/Iran in 2030 was produced using two different prediction methods CA-Markov and Artificial Neural Network (ANN). In general, the study followed a methodology consisting of three steps. In the first steps, Landsat satellite images acquired in 2000, 2010 and 2020 were classified with maximum likelihood algorithm and LULC maps were prepared for each year. In the second stage, to investigate the LULC prediction methods' validation (CA-Markov and ANN) the LULC prediction map of 2020 was produced using the LULC map of 2000 and 2010; In this step, the predicted LULC map of 2020 and the actual LULC map of 2020 were evaluated by correctness, completeness and quality indexes. Finally, The LULC map for 2030 was prepared using all two algorithms and the change map was extracted. The results show that the area of soil and vegetation decreased, and built-up regions increased during the research period. The methods validation results show that the two algorithms are much closer to each other. Nevertheless, in general, ANN has the highest completeness (96.21%) and quality (93.8%) and CA-Markov the most correctness (96.47). This study shows that the CA-Markov algorithm is most successful in predicting the future that had larger areas and a higher percentage in the region (urban and vegetation cover) and the ANN algorithm in predicting phenomena that had smaller levels with fewer percentages (soil and rock).

One of the most dangerous diseases that threaten people is Cancer. Cancer if diagnosed in earlier stages can be eradicated with its life threatening consequences. In addition, accuracy in prediction plays a major role. Hence, developing a reliable model that contributes much towards the medical community in early diagnosis of Biopsy images with perfect accuracy come to the scenario. The article aims towards development of better predictive models using multi-variate data and high-resolution diagnostic tools in clinical cancer research. This paper proposes the social spider optimization (SSO) algorithm tuned neural network to classify microscopic biopsy images of cancer. The significance of the proposed model relies on the effective tuning of the weights of the NN classifier by the SSO algorithm. The performance of the proposed strategy is analysed with the performance metrics, such as accuracy, sensitivity, specificity, and MCC measures, and are attained to be 95.9181%, 94.2515%, 97.125%, and 97.68% respectively, which shows the effectiveness of the proposed method in effective cancer disease diagnosis.

Explaining the emergence of behavior and understanding on the basis of neuronal mechanisms is still elusive. One renowned proposal is the Free Energy Principle (FEP), which uses an information-theoretic framework derived from thermodynamic considerations to describe how behavior and understanding would emerge. FEP starts from a whole organism approach, based on mental states and phenomena, mapping them into the neuronal substrate. An alternative approach, the Energy Homeostasis Principle (EHP), initiates a similar explanatory effort, but starting from single neuron phenomena and building up to the whole organism’s behavior and understanding. In this work, we develop the EHP as an alternative but complementary vision to FEP and try to explain how behavior and understanding would emerge from the local requirements of the neurons. Based on EHP and a strict naturalist approach that sees living beings as physical and deterministic systems, we explain scenarios where learning would emerge without the need for volition or goals. Given these starting points, we state several considerations of how we see the nervous system, particularly the role of function, purpose, and the conception of goal-oriented behaviors. We problematize these conceptions, giving an alternative teleology-free framework in which behavior and, ultimately, understanding would still emerge. We reinterpret neural processing explaining basic learning situations up to simple anticipatory behavior. Finally, we end the work with an evolutionary perspective of how this non-goal-oriented behavior appears. We acknowledge that in the current form of our proposal, we are still far from explaining the emergence of understanding. Still, we set the ground for an alternative neuron-based framework to ultimately explain understanding.

The great importance of estimating dissolved oxygen (DO) dictates utilizing proper evaluative models. In this work, a multi-layer perceptron (MLP) network is trained by three capable metaheuristic algorithms, namely multi-verse optimizer (MVO), black hole algorithm (BHA), and shuffled complex evolution (SCE) for predicting the DO using the data of the Klamath River Station, Oregon, US. The records (DO, water temperature, pH, and specific conductance) belonging to the water years 2015 - 2018 (USGS) are used for pattern analysis. The results of this process showed that all three hybrid models could properly infer the DO behavior. However, the BHA and SCE accomplished this task by simpler configurations. Next, the generalization ability of the developed patterns is tested using the data of the 2019 water year. Referring to the calculated mean absolute errors of 1.0161, 1.1997, and 1.0122, as well as Pearson correlation coefficients of 0.8741, 0.8453, and 0.8775, the MLPs trained by the MVO and SCE perform better than the BHA. Therefore, these two hybrids (i.e., the MLP-MVO and MLP-SCE) can be satisfactorily used for future applications.

The evolution in imaging technologies and artificial intelligence algorithms, coupled with improvements in UAV technology, has enabled the use of unmanned aircraft in a wide range of applications. The feasibility of this kind of approach for cattle monitoring has been demonstrated by several studies, but practical use is still challenging due to the particular characteristics of this application, such as the need to track mobile targets and the extensive areas that need to be covered in most cases. The objective of this study was to investigate the feasibility of using a tilted angle to increase the area covered by each image. Deep Convolutional Neural Networks (Xception architecture) were used to generate the models for the experiments, which covered aspects like ideal input dimensions, effect of the distance between animals and sensor, effect of classification error on the overall detection process, and impact of physical obstacles on the accuracy of the model. Experimental results indicate that oblique images can be successfully used under certain conditions, but some practical limitations need to be addressed in order to make this approach appealing.

Myocarditis is the form of an inflammation of the middle layer of the heart wall which is caused by a viral infection and can affect the heart muscle and its electrical system. It has remained as one of the most challenging diagnoses in cardiology. Myocardial is the prime cause of unexpected death in approximately 20% of adults less than 40 years of age. Cardiac MRI (CMR) has been considered as a noninvasive and golden standard diagnostic tool for suspected myocarditis and plays an indispensable role in diagnosing various cardiac diseases. However, the performance of CMR is heavily dependent on the clinical presentation and non-specific features such as chest pain, arrhythmia, and heart failure. Besides, other imaging factors like artifacts, technical errors, pulse sequence, acquisition parameters, contrast agent dose, and more importantly qualitatively visual interpretation can affect the result of the diagnosis. This paper introduces a new deep learning-based model called Convolutional Neural Network-Clustering (CNN-KCL) to diagnose the Myocarditis. The hybrid CNN-KCL method performs the early and accurate diagnosis of Myocarditis. To the best-of-our-knowledge, a Convolutional neural network has never been used before for the diagnosis of Myocarditis. In this study, we used 47 subjects to diagnose myocarditis patients from Tehran's Omid Hospital. The total number of data examined is 10425. Our results demonstrate that CNN-KCL achieves 92.3% in terms of diagnosis myocarditis prediction accuracy which is significantly better than those reported in previous studies.

The article’s goal is to overview challenges and problems on the way from the state of the art CUDA accelerated neural networks code to multi-GPU code. For this purpose, the authors describe the journey of porting the existing in the GitHub, fully-featured CUDA accelerated Darknet engine to OpenCL. The article presents lessons learned and the techniques that were put in place to make this port happen. There are few other implementations on the GitHub that leverage the OpenCL standard, and a few have tried to port Darknet as well. Darknet is a well known convolutional neural network (CNN) framework. The authors of this article investigated all aspects of the porting and achieved the fully-featured Darknet engine on OpenCL. The effort was focused not only on the classification with the use of YOLO1, YOLO2, and YOLO3 CNN models. They also covered other aspects, such as training neural networks, and benchmarks to look for the weak points in the implementation. The GPU computing code substantially improves Darknet computing time compared to the standard CPU version by using underused hardware in existing systems. If the system is OpenCL-based, then it is practically hardware independent. In this article, the authors report comparisons of the computation and training performance compared to the existing CUDA-based Darknet engine in the various computers, including single board computers, and, different CNN use-cases. The authors found that the OpenCL version could perform as fast as the CUDA version in the compute aspect, but it is slower in memory transfer between RAM (CPU memory) and VRAM (GPU memory). It depends on the quality of OpenCL implementation only. Moreover, loosening hardware requirements by the OpenCL Darknet can boost applications of DNN, especially in the energy-sensitive applications of Artificial Intelligence (AI) and Machine Learning (ML).

In this paper, we presented a method of retrieving sea surface wind speed from Sentinel-1 synthetic aperture radar (SAR) horizontal-horizontal (HH) polarization data in extra-wide mode, which have been extensively acquired over the Arctic for sea ice monitoring. In contrast to the conventional algorithm, i.e., using a geophysical model function (GMF) to retrieve sea surface wind by spaceborne SAR, we introduced an alternative method based on physical model guided neural network. Parameters of SAR normalized radar cross section, incidence angle, and wind direction are used as the inputs of the backward propagation (BP) neural network, and the output is the sea surface wind speed. The network is developed based on more than 11,000 HH-polarized EW images acquired in the marginal ice zone (MIZ) of the Arctic and their collocations with scatterometer measurements. Verification of the neural network based on the testing dataset yields a bias of 0.23 m/s and a root mean square error (RMSE) of 1.25 m/s compared to the scatterometer wind speed. Further comparison of the SAR retrieved sea surface wind speed with independent buoy measurements shows a bias and RMSE of 0.12 m/s and 1.42 m/s, respectively. We also analyzed the uncertainty of retrieval when the wind direction data of a reanalysis model are used as inputs to the neural network. By combining the detected sea ice cover information based on the EW data, one can expect to derive simultaneously sea ice and marine-meteorological parameters by spaceborne SAR in a high spatial resolution in the Arctic.

Speech signals are degraded in real-life environments, product of background noise or other factors. The processing of such signals for voice recognition and voice analysis systems presents important challenges. One of the conditions that make adverse quality difficult to handle in those systems is reverberation, produced by sound wave reflections that travel from the source to the microphone in multiple directions.To enhance signals in such adverse conditions, several deep learning-based methods have been proposed and proven to be effective. Recently, recurrent neural networks, especially those with long and short-term memory (LSTM), have presented surprising results in tasks related to time-dependent processing of signals, such as speech. One of the most challenging aspects of LSTM networks is the high computational cost of the training procedure, which has limited extended experimentation in several cases. In this work, we present a proposal to evaluate the hybrid models of neural networks to learn different reverberation conditions without any previous information. The results show that some combination of LSTM and perceptron layers produce good results in comparison to those from pure LSTM networks, given a fixed number of layers. The evaluation has been made based on quality measurements of the signal's spectrum, training time of the networks and statistical validation of results. Results help to affirm the fact that hybrid networks represent an important solution for speech signal enhancement, with advantages in efficiency, but without a significan drop in quality.

Boiler efficiency is called to some extent of total thermal energy which can be recovered from the fuel. Boiler efficiency losses are due to four major factors: the dry gas flux, the latent heat of steam in the flue gas, the combustion loss or the loss of unburned fuel, radiation and convection losses. In this research, the thermal behavior of boilers in gas refinery facilities is studied and their efficiency and their losses are calculated. The main part of this research is comprised of analyzing the effect of various parameters on efficiency such as excess air, fuel moisture, air humidity, fuel and air temperature, the temperature of combustion gases, and thermal value of the fuel. Based on the obtained results, it is possible to analyze and make recommendations for optimizing boilers in the gas refinery complex using response-surface method (RSM).

Layout estimation is a challenge of segmenting a cluttered room image into floor, walls and ceiling. We applied Double refinement network proved to be efficient in the depth estimation to generate heat maps for room key points and edges. Our method is the first not using encoder-decoder architecture for the room layout estimation. ResNet50 was utilized as a backbone for the network instead of VGG16 commonly used for the task, allowing the network to be more compact and faster. We designed a special layout score function and layout ranking algorithm for key points and edges output. Our method achieved the lowest pixel and corner errors on the LSUN data set. The input image resolution is 224*224.

With the increase of the Artificial Neural Network (ANN), machine learning has taken a forceful twist in recent times. One of the most spectacular kinds of ANN design is the Convolutional Neural Network (CNN). The Convolutional Neural Network (CNN) is a technology that mixes artificial neural networks and up to date deep learning strategies. In deep learning, Convolutional Neural Network is at the center of spectacular advances. This artificial neural network has been applied to several image recognition tasks for decades and attracted the eye of the researchers of the many countries in recent years as the CNN has shown promising performances in several computer vision and machine learning tasks. This paper describes the underlying architecture and various applications of Convolutional Neural Network.

Partial differential equations (PDEs) are used to describe a wide range of phenomena, such as heat transfer, fluid dynamics, and quantum mechanics. By solving PDEs, we can ob- tain insights into the behavior of the system and make predictions about its future evolution. Conventional numerical methods for obtaining the approximate solutions of PDEs may re- quire extensive computational resources and time, especially for complex PDEs and large- scale problems. The recently developed physics-informed neural network (PINN) has shown promise in a variety of scientific and engineering fields by incorporating physical laws into the loss functions of the neural network (NN). In addition, the training of PINN does not require ground truth data, but it has poor generalization ability to unseen domains. On the other hand, a convolutional neural network (CNN) has fast inference and better generalization ability, but it requires a large amount of training data. Taking the advantages of PINN and CNN by using Legendre multiwavelets (LMWs) as basis functions, we introduce a new method to approach the PDEs in this paper, namely Physics-Informed Legendre Multiwavelets CNN (PiLMWs-CNN), in order to continuously approximate a grid-based state representation that can be handled by a CNN. PiLMWs-CNN enable us to train our models using only physics-informed loss functions without any pre- computed training data, simultaneously providing fast and continuous solutions that gener- alize to previously unknown domains. In particular, the LMWs can simultaneously possess compact support, orthogonality, symmetry, high smoothness, and high approximation order. Compared to orthonormal polynomial (OP) bases, the approximation accuracy can be greatly increased and computation costs can be significantly reduced by using LMWs. We applied PiLMWs-CNN to approximate the damped wave equation, incompressible Navier-Stokes (N- S) equation, and two-dimensional heat conduction equation. The experimental results show that this method provides more accurate, efficient, and fast convergence with better stability when approximating the solution of PDEs.

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-FLOPS (floating point operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

In recent years, data providers are generating and streaming a large number of images. More particularly, processing images that contain faces have received great attention due to its numerous applications, such as entertainment and social media apps. The enormous amount of images shared on these applications presents serious challenges and requires massive computing resources to ensure efficient data processing. However, images are subject to a wide range of distortions in real application scenarios during the processing, transmission, sharing, or combination of many factors. So, there is a need to guarantee acceptable delivery content, even though some distorted images do not have access to their original version. In this paper, we present a framework developed to estimate the images' quality while processing a large number of images in real-time. Our quality evaluation is measured using an integration of a deep network with random forests. In addition, a face alignment metric is used to assess the facial features. Experimental results have been conducted on two artificially distorted benchmark datasets, LIVE and TID2013. We show that our proposed approach outperforms the state-of-art methods, having a Pearson Correlation Coefficient (PCC) and Spearman Rank Order Correlation Correlation Coefficient (SROCC) with subjective human scores of almost 0.942 and 0.931 while minimizing the processing time from 4.8ms to 1.8ms.

SQL injection attacks are one of the most common types of attacks on web applications. These attacks exploit vulnerabilities in the application’s database access mechanisms, allowing attackers to execute unauthorized SQL queries. In this study, we propose an architecture for detecting SQL injection attacks using a recurrent neural network (RNN) autoencoder. The proposed architecture was trained on a publicly available dataset of SQL injection attacks. Then compared with several other machine learning models, including ANN, CNN, Decision Tree, Naïve Bayes, SVM, Random Forest, and Logistic Regression. The experimental result showed that the proposed approach achieved an accuracy of 94% and an F1 score of 92%, which demonstrate its effectiveness in detecting QL injection attacks with high accuracy in comparison with other models covered in the study.

Multiply-accumulate calculations using a memristor crossbar array is an important method to realize neuromorphic computing. However, the memristor array fabrication technology is still immature, and it is difficult to fabricate large-scale arrays with high-yield, which restricts the development of memristor-based neuromorphic computing technology. Therefore, cascading small-scale arrays to achieve the neuromorphic computational ability that can be achieved by large-scale arrays, which is of great significance for promoting the application of memristor-based neuromorphic computing. To address this issue, we present a memristor-based cascaded framework with some basic computation units, several neural network processing units can be cascaded by this means to improve the processing capability of the dataset. Besides, we introduce a split method to reduce pressure of input terminal. Compared with VGGNet and GoogLeNet, the proposed cascaded framework can achieve 93.54% Fashion-MNIST accuracy under the 4.15M parameters. Extensive experiments with Ti/AlOx/TaOx/Pt we fabricated are conducted to show that the circuit simulation results can still provide a high recognition accuracy, and the recognition accuracy loss after circuit simulation can be controlled at around 0.26%.

Early-season crop-type data are required for a variety of agricultural monitoring and decision-making applications. The early season in this study referred to the prophase and middle of a growth season. Early-season detection of crop types remains challenging because of limited discriminative features, especially for landscapes that are characterized by complex cropping patterns. In fact, different remote-sensing satellites can increase the frequency of data acquisition, which can provide more information in the early season. Moreover, optical and radar sensors have different degrees of sensitivity to crop parameters. Therefore, the integration and application of two types of multitemporal data are of great significance to improve the accuracy and timeliness of crop type detection.In deep learning (DL), convolutional neural network (CNN) and recurrent neural network (RNN) models have great potential for temporal feature extraction. Compared with RNNs, CNNs usually have fewer parameters and are more conducive to determining early-season detection dates of different crop types, which requires a lot of training because of the need to model on different dates. Nevertheless, revisit dates and temporal intervals of different satellites are usually different, resulting in different data acquisition time series; these data cannot be directly used as input for the same convolutional layer. To address this challenge, a Dual-1DCNN was bulit based on the CNN model in this study. Moreover, an incremental training method was used to attain the network on each data acquisition date and obtained the best detection date for each crop type in the early season. A case study for Hengshui City in China was conducted using time series of Sentinel-1A (S1A) and Sentinel-2 (S2). To verify this method, classical methods support vector machine (SVM) and random forest (RF) were implemented. The results demonstrated the following: (1) the Dual-1DCNN extracted discriminative features from S1A and S2 time series at the early season by producing the highest overall accuracy (OA: 87.23%); (2) for summer maize, cotton, and common yam rhizome, the Dual-1DCNN achieved F1 values of 92.39%, 87.71%, and 84.38%, respectively, at the early season (moreover, the early seasons were almost 40, 70, and 80 days before the end of the growth seasons, respectively). These findings suggested that the Dual-1DCNN is promising for the accurate and timely detection of crop types.

A reinforcement learning algorithm is proposed to improve the accuracy of short-term load forecasting (STLF) in this article. The proposed model integrates radial basis function neural network (RBFNN), support vector regression (SVR), and adaptive annealing learning algorithm (AALA). In the proposed methodology, firstly, the initial structure of RBFNN is determined by using SVR. Then, an AALA with time-varying learning rates is used to optimize the initial parameters of SVR-RBFNN (AALA-SVR-RBFNN). In order to overcome the stagnation for searching optimal RBFNN, a particle swarm optimization (PSO) is applied to simultaneously find promising learning rates in AALA. Finally, the short-term load demands are predicted by using the optimal RBFNN. The performance of the proposed methodology is verified on the actual load dataset from Taiwan Power Company (TPC). Simulation results reveal that the proposed AALA-SVR-RBFNN can achieve a better load forecasting precision as compared to various RBFNNs.

This article explores the crucial task of estimating State of Charge (SOC) in Hybrid Electric Vehicles (HEVs) and examines the applicability of various regression models for this purpose. We delve into the strengths and limitations of Linear Regression, Support Vector Regression (SVR), and Neural Network Regression (NNR) in the context of SOC estimation. Linear regression provides a simple and interpretable baseline, SVR extends this to nonlinear relationships, while NNR emerges as a powerful tool with adaptive capabilities. The choice of model depends on factors such as data characteristics, interpretability, and computational resources. As the field evolves, the article advocates for a nuanced approach, possibly incorporating hybrid models, to achieve robust and accurate SOC estimation, contributing to the ongoing enhancement of HEV efficiency and sustainability.

Seeds can maintain their quality for a limited time; after that, they will lose their germination ability and vigor. Some physiological and physicochemical changes in the structure of the seeds during storage can decrease the quality of the seeds which is known as aging. Therefore, detection of the strong young seeds from the old ones is a vital issue in the modern agriculture. Conventional methods of detection of the seed viability and germination are destructive, time-consuming and costly. In this research, two peanut cultivars, namely North Carolina 2 (NC-2) and Florispan were selected and three artificial aging levels were induced to them. Hyperspectral images (HSI) of the samples were acquired and the seed viability was evaluated using two pre-trained convolutional neural network (CNN) image processing models, AlexNet and VGGNet. The noise of the reflection spectra of the samples was relatively resolved and modified by combining Preprocessing techniques of moving average (MA) and standard normal variate (SNV). Using principal component analysis (PCA), the dimensions were declined and three principal components (PC) were extracted. These PCs were then used as variables in the classification of support vector machine (SVM) and linear discriminant analysis (LDA). The results showed the high capability of CNN architectures such as AlexNet and VGGNet in detection of the seed viability based on the HIS with no pre-processing and feature extraction. The mentioned architectures reached the accuracy of 0.985 and 0.986, respectively. The combination of feature extraction method of PCA with LDA and SVM classifiers showed that the use of a limited number of PCs instead of all wavelengths can decrease the complexity of modeling, while enhancing the efficiency of the models such that LDA and SVM classifiers achieved the accuracy of 0.983 and 0.986 in classification of peanut sees, respectively.

The conventional method used for calculating pavement condition index (PCI) has two major drawbacks: safety problems during pavement inspection, and human error. This paper proposes a method for removing these problems. The proposed method uses surface deflection data in falling weight Deflectometer test to estimate PCI. The data used in this study were derived from 236 pavement segments taken from Tehran-Qom freeway in Iran. The data set was analyzed using multi layers perceptron (MLP) and radial basis function (RBF) neural networks. These neural networks were optimized by levenberg-marquardt (MLP-LM), scaled conjugate gradient (MLP-SCG), imperialist competitive (RBF-ICA), and genetic (RBF-GA) algorithms. After initial modeling with four neural networks mentioned, the committee machine intelligent systems (CMIS) method was adopted to combine the results and improve the accuracy of the modeling. The results of analysis have been verified by the four criteria of average percent relative error (APRE), average absolute percent relative error (AAPRE), root mean square error (RMSE) and standard error (SD). The best reported results belonged to CMIS, including APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.

Direct measurement of strain within muscle is important for understanding muscle function in health and disease. Current technology (kinematics, dynamometry, electromyography) provides limited ability to measure strain within muscle. Regional fiber orientation and length are related with active/passive strain within muscle. Currently, ultrasound imaging provides the only non-invasive means of observing regional fiber orientation within muscle during dynamic tasks. Previous attempts to automatically estimate fiber orientation from ultrasound are not adequate, often requiring manual region selection, feature engineering, providing low-resolution estimations (one angle per muscle), and deep muscles are often not attempted. Here, we propose deconvolutional neural networks (DCNN) for estimating fiber orientation at the pixel-level. Dynamic ultrasound images sequences of the calf muscles were acquired (25 Hz) from 8 healthy volunteers (4 male, ages: 25–36, median 30). A combination of expert annotation and interpolation/extrapolation provided labels of regional fiber orientation for each image. We then trained DCNNs both with and without dropout using leave one out cross-validation. Our results demonstrated robust estimation of regional fiber orientation with approximately 3° error, which was an improvement on previous methods. The methods presented here provide new potential to study muscle in disease and health.

The intracranial pressure (ICP) signal, as monitored on patients in intensive care units, contains pulses of cardiac origin where P1 and P2 subpeaks can often be observed. When calculable, the ratio of their relative amplitudes is an indicator of the patient’s cerebral compliance. This characterization is particularly informative on the overall state of the cerebrospinal system. We developed a recurrent neural network-based framework for P2/P1 ratio computation that only takes a raw ICP signal as an input. Two tasks are performed, namely pulse classification and subpeak designation. Pulse classification was achieved with an area under the curve of 0.90 on a 4,344-pulse testing dataset, while the peak designation algorithm identified pulses with a P2/P1 ratio > 1 with a 97.3% accuracy. Although it still needs to be evaluated on a larger number of labeled recordings, our automated P2/P1 ratio calculation framework appears to be a promising tool for improving bedside monitoring devices.

COVID-19 was a terrible worldwide pandemic that caused a global public health crisis, with numerous deaths and a severe economic depression. To suppress the spread of COVID-19 and initiate patient isolation and contact tracing to reduce its effect, early diagnosis was required, with real-time reverse transcriptase polymerase chain reaction (RT-PCR) swab test being the most widely used. However, the RT-PCR test was sometimes found to be lengthy and inaccurate and; for that reason, in many cases of severe complications of COVID-19 pneumonia, chest screening with radiography imaging was preferred. In this paper, we carried out a study for COVID-19 detection from computed tomography images, and compared the obtained results using deep learning (DL) and support vector machine (SVM). The findings showed that, despite the excellent results shown by deep learning, the accuracy in predicting COVID-19 using SVM, in the presence of small databases, was slightly higher than DL. The execution time using SVM was also shorter

Abstract: It has been shown that three-dimensional self-assembled multicellular structures derived from human pluripotent stem cells show electrical activity similar to EEG. More recently, neurons were successfully embedded in a digital game-worlds (Kagan, et al. 2022). The biologically inspired neural network (BNN), expressing human cortical cells, was able to show internal modification and learn the task at hand (predicting the trajectory of a digital ball while moving a digital paddle). In other words, the system allowed to read motor information and write sensory data into cell cultures. In this article, we discuss Neural Correlates of Consciousness (NCC) theories, and their capacity to predict or even allow for consciousness in a BNN. We found that In-formation Integration Theory (IIT) is the only NCC that offers the possibility for a BNN to show consciousness. IIT argues that any system capable of integrating information will have some degree of phenomenal consciousness. The pattern of activity appearing in the BNN, with increased density of sensory information leading to better performance, implies that the BNN could be conscious. This may have profound implications from a physiological, philosophical, and ethical perspective.

The electroencephalogram (EEG) is a record of brain activity. Brain Computer Interface (BCI) technology formed by the EEG signal has become one of the hotspots at present. How to extract the feature signal of EEG is the most basic research of BCI technology. In this paper, A new method of recognizing fatigue, conscious, concentrated state of human brain is proposed by the combination of discrete wavelet transform and the neural network based on EEG signal. First of all, the law signal is preprocessed by the wavelet denoising method because the law EEG signal contains a large number of high frequency noise, which is decomposed into multi-layer high frequency signal and low frequency signal. thus, δ wave, θ wave, α wave, β wave are obtained by the wavelet transform. And then, frequency band energy of the different wave is regards as the feature signal of EEG. In the experiment, the feature signal is classified by radial basic function (RBF) and annealed chaotic competitive learning network (ACCLN). RBF and ACCLN networks are trained with 500 sets of sample data and are tested by 100 sets of samples in different mental states. The experimental results show that the average accuracy of RBF network under three conditions are 88.75%, 88.25%, 88.5%, respectively, and the correct rate of ACCLN network is 97%, 98%, 98%, respectively.

The coronavirus (covid-19) pandemic is putting healthcare systems across the world under unprecedented and increasing pressure according to the World Health Organization (WHO). With the advances in computer algorithms and especially Artificial Intelligence, the detection of this type of virus in the early stages will help in fast recovery and help in releasing the pressure off healthcare systems. In this paper, a GAN with deep transfer learning for coronavirus detection in chest x-ray images is presented. The lack of benchmark datasets for covid-19 especially in chest x-rays images is the main motivation of this research. The main idea is to collect all the possible images for covid-19 that exists until the writing of this research and use the GAN network to generate more images to help in the detection of the virus from the available x-rays images with the highest accuracy possible. The dataset used in this research was collected from different sources and it is available for researchers to download and use it. The number of images in the collected dataset is 307 images for four different types of classes. The classes are the covid-19, normal, pneumonia bacterial, and pneumonia virus. The dataset is divided into 90% for the GAN and the training and the validation phase, while 10% used in the testing phase. The GAN helps in generating more images from the original dataset to be 30 times larger than the originally collected dataset. The GAN also help in overcoming the overfitting problem and made the proposed model more robust. Three deep transfer models are selected in this research for investigation. The models are the Alexnet, Googlenet, and Restnet18. Those models are selected based on their small number of layers on their architectures, which will reflect in reducing the complexity of the models and the consumed memory and time. Using a combination of GAN and deep transfer models prove it is efficiency according to validation, testing accuracy, and performance measurements such as precision, recall, and F1 score. Three case scenarios are tested through the paper, the first scenario which includes 4 classes from the dataset, while the second scenario includes 3 classes and the third scenario includes 2 classes. All the scenarios include the covid-19 class as it is the main target of this research to be detected. In the first scenario, the Googlenet is selected to be the main deep transfer model as it achieves 80.6% in testing accuracy. In the second scenario, the Alexnet is selected to be the main deep transfer model as it achieves 85.2% in testing accuracy, while in the third scenario which includes 2 classes(covid-19, and normal), Googlenet is selected to be the main deep transfer model as it achieves 100% in testing accuracy and 99.9% in the validation accuracy. All the performance measurement strengthen the obtained results through the research. Finally, this research may be considered one of the first trails to use GAN and deep transfer models together to help in detecting coronaviruses (covid-19) within the absence of a benchmark dataset around the world, especially in x-rays chest images.

The development of new turbomachinery designs requires numerous time-consuming and computationally intensive computational fluid dynamics (CFD) calculations. However, most of the generated high spatial resolution data remains unused at later development steps. That is also the case with automated optimization processes that use only a few integral values to determine objectives and constraints. Therefore the development of a data-driven AI model was initiated to ensure the potential of further use of the CFD data which is also used to train the AI model. The presented method subsequently provides a fast approximation of the 3D flow for new designs. In this paper, the structure of the developed AI model is presented and the approximation quality is analysed using a complex, state-of-the-art compressor test case. It is shown that the AI model can reproduce many characteristics of the 3D flow of new designs, and performance measures such as efficiency can be derived from these flow predictions. In addition, the complex test case revealed that greater design variation reduces the AI approximation quality which can lead to undesirable exploratory behaviour in an optimisation setup. Overall, the test case has shown promising results and has provided hints for further improvements of the AI model.

Facial recognition systems are widely used systems around the globe. Their applications in real world scenarios like law enforcement, surveillance, ID card identification, information security, access control and many more has made them very important in today’s world. These systems have shown promising results and excellent performance; however, these systems need tremendous number of facial images for training before they are implemented in the real-world scenarios. The problem arises when we face lack of training images due to which the performance of such systems decreases exponentially. The problem becomes even worse when there is only one image per subject for training our facial recognition system, the probe image might contain variation like illumination, expression and disguise which are hard to be accurately recognized. Generative models have achieved great success for handling the lack of training data by generating synthetic data that resembles the original data. We have created a new method by fine tuning the basic Conditional Generative Adversarial Network (CGAN) to generate synthetic facial images provided only single image per subject. These synthetic facial images contain six variations that are smile, anger, stare, illumination and disguise. We increased the size of the dataset and then applied a convolutional neural network for facial recognition, which improved the accuracy of our system from 0.76 to 0.99.

To protect power lines, distance relays are used which can rely on a modified distance resistance. But usually the operating range of these relays changes as the network conditions change (network topology, load value, output value, etc.) and leads to false trips, By using methods that can process information and recognize patterns, for example, the use of micro and intelligent processor algorithms can use the new relays with high precision and thus provide adequate protection. In this study, a distance relay was modeled using a neural network, and it was observed that the neural relay had higher accuracy than the conventional relay. In addition to detecting the fault and its location, type and phase of the fault, three-stage simultaneous protection can be performed. As a result, the number of linear relays can be reduced by using relays based on neural technologies. An MLP (multilayer perceptron) neural network is used to model a sequence of distances.

This paper investigates the dynamic properties of artificial neural networks using differential equations and explores the influence of parameters on stability and neural oscillations. By analyzing the equilibrium point of the differential equations, we identify conditions for asymptotic stability and criteria for oscillation in artificial neural networks. Furthermore, we demonstrate how adjusting synaptic weights between neurons can effectively control stability and oscillation. The proposed model offers potential insights into the malfunctioning mechanisms of biological neural networks implicated in neurological disorders like Parkinson's disease tremors and epilepsy seizures, which are characterized by abnormal oscillations.

In this article, a method for the moisture mapping of the soil surface of agrophytocenosis was proposed using neural network based on synchronized radar and multispectral optoelectronic data of Sentinel-1,2. To verify the developed method, data from two experimental plots were used. These plots were located two on irrigated soybean crops. The first of them was located on the right bank (1st plot) and the second one on the left bank (2nd plot) of the down part of Volga River. Two experimental soil moisture geo-datasets were done by measurements and geo-referencing points using gravimetric method (1st plot) and with proximal sensing method (2nd plot) using Soil Moisture Sensor ML3-KIT (THETAKIT, Delta). The soil moisture retrieval algorithm was based on the use of a neural network to predict reflection coefficient of an electromagnetic wave from the soil surface, followed by inversion into soil moisture using a dielectric model that takes into account the soil texture. The input parameter of the neural network was the ratio of the microwave radar vegetation index (calculated on the basis of Sentinel-1 data) to the index (calculated on the basis of data of multispectral optoelectronic channels 8 and 11 of Sentinel-2). Such way calculated index reveals showed a significantly greater dependence on soil moisture than on vegetation height that was been used in previous studies. The retrieved values of soil moisture were compared with the soil moisture measured in-situ. The proposed method with a determination coefficient of 0.44-0.65 and a standard deviation of 2.4%-4.2% for the 1st plot as well as with and of the same metrics for the 2nd allows predicting the soil moisture of both a test plots covered by soybean plants, relative to soil moisture measured in-situ. The conducted research created the scientific basis for a new technology for remote sensing the moisture content of the soil surface of agrophytocenosis as an element of the precision farming system and agroecology.

Three-phase induction motors play a key role in industrial operations. However, their failure can result in serious operational problems. This study focuses on the early identification of faults through accurate diagnosis and classification of faults in three-phase induction motors, using artificial intelligence techniques, by analyzing current, temperature, and vibration signals. Experiments were conducted on a test bench, simulating real operating conditions, including stator phase unbalance, bearing damage and shaft unbalance. To classify the faults, an Auto-Regressive Neural Network with Exogenous Inputs (NARX) was developed. The parameters of this network were determined through a process of selecting the best network, using the scanning method with multiple training and validation iterations, with the introduction of new data. The results of these tests showed that the network had excellent generalization in all the situations evaluated, achieving the following accuracy rates: Motor without fault = 94.2%, Unbalance fault = 95%, Bearings with fault =98% and Stator with fault = 95%.

Evolutionary algorithms and swarm intelligence algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using these algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1, the author previously reported experimental evaluations on Evolution Strategy　for reinforcement learning of binary neural networks, utilizing the Pendulum control task. This article constitutes Part2 of the series of comparative research. In this study, Genetic Algorithm is adopted as another evolutionary algorithm. Wilcoxon signed rank test revealed that there was no statistically significant difference between the fitness scores obtained using GA and those using ES. However, the p-value 0.11 indicated that GA worked better than ES on this training task. As the values of binary weights, {-1, 1} were significantly superior to {0, 1} (p < .01). The motion of the pendulum controlled by the binary MLP after the training showed that the binary MLP successfully swung the pendulum swiftly into an inverted position and maintained its stability after inversion.

The increasing use of Convolutional Neural Networks (CNN) has brought about a significant transformation in numerous fields, such as image categorization and identification. In the development of a CNN model for classifying images of sericea lespedeza (SL; Lespedeza cuneata) from weed images, four architectures were explored: CNN-Model Variant 1, CNN-Model Variant 2, VGG16, and ResNet50. The CNN-Model Variant 1 demonstrated 100 % validation accuracy, while Variant 2 achieved 90.78% validation accuracy. Pre-trained models, like VGG16 and ResNet50, were also analyzed. In contrast, ResNet50's steady learning pattern indicated potential for better generalization. A detailed evaluation of these models revealed that Variant 1 achieved a perfect score in precision, recall, and F1-score, indicating superior optimization and feature utilization. Variant 2 presented a balanced performance, with metrics between 86% and 93%. The VGG16 mirrored the behavior of Variant 2, both maintaining around 90% accuracy, but ResNet50's results revealed a conservative approach for class 0 predictions. Overall, Variant 1 stood out in performance, while both Variant 2 and VGG16 showed balanced results. The reliability of CNN model Variant 1 is highlighted by the significant accuracy percentages, which demonstrate its potential for practical implementation in agriculture. Smartphone application for the identification of SL in a field-based trial has shown promising results with an accuracy of 98%-99%. Using a CNN model with batch normalization has the potential to play a crucial role in redefining and optimizing the management of undesirable vegetation in the future.

Camouflage evaluation typically involves human visual search and detection experiments that are time-consuming and expensive. Hence, there is a need for models that compute camouflage effectiveness from digital imagery. Convolutional neural networks are a powerful tool for automatic object detection and recognition. We investigated whether such a network (YOLO) can also provide a measure of camouflage effectiveness that is related to human perception. To this end, human performance measures of camouflage effectiveness such as detection time and target conspicuity were obtained in observer experiments and compared with the performance of the (standard, i.e. pre-trained) YOLO-V4-tiny algorithm. YOLO provides the probability that a detected object is correctly classified, and this is adopted as our measure of camouflage effectiveness. We compared the YOLO-predicted classification probability for a person in camouflage clothing moving through rural and urban scenes to human detection performance. Overall, camouflage effectiveness predicted by YOLO correlates with human observer performance. At close distances, YOLO’s classification performance appears sensitive to high-contrast shape-breaking elements of a camouflage pattern. This suggests that YOLO may be adapted to assess camouflage effectiveness for a wide range of applications, such as evaluating or optimizing one’s signature and predicting optimal hiding locations in a given environment. Further research is required to fully establish YOLO’s limitations and applicability for this purpose.

Reasonable allocation of production plans and saving the overall electricity cost are crucial for large manufacturing conglomerates, which is an effective way for conglomerates to realize open-source and cost-saving. This paper develops an optimization model of off-site industrial production scheduling for enterprises in response to the problems of high electricity costs due to the irrational allocation of production schedules on the demand side of China's electric power and the difficulty of promoting industrial and commercial distributed photovoltaic (PV) projects in China. The model makes full use of the conditions of different PV resources and different electricity prices in different places to optimize the scheduling of industrial production in different places. The model is embedded with two sub-models of the electricity price prediction model and distributed photovoltaic kWh cost model to complete the model parameters, in which the electricity price prediction model utilizes the LSTM neural network. The integrated model is then solved by the particle swarm algorithm. To verify the effectiveness of the model in solving the problem of off-site production scheduling on the demand side of electricity, the research team researched two off-site pharmaceutical factories belonging to the same large pharmaceutical company. Finally, the research data were substituted into the model for solving, and it was concluded that the optimization model could significantly reduce the cost of electricity consumption of the enterprise by about 7.9 %.

Taekwondo has evolved from a traditional martial art into an official Olympic sport. This study introduces a novel action recognition model tailored for Taekwondo unit actions, utilizing joint motion data acquired via wearable inertial measurement unit (IMU) sensors. The utilization of IMU sensor-measured motion data facilitates the capture of the intricate and rapid movements characteristic of Taekwondo techniques. The model, underpinned by a conventional convolutional neural network (CNN)-based image classification framework, synthesizes action images to represent individual Taekwondo unit actions. These action images are generated by mapping joint motion profiles onto the RGB color space, thus encapsulating the motion dynamics of a single unit action within a solitary image. To further refine the representation of rapid movements within these images, a time-warping technique was applied, adjusting motion profiles in relation to the velocity of the action. The effectiveness of the proposed model was assessed using a dataset compiled from 40 Taekwondo experts, yielding remarkable outcomes: an accuracy of 0.998, precision of 0.983, recall of 0.982, and an F1-score of 0.982. These results underscore the time-warping technique's contribution to enhancing feature representation, as well as the proposed method's scalability and effectiveness in recognizing Taekwondo unit actions.

Neural-objective and image optimization approaches for drilling fluid rheology automation are crucial for drilling engineering optimization. A myriad of intelligent computational models are employed to predict and monitor the parameters of mud rheology and filter cake permeability posture using an artificial neural network feedforward (ANN-FF) function, a non-ANN-FF function, an image processing tool, and a model optimization tool. 498 datasets of synthetic-based mud (SBM) flat rheology from a drilling mud laboratory at Nazarbayev University were imported into a user-friendly MATLAB application using image processing and nftool. Apart from the Google TensorFlow Sequential API DNN architecture used, a Levenberg-Marquardt training algorithm with input sigmoid hidden neurons 10, 12, and 18 coupled with a linear output layer was also used to predict the SBM flow index. OBM and SBM filter cakes were processed for void spaces; however, a model study was extrapolated to maximize filtration volume Vf. The study’s findings show that the ANN-FF model employed for rheological property monitoring and prediction had higher steady and exponential levels of accuracy and a correlation coefficient of 0.96-0.99. More so, SBM and OBM image processing presented an area of void spaces of 1790M2 and 1739M2, respectively. The porosity and permeability postures of both SBM and OBM resulted in a significant void space capable of maximizing the flow index. In addition, the single-objective modelling based on a genetic algorithm did validate the experimental rheological data for flow index or filtration volume Vf optimization; the study resulted in the finding that the constrained physics-informed objective function hindered maximizing oil recovery and instead predicted possible formation damage. It is empirical to note that automating flow predictions with neural, objective, and image functions has presented an alternative novel method for non-programmers using MATLAB and Google Colabs that is capable of enhancing mud rheological parameters, drilling efficiency, and hydrocarbon recovery.

Survival models have become popular for credit risk estimation. Most current credit risk survival models use an underlying linear model. This is beneficial in terms of interpretability but is restrictive for real-life applications since it cannot discover hidden nonlinearities and interactions within the data. This study uses discrete time survival models with embedded neural networks as estimators of time to default. This provides flexibility to express nonlinearities and interactions between variables, and hence allows for models with better overall model fit. Additionally, the neural networks are used to estimate Age-Period-Cohort (APC) models so that default risk can be decomposed into time components for loan age (maturity), origination (vintage) and environment (e.g., economic, operational and social effects). These can be built as general models, or as local APC models for specific customer segments. The local APC models reveal special conditions for different customer groups. The corresponding APC identification problem is solved by a combination of regularization and fitting the decomposed environment time risk component to macroeconomic data, since the environmental risk is expected to have a strong relationship with macroeconomic conditions. Our approach is shown to be effective when tested on a large publicly available US mortgage data set. This novel framework can be adapted by practitioners in the financial industry to improve modelling, estimation and assessment of credit risk.

A long time has passed since COVID-19 was discovered and widely disseminated. Both machine learning and deep learning have moved towards the research of diagnosing COVID-19. Compared to deep learning, traditional machine learning-based methods can also achieve good diagnostic results if they are improved based on innovative points. And deep learning remains a more popular research object. Based on the deep neural network in the field of deep learning, the convolutional neural network, recurrent neural network, long and short-term memory network, and Transformer model have been extended. These models improve the performance and processing power of neural networks by introducing new structures and algorithms. This paper will introduce the basic concepts of machine learning and deep learning, as well as the details of using the relevant methods of both to help diagnose COVID-19.

Big data technologies are disruptive technologies that affect every business, including those in the construction industry. The Thai government has also been affected, and attempted to use machine learning techniques with the analytics of big data technologies to predict which construction projects have a winning price over the project budget. However, this technology was never developed, and the government did not implement it because they had data obtained via a traditional data collection process. In this study, traditional data were processed to predict behavior in Thai government construction projects using a machine learning model. The data were collected from the government procurement system in 2019. There were seven input data, including project owner department, type of construction project, bidding method, project duration, project level, winning price over estimated price, and winning price over budget. A range of classification techniques, including an artificial neural network (ANN), a decision tree (DC), and K-nearest neighbor (KNN), were used in this study (ANN). According to the results, after hyperparameter tuning, ANN had the greatest prediction accuracy with 78.9 percent. This study confirms that data from the Thai government procurement system can be investigated using machine learning techniques from big data technologies.

Near Earth Asteroids represent potential threats to human life because their trajectories may bring them in the proximity of the Earth. Monitoring these objects could help predict future impact events, but such efforts are hindered by the large numbers of objects that pass through the Earth’s vicinity. Additionally, there is also the problem of distinguishing asteroids from other objects in the night sky, which implies sifting through large sets of telescope image data. Within this context, we believe that employing machine learning techniques could greatly improve the detection process by sorting out the most likely asteroid candidates to be reviewed by human experts. At the moment, the use of machine learning techniques is still limited in the field of astronomy and the main goal of the present paper is to study the effectiveness of deep CNNs for the classification of astronomical objects, asteroids in this particular case, by comparing some of the well-known deep convolutional neural networks, including InceptionV3, Xception, InceptionResNetV2 and ResNet152V2. We have applied transfer learning and fine-tuning on these pre-existing deep convolutional networks and from the results that we have obtained one can see the potential of using deep convolutional neural networks in the process of asteroid classification. The InceptionV3 model has the best results in the asteroid class, meaning that by using it, we loose the least number of valid asteroids.

In this paper we derive a unified perspective for Optimal Transport (OT) theory and Mean Field Control (MFC) theory to analyse the learning process for Neural Networks algorithms in a high-dimensional framework. We consider Mean Field Neural Networks in the context of MFC theory, specifically the mean field formulation of OT theory that allows the development of highly efficient algorithms while providing a powerful tool in the context of explainable Artificial Intelligence.

Cancer is a major concern for people, and accurately predicting the probability of cancer incidence and mortality is an important research topic. With the development of big data and artificial intelligence technology, a new machine learning model has emerged. Using 72,591 pieces of data, including age, case count, population size, race, gender, site of onset, and year of discovery, we built a machine learning model. Through calculations, we found that the decision tree, random forest, logistic regression, support vector machine, and neural network achieved testing accuracies of 62.11%, 61.68%, 54.53%, 55.72%, and 63.10%, respectively. With the help of this model, scientists and policymakers can accurately predict future cancer incidence and mortality rates through databases, allowing them to make relevant policies (such as timely allocating doctors and medical resources) to better serve the people.

Biochemical oxygen demand (BOD) is one of the most important factors to consider when evaluating water contamination. BOD5 is the amount of oxygen consumed in five days by microorganisms that oxidize biodegradable organic materials in an aerobic biochemical manner. The primary objective of this effort is to use microbial fuel cells (MFCs) to shorten the time required for BOD5 measurements. We created a regression artificial neural network (AI), and the predictions we obtained for BOD5 measurements were taken over 6 – 24 hours with an average error of just 7%. The outcomes demonstrated by our AI MFC/BES BOD5 sensor’s viability for use in real-world scenarios.

Objective: The aim of this study was to provide a new machine learning method to determine temporal events and inner-cycle parameters (e.g., cycle, poles and skis contact and swing time) in cross-country roller ski skating on the field, using a single deported inertial measurement unit (IMU). Methods: The developed method is based on long short-term memory neural networks to detect poles and skis initial and final contact with the ground during the cyclic movements. Eleven athletes skied four laps of 2.5 km at low and high intensity using skis with two different rolling coefficients. They were equipped with IMUs attached to the upper back, lower back and to the sternum. Data from force insoles and force poles were used as reference system. Results: The IMU placed on the upper back provided the best results, as the LSTM network was able to determine the temporal events with an accuracy ranging from 49 to 55 ms and the corresponding inner-cycles parameters were calculated with a precision of 63 to 68 ms. The method detected 95% of the events for the poles and 87% of the events for the skis. Conclusion: The proposed LSTM method provides a promising tool for assessing temporal events and inner-cycle phases in roller ski skating showing the potential of using a deported IMU to estimate different spatio-temporal parameters of human locomotion.

Heme proteins serve diverse and pivotal biological functions. Therefore, clarifying the mechanisms of these diverse functions of heme is a crucial scientific topic. Distortion of heme porphyrin is one of the key factors regulating the chemical properties of heme. Here, we constructed convolutional neural network models for predicting heme distortion from the tertiary structure of the heme-binding pocket to examine their correlation. For saddling, ruffling, doming, and waving distortions, the experimental structure and predicted values were closely correlated. Furthermore, we assessed the correlation between the cavity shape and molecular structure of heme and demonstrated that hemes in protein pockets with similar structures exhibit near-identical structures, indicating the regulation of heme distortion through the protein environment. These findings indicate that the tertiary structure of the heme-binding pocket regulates the distortion of heme porphyrin, thereby controlling the chemical properties of heme relevant to the protein function; this implies a structure–function correlation in heme proteins.

Objective A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data. Approach PyCharm, a Python platform, will be used to house and process the CNN. The raw data used for the training of the CNN will be sourced from the PhysioBank website. The EEG signal data will then be pre-processed using Brainstorm software that is a toolbox used in conjunction with MATLAB. The sample data used to validate and test the trained CNN, will be also be extracted from Brainstorm but in a much smaller size compared to the training data which is comprised of thousands of images. The sample size would be comparable to a person wearing a Brain Computer Interface (BCI), offering approximately 20 seconds of motor imagery signal data. Results The raw EEG data was successfully extracted and pre-processed. The deep learning model was trained using the extracted image data along with their corresponding labels. After training, it was able to accurately identify the T1 class label at 100 percent. The python coding was then modified to restore the trained model and feed it test sample data in which it was found to recognise 6 out of 10 lines of T1 signal image data. The result suggested that the initial training of the model required a different, more varying approach, so that it would be able to detect varying sample signal image data. The outcome of which could mean that the model could be used in applications for multiple patients wearing the same BCI hardware to control a device or interface.

Stripe rust ​​(caused by Puccinia striiformis f. sp. tritici) is one of the most devastating diseases of wheat and causes large-scale epidemics and severe yield loss. Applying fungicides during early epidemic development is crucial to controlling the disease but is often challenged by resource-limited human visual scouting. Deep learning has the potential to process images and videos captured from affordable devices to empower high-throughput phenotyping for early detection of stripe rust for timely application of fungicides and improve control efficiency. Here, we developed RustNet, a neural network-based image classifier, for efficiently monitoring fields for stripe rust. RustNet was built on a ResNet-18 architecture pre-trained with ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) dataset using transfer learning. RGB images and videos of multiple wheat fields with different wheat types (winter and spring wheat), conditions (irrigated and non-irrigated), and locations were acquired using smartphones or unmanned aerial vehicles near the canopy. A semi-automated image labeling approach was conducted to improve labeling efficiency by combining automated machine labeling and human correction. Cross-validations across multiple categories (sensor platforms, wheat types, and locations) achieved Area Under Curve from 0.72 to 0.87. Independent validation on a published dataset from Germany achieved accuracies ranging from 0.79 to 0.86. The visualization of the last convolutional layer of RustNet demonstrated the identification of pixels with stripe rust. RustNet is freely available at https://zzlab.net/RustNet.

This article presents new PEM fuel cell models with hexagonal and pentagonal designs. After observing cell performance improvement in these models, we optimized them. Inlet pressure and temperature were used as input parameters, and consumption and output power were the target parameters of the multi-objective optimization algorithm. Then we used artificial intelligence techniques, including deep neural networks and polynomial regression, to model the data. Next, we employed the RSM (Response Surface Method) method to derive the target functions. Furthermore, we applied the NSGA-II multi-objective genetic algorithm to optimize the targets. Compared to the base model (Cubic), the optimized Pentagonal and Hexagonal models averagely increase the output current density by 21.819\% and 39.931\%, respectively.

This work aims to contribute to better understanding the use of public street spaces. (1) Background: In this sense, with a multidisciplinary approach, the objective of this work is to propose an experimental and reproducible method on a large scale. (2) Study area: The applied methodology uses artificial intelligence to analyze Google Street View (GSV) images at street level. (3) Method: The purpose is to validate a methodology that allows to characterize and quantify the use (pedestrians and cars) of some squares in Rome belonging to different historical periods. (4) Results: Through the use of machine vision techniques, typical of artificial intelligence and which use convolutional neural networks, a historical reading of some selected squares is proposed with the aim of interpreting the dynamics of use and identifying some critical issues in progress. (5) Conclusions: This work validated the usefulness of a method applied to the use of artificial intelligence for the analysis of GSV images at street level.

Lignocellulosic fibers are widely applied as composite reinforcement due to their properties. The thermal degradation behavior determines the maximum temperature in which the fiber can be applied without significant mass loss. It is possible to determine these temperatures using Thermogravimetric Analysis (TG). In particular, when curves are obtained at different heating rates, kinetic parameters can be determined and more detailed characteristics of the material are obtained. However, every curve obtained at a distinct heating rate demands material, cost, and time. Methods to predict thermogravimetric curves can be very useful in the materials science field and in this sense mathematical approaches are powerful tools if well employed. For this reason, in the present study, curaua TG curves were obtained at three different heating rates (5, 10, 20, and 40 °C.min-1) and Vyazovkin kinetic parameters were obtained. After, the experimental curves were fitted using an artificial neural network (ANN) approach followed by a Surface Response Methodology (SRM). Curves at any heating rate between the minimum and maximum experimental heating rates were obtained with high reliability. Finally, Vyazovkin kinetic parameters were tested again with the new curves showing similar kinetic parameters from the experimental ones. In conclusion, due to the capability to learn from the own data, ANN combined with SRM seems to be an excellent alternative to predict TG curves that do not test experimentally, opening the range of applications.

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a reference signal of different magnitude, or under system parameter change. Such properties make the DL control more attractive for applications that may undergo parameter variation, like sensor networks.

The diagnosis of papillary thyroid carcinoma has always been a concerned and challenging issue and it is very important and meaningful to have a definite diagnosis before the operation. In this study, we tried to use an artificial intelligence algorithm instead of medical statistics to analyze the genetic fingerprint from gene chip results to identify papillary thyroid carcinoma. We trained 20 artificial neural network models with differential genes and other important genes related to the cell metabolic cycle as the list of input features, and apply them to the diagnosis of papillary thyroid cancer in the independent validation data set. The results showed that when we used the DEGs and all genes lists as input features the models got the best diagnostic performance with AUC=98.97% and 99.37% and the accuracy were both 96%. This study revealed that the proposed artificial neural network models constructed with genetic fingerprints could achieve a prediction of papillary thyroid carcinoma. Such models can support clinicians to make more accurate clinical diagnoses. At the same time, it provides a novel idea for the application of artificial intelligence in clinical medicine.

The principal minimum horizontal stress plays an important role in the study of reservoir characteristics, modeling of oil and gas reservoir, drilling, production and stimulating wells. However, it is currently not possible to measure the minimum horizontal stress along the wellbore as a geophysical parameter logging. Minimum horizontal stress is measured by leak-off test (LOT) at only several points in a well. In order to have the values all along the wellbore, experimental formulas were established to determine the minimum horizontal stresses for different fields. Then these formulas must be calibrated with LOT data whose number is usually limited, even sometimes unavailable. On the other hand, the empirical formulas of one field might not be accurate for another. This study presents a new approach to solve the problem of minimum horizontal stress estimation by a combination of artificial intelligence and geostatistics. The method consists of using artificial neural network (ANN) to build a model of minimum horizontal stress estimation from relevant parameters such as true vertical depth, pore pressure and vertical stress, then combined with Kriging interpolation to obtain the distribution in space of the minimum horizontal stress. Hence, this method can estimate the minimum horizontal stress with a limited amount of available data and therefore we do not need to drill new wells or to find empirical formulas for each survey area. The method was then applied in a case study involved real geomechanical dataset of Hai Thach - Moc Tinh field in Nam Con Son basin, Vietnam.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

Significant progress has made in pattern recognition technology. However, one obstacle that has not yet overcome is the recognition of words in the Brahmi script, specifically the identification of characters, compound characters, and word. This study proposes the use of the deep convolutional neural network with dropout to recognize the Brahmi words. This study also proposed a DCNN for Brahmi word recognition and a series of experiments are performed on standard Brahmi dataset. The practical operation of this method was systematically tested on accessible Brahmi image database, achieving 92.47% recognition rate by CNN with dropout respectively which is among the best while comparing with the ones reported in the literature for the same task.

Fusarium head blight (FHB) disease is extensively distributed worldwide. This disease damages grain quality and reduces yield. The detection of this disease in a high throughput way is crucial to planters and breeders. Our study focused on developing a method for processing wheat color images and accurately detecting disease areas using deep learning and image processing techniques. The color images of wheat at the milky stage were collected and processed to construct datasets, which were used to retrain a deep convolutional neural network model using transfer learning. Testing results showed that the model can detect spikes, and the coefficient of determination of the number of spikes between the manual count and the detection was 0.80. The model was assessed, and the mean average precision for the testing dataset was 0.9201. On the basis of the results of spike detection, a new color feature was applied to obtain the gray image of each spike. Then, a modified region growing algorithm was implemented to segment and detect the diseased areas of each spike. Results show that the region growing algorithm performs better than K-means and Otsu’s method in segmenting the FHB disease. Overall, this study demonstrates that deep learning techniques enable the accurate detection of FHB in wheat using color images, and the proposed method can effectively detect spikes and diseased areas, thereby improving the efficiency of FHB detection.

Increase in the emission of Greenhouse Gases (GHS) is among the significant concerns of government, societies, and policymakers. Due to the highest share of carbon dioxide in the produced GHGs, it is necessary to assess the factors that influence its emission. Energy systems and economic activities noticeably influence the amount of carbon dioxide production of countries. In this article, Artificial Neural Network (ANN) in addition to a linear correlation used to predict carbon dioxide emission of four CIS countries, including Turkmenistan, Uzbekistan, Kazakhstan, and Azerbaijan based the consumption of various energy sources and GDP, as the economic indicator. According to the obtained data by the proposed models, carbon dioxide emission can be accurately estimated by utilizing the mentioned input data. Models’ R-squared value are 0.9997 and 0.9999 in the cases of applying the correlation and ANN-based model. Moreover, the average absolute relative deviations by utilizing the correlation and GMDH ANN are approximately 1.05% and 0.61%, respectively. These statistical values demonstrate more proper performance of the ANN-based model compared with the applied linear correlation.

We propose a deep-learning approach for the joint MIMO detection and channel decoding problem. Conventional MIMO receivers adopt a model-based approach for MIMO detection and channel decoding in linear or iterative manners. However, due to the complex MIMO signal model, the optimal solution to the joint MIMO detection and channel decoding problem (i.e., the maximum likelihood decoding of the transmitted codewords from the received MIMO signals) is computationally infeasible. As a practical measure, the current model-based MIMO receivers all use suboptimal MIMO decoding methods with affordable computational complexities. This work applies the latest advances in deep learning for the design of MIMO receivers. In particular, we leverage deep neural networks (DNN) with supervised training to solve the joint MIMO detection and channel decoding problem. We show that DNN can be trained to give much better decoding performance than conventional MIMO receivers do. Our simulations show that a DNN implementation consisting of seven hidden layers can outperform conventional model-based linear or iterative receivers. This performance improvement points to a new direction for future MIMO receiver design.

In this perspective article, we ponder topographical enhancements of artificial neural networks. In our recent paper in JMLR, we proved a quasi-equivalence between the network width and depth and also discussed the power of intra-links, which can be viewed as network height. In 1982, Hopfield published a network to model human associative memory, which contains many loops for dynamic evolution toward fixed points. Based on noising-denoising loops, diffusion models are recently developed to enable Bayesian modeling and inference with big data. Furthermore, we envision development of multi-AI-agent systems through “netware” engineering as a quantum leap of software engineering for emergent behaviors and autonomous AI at individual and population levels. We believe that the novel use of links and loops in space and time via multi-scale coupling would catalyze the next-generation neural networks.

Numerous approaches address over-fitting in neural networks: by imposing a penalty on the parameters of the network (L1, L2, etc); by changing the network stochastically (drop-out, Gaussian noise, etc.); or by transforming the input data (batch normalization, etc.). In contrast, we aim to ensure that a minimum amount of supporting evidence is present when fitting the model parameters to the training data. This, at the single neuron level, is equivalent to ensuring that both sides of the separating hyperplane (for a standard artificial neuron) have a minimum number of data points — noting that these points need not belong to the same class for the inner layers. We firstly benchmark the results of this approach on the standard Fashion-MINST dataset, comparing it to various regularization techniques. Interestingly, we note that by nudging each neuron to divide, at least in part, its input data, the resulting networks make use of each neuron, avoiding a hyperplane completely on one side of its input data (which is equivalent to a constant into the next layers). To illustrate this point, we study the prevalence of saturated nodes throughout training, showing that neurons are activated more frequently and earlier in training when using this regularization approach. A direct consequence of the improved neuron activation is that deep networks are now easier to train. This is crucially important when the network topology is not known a priori and fitting often remains stuck in a suboptimal local minima. We demonstrate this property by training a network of increasing depth (and constant width): most regularization approaches will result in increasingly frequent training failures (over different random seeds) whilst the proposed evidence-based regularization significantly outperforms in its ability to train deep networks.

This paper proposes two max-pooling engines, named the RTB-MAXP engine and the CMB-MAXP engine, with a scalable window size parameter for FPGA-based convolutional neural network (CNN) implementation. The max-pooling operation for the CNN can be decomposed into two stages, i.e., a horizontal axis max-pooling operation and a vertical axis max-pooling operation. These two one-dimensional max-pooling operations are performed by tracking the rank of the values within the window in the RTB-MAXP engine and cascading the maximum operations of the values in CMB-MAXP engine. Both the RBM-MAXP engine and the CMB-MAXP engine were implemented using VHSIC Hardware Description Language (VHDL) and verified by simulations. They have been employed for and tested in our CNN accelerator targeting at the CNN model YOLOv4-CSP-S-Leaky for object detection.

Hyperspectral image and LiDAR image fusion plays a crucial role in remote sensing by capturing spatial relationships and modeling semantic information for accurate classification and recognition. However, existing methods, like Graph Convolutional Networks (GCNs), face challenges in constructing effective graph structures due to variations in local semantic information and limited receptiveness to large-scale contextual structures. To overcome these limitations, we proposed a invariant attribute-driven binary bi-branch classification (IABC) method which is a unified network that combines binary Convolutional Neural Network (CNN) and GCN with invariant attributes. Our approach utilizes a joint detection framework that can simultaneously learn features from small-scale regular regions and large-scale irregular regions, resulting in an enhanced structured representation of HSI and LiDAR images in the spectral-spatial domain. This approach not only improves the accuracy of classification and recognition but also reduces storage requirements and enables real-time decision-making, which is crucial for effectively processing large-scale remote sensing data. Extensive experiments demonstrates the superior performance of our proposed method in hyperspectral image analysis tasks. The combination of CNNs and GCNs allows for accurate modeling of spatial relationships and effective construction of graph structures. Furthermore, the integration of binary quantization enhances computational efficiency, enabling real-time processing of large-scale data. Therefore, our approach presents a promising opportunity for advancing remote sensing applications using deep learning techniques.

Accurate segmentation of skin lesions from dermoscopic images is crucial for early skin cancer detection, yet variations in lesion appearance and image artifacts present challenges. This study proposes two deep learning models, UCM-NetV2 and BNN-UCM-NetV2, to improve accuracy and computational efficiency. UCM-NetV2 enhances the UCM-Net architecture with a novel "cyber-structure" combining Multilayer Perceptron and CNN layers, improving prediction accu-racy without increasing the model's parameter count. BNN-UCM-NetV2 further optimizes for mobile deployment by binarizing activations and weights into 1-bit values, reducing computa-tional complexity and model size. Evaluations on the ISIC2017 and ISIC2018 datasets demonstrate that UCM-NetV2 outperforms existing methods in both accuracy and computational efficiency, achieving this with less than 0.04 GFLOPs. These models have the potential to make skin lesion analysis accessible to a broader population, particularly in resource-limited settings, allowing for proactive skin health monitoring and facilitating teledermatology. To foster further innovation in mobile health diagnostics, the source code for UCM-NetV2 will be available on GitHub: https://github.com/chunyuyuan/UCMV2-Net.

In this study, we investigate how dataset composition influences the performance and bias of age estimation models across different ethnic groups. We utilized pre-trained Convolutional Neural Networks (CNNs) such as VGG19, fine-tuning them on two datasets: UTKFace and APPA-REAL. UTKFace comprises 23,705 samples (12,391 males, 11,314 females) including 10,078 White, 4,526 Black, and 3,434 Asian individuals. APPA-REAL consists of 7,591 samples (3,818 males, 3,773 females) with 6,686 White, 231 Black, and 674 Asian individuals. We adjusted dataset composition by oversampling minority groups and reducing samples from the majority group to evaluate effects on model performance, measured using Mean Absolute Error (MAE) and standard deviation. Our findings demonstrate that oversampling alone does not guarantee equitable performance across ethnicities; reducing samples from the majority group often resulted in more balanced performance, evidenced by lower MAE standard deviations. These results underscore the importance of a nuanced approach to achieve fairness, including combining various sampling techniques. This study emphasizes the critical need for tailored dataset compositions to mitigate bias and suggests exploring more refined data processing methods and algorithmic adjustments for enhanced model fairness and accuracy in facial recognition technologies.

In recent years, extensive research has been conducted on the IoT, one of its challenges has been the field security and penetration in these networks. security solutions it Require more planning and awareness to ensure system security and privacy protection.it has also been shown that adjusting the weights of neural networks can help improve the accuracy of detection to what extent. the challenge in the attack detection field is to increase the accuracy of attack detection by machine learning methods, in this paper, a new method is presented to adjust weights of the random neural network for attack detection. Evaluations of the proposed method show that compared to random neural network methods, nearest neighbor, and support vector machine, the accuracy of attack detection improves up to 99.49 percent, and the random neural network method has been able to improve by 99.01 percent, placing the best methods together in these experiments in the form of a multi-learning model showed that the results also had an increase in accuracy up to 99.56 percent, while the training time in the proposed model is less compared to the random neural network method.

The prediction of hydrological flows (rainfall-depth or rainfall-discharge) is becoming increasingly important in the management of hydrological risks such as floods. In this study, the Long Short-Term Memory (LSTM) network, a state-of-the-art algorithm dedicated to time series, is applied to predict the daily water level of lake Nokoue in Benin. This paper aims to provide an effective and reliable method enable of reproducing the future daily water level of Lake Nokoue, which is influenced by a combination of two phenomena: rainfall and river flow (runoff from the Ouémé River, the Sô River, the Porto-Novo lagoon, and the Atlantic Ocean). Performance analysis based on the forecasting horizon indicates that LSTM can predict the water level of Nokoué Lake up to a forecast horizon of t+10 days. Performance metrics such as Root Mean Square Error (RMSE), coefficient of correlation (R²), Nash-Sutcliffe Efficiency (NSE), and Mean Absolute Error (MAE) agree on a forecast horizon of up to t+3 days. The values of these metrics remain stable for forecast horizons of t+1 days, t+2 days, and t+3 days. The values of R² and NSE are greater than 0.97 during the training and testing phases in the Nokoué Lake basin. Based on the evaluation indices used to assess the model's performance for the appropriate forecast horizon of water level in the Nokoué lake basin, the forecast horizon of t+3 days is chosen for predicting future daily water levels.

Caring for dolphins is a delicate process that requires experienced caretakers to pay close attention to their behavioral characteristics. However, caretakers may sometimes lack experience or not be able to give their full attention, which can lead to misjudgment or oversight. To address these issues, a dolphin behavior analysis system has been designed to assist caretakers in making accurate assessments. The study utilized image preprocessing techniques to reduce sunlight reflection in the pool and enhance the outline of dolphins, making it easier to analyze their movements. The dolphins were divided into 11 keypoints using an open-source tool called DeepLabCut, which helped accurately mark various body parts for skeletal detection. The AquaAI Dolphin Decoder (ADD) was then used to analyze six dolphin behaviors. To improve behavior recognition accuracy, the Long Short-Term Memory (LSTM) neural network was introduced. The ADD and LSTM models were integrated to form the ADD-LSTM system. Several classification models, including unidirectional and bidirectional LSTM, GRU, and SVM, were compared. The results showed that the ADD module combined with a double-layer bidirectional LSTM method achieved high accuracy in dolphin behavior analysis. The accuracy rates for each behavior were over 90%.

Federated learning trains a neural network model using the client's data to maintain the benefits of centralized model training, while maintaining the privacy. However, if the client data are not independently and identically distributed (non-IID) because of different environments, the accuracy of the model may suffer from client drift during training owing to discrepancies in each client's data. This study proposes a personalized federated learning algorithm based on the concept of multitask learning to divide each client model into two layers: a feature extraction layer and a category prediction layer. The feature extraction layer maps the input data to a low-dimensional feature vector space. Furthermore, the parameters of the neural network are aggregated with those of other clients using an adaptive method. The category prediction layer maps low-dimensional feature vectors to the label sample space, with its parameters remaining unaffected by other clients to maintain client uniqueness. The proposed personalized federated learning method produces faster learning model convergence rates and higher accuracy rates for the non-IID datasets in our experiments.

Machine learning (ML) based on neural network (NN) facilitates data-driven techniques for handling large amounts of data, either obtained through experiments or simulations at multiple spatio-temporal scales, thereby finding the hidden patterns underlying these data and promoting efficient research methods. The main purpose of this paper is to extend the capabilities of a new solver, called realFluidReactingNNFoam, under development at University of Perugia in OpenFOAM with NN algorithm for replacing complex real-fluid thermophysical property evaluations, using the approach of coupling OpenFOAM and Python-trained NN models. Currently, NN models are trained against data generated using the Peng-Robinson equation of state (PR-EoS) assuming mixture frozen temperature. The OpenFOAM solver, where needed, calls the NN models in each grid-cell with appropriate inputs, and the returned results are used and stored in suitable OpenFOAM data structures. Such inference for the thermophysical properties is achieved via the “Neural Network Inference in C made Easy” (NNICE) library, which proved to be very efficient and robust. The overall model is validated considering a liquid-rocket benchmark comprised of liquid-oxygen (LOX) and gaseous-hydrogen (GH2) streams. The model accounts for real-fluid thermodynamics and transport properties, making use of the PR-EoS and the Chung transport models. First, the development of a real-fluid model (RFM) with artificial neural network is described in detail. Then, the numerical results of the transcritical mixing layer (LOX/GH2) benchmark are presented and analyzed in terms of accuracy and computational ef-ficiency. Results of the overall implementation indicate that the combined OpenFOAM and ML approach provides a speed-up factor higher than seven, while preserving the original solver accuracy.

In recent years, there has been a growing interest in the prediction of facial age due to its diverse applications in fields such as security, entertainment, and healthcare. The current scourge of underaged voting in Nigeria is a problem and this research delves into the realm of facial age prediction by employing four well-known convolutional neural network (CNN) architectures, namely VGG16, ResNet50, Mobile Net, and VGG19 to predict chronological ages from facial pictures of person. The objective is to achieve precise age estimation from facial images, utilizing two datasets: UTKFace and CASIA African Facial Datasets. The results of this investigation are noteworthy. Specifically, the VGG16 model which demonstrated remarkable performance, yielding a Mean Absolute Error (MAE) of 1.76 when applied to the UTK-Face dataset. Additionally, when utilizing Mobile-Net, an unprecedented MAE of 1.10 was achieved for the Casia Africa Face Dataset. Notably, this marks the first instance of employing the dataset for facial age detection with CNNs, and this approach outperformed previous works, yielding the lowest MAE among all the studies reviewed.

The effect of climate change plays a significant role on groundwater level variations and crop yield. The change in climate leading to increased temperatures, decreased rainfalls and extreme drought conditions ultimately cause low groundwater level and crop yield. Judicious groundwater management technology viz., water recharge options, need based irrigation, crop selection, must be adapted for further increasing the water table level in soil ecosystem. Additionally, climate change impacts combined with changes in agricultural water use can affect groundwater dynamics. Increased irrigation demand and decreased summer precipitation can lower groundwater levels, impacting crop production. Overall, climate change affects both groundwater resources and crop yield highlighting the need for sustainable water management practices and consideration of soil properties in agricultural modelling. The authors carefully selected relevant research articles addressing the impact of climate change on ground water level in Asian countries. The review highlights the use of machine learning method to ground water level and crop yield modelling. According to the study, machine learning techniques have made significant contributions to predicting groundwater level changes and crop yield with higher accuracies, high performance and less running time.

The author previously reported an experimental result of evolutionary reinforcement learning of neural network controllers for the pendulum task. In the previous work, a conventional multilayer perceptron was employed in which connection weights were real numbers. In this study, the author experimentally applies an evolutionary algorithm to the reinforcement training of binary neural networks. In both studies, the same task and the same evolutionary algorithm are utilized, i.e. the pendulum control problem and Evolution Strategy respectively. The only differences lie in the memory size per connection weight and the model size of the neural network. The findings from this study are (1) the performance of the binary MLP with 32 hidden units was inferior to that of the real-valued MLP with 16 hidden units; however, this difference was not statistically significant (p >.05); (2) the trained binary MLP successfully swung the pendulum swiftly into an inverted position and maintained its stability after inversion, as the real-valued MLP had done; and (3) the memory size required to record the binary MLP with 32 hidden units is 3.1% or 6.2% of the memory size required to record the real-valued MLP with 16 hidden units.

Condition monitoring of rotating shafts is essential for ensuring the reliability and optimal performance of machinery in diverse industries. In this context, as industrial systems become increasingly complex, the need for efficient data processing techniques is paramount. Deep learning has emerged as a dominant approach due to its capacity to capture intricate data patterns and relationships. However, a prevalent challenge lies in the black-box nature of many deep learning algorithms, which often operate without adhering to the underlying physical characteristics intrinsic to the studied phenomena. To address this limitation and enhance the fusion of data-driven methodologies with the fundamental physics of the system under study, this paper leverages physics-informed neural networks (PINNs). Specifically, a simple but realistic numerical case study of an extended Jeffcott rotor model, encompassing damping effects and anisotropic supports for a more comprehensive modelling, is considered. PINNs are used for the estimation of five parameters that characterize the health state of the system. These parameters encompass the radial and angular position of the static unbalance due to the disk installed on the shaft, the stiffness along the principal axes of elasticity, and the non-rotating damping coefficient. The estimation is conducted solely by exploiting the displacement signals from the centre of the disk and, to showcase the efficacy and precision provided by this novel methodology, various scenarios involving different constant rotational speeds are examined. Additionally, the impact of noisy input data is also taken into account within the analysis.

The aims of this paper can be traced back to goals number seven, twelve and thirteen introduced by Agenda 2030, namely "affordable and clean energy", “responsible consumption and production” and "climate action”, respectively. This is due to the fact that the present work supports decarbonization processes acting in a direct way on the electricity consumption achieved by plants pertaining to the waste industry; in fact, this study aims at the realization of a machine learning model for predicting the energy consumption achieved by a mechanical biological treatment (MBT) waste plant located in central Italy, given the distribution of the entering waste. This model is implemented in MATLAB. The model can be used to tune the distribution of the entering waste in order to adapt the plant energy consumption to the capability of the energy sources and can serve as a play-ground model for other energy transformation plants. The results of the study, which feed the literature on the application of artificial intelligence to real industrial plants, could be used to determine energy efficiency actions that could be incorporated into Property’s strategic planning.

Facial emotion detection is a challenging task that deals with emotion recognition. It has applications in various domains, such as behavior analysis, surveillance systems and human-computer interaction (HCI). Numerous studies have been implemented to detect emotions, including classical machine learning algorithms and advanced deep learning algorithms. For the machine learning algorithm, the hand-crafted feature needs to be extracted, which is a tiring task and requires human effort. Whereas in deep learning models, automated feature extraction is employed from samples. Therefore, in this study, we have proposed a novel and efficient deep learning model based on Neural Architecture Search Network utilizing superior artificial networks such as RNN and child networks. We performed the training utilizing the FER 2013 dataset comprising seven classes: happy, angry, neutral, sad, surprise, fear, and disgust. Furthermore, we analyzed the robustness of the proposed model on CK+ datasets and comparing with existing techniques. Due to the implication of reinforcement learning in the network, most representative features are extracted from the sample network. It extracts all key features without losing the key information. Our proposed model is based on one stage classifier and performs efficient classification. Our technique outperformed the existing models attaining an accuracy of 98.14%, recall of 97.57%, and precision of 97.84%.

Raindrop size distribution (RSD) is an index for reflecting precipitation characteristics. Analyzing the differences of RSD plays an important role in understanding the precipitation microphysical processes and improving quantitative precipitation prediction of radar. In this paper, the RSD data of Dafang (57708) station, Majang (57828) station, and Luodian (57916) station (with an altitude of 1722.7m, 985.0m, and 441.5m, respectively) in Guizhou are analyzed according to the precipitation microphysical characteristics. First,Particles with particle size less than 1mm contributes the highest value to the density of particle number , and decrease with the descending altitude. Second, the GAMMA distribution fit shows a better fit compare to M-P distribution fit, and GAMMA distribution fit increases with the ascending altitude. Third, the mass-weighted average diameter is not sensitive enough to the change of precipitation intensity with correlation coefficients of 54.84%, but there is a obvious relationship between the average volume diameter and the precipitation intensity with correlation coefficients of 69.15%. Then, the precipitation prediction model is established using LSTM neural network after fusing the representative microphysical characteristics of RSD with radar and rain gauge data. The precipitation prediction model is applied to the Dafang (57708) site to predict precipitation for time range of 0-180 minutes, and it is found that for the prediction of convective cloud and stratiform cloud precipitation, the 60-minute prediction results are the most consistent with the actual precipitation, where the correlation coefficients are 92.87% and 92.57%, respectively. Conclusively, the results demonstrate that combining with the RSD base data could improve the reliability of precipitation forecasting.

Artificial intelligence is increasingly used in various branches of engineering. In this article, artificial neural networks are used to predict the crush resistance of corrugated packaging. Among the analysed packages were boxes with ventilation openings, packages with perforations, and typical flap boxes, which makes the proposed estimation method very universal. Typical shallow feedforward networks were used, which are perfect for regression problems, mainly when the set of input and output parameters is small, so no complicated architecture or advanced learning techniques are required. The input parameters of the neural networks are selected so as to take into account not only the material used for the production of the packaging, but also the dimensions of the box and the impact of ventilation holes and perforations on the load capacity of individual walls of the packaging. In order to maximize the effectiveness of neural network training process, the group of input parameters was changed so as to eliminate those to which the sensitivity of the model was the lowest. This allowed the selection of the optimal configuration of training pairs for which the estimation error was on the acceptable level. Finally, models of neural networks were selected, for which the training and testing error did not exceed 10%. The demonstrated effectiveness allows to conclude that the proposed set of universal input parameters is suitable for efficient training of a single neural network model capable of predicting the compressive strength of various types of corrugated packaging.

With the continuous progress of remote sensing image object detection tasks in recent years, researchers in this field have gradually shifted the focus of their research from horizontal object detection to the study of object detection in arbitrary directions. It is worth noting that some properties are different from the horizontal object detection during oriented object detection that researchers have yet to notice much. This article presents the design of a straightforward and efficient arbitrary-oriented detection system, leveraging the inherent properties of the orientation task, including the rotation angle and box aspect ratio. In the detection of low aspect ratio objects, the angle is of little importance to the orientation bounding box, and it is even difficult to define the angle information in extreme categories. Conversely, in the detection of objects with high aspect ratios, the angle information plays a crucial role and can have a decisive impact on the quality of the detection results. By exploiting the aspect ratio of different targets, this letter proposes a ratio-balanced angle loss that allows the model to make a better trade-off between low-aspect ratio objects and high-aspect ratio objects. The rotation angle of each oriented object, which we naturally embed into a two-dimensional Euclidean space for regression, thus avoiding an overly redundant design and preserving the topological properties of the circular space. The performance of the UCAS-AOD, HRSC2016, and DLR-3K datasets show that the proposed model in this paper achieves a leading level in terms of both accuracy and speed. The code is released at https://github.com/minghuicode/Periodic-Pseudo-Domain.

Deep convolutional neural networks (CNN) are favored methods widely used in medical image processing due to their assured shown performance. Recently, the emergence of new lung diseases and the possibility of early detection of their symptoms has attracted many researchers to classify diseases by training deep CNNs on lung CT images. The trained networks are expected to distinguish between lung indications in different diseases, especially at the early stages of them. With the hope of achieving this purpose, we proposed an efficient deep CNN called AFEX-Net with adaptive feature extraction layers that successfully extract distinguishing features and classify chest CT images. The efficiency of the proposed network has two aspects: it is a lightweight network with low number of parameters and fast training and it has adaptive pooling layers and adaptive activation functions to increase its level of compatibility to the input data. The proposed network has been evaluated on a dataset with more than 10K chest CT slices, while an efficient pre-processing method is developed to remove any bias from the images. Additionally, we evaluated the performance of the proposed model on the public COVID-CTset dataset to prove the generalisability of our model. The obtained results confirm the competence of the proposed network in confronting medical images, where prompt and accurate learning is required.

In recent years, with the popularity of smart mobile devices, the interaction between devices and users, especially in the form of voice interaction, has become increasingly important. If smart devices can understand more users' emotional states through voice data, more customized services can be provided for users. This paper proposes a novel machine learning model for speech emotion recognition, which combines convolutional neural networks (CNN), long short-term memory neural networks (LSTM), and deep neural networks (DNN), called CLDNN. To make the designed system can recognize the audio signal closer to the human auditory system does, this article uses the Mel frequency cepstral coefficients (MFCCs) of audio data as the input of the machine learning model. First, the MFCCs of the voice signal is extracted as the input of the model, and the feature values of the data are calculated using several local feature learning blocks (LFLB) composed of one-dimensional CNN. Because the audio signals are time-series data, the feature values obtained from LFLBs then input into LSTM layer to enhance the learning on time-series level. Finally, fully connected layers are used for classification and prediction. Three databases RAVDESS, EMO-DB and IEMOCAP are used for the experiments in this paper. The experimental results show that the proposed method can improve the accuracy compared to other related researches in speech emotion recognition.

Respiratory rate is an important biomarker that indicates changes in the clinical condition of critically ill patients, so a surveillance tool that can accurately monitor the changing respiratory rate in real time is needed. Through investigating various pairs of machine learning models, we proposed new machine learning model for real-time respiratory rate estimation using photoplethysmogram. New photoplethysmogram-driven respiratory rate dataset(StMary) was collected from surgical intensive care unit of a tertiary referral hospital, using photoplethysmogram signal collector. For 50patients and 50healthy volunteers, 2-minute photoplethysmogram was collected for each subject twice. To evaluate the respiratory rate of subject, it was inputted into the deep neural network model we built, and dataset was splitted into training, validation, testing dataset, then 4-fold cross validation was exploited. Our deep neural network model trained with StMary and two public datasets(BIDMC and CapnoBase) individually, or selectively merged dataset had shown a low error rate in respiration rate measurements. Our model trained with StMary showed low mean absolute error score(1.0273±0.8965), and trained with 3 datasets(CapnoBase, BIDMC and StMary) showed a lower error rate(1.7359±1.6724) than the model trained with CapnoBase and BIDMC(1.9480±1.6751). We could verify the performance of model evaluating respiratory rate from photoplethysmogram, and our dataset could contribute as the clinical research data that supports artificial intelligence models evaluating respiratory rate and surveillance tools to test whether their monitoring function works properly.

Advances in computing technology provide an opportunity to grow and develop an effective crop protection system. This study is a new way of diagnosing plant diseases using a deep and convolutional neural network. Deep learning is the strengthened method of machine learning. It uses a neural network that imitates like a human brain and gains certain information. Although powerful, its training process necessitates millions of tagged data points. The study's Methodology consists of three key stages: data acquisition, pre-processing, and Model Building.

Accurate demand forecasting plays a critical role in most furniture businesses’ operational, tactical, and strategic decisions, as the demand in the furniture business is considered seasonal and becomes more complex in crises. In this work, a neural network model using the Long Short-Term Memory (LSTM) method was developed to forecast the demand for specific product groups. LSTM is a leading deep learning model for time series prediction, particularly seasonal, multi-item, and non-linear situations. The developed model was used to predict the demand based on old data before the Covid-19 pandemic and recent data of the first months of the pandemic as a fast response to the crisis. In addition, a comparison study was conducted between the developed model and the traditional planning inventory used by furniture businesses that provided us with the data. The results showed that the Covid-19 pandemic significantly impacted demand forecasting. Also, the fast response to Covid-19 pandemic has slightly increased the model performance. Finally, the comparison study demonstrated that our model is robust and better than the traditional demand forecasting method. Therefore, the developed model may help the business improve inventory and production planning to create a more flexible supply chain.

While the language model using the stop sign as an independent token has been widely used to decide when the model should stop, it may lead to the growth of vocabulary dimensions and further problems. Similarly, present research on game algorithms usually estimate stopping point related problems based on the evaluation of the winning rate. However, information redundancy may also exist in such models, thus increasing the training difficulty. Above two types of tasks (and similar autoregressive tasks) show a common problem of stopping point prediction. In this paper, we describe a design of separated model, trying to separate the complexity of stopping point prediction from the main task model, so that the information used for estimating stopping point can be reduced. On this basis, in order to verify the rationality of using separated model, we propose a model-free test method. It judges the separability of transformed data based on point difference and sequence difference metrics. In this way, it can predict the credibility of the separated model inference.

The dynamics of suspended sediment involves inherent non-linearity and complexity as a result of the presence of both spatial variability of the basin characteristics and temporal climatic patterns. As a result of this complexity, the conventional sediment rating curve (SRC) and other empirical methods produce inaccurate predictions. Deep neural networks (DNNs) have emerged as one of the advanced modeling techniques capable of addressing inherent non-linearity in hydrological processes over the last few decades. DNN algorithms are used to perform predictive analysis and investigate the interdependencies among the most pivotal water quantity and quality parameters i.e., discharge, suspended sediment concentration (SSC), and turbidity. In this study, the Long short-term memory (LSTM) algorithm of DNNs is used to model the discharge-suspended sediment relationship for the Stony Clove Creek. The simulations were run using primary data on discharge, SSC and turbidity. For the development of the DNN models and examining the effects of input vectors, combinations of different input vectors (namely discharge, and SSC) for the current and previous days are considered. Furthermore, a suitable modelling approach with an appropriate model input structure is suggested based on model performance indices for the training and testing phases. The performance of developed models is assessed using statistical indices such as root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). Statistically, the performance of DNN-based models in simulating the daily SSC performed well with observed sediment concentration series data. The study demonstrates the suitability of the DNN approach for simulation and estimation of daily SSC, opening up new research avenues for applying hybrid soft computing models in hydrology.

The simultaneous advances in artificial neural networks and photonic integration technologies have spurred extensive research in optical computing and optical neural networks (ONNs). The potential to simultaneously exploit multiple physical dimensions of time, wavelength and space give ONNs the ability to achieve computing operations with high parallelism and large-data throughput. Different photonic multiplexing techniques based on these multiple degrees of freedom have enabled ONNs with large-scale interconnectivity and linear computing functions. Here, we review the recent advances of ONNs based on different approaches to photonic multiplexing, and present our outlook on key technologies needed to further advance these photonic multiplexing/hybrid-multiplexing techniques of ONNs.

Deep learning has shown remarkable results in every field, especially in the biomedical field, due to its ability to exploit large-scale datasets. A convolutional neural network (CNN) is a widely used deep learning approach to solve medical imaging problems. Over the past few years, many studies have focused on CNN-based techniques for brain tumor diagnosis. There are, however, still some critical challenges that CNNs face towards clinic application. This study presents a comprehensive review of current literature that involves CNN architectures for brain tumor classification. We compare the key achievements in the performance evaluation metrics of the applied classification algorithms. In addition, this review assesses the clinical effectiveness of the included studies to elaborate on the limitations and directions of this area for future work. No review focusing on the clinical effectiveness of previous works in this field has been published. We believe that this study has the potential to elevate the application of CNN-based deep learning methods in clinical practice and also can be a quick reference for biomedical researchers who are interested in this field.

The ridge line of the western Pacific subtropical high (WPSHRL) plays an important role in determining the shift of the summer rain belt in eastern China. In this study, we developed a forecast system for the June WPSHRL index based on the latest autumn and winter sea surface temperature (SST). Considering the adverse condition of the small observed sample size, a very simple neural network (NN) model was selected to extract the non-linear relationship between input predictors (SST) and target predictands (WPSHRL) in the forecast system. In addition, some techniques are used to deal with the adverse condition, enhance the stabilization of forecast skills, and analyze the interpretability of the forecast system. The forecast experiments show that the linear correlation coefficient between the predictions from the forecast system and their corresponding observations is around 0.6, and about three-fifths of the observed abnormal years (the years with an obviously high or low WPSHRL index) are successfully predicted. Furthermore, sensitivity experiments show that the forecast system is relatively stable in terms of forecast skill. The above evaluations suggest that the forecast system is valuable in a real application sense.