RBF networks are used in a variety of real-world applications such as medical data or signal processing problems. The success of these parametric models lies in the successful adaptation of their parameters using efficient computational techniques. In the current work, a method of adjusting the parameters of these networks using Grammatical Evolution is presented. Grammatical Evolution will be used to successfully discover the most promising range of parameter values and then the training of the parameter set will be achieved using a Genetic Algorithm. The new method was applied to a wide range of data fitting and classification problems, and the results were more than promising.

Snow parameters have traditionally been retrieved using discontinuous, multi-band sensors; however, continuous hyperspectral sensor are now being developed as an alternative. In this paper we investigate the performance of various sensor configurations using machine learning neural networks trained on a simulated dataset. Our results show improvements in accuracy of retrievals of snow grain size and impurity concentration for continuous hyperspectral channel configurations. Retrieval accuracy of snow albedo was found to be similar for all channel configurations.

Tracking temperature changes in certain geographic regions is a current task in modern research on Earth's climate changes. One of the global problems in solving this task is related to the large volume of measured data and the search for appropriate methods for effective determination of changes. The purpose of this research is to track climate temperature changes using a machine learning-based automated change detection method. The presented method includes training of a two-level structure of neural networks, with measured temperatures for a ten-year period of time for a certain geographical region. In the testing phase, the neural structure classifies measured temperatures for two three-year periods, before and after the ten-year time period, respectively, for the same geographic region. An algorithm was developed to visualize the studied regions by creating a map with their geographic coordinates. The classification results in the neural structure outputs are presented and analyzed as possible temperature changes. Suggestions for continuing and expanding the research in the future are discussed.

Bundle recommendation is provided to users by combining related items into a bundle, enhancing the user's shopping experience and increase the merchant's sales revenue. Despite the success of existing solutions based on Graph Neural Networks(GNN), there are still some significant challenges: (1)It is demanding to explicitly model multiple complex associations using standard graph neural networks. (2)Numerous additional nodes and edges are introduced to approximate higher-order associations. (3)The user-bundle historical interaction data is highly sparse. In this work, we propose a Global Structural Hypergraph Convolution model for Bundle Recommendation (SHCBR) to address the above problems. Specifically, we jointly incorporate multiple complex interactions between users, items, and bundles(three entities) into a relational hypergraph without introducing additional nodes and edges. Higher-order associations are already involved in the hypergraph structure which alleviate the training burden of neural networks and the dilemma of scarce data. In addition, we design a special matrix propagation rule that captures non-pairwise complex relationships between entities. Using item nodes as links, hypergraph convolution propagation between user and bundle nodes generates the learned representations. Experimental results on two real-world datasets demonstrate that SHCBR outperforms the state-of-the-art baselines by 11.07%-25.66\% on Recall and 16.81%-33.53% on NDCG. We publicly release the codes and datasets at https://github.com/Lxtdzh/SHCBR-master/.

Retailers must have accurate sales forecasts to operate their businesses efficiently and effectively and to remain competitive in the marketplace. Global forecasting models like RNNs can be a powerful tool for forecasting in retail settings, where multiple time series are often interrelated and influenced by a variety of external factors. By including covariates in a forecasting model, we can better capture the various factors that can influence sales in a retail setting. This can help improve the accuracy of our forecasts and enable better decision-making for inventory management, purchasing, and other operational decisions. In this study we investigate how the accuracy of global forecasting models is affected by the inclusion of different potential demand covariates. To ensure the significance of the study's findings, we used the M5 forecasting competition's openly accessible and well-established dataset. The results obtained from the DeepAR models, which were trained on various combinations of features including time, price, events, and IDs, suggest that individually only the features corresponding to IDs improve the baseline model. However, when all the features are used together, the best performance is achieved, indicating that the individual relevance of each feature is emphasized when the information is given jointly. Comparing the model with features to the model without features, there is an improvement of 1.76\% for MRMSSE and 6.47\% for MMASE.

Speaker recognition methods based on convolutional neural networks (CNN) have been widely used in the security field and smart wearable devices. However, the traditional CNN has a large number of hyperparameters that are difficult to be determined, which makes the model easy to fall into local optimum or even fail to converge during the training process. Intelligent algorithms such as particle swarm optimization and genetic algorithm are used to solve the above problems. However, these algorithms have poor performance compared with the current emerging meta-heuristic algorithms. In this study, the dung beetle optimized convolution neural network (DBO-CNN) is proposed to identify the speakers, which is helpful in finding suitable hyperparameters for training. By testing the dataset of 50 people, it was demonstrated that the accuracy of the model was significantly improved by using this approach. Compared with the traditional CNN and CNN optimized by other intelligent algorithms, the accuracy of DBO-CNN has increased by 0.6%~4.8%, and reached 98.3%.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

Teachability has been extensively studied under the context of making industrial robots to be programmable and reprogrammable. However, it is only recently that the artificial intelligence (AI) research community is accelerating the research works with the objective of making humanoid robots and many other robots to be teachable under the context of using natural languages. We human beings spend many years to learn knowledge and skills despite our extraordinary mental capabilities of being teachable with the use of natural languages. Therefore, if we would like to develop human-like robots such as humanoid robots, it is inevitable for us to face the issue of making future humanoid robots to be teachable with the use of natural languages as well. In this paper, we present the key details of a top-down design for achieving a teachable mind which consists of two major processes: the first one is the process which enables humanoid robots to gain innate mental capabilities of transforming incoming signals into meaningful crisp data, and the second one is the process which enables humanoid robots to gain innate mental capabilities of undertaking incremental and deep learning with the main focus of associating conceptual labels in a natural language to meaningful crisp data. These two processes consist of the two necessary and sufficient conditions for future humanoid robots to be teachable with the use of natural languages. In addition, this paper outlines a very likely new finding underlying human brain’s neural systems as well as the obvious mathematics underlying artificial deep neural networks. These outlines provide us the strong reason to separate the study of mind from the study of brain. Hopefully, the content discussed in this paper will help the AI research community to venture into the right direction which is to make future humanoid robots, non-humanoid robots, and many other systems to achieve human-like self-intelligence at cognitive level with the use of natural languages.

The popularity and development of social media has made it more and more convenient to spread rumors, and it has become especially important to detect rumor information from massive amounts of information. Most of the traditional rumor detection methods use content characteristics or propagation structure to mine rumor characteristics, ignoring the fusion characteristics of content and structure and their interaction characteristics. Therefore, a novel rumor detection method based on heterogeneous convolutional networks is proposed. Firstly, this paper constructs a heterogeneous map of joint rumor content and propagation structure to explore the interaction between content and propagation structure during rumor propagation and obtain rumor representation. On that basis, this paper uses the deep residual graph convolutional neural network to construct the content and structure interaction information of the current network propagation model. Finally, this paper uses the two datasets of Twitter15 and Twitter16 to verify the proposed method. Experimental results show that the proposed method has higher detection accuracy than the traditional rumor detection method.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

Background Some patients with mild cognitive impairment (MCI) experience gait disturbances. However, there are few reports on the relationship between gait disturbance and cognitive function in patients with MCI. Therefore, we investigated the neural correlates of gait characteristics related to cognitive dysfunction. Methods Eighty patients diagnosed with MCI from three dementia centres in Gangwon-do, Korea were recruited for this study. We defined MCI as a Clinical Dementia Rating global score of 0.5 or higher, with a memory domain score of 0.5 or greater. The patients were classified as having either early or late MCI based on their Mini Mental Status Examination z-scores. Multiple logistic regression analysis was performed to examine the association between the gait characteristics and cognitive impairment. Analyses included variables such as age, sex, years of education, number of comorbidities, body mass index and height. Results Gait velocity, step count, step length, heel-to-heel base support, swing and stance phase duration, and support time were associated with cognitive function. A decrease in gray matter volume in the right pericalcarine area was associated with gait characteristics related to cognitive dysfunction. An increase in the curvature of gray matter in the right entorhinal, right lateral orbitofrontal, right cuneus, and right and left pars opercularis areas was also associated with gait characteristics related to cognitive dysfunction. Conclusion Since gait impairment is an important factor in determining activities of daily living in patients with mild cognitive impairment, the evaluation of gait and cognitive functions in patients with mild cognitive impairment is important.

To effectively preserve marine environments and manage endangered species, it is necessary to employ efficient, precise, and scalable solutions for environmental monitoring. Ecoacoustics provides several benefits as it enables non-intrusive, prolonged sampling of environmental sounds, making it a promising tool for conducting biodiversity surveys. However, analyzing and interpreting acoustic data can be time-consuming and often demands substantial human supervision. This challenge can be addressed by harnessing contemporary methods for automated audio signal analysis, which have exhibited remarkable performance due to advancements in deep learning research. This paper introduces a research investigation into developing an automatic computerized system to detect dolphin whistles. The proposed method utilizes a fusion of various resnet50 networks integrated with data augmentation techniques. Through extensive experiments conducted on a publically available benchmark, our findings demonstrate that our ensemble yields significant performance enhancements across all evaluated metrics. The MATLAB/PyTorch source code is freely available at: https://github.com/LorisNanni/

Object classification is a crucial task in deep learning, which involves the identification and categorization of objects in images or videos. Although humans can easily recognize common objects, such as cars, animals, or plants, performing this task on a large scale can be time-consuming and error-prone. Therefore, automating this process using neural networks can save time and effort while achieving higher accuracy. Our study focuses on the classification step of human chromosome karyotyping, an important medical procedure that helps diagnose genetic disorders. Traditionally, this task is performed manually by expert cytologists, which is a time-consuming process that requires specialized medical skills. Therefore, automating it through deep learning can be immensely useful. To accomplish this, we implemented and adapted existing preprocessing and data augmentation techniques to prepare the chromosome images for classification. We used ResNet-50 convolutional neural networks and an ensemble approach to classify the chromosomes, obtaining state-of-the-art performance in the tested dataset.

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

Communication is a key method of expressing one's thoughts and opinions. Amongst many modalities, speech and writing are the most powerful and common forms of human communication. Analysing what and how people think has inherently been an interesting and progressive research domain. This includes bimodal sentiment analysis which is an emerging area in natural language processing (NLP) and has received a great deal of attention in recent years in a variety of areas including social opinion mining, health care, banking, and so on. At present, there are limited studies on bimodal conversational sentiment analysis as it proves to be a challenging area given the complex nature of the way humans express sentiment cues across various modalities. To address this gap, a comparison of the performance of multiple data modality models has been conducted on the MELD dataset, a widely-used dataset for benchmarking sentiment analysis within the research community. Our work then demonstrates the results of combining acoustic and linguistic representations. Lastly, our proposed neural network-based ensemble learning technique is employed over six transformer and deep learning-based models, achieving a State-Of-The-Art (SOTA) accuracy.

Our purpose is to address the biological problem of finding foundations of the organization in the collective activity among cell networks in the nervous system, at the meso/macroscale, giving rise to cognition and consciousness. But in doing so, we encounter another problem related to the interpretation of methods to assess the neural interactions and organization of the neurodynamics, because thermodynamic notions, which have precise meaning only under specific conditions, have been widely employed in these studies. The consequence is that apparently contradictory results appear in the literature, but these contradictions diminish upon the considerations of the specific circumstances of each experiment. After clarifying some of these controversial points and surveying some experimental results, we propose that a necessary condition for cognition/consciousness to emerge is to have available enough energy, or cellular activity; and a sufficient condition is the multiplicity of configurations in which cell networks can communicate, resulting in non-uniform energy distribution, the generation and dissipation of energy gradients due to the constant activity. These ideas may reveal possible fundamental principles of brain organization and how healthy activity may derive to pathological states.

We present a Deep Learning generative model specialized to work with graphs with a regular geometry. It is build on a Variational Autoencoder framework and employs Graph convolutional layers in both encoding and decoding phases. We also introduce a pooling technique (ReNN-Pool), used in the encoder, that allows to downsample graph nodes in a spatially uniform and highly interpretable way. In the decoder, a symmetrical un-pooling technique is used to retrieve the original dimensionality of graphs. Performance of the model are tested on the standard Sprite benchmark dataset, a set of 2D images of video game characters, adequately transforming images data into graphs, and on the more realistic use-case of a dataset of cylindrical-shaped graph data that describe the distributions of the energy deposited by a particle beam in a medium.

As AI models become more and more common in business and even in our daily lives, it is important to understand what the carbon impact of these models is. Recent papers have shown that this impact can be quite great, i.e., the training of a single high-end model can result in emissions of more than 500t of CO2eq. In this paper we discuss the factors that influence the carbon footprint of AI models, explore what impact different decisions have, and show how the footprint can be reduced. We also examine the footprint of different models to give a guideline on how urgent action is for different organizations.

In this work a new hydroelectric basin modelling approach is described and applied to the Pontecosi basin, Italy. Several types of data sources were used to learn the model: a number of weather stations, satellite observations, Reanalysis dataset and basin data. With the goal of predicting the water level of the basin, the model was composed by three cascade modules. Firstly, different spatial interpolation methods, such as Kriging, Radial Basis Function and Natural Neighbours, were compared and applied to interpolate the weather stations data nearby the basin area to infer the main environmental variables (air temperature, air humidity, precipitation and wind speed) in the basin area. Then, using these variables as inputs, a neural network was trained to predict the mean soil moisture concentration over the area, also to improve the low availability due to satellite orbits. Finally, a non-linear auto regressive exogenous input (NARX) model was trained to simulate the basin level with different prediction horizons, using the data from the previous modules and past basin data (water level, discharge flow rate, turbine flow rate). Accurate predictions of the basin water level were achieved within 1 to 6 hours ahead, with mean absolute errors (MAE) between 2cm and 10cm respectively.

Soil working tools, implements, and machines are inevitable in mechanized agriculture. The soil-tool/machine interaction is a multivariate, dynamic, and intricate process. The accurate interpretation, description, and modeling of a soil-machine interaction is key to providing a solution to sustainable crop production by reducing energy input, excessive soil pulverization, and compaction. The traditional method provides insight into soil-machine interaction but often provides inadequate solutions and lacks broad applicability. Computational intelligence (CI) is a comprehensive class of approaches that rely on approximate information to solve complex problems. The CI method has been extensively studied and applied in soil tillage and traction domain in recent decades. The study critically reviews the CI techniques implemented in soil-machine interactions, especially in the context of tillage, traction, and compaction. The traditional methods and their limitation are discussed. The fundamental of CI methods and a detailed overview of the most popular methods are provided. The study reviews and summarizes the 50 selected articles on soil-machine interaction studies where CI methods were employed. It discusses the strength and limitations of employed CI methods. It also suggests the emergent CI methods and future applications are discussed. The outlined study would serve as a concise reference and a quick and systematic way to understand the applicable CI methods that allow crucial farm management decision-making.

Classical religious texts remain an essential part of human culture due to their undiminished influence on the advancement of civilization. Although their entirely divine origin is questioned repeatedly, explicit or implicit quoting and adherence to their basic guidelines are fundamental in modern society. In this respect, these documents’ inner structure and linguistic style appear to be pivotal. This paper considers the topic from the standpoint of small textual patterns classified using deep learning methods, traditionally applied to analyze short textual material like tweets. We divide the considered documents into small sequential chunks imitating tweets and categorizing them, classifying an entire text. The proposed method demonstrates that the religious text collections correspond to stable ”Twitter”-like structures that adequately reflect stylistic properties. So, concise word combinations seem to be an inborn textual attribute that adequately outlines the proposed multi-source authorship. This approach differs from traditional methods of analyzing classical religious documents, which are based on the consideration and interpretation of relatively long templates. The case study consists of three famous collections of Mosaic authorship in the Old Testament (Hebrew), Pauline authorship in the New Testament (Greek), and Al-Ghazali authorship (Arabic). The obtained results go well with most previously expressed evaluations and complement them with new implications, particularly in the authorship of two famous manuscripts attributed to Al-Ghazali.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

A correctly obtained Land-use/land-cover (LULC) prediction map is essential to under-standing and assessing future patterns. In the study, the LULC map of Urmia/Iran in 2030 was produced using two different prediction methods CA-Markov and Artificial Neural Network (ANN). In general, the study followed a methodology consisting of three steps. In the first steps, Landsat satellite images acquired in 2000, 2010 and 2020 were classified with maximum likelihood algorithm and LULC maps were prepared for each year. In the second stage, to investigate the LULC prediction methods' validation (CA-Markov and ANN) the LULC prediction map of 2020 was produced using the LULC map of 2000 and 2010; In this step, the predicted LULC map of 2020 and the actual LULC map of 2020 were evaluated by correctness, completeness and quality indexes. Finally, The LULC map for 2030 was prepared using all two algorithms and the change map was extracted. The results show that the area of soil and vegetation decreased, and built-up regions increased during the research period. The methods validation results show that the two algorithms are much closer to each other. Nevertheless, in general, ANN has the highest completeness (96.21%) and quality (93.8%) and CA-Markov the most correctness (96.47). This study shows that the CA-Markov algorithm is most successful in predicting the future that had larger areas and a higher percentage in the region (urban and vegetation cover) and the ANN algorithm in predicting phenomena that had smaller levels with fewer percentages (soil and rock).

Optical neural networks (ONNs), or optical neuromorphic hardware accelerators, have the potential to dramatically enhance the computing power and energy efficiency of mainstream electronic processors, due to their ultra-large bandwidths of up to 10’s of terahertz together with their analog architecture that avoids the need for reading and writing data back-and-forth. Different multiplexing techniques have been demonstrated to demonstrate ONNs, amongst which wavelength-division multiplexing (WDM) techniques make sufficient use of the unique advantages of optics in terms of broad bandwidths. Here, we review recent advances in WDM-based ONNs, focusing on methods that use integrated microcombs to implement ONNs. We present results for human image processing using an optical convolution accelerator operating at 11 Tera operations per second. The open challenges and limitations of ONNs that need to be addressed for future applications are also discussed.

Bearings are widely used in various types of electrical machinery and equipment. As their core components, failures will often cause serious consequences . At present, most methods of parameter adjustment are still manual adjustment of parameters. This adjustment method is susceptible to prior knowledge and easy to fall into the local optimal solution, failing to obtain the global optimal solution and requires a lot of resources.Therefore, this paper proposes a new method of bearing fault diagnosis based on wavelet packet transform and convolutional neural network optimized by simulated annealing algorithm.The experimental results show that the method proposed in this paper has a more accurate effect in feature extraction and fault classification compared with traditional bearing fault diagnosis methods. At the same time, compared with the traditional artificial neural network parameter adjustment, this paper introduces the simulated annealing algorithm to automatically adjust the parameters of the neural network, thereby obtaining an adaptive bearing fault diagnosis method. To verify the effectiveness of the method, the Case Western Reserve University bearing database was used for testing, and the traditional intelligent bearing fault diagnosis method was compared. The results show that the method proposed in this paper has good results in bearing fault diagnosis. Provides a new way of thinking in the field of bearing fault diagnosis in parameter adjustment and fault classification algorithms

Thermal simulations are an important part in the design of electronic systems, especially as systems with high power density become common. In simulation-based design approaches, a considerable amount of time is spent by repeated simulations. In this work, we present a proof-of-concept study of the application of convolutional neural networks to accelerate those thermal simulations. The goal is not to replace standard simulation tools but to provide a method to quickly select promising samples for more detailed investigations. Based on a training set of randomly generated circuits with corresponding Finite Element solutions, the full 3D steady-state temperature field is estimated using a fully convolutional neural network. A custom network architecture is proposed which captures the long-range correlations present in heat conduction problems. We test the network on a separate dataset and find that the mean relative error is around 2 % and the typical evaluation time is 35 ms per sample ( 2 ms for evaluation, 33 ms for data transfer). The benefit of this neural-network-based approach is that, once training is completed, the network can be applied to any system within the design space spanned by the randomised training dataset (which includes different components, material properties, different positioning of components on a PCB, etc.).

The Physics Informed Neural Networks framework is applied to the understanding of the dynamics of Coronavirus of 2019. To provide the governing system of equations used by the framework, the Susceptible-Infected-Recovered-Death mathematical model is used. The study focused on finding the patterns of the dynamics of the disease which involves predicting the infection rate, recovery rate and death rate; thus predicting the active infections, total recovered, susceptible and deceased at any required time. The study used data that was collected on the dynamics of COVID-19 from the Kingdom of Eswatini between March 2020 and September 2021. The obtained results showed less errors thus making highly accurate predictions.

One of the most dangerous diseases that threaten people is Cancer. Cancer if diagnosed in earlier stages can be eradicated with its life threatening consequences. In addition, accuracy in prediction plays a major role. Hence, developing a reliable model that contributes much towards the medical community in early diagnosis of Biopsy images with perfect accuracy come to the scenario. The article aims towards development of better predictive models using multi-variate data and high-resolution diagnostic tools in clinical cancer research. This paper proposes the social spider optimization (SSO) algorithm tuned neural network to classify microscopic biopsy images of cancer. The significance of the proposed model relies on the effective tuning of the weights of the NN classifier by the SSO algorithm. The performance of the proposed strategy is analysed with the performance metrics, such as accuracy, sensitivity, specificity, and MCC measures, and are attained to be 95.9181%, 94.2515%, 97.125%, and 97.68% respectively, which shows the effectiveness of the proposed method in effective cancer disease diagnosis.

Convolutional Neural Networks (CNNs) have gained prominence in the research literature on image classification over the last decade. One shortcoming of CNNs, however, is their lack of generalizability and tendency to overfit when presented with small training sets. Augmentation directly confronts this problem by generating new data points providing additional information. In this paper, we investigate the performance of more than ten different sets of data augmentation methods, with two novel approaches proposed here: one based on the Discrete Wavelet Transform and the other on the Constant-Q Gabor transform. Pretrained ResNet50 networks are finetuned on each augmentation method. Combinations of these networks are evaluated and compared across three benchmark data sets of images representing diverse problems and collected by instruments that capture information at different scales: a virus data set, a bark data set, and a LIGO glitches data set. Experiments demonstrate the superiority of this approach. The best ensemble proposed in this work achieves state-of-the-art performance across all three data sets. This result shows that varying data augmentation is a feasible way for building an ensemble of classifiers for image classification (code available at https://github.com/LorisNanni).

Explaining the emergence of behavior and understanding on the basis of neuronal mechanisms is still elusive. One renowned proposal is the Free Energy Principle (FEP), which uses an information-theoretic framework derived from thermodynamic considerations to describe how behavior and understanding would emerge. FEP starts from a whole organism approach, based on mental states and phenomena, mapping them into the neuronal substrate. An alternative approach, the Energy Homeostasis Principle (EHP), initiates a similar explanatory effort, but starting from single neuron phenomena and building up to the whole organism’s behavior and understanding. In this work, we develop the EHP as an alternative but complementary vision to FEP and try to explain how behavior and understanding would emerge from the local requirements of the neurons. Based on EHP and a strict naturalist approach that sees living beings as physical and deterministic systems, we explain scenarios where learning would emerge without the need for volition or goals. Given these starting points, we state several considerations of how we see the nervous system, particularly the role of function, purpose, and the conception of goal-oriented behaviors. We problematize these conceptions, giving an alternative teleology-free framework in which behavior and, ultimately, understanding would still emerge. We reinterpret neural processing explaining basic learning situations up to simple anticipatory behavior. Finally, we end the work with an evolutionary perspective of how this non-goal-oriented behavior appears. We acknowledge that in the current form of our proposal, we are still far from explaining the emergence of understanding. Still, we set the ground for an alternative neuron-based framework to ultimately explain understanding.

Surrogate model based optimization method is widely-used to accelerate the design and optimization process~\cite{marler2004survey}. The input of regression model used in the surrogate model are numbers, which requires users to parametrize the geometries. In this paper, a new parameterization-free surrogate model is introduced and its corresponding uncertainty quantification and sensitivity analysis method are discussed. The input of new surrogate model methods is surface mesh of simulation domain. \Gls{gnns} is used to extract geometric information, and \Gls{cnns} is used to predict contours. This framework bypasses parameterization,as a consequence, uncertainties introduced by manual parameterization is reduced. However, such changes compared with conventional surrogate model methods impose great challenge on uncertainties quantification and sensitivity analysis. Uncertainties quantification in this paper means the error bar of prediction results, which is calculated by Gaussian Process Regression method in current surrogate method. In this paper, a new quantification method achieved by Kullback-Leibler divergence (KLD) is introduced. And the sensitivity analysis is conducted by Automatic Differentiation, which gives a Jacobian matrix of inputs. The method and analysis mentioned above are demonstrated by a low-pressure steam turbine rotator and its exhaust system.

Creating intelligent systems capable of recognizing emotions is a difficult task, especially when looking at emotions in animals. This paper describes the process of designing a “proof of concept” system to recognize emotions in horses. This system is formed by two elements, a detector and a model. The detector is a fast region-based convolutional neural network that detects horses in an image. The model is a convolutional neural network that predicts the emotions of those horses. These two elements were trained with multiple images of horses until they achieved high accuracy in their tasks. 400 images of horses were collected and labeled to train both the detector and the model while 80 were used to validate the system. Once the two components were validated, they were combined into a testable system that would detect equine emotions based on established behavioral ethograms indicating emotional affect through head, neck, ear, muzzle and eye position. The system showed an accuracy of between 69% and 74% on the validation set, demonstrating that it is possible to predict emotions in animals using autonomous intelligent systems. Such a system has multiple applications including further studies in the growing field of animal emotions as well as in the veterinary field to determine the physical welfare of horses or other livestock.

Abstract: The Hanqu Joint Station of the Dingbian Oil Production Plant of Yanchang Oilfield Co., Ltd is located at the edge of the desert in northern China. the bad field conditions and strong sandstorm, the hardware of computer monitoring system of Joint Station is often damaged. At the same time, the core equipment of the joint station three-phase separator oil chamber liquid level is hard to achieve high precision constant value control, the general control algorithm is difficult to meet the control requirements.This paper proposed a design scheme of a oilfield joint station computer monitoring system based on the Siemens S7-300 PLC, the hardware of the monitoring system adopts the redundancy scheme of dual monitoring computers, dual programmable logic controllers (PLCs), and dual industrial Ethernet. The BP neural network PID control algorithm was used to realize constant value control of the oil chamber liquid level of the three-phase separator of the core equipment of the joint station，and realized high control precision. The monitoring system could well adapt to the harsh environment of the scene, and showed high reliability and efficiency.

We confirm that energy dissipation weighting provides the most accurate approach to determining the effective hydraulic conductivity (Keff) of a binary K grid. A deep learning algorithm (UNET) can infer Keff with extremely high accuracy (R2 > 0.99). The UNET architecture could be trained to infer the energy dissipation weighting pattern from an image of the K distribution with high fidelity, although it was less accurate for cases with highly localized structures that controlled flow. Furthermore, the UNET architecture learned to infer the energy dissipation weighting even if it was not trained on this information directly. However, the weights were represented within the UNET in a way that was not immediately interpretable by a human user. This reiterates the idea that even if ML/DL algorithms are trained to make some hydrologic predictions accurately, they must be designed and trained to provide each user-required output if their results are to be used to improve our understanding of hydrologic systems most effectively.

The main bottleneck when performing computational fluid dynamics (CFD) simulations of combustion systems is the computation and integration of the highly non-linear and stiff chemical source terms. In recent times, machine learning has emerged as a promising tool to accelerate combustion chemistry, involving the use of regression models to predict the chemical source terms as functions of the thermochemical state of the system. However, combustion is a highly nonlinear phenomenon, and this often leads to divergence from the true solution when the neural network representation of chemical kinetics is integrated in time. This is because these approaches minimize the error during training without guaranteeing successful integration with ordinary differential equation (ODE) solvers. In this work, a novel neural ODE approach to combustion modeling, ChemNODE, is developed to address this issue. The source terms predicted by the neural network are integrated during training, and by backpropagating errors through the ODE solver, the neural network weights are adjusted accordingly to minimize the difference between the predicted and actual ODE solutions. It is shown that even when the dimensionality of the thermochemical manifold is trimmed to remove redundant species, the proposed approach accurately captures the correct physical behavior and reproduces the results obtained using the full chemical kinetic mechanism.

The great importance of estimating dissolved oxygen (DO) dictates utilizing proper evaluative models. In this work, a multi-layer perceptron (MLP) network is trained by three capable metaheuristic algorithms, namely multi-verse optimizer (MVO), black hole algorithm (BHA), and shuffled complex evolution (SCE) for predicting the DO using the data of the Klamath River Station, Oregon, US. The records (DO, water temperature, pH, and specific conductance) belonging to the water years 2015 - 2018 (USGS) are used for pattern analysis. The results of this process showed that all three hybrid models could properly infer the DO behavior. However, the BHA and SCE accomplished this task by simpler configurations. Next, the generalization ability of the developed patterns is tested using the data of the 2019 water year. Referring to the calculated mean absolute errors of 1.0161, 1.1997, and 1.0122, as well as Pearson correlation coefficients of 0.8741, 0.8453, and 0.8775, the MLPs trained by the MVO and SCE perform better than the BHA. Therefore, these two hybrids (i.e., the MLP-MVO and MLP-SCE) can be satisfactorily used for future applications.

The evolution in imaging technologies and artificial intelligence algorithms, coupled with improvements in UAV technology, has enabled the use of unmanned aircraft in a wide range of applications. The feasibility of this kind of approach for cattle monitoring has been demonstrated by several studies, but practical use is still challenging due to the particular characteristics of this application, such as the need to track mobile targets and the extensive areas that need to be covered in most cases. The objective of this study was to investigate the feasibility of using a tilted angle to increase the area covered by each image. Deep Convolutional Neural Networks (Xception architecture) were used to generate the models for the experiments, which covered aspects like ideal input dimensions, effect of the distance between animals and sensor, effect of classification error on the overall detection process, and impact of physical obstacles on the accuracy of the model. Experimental results indicate that oblique images can be successfully used under certain conditions, but some practical limitations need to be addressed in order to make this approach appealing.

We recently reported that refocusing attention between temporal and spatial tasks becomes more difficult with increasing age, which could impair daily activities such as driving (Callaghan et al., 2017). Here we investigated the extent to which difficulties in refocusing attention extend to naturalistic settings such as simulated driving. 118 participants in five age groups (18-30; 40-49; 50-59; 60-69; 70-91 years) were compared during simulated driving, where they switched from a spatially focal yet temporally complex task (braking due to traffic ahead) to a spatially more distributed task (reading a motorway road sign). Sequential-Task (switching) performance was compared to Single-Task performance (road sign only) to calculate age-related switch-costs. Electroencephalography was recorded in 34 participants (17 in the 18-30 and 17 in the 60+ years groups) to explore age-related changes in the neural oscillatory signatures of refocusing attention while driving. We indeed observed age-related impairments in attentional refocusing, evidenced by increased switch-costs in response times and by deficient modulation of theta and alpha frequencies. Our findings highlight virtual reality (VR) and Neuro-VR as important methodologies for future psychological and gerontological research.

Myocarditis is the form of an inflammation of the middle layer of the heart wall which is caused by a viral infection and can affect the heart muscle and its electrical system. It has remained as one of the most challenging diagnoses in cardiology. Myocardial is the prime cause of unexpected death in approximately 20% of adults less than 40 years of age. Cardiac MRI (CMR) has been considered as a noninvasive and golden standard diagnostic tool for suspected myocarditis and plays an indispensable role in diagnosing various cardiac diseases. However, the performance of CMR is heavily dependent on the clinical presentation and non-specific features such as chest pain, arrhythmia, and heart failure. Besides, other imaging factors like artifacts, technical errors, pulse sequence, acquisition parameters, contrast agent dose, and more importantly qualitatively visual interpretation can affect the result of the diagnosis. This paper introduces a new deep learning-based model called Convolutional Neural Network-Clustering (CNN-KCL) to diagnose the Myocarditis. The hybrid CNN-KCL method performs the early and accurate diagnosis of Myocarditis. To the best-of-our-knowledge, a Convolutional neural network has never been used before for the diagnosis of Myocarditis. In this study, we used 47 subjects to diagnose myocarditis patients from Tehran's Omid Hospital. The total number of data examined is 10425. Our results demonstrate that CNN-KCL achieves 92.3% in terms of diagnosis myocarditis prediction accuracy which is significantly better than those reported in previous studies.

The article’s goal is to overview challenges and problems on the way from the state of the art CUDA accelerated neural networks code to multi-GPU code. For this purpose, the authors describe the journey of porting the existing in the GitHub, fully-featured CUDA accelerated Darknet engine to OpenCL. The article presents lessons learned and the techniques that were put in place to make this port happen. There are few other implementations on the GitHub that leverage the OpenCL standard, and a few have tried to port Darknet as well. Darknet is a well known convolutional neural network (CNN) framework. The authors of this article investigated all aspects of the porting and achieved the fully-featured Darknet engine on OpenCL. The effort was focused not only on the classification with the use of YOLO1, YOLO2, and YOLO3 CNN models. They also covered other aspects, such as training neural networks, and benchmarks to look for the weak points in the implementation. The GPU computing code substantially improves Darknet computing time compared to the standard CPU version by using underused hardware in existing systems. If the system is OpenCL-based, then it is practically hardware independent. In this article, the authors report comparisons of the computation and training performance compared to the existing CUDA-based Darknet engine in the various computers, including single board computers, and, different CNN use-cases. The authors found that the OpenCL version could perform as fast as the CUDA version in the compute aspect, but it is slower in memory transfer between RAM (CPU memory) and VRAM (GPU memory). It depends on the quality of OpenCL implementation only. Moreover, loosening hardware requirements by the OpenCL Darknet can boost applications of DNN, especially in the energy-sensitive applications of Artificial Intelligence (AI) and Machine Learning (ML).

In this paper, we presented a method of retrieving sea surface wind speed from Sentinel-1 synthetic aperture radar (SAR) horizontal-horizontal (HH) polarization data in extra-wide mode, which have been extensively acquired over the Arctic for sea ice monitoring. In contrast to the conventional algorithm, i.e., using a geophysical model function (GMF) to retrieve sea surface wind by spaceborne SAR, we introduced an alternative method based on physical model guided neural network. Parameters of SAR normalized radar cross section, incidence angle, and wind direction are used as the inputs of the backward propagation (BP) neural network, and the output is the sea surface wind speed. The network is developed based on more than 11,000 HH-polarized EW images acquired in the marginal ice zone (MIZ) of the Arctic and their collocations with scatterometer measurements. Verification of the neural network based on the testing dataset yields a bias of 0.23 m/s and a root mean square error (RMSE) of 1.25 m/s compared to the scatterometer wind speed. Further comparison of the SAR retrieved sea surface wind speed with independent buoy measurements shows a bias and RMSE of 0.12 m/s and 1.42 m/s, respectively. We also analyzed the uncertainty of retrieval when the wind direction data of a reanalysis model are used as inputs to the neural network. By combining the detected sea ice cover information based on the EW data, one can expect to derive simultaneously sea ice and marine-meteorological parameters by spaceborne SAR in a high spatial resolution in the Arctic.

Recently, various relations and criteria have been presented to establish a proper relationship between control systems and control Global Positioning System (GPS)-intelligent buoy system. Given the importance of controlling the position of buoys and the construction of intelligent systems, in this paper, dynamic system modeling is applied to position marine buoys through the improved neural network with a backstepping technique. This study aims at developing a novel controller based on adaptive fuzzy neural network to optimally track the dynamically positioned vehicle on water with unavailable velocities and unidentified control parameters. In order to model the network with the proposed technique, uncertainties and the unwanted disturbances are studied in the neural network. The presented study aims at developing a neural controlling which applies the vectorial back-stepping technique to the surface ships, which have been dynamically positioned with undetermined disturbances and ambivalences. Moreover, the objective function is to minimize the output error for the neural network (NN) based on closed-loop system. The most important feature of the proposed model for the positioning buoys is its independence from comparative knowledge or information on the dynamics and the unwanted disturbances of ships. The numerical and obtained consequences demonstrate that the controller system can adjust the routes and the position of the buoys to the desired objective with relatively few position errors.

Periodic travelling waves are observed in various brain activities including visual, motor, language, sleep, and so on. There are several neural field models describing periodic waves assuming nonlocal interaction and, possibly, inhibition, time delay, or some other properties. In this work we study the influence of asymmetric connectivity functions and of time delay on the emergence of periodic waves and on their properties. Nonlinear wave dynamics is studied, including modulated and aperiodic waves. Multiplicity of waves for the same values of parameters is observed. External stimulation in order to restore wave propagation in a damaged tissue is discussed.

This paper focuses on quantifying the uncertainty in the specific absorption rate values of brain induced by the uncertain positions of the electroencephalography electrodes placed on patient's scalp. To avoid running a large number of simulations, an artificial neural network architecture for uncertainty quantification involving high-dimensional data is proposed in this paper. The proposed method is demonstrated to be an attractive alternative to conventional uncertainty quantification methods because of its considerable advantage in the computational expense and speed.

Complete digraphs are referred to in the combinatorics literature as tournaments. We consider a family of semi-simplicial complexes, that we refer to as ``tournaplexes'', whose simplices are tournaments. In particular, given a digraph G, we associate with it a ``flag tournaplex'' which is a tournaplex containing the directed flag complex of G, but also the geometric realisation of cliques that are not directed. We define several types of filtrations on tournaplexes, and exploiting persistent homology, we observe that flag tournaplexes provide finer means of distinguishing graph dynamics than the directed flag complex. We then demonstrate the power of these ideas by applying them to graph data arising from the Blue Brain Project's digital reconstruction of a rat's neocortex.

Water quality forecasting is increasingly significant for agricultural management and environmental protection. Enormous amounts of water quality data are increasingly being collected by advanced sensors, which leads to an interest in using data-driven models for predicting trends in water quality. However, the unpredictable background noises introduced during water quality monitoring seriously degrade the performance of those models. Meanwhile, artificial neural networks (ANN) with feed-forward architecture lack the capability of maintaining and utilizing the accumulated temporal information, which leads to biased predictions in processing time series data. Hence, we propose a water quality predictive model based on a combination of Kernal Principal Component Analysis (kPCA) and Recurrent Neural Network (RNN) to forecast the trend of dissolved oxygen. Water quality variables are reconstructed based on kPCA method, which aims to reduce the noise from the raw sensory data and preserve actionable information. With the RNN's recurrent connections, our model can make use of the previous information in predicting the trend in the future. Data collected from Burnett River, Australia was applied to evaluate our kPCA-RNN model. The kPCA-RNN model achieved R2 scores up to 0.908, 0.823 and 0.671 for predicting the concentration of dissolved oxygen in the upcoming 1, 2 and 3 hours, respectively. Compared to current data-driven methods like ANN and SVR, the predictive accuracy of the kPCA-RNN model was at least 8 %, 17 % and 21 % better than the comparative models in these 3 cases. The study demonstrates the effectiveness of the kPAC-RNN modeling technique in predicting water quality variables with noisy sensory data.

Speech signals are degraded in real-life environments, product of background noise or other factors. The processing of such signals for voice recognition and voice analysis systems presents important challenges. One of the conditions that make adverse quality difficult to handle in those systems is reverberation, produced by sound wave reflections that travel from the source to the microphone in multiple directions.To enhance signals in such adverse conditions, several deep learning-based methods have been proposed and proven to be effective. Recently, recurrent neural networks, especially those with long and short-term memory (LSTM), have presented surprising results in tasks related to time-dependent processing of signals, such as speech. One of the most challenging aspects of LSTM networks is the high computational cost of the training procedure, which has limited extended experimentation in several cases. In this work, we present a proposal to evaluate the hybrid models of neural networks to learn different reverberation conditions without any previous information. The results show that some combination of LSTM and perceptron layers produce good results in comparison to those from pure LSTM networks, given a fixed number of layers. The evaluation has been made based on quality measurements of the signal's spectrum, training time of the networks and statistical validation of results. Results help to affirm the fact that hybrid networks represent an important solution for speech signal enhancement, with advantages in efficiency, but without a significan drop in quality.

In this paper, we present a framework to study the spatial structure of noctilucent clouds formed by ice particles in the upper atmosphere at mid and high latitude during summer. We study noctilucent cloud activity in optical images taken from three different locations and under different atmospheric conditions. In order to identify and distinguish noctilucent cloud activity from other objects in the scene, we employ linear discriminant analysis (LDA) with feature vectors ranging from simple metrics to higher-order local autocorrelation (HLAC), and histogram of oriented gradients (HOG). Finally, we propose a Convolutional Neural Networks (CNN) based method for the detection of noctilucent clouds. The results clearly indicate that the CNN based approach outperforms LDA based methods used in this article. Furthermore, we outline suggestions for future research directions to establish a framework that can be used for synchronizing the optical observations from ground based camera systems with echoes measured with radar systems like EISCAT in order to obtain independent additional information on the ice clouds.

Automated weeding is an important research area in agrorobotics. Weeds can be removed mechanically or with the precise usage of herbicides. Deep Learning techniques achieved state of the art results in many computer vision tasks, however their deployment on low-cost mobile computers is still challenging. These paper present an advanced version of the system presented in [1]. The described system contains several novelties, compared both with its previous version and related work. It is a part of a project of the automatic weeding machine, developed by Warsaw University of Technology and MCMS Warka Ltd. The obtained model reaches satisfying accuracy at over 10~FPS on the Raspberry Pi 3B+ computer. It was tested for four different plant species at different growth stadiums and lighting conditions. The system performing semantic segmentation is based on Convolutional Neural Networks. Its custom architecture mixes U-Net, MobileNets, DenseNet and ResNet concepts. Amount of needed manual ground truth labels was significantly decreased by the usage of knowledge distillation process, learning final model to mimic an ensemble of complex models on the large database of unlabeled data. Further decrease of the inference time was obtained by two custom modifications: in the usage of separable convolutions in DenseNet block and in the number of channels in each layer. In the authors’ opinion, described novelties can be easily transferred to other agrorobotics tasks.

Boiler efficiency is called to some extent of total thermal energy which can be recovered from the fuel. Boiler efficiency losses are due to four major factors: the dry gas flux, the latent heat of steam in the flue gas, the combustion loss or the loss of unburned fuel, radiation and convection losses. In this research, the thermal behavior of boilers in gas refinery facilities is studied and their efficiency and their losses are calculated. The main part of this research is comprised of analyzing the effect of various parameters on efficiency such as excess air, fuel moisture, air humidity, fuel and air temperature, the temperature of combustion gases, and thermal value of the fuel. Based on the obtained results, it is possible to analyze and make recommendations for optimizing boilers in the gas refinery complex using response-surface method (RSM).

Drosophila circadian circuit is one of the best described neural circuits but is complex enough to obscure our understanding of how it actually works. Animals’ rhythmic behavior, the seemingly simple outcome of their internal clocks, relies on the interaction of heterogeneous clock neurons that are spread across the brain. Direct observations of their coordinated network interactions can bring us forward in understanding the circuit. The current challenge is to observe activity of each of these neurons over a long span of time –hours to days– in live animals. Here we review the progress in circadian circuit interrogation powered by in vivo calcium imaging.

Layout estimation is a challenge of segmenting a cluttered room image into floor, walls and ceiling. We applied Double refinement network proved to be efficient in the depth estimation to generate heat maps for room key points and edges. Our method is the first not using encoder-decoder architecture for the room layout estimation. ResNet50 was utilized as a backbone for the network instead of VGG16 commonly used for the task, allowing the network to be more compact and faster. We designed a special layout score function and layout ranking algorithm for key points and edges output. Our method achieved the lowest pixel and corner errors on the LSUN data set. The input image resolution is 224*224.

With the increase of the Artificial Neural Network (ANN), machine learning has taken a forceful twist in recent times. One of the most spectacular kinds of ANN design is the Convolutional Neural Network (CNN). The Convolutional Neural Network (CNN) is a technology that mixes artificial neural networks and up to date deep learning strategies. In deep learning, Convolutional Neural Network is at the center of spectacular advances. This artificial neural network has been applied to several image recognition tasks for decades and attracted the eye of the researchers of the many countries in recent years as the CNN has shown promising performances in several computer vision and machine learning tasks. This paper describes the underlying architecture and various applications of Convolutional Neural Network.

Accurate and fast traffic flow forecasting is vital in intelligent transportation system because many of the advanced features in intelligent transportation systems are based on it. However, existing methods have poor performance regarding accuracy and computational efficiency in long-term traffic flow forecasting under big data. Hence, we propose an improved Long short-term memory (LSTM) Network and its cluster computing implementation in this paper to address the above challenge. We propose a singular point probability LSTM (SDLSTM) algorithm. The method discards the units of the network according to the singular point probability during the training process and amends the SDLSTM by Autoregressive Integrated Moving Average Model (ARIMA) to achieve the accurate prediction of 24-hour traffic flow data. Furthermore, the paper designs a scheme for implementing this method through cluster computing to shorten the calculation time and improve the system's operating speed. Theoretical analysis and experimental results show that SDLSTM gains a higher accuracy rate and better stability in the long-term traffic flow forecasting compared with previous methods.

In recent years, data providers are generating and streaming a large number of images. More particularly, processing images that contain faces have received great attention due to its numerous applications, such as entertainment and social media apps. The enormous amount of images shared on these applications presents serious challenges and requires massive computing resources to ensure efficient data processing. However, images are subject to a wide range of distortions in real application scenarios during the processing, transmission, sharing, or combination of many factors. So, there is a need to guarantee acceptable delivery content, even though some distorted images do not have access to their original version. In this paper, we present a framework developed to estimate the images' quality while processing a large number of images in real-time. Our quality evaluation is measured using an integration of a deep network with random forests. In addition, a face alignment metric is used to assess the facial features. Experimental results have been conducted on two artificially distorted benchmark datasets, LIVE and TID2013. We show that our proposed approach outperforms the state-of-art methods, having a Pearson Correlation Coefficient (PCC) and Spearman Rank Order Correlation Correlation Coefficient (SROCC) with subjective human scores of almost 0.942 and 0.931 while minimizing the processing time from 4.8ms to 1.8ms.

We propose a deep learning algorithm that directly compensates for luminance degradation owing to the deterioration of organic light emitting diode (OLED) devices to address the burn-in phenomenon of OLED displays. Conventional compensation circuits are encumbered by a high cost of development and manufacturing processes owing to their complexity. However, given that deep learning algorithms are typically mounted on a system on chip (SoC), the complexity of the circuit design is reduced, and the circuit can be reused by re-learning only the changed characteristics of the new pixel device. The proposed approach comprises deep feature generation and multi-stream self-attention, which decipher the importance of the variables, and the correlation between burn-in-related variables. It also utilizes a deep neural network that identifies the nonlinear relationship between the extracted features and luminance degradation. Thereafter, the luminance degradation is estimated from the burn-in-related variables, and the burn-in phenomenon can be addressed by compensating for the luminance degradation. The experimental results revealed that compensation was successfully achieved within an error range of 4.56%, and demonstrate the potential of a new approach that can mitigate the burn-in phenomenon by directly compensating for pixel-level luminance deviation.

The conventional method used for calculating pavement condition index (PCI) has two major drawbacks: safety problems during pavement inspection, and human error. This paper proposes a method for removing these problems. The proposed method uses surface deflection data in falling weight Deflectometer test to estimate PCI. The data used in this study were derived from 236 pavement segments taken from Tehran-Qom freeway in Iran. The data set was analyzed using multi layers perceptron (MLP) and radial basis function (RBF) neural networks. These neural networks were optimized by levenberg-marquardt (MLP-LM), scaled conjugate gradient (MLP-SCG), imperialist competitive (RBF-ICA), and genetic (RBF-GA) algorithms. After initial modeling with four neural networks mentioned, the committee machine intelligent systems (CMIS) method was adopted to combine the results and improve the accuracy of the modeling. The results of analysis have been verified by the four criteria of average percent relative error (APRE), average absolute percent relative error (AAPRE), root mean square error (RMSE) and standard error (SD). The best reported results belonged to CMIS, including APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.

Direct measurement of strain within muscle is important for understanding muscle function in health and disease. Current technology (kinematics, dynamometry, electromyography) provides limited ability to measure strain within muscle. Regional fiber orientation and length are related with active/passive strain within muscle. Currently, ultrasound imaging provides the only non-invasive means of observing regional fiber orientation within muscle during dynamic tasks. Previous attempts to automatically estimate fiber orientation from ultrasound are not adequate, often requiring manual region selection, feature engineering, providing low-resolution estimations (one angle per muscle), and deep muscles are often not attempted. Here, we propose deconvolutional neural networks (DCNN) for estimating fiber orientation at the pixel-level. Dynamic ultrasound images sequences of the calf muscles were acquired (25 Hz) from 8 healthy volunteers (4 male, ages: 25–36, median 30). A combination of expert annotation and interpolation/extrapolation provided labels of regional fiber orientation for each image. We then trained DCNNs both with and without dropout using leave one out cross-validation. Our results demonstrated robust estimation of regional fiber orientation with approximately 3° error, which was an improvement on previous methods. The methods presented here provide new potential to study muscle in disease and health.

When extract building from high resolution remote sensing image with meter/sub-meter accuracy, the shade of trees and interference of roads are the main factors of reducing the extraction accuracy. Proposed a Bayesian Convolutional Neural Networks(BCNET) model base on standard fully convolutional networks(FCN) to solve these problems. First take building with no shade or artificial removal of shade as Sample-A, woodland as Sample-B, road as Sample-C. Set up 3 sample libraries. Learn these sample libraries respectively, get their own set of feature vector; Mixture Gauss model these feature vector set, evaluate the conditional probability density function of mixture of noise object and roofs; Improve the standard FCN from the 2 aspect:(1) Introduce atrous convolution. (2) Take conditional probability density function as the activation function of the last convolution. Carry out experiment using unmanned aerial vehicle(UVA) image, the results show that BCNET model can effectively eliminate the influence of trees and roads, the building extraction accuracy can reach 97%.

In traffic scene, pedestrian target detection faces significant issues of misdetection and omission due to factors such as crowd density and obstacle occlusion. To address these challenges and enhance detection accuracy, we propose an improved CCW-YOLO algorithm. The algorithm first introduces a lightweight convolutional layer using GhostConv and incorporates an enhanced C2f module to improve the network's detection performance. Additionally, it integrates the Coordinate Attention module to better capture key points of the targets. Next, the bounding box loss function CIoU Loss at the output of YOLOv5 is replaced with WiseIoU Loss to enhance adaptability to various detection scenarios, thereby further improving accuracy. Finally, we develop a pedestrian count detection system by using PyQt5 to enhance human-computer interaction. Experimental results on the INRIA public dataset show that our algorithm achieves a detection accuracy of 95.6%, representing a 8.7% improvement over the original YOLOv5s algorithm. This advancement significantly enhances the detection of small objects in images and effectively addresses misdetection and omission issues in complex environments. These findings have important practical implications for ensuring traffic safety and optimizing traffic flow.

This paper describes the E-Sense Artificial Intelligence system. It comprises of a memory model with 2 levels of information and then a more neural layer above that. The lower memory level stores source data in a Markov (n-gram) structure that is unweighted. Then a middle ontology level is created from a further 3 phases of aggregating source information. Each phase re-structures from an ensemble to a tree, where the information transposition may be from horizontal set-based sequences into more vertical, typed-based clusters. The base memory is essentially neutral, where any weighted constraints or preferences should be stored in the calling module. The success of the ontology typing is open to question, but results produced answers based more on use and context. The third level is more functional, where each function can represent a subset of the base data and learn how to transpose across it. The functional structures are shown to be quite orthogonal, or separate and are made from nodes with a progressive type of capability, including unordered to ordered. Comparisons with the columnar structure of the neural cortex can be made and the idea of ordinal learning, or just learning relative positions, is introduced. While this is still a work in progress, it offers a different architecture to the current favourites and may be able to give different views of the data from what they can provide.

The dynamic nature of quadrotor flight introduces significant uncertainty in system parameters, such as thrust and drag factor. Consequently, operators grapple with escalating challenges in implementing real-time control actions. This study delves into an approach for estimating the model of quadrotor Unmanned Aerial Vehicles using Physics-Informed Neural Networks (PINNs) when you have a limited amount of data available. PINNs offer the potential to tackle issues like heightened non-linearities in low-inertia systems, elevated measurement noise, and constraints on data availability. The effectiveness of the estimator is showcased in a simulation environment with real data and juxtaposed with a state-of-the-art technique, such as the Extended Kalman Filter (EKF).

Among women globally, breast cancer is a major cause of cancer-related death. Accurate and timely diagnosis is essential, and results can be significantly improved. A new era in image analysis has been brought about by the emergence of artificial intelligence (AI), which has made significant progress in the diagnosis and customization of treatment plans for breast cancer possible. This study aimed to develop a comprehensive AI framework for breast cancer detection by integrating convolutional neural networks (CNNs) for image analysis with an artificial neural network (ANN) for clinical data. Using a dataset of ultrasound and pathology images, along with clinical features from 569 patients, we trained CNN models to classify breast tissue as benign or malignant, and the ANN to process clinical data for the same task. The combined approach significantly enhanced the accuracy of breast cancer diagnosis, achieving over 96% accuracy by leveraging both imaging and clinical data. Class Activation Maps (CAM) and heatmaps provided valuable interpretability for CNN predictions, improving trust and transparency in the model’s decision-making process. The results demonstrate that the fusion of CNNs and ANNs enhances diagnostic accuracy and offers a promising tool for early breast cancer detection, while providing crucial insights for clinical validation.

One widely used method to predict concrete strength development based on temperature variations during curing is the equivalent maturity time (te) method. This method uses the activation energy (Ea) as its key parameter, which reflects the cement’s sensitivity to temperature. However, research shows that the Ea value varies depending on factors such as cement type, water-cement ratio, temperature, and additives. The permanent subject of discussion is the question of what value of the Ea parameter should be assumed. In this paper, a new approach is proposed by using a neural network analysis method to develop a strength-temperature-time history model. It was assumed that the ANN-fc% model would have 4 inputs including hydration heat (Q), activation energy (Ea), temperature (T) and time (t). A data set was collected and research was carried out on mortars using: 6 cements, curing temperatures 5-35°C, strength within 90 days. The results showed that the ANN analysis method allows for estimating the relative compressive strength with sufficient accuracy. Input nodes analysis showed that Q influences early strength gain, while Ea affects later strength development. The method of using the ANN model to calculate strength depending on the temperature change during maturation was shown.

In this study, we consider the valuation of rainbow options using unsupervised machine learning methods. In particular, we consider the pricing of multi-asset (rainbow) European and American options, using Physics Informed Neural Net- works (PINNS). After developing the PINNS architecture, we benchmark the method by using it to price vanilla and exotic options with one and two un- derlying assets. We then use the methodology to price a multi-asset European option, followed by the pricing of the multi-asset American option by solving the linear complementarity problem. We compare our results to those obtained using preexisting numerical methods and note excellent agreement. Unlike con- ventional numerical methods, we note that this methodology does not suffer from the ’curse of dimensionality’. The time complexity of our method is con- siderably less than that of the conventional techniques. Thus PINNS may offer a faster more efficient solution to the pricing of rainbow options.

Detecting people and technical objects in various situations, such as natural disasters and warfare, is critical to search and rescue operations and the safety of the civilian. A fast and accurate detection for people and equipment can significantly increase the effectiveness of search and rescue missions and provide timely assistance to people. Computer vision and deep learning technologies play a key role in detecting the required objects due to their ability to analyse big volumes of visual data in real time. The performance of the neural networks such as YOLOv4-v8, Faster R-CNN, SSD, and EfficientDet has been analysed using COCO2017, SARD, SeaDronesSee, and VisDrone2019 datasets. Main criteria for comparison were mAP, Precision, Recall, F1-Score, and the ability of the neural network to work in real time. The most important metrics for evaluating the efficiency and performance of models for a given task are accuracy (mAP), F1-Score, and processing speed (FPS). These metrics allow us to evaluate both the accuracy of object recognition and the ability to use the models in real-world environments where high processing speed is important. Although different neural networks perform better on certain types of metrics, YOLO outperforms them on all metrics, showing the best results of mAP-0.88, F1 - 0.88, and FPS - 48, so the focus was on these models.

The ever-increasing industrialization of certain areas of the planet combined with the simultaneous degradation of the natural environment are alarming phenomena, especially in the field of human health. The concentration of Particulate Matter with an aerodynamic diameter of 2.5μm (PM2.5) and 10μm (PM10), nitrogen oxides (NOx), carbon monoxide (CO), sulfur dioxide (SO2), and ozone (O3) needs constant monitoring, as they consist the main cause for many diseases. Based on the existence of statutory limits, by the World Health Organization (WHO), for the concentration of each of the aforementioned air pollutants, it is considered necessary to develop forecasting systems that will have the ability to correlate the current meteorological data with the concentrations of the above pollutants. In this work, the attempt to predict the air pollutants concentrations in the wider area of Beijing, China, is successfully carried out using artificial neural networks (ANNs) models. In the frame of the specific work, a significant number of ANNs was developed. For this purpose, an open-access meteorological and air pollution database was used. Finally, a statistical evaluation of the developed prognostic models was carried out. Results showed that ANNs present a re-markable prognostic ability in order to forecast the air pollution levels in an urban environment.

Brain aging in mammals is characterized by morphological and functional changes of neural cells. Macroscopically, this process leading to progressive cerebral volume loss and functional decline, includes memory and motor neuron defiance and behavioral disorders as well. Morphologically, brain aging is associated with aged neurons and astrocytes, appearing enlarged and flattened, and expressing an enhanced pH-dependent β-galactosidase activity. Multiple mechanisms are considered hallmarks of cellular senescence in vitro. Among them, cell cycle arrest, increased lysosomal activity, telo-mere shortening, oxidative stress and DNA damage. The most common markers for senescence identification were identified in: i) proteins implicated in cell cycle arrest, such as p16, p21, p53 ii) increased lysosomal mass iii) increased reactive oxygen species (ROS) and senescence associated secretory phenotype (SASP) expression. Finally, dys-functional autophagy, a process occurring during aging, contributes to alter brain homeostasis. The aim of this review is to summarize and update the most recent knowledge about brain aging with a comparative approach, where similarities and differences in some mammalian species are considered.

The financial crisis augmented the need to predict real estate prices. The current study examines the application of Artificial Neural Network (ANN) model and Vector Autoregressive (VAR) model in forecasting real estate prices. The study uses daily observations, which accounted for a total of 2955 observations collected. We found that ANN outperformed significantly the VAR model providing evidence that these models can be used for valuation purposes in the area of real estate and financial markets. These findings are novel and important as they provide evidence of the usefulness of more sophisticated methodologies for market participants and regulators in real estate and financial markets.

Resonance inductive coupling is widely used for wireless power transfer (WPT) in medical applications. In this paper, we analyze the LCL-compensated WPT structure and propose a novel constant voltage transmission system based on gain estimation, without any extra feedback from the receiver. The system is capable for amplitude-modulated implant neural stimulation where the load impedance and the coupling coefficient are both variable. Compared to existing methods for constant voltage transmission, our approach offers advantages in compact size and the compatibility with the industrial, scientific and medical (ISM) band. We validate the load-independent resonant characteristic and the feasibility of constant voltage transmission using an experimental prototype working at 6.78MHz. Finally, we discuss the structure of the implant stimulator and methods of applying the proposed WPT system.

Resonance inductive coupling is widely used for wireless power transfer (WPT) in medical applications. In this paper, we analyze the LCL-compensated WPT structure and propose a novel constant voltage transmission system based on gain estimation, without any extra feedback from the receiver. The system is capable for implant neural stimulation where the load impedance and the coupling coefficient are both variable. Compared to existing methods for constant voltage transmission, our approach offers advantages in compact size and the compatibility with the industrial, scientific and medical (ISM) band. We validate the load-independent resonant characteristic and the feasibility of constant voltage transmission using an experimental prototype working at 6.78MHz. Finally, we discuss the structure of the implant stimulator and methods of applying the proposed WPT system.

Three-phase induction motors play a key role in industrial operations. However, their failure can result in serious operational problems. This study focuses on the early identification of faults through accurate diagnosis and classification of faults in three-phase induction motors, using artificial intelligence techniques, by analyzing current, temperature, and vibration signals. Experiments were conducted on a test bench, simulating real operating conditions, including stator phase unbalance, bearing damage and shaft unbalance. To classify the faults, an Auto-Regressive Neural Network with Exogenous Inputs (NARX) was developed. The parameters of this network were determined through a process of selecting the best network, using the scanning method with multiple training and validation iterations, with the introduction of new data. The results of these tests showed that the network had excellent generalization in all the situations evaluated, achieving the following accuracy rates: Motor without fault = 94.2%, Unbalance fault = 95%, Bearings with fault =98% and Stator with fault = 95%.

Nonlinear optimization (NOPT) is a meaningful tool for solving complex tasks in fields like engineering, economics, and operations research, among others. However, NOPT has problems when it comes to dealing with data variability and noisy input measurements that lead to incorrect solutions. Furthermore, nonlinear constraints may result in outcomes that are either infeasible or suboptimal, such as non-convex optimization. This paper introduces a novel regularized physics-informed neural network (RPINN) framework as a new NOPT tool for both supervised and unsupervised data-driven scenarios. By using custom activation functions and regularization penalties in an artificial neural network (ANN), RPINN can handle data variability and noisy inputs. Besides, it uses physics principles to build the network architecture, computing the optimization variables based on network weights and learned features. In addition, it uses automatic differentiation training to make the system scalable and cut down on computation time through batch-based back-propagation. The test results for both supervised and unsupervised NOPT tasks show that our RPINN can provide solutions that are competitive compared to state-of-the-art solvers. In turn, RPINN’s robustness against noisy input measurements makes it particularly valuable in environments with fluctuating information. Additionally, RPINN’s ANN-based foundation offers significant flexibility and scalability.

Evolutionary algorithms and swarm intelligence algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using these algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1, the author previously reported experimental evaluations on Evolution Strategy　for reinforcement learning of binary neural networks, utilizing the Pendulum control task. This article constitutes Part2 of the series of comparative research. In this study, Genetic Algorithm is adopted as another evolutionary algorithm. Wilcoxon signed rank test revealed that there was no statistically significant difference between the fitness scores obtained using GA and those using ES. However, the p-value 0.11 indicated that GA worked better than ES on this training task. As the values of binary weights, {-1, 1} were significantly superior to {0, 1} (p < .01). The motion of the pendulum controlled by the binary MLP after the training showed that the binary MLP successfully swung the pendulum swiftly into an inverted position and maintained its stability after inversion.

Currently, foam mixers are predominantly categorized into two types: low-pressure and high-pressure. Low-pressure mixers primarily use agitator rotation to mix materials. However, they face challenges such as difficulty in cleaning and complex structures. High-pressure mixers, widely adopted for their structural simplicity and lack of need for cleaning devices, effectively mitigate issues associated with low-pressure mixers. Nonetheless, they encounter problems with uneven mixing when processing high-viscosity materials. Historically, the primary solution to this issue was increasing the working pressure. However, the capacity to increase pressure is finite, and higher pressure demands higher quality materials for the mixers. To address the issues high-pressure mixers face when dealing with high-viscosity materials, this study focuses on the polyimide high-pressure mixer. After reviewing previous studies, four design variables were selected: the mixer's impingement angle, inlet diameter, outlet diameter, and impingement pressure. Using a Full Factorial Design of Experiments (DOE), the significance of the impact exerted by these four variables on Mixing Unevenness was analyzed, determining the extent of their influence. Optimal Latin Hypercube Sampling generated several random sample points, followed by the establishment of both a Back Propagation (BP) Neural Network approximation model and a Kriging approximation model. A Genetic Algorithm was then applied to optimize these two approximation models, resulting in the optimal combination of design variables. The research findings indicate that the BP Neural Network exhibits higher predictive accuracy compared to the Kriging prediction model. The optimal combination of parameters, optimized through the Genetic Algorithm (GA), reduced the Mixing Unevenness by 69.1%, effectively decreasing the Mixing Unevenness of the mixer head.

This paper delves into the concept of information within the context of conscious systems, emphasizing the pivotal role of entropy as a fundamental aspect in comprehending consciousness. Drawing on insights from Integrated Information Theory (IIT) and information theory, the argument posits that consciousness entails dynamic information processing, distinct from the static storage and retrieval model employed by modern computers. The intrinsic dynamics of neural systems are explored, illuminating how they integrate incoming stimuli into a unified state of subjective experience, thereby shaping conscious awareness. By considering entropy as a temporal and qualitative value, its significance in reducing uncertainty and facilitating adaptability in conscious systems is underscored. Through a series of principles, the intricate relationship between entropy, neural dynamics, and consciousness is elucidated. This analysis suggests the necessity of rethinking traditional notions of information when applied to conscious systems, highlighting the dynamic nature of consciousness and its interaction with the environment.

In this work, we introduce the design a 16-channel in-pixel neural analog front-end which employs a current-based summing approach to establish a common-mode feedback loop. The primary aim of this novel structure is to enhance both the system common-mode rejection ratio (SCMRR) and the common-mode interference (CMI) range. Compared to more conventional designs, the hereby proposed front-end utilizes DC-coupled inverter-based main amplifiers, which significantly reduce the occupied on-chip area. Additionally, the current-based implementation of the CMFB loop obviates the need for voltage buffers, replacing them with simple common-gate transistors and in turn decreasing both area occupancy and power consumption. The proposed architecture is further examined from an analytical standpoint, providing a comprehensive evaluation through design equations of its performance in terms of gain, common-mode rejection and noise power. A 50μm×65μm compact layout of the pixel amplifiers that make up the recording channels of the front-end was designd in a 180 nm CMOS process. Simulations conducted in Cadence Virtuoso reveal an SCMRR of 80.5 dB and a PSRR of 72.58 dB, with a differential gain of 44 dB and a bandwidth that fully encompasses the frequency range of the bio-signals that can be theoretically captured by the neural probe. The noise integrated in the range between 1 Hz and 7.5 kHz results in an IRN of 4.04 μVrms. Power consumption is also tested, with a measured value of 3.77 μW per channel, corresponding to an overall consumpution of about 60 μW. To test its robustness with respect to PVT and mismatch variations, the front-end is evaluated by means of extensive parametric simulations and Monte Carlo simulations, revealing favorable results.

Prochlorococcus, a cyanobacteria genus of the smallest and most abundant oceanic phototrophs, encompasses ecotype strains adapted to high-light (HL) and low-light (LL) niches. To elucidate the adaptive evolution of this genus, we analyzed 40 Prochlorococcus marinus ORFeomes, including two cornerstone strains, MED4 and NATL1A. Employing deep learning with robust statistical methods, we detected new protein family distributions in the strains and identified key genes differentiating HL and LL strains. HL strains harbor genes (ABC-2 transporters) related to stress resistance, such as DNA repair and RNA processing, while LL strains exhibit unique chlorophyll adaptations (ion transport proteins, HEAT repeats). We report variable, depth-dependent endogenous viral elements in the 40 strains. We constructed the ORFeomes of MED4 and NATL1A covering 99 % of the annotated protein-coding sequences of the two species, totaling 3976 cloned, sequence-verified ORFs. These comparative genomics analyses, paired with MED4 and NATL1A ORFeomes, will facilitate future genotype-to-phenotype mappings and systems biology exploration of Prochlorococcus ecology.

To address the challenge of recognizing ship states accurately amidst the complexities of marine environments, this study proposes a novel ship state recognition approach leveraging a graph convolutional neural network (GCNN). Initially, the method extracts canonical and efficient ship motion trajectories from AIS data. Subsequently, a state recognition network tailored for ship motion trajectories is devised and implemented employing graph convolution. Notably, the accuracy of this model is enhanced through the introduction of novel weights and optimization of the Adj parameter. Experimental evaluations conducted on a ship state dataset demonstrate significant performance improvements. Specifically, the proposed recognition network achieves a recognition accuracy of 98.3% for regulated ship trajectories, marking an impressive 8.4% enhancement over traditional convolutional neural networks. This advancement holds promise for enhancing ship state recognition accuracy across diverse maritime applications including maritime supervision, navigation safety, and ship management.

Throughout the evolution of machine learning, the size of models has steadily increased as researchers strive for higher accuracy by adding more layers. This escalation in model complexity necessitates enhanced hardware capabilities. Today, state-of-the-art machine learning models have become so large that effectively training them requires substantial hardware resources, which may be readily available to large companies but not to students or independent researchers. To make the research on machine learning models more accessible, this study introduces a size reduction technique that leverages stages in Pyramid Training and Similarity Comparison. Our results demonstrate that pyramid training can reduce model complexity while maintaining accuracy of conventional full-sized models, offering a scalable and resource-efficient solution for researchers and practitioners in hardware-constrained environments.

Nitrogen is one of the most important macronutrients for crops, and in conjunction with artificial intelligence algorithms, it is possible to estimate it with the aid of vegetation indices through remote sensing. Various indices were calculated and those with a correlation ≥ 0.7 were selected for subsequent use in Random Forest, Gradient Boosting, and Artificial Neural Networks to determine their relationship with nitrogen levels measured in the laboratory. Random Forest showed no relationship, yielding an R2 of zero, whereas Artificial Neural Networks yielded the best results with an R2 of 0.93. Thus, it is reliable to estimate nitrogen levels using this algorithm by feeding it with data from TCARI, MCARI, TCARI/OSAVI, and MCARI/OSAVI, assisted by technological tools.

Mechanical equipment is composed of several parts, the interaction between the parts exists throughout whole life cycle leads to the widespread phenomenon of fault coupling and the diagnosis of independent faults cannot meet the requirements of the health management of mechanical equipment under actual working conditions. In this paper, the topological structure of graph neural network is used to describe the correlation of coupling faults and multiple fault types are regarded as network nodes respectively. The fault features are fused and extracted by graph convolution to achieve the classification of coupling faults. In this paper, dynamic vertexes are defined in data topology and the parameters of DIGNN classification model are optimized by changing the fault type of dynamic vertexes during training stage. The data is loaded into dynamic vertexes for classification and analysis during testing stage. The one-dimensional vibration data is converted into two-dimensional time-frequency domain data by wavelet transform making the input features of the model interpretable to reduce the uncertainty of model training. The data topology is then fed into DIGNN for fault classification, and GCN's node aggregation gives interpretability to each layer of network data processing. The method proposed in this paper can realize accurate diagnosis of independent faults on the data set, and can effectively judge the coupling mode of coupling faults, which is suitable for coupling fault analysis of mechanical equipment.

The article presents an innovative method for synthesizing radiation patterns efficiently by 1 combining the Taguchi method and neural networks, while validating the results on a 10-element 2 antenna array. The Taguchi method aims to minimize product and process variability, while neural 3 networks are used to model the relationship between antenna design parameters and radiation 4 pattern characteristics. This approach utilizes Taguchi parameters as inputs for the neural network, 5 which is then trained on a dataset generated by the Taguchi method. After training, the network is 6 validated using a real 10-element antenna array. Analytical results demonstrate that this method 7 enables efficient synthesis of radiation patterns with a significant reduction in computation time 8 compared to traditional approaches. Furthermore, validation on the antenna array confirms the 9 accuracy and robustness of the approach, showing a high correlation between predicted performances 10 by the neural network model and actual measurements on the antenna array.In summary, our article 11 highlights that the combined use of the Taguchi method and neural networks, with validation on a 12 real antenna array, offers a promising approach for efficient synthesis of antenna radiation patterns. 13 This approach combines speed, accuracy, and reliability in antenna system design.

The increasing use of Convolutional Neural Networks (CNN) has brought about a significant transformation in numerous fields, such as image categorization and identification. In the development of a CNN model for classifying images of sericea lespedeza (SL; Lespedeza cuneata) from weed images, four architectures were explored: CNN-Model Variant 1, CNN-Model Variant 2, VGG16, and ResNet50. The CNN-Model Variant 1 demonstrated 100 % validation accuracy, while Variant 2 achieved 90.78% validation accuracy. Pre-trained models, like VGG16 and ResNet50, were also analyzed. In contrast, ResNet50's steady learning pattern indicated potential for better generalization. A detailed evaluation of these models revealed that Variant 1 achieved a perfect score in precision, recall, and F1-score, indicating superior optimization and feature utilization. Variant 2 presented a balanced performance, with metrics between 86% and 93%. The VGG16 mirrored the behavior of Variant 2, both maintaining around 90% accuracy, but ResNet50's results revealed a conservative approach for class 0 predictions. Overall, Variant 1 stood out in performance, while both Variant 2 and VGG16 showed balanced results. The reliability of CNN model Variant 1 is highlighted by the significant accuracy percentages, which demonstrate its potential for practical implementation in agriculture. Smartphone application for the identification of SL in a field-based trial has shown promising results with an accuracy of 98%-99%. Using a CNN model with batch normalization has the potential to play a crucial role in redefining and optimizing the management of undesirable vegetation in the future.

Camouflage evaluation typically involves human visual search and detection experiments that are time-consuming and expensive. Hence, there is a need for models that compute camouflage effectiveness from digital imagery. Convolutional neural networks are a powerful tool for automatic object detection and recognition. We investigated whether such a network (YOLO) can also provide a measure of camouflage effectiveness that is related to human perception. To this end, human performance measures of camouflage effectiveness such as detection time and target conspicuity were obtained in observer experiments and compared with the performance of the (standard, i.e. pre-trained) YOLO-V4-tiny algorithm. YOLO provides the probability that a detected object is correctly classified, and this is adopted as our measure of camouflage effectiveness. We compared the YOLO-predicted classification probability for a person in camouflage clothing moving through rural and urban scenes to human detection performance. Overall, camouflage effectiveness predicted by YOLO correlates with human observer performance. At close distances, YOLO’s classification performance appears sensitive to high-contrast shape-breaking elements of a camouflage pattern. This suggests that YOLO may be adapted to assess camouflage effectiveness for a wide range of applications, such as evaluating or optimizing one’s signature and predicting optimal hiding locations in a given environment. Further research is required to fully establish YOLO’s limitations and applicability for this purpose.

Reasonable allocation of production plans and saving the overall electricity cost are crucial for large manufacturing conglomerates, which is an effective way for conglomerates to realize open-source and cost-saving. This paper develops an optimization model of off-site industrial production scheduling for enterprises in response to the problems of high electricity costs due to the irrational allocation of production schedules on the demand side of China's electric power and the difficulty of promoting industrial and commercial distributed photovoltaic (PV) projects in China. The model makes full use of the conditions of different PV resources and different electricity prices in different places to optimize the scheduling of industrial production in different places. The model is embedded with two sub-models of the electricity price prediction model and distributed photovoltaic kWh cost model to complete the model parameters, in which the electricity price prediction model utilizes the LSTM neural network. The integrated model is then solved by the particle swarm algorithm. To verify the effectiveness of the model in solving the problem of off-site production scheduling on the demand side of electricity, the research team researched two off-site pharmaceutical factories belonging to the same large pharmaceutical company. Finally, the research data were substituted into the model for solving, and it was concluded that the optimization model could significantly reduce the cost of electricity consumption of the enterprise by about 7.9 %.

Military medical service is an important component of the Armed Forces of any country [1]. In wartime, healthcare performs critical functions of medical support for military operations, providing effective and qualified care to the wounded and sick. Consequently, it is imperative to equip military hospitals with state-of-the-art materials and technical resources commensurate with the predefined requirements. In this study, we examine a series of enhancements applied to the TurtleBot 3 Waffle Pi-based medical assistant robot, tailored for deployment in military hospital settings.

Taekwondo has evolved from a traditional martial art into an official Olympic sport. This study introduces a novel action recognition model tailored for Taekwondo unit actions, utilizing joint motion data acquired via wearable inertial measurement unit (IMU) sensors. The utilization of IMU sensor-measured motion data facilitates the capture of the intricate and rapid movements characteristic of Taekwondo techniques. The model, underpinned by a conventional convolutional neural network (CNN)-based image classification framework, synthesizes action images to represent individual Taekwondo unit actions. These action images are generated by mapping joint motion profiles onto the RGB color space, thus encapsulating the motion dynamics of a single unit action within a solitary image. To further refine the representation of rapid movements within these images, a time-warping technique was applied, adjusting motion profiles in relation to the velocity of the action. The effectiveness of the proposed model was assessed using a dataset compiled from 40 Taekwondo experts, yielding remarkable outcomes: an accuracy of 0.998, precision of 0.983, recall of 0.982, and an F1-score of 0.982. These results underscore the time-warping technique's contribution to enhancing feature representation, as well as the proposed method's scalability and effectiveness in recognizing Taekwondo unit actions.

Spiking neural networks (SNNs) promise to perform tasks currently done by classical artificial neural networks (ANNs) faster, in smaller footprints and using less energy. Neuromorphic processors are set out to revolutionize computing at a large scale, but the move to edge-computing applications calls for finely-tuned custom implementations to keep pushing towards more efficient systems. To that end, we have examined the architectural design space for executing spiking neuron models on FPGA platforms, focusing on achieving ultra-low area and power consumption. This work presents an efficient clock-driven spiking neuron architecture used for the implementation of both fully-connected cores and 2D convolutional cores, which rely on deep pipelines for synaptic processing and distributed memory for weight and neuron states. With them, we have developed an accelerator for an SNN version of the LeNet-5 network trained on the MNIST dataset. At around 5.5 slices/neuron and only 348 mW, it is able to use 33% less area and 4 times as less power per neuron as current state-of-the-art implementations while keeping low simulation step times.

Intrinsically Disordered Proteins (IDPs) play crucial roles in signal transduction, cell differentiation, and transcriptional regulation. Many disrupted genes associated with mental disorders are identified as IDPs, and emerging evidence suggests the functional role of IDPs in neuropsychiatric disorders. However, few studies comprehensively explore the functional association between protein disorder properties and different mental diseases. To address this gap, we collected disrupted gene sets for seven mental diseases (MDD, SCZ, BP, ID, AD, ADHD, ASD) and a control gene set from normal brains using DisGeNET and GeneCards databases. The state-of-the-art predictor IUPred2A was then utilized to calculate the disorder properties , followed by a thorough comparison between the disordered proteins in mental diseases and healthy controls. Functional enrichment analysis and protein-protein interaction networks were conducted to investigate the IDPs’ functional roles in psychiatric diseases. Additionally, we demonstrated the role of IDPs in protein binding formations through a case study of alpha-synuclein using protein docking. Our findings reveal that differentially expressed proteins in mental disorders, especially in ASD and ADHD, exhibit more IDPs than those in healthy controls. IDPs in psychiatric disorders are significantly enriched in neurodevelopmental pathways and play an important role in in gene expression regulation. Our results indicate distinct functional patterns of disorder proteins among mental diseases and healthy controls. When comparing the IDPs between ASD and ADHD, we observed that IDPs in ADHD are more likely linked to the synaptic signaling and regulation, while IDPs in ASD are more tendentiously related to diverse and complex biological processes. Our work offers valuable insights into the important functions of IDPs in psychiatric disorders, enhancing our understanding of the molecular mechanisms involved in psychiatric disorders.

Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1 and Part2, the author previously reported experimental evaluations on Genetic Algorithm and Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. This article constitutes Part3 of the series of comparative research. In this study, Differential Evolution is adopted as the third instance of major evolutionary algorithms. The experimental results show a statistically significant superiority of DE over both GA and ES (p < .01). In addition, DE exhibits its robustness to variations in hyperparameter configurations (the number of offsprings and generations). In the previous experiments, both ES and GA showed significant performance differences depending on the configurations, whereas in the experiment reported in this article, such differences are not detected for DE.

This study explores the use of Bayesian Neural Networks (BNNs) for estimating chlorophyll-a concentration ([CHL-a]) from remotely sensed data. The BNN model enables uncertainty quantification, offering additional layers of information compared to traditional ocean colour models. An extensive in situ bio-optical dataset is utilized, generated by merging 27 data sources across the world’s oceans. The BNN model demonstrates remarkable capability in capturing mesoscale features and ocean circulation patterns, providing comprehensive insights into spatial and temporal variations in [CHL-a] across diverse marine ecosystems. In comparison to established ocean colour algorithms, such as Ocean Colour 4 (OC4), the BNN shows comparable performance in terms of correlation coefficients, errors, and biases when compared with the in situ data. The BNN, however, further provides critical information about the distribution of [CHL-a], which can be used to assess uncertainties in the prediction. Moreover, the BNN model’s ability to provide more information for coastal waters, especially with higher spatial resolution imagery, offers valuable advantages for marine research and management. By quantifying uncertainty, the model builds confidence in [CHL-a] predictions, even in regions with limited data coverage. This is reflected by the spread in the model predictions, where the BNN can detect a range of uncertainty bounds that reflect confidence in the retrievals. Introducing BNNs as probabilistic ocean colour models represents a significant advancement, enabling more accurate and reliable predictions of [CHL-a] in the global oceans.

Neural-objective and image optimization approaches for drilling fluid rheology automation are crucial for drilling engineering optimization. A myriad of intelligent computational models are employed to predict and monitor the parameters of mud rheology and filter cake permeability posture using an artificial neural network feedforward (ANN-FF) function, a non-ANN-FF function, an image processing tool, and a model optimization tool. 498 datasets of synthetic-based mud (SBM) flat rheology from a drilling mud laboratory at Nazarbayev University were imported into a user-friendly MATLAB application using image processing and nftool. Apart from the Google TensorFlow Sequential API DNN architecture used, a Levenberg-Marquardt training algorithm with input sigmoid hidden neurons 10, 12, and 18 coupled with a linear output layer was also used to predict the SBM flow index. OBM and SBM filter cakes were processed for void spaces; however, a model study was extrapolated to maximize filtration volume Vf. The study’s findings show that the ANN-FF model employed for rheological property monitoring and prediction had higher steady and exponential levels of accuracy and a correlation coefficient of 0.96-0.99. More so, SBM and OBM image processing presented an area of void spaces of 1790M2 and 1739M2, respectively. The porosity and permeability postures of both SBM and OBM resulted in a significant void space capable of maximizing the flow index. In addition, the single-objective modelling based on a genetic algorithm did validate the experimental rheological data for flow index or filtration volume Vf optimization; the study resulted in the finding that the constrained physics-informed objective function hindered maximizing oil recovery and instead predicted possible formation damage. It is empirical to note that automating flow predictions with neural, objective, and image functions has presented an alternative novel method for non-programmers using MATLAB and Google Colabs that is capable of enhancing mud rheological parameters, drilling efficiency, and hydrocarbon recovery.

In the pursuit of energy-efficient spiking neural network (SNN) hardware, synaptic devices lev-eraging emerging memory technologies hold significant promise. This study investigates the ap-plication of the recently proposed HfO2/SiO2-based interface dipole modulation (IDM) memory for synaptic spike timing-dependent plasticity (STDP) learning. Firstly, through pulse measure-ments of IDM metal-oxide-semiconductor (MOS) capacitors, we demonstrate that IDM exhibits an inherently nonlinear and near-symmetric response. Secondly, we discuss the drain current re-sponse of a field-effect transistor (FET) incorporating a multi-stack IDM structure, revealing its nonlinear and asymmetric pulse response, and suggest that the degree of the asymmetry depends on the modulation current ratio. Thirdly, to emulate synaptic STDP behavior, we implement dou-ble-pulse-controlled drain current modulation of IDMFET using a simple bipolar rectangular pulse. Additionally, we propose a double-pulse-controlled synaptic depression that is valuable for optimizing STDP-based unsupervised learning. Integrating the pulse response characteristics of IDMFETs into a two-layer SNN system for synaptic weight updates, we assess training and classification performance on handwritten digits. Our results demonstrate that ID-MFET-based synaptic devices can achieve classification accuracy comparable to previously re-ported simulation-based results.

Survival models have become popular for credit risk estimation. Most current credit risk survival models use an underlying linear model. This is beneficial in terms of interpretability but is restrictive for real-life applications since it cannot discover hidden nonlinearities and interactions within the data. This study uses discrete time survival models with embedded neural networks as estimators of time to default. This provides flexibility to express nonlinearities and interactions between variables, and hence allows for models with better overall model fit. Additionally, the neural networks are used to estimate Age-Period-Cohort (APC) models so that default risk can be decomposed into time components for loan age (maturity), origination (vintage) and environment (e.g., economic, operational and social effects). These can be built as general models, or as local APC models for specific customer segments. The local APC models reveal special conditions for different customer groups. The corresponding APC identification problem is solved by a combination of regularization and fitting the decomposed environment time risk component to macroeconomic data, since the environmental risk is expected to have a strong relationship with macroeconomic conditions. Our approach is shown to be effective when tested on a large publicly available US mortgage data set. This novel framework can be adapted by practitioners in the financial industry to improve modelling, estimation and assessment of credit risk.

River bed materials serve multiple environmental functions as a habitat for aquatic invertebrates and fishes. At the same time, the particle size of the bed material reflects the tractive force of the flow regime in a flood and provides useful information for flood control. The traditional river bed particle size surveys, such as sieving, require time and labor to investigate river bed materials. The authors proposed a method to classify aerial images taken by unmanned aerial vehicle (UAV) using convolutional neural networks (CNN), our previous study showed that terrestrial riverbed material could be classified with high accuracy. In this study, we attempted to classify riverbed materials distributed in shallow waters where the bottom can be seen from UAVs. After training the CNN to classify the images with the same grain size as being in the same class even if the surface flow types taken overlapping the riverbed material were different, the total accuracy reached 90.3%. Moreover, the proposed method was applied to the wide-ranging area to determine the distribution of the particle size. In parallel, the microtopography was surveyed using Lidar-UAV, and the relationship between the microtopography and particle size distribution was discussed. In the steep section, coarse particles were distributed and formed a rapid. Fine particles were deposited on the upstream side of those rapids, where the slope had become gentler due to the damming. There was good agreement between the microtopographical trends and the grain size distribution.

The emergence of the Internet of Things (IoT) has led to the deployment of various types of sensors in many application fields, including environment monitoring, smart cities, health, industries, and others. The increasing number of connected devices has led to the creation of massive quantities of data that need to be analyzed. Typically, this data is ordered by time, as a time series. In this context, this paper presents a time series prediction model based on Recurrent Neural Networks in order to predict one step ahead. Result obtained through five Internet of Things monitoring datasets, showed that the Recurrent Neural Network obtained better performance that the prediction methods, ARIMA and SVM.

Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. The author previously reported experimental evaluations on Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. In this study, Genetic Algorithm is adopted as another instance of major evolutionary algorithms. Experimental results demonstrate that there was no statistically significant difference between the experimental performances of GA and ES, but the priority of generations and offsprings was different; GA performed better with a greater number of generations while ES performed better with a greater number of offsprings. Eight hidden units were the best among four variations (4, 8, 16 or 32 units), which aligns with previous study using ES.

A long time has passed since COVID-19 was discovered and widely disseminated. Both machine learning and deep learning have moved towards the research of diagnosing COVID-19. Compared to deep learning, traditional machine learning-based methods can also achieve good diagnostic results if they are improved based on innovative points. And deep learning remains a more popular research object. Based on the deep neural network in the field of deep learning, the convolutional neural network, recurrent neural network, long and short-term memory network, and Transformer model have been extended. These models improve the performance and processing power of neural networks by introducing new structures and algorithms. This paper will introduce the basic concepts of machine learning and deep learning, as well as the details of using the relevant methods of both to help diagnose COVID-19.

Water resource pollution, particularly in river channels, presents a grave environmental challenge that necessitates a comprehensive and systematic approach encompassing assessment, forecasting, and effective management. This article provides a comprehensive exploration of the methodology and modeling tools employed to scrutinize the process of river channel pollution due to silting, rooted in the fundamental principles of hydrodynamics and pollutant transport dynamics. The study's methodology seamlessly integrates numerical simulations with state-of-the-art neural network techniques, with a specific focus on the Physics-informed neural networks (PINN) method. This innovative approach represents a groundbreaking fusion of artificial neural networks (ANN) and physical equations, offering a more efficient and precise means of modeling a wide array of complex processes and phenomena. The proposed mathematical model, grounded in the Euler equation, has been meticulously implemented using the Ansys Fluent software package, ensuring accuracy and reliability in the computations. In a pivotal phase of the research, a thorough comparative analysis was conducted between the results derived from the PINN method and those obtained through conventional numerical approaches using the Ansys Fluent software package. The outcomes of this analysis revealed the superior performance of the PINN method, characterized by the generation of smoother pressure fluctuation profiles and significantly reduced computation time, underscoring its potential as a transformative modeling tool. The calculated data originating from this study assumes paramount significance in the ongoing battle against river sedimentation. Beyond this immediate application, these findings also serve as a valuable resource for creating predictive materials pertaining to river channel silting, thereby empowering decision-makers and environmental stakeholders with essential information. The utilization of modeling techniques to address pollution concerns in river channels holds the potential to revolutionize risk management and safeguard the integrity of our vital water resources. However, it is imperative to underscore that the effectiveness of such models hinges on ongoing monitoring and frequent data updates, ensuring that they remain aligned with real-world conditions. This research not only contributes to the enhanced understanding and proactive management of river channel pollution due to silting but also underscores the pivotal role of advanced modeling methodologies in the preservation of our invaluable water resources for present and future generations.