Neural-objective and image optimization approaches for drilling fluid rheology automation are crucial for drilling engineering optimization. A myriad of intelligent computational models are employed to predict and monitor the parameters of mud rheology and filter cake permeability posture using an artificial neural network feedforward (ANN-FF) function, a non-ANN-FF function, an image processing tool, and a model optimization tool. 498 datasets of synthetic-based mud (SBM) flat rheology from a drilling mud laboratory at Nazarbayev University were imported into a user-friendly MATLAB application using image processing and nftool. Apart from the Google TensorFlow Sequential API DNN architecture used, a Levenberg-Marquardt training algorithm with input sigmoid hidden neurons 10, 12, and 18 coupled with a linear output layer was also used to predict the SBM flow index. OBM and SBM filter cakes were processed for void spaces; however, a model study was extrapolated to maximize filtration volume Vf. The study’s findings show that the ANN-FF model employed for rheological property monitoring and prediction had higher steady and exponential levels of accuracy and a correlation coefficient of 0.96-0.99. More so, SBM and OBM image processing presented an area of void spaces of 1790M2 and 1739M2, respectively. The porosity and permeability postures of both SBM and OBM resulted in a significant void space capable of maximizing the flow index. In addition, the single-objective modelling based on a genetic algorithm did validate the experimental rheological data for flow index or filtration volume Vf optimization; the study resulted in the finding that the constrained physics-informed objective function hindered maximizing oil recovery and instead predicted possible formation damage. It is empirical to note that automating flow predictions with neural, objective, and image functions has presented an alternative novel method for non-programmers using MATLAB and Google Colabs that is capable of enhancing mud rheological parameters, drilling efficiency, and hydrocarbon recovery.

In the pursuit of energy-efficient spiking neural network (SNN) hardware, synaptic devices lev-eraging emerging memory technologies hold significant promise. This study investigates the ap-plication of the recently proposed HfO2/SiO2-based interface dipole modulation (IDM) memory for synaptic spike timing-dependent plasticity (STDP) learning. Firstly, through pulse measure-ments of IDM metal-oxide-semiconductor (MOS) capacitors, we demonstrate that IDM exhibits an inherently nonlinear and near-symmetric response. Secondly, we discuss the drain current re-sponse of a field-effect transistor (FET) incorporating a multi-stack IDM structure, revealing its nonlinear and asymmetric pulse response, and suggest that the degree of the asymmetry depends on the modulation current ratio. Thirdly, to emulate synaptic STDP behavior, we implement dou-ble-pulse-controlled drain current modulation of IDMFET using a simple bipolar rectangular pulse. Additionally, we propose a double-pulse-controlled synaptic depression that is valuable for optimizing STDP-based unsupervised learning. Integrating the pulse response characteristics of IDMFETs into a two-layer SNN system for synaptic weight updates, we assess training and classification performance on handwritten digits. Our results demonstrate that ID-MFET-based synaptic devices can achieve classification accuracy comparable to previously re-ported simulation-based results.

Survival models have become popular for credit risk estimation. Most current credit risk survival models use an underlying linear model. This is beneficial in terms of interpretability but is restrictive for real-life applications since it cannot discover hidden nonlinearities and interactions within the data. This study uses discrete time survival models with embedded neural networks as estimators of time to default. This provides flexibility to express nonlinearities and interactions between variables, and hence allows for models with better overall model fit. Additionally, the neural networks are used to estimate Age-Period-Cohort (APC) models so that default risk can be decomposed into time components for loan age (maturity), origination (vintage) and environment (e.g., economic, operational and social effects). These can be built as general models, or as local APC models for specific customer segments. The local APC models reveal special conditions for different customer groups. The corresponding APC identification problem is solved by a combination of regularization and fitting the decomposed environment time risk component to macroeconomic data, since the environmental risk is expected to have a strong relationship with macroeconomic conditions. Our approach is shown to be effective when tested on a large publicly available US mortgage data set. This novel framework can be adapted by practitioners in the financial industry to improve modelling, estimation and assessment of credit risk.

River bed materials serve multiple environmental functions as a habitat for aquatic invertebrates and fishes. At the same time, the particle size of the bed material reflects the tractive force of the flow regime in a flood and provides useful information for flood control. The traditional river bed particle size surveys, such as sieving, require time and labor to investigate river bed materials. The authors proposed a method to classify aerial images taken by unmanned aerial vehicle (UAV) using convolutional neural networks (CNN), our previous study showed that terrestrial riverbed material could be classified with high accuracy. In this study, we attempted to classify riverbed materials distributed in shallow waters where the bottom can be seen from UAVs. After training the CNN to classify the images with the same grain size as being in the same class even if the surface flow types taken overlapping the riverbed material were different, the total accuracy reached 90.3%. Moreover, the proposed method was applied to the wide-ranging area to determine the distribution of the particle size. In parallel, the microtopography was surveyed using Lidar-UAV, and the relationship between the microtopography and particle size distribution was discussed. In the steep section, coarse particles were distributed and formed a rapid. Fine particles were deposited on the upstream side of those rapids, where the slope had become gentler due to the damming. There was good agreement between the microtopographical trends and the grain size distribution.

The emergence of the Internet of Things (IoT) has led to the deployment of various types of sensors in many application fields, including environment monitoring, smart cities, health, industries, and others. The increasing number of connected devices has led to the creation of massive quantities of data that need to be analyzed. Typically, this data is ordered by time, as a time series. In this context, this paper presents a time series prediction model based on Recurrent Neural Networks in order to predict one step ahead. Result obtained through five Internet of Things monitoring datasets, showed that the Recurrent Neural Network obtained better performance that the prediction methods, ARIMA and SVM.

Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. The author previously reported experimental evaluations on Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. In this study, Genetic Algorithm is adopted as another instance of major evolutionary algorithms. Experimental results demonstrate that there was no statistically significant difference between the experimental performances of GA and ES, but the priority of generations and offsprings was different; GA performed better with a greater number of generations while ES performed better with a greater number of offsprings. Eight hidden units were the best among four variations (4, 8, 16 or 32 units), which aligns with previous study using ES.

A long time has passed since COVID-19 was discovered and widely disseminated. Both machine learning and deep learning have moved towards the research of diagnosing COVID-19. Compared to deep learning, traditional machine learning-based methods can also achieve good diagnostic results if they are improved based on innovative points. And deep learning remains a more popular research object. Based on the deep neural network in the field of deep learning, the convolutional neural network, recurrent neural network, long and short-term memory network, and Transformer model have been extended. These models improve the performance and processing power of neural networks by introducing new structures and algorithms. This paper will introduce the basic concepts of machine learning and deep learning, as well as the details of using the relevant methods of both to help diagnose COVID-19.

Water resource pollution, particularly in river channels, presents a grave environmental challenge that necessitates a comprehensive and systematic approach encompassing assessment, forecasting, and effective management. This article provides a comprehensive exploration of the methodology and modeling tools employed to scrutinize the process of river channel pollution due to silting, rooted in the fundamental principles of hydrodynamics and pollutant transport dynamics. The study's methodology seamlessly integrates numerical simulations with state-of-the-art neural network techniques, with a specific focus on the Physics-informed neural networks (PINN) method. This innovative approach represents a groundbreaking fusion of artificial neural networks (ANN) and physical equations, offering a more efficient and precise means of modeling a wide array of complex processes and phenomena. The proposed mathematical model, grounded in the Euler equation, has been meticulously implemented using the Ansys Fluent software package, ensuring accuracy and reliability in the computations. In a pivotal phase of the research, a thorough comparative analysis was conducted between the results derived from the PINN method and those obtained through conventional numerical approaches using the Ansys Fluent software package. The outcomes of this analysis revealed the superior performance of the PINN method, characterized by the generation of smoother pressure fluctuation profiles and significantly reduced computation time, underscoring its potential as a transformative modeling tool. The calculated data originating from this study assumes paramount significance in the ongoing battle against river sedimentation. Beyond this immediate application, these findings also serve as a valuable resource for creating predictive materials pertaining to river channel silting, thereby empowering decision-makers and environmental stakeholders with essential information. The utilization of modeling techniques to address pollution concerns in river channels holds the potential to revolutionize risk management and safeguard the integrity of our vital water resources. However, it is imperative to underscore that the effectiveness of such models hinges on ongoing monitoring and frequent data updates, ensuring that they remain aligned with real-world conditions. This research not only contributes to the enhanced understanding and proactive management of river channel pollution due to silting but also underscores the pivotal role of advanced modeling methodologies in the preservation of our invaluable water resources for present and future generations.

The traditional understanding of brain function has predominantly focused on chemical and electrical processes. However, new research in fruit fly (Drosophila) binocular vision reveals ultrafast photomechanical photoreceptor movements significantly enhance information processing, thereby impacting a fly's perception of its environment and behaviour. The coding advantages resulting from these mechanical processes suggest that similar physical motion-based coding strategies may affect neural communication ubiquitously. The theory of neural morphodynamics proposes that rapid biomechanical movements and microstructural changes at the level of neurons and synapses enhance the speed and efficiency of sensory information processing, intrinsic thoughts, and actions by regulating neural information in a phasic manner. We propose that morphodynamic information processing evolved to drive predictive coding, synchronising cognitive processes across neural networks to match the behavioural demands at hand effectively.

Object detection is a popular image processing technique, widely used in numerous applications for detecting and locating objects in images or videos. While being one of the fastest algorithms for object detection, Single-Shot Multibox Detection (SSD) networks are also computationally very demanding, which limits their usage in real-time edge applications. Even though the SSD post-processing algorithm is not the most complex segment of the overall SSD object detection network, it is still computationally demanding and can become a bottleneck with respect to processing latency and power consumption, especially in edge applications with limited resources. When using hardware accelerators to accelerate backbone CNN processing, the SSD post-processing step implemented in software can become critical for high-end applications where high frame rates are required, as this paper shows. To overcome this problem, we propose Puppis, an architecture for hardware acceleration of SSD post-processing algorithm. As experiments will show, our solution will lead to an average SSD post-processing speedup of 34.42 when compared with a software implementation. Furthermore, execution of a complete SSD network will be on average 45.39 times faster than software implementation when the proposed Puppis SSD hardware accelerator is used together with some existing CNN accelerators.

Big data technologies are disruptive technologies that affect every business, including those in the construction industry. The Thai government has also been affected, and attempted to use machine learning techniques with the analytics of big data technologies to predict which construction projects have a winning price over the project budget. However, this technology was never developed, and the government did not implement it because they had data obtained via a traditional data collection process. In this study, traditional data were processed to predict behavior in Thai government construction projects using a machine learning model. The data were collected from the government procurement system in 2019. There were seven input data, including project owner department, type of construction project, bidding method, project duration, project level, winning price over estimated price, and winning price over budget. A range of classification techniques, including an artificial neural network (ANN), a decision tree (DC), and K-nearest neighbor (KNN), were used in this study (ANN). According to the results, after hyperparameter tuning, ANN had the greatest prediction accuracy with 78.9 percent. This study confirms that data from the Thai government procurement system can be investigated using machine learning techniques from big data technologies.

Evolutionary algorithms find applicability in the reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. The author previously reported experimental evaluations on Evolution Strategy for reinforcement learning of neural networks, utilizing the pendulum control task. In this study, the Acrobot control task is adopted as another task. Experimental results demonstrate that ES successfully trained a Multi-Layer Perceptron to achieve a remarkable height of 99.85% concerning the maximum height. However, the trained MLP failed to maintain the chain end in an upright position throughout an episode. In this study, it was observed that employing 8 hidden units in the neural network yielded better results with statistical significance compared to using 4, 16, or 32 hidden units. Furthermore, the findings indicate that a larger population size in ES led to a more extensive exploration of potential solutions over a greater number of generations, which aligns with the previous study.

Near Earth Asteroids represent potential threats to human life because their trajectories may bring them in the proximity of the Earth. Monitoring these objects could help predict future impact events, but such efforts are hindered by the large numbers of objects that pass through the Earth’s vicinity. Additionally, there is also the problem of distinguishing asteroids from other objects in the night sky, which implies sifting through large sets of telescope image data. Within this context, we believe that employing machine learning techniques could greatly improve the detection process by sorting out the most likely asteroid candidates to be reviewed by human experts. At the moment, the use of machine learning techniques is still limited in the field of astronomy and the main goal of the present paper is to study the effectiveness of deep CNNs for the classification of astronomical objects, asteroids in this particular case, by comparing some of the well-known deep convolutional neural networks, including InceptionV3, Xception, InceptionResNetV2 and ResNet152V2. We have applied transfer learning and fine-tuning on these pre-existing deep convolutional networks and from the results that we have obtained one can see the potential of using deep convolutional neural networks in the process of asteroid classification. The InceptionV3 model has the best results in the asteroid class, meaning that by using it, we loose the least number of valid asteroids.

Wet granulation is a frequent process in the pharmaceutical industry. As a starting point for numerous dosage forms, the quality of the granulation not only affects subsequent production steps but also impacts the quality of the final product. It is thus crucial and economical to monitor this operation thoroughly. Here, we report on identifying different phases of a granulation process using a machine learning approach. The phases reflect the water content which in turn influences the processability and quality of the granule mass. We used two kinds of microphones and an acceleration sensor to capture acoustic emissions and vibrations. We trained convolutional neural networks (CNNs) to classify the different phases using transformed sound recordings as the input. We achieved a classification accuracy of up to 90 % using vibrational data and an accuracy of up to 97 % using the audible microphone data. Our results indicate the suitability of using audible sound and machine learning to monitor pharmaceutical processes. Moreover, since recording acoustic emissions is contactless, it readily complies with legal regulations and present Good Manufacturing Practices.

In this paper we derive a unified perspective for Optimal Transport (OT) theory and Mean Field Control (MFC) theory to analyse the learning process for Neural Networks algorithms in a high-dimensional framework. We consider Mean Field Neural Networks in the context of MFC theory, specifically the mean field formulation of OT theory that allows the development of highly efficient algorithms while providing a powerful tool in the context of explainable Artificial Intelligence.

Zearalenone is one of the most prevalent estrogenic mycotoxins produced mainly by Fusarium family fungi, and harmed the heath of animals. Zearalenone hydrolase is an important enzyme capable of degrading zearalenone into a non-toxic compound. Although previous research has investigated the catalytic mechanism of zearalenone hydrolase, information on its dynamic interaction with zearalenone remains unknown. This study aimed to develop a pipeline for identifying the allosteric pathway of zearalenone hydrolase. Using an identity analysis, we identified hub genes whose sequences can generalize a set of sequences in a protein family. We then utilized a neural relational inference (NRI) model to identify the allosteric pathway of the protein throughout the entire molecular dynamics simulation. The production run lasted 1 microsecond, and we analyzed residues 139-222 for the allosteric pathway using the NRI model. We found that the cap domain of the protein opened up during catalysis, resembling a hemostatic tape. We used umbrella sampling to simulate the dynamic docking phase of the ligand-protein complex and found that the protein took on a square sandwich shape. Our energy analysis using both MMPBSA and PMF analysis showed discrepancies, with scores of -8.45 kcal/mol and -1.95 kcal/mol, respectively. MMPBSA, however, obtained a similar score to that of a previous report.

The intrinsic non-linearity and complexity of suspended sediment dynamics, which are impacted by the geographical variability of basin parameters and temporal climatic patterns, make it difficult to estimate suspended sediment concentration (SSC) accurately in hydrological processes. Deep neural networks (DNNs), a cutting-edge modeling method that can capture the innate non-linearity in hydrological systems, have emerged as a solution to this problem. Using primary data on discharge, SSC, and turbidity, the long short-term memory method of DNNs was employed in this study to simulate the discharge-suspended sediment connection for the Esopus Creek, NY, USA as the first objective. To develop effective modeling strategies, multiple scenarios of feature selection, including combinations of discharge, turbidity and SSC for preceding days, were considered. Secondly, the variations in SSC and discharge between the three USGS gages along Esopus Creek that were upper stream, lower stream, and downstream, adjacent to the pourpoint were analyzed. Statistical metrics and scenarios of feature importance were used to evaluate the effectiveness of the DNN-based models. The study shows that among 24 DNN approaches feature selection is crucial in simulating the daily SSC, and discharge and presenting novel research directions for utilizing machine learning algorithms in water quality.

Activated sludge process is a well known method to treat municipal and industrial waste water. In this complex process, the oxygen concentration in the reactors plays a critical role in the plant efficiency. This paper proposes the use of a Long Short-Term Memory (LSTM) network to identify an input-output model suitable for the design of an oxygen concentration controller. The model is identified from easy-accessible measures collected from a real plant. This dataset covers almost a month. The performances achieved with the proposed LSTM model are compared with the ones obtained with a standard AutoRegressive model with eXogenous input (ARX). Both models catch the oscillation and the overall behaviour (ARX ρ=0.833 , LSTM ρ=0.921), but, while the ARX model fails in reaching the correct amplitude (FIT=41.20%), the LSTM presents satisfactory performance (FIT=60.56%).

Data-driven models based on artificial intelligence are efficiently used to solve complex problems. The quality of groundwater is of utmost importance, as it directly impacts human health and the environment. In major parts of the world groundwater is the main source of drinking water, it is essential to periodically monitor water quality. Conventional water quality monitoring techniques involve periodical collection of water samples and analysis in the laboratory. This process is expensive, time consuming and involves lot of manual labor. The aim of our study is to build an ant colony optimized neural network for predicting groundwater quality parameters. We have proposed artificial neural network comprising of six hidden layers. The approach was validated using our groundwater quality dataset of a hard rock region in the northern part of Karnataka, India. Groundwater samples were collected by us periodically from March 2014 to October 2020 from 50 wells in this region. These samples where analysed for measuring the pH, Electrical Conductivity, Na+, Ca+, Na+, K+, Mg2+, F-, Cl- and U+. The temporal dataset was split for training, testing and validation of our model. Metrics such as R2 (Coefficient of Determination), RMSE (Root Mean Squared Error), NSE (Nash–Sutcliffe efficiencies) and MAE (Mean Absolute Error) were used to evaluate the prediction error and model performance. These performance evaluation metrics indicated the efficiency of our model in predicting the temporal variation in groundwater quality parameters. The method proposed by us can be used for prediction and the temporal frequency of sample collection can be reduced to save time and cost. The results also confirm that the combination of artificial neural network with ACO is a promising tool to optimize weights while training the network, and hence will help in reasonable prediction of groundwater quality parameters.

Rice bran (RB) is a promising food ingredient that can improve biological function. In this study, we investigated the effects of RB, both unfermented (RB30) and fermented (RBF30) with five different microorganisms on the neurobehavioral activity in zebrafish larvae. Analytical methods such as UV spectrum and MS scan were performed. Interestingly, niacin content, which is known to improve brain functions such as cognition and emotion, was found to be higher in RBF30 than in RB30. Furthermore, niacin content was highly increased in the RBF30-exposed fish, compared to those in control fish. Therefore, we profiled behavioral patterns and various neurochemistry in zebrafish larvae following supplementation with RBF30 as well as performed calcium imaging on Tg (huC:GAL4-VP16);(UAS:GCaMP7a) zebrafish larvae to determine the correlation of neural activity. RBF30 revealed greater stimulation of locomotor activity without negatively affecting decision-making behavior in zebrafish larvae, as compared to RB30 or niacin. Its behavioral activation is mainly linked with the elevations of neural activity and several neurochemicals such as serotonergic and dopaminergic systems that are implicated in the control of anxiety and stress. Taken together, these results suggest that RBF30 could be a food material that improve the behavioral health by modulating neural activity and brain neurochemistry.

To drive safely, the driver must be aware of the surroundings, pay attention to the road traffic, and be ready to adapt to new circumstances. Most studies on driving safety focus on detecting anomalies in driver behavior and monitoring the cognitive capabilities of drivers. In our study, we proposed a classifier for basic activities in driving a car, based on a similar approach that could be applied to the recognition of basic activities in daily life, that is, using electrooculographic (EOG) signals and a one-dimensional convolutional neural network (1D CNN). Our classifier achieved an accuracy of 80% for the 16 primary and secondary activities. The accuracy related to primary activities in driving, including crossroad, parking, roundabout was 97.9%, 96.8%, 97.4%, and 99.5%, respectively. The F1 score for secondary driving actions (0.99) was higher than for primary driving activities (0.93–0.94). Furthermore, using the same algorithm, it was possible to distinguish four secondary activities related to activities of daily life and secondary when driving a car.

In the last decade, the genetic engineering world has been shaken up by a relatively new genetic editing tool based on RNA-guided Nucleases (RGNs): the CRISPR/Cas9 system. Since the first report in 1987 and its characterization in 2007 as a bacterial defense mechanism, the interest and research on this system have grown exponentially. CRISPR systems provide immunity to bacteria against invading genetic material; however, with specific modifications in sequence and structure, it becomes a precise editing system that makes it possible to genetically modify almost any organism. There are diverse approaches regarding the refinement of these modifications, such as constructing more accurate nucleases, understanding the cellular context and facing the epigenetic conditions, or re-designing guide RNAs (gRNAs). Considering the critical importance for the correct CRISPR/Cas9 systems performance, our scope will emphasize in the latter approach. Hence, we present an overview of the past and the most recent guide RNA web-based design tools, highlighting their computational architecture and gRNA characteristics evolution through the years. Our study concisely explains the computational approaches that use machine learning techniques, deep neural networks, and large datasets of gRNA/target interactions to make possible both predictions and classifications directed to design, optimize, and create promising gRNAs suitable for future gene therapies.

Cancer is a major concern for people, and accurately predicting the probability of cancer incidence and mortality is an important research topic. With the development of big data and artificial intelligence technology, a new machine learning model has emerged. Using 72,591 pieces of data, including age, case count, population size, race, gender, site of onset, and year of discovery, we built a machine learning model. Through calculations, we found that the decision tree, random forest, logistic regression, support vector machine, and neural network achieved testing accuracies of 62.11%, 61.68%, 54.53%, 55.72%, and 63.10%, respectively. With the help of this model, scientists and policymakers can accurately predict future cancer incidence and mortality rates through databases, allowing them to make relevant policies (such as timely allocating doctors and medical resources) to better serve the people.

In the realm of computer vision, semantic segmentation is the task of recognizing objects in images at the pixel level. This is done by performing a classification of each pixel. The task is complex and requires sophisticated skills and knowledge about the context to identify objects’ boundaries. The importance of semantic segmentation in many domains is undisputed. In medical diagnostics, it simplifies the early detection of pathologies, thus mitigating the possible consequences. In this work, we provide a review of the literature on deep ensemble learning models for polyp segmentation and we develop new ensembles based on convolutional neural networks and transformers. The development of an effective ensemble entails ensuring diversity between its components. To this end, we combine different models (HarDNet-MSEG, Polyp-PVT, and HSNet) trained with different data augmentation techniques, optimization methods, and learning rates, which we experimentally demonstrate to be useful to form a better ensemble. Most importantly, we introduce a new method to obtain the segmentation mask which is more suitable for combining transformers in an ensemble. In our extensive experimental evaluation, the proposed ensembles exhibit state-of-the-art performance.

Biochemical oxygen demand (BOD) is one of the most important factors to consider when evaluating water contamination. BOD5 is the amount of oxygen consumed in five days by microorganisms that oxidize biodegradable organic materials in an aerobic biochemical manner. The primary objective of this effort is to use microbial fuel cells (MFCs) to shorten the time required for BOD5 measurements. We created a regression artificial neural network (AI), and the predictions we obtained for BOD5 measurements were taken over 6 – 24 hours with an average error of just 7%. The outcomes demonstrated by our AI MFC/BES BOD5 sensor’s viability for use in real-world scenarios.

Objective: The aim of this study was to provide a new machine learning method to determine temporal events and inner-cycle parameters (e.g., cycle, poles and skis contact and swing time) in cross-country roller ski skating on the field, using a single deported inertial measurement unit (IMU). Methods: The developed method is based on long short-term memory neural networks to detect poles and skis initial and final contact with the ground during the cyclic movements. Eleven athletes skied four laps of 2.5 km at low and high intensity using skis with two different rolling coefficients. They were equipped with IMUs attached to the upper back, lower back and to the sternum. Data from force insoles and force poles were used as reference system. Results: The IMU placed on the upper back provided the best results, as the LSTM network was able to determine the temporal events with an accuracy ranging from 49 to 55 ms and the corresponding inner-cycles parameters were calculated with a precision of 63 to 68 ms. The method detected 95% of the events for the poles and 87% of the events for the skis. Conclusion: The proposed LSTM method provides a promising tool for assessing temporal events and inner-cycle phases in roller ski skating showing the potential of using a deported IMU to estimate different spatio-temporal parameters of human locomotion.

Although neural network architectures are critical for their performance, how the structural characteristics of a neural network affect its performance has still not been fully explored. We here map architectures of neural network to directed acyclic graphs, and find that incoherence, a structural characteristic to measure the order of directed acyclic graphs, is a good indicator for the performance of corresponding neural networks. Therefore we propose a deep isotropic neural network architecture by folding a chain of same blocks then connecting the blocks with skip connections at different distances. Our models, named FoldNet, have two distinguishing features compared with traditional residual neural netowrks. First, the distances between block pairs connected by skip connections increase from always equal to one to specially selected different values, which lead to more incoherent graphs and let the neural network explore larger receptive fields and thus enhance its multi-scale representation ability. Second, the number of direct paths increases from one to multiple, which leads to a larger proportion of shorter paths and thus improve the direct propagation of information throughout the entire network. Image classification results on CIFAR-10 and Tiny ImageNet benchmarks suggested that our new network architecture performs better than traditional residual neural networks.

Heme proteins serve diverse and pivotal biological functions. Therefore, clarifying the mechanisms of these diverse functions of heme is a crucial scientific topic. Distortion of heme porphyrin is one of the key factors regulating the chemical properties of heme. Here, we constructed convolutional neural network models for predicting heme distortion from the tertiary structure of the heme-binding pocket to examine their correlation. For saddling, ruffling, doming, and waving distortions, the experimental structure and predicted values were closely correlated. Furthermore, we assessed the correlation between the cavity shape and molecular structure of heme and demonstrated that hemes in protein pockets with similar structures exhibit near-identical structures, indicating the regulation of heme distortion through the protein environment. These findings indicate that the tertiary structure of the heme-binding pocket regulates the distortion of heme porphyrin, thereby controlling the chemical properties of heme relevant to the protein function; this implies a structure–function correlation in heme proteins.

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs have not yet achieved high output for their well-established two-dimensional (2D) equivalents in still photographs. Board 3D Convolutional Memory and Spatiotemporal fusion face training difficulty preventing 3D CNN from accomplishing remarkable evaluation. In this paper, we implement Hybrid Deep Learning Architecture that combines STIP and 3D CNN features to enhance the performance of 3D videos effectively. After implementation, the more detailed and deeper charting for training in each circle of space-time fusion. The training model further enhances the results after handling complicated evaluations of models. The video classification model is used in this implemented model. Intelligent 3D Network Protocol for Multimedia Data Classification using Deep Learning is introduced to further understand space-time association in human endeavors. In the implementation of the result, the well-known dataset, i.e., UCF101 to, evaluates the performance of the proposed hybrid technique. The results beat the proposed hybrid technique that substantially beats the initial 3D CNNs. The results are compared with state-of-the-art frameworks from literature for action recognition on UCF101 with an accuracy of 95%.

Imitation Learning is a discipline of Machine Learning primarily concerned with replicating observed behavior of agents known to perform well on a given task, collected in demonstration data sets. In this paper, we set out to introduce a pipeline for collecting demonstrations and training models that can produce motion plans for industrial robots. Object throwing is defined as the motivating use case. Multiple input data modalities are surveyed, and motion capture is selected as the most practicable. Two model architectures operating autoregressively are examined -- feedforward and recurrent neural networks. Trained models execute throws on a real robot successfully, and a battery of quantitative evaluation metrics is proposed, including extrapolated throw accuracy estimates. Recurrent neural networks outperform feedforward ones in most respects, with the best models having an assessed mean throw error on the order of 0.1...0.2 m at distances of 1.5...2.0 m. The data collection, pre-processing, and model training aspects of our proposed approach show promise, but further work is required in developing Cartesian motion planning tools before it is suitable for application in production.

Objective A trained T1 class Convolutional Neural Network (CNN) model will be used to examine its ability to successfully identify motor imagery when fed pre-processed electroencephalography (EEG) data. In theory, and if the model has been trained accurately, it should be able to identify a class and label it accordingly. The CNN model will then be restored and used to try and identify the same class of motor imagery data using much smaller sampled data in an attempt to simulate live data. Approach PyCharm, a Python platform, will be used to house and process the CNN. The raw data used for the training of the CNN will be sourced from the PhysioBank website. The EEG signal data will then be pre-processed using Brainstorm software that is a toolbox used in conjunction with MATLAB. The sample data used to validate and test the trained CNN, will be also be extracted from Brainstorm but in a much smaller size compared to the training data which is comprised of thousands of images. The sample size would be comparable to a person wearing a Brain Computer Interface (BCI), offering approximately 20 seconds of motor imagery signal data. Results The raw EEG data was successfully extracted and pre-processed. The deep learning model was trained using the extracted image data along with their corresponding labels. After training, it was able to accurately identify the T1 class label at 100 percent. The python coding was then modified to restore the trained model and feed it test sample data in which it was found to recognise 6 out of 10 lines of T1 signal image data. The result suggested that the initial training of the model required a different, more varying approach, so that it would be able to detect varying sample signal image data. The outcome of which could mean that the model could be used in applications for multiple patients wearing the same BCI hardware to control a device or interface.

The choice of holiday destinations is highly depended on climate considerations. Nowadays, since the effects of climate crisis are being increasingly felt, the need of accurate weather and climate services for hotels is crucial. Such a service could be beneficial for both the future planning of tourists’ activities and destinations and for hotel managers as it could help in decision making about the planning and expansion of the touristic season, due to a prediction of higher temperatures for a longer time span, thus causing increased revenue for companies in the local touristic sector. The aim of this work is to calculate predictions on climatic variables using statistical techniques as well as Artificial Intelligence (AI) for a specific area of interest utilising data from in situ meteorological station, and produce valuable and reliable localised predictions with the most cost-effective method possible. This investigation will answer the question of the most suitable prediction method for time series data from a single meteorological station that is deployed in a specific location. As a result, an accurate representation of the microclimate in a specific are is achieved. To achieve this high accuracy in situ measurements and prediction techniques are used. As prediction techniques, Seasonal Auto Regressive Integrated Moving Average (SARIMA), AI techniques like the Long-Short-Term-Memory (LSTM) Neural Network and hybrid combinations of the two are used. Variables of interest are divided in the easier to predict temperature and humidity that are more periodic and less chaotic, and the wind speed as an example of a more stochastic variable with no known seasonality and patterns. Our results show that the examined Hybrid methodology performs the best at temperature and wind speed forecasts, closely followed by the SARIMA whereas LSTM perform better overall at the humidity forecast, even after the correction of the Hybrid to the SARIMA model.

Stripe rust ​​(caused by Puccinia striiformis f. sp. tritici) is one of the most devastating diseases of wheat and causes large-scale epidemics and severe yield loss. Applying fungicides during early epidemic development is crucial to controlling the disease but is often challenged by resource-limited human visual scouting. Deep learning has the potential to process images and videos captured from affordable devices to empower high-throughput phenotyping for early detection of stripe rust for timely application of fungicides and improve control efficiency. Here, we developed RustNet, a neural network-based image classifier, for efficiently monitoring fields for stripe rust. RustNet was built on a ResNet-18 architecture pre-trained with ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) dataset using transfer learning. RGB images and videos of multiple wheat fields with different wheat types (winter and spring wheat), conditions (irrigated and non-irrigated), and locations were acquired using smartphones or unmanned aerial vehicles near the canopy. A semi-automated image labeling approach was conducted to improve labeling efficiency by combining automated machine labeling and human correction. Cross-validations across multiple categories (sensor platforms, wheat types, and locations) achieved Area Under Curve from 0.72 to 0.87. Independent validation on a published dataset from Germany achieved accuracies ranging from 0.79 to 0.86. The visualization of the last convolutional layer of RustNet demonstrated the identification of pixels with stripe rust. RustNet is freely available at https://zzlab.net/RustNet.

This article presents new PEM fuel cell models with hexagonal and pentagonal designs. After observing cell performance improvement in these models, we optimized them. Inlet pressure and temperature were used as input parameters, and consumption and output power were the target parameters of the multi-objective optimization algorithm. Then we used artificial intelligence techniques, including deep neural networks and polynomial regression, to model the data. Next, we employed the RSM (Response Surface Method) method to derive the target functions. Furthermore, we applied the NSGA-II multi-objective genetic algorithm to optimize the targets. Compared to the base model (Cubic), the optimized Pentagonal and Hexagonal models averagely increase the output current density by 21.819\% and 39.931\%, respectively.

Recent progress in microfabrication technique allowed the rapid development of neural implants. They are getting categorized as effective tools for clinical practice, especially to treat traumatic and neurodegenerative disorders. Microelectrode arrays already have been used in numerous neural interface devices. Basically, almost all neural implants have been developed based on BCI (Brain Computer Interface) system. When BCI system falls under invasive technique, it is referred as BMI or Brain Machine Interface. BMIs hold promises for neurorehabilitation of motor and sensory function, cognitive state evaluation and treatment of neurological chaos. A directed overview of the field of neural implants is discussed in this article. The aim of this review is to give a brief introduction of neural prosthetics as well as their exciting applications in treating neurological disorders and a deep discussion on their functionality are mentioned. BCI system and their different types, their functionality, their pros and cons, how other neural implants developed, and their present status have been covered. Different possibilities and possible future of deep brain stimulation (DBS), Neuralink, motor and sensory neural prosthetics are further discussed.

A convolutional neural network (CNN) is sometimes understood as a black box in the sense that while it can approximate any function, studying its structure will not give us any insights into the nature of the function being approximated. In other terms, the discriminative ability does not reveal much about the latent representation of a network. This research aims to establish a framework for interpreting the CNNs by profiling them in terms of interpretable visual concepts and verifying them by means of Integrated Gradient. We also ask the question, "Do different input classes have a relationship or are they unrelated?" For instance, could there be an overlapping set of highly active neurons to identify different classes? Could there be a set of neurons that are useful for one input class whereas misleading for a different one? Intuition answers these questions positively, implying the existence of a structured set of neurons inclined to a particular class. Knowing this structure has significant values; it provides a principled way for identifying redundancies across the classes. Here the interpretability profiling has been done by evaluating the correspondence between individual hidden neurons and a set of human-understandable visual semantic concepts. We also propose an integrated gradient-based class-specific relevance mapping approach that takes the spatial position of the region of interest in the input image. Our relevance score verifies the interpretability scores in terms of neurons tuned to a particular concept/class. Further, we perform network ablation and measure the performance of the network based on our approach.

Direct interaction with the neuronal cells is a prerequisite to deciphering useful information in understanding the underlying causes of diseases and functional abnormalities in the brain. Precisely fabricated nanoelectrodes provide the capability to interact with the brain in its natural habitat without compromising its functional integrity. Considerable research has been focused on the employment of vertical nanotubes as nanoelectrodes due to large-scale intracellular recording capability and longer-term intracellular access that arise from their unique geometry. Despite many types of nanotube structures reported in the literature, a limited subset of the nanotubes has been investigated for neural interfacing. This work reports on the fabrication and optimisation of vertically oriented titania nanotube arrays as a scalable electrode platform for neural interface application. To this end, the doping was performed by incorporating a selected group of biologically active metallic ions, including zinc, strontium, and copper, into TiO2 lattice and its effect was studied with respect to the structural, electrochemical and biological properties of the nanotube arrays. It was found that doping can change the length, diameter and wall thickness of the nanotubes. Among pure and doped samples, the copper-doped TiO2 nanotubes demonstrated the highest electrochemical and biological performance. Our results suggest that the doping can be used as a promising method to optimise the properties of nanotube arrays for the development of high-performance neural electrodes.

The use of convolutional neural networks (CNNs) in image classification has become the standard method of approaching computer vision problems. Here we apply pre-trained networks to classify images of non-breaking, plunging and spilling breaking waves. The CNNs are used as basic feature extractors and a classifier is then trained on top of these networks. The dynamic nature of breaking waves is exploited by using image sequences to gain extra information and improve the classification results. We also see improved classification performance in using pre-computed image features such as the optical flow between image pairs. The inclusion of the dynamic information improves the classification between breaking wave classes. We also provide corrections to the methodology from the article from which the data originates to achieve a more accurate assessment of performance.

How does the world around us work and what is real? This question has preoccupied humanity since its beginnings. From the 16th century onwards, it has been periodically necessary to revise the prevailing worldview. But things became very strange at the beginning of the 20th century with the advent of relativity theory and quantum physics. The current focus is on the role of information, there being a debate about whether this is ontological or epistemological. A theory has recently been formulated in which spacetime and gravity emerges from microscopic quantum information, more specifically from quantum entanglement via entanglement entropy. A latest theory describes the emergence of reality itself through first-person perspective experiences and algorithmic information theory. In quantum physics, perception and observation play a central role. Perception, interaction with the environment, requires an exchange of information. Via biochemical projection, information is given an interpretation that is necessary to make life and consciousness possible. The world around us is not at all what it seems.

Capability assessment plays a crucial role in the demonstration and construction of equipment. To improve the accuracy and stability of capability assessment, we study the neural network learning algorithms in the field of capability assessment and index sensitivity. Aiming at the problem of over-fitting and parameter optimization in neural network learning, the paper proposes an improved machine learning algorithm—the Ensemble Learning Based on Policy Optimization Neural Networks (ELPONN) algorithm with the policy optimization and ensemble learning. This algorithm presents optimized neural network learning algorithm through different strategies evolution, and builds an ensemble learning model of multi-intelligent algorithms to assessment the capability and analyze the sensitivity of the indexes. Through the assessment of capabilities, the algorithm effectively avoids parameter optimization from entering the minimum point in performance to improve the accuracy of equipment capability assessment, which is significantly better than previous neural network assessment methods. The experimental results show that the mean relative error is 4.10%, which is better than BP, GABP, and early stopping. The ELPONN algorithm has better accuracy and stability performance, and meets the requirements of capability assessment.

In this article, the evolution in space and in time of the coronavirus pandemic is studied by utilizing a neural network with a self-organizing nature for the spatial analysis of data, and a fuzzy fractal method for capturing the temporal trends of the time series of the countries. Self-organizing neural networks possess the capability for clustering countries in the space domain based on their similar characteristics with respect to their coronavirus cases. In this form enabling finding the countries that are having similar behavior and thus can benefit from utilizing the same methods in fighting the virus propagation. To validate the approach, publicly available datasets of coronavirus cases worldwide have been used. In addition, a fuzzy fractal approach is utilized for the temporal analysis of time series of the countries. Then, a hybrid combination of both the self-organizing maps and the fuzzy fractal approach is proposed for efficient COVID-19 forecasting of the countries. Relevant conclusions have emerged from this study, that may be of great help in putting forward the best possible strategies in fighting the virus pandemic. A lot of the existing works concerned with the Coronavirus have look at the problem mostly from the temporal viewpoint that is of course relevant, but we strongly believe that the combination of both aspects of the problem is relevant to improve the forecasting ability. The most relevant contribution of this article is the proposal of combining neural networks with a self-organizing nature for clustering countries with high similarity and the fuzzy fractal approach for being able to forecast the times series and help in planning control actions for the Coronavirus pandemic.

In this paper, the Group Method of Data Handling (GMDH) type of neural networks is used for the inductance calculation of variable inductors. The relation between the inductance of the inductor in the linear and nonlinear regions is investigated, and parameters such as the voltage across the inductor, bias current, and ac current are taken into account. The experimental setup is used for generating the data needed for training the neural network. Over 800 experiments were conducted and were used for training and validation of the neural network results. The results are compared with the reluctance equivalent circuit method, and they show a much better accuracy. The proposed method can be used for the calculation of various magnetic components, and it is not limited to variable inductors.

Neural precursors (NPs) present in the hippocampus can be modulated by several neurogenic stimuli including environmental enrichment (EE) and antidepressant treatment acting through BDNF-TrkB signaling. We have recently identified NPs in meninges, however menigneal niche response to pro-neurogenic stimuli has never been investigated. To this aim, we analyzed the effects of 4 weeks fluoxetine administration or 1 week EE treatment on NP distribution in mouse brain meninges. Following neurogenic stimuli, although we did not detect modification of meningeal cell number and proliferation, we observed, in meninges, an increased number of β3-Tubulin⁺ immature neuronal cells. Lineage-tracing experiment confirmed that EE-induced β3-Tubulin⁺ immature neuronal cells present in meninges originated from GLAST⁺ radial glia cells. To investigate the molecular mechanism responsible for this response, we studied the BDNF-TrkB interaction. Treatment with ANA-12, a TrkB non-competitive inhibitor, abolished the EE-induced increase of β3-Tubulin⁺ immature neuronal cells in meninges.Overall these data showed, for the first time, that the meningeal niche responded to neurogenic stimuli by increasing the immature neuronal population through TrkB-mediated signaling. A better understanding of the neurogenic stimuli effects on NPs in meninges may be useful to improve the effectiveness of depression and mood disorders treatments.

In this paper, we propose methods for brain tumor detection in MRI images based on ensemble learning. We build upon prior research on ensemble methods by testing the concatenation of pre-trained models: features extracted via transfer learning are merged and segmented by classification algorithms or a stacked ensemble of those algorithms. The proposed approach achieved accuracy scores of 0.98 , outperforming a benchmark VGG-16 model. Considerations to granular computing are given in the paper as well.

This work aims to contribute to better understanding the use of public street spaces. (1) Background: In this sense, with a multidisciplinary approach, the objective of this work is to propose an experimental and reproducible method on a large scale. (2) Study area: The applied methodology uses artificial intelligence to analyze Google Street View (GSV) images at street level. (3) Method: The purpose is to validate a methodology that allows to characterize and quantify the use (pedestrians and cars) of some squares in Rome belonging to different historical periods. (4) Results: Through the use of machine vision techniques, typical of artificial intelligence and which use convolutional neural networks, a historical reading of some selected squares is proposed with the aim of interpreting the dynamics of use and identifying some critical issues in progress. (5) Conclusions: This work validated the usefulness of a method applied to the use of artificial intelligence for the analysis of GSV images at street level.

Lignocellulosic fibers are widely applied as composite reinforcement due to their properties. The thermal degradation behavior determines the maximum temperature in which the fiber can be applied without significant mass loss. It is possible to determine these temperatures using Thermogravimetric Analysis (TG). In particular, when curves are obtained at different heating rates, kinetic parameters can be determined and more detailed characteristics of the material are obtained. However, every curve obtained at a distinct heating rate demands material, cost, and time. Methods to predict thermogravimetric curves can be very useful in the materials science field and in this sense mathematical approaches are powerful tools if well employed. For this reason, in the present study, curaua TG curves were obtained at three different heating rates (5, 10, 20, and 40 °C.min-1) and Vyazovkin kinetic parameters were obtained. After, the experimental curves were fitted using an artificial neural network (ANN) approach followed by a Surface Response Methodology (SRM). Curves at any heating rate between the minimum and maximum experimental heating rates were obtained with high reliability. Finally, Vyazovkin kinetic parameters were tested again with the new curves showing similar kinetic parameters from the experimental ones. In conclusion, due to the capability to learn from the own data, ANN combined with SRM seems to be an excellent alternative to predict TG curves that do not test experimentally, opening the range of applications.

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a reference signal of different magnitude, or under system parameter change. Such properties make the DL control more attractive for applications that may undergo parameter variation, like sensor networks.

As a system becomes more complex, at first, its description and analysis becomes more complicated. However, a further increase in the system’s complexity often makes this analysis simpler. A classical example is Central Limit Theorem: when we have a few independent sources of uncertainty, the resulting uncertainty is very difficult to describe, but as the number of such sources increases, the resulting distribution get close to an easy-to-analyze normal one – and indeed, normal distributions are ubiquitous. We show that such limit theorems make analysis of complex systems easier – i.e., lead to blessing of dimensionality phenomenon – for all the aspects of these systems: the corresponding transformation, the system’s uncertainty, and the desired result of the system’s analysis.

The diagnosis of papillary thyroid carcinoma has always been a concerned and challenging issue and it is very important and meaningful to have a definite diagnosis before the operation. In this study, we tried to use an artificial intelligence algorithm instead of medical statistics to analyze the genetic fingerprint from gene chip results to identify papillary thyroid carcinoma. We trained 20 artificial neural network models with differential genes and other important genes related to the cell metabolic cycle as the list of input features, and apply them to the diagnosis of papillary thyroid cancer in the independent validation data set. The results showed that when we used the DEGs and all genes lists as input features the models got the best diagnostic performance with AUC=98.97% and 99.37% and the accuracy were both 96%. This study revealed that the proposed artificial neural network models constructed with genetic fingerprints could achieve a prediction of papillary thyroid carcinoma. Such models can support clinicians to make more accurate clinical diagnoses. At the same time, it provides a novel idea for the application of artificial intelligence in clinical medicine.

Conventionally, partial differential equations (PDE) problems are solved numerically through discretization process by using finite difference approximations. The algebraic systems generated by this process are then finalized by using an iterative method. Recently, scientists invented a short cut approach, without discretization process, to solve the PDE problems, namely by using machine learning (ML). This is potential to make scientific machine learning as a new sub-field of research. Thus, given the interest in developing ML for solving PDEs, it makes an abundance of an easy-to-use methods that allows researchers to quickly set up and solve problems. In this review paper, we discussed at least three methods for solving high dimensional of PDEs, namely PyDEns, NeuroDiffEq, and Nangs, which are all based on artificial neural networks (ANNs). ANN is one of the methods under ML which proven to be a universal estimator function. Comparison of numerical results presented in solving the classical PDEs such as heat, wave, and Poisson equations, to look at the accuracy and efficiency of the methods. The results showed that the NeuroDiffEq and Nangs algorithms performed better to solve higher dimensional of PDEs than the PyDEns.

Recent neuroscience research results show that the nerve information in the brain is not only encoded by the spatial information. Spiking neural network based on pulse frequency coding plays a very important role in dealing with the problem of brain signal, especially complicated space-time information. In this paper, an unsupervised learning algorithm for bilayer feedforward spiking neural networks based on spike-timing dependent plasticity (STDP) competitiveness is proposed and applied to SAR image classification on MSTAR for the first time. The SNN learns autonomously from the input value without any labeled signal and the overall classification accuracy of SAR targets reached 80.8%. The experimental results show that the algorithm adopts the synaptic neurons and network structure with stronger biological rationality, and has the ability to classify targets on SAR image. Meanwhile, the feature map extraction ability of neurons is visualized by the generative property of SNN, which is a beneficial attempt to apply the brain-like neural network into SAR image interpretation.

Regarding the high efficiency of metaheuristic techniques in energy performance analysis, this paper scrutinizes and compares five novel optimizers, namely biogeography-based optimization (BBO), invasive weed optimization (IWO), social spider algorithm (SOSA), shuffled frog leaping algorithm (SFLA), and harmony search algorithm (HSA) for the early prediction of cooling load in residential buildings. The algorithms are coupled with a multi-layer perceptron (MLP) to adjust the neural parameters that connect the CL with the influential factors. The complexity of the models is optimized by means of a trial-and-error effort, and it was shown that the BBO and IWO need more crowded spaces for fulfilling the optimization. The results revealed that the internal parameters (i.e., biases and weights) suggested by the BBO generate the most reliable MLP for both analyzing and generalizing the CL pattern (with nearly 93 and 92% correlations, respectively). Followed by this, the IWO emerged as the second powerful optimizer with mean absolute errors of 1.8632 and 1.9110 in the training and testing phases. Therefore, the BBO-MLP and IWO-MLP can be reliably used for accurate analysis of the CL in future projects.

The adoption of Machine Learning (ML) for building emulators for complex physical processes has seen an exponential rise in the recent years. While neural networks are good function approximators, optimizing the hyper-parameters of the network to reach a global minimum is not trivial, and often needs human knowl- edge and expertise. In this light, automatic ML or autoML methods have gained large interest as they automate the process of network hyper-parameter tuning. In addition, Neural Architecture Search (NAS) has shown promising outcomes for improving model performance. While autoML methods have grown in popularity for image, text and other applications, their effectiveness for high-dimensional, complex scientific datasets remains to be investigated. In this work, a data driven emulator for turbulence closure terms in the context of Large Eddy Simulation (LES) models is trained using Artificial Neural Networks and an autoML frame- work based on Bayesian Optimization, incorporating priors to jointly optimize the hyper-parameters as well as conduct a full neural network architecture search to converge to a global minima, is proposed. Additionally, we compare the effect of using different network weight initializations and optimizers such as ADAM, SGDM and RMSProp, to explore the best performing setting. Weight and function space similarities during the optimization trajectory are investigated, and critical differences in the learning process evolution are noted and compared to theory. We observe ADAM optimizer and Glorot initialization consistently performs better, while RMSProp outperforms SGDM as the latter appears to have been stuck at a local minima. Therefore, this autoML BayesOpt framework provides a means to choose the best hyper-parameter settings for a given dataset.

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

The principal minimum horizontal stress plays an important role in the study of reservoir characteristics, modeling of oil and gas reservoir, drilling, production and stimulating wells. However, it is currently not possible to measure the minimum horizontal stress along the wellbore as a geophysical parameter logging. Minimum horizontal stress is measured by leak-off test (LOT) at only several points in a well. In order to have the values all along the wellbore, experimental formulas were established to determine the minimum horizontal stresses for different fields. Then these formulas must be calibrated with LOT data whose number is usually limited, even sometimes unavailable. On the other hand, the empirical formulas of one field might not be accurate for another. This study presents a new approach to solve the problem of minimum horizontal stress estimation by a combination of artificial intelligence and geostatistics. The method consists of using artificial neural network (ANN) to build a model of minimum horizontal stress estimation from relevant parameters such as true vertical depth, pore pressure and vertical stress, then combined with Kriging interpolation to obtain the distribution in space of the minimum horizontal stress. Hence, this method can estimate the minimum horizontal stress with a limited amount of available data and therefore we do not need to drill new wells or to find empirical formulas for each survey area. The method was then applied in a case study involved real geomechanical dataset of Hai Thach - Moc Tinh field in Nam Con Son basin, Vietnam.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

Motivated by the way animals react in nature, we introduce a fully-connected neural-network model, which incorporates the external pattern presented to the system as a fundamental tool of the recognition process. In this new scenario, in the absence of this external field, memories are not attractors inside basins of attraction, as in usual attractor neural networks, although basins may be created according to the external pattern, thus allowing storing a much larger number of memories. The key point consists in calibrating the influence of the external pattern such as to cancel the noise generated by those memories not correlated with the external pattern.We illustrate how this proposal works by including this new contribution in the standard Hopfield model, showing a significant increase in its recognition capacity (typically by a factor $10^{2}$). As an additional feature of this model, we show its ability to react promptly to changes in the external environment, a crucial attribute of living beings. This procedure can be applied to a wide variety of neural-network models to increase considerably their recognition and reaction capabilities.

State-of-the-art remote sensing scene classification methods employ different Convolutional Neural Network architectures for achieving very high classification performance. A trait shared by the majority of these methods is that the class associated with each example is ascertained by examining the activations of the last fully connected layer, and the networks are trained to minimize the cross-entropy between predictions extracted from this layer and ground-truth annotations. In this work, we extend this paradigm by introducing an additional output branch which maps the inputs to low dimensional representations, effectively extracting additional feature representations of the inputs. The proposed model imposes additional distance constrains on these representations with respect to identified class representatives, in addition to the traditional categorical cross-entropy between predictions and ground-truth. By extending the typical cross-entropy loss function with a distance learning function, our proposed approach achieves significant gains across a wide set of benchmark datasets in terms of classification, while providing additional evidence related to class membership and classification confidence.

The traditional standards employed for pain assessment have many limitations. One such limitation is reliability because of inter-observer variability. Therefore, there have been many approaches to automate the task of pain recognition. Recently, deep-learning methods have appeared to solve many challenges, such as feature selection and cases with a small number of data sets. This study provides a systematic review of pain-recognition systems that are based on deep-learning models for the last two years only. Furthermore, it presents the major deep-learning methods that were used in review papers. Finally, it provides a discussion of the challenges and open issues.

One of the biggest queries in cognitive sciences is the emergence of consciousness from matter. Modern neurobiological theories of consciousness propose that conscious experience is the result of interactions between large-scale neuronal networks in the brain, traditionally described within the realm of classical physics. Here, we propose a generalized connectionist framework in which the emergence of “conscious networks” is not exclusive of large brain areas, but can be identified in sub-cellular networks exhibiting non-trivial quantum phenomena. The essential feature of such networks is the existence of strong correlations in the system (classical or quantum coherence) and the presence of an optimal point at which the system’s complexity is maximized, expressed either by maximization of the information content in large scale functional networks or by achieving optimal efficiency through the quantum Goldilock effect.

Significant progress has made in pattern recognition technology. However, one obstacle that has not yet overcome is the recognition of words in the Brahmi script, specifically the identification of characters, compound characters, and word. This study proposes the use of the deep convolutional neural network with dropout to recognize the Brahmi words. This study also proposed a DCNN for Brahmi word recognition and a series of experiments are performed on standard Brahmi dataset. The practical operation of this method was systematically tested on accessible Brahmi image database, achieving 92.47% recognition rate by CNN with dropout respectively which is among the best while comparing with the ones reported in the literature for the same task.

In this paper we address the understanding of the problem, of why a deep learning model decides that an individual is eligible for a loan or not. Here we propose a novel approach for inferring, which attributes matter the most, for making a decision in each specific individual case. Specifically we leverage concepts from neural attention to devise a novel feature wise attention mechanism. As we show, using real world datasets, our approach offers unique insights into the importance of various features, by producing a decision explanation for each specific loan case. At the same time, we observe that our novel mechanism, generates decisions which are much closer to the decisions generated by human experts, compared to the existent competitors.

With the fast development of the mobile Internet, the online platforms of social networks have rapidly been developing for the purpose of making friends, sharing information, etc. In these online platforms, users being related to each other forms social networks. Literature reviews have shown that social networks have community structure. Through the studies of community structure, the characteristics and functions of networks structure and the dynamical evolution mechanism of networks can be used for predicting user behaviours and controlling information dissemination. Therefore, this study proposes a deep community detection method which includes (1) matrix reconstruction method, (2) spatial feature extraction method and (3) community detection method. The original adjacency matrix in social network is reconstructed based on the opinion leader and nearer neighbors for obtaining spatial proximity matrix. The spatial eigenvector of reconstructed adjacency matrix can be extracted by an auto-encoder based on convolution neural network for the improvement of modularity. In experiments, four open datasets of practical social networks were selected to evaluate the proposed method, and the experimental results show that the proposed deep community detection method obtained higher modularity than other methods. Therefore, the proposed deep community detection method can effectively detect high quality communities in social networks.

Fusarium head blight (FHB) disease is extensively distributed worldwide. This disease damages grain quality and reduces yield. The detection of this disease in a high throughput way is crucial to planters and breeders. Our study focused on developing a method for processing wheat color images and accurately detecting disease areas using deep learning and image processing techniques. The color images of wheat at the milky stage were collected and processed to construct datasets, which were used to retrain a deep convolutional neural network model using transfer learning. Testing results showed that the model can detect spikes, and the coefficient of determination of the number of spikes between the manual count and the detection was 0.80. The model was assessed, and the mean average precision for the testing dataset was 0.9201. On the basis of the results of spike detection, a new color feature was applied to obtain the gray image of each spike. Then, a modified region growing algorithm was implemented to segment and detect the diseased areas of each spike. Results show that the region growing algorithm performs better than K-means and Otsu’s method in segmenting the FHB disease. Overall, this study demonstrates that deep learning techniques enable the accurate detection of FHB in wheat using color images, and the proposed method can effectively detect spikes and diseased areas, thereby improving the efficiency of FHB detection.

The Sentinel-2 satellite mission offers high resolution multispectral time series image data, enabling the production of detailed land cover maps globally. At this scale, the trade-off between processing time and result quality is a central design decision. Currently, this machine learning task is usually performed using pixelwise classification methods. The radical shift of the computer vision field away from hand engineered image features and towards more automation by representation learning comes with many promises, including higher quality results and less engineering effort. In this paper we assess fully convolutional neural networks architectures as replacements for a Random Forest classifier in an operational context for the production of high resolution land cover maps with Sentinel-2 time series at the country scale. Our contributions include a framework for working with Sentinel-2 L2A time series image data, an adaptation of the U-Net model for dealing with sparse annotation data while maintaining high resolution output, and an analysis of those results in the context of operational production of land cover maps.

From single-cell organisms to complex neural networks, all evolved to provide control solutions to generate context and goal-specific actions. Neural circuits performing sensorimotor computation to drive navigation employ inhibitory control as a gating mechanism, as they hierarchically transform (multi)sensory information into motor actions. Here, we focus on this literature to critically discuss the proposition that prominent inhibitory projections form sensorimotor circuits. After reviewing the neural circuits of navigation across various invertebrate species, we argue that with increased neural circuit complexity and the emergence of parallel computations inhibitory circuits acquire new functions. The contribution of inhibitory neurotransmission for navigation goes beyond shaping the communication that drives motor neurons, instead, include encoding of emergent sensorimotor representations. A mechanistic understanding of the neural circuits performing sensorimotor computations in invertebrates will unravel the minimum circuit requirements driving adaptive navigation.

Increase in the emission of Greenhouse Gases (GHS) is among the significant concerns of government, societies, and policymakers. Due to the highest share of carbon dioxide in the produced GHGs, it is necessary to assess the factors that influence its emission. Energy systems and economic activities noticeably influence the amount of carbon dioxide production of countries. In this article, Artificial Neural Network (ANN) in addition to a linear correlation used to predict carbon dioxide emission of four CIS countries, including Turkmenistan, Uzbekistan, Kazakhstan, and Azerbaijan based the consumption of various energy sources and GDP, as the economic indicator. According to the obtained data by the proposed models, carbon dioxide emission can be accurately estimated by utilizing the mentioned input data. Models’ R-squared value are 0.9997 and 0.9999 in the cases of applying the correlation and ANN-based model. Moreover, the average absolute relative deviations by utilizing the correlation and GMDH ANN are approximately 1.05% and 0.61%, respectively. These statistical values demonstrate more proper performance of the ANN-based model compared with the applied linear correlation.

An appearance model plays a crucial rule in multi-target tracking. In traditional approaches, the two steps of appearance modeling i.e visual representation and statistically similarity measure are modeled separately. Visual representation is achieved either through hand-crafted features or deep features and statically similarity is measure through a cross entropy loss function. A loss function based on cross-entropy (KL-divergence, mutual information) find closely related probability distribution for the targets. However, if the targets have similar visual representation, it ends up mixing the targets. To tackle this problem, we come up with a synergetic appearance model named Single Shot Appearance Model based on Siamese neural network. The network is trained with a contrastive loss function for finding the similarity between different targets in a single shot. The input to the network is two target patches and based on their similarity, a contrastive score is output by the network. The proposed model is evaluated on accumulative dissimilarity metric on three datasets. Quantitatively, promising results are achieved against three baseline methods.

Buildings have started to play a critical role in the stability and resilience of modern smart grids, leading to a refocusing of large scale energy management strategies from the supply side to the consumer side. When the buildings integrate local renewable energy generation in the form of renewable energy resources they become prosumers and this reflects into additional complexity into the operation of the interconnected complex energy systems. A class of methods of modelling the energy consumption patterns of the building have recently emerged as black-box input-output approaches with the ability to capture underlying consumption trends. These make use and require large quantities of quality data produces by non-deterministic processes underlying the energy consumption. We present an application of a class of neural networks, namely deep learning techniques for time series sequence modelling with the goal of accurate and reliable building energy load forecasting. The Recurrent Neural Network implementation uses Long Short-Term Memory layers in increasing density of nodes to quantify prediction accuracy. The case study is illustrated on four university buildings from temperate climates over one year of operation using a reference benchmarking dataset that allows replicable results. The obtained results are discussed in terms of accuracy metrics and computational and network architecture aspects and are considered suitable for further used in future in situ energy management at the building and neighbourhood levels.

The objective of this article was to forecast the ultimate failure load laminate stacking sequence combination on bonding joints which are exposed to tensile strength by using artificial neural networks. We have glass fiber composite materials with three different sequence combinations ([0°/90°], [±45°], [0°/90°/±45°]). Various adherend thicknesses and also ductile type adhesive was used in the experiment. The bonding geometry is a single lap and has four types of overlap angles 30°, 45°, 60°, 75° respectively. The experimental results demonstrate that composite laminate stacking sequence profoundly affects the bonding joints of failure load. Taking experimental results into account, Levenberg–Marquardt learning algorithm model was used by preferring a three layer forward on ANN so as to discipline network. In order to procure a precise ANN tool, an integrate methodology of experimental method has been used. The outcomes are used to ensure the experimental data’s to the ANN. The method of ANN permits surveying much adequately the probabilities of composite laminate stacking sequence combination using the prevalent ones which are [0°/90°], [±45°] and [0°/90°/±45°]. Testing data and training results were quite well 0.998, 0.997 and 0.998 in turn. Consequences acquired can be used by engineers who are interested in the composite material design to enhance failure load.

We propose a deep-learning approach for the joint MIMO detection and channel decoding problem. Conventional MIMO receivers adopt a model-based approach for MIMO detection and channel decoding in linear or iterative manners. However, due to the complex MIMO signal model, the optimal solution to the joint MIMO detection and channel decoding problem (i.e., the maximum likelihood decoding of the transmitted codewords from the received MIMO signals) is computationally infeasible. As a practical measure, the current model-based MIMO receivers all use suboptimal MIMO decoding methods with affordable computational complexities. This work applies the latest advances in deep learning for the design of MIMO receivers. In particular, we leverage deep neural networks (DNN) with supervised training to solve the joint MIMO detection and channel decoding problem. We show that DNN can be trained to give much better decoding performance than conventional MIMO receivers do. Our simulations show that a DNN implementation consisting of seven hidden layers can outperform conventional model-based linear or iterative receivers. This performance improvement points to a new direction for future MIMO receiver design.

Background: In spinal cord injury, radical treatment is still a persistent hope for patients and clinicians. Our study aimed to determine the different histological changes in central, cranial and caudal sites of compressed spinal cord as a result of neuroectodermal stem cells (NESCs) transplantation in rats. Material and methods: For extraction of NESCs, future brains were extracted from mice embryos (10-days old) and cultured. Eighty, male rats were divided randomly into control, sham (20 rats each); while 40 rats were subjected to compressed spinal cord injury (CSCI). Seven days after spinal cord injury, rats were subdivided into 2 groups (20 rats each); an untreated and treated with NESCs injected cranial and caudal to the site of the spinal cord injury. Rats were sacrificed 4 weeks after transplantations of NESCs and specimens from the spinal cord at the central, cranial and caudal to site of spinal cord injury were proceeded to be stained with haematoxylin & eosin, osmic acid and Immunohistochemistry of glial fibrillary acidic protein (GFAP). Results: Sections of CSCI revealed areas of hemorrhages, necrosis and cavitation limited by reactive astrocytosis, with upregulation of GFAP expression. Evidence of remyelination and mitigation of histopathological features, reactive astrocytosis in CSCI sections were more pronounced in cranial than in caudal region. Conclusions: NESCs transplantation ameliorated the pathological changes, promoted remyelination.

We consider a random dynamical system arising in a model of associative memory. This system can be seen as a small (stochastic and deterministic) perturbation of a determinstic system having two weak attractors which are destroyed after the perturbation. We show, with a computer aided proof, that the system has a kind of chaotic itineracy. Typical orbits are globally chaotic, while they spend relatively long time visiting attractor's ruins.

Neural microprobes represent an important component of neural prosthetic systems where implanted microprobes record the electro-potentials generated by specific thoughts in the brain and convey the signals to algorithms trained to interpret these thoughts. Here, we present novel elongated multi-site neural probe that can reach depths greater than 10mm. We hypothesize that reaching such depth allows the recording of cognitive signals required to drive cognitive prosthetics. The impedance of the recording sites on the probes was on the order of 500 kΩ at 1 kHz, which is consistent with probes used for neurophysiological recordings. The probes were made porous using Xenon Difluoride (XeF₂) dry etching to improve the biocompatibility and their adherence to the surrounding neural tissue. Numerical studies were performed to determine the reliability of the porous probes. We implanted the elongated probe in rats and show that the elongated probes are capable of simultaneously recording both spikes and local field potentials (LFPs) from various recording sites.

Conducting computational stress-strain analysis using finite element methods (FEM) is a common approach when dealing with the complex geometries of atherosclerosis, which is a leading cause of global mortality and complex cardiovascular disease. The considerable expense linked to FEM analysis encourages the substitution of FEM with a considerably faster data-driven machine learning (ML) approach. This study investigated the potential of end-to-end deep learning tools as a more effective substitute for FEM in predicting stress-strain fields within 2D cross sections of arterial wall. We first proposed a U-Net based fully convolutional neural network (CNN) to predict the von Mises stress and strain distribution based on the spatial arrangement of calcification within arterial wall cross-sections. Further, we developed a conditional generative adversarial network (cGAN) to enhance, particularly from the perceptual perspective, the prediction accuracy of stress and strain field maps for arterial walls with various calcification quantities and spatial configurations. On top of U-Net and cGAN, we also proposed their ensemble approaches to further improve the prediction accuracy of field maps. Our dataset, consisting of input and output images, was generated by implementing boundary conditions and extracting stress-strain field maps. The trained U-Net models can accurately predict von Mises stress and strain fields, with structural similarity index scores (SSIM) of 0.854 and 0.830 and mean squared errors of 0.017 and 0.018 for stress and strain, respectively, on a reserved test set. Meanwhile, the cGAN models in a combination of ensemble and transfer learning techniques demonstrate high accuracy in predicting von Mises stress and strain fields, as evidenced by SSIM scores of 0.890 for stress and 0.803 for strain. Additionally, mean squared errors of 0.008 for stress and 0.017 for strain further support the model's performance on a designated test set. Overall, this study developed a surrogate model for finite element analysis, which can accurately and efficiently predict stress-strain fields of arterial walls regardless of complex geometries and boundary conditions.

We propose an advanced filtering scheme based on Recurrent Neural Networks (RNNs) and Deep Learning to enable efficient control strategies for Vertical Farming (VF) applications.  We demonstrate that the best RNN model incorporates five neuron layers, with the first and second containing ninety Long Short-Term Memory neurons.  The third layer implements one Gated Recurrent Units neuron.  The fourth segment incorporates one RNN network, while the output layer is designed by using a single neuron exhibiting a rectified linear activation function.  By utilizing this RNN digital filter, we introduce two variations: (1) A scaled RNN model to tune the filter to the signal of interest, and (2) A moving average filter to eliminate harmonic oscillations of the output waveforms. The RNN models are contrasted with conventional digital Butterworth, Chebyshev I, Chebyshev II, and Elliptic Infinite Impulse Response (IIR) configurations.  The RNN digital filtering schemes avoid introducing unwanted oscillations, which makes them more suitable for VF than their IIR counterparts.  Finally, by utilizing the advanced features of scaling of the RNN model, we demonstrate that the RNN digital filter can be pH selective, as opposed to conventional IIR filters.

: In the last years, materializations of neuromorphic circuits based on nanophotonic arrangements have been proposed, which contain complete optical circuits, laser, photodetectors, photonic crystals, optical fibers, flat waveguides, and other passive optical elements of nanostructured materials, which eliminate the time of simultaneous processing of big groups of data, taking advantage of the quantum perspective and thus highly increasing the potentials of contemporary intelligent computational systems. This article is an effort to record and study the research that has been conducted concerning the methods of development and materialization of neuromorphic circuits of Neural Networks of nanophotonic arrangements. In particular, an investigative study of the methods of developing nanophotonic neuromorphic processors, their originality in neuronic architectural structure, their training methods and their optimization has been realized along with the study of special issues such as optical activation functions and cost functions.

Improper lifting measures of long-span spatial steel structures during construction process may delay the construction period and even cause safety accidents. Few studies on long-span spatial steel structures considered time-varying mechanical characteristic during construction process. In order to achieve safe and efficient installation in a long-span spatial steel structure, this research presents a time-varying mechanical analysis of the synchronous and asynchronous integral lifting and a single and interlaced point’s asynchronous integral lifting analysis method of a long-span spatial steel structure. The results showed that in the case of asynchronous lifting of single point, the displacement influence on other members is related to the distance. The closer the distance from the lifting point, the greater the influence. In asynchronous integral lifting, the lifting point with large lifting force is first installed to the specified position, and the lifting point with small lifting force is installed to the specified position.

In our recent publications, based on strong and electroweak interactions, we have developed a completely new formula for estimating nuclear binding energy. With reference to currently believed Semi Empirical Mass Formula (SEMF), we call our formula as ‘Strong and Electroweak Mass Formula’ (SEWMF). Our formula constitutes 4 simple terms and only one energy coefficient of magnitude 10.1 MeV. First term is a volume term, second term seems to be a representation of free nucleons associated with electroweak interaction, third term is a radial term and fourth one is an asymmetry term about the mean stable mass number. In this paper, we make an attempt to understand and estimate the maximum binding energy associated with any mass number. It can be expressed as, for A > 4, $\left(BE\right)_A\cong \left[A-0.000935A^2-A^{1/3}-A^{-1/2}\right]$ MeV. We are working on refining the 4^th term with even-odd corrections, shell corrections and other microscopic corrections. Proceeding further, stable mass numbers and super heavy mass numbers can be understood with a relation of the form, $\left[\textrm{RoundOff}\left(\left(Z+2.9464\right)^{1.2}-1.7165\right)\right]\pm\left[0,1\right]\pm\left(2n\right)$ where $n \cong 0,1,2$. It needs a review with respect to even-odd proton numbers and other microscopic corrections.Very interesting point to be noted is that based on the concept of “binding energy per nucleon”, the most complicated Avogadro number and Unified atomic mass unit can be estimated in a unified approach.

This literature review investigates the morphological and behavioral significance of the horns of Carnotaurus sastrei, a theropod dinosaur from the Late Cretaceous period. Through a comprehensive analysis of fossil specimens, comparative anatomy, and biomechanical modeling, this review explores the evolutionary adaptations and potential functions of these distinctive cranial structures. The horns of Carnotaurus are hypothesized to serve multiple roles, including species recognition, thermoregulation, and intraspecific combat. Our findings suggest that its cranial horns likely served a primary role in species recognition, intimidating rivals and signaling mating readiness. It also could have been used occasionally in head-butting contests, potentially as a display of dominance, but likely did not play a role in thermoregulation. Additionally, we examine the ecological context in which Carnotaurus lived, assessing how environmental factors could have influenced the development of such features. The implications of this study extend to broader discussions on the functional morphology and adaptive strategies of theropod dinosaurs, highlighting the complex relationship between form and function in the evolutionary history of predatory dinosaurs like Carnotaurus sastrei.

Health management in industrial systems is more critical in maintenance management and it plays an important role in productivity, fault diagnosis, safety, efficiency, and economy in manufacturing industries. Early detection of faults in machinery may increase the effectiveness of maintenance actions and will avoid unwanted consequences in process operations and maintenance. Existing fault diagnosis methods have limitations such as insufficient accuracy, slow detection rate, and handling large and complex data sets. In this digital age, Industry 4.0 techniques have been applied across all fields, including the condition monitoring of machines. This research addresses the gaps in traditional fault diagnosis by using deep learning, a modern AI technique effective for diagnosing faults in various machines. Deep learning algorithms Multilayer Perceptron (MLP), Coevolutionary Neural Network (CNN), and Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) are tested for fault diagnosis using vibration datasets collected from Spectra Quest Machinery Fault Simulator (SQMFS). In this research work, NI-DAQ (National Instruments- Data Acquisition) system, accelerometer, and LabVIEW software are used to collect vibration signals. Preprocessing of the signals has been done using a sampling strategy, shuffling, standardization, and reshaping data augmentation. The result shows that MLP accuracy in the prediction of fault is 0.9, CNN reached 0.95, and RNN and LSTM with 0.57 and 0.45 respectively. The high performance of CNN is due to its ability to effectively capture spatial patterns in vibration data which is crucial for fault diagnosis in rotating machinery followed by MLP due to its faster convergence during training. However, when scaling the data, MLP outperformed CNN, demonstrating superior adaptability to increased data complexity and volume. Due to the need for larger datasets and temporal patterns in the vibration data, which RNN and LSTM are designed to handle, they resulted in a lower accuracy. This study shows that CNN has given better results than other deep learning algorithms MLP, RNN, and LSTM in fault diagnosis of rotating machinery. Future research could explore the application of these techniques to different types of machinery and fault conditions.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

One of the biggest challenges in characterizing 2-D image topographies is finding a low-dimensional parameter set that can succinctly describe, not so much image patterns themselves, but the nature of these patterns. The 2-D Cluster Variation Method (CVM), introduced by Kikuchi in 1951, can characterize very local image pattern distributions using configuration variables, identifying nearest-neighbor, next-nearest-neighbor, and triplet configurations. Using the 2-D CVM, we can characterize 2-D topographies using just two parameters; the activation enthalpy and the interaction enthalpy. Initial investigations with two different representative topographies (``scale-free-like'' and ``rich club-like'') produce interesting results when brought to a CVM free energy minimum. Additional phase space investigations, where one of these two parameters has been set to zero, identify useful parameter ranges. Careful comparison of the analytically-predicted configuration variables versus those obtained when performing computational free energy minimization on a 2-D grid show that the computational results differ significantly from the analytic solution. The 2-D CVM can potentially function as a secondary free energy minimization within the hidden layer of a neural network, providing a basis for extending node activations over time and allowing temporal correlation of patterns.

In order for robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities in order to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged on top of an object to securely grab it between the robotic gripper and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the application of deep learning methods in task generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. A number of the most promising approaches are evaluated and the most successful for grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is identified as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

Event detection provides a crucial foundation for intelligent text analysis and supports numerous downstream applications. However, existing detection models often fail to meet the high accuracy requirements and typically require a human–machine collaborative detection mode involving “machine detection followed by manual audit and correction.” Analysis reveals that the recall rate of machine detection is a major factor limiting the efficiency of human–machine collaboration. To address this at its root and ensure high recall, an event trigger recommendation task is introduced, and a span-based recommendation model for Chinese, SpETR (Span-based Event Trigger Recommender), is developed. This model integrates confidence information from both trigger identification and event classification stages to recommend candidate triggers and their event types for each event. To enhance recall, a semantic boundary smoothing method is proposed, which assigns soft labels to spans around gold triggers based on semantic completeness and part-of-speech, combined with a modified focal loss function to make the model predictions smoother. Experiments on DuEE and a self-built dataset show that SpETR is most effective when the number of recommendations is set to 3, achieving recall rates of 97.76% and 98.70%, respectively, comprising improvements of 4.30% and 5.22% over the optimal baseline models. In terms of human–machine collaborative detection, SpETR saved 30.6% and 25.8% of time compared to traditional detection models on two datasets, and the average F1 score of the annotation results was also improved by 5.35% and 3.48%, respectively.

Mathematical models are designed to assist decision-making processes across various scientific fields. These models typically contain numerous parameters, the values’ estimation of which often comes under analysis when evaluating the strength of these models as management tools. Advanced artificial intelligence software, has proven to be highly effective in estimating these parameters. In this research work, we use the Lotka-Volterra model to describe the dynamics of a telecommunication sector in Greece and then we propose a methodology that employs a feed-forward neural network (NN). The NN is used to estimate the parameter’s values of the Lotka-Volterra system, which are later applied to solve the system using a fourth algebraic order Runge-Kutta method. The application of the proposed architecture to the specific case study, reveals that the model fits well to the experiential data. Furthermore, the results of our method surpassed the other three methods used for comparison, demonstrating its higher accuracy and effectiveness. The implementation of the proposed feed-forward neural network as well as the fourth algebraic order Runge-Kutta method was accomplished using MATLAB.

Background: Accurate prediction of neurorehabilitation outcomes following Spinal Cord Injury (SCI) is crucial for optimizing healthcare resource allocation and improving rehabilitation strategies. Artificial neural networks (ANNs) may identify complex prognostic factors in patients with SCI. However, psychological variables’ influence on rehabilitation outcomes remains underexplored, despite their potential impact on re-covery success. Materials and Methods: A cohort of 303 patients with SCI was analyzed with an ANN model that employed 17 input variables, structured into two hidden layers and a single output node. Clinical and psychological data were integrated to predict functional outcomes, measured by the Spinal Cord Independence Measure (SCIM) at discharge. Paired Wilcoxon tests evaluated pre-post differences, and linear regression assessed correlation, with Pearson’s coefficient and Root Mean Square Error calculated. Results: Significant improvements in SCIM scores were observed (21.8 ± 15.8 at admission vs. 57.4 ± 22.5 at discharge, p < 0.001). The model assigned the highest predictive weight to SCIM at admission (10.3%), while psychological factors accounted for 36.3%, increasing to 40.9% in traumatic SCI cases. Anxiety and de-pression were the most influential psychological predictors. Correlation between predicted and actual SCIM scores was R=0.794 for the entire sample and R=0.940 for traumatic cases. Conclusion: ANN model demonstrated strong impact, especially for traumatic SCI, of psychological factors on functional outcomes. Anxiety and depression emerged as dominant negative predictors, conversely self-esteem and emotional regulation functioned as protective factors increasing functional outcomes. These findings support the integration of psychological assessments into predictive models to enhance accuracy in SCI rehabilitation outcomes.

Bone fractures are common injuries that require quick and accurate diagnosis to provide the right medical care. The “convolutional neural network” technique relies mostly on manual inspection, by radiologists and can be laborious and prone to error. The objective of this work was to increase the efficiency and accuracy of fracture identification by automating the examination of X-ray images using convolutional neural networks. A “convolutional neural network” model created to detect bone fractures in X-ray images was used in the present study. The model was trained and validated using an extensive dataset of X-ray images, which included both fractured and nonfractured bones. Multiple convolutional layers were used in the “convolutional neural network” architecture for feature extraction, and pooling and fully connected layers were added for classification. The main measures used to assess the model's performance were sensitivity, specificity, and accuracy. In regard to identifying bone fractures, the “convolutional neural network”-based model outperformed the conventional technique. With significant gains in sensitivity and specificity, this approach achieved a high accuracy rate and decreased the frequency of false positives and false negatives. We used “convolutional neural network” tool in PyTorch for bone fracture detection and we outlined the important considerations that must be considered when attempting to achieve this goal Additionally, we contrasted every study with our baseline. Here our maximum accuracies were 99.05%, 98.60%, 99.45% and 99.74% for epochs 8, 9, 10 and 11, respectively. These findings highlight the model's ability to improve the diagnostic efficiency and accuracy in clinical settings. Using “convolutional neural network” to identify bone fractures from X-ray images is a promising development in medical imaging. In the end, our method improves patient outcomes by ensuring faster and more reliable fracture diagnosis while also lessening the diagnostic burden on radiologists. Subsequent investigations will focus on incorporating this system into clinical procedures and investigating its utilization in real-time emergency situations. Since there was no medical intervention on human subjects in this investigation, trial registration regulations were not applied.

Due to the influence of factors such as user consumption habits and manufacturer service quality, e-commerce platforms cannot push personalized product information to any consumer. This project studies the push of product information on e-commerce platforms based on deep neural networks. It mines the data of users' online shopping behaviors such as browsing, collecting, and adding to cart on e-commerce platforms, and pre-processes the mined user behavior data by cleaning, integrating, and normalizing them. It builds a deep bidirectional Transformer model to learn users' historical behavior data and predict the most probable products that meet users' behavior needs, thereby realizing the automatic push of product information on e-commerce platforms. The experimental results show that the F1 value of the push result of product information on e-commerce platforms under the method designed by this algorithm is 0.97, which confirms the effectiveness and superiority of this method.

This paper investigates the application of Graph Neural Networks (GNNs) in solving the facility location decision problem. By adapting the learning objectives and structure of GNNs, this research bridges the gap between traditional optimization approaches and modern machine learning techniques. The proposed method demonstrates improved decision-making capabilities, providing promising results for facility location optimization. Additionally, potential future research directions are outlined, highlighting areas where GNNs can further enhance decision-making processes in complex supply chain networks. Hybrid GNN and Mixed Integer Programming solutions have been proposed.

Artificial intelligence (AI), the wide spectrum of technologies aiming to give machines or computers the ability to perform human-like cognitive functions, began in the 40s with the first abstract models of intelligent machines. Soon later in the 50s and 60s machine learning algorithms such as neural networks and decision trees ignited large enthusiasm. More recent advancements include the refinement of learning algorithms, the development of convolutional neural networks to efficiently analyze images, and methods to synthesize new images. The renewed enthusiasm was also due to the increase in computational power with graphical processing units and the availability of large digital databases to be mined by neural networks. AI soon began to be applied in medicine, first through expert systems designed to support the clinician’s decision, and later with neural networks for the detection or classification of malignant lesions in medical images. More recently, the use of natural language processing, recurrent neural networks, transformers and generative models has both improved the capabilities of making an automated reading of medical images and moved AI to new domains, including text analysis of electronic health records, image self-labelling and self-reporting. Thanks to its versatility and impressive results and fueled by the availability of powerful computing resources and open-source libraries, AI is one of the most promising resources for frontier research and applications in medicine.

Federated unlearning represents a sophisticated evolution in the domain of machine learning, particularly within federated learning frameworks. In financial applications, where data privacy and security are paramount, federated unlearning allows institutions to selectively remove or “unlearn” specific data from trained models without compromising their overall performance and accuracy. This capability is essential for ensuring that models remain adaptable, secure, and compliant with regulatory requirements, while minimizing the need for expensive retraining. In this paper, we explore various financial applications where federated unlearning can have a significant impact, including fraud detection, portfolio management, and credit risk modeling. By allowing targeted removal of outdated, erroneous, or sensitive data, federated unlearning enhances the agility of financial models, enabling institutions to keep pace with the dynamic financial landscape. Using practical numerical examples, we demonstrate how unlearning improves model accuracy and decision-making while maintaining data privacy across distributed systems. This paper underscores the critical role of federated unlearning in addressing the challenges of modern financial institutions, offering insights into its practical applications and future potential.

In this study, we introduce an innovative framework for multimodal learning that leverages enhanced fusion gate units within gated neural network architectures. The proposed Fusion Gate Unit (FGU) serves as a pivotal component in neural network designs, aiming to derive a comprehensive intermediate representation by amalgamating data from diverse modalities. The FGU is adept at determining the extent to which each modality influences the unit's activation through the utilization of multiplicative gating mechanisms. We conducted evaluations on a multilabel genre classification task for movies, utilizing both plot summaries and poster images as input modalities. The results demonstrate that the FGU significantly elevates the macro F-score compared to single-modality approaches and surpasses existing fusion techniques, including mixture of experts models. Additionally, we present the MM-IMDb dataset alongside this publication, which, to our knowledge, represents the most extensive publicly accessible multimodal dataset for movie genre prediction to date. This dataset is expected to facilitate further research and development in the field of multimodal information processing.

This article explores the intricate functioning of the human brain, highlighting how it operates near a critical state to optimize memory storage, adaptability, and the generation of thoughts. Through complex, fractal-like neural networks and brain waves, the brain largely governs our actions via subconscious processes, allowing for rapid, automated responses while reserving conscious thought for novel or complex tasks. Reasoning and planning emerge from the interplay of episodic memory and various neural networks such as Default Mode Network (DMN), Salience Network (SN), and Executive Network (EN), guiding decisions and actions. The "self" and “consciousness” are portrayed as functional illusions, which is being continuously constructed by dynamic neural activity, while free will is examined as a deterministic illusion shaped by prior neural states. We have argued that the brain's response to the physical world is a blend of subconscious automation and conscious sensory processing, thus, reality navigating through an evolving neural plasticity that promotes creativity and the illusion of a coherent, freely acting self. We discuss how does the mind select what to think about, how does it begin? Online and offline state of mind. We address what is an intelligence, understanding, creativity. We propose individual neuronal cells might store information beyond synaptic changes, the pathways through which neuronal thoughts propagate and Darwinian-like evolution of thoughts in minimizing surprises. We have drawn some parallels between the human brain and Large Language Model (LLM) like ChatGPT in terms of their functional roles.

Plant diseases not only cause economic losses, but they also pose a health risk. In this regard, aflatoxins are linked to the development of some type of liver cancer, especially the hepatocellular carcinoma. Aflatoxins are usually produced by the fungi Aspergillus flavus and Parsiticus in figs, and their identification is usually carried out using invasive and complex methods or by visual inspection at an advanced stage. Given that Spain is one of the main producers of figs and Extremadura is the leading region in the country, it is necessary to explore alternative ways of detecting the presence of aflatoxins in figs and preventing them from entering the food chain. The aim of this research is to address the early detection of Aspergillus flavus fungus using non-invasive techniques with the aid of hyperspectral imaging and the application of artificial intelligence techniques, in particular deep learning. The images were taken after inoculation of the microtoxin using 3 different concentrations, related to three different classes and healthy figs (healthy controls). The analysis of the hyperspectral images was performed at the pixel level. Firstly, a full connected neural network was used to analyse the spectral signature associated with each pixel; second, the wavelet transform was applied to each spectral signature. The resulting images are fed to a convolutional neural network. The hyperparameters of the proposed models were adjusted based on the parameter tuning process also performed. The results are promising, with 83% accuracy, 82.75% recall and 83.25% F1-measure for the single neural network, and 77.25% accuracy, recall and F1 for the convolution neural network.

A novel approach to optimizing turbomachinery performance is presented in this chapter, which integrates Computational Fluid Dynamics (CFD) simulations, an artificial neural network (ANN) with a modified Non-dominated Sorting Genetic Algorithm II (NSGA-II). Using this enhanced algorithm, substantial performance improvements can be achieved through geometric optimization. The effectiveness of this method is demonstrated in two case studies: an inducer for a centrifugal pump and a Savonius wind turbine. The inducer is designed to maximize head coefficient, hydraulic efficiency, and net positive suction head by optimizing factors such as inlet and outlet blade angles. The optimization process employs the Group Method of Data Handling (GMDH) for objective function modeling, followed by Pareto front plotting and TOPSIS for identifying trade-off optimal points. Results indicate significant improvements in head coefficient, hydraulic efficiency, and NPSHR by 14.3%, 0.3%, and 30.2%, respectively. Twist angle, aspect ratio, and overlap ratio are also optimized for wind turbine blades. The power coefficient is enhanced by 5.32%, the torque coefficient by 13.74%, and the rotational speed by 0.071% through multi-objective optimization. As a result of this approach, efficiency improves, and valuable insights into the optimal design principles for turbomachinery components are also gained.

Artificial neural networks are highly efficient tools for numerous kinds of tasks, which include forecasting, regression, and recognizing patterns in classification and pattern recognition. An artificial neural network is a model for processing information using essential components called artificial neurons that are inspired by the human brain. Two significant aspects of delayed neural networks dynamic activity are their stability and the synchronization phenomenon. This work presents a bidirectional associative memory (BAM) incommensurate fractional-order delay neural network model. The incommensurate fractional orders are calculated within the stability region through the corresponding eigenvalues and their points of equilibrium. The involved neuron states are synchronized with each other for the calculated incommensurate stable fractional orders. The reduction of the time delay will give more relaxation time for the state variable $w_4(t)$ to be stable as compared to the state variable $w_3(t)$ due to the induction of extra activation functions. The theoretical findings of this research have significance for providing guidance and controlling the dynamic behavior of artificial neural networks.

We explore the integration of smart pixel light modulators (SPLMs) into bidirectional optical neural networks (BONNs), highlighting their advantages over traditional spatial light modulators (SLMs). SPLMs enhance BONN performance by enabling faster light modulation in both directions, significantly increasing the refresh rate of neural network weights to hundreds of megahertz, thus facilitating the practical implementation of the backpropagation algorithm and two-mirror-like BONN structures. The architecture of an SPLM-based BONN (SPBONN) features bidirectional modulation, simplifying hardware with electrical fan-in and fan-out. Scalability limitations of the projection system restrict input and output array sizes but achieve high throughput, up to 4.3 × 10¹⁷ MAC/s with 100 layers. Energy assessments showed that the SPLM array, despite its higher power consumption compared to the SLM array, is manageable via effective heat dissipation. Smart pixels with programmable memory in the SPBONN provide a cost-effective solution for expanding network node size and overcoming scalability limitations without the need for additional hardware.

Accurate measurement of pedaling kinetics and kinematics is vital for optimizing rehabilitation, exercise training, and understanding musculoskeletal biomechanics. Pedal reaction force, the main external force in cycling, is essential for musculoskeletal modeling and closely correlates with lower limb muscle activity and joint reaction forces. However, sensor instrumentation like 3-axis pedal force sensors is costly and requires extensive post-processing. Recent advancements in machine learning (ML), particularly neural network (NN) models, provide promising solutions for kinetic analyses. In this study, an NN model was developed to predict radial and mediolateral forces, providing a low-cost solution to study pedaling biomechanics with stationary cycling ergometers. Fifteen healthy individuals performed a 2-minute pedaling task at two different self-selected (58±5 rpm) and higher (72±7 rpm) cadences. Pedal forces were recorded using a 3-axis force system. The dataset included pedal force, crank angle, cadence, power, and participants' weight and height. The NN model achieved an inter-subject normalized root mean square error (nRMSE) of 0.15±0.02 and 0.26±0.05 for radial and mediolateral forces at high cadence, respectively, and 0.20±0.04 and 0.22±0.04 at self-selected cadence. The NN model's low computational time suits real-time pedal force predictions, matching the accuracy of previous ML algorithms for estimating ground reaction forces in gait.

The metaverse is gradually expanding. There is a growing number of photo and video recordings of metaverse virtual worlds being used in multiple domains, with growing collections. An essential element of the metaverse and its recordings are avatars. In this paper, we present a novel task of avatar detection in metaverse recordings, supporting semantic retrieval in collections of metaverse recordings and other use cases. Our work addresses the characterizations and definitions of avatars and presents a new model supporting avatar detection. The latest object detection algorithms are trained and tested on a variety of avatar types in metaverse recordings. Our work achieves a higher level of accuracy than existing models, which encourages further research in this field.