Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial & temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

Evidence on adult mammalian neurogenesis and scarce studies with human brains led to the idea that adult human neurogenesis occurs in the subgranular zone (SGZ) of the dentate gyrus and in the subventricular zone (SVZ). However, findings published from 2018 rekindled controversies on adult human SGZ neurogenesis. We systematically reviewed studies published during the first decade of characterization of adult human neurogenesis (1994–2004) – when the two-neurogenic-niche concept in humans was consolidated – and compared with further studies. The synthesis of both periods is that adult human neurogenesis occurs in an intensity ranging from practically zero to a level comparable to adult mammalian neurogenesis in general, which is the prevailing conclusion. Nonetheless, Bernier and colleagues showed in 2000 intriguing indications of adult human neurogenesis in a broad area including the limbic system. Likewise, we later showed evidence that limbic and hypothalamic structures surrounding the circumventricular organs form a continuous zone expressing neurogenesis markers encompassing the SGZ and SVZ. The conclusion is that publications from 2018 on adult human neurogenesis did not bring novel findings on location of neurogenic niches. Rather, we expect that the search of neurogenesis beyond the canonical adult mammalian neurogenic niches will confirm our indications that adult human neurogenesis is orchestrated in a broad brain area. We predict that this approach may, for example, clarify that human hippocampal neurogenesis occurs mostly in the CA1-subiculum zone and that the previously identified human rostral migratory stream arising from the SVZ is indeed the column of the fornix expressing neurogenesis markers.

This paper attempts to compare two different approaches to solve the problem of accident rates prediction based on human factors for industrial workers. One of the methods has already been done using Fuzzy c-Means Clustering and proved to be working with decent results. The second method which will be covered in this paper is using Artificial Neural Networks. The primary goal of this work is to insure that ANN will work efficiently in such prediction problem. The second goal is to reveal the fact that which one of the two selected methodologies is better at defining the estimation of accident rates among people who work in different industrial fields. The purpose has been achieved when the outcome of the ANN was obtained and compared accordingly with the output of the research previously carried out with Fuzzy c-means clustering method. Comparing the outcomes of these two different methods gave an immense insight on which features are more important than others when it comes to laborers properties with completely different background such as varying levels of health, knowledge, experience, training and physical properties. At the end of the research, it becomes clear that accident rates estimation for laborers with properly trained Artificial Neural Network gives better results when it is compared with Fuzzy c-Means Clustering method. Standard deviation method was used to calculate the validity of ANN technique. The result was compared with Fuzzy c-mean clustering technique. Impressive improvement of 8.8% in the accident rate prediction was achieved using Tailored-Made-ANN.

Predicting trip purpose from comprehensive and continuous smart card data is beneficial for transport and city planners in investigating travel behaviours and urban mobility. Here we propose a framework, ActivityNET, using machine learning (ML) algorithms to predict passengers’ trip purpose from smart card data and Points-of-Interest (POIs) data. The feasibility of the framework is demonstrated in two phases. Phase I focuses on extracting activities from individuals’ daily travel patterns from smart card data and combining them with POIs using the proposed ‘activity-POIs consolidation algorithm’. Phase II feeds the extracted features into an artificial neural network (ANN) with multiple scenarios and predicts trip purpose under primary activities (home and work) and secondary activities (entertainment, eating, shopping, child drop-offs/pick-ups and part-time work) with high accuracy. As a case study, the proposed ActivityNET framework is applied in Greater London and illustrates a robust competence to predict trip purpose. The promising outcomes demonstrate that the cost-effective framework offers high predictive accuracy and valuable insights into transport planning.

Computer systems are involved in many critical human applications today, so that a small error can lead to serious and dangerous problems. These errors can be from an error in the incorrect design of the user interface to an error in the program code. The success of a software product depends on several factors. Given that different organizations and institutions use software products, the need to have a quality and desirable Software according to the goals and needs of the organization makes measuring the quality of software products. an important issue for most organizations and institutions, To be sure of having the right software. It is necessary to use a standard quality model to examine the features and sub-features for a detailed and principled study in the quality discussion. In this study, the quality of Word software was measured by Adaptive Neural Fuzzy Inference System. In recent years, powerful systems called fuzzy inference systems on The basis of adaptive neural network (ANFIS) has been used in various sciences. Using the power of neural network training and the linguistic advantage of fuzzy systems, these types of systems have been able to realize the advantages of the two in terms of analyzing very powerful complex processes. Considering the importance of software quality and to have a good and usable software in terms of quality and measuring the quality of software during the study. It was applied at different levels to make the result of measuring the quality of Word software more accurate and closer to reality. In this research, the quality of the software product is measured based on the adaptive neural-fuzzy inference system in ISO standard. According to the results obtained in this study, it is understood that quality is a continuous and hierarchical concept and the quality of each part of the software at any stage of production can lead to high quality products.

Missing observations constitute one of the most important issues in data analysis in applied research studies. The magnitude and their structure impact parameters estimation in the modeling with important consequences for decision-making. This study aims to evaluate the efficiency of imputation methods combined with the backpropagation algorithm in a nonlinear regression context. The evaluation is conducted through a simulation study including sample sizes (50, 100, 200, 300 and 400) with different missing data rates (10, 20, 30 40 and 50%) and three missingness mechanisms (MCAR, MAR and MNAR). Four imputation methods (Last Observation Carried Forward, Random Forest, Amelia and MICE) were used to impute datasets before making prediction with backpropagation. 3-MLP model was used by varying the activation functions (Logistic-Linear, Logistic-Exponential, TanH-Linear and TanH-Exponentiel), the number of nodes in the hidden layer (3 - 15) and the learning rate (20 - 70%). Analysis of the performance criteria (R2, r and RMSE) of the network revealed good performances when it is trained with TanH-Linear functions, 11 nodes in the hidden layer and a learning rate of 50%. MICE and Random Forest were the most appropriate for data imputation. These methods can support up to 50% of missing rate with an optimal sample size of 200.

Timely diagnosis of Alzheimer's diseases(AD) is crucial to obtain more practical treatments. In this paper, a novel approach Based on Multi-Level Fuzzy Neural Networks (MLFNN) for early detection of AD is proposed. The focus of study was on the problem of diagnosing AD and MCI patients from healthy people using MLFNN and selecting the best feature(s) and most compatible classification algorithm. In this way, we achieve an excellent performance using only a single feature i.e. MMSE score, by fitting the optimum algorithm to the best area using optimum possible feature(s) namely one feature for a real life problem. It can be said, the proposed method is a discovery that help patients and healthy people get rid of painful and time consuming experiments. Experiments shows the effectiveness of proposed method in current research for diagnosis of AD with one of the highest performance (accuracy rates of 96.6%), ever reported in the literature.

We consider the problem of coordinating the charging of an entire fleet of electric vehicles (EV), using a model-free approach, i.e. purely data-driven reinforcement learning (RL). The objective of the RL-based control is to optimize charging actions, while fulfilling all EV charging constraints (e.g. timely completion of the charging). In particular, we focus on batch-mode learning and adopt fitted Q-iteration (FQI). A core component in FQI is approximating the Q-function using a regression technique, from which the policy is derived. Recently, a dueling neural networks architecture was proposed and shown to lead to better policy evaluation in the presence of many similar-valued actions, as applied in a computer game context. The main research contributions of the current paper are that (i)we develop a dueling neural networks approach for the setting of joint coordination of an entire EV fleet, and (ii)we evaluate its performance and compare it to an all-knowing benchmark and an FQI approach using EXTRA trees regression technique, a popular approach currently discussed in EV related works. We present a case study where RL agents are trained with an epsilon-greedy approach for different objectives, (a)cost minimization, and (b)maximization of self-consumption of local renewable energy sources. Our results indicate that RL agents achieve significant cost reductions (70--80%) compared to a business-as-usual scenario without smart charging. Comparing the dueling neural networks regression to EXTRA trees indicates that for our case study's EV fleet parameters and training scenario, the EXTRA trees-based agents achieve higher performance in terms of both lower costs (or higher self-consumption) and stronger robustness, i.e. less variation among trained agents. This suggests that adopting dueling neural networks in this EV setting is not particularly beneficial as opposed to the Atari game context from where this idea originated.

Great Malang region is developing rapidly with the population increase and inhabitant`s activity, like migration and urbanization. Other activities like agricultural expansion as well as an uncontrolled residential development need to be monitored to avoid any negative impact in the future. The availability of free and open-source software, spatial high-resolution satellite imagery datasets, and powerful algorithms open the possibilities to map, monitor, and predict the future trend of land use land cover (LULC) changes. However, the accuracy and precision of this model is still in doubt, especially in the Great Malang region. Research is needed to provide a foundational basis and documentation on how the changes occur, where did the changes occur, and the accuracy of the predicted model. This study tries to answer those questions using the high spatial resolution of Sentinel-2 imageries. Combination of the fuzzy algorithm, artificial neural network, and cellular automata was utilized to process the datasets. We analysed four different scenarios of simulation and the result then compared. The different number of hidden layers and iteration was used and evaluated to understand the effect of different parameters in the prediction result. The best scenario was then used to predict future land use changes. This study has successfully produced the future LULC model of Great Malang region with high accuracy level (87%). The study also found that the land use transformation from agriculture to urban built-up area is relatively low, where changes of the built-up area over three periods of analysis are below than 5%. This is due to the physical condition of Great Malang region where mountainous areas are dominated.

Adult neurogenesis is an evolutionary conserved process occurring in all vertebrates. However, striking differences are observed between the taxa, considering the number of neurogenic niches, the neural stem cell (NSC) identity and brain plasticity under constitutive and injury-induced conditions. Zebrafish has become a popular model for the investigation of the molecular and cellular mechanisms involved in adult neurogenesis. Compared to mammals, the adult zebrafish displays a high number of neurogenic niches distributed throughout the brain. Furthermore, it exhibits a strong regenerative capacity without scar formation or any obvious disabilities. In this review, we will first discuss the similarities and differences regarding (i) the distribution of neurogenic niches in the brain of adult zebrafish and mammals (mainly mouse) and (ii) the nature of the neural stem cells within the main telencephalic niches. In the second part, we will describe the cascade of cellular events occurring after telencephalic injury in zebrafish and mouse. Our study clearly shows that most early events happening right after the brain injury are shared between zebrafish and mouse including cell death, microglia and oligodendrocyte recruitment, as well as injury-induced neurogenesis. In mammals one of the consequences following an injury is the formation of a glial scar that is persistent. This is not the case in zebrafish, which may be one of the main reasons that zebrafish display a higher regenerative capacity.

In recent years, intelligent fault diagnosis algorithms using deep learning method have achieved much success. However, the signals collected by sensors contain a lot of noise, which will have a great impact on the accuracy of the diagnostic model. To address this problem, we propose a one-dimensional convolutional neural network with multi-scale kernels (MSK-1DCNN) and apply this method to bearing fault diagnosis. We use a multi-scale convolution structure to extract different fault features in the original signal, and use the ELU activation function instead of the ReLU function in the multi-scale convolution structure to improve the anti-noise ability of MSK-1DCNN; then we use the training set with pepper noise to train the network to suppress overfitting. We use the Western Reserve University bearing data to verify the effectiveness of the algorithm and compare it with other fault diagnosis algorithms. Experimental results show that the improvements we proposed have effectively improved the diagnosis performers of MSK-1DCNN under strong noise and the diagnosis accuracy is higher than other comparison algorithms.

Deep learning has achieved lots of successes in many fields, but when trainable sample are extremely limited, deep learning often under or overfitting to few samples. Meta-learning was proposed to solve difficulties in few-shot learning and fast adaptive areas. Meta-learner learns to remember some common knowledge by training on large scale tasks sampled from a certain data distribution to equip generalization when facing unseen new tasks. Due to the limitation of samples, most approaches only use shallow neural network to avoid overfitting and reduce the difficulty of training process, that causes the waste of many extra information when adapting to unseen tasks. Euclidean space-based gradient descent also make meta-learner's update inaccurate. These issues cause many meta-learning model hard to extract feature from samples and update network parameters. In this paper, we propose a novel method by using multi-stage joint training approach to post the bottleneck during adapting process. To accelerate adapt procedure, we also constraint network to Stiefel manifold, thus meta-learner could perform more stable gradient descent in limited steps. Experiment on mini-ImageNet shows that our method reaches better accuracy under 5-way 1-shot and 5-way 5-shot conditions.

Unmanned Aerial Vehicles (UAVs) are being increasingly viewed as valuable tools to aid the management of farms. This kind of technology can be particularly useful in the context of extensive cattle farming, as production areas tend to be expansive and animals tend to be more loosely monitored. With the advent of deep learning, and Convolutional Neural Networks (CNNs) in particular, extracting relevant information from aerial images has become more effective. Despite the technological advancements in drone, imaging and machine learning technologies, the application of UAVs for cattle monitoring is far from being thoroughly studied, with many research gaps still remaining. In this context, the objectives of this study were threefold: 1) to determine the highest possible accuracy that could be achieved in the detection of animals of the Canchim breed, which is visually similar to the Nelore breed (\textit{Bos taurus indicus}); 2) to determine the ideal Ground Sample Distance (GSD) for animal detection; 3) to determine the most accurate CNN architecture for this specific problem. The experiments involved 1,853 images containing 8,629 samples of animals, and 15 different CNN architectures were tested. A total of 900 models were trained (15 CNN architectures * 3 spacial resolutions * 2 datasets * 10-fold cross validation), allowing for a deep analysis of the several aspects that impact the detection of cattle using aerial images captured using UAVs. Results revealed that many CNN architectures are robust enough to reliably detect animals in aerial images even under far from ideal conditions, indicating the viability of using UAVs for cattle monitoring.

Many scientific and technological problems are studied with the help of computer codes that simulate the phenomena of interest rather than via traditional laboratory experiments. Such models play an important role in neuroscience where they are used to mimic brain function from the sub-cellular to the macroscopic level. Exploration with computer models carries with it a number of statistical challenges: where to sample the input space for the simulator, how to make sense of the data that is generated, how to estimate unknown parameters in the model, how to validate a model. The simulator setting also has some unique problems and possibilities. This review paper describes statistical research on these issues and how that work might be applied to neural simulations.

Various empirical models are available to evaluate the temperature effects on relative permeability of the different rock and fluid systems. However, the implementation of limited experimental data points may hinder the applicability of such models to other systems. This study aims to develop new predictive models for k_ro estimation based on multilayer perceptron artificial neural network (MLP-ANN), adaptive neuro-fuzzy inference system (ANFIS), and least squares support vector machine (LSSVM) approaches. A database comprising of 626 data points applied to the model development. The independent variables are temperature, oil viscosity, water viscosity, water saturation ( ), and the absolute permeability. Each variable covers a wide range of variations which increases models’ potential to be applied in various systems with different characteristics. The doubtful experimental data points excluded using a leverage value approach and a sensitivity analysis carried out to determine the quantitative impact of every individual independent variable on the k_ro. Statistical error analyses demonstrated the coefficient of determination (R²) values of 0.985, 0.975, and 0.999 for MLP-ANN, ANFIS, and LSSVM, respectively. The comparative study indicated that the LSSVM had the best performance regarding both graphical and statistical error analyses among the newly proposed models and previously reported models in the literature.

An article's tone and framing not only influence an audience's perception of a story but may also reveal attributes of author identity and bias. Building upon prior media, psychological, and machine learning research, this neural network-based system detects those writing characteristics in ten news agencies' reporting, discovering patterns that, intentional or not, may reveal an agency's topical perspectives or common contextualization patterns. Specifically, learning linguistic markers of different organizations through a newly released open database, this probabilistic classifier predicts an article's publishing agency with 74% hidden test set accuracy given only a short snippet of text. The resulting model demonstrates how unintentional 'filter bubbles' can emerge in machine learning systems and, by comparing agencies' patterns and highlighting outlets' prototypical articles through an open source exemplar search engine, this paper offers new insight into news media bias.

In this paper, PEN3 electronic nose was used to detect and recognize fresh and moldy apples (inoculated with Penicillium expansum and Aspergillusniger) taken Golden Delicious apples as model subject. Firstly, the apples were divided into two groups: apples only inoculated with different molds (Group A) and mixed apples of inoculated apples with fresh apples (Group B). Then the characteristic gas sensors of the PEN3 electronic nose that were most closely correlated with the flavor information of the moldy apples were optimized and determined, which can simplify the analysis process and improve the accuracy of results. Four pattern recognition methods, including linear discriminant analysis (LDA), backpropagation neural network (BPNN), support vector machines (SVM) and radial basis function neural network (RBFNN), were then applied to analyze the data obtained from the characteristic sensors, respectively, aiming at establishing the prediction model of flavor information and fresh/moldy apples. The results showed that only the gas sensors of W1S, W2S, W5S, W1W and W2W in the PEN3 electronic nose exhibited strong signal response to the flavor information, indicating were most closely correlated with the characteristic flavor of apples and thus the data obtained from these characteristic sensors was used for modeling. The results of the four pattern recognition methods showed that BPNN presented the best prediction performance for the training and validation sets for both the Group A and Group B, with prediction accuracies of 96.29% and 90.00% (Group A), 77.70% and 72.00% (Group B), respectively. Therefore, it first demonstrated that PEN3 electronic nose can not only effectively detect and recognize the fresh and moldy apples, but also can distinguish apples inoculated with different molds.

Localizing the source of a signal is often as important as deciphering the signal’s message. Localization mechanisms must cope with the challenges of representing the spatial information of weak, noisy signals. Comparing these strategies across modalities and model systems allows a broader understanding of the general principles shaping spatial processing. In this review we focus on the electrosensory system of knifefish and provide an overview of our current understanding of spatial processing in this system, in particular, localization of conspecific signals. We argue that many mechanisms observed in other sensory systems, such as the visual or auditory systems, have comparable implementations in the electrosensory system. Our review therefore describes a field of research with unique opportunities to provide new insights into the principles underlying spatial processing.

Multi-floor environments are usually ignored while designing an autonomous robot for indoor cleaning applications. However, for efficient operation in such environments, the ability of a robotic platform to traverse staircases is crucial. Staircase detection and localization is highly important for planning the traversal on staircases. This paper describes a deep learning approach using Convolutional Neural Networks (CNNs) based Robot Operation System (ROS) to staircase detection and localization. We use an object detection network to detect staircases in images. We also localize these staircases using a contour detection algorithm to detect the target point, a point close to the center of the first step, and the angle of approach to the target point. Experiments are performed with data obtained from images captured on different types of staircases at different view points/angles. Results show that the approach is very accurate in identifying the presence of the staircase in the working environment and is also able to locate the target point with good accuracy.

A statistical analysis of semantic memory should reflect the complex, multifactorial structure of the relations among its items. Still, a dominant paradigm in the study of semantic memory has been the idea that the mental representation of concepts is structured along a simple branching tree spanned by superordinate and subordinate categories. We propose a generative model of item representation with correlations that overcomes the limitations of a tree structure. The items are generated through "factors" that represent semantic features or real-world attributes. The correlation between items has its source in the extent to which items share such factors and the strength of such factors: if many factors are balanced, correlations are overall low; whereas if a few factors dominate, they become strong. Our model allows for correlations that are neither trivial nor hierarchical, but may reproduce the general spectrum of correlations present in a data-set of nouns. We provide an estimate of the number of concepts that can be stored and retrieved by a large-scale cortical network, the Potts network, which is perhaps approximately 10⁷ with human cortical parameters. When this storage capacity is exceeded, however, retrieval fails completely only for balanced factors; above a critical degree of imbalance, a phase transition leads to a regime where the network still extracts considerable information about the cued item, even if not recovering its detailed representation: partial categorization seems to emerge spontaneously as a consequence of the dominance of particular factors, rather than being imposed ad hoc. We argue this to be a relevant model of semantic memory resilience in Tulving’s remember/know paradigms.

Accurate estimates of daily rainfall are essential for understanding and modeling the physical processes involved in the interaction between the land surface and the atmosphere. In this study, daily satellite soil moisture observations from the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) generated by implementing the standard NASA- algorithm are employed for estimating rainfall, firstly, through the use of recently developed approach, SM2RAIN (Brocca et al., 2013) and, secondly, the nonlinear autoregressive network with exogenous inputs (NARX) neural modelling at five climate stations in the Karkheh river basin (KRB), located in southwest Iran. In the SM2RAIN method, the period 1 January 2003 to 31 December 2005 is used for the calibration of algorithm and the remaining 9 months from 1 January 2006 to 30 September 2006 is used for the validation of the rainfall estimates. In the NARX model, the full study period is split into a training (1 January 2003 to 31 September 2005) and a testing (1 September 2005 to 30 September 2006) stage. For the prediction of the rainfall as the desired target (output), relative soil moisture changes from AMSR-E and measured air temperature time series are chosen as exogenous (external) inputs in NARX. The quality of the estimated rainfall data is evaluated by comparing it with observed rainfall data at the five rain gauges in terms of the correlation coefficient R, the RMSE and the statistical bias. For the SM2RAIN method, R ranges between 0.44 and 0.9 for all stations, whereas for the NARX- model the values are generally slightly lower. Moreover, the values of the bias for each station indicate that although SM2RAIN is likely to underestimate large rainfall intensities, due to the known effect of soil moisture saturation, its biases are somewhat lower than those of NARX. In conclusion, the results of the present study show that with the use of AMSR-E soil moisture products in the physically based SM2RAIN- algorithm as well as in the NARX neural network, rainfall for poorly gauged regions can be fairly predicted.

Maximum hardness and hardened depth are the responses of interest in relation to the laser hardening process. These values define heat treatment quality and have a direct impact on mechanical performance. This paper aims to develop models capable of predicting the shape of the hardness profile depending on laser process parameters for controlling laser hardening quality (LHQ), or rather the response values. An experimental study was conducted to highlight hardened profile sensitivity to process input parameters such as laser power (P_L), beam scanning speed (V_S) and initial hardness in the core (H_C). LHQ modeling was conducted by modeling attributes extracted from the hardness profile curve using two effective techniques based on the punctual and geometrical approaches. The process parameters with the most influence on the responses were laser power, beam velocity and initial hardness in the core. The obtained results demonstrate that the geometrical approach is more accurate and credible than the punctual approach according to performance assessment criteria.

Recent advances in recording and real-time analysis of surface electromyographic signals (sEMG) have fostered the use of sEMG human-machine interfaces for controlling personal computers, prostheses of upper limbs, and exoskeletons among others. Despite a relatively high mean performance, sEMG-interfaces still exhibit strong variance in the fidelity of gesture recognition among different users. Here we systematically study the latent factors determining the performance of sEMG-interfaces in synthetic tests and in an arcade game. We show that the degree of muscle cooperation and the amount of the body fatty tissue are the decisive factors in synthetic tests. Our data suggest that these factors can only be adjusted by a long-term training, which promotes fine-tuning of low-level neural circuits driving the muscles. A short-term training has no effect on synthetic tests, but significantly increases the game scoring. This implies that it works at a higher decision-making level, not relevant for synthetic gestures. We propose a procedure that enables quantification of the gestures’ fidelity in a dynamic gaming environment. For each individual subject the approach allows identifying “problematic” gestures that decrease gaming performance. This information can be used for optimizing the training strategy and for adapting the signal processing algorithms to individual users, which could be a way for a qualitative leap in the development of future sEMG-interfaces.

With recent focus on deep neural network architectures for development of algorithms for computer-aided diagnosis (CAD), we provide a review of studies within the last 3 years (2015-2017) reported in selected top journals and conferences. 29 studies that met our inclusion criteria were reviewed to identify trends in this field and to inform future development. Studies have focused mostly on cancer-related diseases within internal medicine while diseases within gender-/age-focused fields like gynaecology/pediatrics have not received much focus. All reviewed studies employed image datasets, mostly sourced from publicly available databases (55.2%) and few based on data from human subjects (31%) and non-medical datasets (13.8%), while CNN architecture was employed in most (70%) of the studies. Confirmation of the effect of data manipulation on quality of output and adoption of multi-class rather than binary classification also require more focus. Future studies should leverage collaborations with medical experts to aid future with actual clinical testing with reporting based on some generally applicable index to enable comparison. Our next steps on plans for CAD development for osteoarthritis (OA), with plans to consider multi-class classification and comparison across deep learning approaches and unsupervised architectures were also highlighted.

Emergency control load-shedding is a key solution to prevent blackouts in the power system. This paper proposed a new model of emergency controls load shedding based on the fast identification of the unstable state of the power system. K-means clustering algorithm divided the instability mode into the clusters. The results of analysis of this cluster were used as the basis for classification control. Building load shedding strategies is consisted of the pre-designed rules based on AHP algorithm. When the recognition of the power system “instability” is detected, the signal of load shedding control is triggered immediately, therefore the decision time is greatly shortened comparing to the traditional methods. The effectiveness of the proposed method was tested on the IEEE 39-bus to overcome the limitations of the last traditional methods.

Change Detection (CD) of aerial images refers to identifying and analyzing changes between two or more aerial images of the same location taken at different times. The CD is a highly challenging task due to the need to distinguish relevant changes, such as urban expansion, deforestation, or post-disaster damage assessment, from irrelevant ones, such as light conditions, shadows, and seasonal variations. Many CD papers have recently been published, where most of the papers that proposed a new model contained a comparison between their proposed and state-of-the-art (SOTA) models. While many recent studies propose new deep learning (DL) models for improving CD performance, their comparative analyses are often restricted, lacking comprehensive insights into the proposed models' real-world generalizability, robustness, and performance trade-offs across diverse change characteristics. This paper presents a novel generic framework to systematically benchmark and assess DL-based CD models through three parallel pipelines: 1) cross-testing models on diverse benchmark datasets to evaluate generalization, 2) robustness analysis against different image corruptions, and 3) multi-faceted contour-level analytics evaluating detection sensitivity to change size/complexity. The framework is applied to comparatively evaluate five state-of-the-art DL-based CD models - Changeformer, BIT, Tiny, SNUNet, and CSA-CDGAN. Extensive experiments unveil each model's strengths, limitations and biases, highlighting their relative proficiencies in generalizing across data distributions, resilience to noise corruption, and discriminative capabilities for changes of varying characteristics. The proposed benchmarking framework demonstrates significant potential for guiding the selection of suitable CD models tailored to specific application requirements by comprehensively evaluating their generalizability, robustness, and detection capabilities across diverse real-world scenarios. This systematic evaluation approach can drive future research into developing more robust and versatile CD solutions aligned with practical needs.

Gilbert's syndrome (GS) is a common hereditary condition characterized by mild increases in serum bilirubin levels due to inherited defects in bilirubin metabolism. This review, based on data from peer-reviewed articles and journals spanning from 1977 to January 2024, provides a comprehensive overview of over four decades of research on GS. Early studies primarily focused on defining the clinical and genetic characteristics of the syndrome, laying the foundation for subsequent investigations. More recent research has delved into the genetic mechanisms underlying the reduced expression of bilirubin UDP-glucuronosyltransferase, which has significantly enhanced our understanding of the pathogenesis of GS. Furthermore, recent studies have shed light on the clinical implications of GS, including its association with non-alcoholic fatty liver disease and mortality risk, highlighting the complex interplay between genetic factors, bilirubin metabolism, and clinical outcomes. Despite its generally benign nature, thorough research is essential to fully understand the impact of GS on patients' lives. This review emphasizes the importance of ongoing research to deepen our understanding of GS and its broader implications.

Finding a template location in query image is a fundamental problem in many computer vision applications, such as localization of known objects, image registration, image matching and object tracking. Currently available methods fail when not enough training data is available or big variations in the textures, different modalities and weak visual features exist in the images, leading to limited applications on real-world tasks. We introduce Self-Supervised Foundation Model for Template Matching (Self-TM), a novel end-to-end approach for self-supervised learning template matching. The idea behind Self-TM is to learn hierarchical features incorporating localization properties from images without any annotations. As going deeper in the convolutional neural network (CNN) layers, their filters begin to react to more complex structures and their receptive fields increase. This leads to loss of localization information in contrast to the early layers. The hierarchical propagation of the last layers activations back to the first layer results in precise template localization. Due to its zero-shot generalization capabilities on tasks such as image retrieval, dense template matching and sparse image matching our pre-trained model can be classified as a foundation one.

This study addresses the challenge of predicting the dynamic behavior of the structures under seismic excitation. Accurate prediction of such systems' responses is critical for the design and evaluation of buildings and infrastructure. Traditional methods, including numerical models and differential equation solvers, often face significant computational burdens, especially with nonlinear hysteretic behaviors and large-scale problems. To overcome these limitations, a novel Fuzzy-based Convolutional Neural Network (FuzzyCNN) model is developed. This model integrates fuzzy logic principles with convolutional neural networks to effectively manage the uncertainties and complexities inherent in soil-structure interaction under seismic loads. The model's performance is validated through both numerical simulations and experimental data from a mid-rise concrete building subjected to seismic events. Comparative analysis with a traditional Physics-informed CNN (PhyCNN) model demonstrates the superior accuracy and robustness of the FuzzyCNN in predicting seismic responses. Key results show that the FuzzyCNN model not only enhances prediction accuracy but also handles uncertainties more effectively than the PhyCNN model. The findings suggest that the FuzzyCNN model can significantly improve the efficiency and accuracy of dynamic response predictions. This advancement offers valuable implications for engineering design, seismic risk assessment, and the development of more resilient infrastructure.

The advent of the era of big data has led to the emergence of heterogeneous network data fusion as a prominent area of research. Heterogeneous network data is characterised by multi-modality, multi-source, and high dimensionality, which presents significant challenges for traditional data fusion methods. These methods often encounter difficulties in processing such data, including issues such as information redundancy, data inconsistency, and high computational complexity. This paper proposes a heterogeneous network data fusion model based on a deep neural network. The model employs the Multi-Layer Perceptron (MLP) as its fundamental framework, utilising the deep neural network to facilitate joint feature representation learning on data from disparate modalities. The Adaptive Feature Reconstruction Module enables the model to learn the interrelationships between different modalities and to balance the importance of different modal features in the fusion process in a dynamic manner. Furthermore, we introduce an innovative cross-modal attention mechanism, which is capable of effectively capturing the coupling relationship between deep features in heterogeneous data, thereby enhancing the expressiveness and data fusion efficacy of the model. The experimental results demonstrate that the proposed model markedly enhances the accuracy of classification and regression tasks in comparison to traditional methodologies.

Studies on integrating Spiking Neural Networks (SNNs) with the Transformer architecture holds promise for enabling models to achieve ultra-low energy consumption while possessing the performance of the Transformer architecture. Currently, studies on ANN-to-SNN conversion of integrating Spiking Neural Networks (SNNs) with the Transformer architecture mainly focuses on simple activation functions in MLPs, and has not yet addressed the mismatch between the Softmax activation function in the self-attention mechanism and the computation rules of SNNs. Consequently, the ANN-to-SNN conversion efforts have consistently failed to make the Transformer architecture directly applicable to SNNs. To address this challenge, we propose the Spiking-Softmax method, which integrates Spiking Exponential Neuron (SI-exp) and Spiking Collaboration Normalized Neuron (SI-norm). The Spiking-Softmax method accurately simulates the Softmax activation function with only 12 time steps. Building upon this, we propose the Spike Integrated Transformer conversion (SIT-conversion) method, which enables the conversion of the Transformer architecture to SNNs. The SNNs generated by the SIT-conversion of Transformer models of various sizes achieve accuracy nearly identical to their ANNs counterparts, achieving nearly lossless and ultra-low-latency ANN-to-SNN conversion. This work represents the first implementation of simulating the Softmax activation function and fully converting the Transformer architecture into SNNs through spike firing.

In aerial image object detection, small targets present significant challenges due to limited pixel information, complex backgrounds, and sensitivity to bounding box perturbations. To tackle these issues, we propose SO-RTDETR for small object detection. The model introduces a Cross-Scale Feature Fusion with S2 (S2-CCFF) module, a Parallelized Patch-Aware attention (PPA) module, and the Normalized Wasserstein Distance (NWD) loss function, leading to significant performance improvements. Specifically, the S2-CCFF module enhances small object information by incorporating an additional S2 layer, while SPDConv downsampling maintains key details and reduces computational cost. The CSPOK-Fusion mechanism integrates global, local, and large branch features, capturing multi-scale representations and effectively mitigating interference from complex backgrounds and occlusions, thereby enhancing the spatial representation of features across scales. The PPA module, embedded in the Backbone network, leverages multi-level feature fusion and attention mechanisms to retain and strengthen small object features, addressing the issue of information loss. The NWD loss function, by focusing on the relative positioning and shape differences of bounding boxes, increases robustness to minor perturbations, enhancing detection accuracy. Experimental results on the VisDrone and NWPU VHR-10 aerial datasets demonstrate that our approach outperforms state-of-the-art detectors.

The agriculture industry is critical to the global economy, with product quality having a direct impact on marketability and waste management. Apples, one of the most extensively produced fruits, are affected by a variety of diseases that can reduce productivity and quality. Accurate diagnosis of diseases is critical, but traditional manual approaches are time-consuming, error-prone, and ineffective. Inadequate labeled data and a wide range of disease symptoms make it necessary to design an automated, robust, and accurate system. This article describes a hybrid model for Apple Fruit Disease Detection (HMAFDD) that combines the strengths of three pre-trained convolutional neural network (CNN) models: ResNet50, DenseNet121, and EfficientNetB0. It accomplish this by using multi-architecture feature extraction. The hybrid system, which combines both models, is able to recognize a wide range of features, from simple textures to complex patterns unique to a certain diseases. Grad-CAM, or gradient-weighted class activation mapping, creates heatmaps that highlight significant regions for prediction, which enhances the interpretability of the model.To increase robustness and accuracy, techniques such as spectral-shifted adversarial perturbation for data augmentation and spectrally-weighted global average pooling for feature aggregation are used. This technique provides 99.75% accuracy with minimal processing needs, making it acceptable for real-time applications in agricultural situations. This considerably improves apple disease management.

High purity hydrogen is a necessary need for fuel cell. Pressure swing adsorption (PSA) technology is one of the effective methods for hydrogen purification and separation. A layered adsorption bed packed with activated carbon and zeolite 5A for five-component gas mixture (H2/CH4/CO/N2/CO2=56.4/26.6/8.4/5.5/3.1 mol%) PSA model was built. The model was validated by breakthrough curves and comparing the results with the experimental data. The purification performance of six-step layered bed PSA cycle was studied using the model. In order to optimize the cycle, the Box-Behnken design (BBD) method was used, as implemented in Design Expert™. In addition to adsorption time, the pressure equalization time and the feed flow rate were considered as independent optimization parameters. Quadratic regression equations were then obtained for three responses of the system, namely purity, recovery, and productivity. To explore a better optimization solution, a novel optimization method of machine learning with back propagation neural network (BPNN) was proposed in this work, a kind of heuristic algorithm of genetic algorithm (GA) is introduced to optimize the structure of BPNN. The predicted outputs of hydrogen production using two kinds of models based on back propagation neural network-genetic algorithm (BPNN-GA) and BBD method integrated with BPNN-GA (BBD-BPNN-GA) models. The results showed that the BBD-BPNN-GA model have a better performance with the mean square error (MSE) of 0.0005, while the MSE of BPNN-GA model was 0.0035. And the correlation coefficient of R-values were much closer to 1 of the BBD-BPNN-GA model, which was illustrated that the BBD-BPNN-GA model can be effectively applied to the prediction and optimization of PSA process.

Climate change is a global issue that has driven the adoption of renewable energies due to their sustainability and environmental benefits. However, these energies face limitations, such as the lack of regional studies on wind or solar dynamics and the efficiency of energy systems. Tools that simulate and calculate energy potential while considering uncontrollable climatic variables are crucial for optimizing the design of these systems. Artificial intelligence, particularly multilayer neural networks, has proven effective in data prediction across industries. This paper focuses on training a 3-layer neural network using the ReLU activation function and quadratic error to predict wind potential density in Mexico, aiming to identify key areas for renewable energy development.

The Association of Mutual Funds of India (AMFI) under the direction of the Securities and Exchange Board of India (SEBI) provided open access to various risk parameters with respect to MidCap and SmallCap funds on its website in February, 2024. This disclosure of month wise cross-sectional data depicting stress-test and liquidity analysis was hailed as a milestone as it provided a glimpse into inherent risk of mutual funds. The AMFI dataset consisted of 14 variables including stress test results, ownership concentration on both liability & asset sides, standard deviation on portfolio’s returns, portfolio beta, trailing 12-month PE ratio, portfolio turnover etc. Among these, the primary variable identified in grading mutual fund is the stress test parameter, expressed as number of days required to liquidate 50% and 25% of the portfolio respectively on a pro-rata basis under stress condition. A higher number of days to liquidate the portfolio under stress conditions represented higher risk for the investor. The objective of our paper is to test various neural network models which can help in predicting stress levels with the highest accuracy and specificity in MidCap and SmallCap mutual funds based on AMFI’s 14 parameters as predictors.Our study utilizes AMFI datasets available for MidCap and SmallCap mutual funds from February 2024 (inception period) to May 2024. To operationalize the analysis, the derived response variable was binned to represent high and low risk based on the time required for pro-rata liquidation of the portfolio. The study employed feed-forward neural networks, with the logistic regression as the step function, to model the relationships. Results suggest that the simpler neural network models with one hidden layer and two to three nodes show higher accuracy and specificity. Analysis also shows that more complex architectures do not always guarantee better performance as these models might suffer from higher bias. By leveraging advanced computational techniques, this study contributes to the ongoing discourse surrounding risk management and decision-making in the realm of mutual fund investments.

Single crystal nickel-based superalloys are extensively used in turbine blade applications 1 due to their superior creep resistance compared to their polycrystalline counterparts. With the high 2 creep resistance, High Cycle Fatigue (HCF) and Low Cycle Fatigue (Single crystal nickel-based 3 superalloys are extensively used in turbine blade applications due to their superior creep resistance 4 compared to polycrystalline counterparts. As a result, fatigue becomes the primary failure mechanism 5 in such applications. Specifically, High Cycle Fatigue (HCF) and Low Cycle Fatigue (LCF) are of 6 significant concern under these conditions. This study investigates the fatigue life prediction of 7 CMSX-4 using a combined crystal plasticity and lifetime assessment model. The constitutive crystal 8 plasticity model simulates the anisotropic, rate-dependent deformation behavior of CMSX-4, while 9 a modified Chaboche damage model is used for lifetime assessment, incorporating anisotropy by 10 focusing on cleavage stresses on active slip planes. Both qualitative and quantitative data obtained 11 from HCF experiments on single crystal superalloys with notched geometry were used to validate 12 the model. Furthermore, artificial neural networks (ANNs) were employed to enhance the accuracy 13 of lifetime predictions across varying temperatures by analyzing the stress-strain data obtained from 14 simulations. The integration of crystal plasticity, damage mechanics, and ANNs resulted in accurate 15 predictions of fatigue life and crack initiation points under complex loading conditions of single 16 crystal superalloys.

This paper surveys the landscape of security and data attacks on machine unlearning, with a focus on financial and e-commerce applications. We discuss key privacy threats such as Membership Inference Attacks and Data Reconstruction Attacks, where adversaries attempt to infer or reconstruct data that should have been removed. In addition, we explore security attacks including Machine Unlearning Data Poisoning, Unlearning Request Attacks, and Machine Unlearning Jailbreak Attacks, which target the underlying mechanisms of unlearning to manipulate or corrupt the model. To mitigate these risks, various defense strategies are examined, including differential privacy, robust cryptographic guarantees, and Zero-Knowledge Proofs (ZKPs), offering verifiable and tamper-proof unlearning mechanisms. These approaches are essential for safeguarding data integrity and privacy in high-stakes financial and e-commerce contexts, where compromised models can lead to fraud, data leaks, and reputational damage. This survey highlights the need for continued research and innovation in secure machine unlearning, as well as the importance of developing strong defenses against evolving attack vectors.

Phakopsora pachyrhizi, the causative agent of the Asian Soybean Rust, is one of the most prominent causes of yield loss in soybean production worldwide. In this study, a combination of hyperspectral imaging with advanced data analysis methodology is shown to accurately detect soybean rust symptoms in early stages and differentiate them from other factors at leaf scale. Data analysis was performed with neural networks based on training data from a small subset of the respective experiments and compared with classical machine learning methods for its accuracy and early disease detection capabilities. Results show that even with a comparably small subset of training data the analysis through neural networks can outperform classical machine learning methods in a complex dataset with high variability in the designated classes. In two separate experiments it was possible to accurately detect disease in inoculated leaves before symptoms were visible to the human eye. These results do not only show the potential of this methodology for precision farming applications, but also allow accurate and objective assessment of symptom severity and development for scientific studies and resistance breeding.

The study compares three machine learning and deep learning models—Support Vector Regression (SVR), Recurrent Neural Networks (RNN), and Long Short-Term Memory (LSTM)—for predicting market prices using the NGX All-Share Index dataset. The models were evaluated using multiple error metrics, including Mean Absolute Error (MAE), Mean Squared Error (MSE), Root Mean Square Error (RMSE), Mean Percentage Error (MPE), and R-squared. RNN and LSTM were tested with both 30 and 60-day windows, with performance compared to SVR. LSTM delivered better R-squared values, with a 60-day LSTM achieving the best accuracy (R-squared = 0.993) when using a combination of endogenous market data and technical indicators. SVR showed reliable results in certain scenarios but struggled in fold 2 with sudden spike that shows high probability of not capturing the entire underlying NGX pattern in the dataset correctly as witnessed with the high validation loss during the period. Additionally, RNN faced the vanishing gradient problem that limits its long-term performance. Despite challenges, LSTM's ability to handle temporal dependencies, especially with the inclusion of On-Balance Volume, led to significant improvements in prediction accuracy. The use of the Optuna optimization framework further enhanced model training and hyperparameter tuning, contributing to the performance of the LSTM model.

Recently, deep neural networks (DNNs) have been widely used in various fields such as autonomous vehicles and smart homes. Since these DNNs can be directly implemented on edge devices, they offer advantages such as real-time processing in low-power and low-bandwidth environments. However, deployment of DNNs in embedded systems, including edge devices, exposes them to threats such as fault injection attacks. In this paper, we introduce two methods to induce misclassifications by using clock and voltage glitch-based fault attacks in devices where DNN models are executed. As a result of experiments on a microcontroller implemented with a DNN for image classification, we show that glitch injection attacks can lead with high probability to serious misclassifications. Furthermore, we propose a countermeasure to glitch attacks on the softmax function, and confirm that this method is effective in preventing misclassifications.

In modern agriculture, decision-making is deeply intertwined with data, yet essential agricultural knowledge remains encased within dense scientific texts such as journals, manuals, and free-text reports. This necessitates specialized search systems capable of distilling and delivering precise information in response to specific queries from agricultural users. This study introduces AgriQuery, a sophisticated agent designed to field natural language questions from the agricultural sector by exploring vast troves of scientific documents. A comprehensive review and analysis of farmers' information needs have been conducted, leading to the creation of an information retrieval test collection that includes actual queries, a vast array of scientific documents segmented into passages, and a set of ground truth relevance assessments that map these passages to corresponding queries. We explore and benchmark several information retrieval models, highlighting the efficacy of advanced neural ranking models in this context. AgriQuery's proposed deployment architecture features a client interface on the Telegram platform and a backend model on standard hardware. This test collection aims to catalyze further research into matching natural language queries with scientific text answers, with implications extending beyond agriculture.

Drug development is a lengthy process with a high failure rate. Increasingly, machine learning is utilized to facilitate the drug development processes. These models aim to enhance our understanding of drug characteristics, including their activity in biological contexts. However, a major challenge in drug response (DR) prediction is model interpretability as it aids in the validation of findings. This is important in biomedicine, where models need to be understandable in comparison with established knowledge of drug interactions with proteins. drGAT, a graph deep learning model, leverages a heterogeneous graph composed of relationships between proteins, cell lines, and drugs. drGAT is designed with two objectives: DR prediction as a binary sensitivity prediction and elucidation of drug mechanism from attention coefficients. drGAT has demonstrated superior performance over existing models, achieving 78\% accuracy (and precision), and 76\% F1 score for 269 DNA-damaging compounds of the NCI60 drug response dataset. To assess the model's interpretability, we conducted a review of drug-gene co-occurrences in Pubmed abstracts in comparison to the top 5 genes with the highest attention coefficients for each drug. We also examined whether known relationships were retained in the model by inspecting the neighborhoods of topoisomerase-related drugs. For example, our model retained TOP1 as a highly weighted predictive feature for irinotecan and topotecan, in addition to other genes that could potentially be regulators of the drugs. Our method can be used to accurately predict sensitivity to drugs and may be useful in the identification of biomarkers relating to the treatment of cancer patients.

Finite element discretizations of problems in computational physics often rely on hand-generated initial mesh and adaptive mesh refinement (AMR) to preferentially resolve regions containing important features during simulation. We propose Adaptnet, a Graph Neural Networks (GNNs) framework for learning mesh generation and adaptation. The model is composed of two GNNs: the first one, Meshnet, learns mesh parameters commonly used in open-source mesh generators, to generate an initial mesh from a Computer Aid Design (CAD) file; while the second one, Graphnet, learns mesh-based simulations to predict the components of an Hessian-based metric to perform anisotropic mesh adaptation. Our approach is tested on structural (Deforming plate - Linear elasticity) and fluid mechanics (Flow around cylinders - steady-state Stokes) problems. Our results show it can accurately predict the dynamics of the system and adapt the mesh accordingly. The adaptivity of the model supports learning resolution-independent dynamics and can scale to more complex state spaces at test time.

Vermicomposting is one of the most important waste management techniques in the process of vermiculture. In this study, a Neural Network-assisted novel paradigm is proposed to predict waste from vermicomposting. The proposed Neural Network Skeleton is based on a Gallium Arsenide Processing Schema, which is used to separate wastes. By comparing the proposed sys-tem with existing methods, it was found that the proposed approach had the highest average prediction ratio of 91.32%, outperforming other techniques like ERD, RNN, and Deep LSTM. The separation ratio analysis also demonstrated the effectiveness of the proposed method, with a range of 45-94%. Furthermore, the study emphasizes the importance of chemical equilibrium and the effectiveness of our proposed Gallium Arsenide Processing Schema in achieving high prediction and separation accuracies, showcasing its potential for practical application in waste management processes. Lastly, the prediction of the process evolution stages is detailed, indicating the efficiency of the proposed system in achieving various levels of waste separation. Overall, the study provides valuable insights into the potential of the proposed methods in op-timizing wastewater management processes, paving the way for more effective and sustainable vermicomposting practices.

Temperature and pressure sensors currently encounter challenges such as slow response times, large sizes, and insufficient sensitivity. To address these issues, we developed tetraphenylethylene (TPE)-doped polyvinylidene fluoride (PVDF) nanofiber membranes using electrospinning, with process parameters optimized through a convolutional neural network (CNN). We systematically analyzed the effects of PVDF concentration, spinning voltage, tip-to-collector distance, and flow rate on fiber morphology and diameter. The CNN model achieved high predictive accuracy, resulting in uniform and smooth nanofibers under optimal conditions. Incorporating TPE enhanced the hydrophobicity and mechanical properties of the nanofibers. Additionally, the fluorescent properties of the TPE-doped nanofibers remained stable under UV exposure and exhibited significant linear responses to temperature and pressure variations. The nanofibers demonstrated a temperature sensitivity of -0.976 gray value/°C and pressure sensitivity with an increase in fluorescence intensity from 537 a.u. to 649 a.u. under 600 g pressure. These findings highlight the potential of TPE-doped PVDF nanofiber membranes for advanced temperature and pressure sensing applications.

The present research project entitled "Development of a method for predicting the optimal maturity level of avocado using machine learning" aims to establish an accurate and efficient approach to assess the maturity of avocados using machine learning methodologies. This research specifically focuses on identifying the relevant physical and chemical characteristics of avocados, creating a dataset containing categorized images of maturity levels, and creating machine learning models capable of accurately predicting fruit maturity. The studies reveal that the application of machine learning, in particular convolutional neural networks and multisensor models, has the potential to transform the prediction of avocado maturity and thus improve product quality and customer satisfaction. The findings indicate that the proposed techniques achieve an accuracy rate of over 90%, demonstrating their viability for integration into mobile applications that can benefit growers and suppliers in their decision-making processes.

This study investigates anomaly detection of IoT device traffic using Convolutional Neural Networks (CNN) and Variational Autoencoders (VAE) to enhance the detection capability of security threats in IoT environments. A series of hardware configurations, software environments, and hyperparameters were utilized to optimize the training and testing processes of the models. The CNN model demonstrates robust classification performance, achieving an accuracy rate of 95.85% on the test dataset, effectively distinguishing between different types of IoT device traffic. Meanwhile, the VAE model exhibits proficient anomaly detection capabilities by effectively capturing abnormal patterns in the data using reconstruction loss and KL divergence. The combined use of CNN and VAE models offers a comprehensive solution to cybersecurity challenges in IoT environments. Future research directions include exploring diverse IoT traffic data, practical deployment for validation, and further optimization of model structures and parameters to improve performance and applicability.

Traditional computer vision techniques aim to extract meaningful information from images but often depend on manual feature engineering, making it difficult to handle complex real-world scenarios. Fractional Calculus (FC), which extends derivatives to non-integer orders, provides a flexible way to model systems with memory effects and long-term dependencies, making it a powerful tool for capturing fractional rates of variation. Recently, Neural Networks (NNs) have demonstrated remarkable capabilities in learning complex patterns directly from raw data, automating computer vision tasks and enhancing performance. Therefore, the use of fractional calculus in neural network-based computer vision is a powerful method to address existing challenges by effectively capturing complex spatial and temporal relationships in images and videos. This paper presents a survey of Fractional Calculus Neural Network-based (FC NN-based) computer vision techniques for denoising, enhancement, object detection, segmentation, restoration, and NN compression. The survey compiles existing FFC NN-based approaches, elucidates underlying concepts, and identifies open questions and research directions. By leveraging FC's properties, FC NN-based approaches offer a novel way to improve the robustness and efficiency of computer vision systems.

As modern systems are becoming more complex their control strategy cannot longer relay only on measurement information that usually comes from probes but also from mathematical models. Those systems models can lead to unbearable computation times due to their own complexity, turning the control process non-viable, which leads to the implementation of surrogate models that enable to achieve estimates within acceptable time to take decisions. A control trained with Deep Reinforcement Learning algorithm, using a Physics-Informed Neural Network to obtain the temperature map on the following time step, replaces the need of running Direct Numerical Simulations. On this work we considered an 1D heat conduction problem, which temperature distribution feeds a control system to activate a heat source aiming to obtain a constant, previously defined, temperature value. With this approach, control training becomes much faster without the need of performing numerical simulations or laboratory measurements, as well the control is taken based on Neural Network enabling its implementation on simple processors to edge computing.

Robot manipulators are robotic systems that are frequently used in automation systems and able to provide increased speed, precision and efficiency in the industrial applications. Due to their nonlinear and complex nature, it is crucial to optimize the robot manipulator systems in terms of trajectory control. In this study, positioning analysis based on artificial neural networks (ANN) were performed for robot manipulator systems used in the textile industry and the optimal ANN model for the high-accuracy positioning was improved. The inverse kinematic analysis of a 6 degree of freedom (DOF) industrial denim robot manipulator were carried out via 4 different learning algorithms of Delta-Bar-Delta (DBD), Online Back Propagation (OBP), Quick Back Propagation (QBP) and Random Back Propagation (RBP) for proposed neural network predictor. From the results obtained, it was observed that QBP based 3-10-6 type ANN structure produced the optimal results in terms of estimation and modelling of trajectory control. In addition, 3-5-6 type ANN structure was also improved and its Root Mean Square Error (RMSE) and statistical R2 performances were compared to that of 3-10-6 ANN structure. Consequently, it can be concluded that the proposed neural predictors can successfully be employed in real-time industrial applications for robot manipulator trajectory analysis.

We introduce NodeFlow, a flexible framework for probabilistic regression on tabular data that combines Neural Oblivious Decision Ensemble (NODE) and Conditional Continuous Normalizing Flows (CNF). It offers improved modeling capabilities for arbitrary probabilistic distributions, addressing the limitations of traditional parametric approaches. In NodeFlow, the NODE captures complex relationships in tabular data through a tree-like structure, while the conditional CNF utilizes the NODE’s output space as a conditioning factor. The training process of NodeFlow employs standard gradient-based learning, facilitating end-to-end optimization of the NODEs and CNF-based density estimation. This approach ensures outstanding performance, ease of implementation, and scalability, making NodeFlow an appealing choice for practitioners and researchers. Comprehensive assessments on benchmark datasets underscore NodeFlow’s efficacy, revealing its achievement of state-of-the-art outcomes in multivariate probabilistic regression setup and its strong performance in univariate regression tasks. Furthermore, ablation studies are conducted to justify the design choices of NodeFlow. In conclusion, NodeFlow’s end-to-end training process and strong performance make it a compelling solution for practitioners and researchers. Additionally, it opens new avenues for research and application in the field of probabilistic regression on tabular data.

Securing the structural safety of blades has become crucial, owing to the increasing size and weight of blades resulting from the recent development of large wind turbines. Composites are primarily used for blade manufacturing because of their high specific strength and specific stiff-ness. However, in composite blades, joints may experience fractures from the loads generated during wind turbine operation, leading to deformation caused by changes in the structural stiff-ness. In this study, 7,132 debonding damage data, classified by damage type, position, and size, are selected to predict debonding damage based on natural frequency. The change in the natural frequency caused by debonding damage is acquired through finite element (FE) modeling and modal analysis. Synchronization between the FE analysis model and manufactured blades is achieved through modal testing and data analysis. Finally, the relationship between the debond-ing damage and the change in natural frequency is examined using artificial neural network techniques

Sparse training (ST) aims to ameliorate deep learning by replacing fully connected artificial neural networks (ANNs) with sparse or ultra-sparse ones, such as brain networks are, therefore it might benefit to borrow brain-inspired learning paradigms from complex network intelligence theory. Here, we launch the ultra-sparse advantage challenge, whose goal is to offer evidence on the extent to which ultra-sparse (around 1% connection retained) topologies can achieve any leaning advantage against fully connected. Epitopological learning is a field of network science and complex network intelligence that studies how to implement learning on complex networks by changing the shape of their connectivity structure (epitopological plasticity). One way to implement Epitopological (epi- means new) Learning is via link prediction: predicting the likelihood of non-observed links to appear in the network. Cannistraci-Hebb learning theory inspired the CH3-L3 network automata rule for link prediction which is effective for general-purpose link prediction. Here, starting from CH3-L3 we propose Epitopological Sparse Meta-deep Learning (ESML) to apply Epitopological Learning to sparse training. In empirical experiments, we find that ESML learns ANNs with ultra-sparse hyperbolic (epi-)topology in which emerges a community layer organization that is meta-deep (meaning that each layer also has an internal depth due to power-law node hierarchy). Furthermore, we discover that ESML can in many cases automatically sparse the neurons during training (arriving even to 30% neurons left in hidden layers), this process of node dynamic removal is called percolation. Starting from this network science evidence, we design Cannistraci-Hebb training (CHT), a 4-step training methodology that puts ESML at its heart. We conduct experiments on 7 datasets and 5 network structures comparing CHT to dynamic sparse training SOTA algorithms and the fully connected counterparts. The results indicate that, with a mere 1% of links retained during training, CHT surpasses fully connected networks on VGG16, GoogLeNet, ResNet50, and ResNet152. This key finding is an evidence for ultra-sparse advantage and signs a milestone in deep learning. CHT acts akin to a gradient-free oracle that adopts CH3-L3-based epitopological learning to guide the placement of new links in the ultra-sparse network topology to facilitate sparse-weight gradient learning, and this in turn reduces the convergence time of ultra-sparse training. Finally, CHT offers the first examples of parsimony dynamic sparse training because, in many datasets, it can retain network performance by percolating and significantly reducing the node network size. Our code is available at: https://github.com/biomedical-cybernetics/Cannistraci-Hebb-training.

This article focuses on generating an alternative in order to identify traffic officers during driving. This research employed the latest You Only Look Once (YOLO) model, using a six-phase methodology: data collection, data preparation involving resizing and labeling, implementation of various filters to avoid overfitting, model training, prediction evaluation, and result interpretation. The YOLO model was applied across three iterations using a dataset of 1862 images. To enhance training efficiency and detection speed, the graphics processing unit (GPU) acceleration was utilized, further enhancing the experimental process. The results of this study revealed that the YOLOv8x variant produced the most promising results. This proposed model attained a remarkable F1 score of 0.95, bolstered by a confidence score of 0.631, with the potential for an increase to 0.80 in confidence without significantly compromising the F1-score. These findings are poised to make a substantial contribution to the broader research landscape, particularly in advancing the effectiveness of detection models for traffic officers.

Breast cancer stands as a predominant health concern for women globally. As mammography is the primary screening tool for breast cancer detection, improving the detection of breast cancer at screening could save more lives. This mammography re-view paper provides a systematic review of computer-aided techniques during a specific time frame for the segmentation and classification of microcalcification, evaluating image processing, machine learning, and deep learning techniques. The systematic review is meticulously carried out, adhering closely to the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This article focuses on mammographic breast cancer detection approaches based on automated systems, discussed chronologically from 1970 through 2023. This article encompasses the breadth of artificial intelligence-based methods from the most primitive to the most sophisticated models. Image processing and machine learning-based methods are compre-hensively reviewed. The evaluation of a deep learning architecture based on self-extracted features for classification tasks demonstrated outclass performance. Large-scale datasets required for a broader and in-depth analysis of novel methods for breast cancer detection are also discussed in this article. This research work is aligned with the United Nations' sustainability de-velopment goals.

The intricate architecture of dendritic arborization is fundamental to the formation and functionality of neural networks, serving as the primary site for synaptic integration and signal propagation. This study presents a pioneering computational model that simulates dendritic growth dynamics, employing exponential and logarithmic scaling over an extended developmental period of 720 days. This model offers a valuable tool for investigating the implications of diverse dendritic growth patterns on neural development, synaptic connectivity, and ultimately, cognitive functions. The computational framework incorporates biologically plausible parameters, allowing for the systematic exploration of dendritic branching patterns and their potential impact on neuronal information processing. By simulating exponential and logarithmic growth scales, the model captures the inherent complexity and diversity of dendritic morphologies observed in various neuronal populations across different brain regions. The findings from this study hold significant implications for our understanding of neural circuit assembly, synaptic integration, and the potential functional consequences of aberrant dendritic growth patterns observed in neurodevelopmental disorders. Furthermore, the model's ability to simulate extended developmental trajectories over a prolonged period of 720 days offers insights into the dynamic interplay between dendritic growth and synaptic pruning, which is crucial for the refinement and optimization of neural networks.

Adult neurogenesis involves generation of functional neurons from neural progenitor cells, which have the potential to complement and restore damaged neurons and neural circuits. Therefore, the development of drugs that stimulate neurogenesis represents a promising strategy in stem cell therapy and neural regeneration, greatly facilitating the reconstruction of neural circuits in cases of neurodegeneration and brain injury. Our study reveals that compound A5, previously designed and synthesized by our team, exhibits remarkable neuritogenic activities, effectively inducing neurogenesis in neural stem/progenitor cells (NSPCs). Subsequently, transcriptome analysis using high-throughput Illumina RNA-seq technology was performed to further elucidate the underlying molecular mechanisms by which compound A5 promotes neurogenesis. Notably, comparative transcriptome analysis showed that the up-regulated genes were mainly associated with neurogenesis and the down-regulated genes were mainly concerned with cell cycle progression. Furthermore, we confirmed that compound A5 significantly affected the expression of transcription factors related to neurogenesis and cell cycle regulatory proteins. Collectively, these findings identify a new compound with neurogenic activity and may provide insights into drug discovery for neural repair and regeneration.

Facial Emotion Recognition (FER) is crucial across psychology, neuroscience, computer vision, and machine learning due to the diversified and subjective nature of emotions, varying considerably across individuals, cultures, and contexts. This paper investigates the impact of histogram equalization, data augmentation and model optimization strategies on three well-known FER datasets using pre-trained VGG models. Additionally, this paper showcases the effectiveness of different regularization techniques, callbacks, and learning schedulers in enhancing model performance by conducting extensive experiments. The model evaluation is discussed in terms of the following metrics: Accuracy, Area Under the Receiver Operating Characteristic Curve (AUC-ROC), Area Under the Precision-Recall Curve (AUC-PRC), and Weighted F1 score. Notably, the fine-tuned VGG models exhibit state-of-the-art performance compared to more complex conventional transfer learning models resulting in accuracies of 100%, 95.92%, and 69.65% on the CK+, KDEF, and FER2013 datasets, respectively.

Despite their relatively low incidence globally, CNS tumors remain amongst the most lethal cancers, with only a few other malignancies surpassing them in 5-year mortality rates. Treatment decisions for brain tumors heavily rely on histopathological analysis, particularly intraoperatively, to guide surgical interventions and optimize patient outcomes. Frozen sectioning has emerged as a vital intraoperative technique, allowing for highly accurate, rapid analysis of tissue samples, although it poses challenges regarding interpretive errors and tissue distortion. Raman histology, based on Raman spectroscopy, has shown great promise in providing label-free, molecular information for accurate intraoperative diagnosis, aiding in tumor resection and identification of neurodegenerative disease. Techniques including Stimulated Raman Scattering (SRS), Coherent Anti-Stokes Raman Scattering (CARS), Surface-Enhanced Raman Scattering (SERS), and Tip-Enhanced Raman Scattering (TERS) have profoundly enhanced the speed and resolution of Raman imaging. Similarly, Confocal Laser Endomicroscopy (CLE) allows for real-time imaging and rapid intraoperative histologic evaluation of specimens. While CLE is primarily utilized in gastrointestinal procedures, its application in neurosurgery is promising, particularly in the context of gliomas and meningiomas. This review focuses on discussing the immense progress in intraoperative histology within neurosurgery and provides insight into the impact of these advancements on enhancing patient outcomes..

This work presents a novel approach for the study of the movement of droplets on inclined surfaces under the influence of gravity and chemical heterogeneities. The developed numerical methodology uses data-driven modeling to extend the applicability limits of an analytically derived reduced-order model for the contact line velocity. More specifically, while the reduced-order model is able to capture the effects of the chemical heterogeneities to a satisfactory degree, it does not account for gravity. To alleviate this shortcoming, datasets generated from direct numerical simulations are used to train a data-driven model for the contact line velocity, which is based on the Fourier neural operator and corrects the reduced-order model predictions to match the reference solutions. This hybrid surrogate model, which comprises of both analytical and data-driven components, is then integrated in time to simulate the droplet movement, offering a speedup of five orders of magnitude compared to direct numerical simulations. The performance of this hybrid model is quantified and assessed in different wetting scenarios, by considering various inclination angles and values for the Bond number, demonstrating the accuracy of the predictions as long as the adopted parameters lie within the ranges considered in the training dataset.

Diabetic retinopathy (DR) is the primary factor leading to vision impairment and blindness in diabetic people. Uncontrolled diabetes can damage the retinal blood vessels. Initial detection and prompt medical intervention are vital in preventing progressive vision impairment. Today's growing medical field poses more significant workload and diagnostic demands on medical professionals. In the proposed study, a convolutional neural network (CNN) is employed to detect the stages of DR. This research is crucial for studying DR because of its innovative methodology incorporating two different public datasets. This strategy enhances the model's capacity to generalize unseen DR images, as each dataset encompasses unique demographics and clinical circumstances. The network can learn and capture complicated hierarchical image features with asymmetric weights. Each image undergoes preprocessing using contrast-limited adaptive histogram equalization (CLAHE) and the discrete wavelet transform (DWT). The model is trained and validated using the combined datasets of Dataset for Diabetic Retinopathy (DDR) and the Asia Pacific Tele-Ophthalmology Society (APTOS). The CNN model is tuned with different learning rates and optimizers. The CNN model with Adam optimizer achieved 70% accuracy and an area under curve (AUC) score of 0.82. The recommended study results may reduce diabetes-related vision impairment by early DR severity identification.

In the age of social media, images come from unreliable sources that may change their content to fit a narrative. Automated detection of forged images is a complex task, especially considering recent technological advances in image manipulation software. However, in the existing literature, it is possible to identify two general approaches adopted by detection methods, active and passive. Active techniques preemptively act on an image by inserting structures before any manipulation is made that can verify its authenticity. In contrast, passive methods analyze the content of an image in search of traces of manipulation. In this way, this research proposes a novel approach to image manipulation detection, combining two passive methods through neural networks, creating a generalist approach capable of detecting with greater accuracy than the methods that compose it. Furthermore, this work used a combination of four datasets available in the literature for training and evaluation. After training, the merged approach obtained an accuracy of 89.59% in the set of validation images, significantly higher than the model trained with only unaltered images, which obtained 78.64%, and the two other models trained using images with a feature selection method applied to enhance inconsistencies that obtained 68.02% for Error-Level Analysis images and 50.70% for the method using Discrete Wavelet Transform. In addition to the performance improvement, the proposed approach’s accuracy variation was lower than the other models.

The exceptional performance advantages of the fiber optic gyroscope (FOG) position it as a dominant player in middle and high-end inertial navigation systems. To prevent the loss of sensor precision caused by algorithm design and simplify the complex modeling strategy in traditional methods. We gradually demonstrate the significant role of Convolutional Neural Network (CNN) in the navigation system based on FOG, and utilize the particle swarm optimization algorithm (PSO) to expedite the convergence of the network. The experimental results demonstrate that the initial alignment method based on deep learning is more accurate than the traditional method. The attitude angle error is reduced by 81.25%, 92.54% and 36.53% respectively. The research provides support for the future application of deep learning in optical navigation systems.

In this paper, a class of coupled competitive neural networks, which subject to disturbance and discontinuous activation functions, is concerned. To realize the fixed-time quasi-bipartite synchronization, an aperiodic intermittent controller is initially designed. Subsequently, by combining the fixed-time stability theory and nonsmooth analysis, several criteria are established to ensure the bipartite synchronization in fixed time. Moreover, synchronization error bounds and settling time estimates are provided. Finally, numerical simulations are presented to verify the main results.

This study introduces a cybernetic control and architectural framework for a robotic fish avatar operated by a human. The behavior of the robot fish is influenced by the electromyographic (EMG) signals of the human operator, triggered by stimuli from the surrounding objects and scenery. An deep artificial neural network (ANN) with perceptrons classifies EMG signals, discerning the type of muscular stimuli generated. The research unveils a fuzzy-based oscillation patterns generator (OPG) designed to emulate functions akin to a neural central pattern generator, producing coordinated fish undulations. The OPG generates swimming behavior as an oscillation function, decoupled into coordinated step signals, right and left, for a dual electromagnetic oscillator in the fish propulsion system. Furthermore, the research presents an underactuated biorobotic mechanism of the subcarangiform type, comprising a two-solenoid electromagnetic oscillator, an antagonistic musculoskeletal elastic system of tendons, and a multi-link caudal spine composed of helical springs. The biomechanics dynamic model and control for swimming, as well as the ballasting system for submersion and buoyancy, are deduced. Experimental results encompass EMG pattern recognition, OPG, and coordinated fish locomotion, with additional topics illustrated through numerical simulations.

The article describes machine learning using artificial neural networks (ANN) to develop the parameters of the friction stir welding (FSW) process for three types of aluminum joints (EN AW 7075). A total of 608 experimental data were used to build the ANN. Two types of networks were built: the first one was used to classify good/bad connections with the MLP 7-19-2 topology, the second one was used to regress the tensile load-bearing capacity with the MLP 7-19-1 topology. Selected parameters of the FSW process were used as input data for ANN training: rotational speed, welding speed, joint and tool geometry. Based on a case study, the quality of the FSW joint was assessed in terms of microstructure and mechanical properties. The usefulness of both trained neural networks has been demonstrated. For the regression network, the quality of the validation set was approximately 93.6%. In the case of confusion matrix for the test set, errors never exceeded 6%. Only 184 epochs were needed to train the regression network. The quality of the validation set was approximately 87.1%. On their basis, predictive maps were developed and presented in the work allowing for the selection of optimal parameters of the FSW process for three types of joints.

AliAmbra is a project developed to explore and promote high-quality catches of the Amvrakikos Gulf GP to Artas’ wider regions. In addition, this project aimed to implement an integrated plan of action, to form a business identity with high-added value and achieve integrated business services adapted to the special characteristics of the area. The action plan for this project was to actively search for new markets, create a collective identity for the products, promote their quality and added value, engage in gastronomes and tasting exhibitions, dissemination and publicity actions, as well as enhance the quality of the products and markets based on the customer needs. The primary focus of this publication is to observe and analyze the data retrieved from various tasting exhibitions of the AliAmbra project, with a target goal of improving customer experience and product quality.

The Spiking Neural Network (SNN) has attracted more and more attention recently. It adopts binary spike signals to transmit information. Benefitting from the information passing paradigm of SNNs, the multiplications of activations and weights can be replaced by additions, which are more energy-efficient. However, its ``Hard Reset" mechanism for the firing activity would ignore the difference among membrane potentials when the membrane potential is above the firing threshold, causing information loss. Meanwhile, quantifying the membrane potential to 0/1 spikes at the firing instants will inevitably introduce the quantization error thus bringing about information loss too. To address these problems, we propose to use the ``Soft Reset" mechanism for the supervised training-based SNNs, which will drive the membrane potential to a dynamic reset potential according to its magnitude, and Membrane Potential Rectifier (MPR) to reduce the quantization error via redistributing the membrane potential to a range close to the spikes. Results show that the SNNs with the ``Soft Reset" mechanism and MPR outperform their vanilla counterparts on both static and dynamic datasets.

During geomagnetic storms, which are a result of solar wind interaction with the Earth’s magnetosphere, geomagnetically induced currents (GICs) begin to flow in the long-distance high-voltage power grids on the Earth’s surface. It causes a number of negative phenomena that affect the normal operation of the entire electric power system. To investigate the nature of the phenomenon and its possible effects on transformers, a GIC monitoring system was created in 2011, the devices of which were installed at five substations of the Kola-Karelian power transit in northwestern Russia. Over 12 years of operating the system a large amount of data has been accumulated, which cannot be analyzed manually within a reasonable amount of time. To analyze the constantly growing volume of recorded data effectively, a method for automatic classification of GIC in autotransformer neutral was proposed. The method is based on a continuous wavelet transform of the neutral current data combined with a convolutional neural network (CNN) to classify the obtained scalogram images. As the result of comparing four CNNs with different architectures, a model that showed excellent GIC classification performance on the validation set (100.00% accuracy and loss of 0.0115) was chosen.

Lithium-ion batteries are key elements in the development of electrical energy storage solutions. However, due to cycling, environmental and operating conditions, battery capacity tends to degrade over time. Capacity fade is a common indicator of battery state of health (SOH) because it is an indication of how capacity has been degraded. However, battery capacity cannot be measured directly, so there is an urgent need to develop methods for estimating battery capacity in real time. By analyzing the historical data of a battery in detail, it is possible to predict the future state of the battery and forecast its remaining useful life. This paper develops a real-time, simple and fast method to estimate the cycle capacity of a battery during the charge cycle using only data from a short period of each charge cycle. This proposal is attractive because it does not require data from the entire charge period, since batteries are rarely charged from zero to full. The proposed method allows simultaneous and accurate real-time prediction of the health and remaining useful life of the battery over its lifetime. The accuracy of the proposed method has been tested using experimental data from several lithium-ion batteries with different cathode chemistries under various test conditions.

In this paper, we present a groundbreaking methodology in the realm of aspect-level sentiment analysis, which capitalizes on the advanced capabilities of graph-based neural networks. Our approach, distinguished as the Aspect Correlation Graph Network (ACGN), represents a significant departure from conventional models. These traditional models often analyze aspects in isolation, failing to capture the intricate web of sentiment relationships that may exist within a single sentence. ACGN, however, is designed to address this gap by employing a sophisticated bidirectional attention mechanism, integrated with positional encoding. This unique combination not only enhances the model's ability to focus on relevant parts of the sentence but also aids in constructing detailed, aspect-focused representations. These representations are particularly crucial for understanding the nuanced interplay of sentiments associated with different aspects. Central to our model's architecture is the incorporation of a graph convolutional network. This network serves as a pivotal component in mapping and analyzing the complex network of sentiment correlations that can exist among various aspects within sentences. Through this integration, ACGN is able to unearth and interpret the subtle and often overlooked sentiment dynamics that traditional models might miss. Our comprehensive evaluations of the Aspect Correlation Graph Network, conducted using the SemEval 2014 datasets, have yielded promising results. These findings demonstrate a clear and significant advancement over the capabilities of existing models. Particularly, the results underscore the critical importance and utility of recognizing and understanding the connections between sentiments of different aspects in text analysis. This insight opens new avenues in the field of sentiment analysis, suggesting a broader application potential of ACGN in various contexts where understanding nuanced sentiment relationships is key. Overall, our study not only introduces a novel approach in aspect-level sentiment analysis but also sets a new standard for future research in this area. By highlighting the integral role of inter-aspect sentiment connections, ACGN paves the way for more sophisticated and accurate sentiment analysis tools, capable of handling the complexities of natural language with greater finesse and precision.

The paper illustrates a general framework in which a neural network application can be easily integrated and proposes a traffic forecasting approach that uses neural networks based on graphs. The method minimizes the communication network (between vehicles and the database servers) load and represents a reasonable trade-off between communication network load and forecasting accuracy. Traffic prediction leads to the choice of less congested routes and therefore to the reduction of energy consumption. The traffic is forecasting using a LTSM neural network with a regression layer. The inputs of the neural network are sequences - obtained from graph that represent the road network - at specific moments of time that are read from traffic sensors or the outputs of neural network (forecasting sequences). The input sequences can be filtered to improve the forecasting accuracy. This general framework is based on Contiki IoT operating system that ensure support for wireless communication and efficient implementation of processes in a resource constrained system and it is particularized to implement a graph neural network. Two cases are studied: one case in which the traffic sensors are periodically read and the other case in which the traffic sensors are read when their values changes are detected. A comparison between the cases is made and the influence of filtering is evaluated. The obtained accuracy is very good, very close to the accuracy obtained in infinite precision simulation, and the computation time is low enough and the system can work in real time.

In this paper, we demonstrate that fixed-weight layers, generated from random distribution or logistic functions, can effectively extract significant features from input data, resulting in high accuracy on a variety of tasks, including Fisher’s iris, Wisconsin Breast Cancer, and MNIST datasets. We have observed that logistic functions yield high accuracy with less dispersion in results. We have also assessed the precision of our approach under conditions of minimizing spikes number generated in the network, it is a practically useful for reducing energy consumption in spiking neural networks. Our findings reveal that the proposed method demonstrates a highest accuracy on Fisher’s iris and MNIST datasets with logistic regression. Furthermore, they surpass the accuracy of the conventional (non-spiking) approach using logistic regression in the case of Wisconsin Breast Cancer. We have also investigated the impact of non-stochastic spike generation on accuracy.

In the field of maneuvering target tracking, the combined observations of azimuth and Doppler may cause weak observation or non-observation in the application of traditional target tracking algorithms. Additionally, traditional target-tracking algorithms require pre-defined multiple mathematical models to accurately capture the complex motion states of targets, while model mismatch and unavoidable measurement noise lead to significant errors in target state prediction. To address those above challenges, in recent years, the target-tracking algorithms based on neural networks, such as recurrent neural networks (RNNs), long short-term memory (LSTM) networks, and Transformer architectures, have been widely used for their unique advantages to achieve accurate predictions. To better model the nonlinear relationship between the observation time series and the target state time series, as well as the contextual relationship among time series points, we present a deep learning algorithm called recursive downsample-convolve-interact neural network (RDCINN) based on convolutional neural network (CNN) that downsamples time series into sub-sequences and extracts multi-resolution features to enable the modeling of complex relationships between time series, which overcomes the shortcomings of traditional target-tracking algorithms in using observation information inefficiently due to weak observation or non-observation. The experimental results show that our algorithm outperforms other existing algorithms in the scenario of strong maneuvering target tracking with the combined observations of azimuth and Doppler.

Keywords: Аrtificial neural network, electric drive system, database, stability, training algorithm, technological mechanisms.

Audio recording in classrooms is a common practice in educational research, with applications ranging from detecting classroom activities to analysing student behaviour. Previous research has employed neural networks for classroom activity detection and speaker role identification. However, these recordings are often affected by background noise that can hinder further analysis, and the literature has only sought to identify noise with general filters and not specifically designed for classrooms. Although the use of high-end microphones and environmental monitoring can mitigate this problem, these solutions can be costly and potentially disruptive to the natural classroom environment. In this context, we propose the development of a neural network model that can specifically detect and filter out background noise in classroom recordings. This model would allow the use of lower quality recordings without compromising analysis capability, thus facilitating data collection in natural educational environments and reducing the costs associated with high-end recording equipment.

Next-generation cancer and oncology research needs to take full advantage of the multi-modal structured, or graph, information, with the graph datatypes ranging from molecular structures to spatially resolved imaging and digital pathology to biological networks to knowledge graphs. Graph Neural Networks (GNNs) efficiently combine the graph structure representations with the high predictive performance of deep learning, especially on the large multi-modal datasets. In this review article, we survey the landscape of recent (2020-present) GNN applications in the context of cancer and oncology research, and delineate six currently predominant research areas. Subsequently, we identify the most promising directions for future research. We compare GNNs with graphical models and "non-structured" deep learning, and devise the guidelines for cancer and oncology researchers or physician-scientists asking the question of whether they should adopt the GNN methodology in their research pipelines.

Although adults and children differ in self-versus-other perception, the developmental perspective on this discriminative ability is missing. We compared neural activation of self-vs-others in 39 participants of 4 different age groups (4 yo. to adulthood). Two brain regions, the MCC and right postcentral gyrus, exhibited respectively non-linear and gradual gains in discriminative abilities for self-vs-others stimuli. These regions play critical roles in self-referential processing, empathy, and social cognition. Nine brain regions showed linear increase for others-vs-self stimuli. These regions are associated with multisensory processing, somatosensory skills, complex visual stimuli, self-awareness, empathy, theory of mind, and social recognition. Understanding the neural basis of self-vs-others discrimination during development can inform when and how social contexts support learning processes during childhood and adolescence.

In Holter monitoring, the precise detection of standard heartbeats and Ventricular Premature Contractions (PVCs) is paramount for accurate cardiac rhythm assessment. This study introduces a novel application of the 1D U-Net neural network architecture aimed at enhancing PVC detection in Holter recordings. Training data comprised the Icentia11k, INCART DB, and our custom dataset. The model’s efficacy was subsequently validated against traditional Holter analysis methodologies across multiple databases, including AHA DB, MIT 11 DB, NST, and another custom dataset encompassing challenging real-world examples. The results underscored the 1D U-Net model’s prowess in QRS complex detection, achieving near-perfect balanced accuracy scores across all databases. PVC detection exhibited variability, with balanced accuracy scores ranging from 0.909 to 0.986. Despite some databases, like the AHA DB, showcasing lower sensitivity metrics, their robust balanced accuracy accentuates the model’s equitable performance in discerning both false positives and negatives. In conclusion, while the 1D U-Net architecture is a formidable tool for QRS detection, there’s a clear avenue for further refinement in its PVC detection capability, given the inherent complexities and noise challenges in real-world PVC occurrences.

In South Korea, demolition waste (DW) management has become increasingly significant owing to the rising number of old buildings. Effective DW management requires an efficient approach that accurately quantifies and predicts the generation of DW (DWG) of various types, which necessitates access to the required information or technology capable of achieving this. Hence, we developed an artificial intelligence-based model that predicts the generation of ten DW types, specifically from buildings in redevelopment areas. We used an artificial neural network algorithm with < 10 neurons in the hidden layer to derive individual input variables and optimal hyperparameters for each DW type. All DWG prediction models achieved an average validation and test prediction performance (R²) of 0.970 and 0.952, respectively, with their ratios of percent deviation ≥ 2.5, ver-ifying them as excellent models. Moreover, a Shapley additive explanations analysis revealed that DWG was most impacted by the floor area for all the DW types, with a positive correlation with DWG. Conversely, other factors showed either a positive or negative correlation with DWG de-pending on the DW type. The study findings will enable demolition companies and local gov-ernments in making informed decisions for efficient DW management and resource allocation by accurately predicting the generation of various types of DW.

Iron ore processing involves critical steps that affect the quality of the final product. Determining the diameter of the pellets is the necessary initial step for volume measurement and, ultimately, for porosity and bulk density measurement, crucial characteristics for optimizing the burning process in the blast furnace. Traditional measurement methods using mercury present issues related to operator safety and environmental preservation, while the practices described in ISO 4698 standard require lengthy preparation and execution time. In light of environmental needs, operator safety, and the time consumed in tests, implementing a new method based on digital image processing and convolutional neural networks for measuring the diameter of burnt iron ore pellets is proposed. The methodology involves capturing images of the pellets using a high-resolution camera and utilizing digital image processing and neural networks capable of performing pixel-by-pixel object segmentation in the images, providing precise information about the pellets to calculate their volume automatically. The results were compared with those obtained using traditional methods, evaluating their conformity with the ISO 4698 standard. In conclusion, this study offers a new approach to measuring the volume of burnt iron ore pellets, providing accurate and reliable results in compliance with safety and environmental preservation standards.

An important indicator of human-related pollution in watersheds is dissolved oxygen (DO). The DO is highly dependent on both space and time characteristics of the watershed and is directly linked to eutrophication, which impairs the development of both the aquatic fauna and flora, also negatively impacting the water quality. Aspiring to reach a more accurate and precise forecasting approach to predict levels of DO, the present work proposes new graph-based and transformer-based deep learning models. The models were trained and validated for the Credit River Watershed, and the results were compared with both benchmarking and literature-found approaches. The proposed Graph Neural Network Sample and Aggregate (GNN-SAGE) model was the best-performing approach, reaching coefficient of determination (R2) and Root Mean Squared Error (RMSE) values of 97% and 0.34 ppm, respectively. The findings from the Shapley additive explanations (SHAP) indicated that the GNN-SAGE benefited from spatiotemporal information from the surrounding stations, improving the model’s results, and that temperature is a major input attribute for determining future DO levels. The results established that the proposed GNN-SAGE model stands as a state-of-the-art solution for DO forecasting, with potential for real-time water quality applications.

Axonal degeneration resulting from optic nerve damage can lead to the progressive death of retinal ganglion cells (RGCs), culminating in irreversible vision loss. We contrasted two methods for inducing optic nerve damage: optic nerve compression (ONCo) and optic nerve crush (ONCr). These were assessed for their respective merits in simulating traumatic optic neuropathies and neurodegeneration. We also administered neural progenitor cells (NPCs) into the subtenon space to validate their potential in mitigating optic nerve damage. Our findings indicate that both ONCo and ONCr successfully induced optic nerve damage, as shown by increased ischemia and expression of genes linked to neuronal regeneration. Post NPCs injection, recovery in the expression of neuronal regeneration-related genes was more pronounced in the ONCo model than in the ONCr model, while inflammation-related gene expression saw a better recovery in ONCr. In addition, proteomic analysis of R28 cells in hypoxic conditions identified Vps35 and Syntaxin12 genes. Vps35 preserved mitochondrial function in ONCo, while Syntaxin12 appeared to restrain inflammation via the Wnt/β-catenin signaling pathway in ONCr. NPCs managed to restore damaged RGCs by elevating neuroprotection factors and controlling inflammation through mitochondrial homeostasis and Wnt/β-catenin signaling in hypoxia-injured R28 cells and in both animal models. Our results suggest that ischemic injury and crush injury cause optic nerve damage via different mechanisms, which can be effectively simulated using ONCo and ONCr, respectively. Moreover, cell-based therapies such as NPCs may offer promising avenues for treating various optic neuropathies, including ischemic and crush injuries.

The enteric nervous system (ENS) is principally derived from vagal neural crest cells that migrate caudally along the entire length of the gastrointestinal tract, giving rise to neurons and glial cells in two ganglionated plexuses. Incomplete migration of enteric neural crest-derived cells (ENCDC) leads to Hirschsprung disease, a congenital disorder characterized by the absence of enteric ganglia along variable lengths of the colorectum. Our recent data [1] support an essential role for the avian ceca, present at the junction of midgut and hindgut, in hindgut ENS development, since ablation of the cecal buds leads to incomplete ENCDC colonization of the hindgut. In situ hybridization shows bone morphogenetic protein-4 (BMP4) highly expressed in the cecal mesenchyme, leading us to hypothesize that cecal BMP4 is required for hindgut ENS development. To test this, we modulated BMP4 activity using embryonic intestinal organ culture techniques and retroviral infection in ovo. We show that overexpression or inhibition of BMP4 in the ceca disrupts hindgut ENS development, with GDNF playing an important regulatory role. Our results suggest that these two important signaling pathways are required for normal ENCDC migration and enteric ganglion formation in the developing hindgut ENS.

For autonomous driving, perception is a primary and essential element that fundamentally deals with the insight into the ego vehicle’s environment through sensors. Perception is a challenging task suffering from dynamic objects and continuous environmental changes. The issue gets worse due to interrupting the quality of perception by adverse weather like snow, rain, fog, night light, sand storm, strong daylight, etc. In this work, we have tried to improve camera-based perception accuracy, such as autonomous driving-related object detection in adverse weather. We proposed the improvement of YOLOv8-based object detection in adverse weather through transfer learning using merged data from various harsh weather datasets. Two prosperous open-source datasets (ACDC and DAWN) and their merged dataset were used to detect primary objects on the road in harsh weather. A set of training weights were collected from training on the individual datasets, their merged version, and several subsets of those datasets according to their characteristics. A comparison between the training weights also occurred by evaluating the detection performance on the above-mentioned datasets and their subsets. The evaluation revealed that using custom datasets for training significantly improves the detection performance compared to the YOLOv8 base weights. And using more images through the feature-related data merging technique steadily increases the object detection performance.

Understanding park events and their categorization offer pivotal insights into urban parks and their integral roles in cities. This study utilized images and event category data from the New York City Parks Events Listing database to train a Convolutional Neural Network (CNN) for image-based park event categorization. Different CNN models were tuned to complete this multi-label classification task, their performances compared. Preliminary results underscore the efficacy of deep learning in automating the event classification process, revealing the multifaceted activities within urban green spaces. The CNN showcased proficiency in discerning various event nuances, emphasizing the diverse recreational and cultural offerings of urban parks. Such categorization has potential applications in urban planning, aiding decision-making processes related to resource distribution, event coordination, and infrastructure enhancements tailored to specific park activities.

This study will lead to the development of a numerical data set that will assist in the design of Savonius wind turbines. A major objective of this study is to develop a better design for Savonius turbine blades in order to increase their torque coefficients, rotational speeds, and pressure coefficients. As part of the experimental design methodology, a full dataset was generated by simulating three-dimensional scale models utilizing computational fluid dynamics (CFD) simulations that were validated by wind tunnel data. This process is multi-objective optimization for optimizing turbine performance. The twist angle, aspect ratio, and overlap ratio are all important factors in determining the optimal torque and power coefficients. The group method of data handling (GMDH) algorithm was utilized to model objective functions based on input-output data. The Pareto fronts were plotted using polynomial models obtained from the evolutionary Pareto-based optimization approach (modified NSGA-II), and the optimal commercial points were determined using TOPSIS. A comparison of three- and two-objective optimization data revealed that two-objective optimization data lie within the boundaries of a three-objective optimization problem. The torque coefficient, rotational speed, and power coefficient are all improved by 13.74%, 0.071%, and 5.32%, respectively, using multi-objective optimization. As a result of the multi-objective optimization of the turbine, some significant characteristics of objective functions were discovered.

There has been considerable progress in implicit neural representation to upscale an image to any arbitrary resolution. However, existing methods are based on defining a function to predict the RGB value from just four specific loci. Relying on just four loci is insufficient as it leads to losing fine details from the neighboring region(s). We show that by taking into account the semi-local region leads to an improvement in performance. In this paper, we propose applying a new technique called Overlapping Windows on Semi-Local Region (OW-SLR) to an image to obtain any arbitrary resolution by taking the coordinates of the semi-local region around a point in the latent space. This extracted detail is used to predict the RGB value of a point. We illustrate the technique by applying the algorithm to the Optical Coherence Tomography-Angiography (OCT-A) images and show that it can upscale them to random resolution. This technique outperforms the existing state-of-the-art methods when applied to the OCT500 dataset. OW-SLR provides better results for classifying healthy and diseased retinal images such as diabetic retinopathy and normals from the given set of OCT-A images. The project page is available at https://rishavbb.github.io/ow-slr/index.html

This study focuses on the impact of weak partial discharges (PDs) on defect recognition accuracy in epoxy resin through phase-resolved partial discharge (PRPD) analysis. Two measurement conditions are compared until PRPD pattern saturation: one-minute and one-hour durations. The PD data specifically target three void types located at different positions within the epoxy material. The aim is to evaluate how the presence of weak PDs at the PD extinction voltage (PDEV) influences defect recognition accuracy. This research sheds light on the potential implications of neglecting the significance of weak PD signals in defect detection. A convolutional neural network (CNN) model is trained using PRPD data recorded at the PD inception voltage (PDIV) and tested using the new PRPD data from both conditions recorded from a lower PDIV to a PDEV. The trained CNN model achieves a defect recognition accuracy of 100% for a one-hour duration, highlighting the importance of not neglecting weak PD signals. This emphasizes the significance of extended measurement duration and pattern saturation in capturing and analyzing weak PD signals for improved defect recognition. This study contributes to the advancement of practical applications by understanding the behavior of the epoxy material and enhancing defect detection techniques.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

This paper presents the use of Graph Neural Networks (GNNs) to predict the tensile strength of Fused Deposition Modeling (FDM) specimens. In the present work, there are four main input parameters i.e. Infill percentage, Layer height, Print speed and Extrusion temperature while the Tensile Strength is an output parameter were considered. This study includes use of central composite design based response surface methodology to finalize the experimental layout. 3D printed specimen were manufactured as per the ASTM E8 standard on FDM printer using Polylactic Acid (PLA) as filament. Micro-tensile test were performed on the printed specimen as per ASTM E8 standard. The GNN algorithm was trained on a dataset of FDM specimens, achieving a mean squared error (MSE) of 2.47, mean absolute error (MAE) of 1.14, and R-squared value of 0.78. An adjacency matrix, which shows the connections between nodes in a graph. The obtained plot for nodes and weights in a GNN provide valuable information about the model and its performance. The results show the potential of using GNNs in predicting the mechanical properties of additively manufactured specimens and provide a promising direction for further research in this field.

Blasting pattern optimization is an attempt to optimize blast design parameters aiming to achieve optimum fragmentation, reduce mining operating costs as well as environmental side consequences. The present study aims to propose a multi-objective optimization model, employing artificial intelligence and metaheuristics, to simultaneously minimize the mine-to-crusher operating costs and the impact of blasting consequences including fly-rock and back-break. To achieve the purpose of the study, a multi-variable regression model was developed to model total costs from drilling to crushing. In addition to the costs, multilayer perception neural networks were implemented to predict the blast-induced back-break and fly-rock as a function of collected variables such as number of holes, hole length, burden, spacing, hole slope, stemming, blasted rock per hole, powder factor, and charge per delay. High-precise estimations for both back-break and fly-rock were achieved with the average of 99% coefficient of determination for train, test and validation data sets. Then, the developed regression model and the neural networks were used in an optimization framework, employing Grasshopper algorithm, to find the optimum blast design satisfying practical constraints. The proposed model was tested on a lead-zinc open-pit mine, where 1032 blasting patterns were recorded and analyzed. The results of the optimization model provide a Pareto set of solutions, such that any of these solutions can be implemented according to the strategy of the mining operation management team. The blast pattern with the lowest cost, result in a relatively high fly-rock and back-break, while the pattern with low fly-rock and back-break raises the cost by 20.13 % compared the minimum cost blast design.

This study aims to develop novel automated computer vision algorithms and systems for component replacement inspection for Printed Circuit Boards (PCBs). The proposed algorithms are able to identify locations as well as sizes of different components. They are object detection algorithms based on keypoints of the target components. The algorithms can be implemented as neural networks consisting of two portions: frontend networks and backend networks. The frontend networks are used for the feature extractions of input images. The backend networks are adopted for producing component inspection results. Each component class can has its own frontend and backend networks. In this way, the neural model for the component class can be effectively reused for different PCBs. To reduce the computation time for the inference of the networks, different component classes can share the same frontend networks. A two-stage training process is proposed for effectively exploring features of different components for accurate component inspection. The proposed algorithm has the advantages of the simplicity for training data collection, high accuracy for defect detection, and high reusability and flexibility for online inspection. The algorithm is an effective alternative for the automated inspection in smart factory with growing demand for product quality and diversification.

The total tree height (h) and diameter at breast height (dbh) relationship is an essential tool in forest management and planning. The height—diameter (h-dbh) relationship had been studied with several approaches and for several species worldwide. The nonlinear mixed effect modeling (NLMEM) has been extensively used and lately the resilient backpropagation artificial neural network (RBPANN) approach has been a trend topic for modeling this relationship. The artificial neural network (ANN) is a computing system based in artificial intelligence and inspired in biological neural network for supervised learning. In this study the NLMEN and RBPANN approaches were used for modeling the h—dbh relationship for Durango pine species (Pinus durangensis Martínez) in mixed-species forest from Mexico. The total dataset considered 1,000 (11,472 measured trees) randomly selected from 14,390 temporary forest inventory plots and the dataset was randomly divided into two parts; 50% for training and 50% for testing. An unsupervised clustering analysis was used to grouped the dataset into 10 clusters based on k-means clustering method and plot-variables like density, basal area, mean dbh, mean h, quadratic mean diameter, altitude and aspect. The RBPANN was performed for tangent hyperbolicus (RBPANN-tanh), softplus (RBPANN-softplus), and logistic (RBPANN-logistic) activation functions for functions in cross product of the covariate or neurons and the weights for the ANN analysis. For both training and testing, 10 classical statistics (e.g., RMSE, R2, AIC, BIC, logLik) were computed for the residual values and assess the approaches for h—dbh relationship. For training and testing, the ANNs approach outperformed the NLMEM approach, and the RBPANN-tanh has the best performance in both training and testing phases.

Hospital readmission and length of stay prediction provide info to manage hospitals’ bed capacity and the number of required staff, especially during pandemics. We present a hybrid deep model called Genetic Algorithm-Optimized Convolutional Neural Network (GAOCNN) with a unique preprocessing method to predict hospital readmission and the length of stay in patients having various conditions. GAOCNN uses one-dimensional convolutional layers to predict hospital readmission and length of stay. The parameters of the layers are optimized using a genetic algorithm. To show the performance of the proposed model in patients with various conditions, we evaluate the model under three healthcare datasets; the Diabetes 130-US hospitals dataset, the COVID-19 dataset, and the MIMIC-III dataset. The diabetes 130-US hospitals dataset has information on both readmission and the length of stay, while COVID-19 and MIMIC-III datasets just include information on the length of stay. Experimental results show that the proposed model’s accuracy for hospital readmission is 97.2% for diabetic patients. Also, the accuracy of the length of stay prediction is 89%, 99.4%, and 94.1% for diabetic, COVID-19, and ICU patients, respectively. These results confirm the superiority of the proposed model compared to existing methods. Our findings offer a platform for managing healthcare funds and resources for patients with various diseases.

Soil moisture maps are essential for hydrological, agricultural and risk assessment applications. To best meet these requirements, it is essential to develop soil moisture products at high spatial resolution which is now made possible using the free Sentinel-1 (S1) SAR (Synthetic Aperture Radar) data. Some soil moisture retrieval techniques using S1 data relied on the use of a priori weather information in order to increase the precision of soil moisture estimates, which required access to a weather forecasting framework. This paper presents an improved and fully automated solution for high-resolution soil moisture mapping in bare agricultural areas. The proposed solution derives a priori weather information directly from the original Sentinel images, thus bypassing the need for a weather forecasting framework. For soil moisture estimation, the neural network technique was implemented to ensure the optimum integration of radar information. The neural networks were trained using synthetic data generated by the modified Integral Equation Model (IEM) model and validated on real data from two study sites in France and Tunisia. Main findings showed that the use of radar signal averaged over grids of a few km2 in addition to radar signal at plot scale instead of a priori weather information, provides good soil moisture estimations. The accuracy is even slightly better comparatively to the accuracy obtained using a priori weather information.

Grapes are a globally popular fruit, with grape cultivation worldwide being second only to citrus. This article focuses on the low efficiency and accuracy of traditional manual grading of red grape external appearance and proposes a small-sample red grape external appearance grading model based on transfer learning with convolutional neural networks (CNNs). Initially, the CNN transfer learning method was used to transfer the pre-trained AlexNet, VGG16, GoogleNet, InceptionV3, and ResNet50 network models on the ImageNet image dataset to the red grape image grading task. By comparing the classification performance of the CNN models of these five different network depths with fine-tuning, ResNet50 with a learning rate of 0.001 and a loop number of 10 was determined to be the best feature extractor for red grape images. Moreover, given the small number of red grape image samples in this study, different convolutional layer features output by the ResNet50 feature extractor were analyzed layer by layer to determine the effect of deep features extracted by each convolutional layer on SVM classification performance. This analysis helped to obtain a ResNet50+SVM red grape external appearance grading model based on the optimal ResNet50 feature extraction strategy. Experimental data showed that the classification model constructed using the feature parameters extracted from the 10th node of the ResNet50 network achieved an accuracy rate of 95.08% for red grape grading. These research results provide a reference for the online grading of red grape clusters based on external appearance quality and have certain guiding significance for the quality and efficiency of grape industry circulation and production.

Effortful control (EC) describes individual differences in self-regulation, with a strong attentional basis. Moreover, during early childhood EC has a central role on children’s socio-emotional adjustment and academic achievement. The aim of the current study was to predict the development of EC at 36 months of age from early attentional and environmental measures taken in infancy using a machine learning approach. A sample of 75 infants participated in a longitudinal study running different waves of data collection at 6, 9 and 36 months of age. Attentional tasks were administered at 6 months of age and two additional measures were collected at 9 months of age. Parents reported household environment variables during wave 1, and their child’s EC at 36 months. A machine -learning algorithm was implemented to identify children with low EC scores at 36 months of age. An “attention only” model showed greater predictive sensitivity than the “environmental only” model. However, a model including both attentional and environmental variables was able to classify the groups (Low-EC vs Average-to-High EC) with 100% accuracy. Sensitivity analyses indicate that socio-economic variables together with attention control processes at 6-months, and self-restraint capacity at 9-months, are the most important predictors of EC. Results suggest a foundational role of executive attention processes in the development of EC in complex interaction with household environment and provide a new tool to identify early markers of socio-emotional regulation development.

Multivariate predictive analysis of the Stream-Water (SW) parameters (discharge, water level, temperature, dissolved oxygen, pH, turbidity, and specific conductance) is a pivotal task in the field of water resource management during the era of rapid climate change. The highly dynamic and evolving nature of the meteorological and climatic features have a significant impact on the temporal distribution of the SW variables in recent days making the SW variables forecasting even more complicated for diversified water-related issues. To predict the SW variables, various physics-based numerical models are used using numerous hydrologic parameters. Extensive lab-based investigation and calibration are required to reduce the uncertainty involved in those parameters. However, in the age of data-informed analysis and prediction, several deep learning algorithms showed satisfactory performance in dealing with sequential data. In this research, a comprehensive Explorative Data Analysis (EDA) and feature engineering were performed to prepare the dataset to obtain the best performance of the predictive model. Long Short-Term Memory (LSTM) neural network regression model is trained using over several years of daily data to predict the SW variables up to one week ahead of time (lead time) with satisfactory performance. The performance of the proposed model is found highly adequate through the comparison of the predicted data with the observed data, visualization of the distribution of the errors, and a set of error matrices. Higher performance is achieved through the increase in the number of epochs and hyperparameter tuning. This model can be transferred to other locations with proper feature engineering and optimization to perform univariate predictive analysis and potentially be used to perform real-time SW variables prediction.