Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localisation using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localisation system, MM-Loc, relying on zero hand-engineered features, learning them automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures is capable of estimating the location with good accuracy independently. But for better accuracy, a multimodal neural network fusing the features of early modality-specific representations is a better proposition. Our proposed MM-Loc solution is tested on cross-modality samples characterised by different sampling rates and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

The primary cilium plays a pivotal role during embryonic development of vertebrates. It acts as a somatic signaling hub for specific pathways, such as sonic hedgehog signaling. In humans, mutations in genes that cause dysregulation of ciliogenesis or ciliary function lead to severe developmental disorders called ciliopathies. Beyond its obvious role in early morphogenesis, growing evidence points towards an essential function of the primary cilium in neural circuit formation in the central nervous system. However, very little is known about a potential role in the formation of the peripheral nervous system. Here, we investigated the presence of the primary cilium in neural crest cells and their derivatives in the trunk of the developing chicken embryo in vivo. We found that neural crest cells, sensory neurons, and boundary cap cells all bear a primary cilium during key stages of early peripheral nervous system formation. Moreover, we described differences in the ciliation of neuronal cultures of different populations from the peripheral and central nervous system. Our results offer a framework for further in vivo and in vitro investigations on specific roles that the primary cilium might play during peripheral nervous system formation.

In the rapidly evolving field of natural language processing (NLP), the processing of the Chinese language, with its unique complexities, presents significant challenges, especially in the context of Large Language Models (LLMs) like LLaMA2. These challenges are further exacerbated by the presence of non-standardized text prevalent across digital Chinese content. To address these challenges, this paper proposes a novel hybrid approach that seamlessly integrates deep contextual embeddings with Convolutional Neural Networks (CNNs) to enhance the processing of standardized Chinese text. Our approach involves a multi-stage process wherein deep contextual embeddings are first utilized to capture the nuanced semantic relationships within text. Following this, CNNs are employed to identify and exploit structural and syntactic patterns, facilitating a comprehensive understanding of the text. This hybrid model significantly improves LLaMA2’s efficiency and accuracy across various Chinese text processing tasks by ensuring that both semantic depth and structural nuances are accurately captured. The effectiveness of our model is demonstrated through rigorous testing across several benchmarks, showcasing its superiority in processing Chinese text with enhanced accuracy and speed. This research not only contributes to the advancement of text processing capabilities of LLMs but also opens new avenues for their application in tasks such as automated translation and sentiment analysis.

This research presents a comparative analysis of various deep learning models—including Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN), Gated Recurrent Units (GRU), and Attention LSTM—in predicting stock prices of major companies in the Indian stock market, specifically HDFC, TCS, ICICI, Reliance, and Nifty. The study evaluates model performance using key regression metrics such as Mean Absolute Error (MAE), Mean Squared Error (MSE), and R-Squared (R²). The results indicate that CNN and GRU models generally outperform the others, depending on the specific stock, and demonstrate superior capabilities in forecasting stock price movements. This investigation provides insights into the strengths and limitations of each model while highlighting potential avenues for improvement through feature engineering and hyperparameter optimization.

The main purpose of this article is to identify brain diseases such as Alzheimer's and Parkinson's in an intelligent way using Python software and processing the function of neurons in the neural network areas of the brain, which are classified into different components, and the data is based on the information obtained from FMRI images using algorithms artificial intelligence can intelligently diagnose the type of disease. Therefore, by using spatial clustering based on the deep learning method with noise algorithm (DBSCAN), fMRI brain image and fMRI brain surface complexity are classified, and then image preprocessing will be applied to fMRI images by using artificial intelligence neural networks (ANN) algorithm. became. Then, by using the ANN algorithm and Deep CNN topology of the brain neural network, the type of disease in the brain can be diagnosed by simulating the performance of an artificial neural network (ANN) in Python software. Deep machine learning-based methods, especially algorithms based on neural networks, have shown great success in medical image analysis for various tasks including brain tumor detection, segmentation, and classification, and Alzheimer's and epilepsy. In this research, we propose an integrated model based on a convolutional neural network for simultaneous recognition and classification of brain diseases for intelligent diagnosis of tumors and epilepsy. The average accuracy obtained from our proposed model is 97.89 percent accuracy and 91.66 percent specificity.

Augmented reality (AR) provides an opportunity for mobile fitness applications to show users real-time feedback on their current fitness activity. For such applications, it is essential to accurately track the user’s current fitness activity using available mobile sensors, such as inertial measurement units (IMUs). Convolutional neural networks (CNNs) have been shown to produce strong results in different time series classification tasks, including the recognition of activities of daily living. However, fitness activities can present unique challenges to the human activity recognition task (HAR), including greater similarity between individual activities and fewer available data for model training. In this paper, we evaluate the applicability of CNNs to the fitness activity recognition task (FAR) using IMU data and determine the impact of input data size and sensor count on performance. For this purpose, we adapted three existing CNN architectures to the FAR task and designed a fourth CNN variant, which we call the scaling fully convolutional network (Scaling-FCN). We designed a preprocessing pipeline and recorded a running exercise data set with 20 participants, in which we evaluated the respective recognition performances of the four networks, comparing them with three traditional machine learning methods commonly used in HAR. On our data set, all CNN architectures significantly outperformed traditional machine learning methods, reaching up to 97.14±1.36% classification accuracy on the test set for ResNet. Whereas a reduced input data size invariably led to a performance loss, removing specific sensors improved the performance of all CNN architectures, with our Scaling-FCN reaching the highest accuracy of 99.86±0.11%. Our results suggest that CNNs are generally well suited for fitness activity recognition, and noticeable performance improvements can be achieved if sensors are dropped selectively.

Speech Emotion Recognition (SER) is an interesting and difficult problem to handle. In this paper, we deal with it through the implementation of deep learning networks. We have designed and implemented six different deep learning networks, a Deep Belief Network (DBN), a simple deep neural network (SDNN), a LSTM network (LSTM), a LSTM network with the addition of an attention mechanism (LSTM-ATN), a Convolutional neural network (CNN), and a Convolutional neural network with the addition of an attention mechanism (CNN-ATN), having in mind, apart from solving the SER problem, to test the impact of attention mechanism to the results. Dropout and Batch Normalization techniques are also used to improve the generalization ability (prevention of overfitting) of the models as well as to speed up the training process. The Surrey Audio-Visual Expressed Emotion database (SAVEE), and the Ryerson Audio-Visual Database (RAVDESS) database were used for training and evaluation of our models. The results showed that networks with the addition of the attention mechanism did better than the others. Furthermore, they showed that CNN-ATN was the best among tested networks, achieving an accuracy of 74% for the SAVEE and 77% for the RAVDESS dataset, and exceeded existing state-of-the-art systems for the same datasets.

The accurate prediction of molecular properties such as lipophilicity and aqueous solubility are of great importance and pose challenges in several stages of the drug discovery pipeline. Machine learning methods like graph-based neural networks (GNNs) have shown exceptionally good performance in predicting these properties. In this work, we introduce a novel GNN architecture, called directed edge graph isomorphism network (D-GIN). It is composed of two distinct sub-architectures (D-MPNN, GIN) and achieves an improvement in accuracy over its sub-architectures employing various learning, and featurization strategies. We argue that combining models with different key aspects help make graph neural networks deeper and simultaneously increase their predictive power. Furthermore, we address current limitations in assessment of deep-learning models, namely, comparison of single training run performance metrics, and offer a more robust solution.

Corona virus disease (COVID-19) has infected over more than 10 million people around the globe and killed at least 500K worldwide by the end of June 2020. As this disease continues to evolve and scientists and researchers around the world now trying to find out the way to combat this disease in most effective way. Chest X-rays are widely available modality for immediate care in diagnosing COVID-19. Precise detection and diagnosis of COVID-19 from these chest X-rays would be practical for the current situation. This paper proposes one shot cluster based approach for the accurate detection of COVID-19 chest x-rays. The main objective of one shot learning (OSL) is to mimic the way humans learn in order to make classification or prediction on a wide range of similar but novel problems. The core constraint of this type of task is that the algorithm should decide on the class of a test instance after seeing just one test example. For this purpose we have experimented with widely known Generalized Regression and Probabilistic Neural Networks. Experiments conducted with publicly available chest x-ray images demonstrate that the method can detect COVID-19 accurately with high precision. The obtained results have outperformed many of the convolutional neural network based existing methods proposed in the literature.

Neural tissue engineering, nanotechnology and neuroregeneration are diverse biomedical disciplines that have been working together in recent decades to solve the complex problems linked to central nervous system (CNS) repair. It is known that the CNS demonstrates a very limited regenerative capacity because of a microenvironment that impedes effective regenerative processes, making development of CNS therapeutics challenging. Given the high prevalence of CNS conditions such as stroke that damage the brain and place a severe burden on afflicted individuals and on society, it is of utmost significance to explore the optimum methodologies for finding treatments that could be applied to humans for restoration of function to pre-injury levels. Extracellular vesicles (EVs), also known as exosomes, when derived from mesenchymal stem cells, are one of the most promising approaches that have been attempted thus far, as EVs deliver factors that stimulate recovery by acting at the nanoscale level on intercellular communication while avoiding the risks linked to stem cell transplantation. At the same time, advances in tissue engineering and regenerative medicine have offered the potential of using hydrogels as bio-scaffolds in order to provide the stroma required for neural repair to occur, as well as the release of biomolecules facilitating or inducing the reparative processes. This review introduces a novel experimental hypothesis regarding the benefits that could be offered if EVs were to be combined with biocompatible injectable hydrogels. The rationale behind this hypothesis is presented, analyzing how a hydrogel might prolong the retention of EVs and maximize the localized benefit to the brain. This sustained delivery of EVs would be coupled with essential guidance cues and structural support from the hydrogel until neural tissue remodeling and regeneration occur. Finally, the importance of including non-human primate (NHP) models in the clinical translation pipeline, as well as the added benefit of multi-modal neuroimage analysis to establish non-invasive, in vivo, quantifiable imaging-based biomarkers for CNS repair are discussed, aiming for more effective and safe clinical translation of such regenerative therapies to humans.

Deep learning has taken over - both in problems beyond the realm of traditional, hand-crafted machine learning paradigms as well as in capturing the imagination of the practitioner sitting on top of petabytes of data. While the public perception about the efficacy of deep neural architectures in complex pattern recognition tasks grows, sequentially up-to-date primers on the current state of affairs must follow. In this review, we seek to present a refresher of the many different stacked, connectionist networks that make up the deep learning architectures followed by automatic architecture optimization protocols using multi-agent approaches. Further, since guaranteeing system uptime is fast becoming an indispensable asset across multiple industrial modalities, we include an investigative section on testing neural networks for fault detection and subsequent mitigation. This is followed by an exploratory survey of several application areas where deep learning has emerged as a game-changing technology - be it anomalous behavior detection in financial applications or financial time-series forecasting, predictive and prescriptive analytics, medical imaging, natural language processing or power systems research. The thrust of this review is on outlining emerging areas of application-oriented research within the deep learning community as well as to provide a handy reference to researchers seeking to embrace deep learning in their work for what it is: statistical pattern recognizers with unparalleled hierarchical structure learning capacity with the ability to scale with information.

Invasive species and plant diseases are critical threats to ecosystems and agriculture worldwide. Effective early detection of these threats can significantly mitigate their impact on biodiversity and crop yields. This paper presents a neural network-based model for detecting leaf diseases and identifying invasive species using advanced image processing techniques. The model integrates edge detection, color analysis, and morphological feature extraction to assess leaf health and species type. By automating the identification process, this approach offers an efficient and scalable solution for real-time ecological monitoring, contributing to conservation and agricultural sustainability efforts.

Explainability is essential for AI models, especially in clinical settings where understanding the model's decisions is crucial. Despite their impressive performance, black-box AI models are unsuitable for clinical use if their operations cannot be explained to clinicians. While deep neural networks (DNNs) represent the forefront of model performance, their explanations are often not easily interpretable by humans. On the other hand, using hand-crafted features extracted to represent different aspects of the input data and traditional machine learning models are generally more understandable. However, they often lack the effectiveness of advanced models due to human limitations in feature design. To address this, we propose ExShall-CNN, a novel explainable shallow convolutional neural network for medical image processing. This model enhances hand-crafted features to maintain human interpretability while achieving performance levels comparable to advanced deep convolutional networks, such as U-Net, for medical image segmentation. ExShall-CNN and its source code are publicly available at: https://github.com/MLBC-lab/ExShall-CNN

In this paper, we explore the theoretical foundation of Graph Neural Network (GNN) model and apply it to various traditional supply chain logistics problem. In particular, we study the Route Optimization Problem, Demand Forecasting Problem, Risk Assessment and Anomaly Detection, Supplier Section and Procurement Optimization, Inventory Optimization Problem, and Green Supply Chain Problem. The study helps us the expand the use the GNN and gives daily supply chain management a boost.

The evaluation of machine unlearning has become increasingly significant as machine learning systems face growing demands for privacy, security, and regulatory compliance. This paper focuses on categorizing and analyzing evaluation metrics for machine unlearning, essential for assessing the success of unlearning processes. We divide the metrics into three key dimensions: unlearning effectiveness, unlearning efficiency, and model utility. Unlearning effectiveness examines the degree to which data is removed from the model, utilizing methods such as data removal completeness, privacy leakage detection, and perturbation analysis to ensure thorough data erasure. Unlearning efficiency considers metrics like time to unlearn, computational cost, and scalability, which are crucial for maintaining system performance in real-time environments. Model utility metrics, including accuracy retention, robustness, and fairness, ensure that unlearning does not compromise the model’s predictive capabilities. Through this categorization, we present a comprehensive framework for evaluating machine unlearning, providing a foundation for developing unlearning techniques that balance privacy, performance, and regulatory needs across diverse industries, particularly finance.

Background: In the field of brain-computer interfaces, neural decoding plays a crucial role in translating neural signals into meaningful physical actions. These signals are transmitted to processors for decoding via wired or wireless channels, often encountering data loss, commonly referred to as "packet loss." Despite its importance, the impact of different types and degrees of packet loss on neural decoding has yet to be comprehensively studied. Understanding this impact is critical for advancing neural signal processing and data filtering. Methods: This paper addresses this gap by constructing four distinct packet loss models, simulating congestion packet loss, distributed packet loss, and burst packet loss scenarios. Using macaque superior arm-movement decoding experiments, we evaluate the effects of these packet loss types on decoding performance. Results: Our findings reveal that continuous burst packet loss significantly degrades decoding performance at the same packet loss probability, and decoding parameters that are sensitive to data continuity are more heavily impacted by packet loss. Conclusions: This study provides an analysis of the relationship between packet loss and neural decoding results, offering valuable insights for future strategies aimed at preventing and handling packet loss in neural signal acquisition.

The article focusses on detecting the unbalance of a mechanical component in the electric drive system of a two-mass servomechanism with a PMSM motor, which is connected to the load via a long, flexible shaft. In the example analysed, the degree of unbalance was determined using the reference current signal from the speed controller of the FOC control system. The authors pre-sented a two-mass model with an unbalanced mechanical system. The STFT transform was used to analyse the symptoms of unbalance and an artificial neural network MLP was used for system state inference. The effectiveness of the presented analysis, based on the reference current signal from the sensor embedded in the control system, was experimentally confirmed.

Endogenous bioelectrical patterns are an important regulator of anatomical pattern during embryogenesis, regeneration, and cancer. While there are three known classes of instructive bioelectric patterns: directly encoding, indirectly encoding, and binary trigger, it is not known how these design principles could be exploited by evolution and what their relative advantages might be. To better understand the evolutionary role of bioelectricity in anatomical homeostasis, we developed a neural cellular automaton (NCA). We used evolutionary algorithms to optimize these models to achieve reliable morphogenetic patterns driven by the different ways in which tissues can interpret their bioelectrical pattern for downstream anatomical outcomes. We found that: (1) All three types of bioelectrical codes allow the reaching of target morphologies; (2) Resetting of the bioelectrical pattern and the change in duration of the binary trigger alter morphogenesis; (3) Direct pattern organisms show an emergent robustness to changes in initial anatomical configurations; (4) Indirect pattern organisms show an emergent robustness to bioelectrical perturbation; (5) Direct and indirect pattern organisms show an emergent generalizability competency to new (rotated) bioelectrical patterns; (6) Direct pattern organisms show an emergent repatterning competency in post-developmental-phase. Because our simulation was fundamentally a homeostatic system seeking to achieve specific goals in anatomical state space, we sought to understand the role of anxiolytics that reduced concern over the distance to those goals. We simulated selective serotonin reuptake inhibitors, which diminished ability of artificial embryos to correctly interpret bioelectric patterns due to an altered organismal reward machinery, leading to higher variance of developmental outcomes, global morphological degradation, and induced in some organisms anatomical bistability. These computational findings were validated by data collected from in vivo experiments in SSRI exposure in planarian flatworm regeneration.

Kolmogorov–Arnold Network (KAN) is an emerging interpretable neural network compared to fully black-box MLPs. Recently, emerging works focus on comprehensive and fair comparisons between KAN and MLP in various tasks. However, these works didn't focus on the strongest advantage of KAN: generating symbolic outputs. The ability of KAN to provide scientific insights or even discover new science is under-examined. In this work, we propose several novel metrics to measure how well a KAN performs on symbolic function fitting: R^2-Mean, weighted R^2-complexity loss, and ranking metrics. We also propose a metric to determine mathematical complexity of a target function and evaluate KAN with several functions of different mathematical complexity. Additionally, we also tried inputs with different ranges to find the effect of normalization.

This paper introduces an innovative approach that enables automated and precise prediction of the steel's chemical composition based on the desired Jominy curve. The microstructure, and in fact the presence of martensite, is decisive for the hardness of the steel, so the study considered the occurrence of this phase at particular distances from the quenched-end of the Jominy sample. Steels for quenching and tempering and case hardening were investigated. With representative collected dataset of hardness values from quenched-end of Jominy specimen, microstructure and chemical composition of steels, the complex regression model was made using supervised artificial neural networks. The balance between cost and required hardenability can be achieved through optimizing the chemical composition of steel. This model of designing steel with required hardenability can be of great benefit in the mechanical engineering and manufacturing industry. The model is verified experimentally.

This small article examines the pivotal roles of redundant and degenerate neural networks in the brain across three critical dimensions: evolutionary development, early childhood neural formation, and their implications in neurological diseases. Redundant networks, characterized by parallel neural pathways with similar functions, provide a foundation for cognitive resilience, ensuring continuity of brain functions despite damage or developmental anomalies. Degenerate networks, comprising structurally varied but functionally equivalent pathways, contribute to cognitive flexibility and adaptability, essential for innovative problem-solving and learning. From an evolutionary perspective, these networks have been instrumental in the brain's adaptation to diverse environmental challenges, facilitating cognitive maximization and the development of complex behaviors. The genetic underpinnings and environmental influences that shaped these networks are explored, highlighting their contribution to the evolutionary success of the human species. In the realm of early childhood development, the formation and reinforcement of these networks are crucial. The brain's plasticity during this period leads to the establishment of robust redundant networks and versatile degenerate networks, shaped significantly by environmental stimuli and learning experiences. This developmental phase lays the groundwork for cognitive abilities and resilience to neurological challenges later in life. Furthermore, the paper delves into the implications of these networks in the context of brain diseases. The disruption of the equilibrium between redundancy and degeneracy is linked to various neurological conditions, including Alzheimer's disease, Parkinson's disease, multiple sclerosis, stroke and Huntington's disease. Understanding the roles and balances of these networks offers insights into the pathophysiology of these diseases and potential therapeutic approaches. This review underscores the significance of redundant and degenerate neural networks in the evolutionary context, their critical formation during early childhood, and their profound impact on brain health and disease. It highlights the need for further research into these networks to enhance our understanding of brain function and to develop targeted interventions for neurological disorders.

The importance of XAI is undeniable in the current scenario and thus it's importance in considerable. Unfortunately, there are a couple of scenarios where the current XAI models fail. Additionally, attackers seek vulnerabilities in these models. This review paper is intended to cover some of the important scenarios where the existing XAI models may fail and some progresses made which shows their vulnerabilities and how to secure them.

This article presents a novel computational approach to visualizing memristor dynamics within a simulated neural network. Memristors, known for their ability to emulate synaptic plasticity due to their variable resistance characteristics, are key components in neuromorphic computing and hold potential for advancing our understanding of neural processes. Our study introduces a sophisticated memristor model that incorporates non-linear resistance changes, simulating the complex behavior of synaptic connections in a neural network.The neural network, consisting of multiple interconnected neurons with memristor-based synapses, is subjected to a series of electrical stimuli. Each memristor's resistance is modulated in response to the applied voltage, mimicking the synaptic weight adjustments that occur during learning and memory formation in biological neural networks. To effectively illustrate these changes, we employ a high-contrast color mapping scheme, where the varying resistance of each memristor is represented by distinct colors, providing a clear and intuitive visualization of synaptic modifications over time.Our simulation runs through multiple iterations, demonstrating how synaptic weights evolve in response to different input patterns. The use of an extended voltage range and increased scaling factors ensures pronounced changes in memristance, enhancing the visibility of synaptic adaptations. The resulting visualizations offer a compelling representation of how memristors can mimic the dynamic nature of biological synapses, contributing to the field of neuromorphic engineering and deepening our comprehension of neural mechanisms underlying learning and memory.This work not only showcases the potential of memristors in simulating neural behavior but also provides a valuable educational tool for illustrating complex concepts in neuroscience and neuromorphic computing. The insights gained from this study pave the way for further exploration into the development of advanced neural network models and the design of memristor-based computing systems.

Nowadays, inquiries are one of the most important tasks to be executed in order to get valued information. When an inquiry is done to gather information about a human behavior there are some problems inherent to it. One of the main problems is how the information about many different persons can be processed to give good information about their environment. Most of the information gathered by these inquiries is used to analyze the behavior of the respondents. It can be used to estimate the success of a certain product on the market or just to validate the satisfaction of current costumers. The veracity of this information can be critical to model environments with some acceptable level of precision. Modelling environments through Artificial Neural Networks (ANN) is highly common because ANN’s are excellent to model predictable environments using a set of data. ANN’s are good in deal with sets of data with some noise, but they are fundamentally surjective mathematical functions and they aren’t able to give different results for the same input. So if an ANN is trained using data where the same input has different images which can be the case of survey data, this can be a problem for the success of modelling the environment. Therefore is necessary to process the data in order to adjust and eliminate invalid data.

This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLME-Resnet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial and spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3\%) and Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and adjustment of treatment, by providing physicians with insights into the underlying pathological organization of gliomas.

In the present article, we study the possibilities of machine learning for estimation of seeing at the Maidanak Astronomical Observatory (38∘40′24′′N, 66∘53′47′′E) using only Era-5 re-analysis data. Seeing is usually associated with the integral of the turbulence strength Cn2(z) over the height z. Based on the seeing measurements accumulated over 13 years we created ensemble models of multi-layer neural networks under the machine learning framework, including training and validation. For the first time in the world, we have simulated optical turbulence (seeing variations) during night-time with deep neural networks trained on a 13-year database of astronomical seeing. A set of neural networks for simulations of night-time seeing variations have been obtained. For these neural networks the linear correlation coefficient ranges from 0.48 to 0.68. We show that modeled seeing with neural networks is well described through meteorological parameters, which include wind speed components, air temperature, humidity and turbulent surface stresses. One of the fundamental new results is that the structure of small-scale (optical) turbulence over the Maidanak Astronomical Observatory does not depend or depends negligibly on the vortex component of atmospheric flows.

Calligraphy works have high artistic value, but there is a rampant problem of forgery. Indeed, authentication of traditional calligraphy heavily relies on calligraphers' subjective judgment. Therefore, spurred by the recent development of neural networks, this paper proposes a method for authenticating calligraphy works based on an improved EfficientNet network. Specifically, the developed method utilizes the character box algorithm and the centroid algorithm to extract individual calligraphy characters, which are then augmented and used as the training set for the model. The training process employs CBAM and Self-Attention modules to enhance the attention mechanism of the EfficientNet network. The model is tested on authentic works, imitated works, and works from other calligraphers and is compared with other networks. The experimental results demonstrate that the proposed method effectively achieves the authentication of calligraphy works, and the improved CBAM-EfficientNet network and SA-EfficientNet network achieve better authentication performance.

Interhemispheric and frontoparietal functional connectivity have been reported to increase during explicit information processing. However, it is unclear how and when interhemispheric and frontoparietal functional connectivity interact during explicit semantic processing. Here, we tested the neural coupling hypothesis that explicit semantic processing promotes neural activity in the nondominant right hemispheric areas owing to synchronization with enhanced frontoparietal functional connectivity at later processing stages. We analyzed electroencephalogram data obtained using a semantic priming paradigm, which comprised visual priming and target words successively presented under direct or indirect attention to semantic association. Scalp potential analysis demonstrated that the explicit processing of congruent targets reduced negative event-related potentials, as previously reported. Current source density analysis showed that explicit semantic processing activated the right temporal area during later temporal intervals. Subsequent dynamic functional connectivity and neural coupling analyses revealed that explicit semantic processing increased the correlation between right temporal source activities and frontoparietal functional connectivity in later temporal intervals. These findings indicate that explicit semantic processing increases neural coupling between the interhemispheric and frontoparietal functional connectivity during later processing stages.

One of the most important sources of energy is the sun. Taiwan is located at north 22-25° latitude. Due to its proximity to the equator, it experiences only a small angle of sunlight incidence. Its unique geographical location which can obtain sustainable and stable solar resources. This study takes research on the forecast of solar radiation to maximize the benefits of solar power generation, and develops methods that can predict the future solar radiation pattern to help reduce the costs of solar power generation. This study builds supervised machine learning models, known as deep neural network (DNN) and long short-term memory neural network (LSTM). The hybrid supervised and unsupervised model, namely cluster-based artificial neural network (k-means clustering and fuzzy C-means clustering-based models), was developed. After establishing these models, the study evaluated their prediction results. For different prediction periods, the study selected the best-performing model based on the results and proposed combining them to establish a real-time updated solar radiation forecast system capable of predicting the next 12 hours. The study area covered Kaohsiung, Hualien, and Penghu in Taiwan. Data from ground stations of the Central Weather Administration, collected between 1993 and 2021, as well as the solar angle parameters of each station, were used as input data for the model. The results of this study show that different models have their advantages and disadvantages in predicting different future times. Therefore, the hybrid prediction system can predict future solar radiation more accurately than a single model.

Transfer learning has proven to be a valuable technique for deploying machine learning models on edge devices and embedded systems. By leveraging pre-trained models and fine-tuning them on specific tasks, practitioners can effectively adapt existing models to the constraints and requirements of their application. In the process of adapting an existing model, a practitioner may make adjustments to the model architecture, including the input layers, output layers, and intermediate layers. In this study, we examine the effects of these adjustments on the runtime and energy performance of an edge processor performing inferences. Based on our observations, we make recommendations for how to adjust convolutional neural networks during transfer learning to maintain runtime performance. We observe that the Edge TPU is generally more efficient than a CPU at performing inferences on convolutional neural networks, and continues to outperform a CPU as the depth and width of the convolutional network increases. We explore multiple strategies for adjusting the input and output layers of an existing model and demonstrate important performance cliffs for practitioners to consider when modifying a convolutional neural network model.

Aimed for the difficulty and complexity of detecting the piston error for segmented telescope, this paper proposed a new piston error measurement method based on a hybrid artificial neural net-work. Firstly, we use Resnet network to learn the mapping relationship between the focal plane degradation image and the signs of the piston error. Then, based on the established theoretical re-lationship between modulation transfer function and the piston error, BP neural network is used here to learn the mapping relationship between the MTF and the absolute value of the piston error. After the training of the hybrid network is completed, a wide-range and high-precision detection of the piston error of the sub-mirrors can be achieved using the combined output of the two net-works only a focal plane image of a point source with broadband illumination is used as input. The detection range can reach the whole coherent length of the input broadband light, and the detec-tion accuracy can reach 10nm. The method proposed in this paper has the advantages of high de-tection accuracy, wide detection range, low hardware cost, small network scale and low training difficult.

With an explosion of data in the nearly every domain, from physical and environmental sciences to econometrics and even social science, we have entered a golden era of time-domain data science. In addition to ever increasing data volumes and varieties of time-series, there's a plethora of techniques available to analyses them. Unsurprisingly, machine learning approaches are very popular. In environmental sciences (ranging from climate studies to space weather/solar physics), machine learning (ML )and deep learning (DL) approaches complement the traditional data assimilation approaches. In solar and astrophysics, multiwavelength time-series or lightcurves along with observations of other messengers like gravitational waves provide a treasure trove of time-domain data for ML/DL approaches for modeling and forecasting. In this regard, deep learning algorithms such as recurrent neural networks (RNNs) should prove extremely powerful for forecasting as it has in several other domains. Such methods agnostic of the physics can only predict transient flares that are represented in the original distribution trained on (eg. coloured noise fluctuations) and not special, isolated episodes (eg. a one-off outburst like a major coronal mass ejection) potentially distinguishing them. Therefore it is vital to test robustness of these techniques ; here we attempt to make a small contribution to this by exploring sensitivity of RNNs with some rudimentary experiments. We test the performance of a very successful class of RNNs, the Long Short Term Memory (LSTM) algorithms with simulated lightcurves. As an example, we focus on univariate forecasting of time-series (or lightcurves) characteristic certain variable astrophysical objects (eg. active galactic nuclei or AGN). Specifically, we explore the sensitivity of training and test losses to key parameters of the LSTM network and data characteristics namely gaps and complexity measured in terms of number of Fourier components. We find that typically, the performances of LSTMs are better for pink or flicker noise type sources. The key parameters on which performance is dependent are batch size for LSTM and the gap percentage of the lightcurves. While a batch size of $10-30$ seems optimal, the most optimal test and train losses are under $10 \%$ of missing data for both periodic and random gaps in pink noise. The performance is far worse for red noise. This compromises detectability of transients. Thus, we show that generative models (time-series simulations) are excellent guides for use of RNN-LSTMs in building forecasting systems

Artificial neural networks are a powerful tool for managing data that is difficult to process and interpret. This paper presents the study of artificial neural networks for information processing generated by an optical encoder based on the polarization of light. A machine learning technique is proposed to train the neural networks, such that the system can predict with remarkable accuracy the angular position in which the rotating element of the neuro-encoder is located, based on information provided by light’s phase shifting arrangements. The proposed neural designs show excellent performance in small angular intervals, and a methodology is proposed to avoid losing this remarkable characteristic in measurements from 0 to 180o or even to 360o. The neuro-encoder is implemented in simulation stage to obtain performance results. This study can be useful to improve capabilities of resolvers or other polyphasic sensors.

Convolutional Neural Networks (CNNs) are largely hand-crafted, which leads to inefficiency in the constructed network. Various other algorithms have been proposed to address this issue, but the inefficiencies resulting from human intervention have not been addressed. Our proposed EvolveNet algorithm is a task-agnostic evolutionary search algorithm that can find optimal depth and width scales automatically in an efficient way. The optimal configurations are not found using grid search, instead evolved from an existing network. This eliminates inefficiencies that emanate from hand-crafting, thus reducing the drop in accuracy. The proposed algorithm is a framework to search through a large search space of subnetworks until a suitable configuration is found. Extensive experiments on the ImageNet dataset demonstrate the superiority of the proposed method by outperforming the state-of-the-art methods.

Wastewater (WW) analysis is a critical step in various operations such as control of a WW treatment facility, and speeding-up the analysis of WW quality can significantly improve such operations. This work demonstrates the capability of neural network (NN) regression models to estimate WW characteristic properties such as biochemical oxygen demand (BOD), chemical oxygen demand (COD), ammonia (NH3-N), total dissolved substances (TDS), total alkalinity (TA), and total hardness (TH) by training on WW spectral reflectance in the visible to near-infrared spectrum (400nm-2000nm). The dataset contains samples of spectral reflectance intensity, which were the inputs, and the WW parameter levels (BOD, COD, NH3-N, TDS, TA, and TH), which were the outputs. Various NN model configurations were evaluated in terms of regression model fitness. The mean-absolute-error (MAE) was used as the metric for training and testing the NN models, and the coefficient of determination (R2) between the model predictions and true values was also computed to measure how well the NN models predict the true values. With online spectral measurements, the trained neural network model can provide non-contact and real-time estimation of WW quality at minimum estimation error.

Chickpea is one of the most widely consumed pulses globally because of its high protein content. The morphological features of chickpea seed, such as colour, texture, are observable and play a major role in classifying different chickpea varieties. This process is often carried out by human experts, and is time-consuming, inaccurate, and expensive. The objective of the study was to design an automated chickpea classifier using an RGB colour image-based model by considering the morphological features of chickpea seed. As part of the data acquisition process, five hundred and fifty images were collected per variety for four varieties of chickpea (CDC-Alma, CDC-Consul, CDC-Cory, and CDC-Orion) using an industrial RGB camera and a mobile phone camera. Three CNN-based models such as NasNet-A (mobile), MobileNetV3 (small), and EfficientNetB0 were evaluated using a transfer learning-based approach. The classification accuracy was 97%, 99%, and 98% for NasNet-A (mobile), MobileNetV3 (small), and EfficientNetB0 models, respectively. The MobileNetV3 model was used for further deployment on an Android mobile and Raspberry Pi 4 devices based on its higher accuracy and light-weight architecture. The classification accuracy for the four chickpea varieties was 100% while the MobileNetV3 model was deployed on both Android mobile and Raspberry Pi 4 platforms.

The Ocean Color - Simultaneous Marine and Aerosol Retrieval Tool (OC-SMART) is a robust data processing platform that supports a large array of multi-spectral and hyper-spectral sensors. It provides accurate aerosol optical depths and remote sensing reflectances (Rrs estimates) that can be used to generate products such as absorption coefficients due to phytoplankton and detritus/Gelbstoff as well as backscattering coefficients due to particulate matter. The OC-SMART platform yields improved performance in complex environments by utilizing scientific machine learning (SciML) in conjunction with comprehensive radiative transfer computations. This paper expands the capability of OC-SMART by quantifying uncertainties in ocean color retrievals. Bayesian inversion is used to relate measured top of atmosphere radiances and a priori data to estimate posterior probability density functions and associated uncertainties. A framework of the methodology and implementation strategy is presented and uncertainty estimates for Rrs retrievals are provided to demonstrate the approach by applying it to MODIS, OLCI Sentinel-3, and VIIRS sensor data.

Link prediction is to complete the missing links in the network or to predict the generation of new links according to the current network structure information, which is very important for mining and analyzing the evolution of the network such for construction and analysis of logical architecture in 6G network. Link prediction algorithms based on node similarity need predefined similarity functions, which is highly hypothetical and only applies to specific network structures without generality. To solve this problem, this paper proposes a link prediction algorithm based on the subgraph of the target node pair. In order to automatically learn the graph structure characteristics, the algorithm firstly extracts the h-hop subgraph of the target node pair, and then predicts whether the target node pair will be linked according to the subgraph. Experiments on seven real data sets show that the link prediction algorithm based on target node pair subgraph is suitable for various network structures and superior to other link prediction algorithms.

In this study, we explore the potential of using a straightforward neural network inspired by the retina model to efficiently restore low-light images. The retina model imitates the neurophysiological principles and dynamics of various optical neurons. Our proposed neural network model reduces the computational overhead compared to traditional signal-processing models while achieving results similar to complex deep learning models from a subjective perceptual perspective. By directly simulating retinal neuron functionalities with neural networks, we not only avoid manual parameter optimization but also lay the groundwork for constructing artificial versions of specific neurobiological organizations.

Existing one-shot neural architecture search (NAS) methods have to conduct a search over a giant super-net, which leads to the huge computational cost. To reduce such cost, in this paper, we propose a method, called FTSO, to divide the whole architecture search into two sub-steps. Specifically, in the first step, we only search for the topology, and in the second step, we search for the operators. FTSO not only reduces NAS’s search time from days to 0.68 seconds, but also significantly improves the found architecture's accuracy. Our extensive experiments on ImageNet show that within 18 seconds, FTSO can achieve a 76.4% testing accuracy, 1.5% higher than the SOTA, PC-DARTS. In addition, FTSO can reach a 97.77% testing accuracy, 0.27% higher than the SOTA, with nearly 100% (99.8%) search time saved, when searching on CIFAR10.

American Sign Language is a popular language for deaf individuals. Communication is made easier for these people through sign language. However, in a digital era like today, there is a need for these people to be able to communicate online, and even get help from technology to communicate in person with non sign language speakers. This research will present a program able to translate American sign language to plain English. This study aims to use the OpenCV library to recognize hand signals, also a trained model to identify images so that the program can then translate them to words and letters. The program uses a data set of over 2000 images which will be in this case the largest data set available. With over 90\% of accuracy it results in a basic computer program with the largest data set available that would make possible for users to communicate with a wide variety of words and expressions.

Deep Learning is an extremely important research topic in Earth Observation. Current use-cases range from semantic image segmentation, object detection to more common problems found in computer vision such as object identification. Earth Observation is an excellent source for different types of problems and data for Machine Learning in general and Deep Learning in particular. It can be argued that both Earth Observation and Deep Learning as fields of research will benefit greatly from this recent trend of research. In this paper we take several state of the art Deep Learning network topologies and provide a detailed analysis of their performance for semantic image segmentation for building footprint detection. The dataset used is comprised of high resolution images depicting urban scenes. We focused on single model performance on simple RGB images. In most situations several methods have been applied to increase the accuracy of prediction when using deep learning such as ensembling, alternating between optimisers during training and using pretrained weights to bootstrap new models. These methods although effective, are not indicative of single model performance. Instead, in this paper, we present different topology variations of these state of the art topologies and study how these variations effect both training convergence and out of sample, single model, performance.

This concept paper gives a narrative about intelligence from insects to the human brain, showing where evolution may have been influenced by the structures in these simpler organisms. The ideas also come from the author's own cognitive model, where a number of algorithms have been developed over time and the precursor structures should be codable to some level. Through developing and trying to implement the design, ideas like separating the data from the function have become architecturally appropriate and there have been several opportunities to make the system more orthogonal. Similarly for the human brain, neural structures may work in-sync with the neural functions, or may be slightly separate from them. Each section discusses one of the neural assemblies with a potential functional result, that cover ideas such as timing or scheduling, structural intelligence and neural binding. Another aspect of self-representation or expression is interesting and may help the brain to realise higher-level functionality based on these lower-level processes.

Dysregulation of high-frequency neuronal oscillations has been implicated in the pathophysiology of schizophrenia. Chronic methamphetamine (METH) use can induce psychosis similar to paranoid schizophrenia. The current study in mice aimed to determine the effect of chronic METH treatment on ongoing and evoked neuronal oscillations. C57BL/6 mice were treated with METH or vehicle control for three weeks and implanted with extradural recording electrodes. Two weeks after the last METH injection, mice underwent three EEG recording sessions to measure ongoing and auditory-evoked gamma and beta oscillatory power in response to an acute challenge with METH (2mg/kg), the NMDA receptor antagonist MK-801 (0.3mg/kg), or saline control. A separate group of mice pretreated with METH showed significantly greater locomotor hyperactivity to an acute METH challenge, confirming long-term sensitisation. Chronic METH did not affect ongoing or evoked gamma or beta power. Acute MK-801 challenge reduced ongoing beta power whereas acute METH challenge significantly increased ongoing gamma power. Both MK-801 and METH challenge suppressed evoked gamma power. Chronic METH treatment did not modulate these acute drug effects. There were minor effects of chronic METH and acute METH and MK-801 on selected components of event-related potential (ERP) waves. In conclusion, chronic METH treatment did not exert neuroplastic effects on the regulation of cortical gamma oscillations in a manner consistent with schizophrenia, despite causing behavioural sensitisation.

With the development of data science, more and more machine learning technologies have been designed to solve complicated and challenging real-world tasks containing a large volume of data. And many significant real-world datasets contain data in the form of networks or graphs. Graph Neural Networks is one of the powerful machine learning tools, which could provide a perfect solution to processing a large amount of non-Euclidean data. And because most bio information data in bioinformatics is in the non-Euclidean domain, Graph Neural Networks could then directly be applied to solve problems in bioinformatics. Much research has been done in the field of GNN, and there are also some surveys related to GNN and its applications. However, there has been little research focusing on GNN in bioinformatics, and we think in the future we could better utilize GNN in the field of biology, so we would like to write a literature review to help take a comprehensive look at GNN and their applications in the field of bioinformatics. In this paper, we would first introduce SOTA models in Graph Neural Networks, and second, introduce their applications in bio information. And then we would provide future directions of Graph Neural Networks in bioinformatics.

Model understanding is critical in many domains, particularly those involved in high-stakes decisions, i.e., medicine, criminal justice, and autonomous driving. Explainable AI (XAI) methods are essential for working with black-box models such as Convolutional Neural Networks. This paper evaluates the traffic sign classifier of Deep Neural Network (DNN) from the Programmable Systems for Intelligence in Automobiles (PRYSTINE) project for explainability. The results of explanations were further used for the CNN PRYSTINE classifier vague kernels` compression. After all, the precision of the classifier was evaluated in different pruning scenarios. The proposed classifier performance methodology was realised by creating the original traffic sign and traffic light classification and explanation code. First, the status of the kernels of the network was evaluated for explainability. For this task, the post-hoc, local, meaningful perturbation-based forward explainable method was integrated into the model to evaluate each kernel status of the network. This method enabled distinguishing high and low-impact kernels in the CNN. Second, the vague kernels of the classifier of the last layer before the fully connected layer were excluded by withdrawing them from the network. Third, the network's precision was evaluated in different kernel compression levels. It is shown that by using the XAI approach for network kernel compression, the pruning of 5% of kernels leads only to a 1% loss in traffic sign and traffic light classification precision. The proposed methodology is crucial where execution time and processing capacity prevail.

Distortion of financial statements is recognized as one of the most important issues in the field of accounting and auditing, which is also one of the most common issues today. In this regard, the present research was conducted, in which stock exchange information was used to investigate, predict, and model accounting distortions. For this purpose, financial performance, non-financial metrics, market-based metrics and commitment, or selection items were reviewed over a 6-year period. For collecting data of distorting companies, database of the Society of Certified Public Accountants in Iran was used and the information was analyzed using data mining methods (decision tree, neural networks, and Bayesian method). The results showed that analysis of financial statements҆ information has a high accuracy in determining and identifying the distorted financial statements. Using this information, it is possible to get better acquainted with the methods of document distortion and to take necessary measures in order to control and prevent administrative violations at national and international levels. Given frequent occurrence of these violations, artificial intelligence models can be used to identify these papers.

Over the past decade, recognition of human activities (HAR) has become a vibrant field of research, in particular, the spread in our everyday lives of electronics such as mobile phones, smart cell phones, and video cameras. Furthermore, the advancement in the field of deep methodologies and other paradigms have enabled scientists to enable HAR in many areas, consisting of activities in fitness and wellness. For instance, HAR is one of many resorts to support older people through day-to-day activities to support their cognition and physicality. This study is centered on the key aspects deep learning plays in the development of HAR applications. Although numerous HAR examination studies were carried out previously, there have been no overall studies on this subject, in all the earlier studies there were only specific HAR-related subjects. A detailed review covering all the main subjects in this area is therefore essential. This study discusses the latest developments and works in HAR. It separates the methods and the advantages and disadvantages of each method group. This paper finally addresses many problems in the current HAR subject and provides recommendations for potential study.

Neural networks present the characteristics that the results are strongly dependent on the training data, the weight initialisation, and the hyper-parameters chosen. The determination of the distribution of a statistical estimator, as the Mean Squared Error (MSE) or the accuracy, is fundamental to evaluate the performance of a neural network model (NNM). For many machine learning models, as linear regression, it is possible to analytically obtain information as variance or confidence intervals on the results. Neural networks present the difficulty of being not analytically tractable due to their complexity. Therefore, it is impossible to easily estimate distributions of statistical estimators. When estimating the global performance of an NNM by estimating the MSE in a regression problem, for example, it is important to know the variance of the MSE. Bootstrap is one of the most important resampling techniques to estimate averages and variances, between other properties, of statistical estimators. In this tutorial, the application of two resampling (including bootstrap) techniques to the evaluation of neural networks’ performance is explained from both a theoretical and practical point of view. Pseudo-code of the algorithms is provided to facilitate their implementation. Computational aspects, as the training time, are discussed since resampling techniques always require to run simulations many thousands of times and, therefore, are computationally intensive. A specific version of the bootstrap algorithm is presented that allows the estimation of the distribution of a statistical estimator when dealing with an NNM in a computationally effective way. Finally, algorithms are compared on synthetically generated data to demonstrate their performance.

Accurately mapping individual tree species in densely forested environments is crucial to forest inventory. When considering only RGB images, this is a challenging task for many automatic photogrammetry processes. The main reason for that is the spectral similarity between species in RGB scenes, which can be a hindrance for most automatic methods. State-of-the-art deep learning methods could be capable of identifying tree species with an attractive cost, accuracy, and computational load in RGB images. This paper presents a deep learning-based approach to detect an important multi-use species of palm trees (Mauritia flexuosa; i.e., Buriti) on aerial RGB imagery. In South-America, this palm tree is essential for many indigenous and local communities because of its characteristics. The species is also a valuable indicator of water resources, which comes as a benefit for mapping its location. The method is based on a Convolutional Neural Network (CNN) to identify and geolocate singular tree species in a high-complexity forest environment, and considers the likelihood of every pixel in the image to be recognized as a possible tree by implementing a confidence map feature extraction. This study compares the performance of the proposed method against state-of-the-art object detection networks. For this, images from a dataset composed of 1,394 airborne scenes, where 5,334 palm-trees were manually labeled, were used. The results returned a mean absolute error (MAE) of 0.75 trees and an F1-measure of 86.9%. These results are better than both Faster R-CNN and RetinaNet considering equal experiment conditions. The proposed network provided fast solutions to detect the palm trees, with a delivered image detection of 0.073 seconds and a standard deviation of 0.002 using the GPU. In conclusion, the method presented is efficient to deal with a high-density forest scenario and can accurately map the location of single species like the M flexuosa palm tree and may be useful for future frameworks.

Identifying fake news on the media has been an important issue. This is especially true considering the wide spread of rumors on the popular social networks such as Twitter. Various kinds of techniques have been proposed for automatic rumor detection. In this work, we study the application of graph neural networks for rumor classification at a lower level, instead of applying existing neural network architectures to detect rumors. The responses to true rumors and false rumors display distinct characteristics. This suggests that it is essential to capture such interactions in an effective manner for a deep learning network to achieve better rumor detection performance. To this end we present a simplified aggregation graph neural network architecture. Experiments on publicly available Twitter datasets demonstrate that the proposed network has performance on a par with or even better than that of state-of-the-art graph convolutional networks, while significantly reducing the computational complexity.

Due to its aggressive and invasive nature glioblastoma (GBM), the most common and aggressive primary brain tumour in adults, remains almost invariably lethal. Significant advances in the last several years have elucidated much of the molecular and genetic complexities of GBM. However, GBM exhibits a vast genetic variation and a wide diversity of phenotypes that has complicated the development of effective therapeutic strategies. This complex pathogenesis makes it necessary the development of experimental models that could be used to further understand the disease, and also to provide a more realistic testing ground for potential therapies. In this report, we describe the process of transformation of primary mouse embryo astrocytes into immortalized cultures with neural stem cell characteristics, that are able to generate of GBM when injected in the brain of C57BL/6 mice, or heterotopic tumours when injected iv. Overall, our results show that oncogenic transformation is a fate for NSC if cultured for long periods in vitro. In addition, since no additional hit is necessary to induce the oncogenic transformation, our model may be used to investigate the pathogenesis of gliomagenesis and to test the effectiveness of different drugs throughout the natural history of GBM.

Long-Term Potentiation(LTP) and Long-Term Depression(LTD) are two major forms of synaptic plasticity, which are also two well-know functional and unit activities involved in high advanced central neural system(CNS) activities, like memory. But we still know little about how the advanced CNS activities are organized in the brain and in the level of organism. Based on the current understanding and experimental evidence of neurology, we propose the term “Information Circulation” to summarize the current understandings for advanced CNS activities, and we define it as separately input neural signals finally converge in different levels of CNS and interact with each other, then neural information are circulated and processed in different levels of CNS to give out orders for next body actions. This review provides a detailed description for the functional organizations of advanced CNS activities in the term of Information Circulation. This article outlines the receiving of outside stimulation and transmission of neural information, especially transmission and procession of visual bioelectrical signals, then we described neural circuits of Information Circulation in advanced CNS activities, the corresponding specificity and dynamic properties of neural circuits, different sensation linkages, and neural synchronization for information circulation to produce consciousness in CNS. In conclusion, Information Circulation is defined as an important signature involved in advanced CNS activities.

Over the years, various models have been developed in the stages of the mining process that have allowed predicting and enhancing results, but it is the breakage the variable that connects all the activities of the mining process from the point of view of costs (drilling, blasting, loading, hauling, crushing and grinding). To improve this process, we come up with an idea to develop a breakage prediction model; on the basis of the main variables involved in the drilling and blasting process. For this purpose, we design a computer model based on an Artificial Neuronal Networks (ANN), built by using the most representative variables that come into play with drilling and blasting, such as: the properties of the explosives, the geomechanical parameters of the rock mass, and the design parameters of drilling-blasting. For its experimentation and validation, we have taken the data from a copper mine as reference located in the north of Chile, because of we have the dataset of that ore deposit, which is valid and reliable to evaluate prediction problems based on ANN applied to copper mines. The ANN architecture was of the supervised type, feedforward, with 3 layers and 13 neurons in the only hidden layer, trained with the input data using a dataset with the previously mentioned variables, which then were compared with the breakage results. The model was feed backed in its learning process until it becomes perfected, and is a prediction option that can be used in future blasting of ore deposits with similar characteristics using the same representative variables. Therefore, this is a valid alternative for predicting rock breakage, given that it has been experimentally validated, and has achieved moderately reliable results, providing higher correlation coefficients than traditional models, and with the additional advantage that an ANN model provides, due to its ability to learn and recognize compiled dataset patterns. In this way, using this computer model we can obtain satisfactory results that allow us to predict breakage, providing an alternative for evaluating the costs that this entails.

The paper concludes the first research on mouth-based Emotion Recognition (ER), adopting a Transfer Learning (TL) approach. Transfer Learning results paramount for mouth-based emotion ER, because a few data sets are available, and most of them include emotional expressions simulated by actors, instead of adopting a real-world categorization. Using TL we can use fewer training data than training a whole network from scratch, thus more efficiently fine-tuning the network with emotional data and improving the convolutional neural network accuracy in the desired domain. The proposed approach aims at improving the Emotion Recognition dynamically, taking into account not only new scenarios but also modified situations with respect to the initial training phase, because the image of the mouth can be available even when the whole face is visible only in an unfavourable perspective. Typical applications include automated supervision of bedridden critical patients in an healthcare management environment, or portable applications supporting disabled users having difficulties in seeing or recognizing facial emotions. This work takes advantage from previous preliminary works on mouth-based emotion recognition using CNN deep-learning, and has the further benefit of testing and comparing a set of networks on large data sets for face-based emotion recognition well known in literature. The final result is not directly comparable with works on full-face ER, but valorizes the significance of mouth in emotion recognition, obtaining consistent performances on the visual emotion recognition domain.

In recent years, artificial neural networks (ANNs) have won numerous contests in pattern recognition, machine learning, and artificial intelligence. The basic unit of an ANN is to mimic neurons in the brain. Neuron in ANNs is expressed as f (wx+b) or f (wx). This structure does not consider the information processing capabilities of dendrites. However, recently, studies shown that dendrites participate in pre-calculation in the brain. Concretely, biological dendrites play a role in the pre-processing to the interaction information of input data. Therefore, it is time to perfect the neuron of the neural network. This paper, add dendrite processing section, presents a novel artificial neuron, according to our previous studies (CR-PNN or Gang transform). The dendrite processing section can be expressed as . Because I perfected the basic unit of ANNs— neuron, there are so many networks to try. This article gives the basic architecture for reference in future research.

The recent worldwide outbreak of the novel corona-virus (COVID-19) opened up new challenges to the research community. Artificial intelligence (AI) driven methods can be useful to predict the parameters, risks, and effects of such an epidemic. Such predictions can be helpful to control and prevent the spread of such diseases. The main challenges of applying AI is the small volume of data and the uncertain nature. Here, we propose a shallow Long short-term memory (LSTM) based neural network to predict the risk category of a country. We have used a Bayesian optimization framework to optimized and automatically design country-specific networks. We have combined the trend data and weather data together for the prediction. The results show that the proposed pipeline outperforms against state-of-the-art methods for 170 countries data and can be a useful tool for such risk categorization. The tool can be used to predict long-duration outbreak of such an epidemic such that we can take preventive steps earlier.

Topology optimization is a pioneering design method that can provide various candidates with high mechanical properties. However, the high-resolution for the optimum structures is highly desired, normally in turn leading to computationally intractable puzzle, especially for the famous Solid Isotropic Material with Penalization (SIMP) method. In this paper, an efficient and high-resolution topology optimization method is proposed based on the Super-Resolution Convolutional Neural Network (SRCNN) technique in the framework of SIMP. The SRCNN includes four processes, i.e. refining, path extraction & representation, non-linear mapping, and reconstruction. The high computational efficiency is achieved by a pooling strategy, which can balance the number of finite element analysis (FEA) and the output mesh in optimization process. To further reduce the high computational cost of 3D topology optimization problems, a combined treatment method using 2D SRCNN is built as another speeding-up strategy. A number of typical examples justify that the high-resolution topology optimization method adopting SRCNN has excellent applicability and high efficiency for 2D and 3D problems with arbitrary boundary conditions, any design domain shape, and varied load.

Equality and incomparability multi-label ranking have not been introduced to learning before. This paper proposes new native ranker neural network to address the problem of multi-label ranking including incomparable preference orders using a new activation and error functions and new architecture. Preference Neural Network PNN solves the multi-label ranking problem, where labels may have indifference preference orders or subgroups which are equally ranked. PNN is a nondeep, multiple-value neuron, single middle layer and one or more output layers network. PNN uses a novel positive smooth staircase (PSS) or smooth staircase (SS) activation function and represents preference orders and Spearman ranking correlation as objective functions. It is introduced in two types, Type A is traditional NN architecture and Type B uses expanding architecture by introducing new type of hidden neuron has multiple activation function in middle layer and duplicated output layers to reinforce the ranking by increasing the number of weights. PNN accepts single data instance as inputs and output neurons represent the number of labels and output value represents the preference value. PNN is evaluated using a new preference mining data set that contains repeated label values which have not experimented on before. SS and PS speed-up the learning and PNN outperforms five previously proposed methods for strict label ranking in terms of accurate results with high computational efficiency.

This paper presents a study and implementation of a convolutional neural network to identify and recognize humpback whale specimens from the unique patterns of their tails. Starting from a dataset composed of images of whale tails, all the phases of the process of creation and training of a neural network are detailed – from the analysis and pre-processing of images to the elaboration of predictions, using TensorFlow and Keras frameworks. Other possible alternatives are also explained when it comes to tackling this problem and the complications that have arisen during the process of developing this paper.

Geospatial Information Systems (GIS) can provide a great environment for using machine learning algorithm for spatial data such as satellite images. Integrating this functionality with artificial intelligence algorithms for analyzing spatial data enables us to predict challenging disasters such as deforestation. Deforestation as an environmental problems has been recorded the most serious threat to environmental diversity and one of the main components of land-use change. In this paper, we investigate spatial distribution of deforestation using artificial neural networks and satellite imagery. We modeled deforestation process using various factors in determining the relationship between deforestation and environmental and socioeconomic factors. Hence, for this purpose, the proximity to roads and habitats, fragmentation of the forest, height from sea level, slope, and soil type are considered in the model. In this research, we modeled land cover changes (forests) to predict deforestation using an artificial neural network due to its significant potential for the development of nonlinear complex models. The procedure involves image registration and error correction, image classification, preparing deforestation maps, determining layers, and designing a multi-layer neural network to predict deforestation. The satellite images for this study are of a region in Hong Kong which are captured from 2012 to 2016. The results of the study demonstrate that neural networks approach for predicting deforestation can be utilized and its outcomes show the areas that destroyed during the research period.

The many-body problem in quantum physics originates from the difficulty of describing the non-trivial correlations encoded in the exponential complexity of the many-body wave function. Motivated by the Giuseppe Carleo's work titled solving the quantum many-body problem with artificial neural networks [Science, 2017, 355: 602], we focus on finding the NNQS approximation of the unknown ground state of a given Hamiltonian $H$ in terms of the best relative error and explore the influences of sum, tensor product, local unitary of Hamiltonians on the best relative error. Besides, we illustrate our method with some examples.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

We examine the use of deep learning (neural networks) to predict the movement of the S&P 500 Index using past returns of all the stocks in the index. Our analysis finds that the future direction of the S&P 500 index can be weakly predicted by the prior movements of the underlying stocks in the index. Decomposition of the prediction error indicates that most of the lack of predictability comes from randomness and only a little from nonstationarity. We believe this is the first test of S&P500 market efficiency that uses a very large information set, and it extends the domain of weak-form market efficiency tests.

Biofilms are congregations of bacteria on a surface, and they grow into obstacles for the functionalities of any device or machinery involves anything biological. Biofilms are developed through a biochemical system known as ‘Quorum Sensing’ that accounts for the chemical signaling that direct either biofilm formation or inhibition. Computational models that relate chemical and structural features of compounds to their performance properties have been used to aide in the discovery of active small molecules for many decades. These quantitative structure-activity relationship (QSAR) models are also important for predicting the activity of molecules that can have a range of effectiveness in biological systems. This study uses QSAR methodologies combined with and different machine learning algorithms to predict and assess the performance of several different compounds acting in Quorum Sensing. Through computational probing of the quorum sensing molecular interaction, new design rules can be elucidated for countering biofilms.

With the rapid development of MEMS (Micro-electro-mechanical Systems) fabrication technologies, manifolds microelectrodes with various structures and functions have been designed and fabricated for applications in biomedical research, diagnosis and treatment through electrical stimulation and electrophysiological signal recording. The flexible MEMS microelectrodes exhibit multi-aspect excellent characteristics beyond stiff microelectrodes based on silicon or SU-8, which comprising: lighter weight, smaller volume, better conforming to neural tissue and lower fabrication cost. In this paper, we mainly reviewed key technologies on flexible MEMS microelectrodes for neural interface in recent years, including: design and fabrication technology, flexible MEMS microelectrodes with fluidic channels and electrode-tissue interface modification technology for performance improvement. Furthermore, the future directions of flexible MEMS microelectrodes for neural interface were described including transparent and stretchable microelectrodes integrated with multi-aspect functions and next-generation electrode-tissue interface modifications facilitated electrode efficacy and safety during implantation. Finally, the combinations among micro fabrication techniques with biomedical engineering and nanotechnology represented by flexible MEMS microelectrodes for neural interface will open a new gate to human lives and understanding of the world.

In the rapidly evolving field of real estate economics, the prediction of house prices continues to be a complex challenge, intricately tied to a multitude of socio-economic factors. However, traditional predictive models have often overlooked the spatial interdependencies that play a vital role in shaping housing prices. This study applies Graph Neural Networks (GNNs) on Open Statistics Knowledge Graphs to model spatial dependencies and predict house prices across Scotland’s 2011 data zones. To this end, integrated statistical indicators are retrieved from the official Scottish Open Government Data portal. The three representative GNN algorithms employed - ChebNet, GCN, and GraphSAGE - demonstrate higher prediction accuracy than traditional models, including the tabular-based XGBoost and a simple Multi-Layer Perceptron (MLP). In addition, local and global explainability are employed to increase transparency and trust in the predictions made by the most accurate GNN - GraphSAGE. The global feature importance is determined by a logistic regression surrogate model while the local, region-level understanding of the GNN predictions is achieved through the use of GNNExplainer. Explainaibility results are compared with those from a previous work that applied the XGBoost machine learning algorithm and the SHapley Additive exPlanations (SHAP) explainability framework on the same dataset. Interestingly, both global surrogate model and the SHAP approach underscored the Comparative Illness Factor, a health indicator, and the ratio of detached dwellings as the most crucial features in the global explainability. In the case of local explanations, while both methods showed similar results, the GNN approach provided a richer, more comprehensive understanding of the predictions for two specific data zones.

In recent years, advancements in brain science and neuroscience have significantly influenced the field of computer science, particularly in the domain of reinforcement learning (RL). Drawing insights from neurobiology and neuropsychology, researchers have leveraged these findings to develop novel mechanisms for understanding intelligent decision-making processes in the brain. Concurrently, the emergence of quantum computing has opened new frontiers in artificial intelligence, leading to the development of quantum machine learning (QML). This study introduces a novel model that integrates Quantum Spiking Neural Networks (QSNN) and Quantum Long Short-Term Memory (QLSTM) architectures, inspired by the complex workings of the human brain. Specifically designed for reinforcement learning tasks in energy-efficient environments, our approach progresses through two distinct stages mirroring sensory and memory systems. In the initial stage, analogous to the brain’s hypothalamus, low-level information is extracted to emulate sensory data processing patterns. Subsequently, resembling the hippocampus, this information is processed at a higher level, capturing and memorizing correlated patterns. We conduct a comparative analysis of our model against existing quantum models such as Quantum Neural Networks and their classical counterparts, elucidating its unique contributions. Through empirical results, we aim to underscore the effectiveness of our approach in optimizing energy consumption in practical scenarios.

The timely diagnosis of defects at their incipient stage of formation is crucial to extend the life-cycle of technical appliances. This is the case of mechanical-related stress, either due to long aging degradation processes (e.g., corrosion) or in-operation forces (e.g., impact events), which might provoke detrimental damages, such as cracks, disbonding or delaminations, most commonly followed by the release of acoustic energy. The localization of these sources can be successfully fulfilled via adoption of Acoustic Emission (AE)-based inspection techniques through the computation of the Time of Arrival (ToA), namely the time at which the induced mechanical wave released at the occurrence of the acoustic event arrives to the acquisition unit. However, the accurate estimation of the ToA may be hampered by poor Signal-to-Noise ratios (SNRs). In these conditions, standard statistical methods typically fail. In this work, two alternative Deep Learning methods are proposed for ToA retrieval, namely a Dilated Convolutional Neural Network (DilCNN) and a Capsule Neural Network for ToA (CapsToA). These methods have the additional benefit of being portable on resource-constrained microprocessors. Their performance has been extensively studied on both synthetic and experimental data, focusing on the problem of ToA identification for the case of a metallic plate. Results show that the two novel methods can achieve localization errors which are up to 70% more precise than those yielded by conventional strategies, even when the SNR is severely compromised (i.e., down to 2 dB). Moreover, DilCNN and CapsNet have been implemented in a tiny machine learning environment and then deployed on microcontroller units, showing a negligible loss of performance with respect to offline realizations.

Multilabel learning goes beyond standard supervised learning models by associating a sample with more than one class label. Among the many techniques developed in the last decade to handle multilabel learning best approaches are those harnessing the power of ensembles and deep learners. This work proposes merging both methods by combining a set of gated recurrent units, temporal convolutional neural networks, and long short-term memory networks trained with variants of the Adam optimization approach. We examine many Adam variants, each fundamentally based on the difference between present and past gradients, with step size adjusted for each parameter. We also combine Incorporating Multiple Clustering Centers and a bootstrap-aggregated decision trees ensemble, which is shown to further boost classification performance. In addition, we provide an ablation study for assessing the performance improvement that each module of our ensemble produces. Multiple experiments on a large set of datasets representing a wide variety of multilabel tasks demonstrate the robustness of our best ensemble, which is shown to outperform the state-of-the-art. The MATLAB code for generating the best ensembles in the experimental section will be made available at https://github.com/LorisNanni.

In previous work, a quantum mathematical formalism associated an element of experience with a single sensory neuron, as a local reduction of a global mental state. In contrast to the binary objective states of neuronal polarisation/depolarisation, neuronal experience was modeled as a continuous variable, the instantaneous value of which could only be estimated statistically from an ensemble of evoked responses to stereotyped stimulus presentation. In the present work, the quantum operations formalism of energy dissipation through amplitude damping is adopted to explain how smooth evolution of conscious experience might arise from discrete spikes and discontinuous synaptic transmission between neurons.

This research proposes a near-infrared hyperspectral imaging/two-branch convolutional neural network (NIR-HSI/2B-CNN) algorithmic scheme to detect mango anthracnose of the species Colletotrichum asianum at the early stages of disease development. In the algorithmic model development, root mean square propagation was used as the solver to train the neural network, given 150 epochs. In addition, spectral raw data was preprocessed to transform it into an understandable and efficient format. The optimal classification model was the 2B-CNN model with 1st-derivative preprocessing, achieving an accuracy of 0.94 for the calibration set and 0.71 for the prediction set. The proposed NIR-HSI/2B-CNN scheme could detect anthracnose mangoes since the the first day of inoculation of the spore suspension (i.e., day 0) through to day 3, achieving a moderate classification accuracy. Meanwhile, the accuracy of conventional convolutional neural networks (CNN) were within a range of 0.66-0.67 for the calibration set and 0.55-0.57 for the prediction set. The results indicated that incorporating spatial features in the 2B-CNN modeling enhanced the prediction performance of the algorithm. The proposed NIR-HSI/2B-CNN algorithmic scheme needs refinements to be able to reliably sort mango fruits into those suitable for premium fresh consumption and export without anthracnose and those for domestic consumption or processing. The novelty of this research lies in the use of NIR-HSI and 2B-CNN algorithm to detect plant pathogens at the early stages of disease development. In addition, the new method of natural simulation to deposit the fungal spores onto the mango surface by spraying spore suspension onto the mango surface where the conidia penetrated unaided into the underneath of the mango peel is proposed.

This study aimed to learn disturbance information to effectively control multiple small unmanned surface vehicles (USVs) for marine research purposes at sea. The learned disturbance information was used to investigate the control of multiple USV swarms based on the leading–following formation technique. Numerous studies have already been conducted on swarm control using drones in the air; however, there has been a paucity of studies on swarm control in the sea. Contrary to swarm control in aviation, the fluid density of the sea is high, and the environment is constantly changing; thus, a robot system would be significantly affected by disturbances. This ultimately influences the maintenance of swarm formations and the accomplishment of missions [1,2]. Therefore, it is difficult to control numerous moving objects while maintaining a formation at sea by using the existing aerial drone swarm control technology. To solve this problem, we learned a long short-term memory (LSTM) model with time-series marine environmental data to predict maritime disturbances. Thereafter, the model was applied to a mission-based position control algorithm of each USV constituting the swarm to design a marine unmanned floating vessel swarm control system that can be applied to various marine environments. Specifically, to effectively control numerous small USVs for marine research purposes, ocean currents are learned using the LSTM algorithm, and the predicted ocean currents are used to generate a swarm USV control system for USV formations. In this study, a control system model of several small USVs equipped with two rear thrusters and a front lateral thruster was designed. The LSTM algorithm was learned using the previous ocean current data, and the velocity of the following ocean currents was predicted. The predictions were then used as a system disturbance to determine the thrust of the controller. To measure ocean currents in the sea when each USV moves, the velocity, azimuth, and position (latitude, longitude) data from the GPS mounted on the USV were used to measure the velocity and direction of the hull's movement. Further, the flow rate was measured using a flow rate sensor on a small USV. The USV movement and position were controlled using an artificial neural network-PID (ANN-PID) controller. This study entailed a comparative analysis of the designed USV model results and those generated by the simulator, including the behavior control rule of the USV swarm and the path of the actual USV swarm at sea. It was verified that the effectiveness of the USV mathematical model and behavior control rules. By comparing the movement path of the swarm USV with and without the disturbance learning algorithm and ANN-PID control algorithm applied to the designed simulator, the position error and maintenance performance of the swarm formation were analyzed, and the application results were compared.

Abstract Background and Objective: Medical Microwave Radiometry (MWR) is used to capture the thermal properties of internal tissues and has usages in breast cancer detection. Our goal in this paper is to improve classification performance and investigate automated neural architecture search methods. Methods: We investigate optimizing the weights of a weight agnostic neural network using bi-population covariance matrix adaptation evolution strategy (BIPOP-CMA-ES) once the topology is found. We compare it against a weight agnostic and cascade correlation neural network. Results: The experiments are conducted on a breast cancer dataset of 4912 patients. Our proposed weight agnostic BIPOP-CMA-ES model achieved the best performance. It obtained an F1-score of 0.9225, accuracy of 0.9219, precision of 0.9228, recall of 0.9217 and topology of 153 connections. Conclusions: The results are an indication of the potential of MWR utilizing a neural network-based diagnostic tool for cancer detection. By separating the tasks of topology search and weight training, we are able to improve the overall performance.

The zoonotic disease known as monkeypox, which is related to smallpox, can be difficult to diagnose since it resembles other illnesses that might cause the same symptoms. In this study, we present an accurate technique for monkeypox detection based on convolutional neural networks (CNNs). Our method improves diagnosis reliability by having the CNN model incorporate a dataset of nine important symptoms. For creating CNN-based monkeypox detection system, the researchers used a collection of high-definition photos and nine symptoms. The model was constructed using TensorFlow's Keras API and Python 3.10, classifying lesions based on a probabilistic score. A likelihood greater than 50% on CNN indicated that the case was really monkeypox. If not, five or more symptoms suggested that monkeypox may be present with metrics including accuracy, precision, recall, and F1-score. The study developed a CNN model to predict monkeypox from lesion images and symptom analysis. The model, built with layers including convolutional, pooling, and fully connected, achieved high accuracy and low loss, with metrics like ROC AUC (0.84), precision (0.78), and recall (0.90). The model effectively differentiates between monkeypox and other conditions. Tables illustrate the model's predictions based on various symptom combinations, highlighting its capability to assess monkeypox risk with high confidence. The study developed a CNN model integrating patient symptoms and skin lesion images for accurate monkeypox diagnosis. With a balanced accuracy of 82%, F1-Score of 84%, and sensitivity and specificity of 80% and 85%, respectively, the model effectively distinguishes monkeypox from similar illnesses. It demonstrated resilience despite limited high-resolution images, emphasizing the potential of CNNs in medical diagnosis. The model's performance can be further improved by incorporating additional data and advanced techniques, enhancing early detection in future outbreaks.

Graph neural networks (GNNs) have been effectively implemented in a variety of real-world applications, while their underlying work mechanisms remain a mystery. To unveil this mystery and advocate trustworthy decision-making, many GNN explainers have been proposed. However, existing explainers often face significant challenges, such as: 1) explanations being tied to specific instances; 2) limited generalizability to unseen graphs; 3) potential generation of invalid graph structures; and 4) restrictions to particular tasks (e.g., node classification, graph classification). To address these challenges, we propose a novel explainer, GAN-GNNExplainer, which employs a generator to produce explanations and a discriminator to oversee the generation process, enhancing the reliability of the outputs. Despite its advantages, GAN-GNNExplainer still struggles with generating faithful explanations and underperforms on real-world datasets. To overcome these shortcomings, we introduce ACGAN-GNNExplainer, an improved approach that improves upon GAN-GNNExplainer by using a more robust discriminator that consistently monitors the generation process, thereby producing explanations that are both reliable and faithful. Extensive experiments on both synthetic and real-world graph datasets demonstrate the superiority of our proposed methods over existing GNN explainers.

This paper investigates the integration of Graph Neural Networks (GNNs) and incremental learning for blockchain applications, with a focus on fraud detection, anomaly detection, and smart contract verification. By leveraging graph structure exploitation, GNNs can propagate information across nodes, reducing label dependency. Incremental learning enhances the model's adaptability to evolving blockchain networks, allowing continual learning without full retraining. Together, these technologies provide a scalable, efficient solution for improving security, performance, and adaptability in decentralized financial systems and smart contract environments.

A novel approach is developed to improve the convergence of Physics-Informed Neural Networks (PINNs), aiming to employ them as real-time computational models within the framework of the digital twin for manufacturing processes. This method entails the weighting of physical equations, boundary conditions, and initial conditions to ensure their comparable magnitudes, with power being the chosen quantity in this study. The approach is applied to thermal problems, which are crucial for predicting manufacturing part defects. Different configurations, including complex boundary conditions and complex physics, were tested to assess the model’s robustness. The W-PINN demonstrates good predictions and strong stability compared to the classical PINN.

Making sustainable business models, especially in manufacturing, is a key approach for organizations to adopt in order to create more sustainable processes. New technologies are needed to implement new policies that can minimize the economic, environmental, and social consequences of industrial activity. Sustainable maintenance is decisive to guarantee the availability, reliability, and safety of assets, surpassing traditional maintenance policies and embracing the principles of the circular economy. The main objective of Maintenance 4.0 is to increase the lifespan and availability of the equipment by preventing unplanned downtime, reducing planned shutdowns, and improving safety. This research focuses on the integration of advanced Industry 4.0 tools with conventional monitoring and control techniques in process industries. The article suggests that while complex neural networks might provide good predictions, simpler solutions can generalize well and have lower prediction errors because they can capture the underlying relationships between variables in a specific asset better. The combination of maintenance function, Industry 4.0 tools, and advanced statistical solutions to obtain sustainable processes can facilitate organizational change and aid decision-making in equipment management. These solutions seek to reduce interruptions and expenses through the unnecessary utilization of labor and spare parts. All these considerations improve communication and data processing, resulting in improved maintenance of a hydrogen compressor in the petrochemical industry.

Geopolymers, made from aluminosilicate raw materials, offer significant environmental advantages over conventional concrete (CC) mixes. This study explores the compressive strength, setting time, and durability of geopolymer concrete (GPC) cylinders, some of which include an additional ordinary portland cement (OPC) mix. Consistent material composition and testing methods are emphasized to achieve reliable results. MATLAB was utilized to develop and assess a neural network model predicting the compressive strength of GPC based on key variables. The model was validated using 16 experimental samples and 1047 samples from various studies. The performance plot displayed the Mean Squared Error (MSE) over iterations, identifying the best training performance at epoch 658 with an MSE of 5.3408. The Error Histogram highlighted distribution errors between predicted and actual compressive strength values, with the highest range from -1.015 to 0.3587, meaning that the predicted values were mostly within a small margin of error from the actual values. This narrow error range indicates that the ANN model has high accuracy in its predictions, as most errors are small and clustered around zero, demonstrating reliable performance in estimating compressive strength. Regression analysis showed varying correlation coefficients (training set R=0.98373, test set R=0.88164, and whole set R=0.96982), indicating adequate predictive accuracy. The results demonstrate that properly trained neural networks can effectively predict the compressive strength of GPC, highlighting its potential as a sustainable construction material.

With the rapid developments that have been made in computer vision and computer technology, semantic segmentation of high-resolution images has emerged as a mainstream and challenging task. The, segmentation of water areas remains a complex task due to the similar features between water areas or between water areas and other land objects. Meanwhile, since coastlines and riverbanks are typically presented in irregular shapes, it is difficult to obtain the categories of pixels at boundaries. This paper proposed the use of a Water-Land Boundary Attention Network (WLBANet) to improve the accuracy of pixels at boundaries between water and land. This network also reinforced the performance of contextual information extraction into distinguishing between water areas and other land objects. To prove the validity of this proposed network, WLBANet was performed on the Water Land Dataset (WLD), which is also by this paper, and which contains water areas and other land objects categories. The results demonstrates that the proposed method has significant effectiveness.

Background: Prediction of neurorehabilitation outcomes after a Spinal Cord Injury (SCI) is crucial for healthcare resource management and improving prognosis and rehabilitation strategies. Arti-ficial neural networks (ANNs) have emerged as a promising alternative to conventional statistical approaches for identifying complex prognostic factors in SCI patients. Materials: a database of 1256 SCI patients admitted for rehabilitation was analyzed. Clinical and demographics data and SCI characteristics, were used to predict functional outcomes using both ANN and linear regression models. The former was structured with input, hidden, and output layers, while the linear regression identified significant variables affecting outcomes. Both ap-proaches aimed to evaluate and compare their predictive accuracy for rehabilitation outcomes measured by the Spinal Cord Independence Measure (SCIM) score. Results: Both ANN and linear regression models identified key predictors of functional outcomes, such as age, injury level, and initial SCIM scores (correlation with actual outcome: R=0.75 and 0.73, respectively). When alimented also with parameters recorded during hospitalization, the ANN highlighted the importance of these additional factors like motor completeness and compli-cations during hospitalization, showing an improvement in its predictive accuracy (R=0.87). Conclusion: ANN seemed to be not widely superior to classical statistics in general, but, taking into account complex and non-linear relationships among variables, emphasized the impact of complications during the hospitalization on recovery, particularly respiratory issues, deep vein thrombosis, and urological complications. These results suggested that the management of com-plications is crucial for improving functional recovery in SCI patients.

Artificial intelligence technologies based on deep convolutional neural networks and large lan-guage models have made significant breakthroughs in many tasks such as image recognition, target detection, semantic segmentation and natural language processing, but also face the problem of contradiction between the high computational capacity of the algorithms and the limited deployment resources. Quantization, which converts floating-point neural networks into low-bit-width integer networks, is an important and essential technique for efficient deploy-ment and cost reduction in edge computing. This paper analyze various existing quantization methods, showcase the deployment accuracy of advanced techniques, and discuss the future challenges and trends in this domain.

Microwave technology, foundational in quantum computing, utilizes precise control of quantum states via microwave pulses to manage quantum bits (qubits). This review explores the potential of leveraging these principles in neuroscience, where such technology could enable novel approaches to imaging, diagnosing, and treating neurological disorders. By comparing the techniques used in quantum computing with potential applications in neural circuit manipulation and brain activity monitoring, we highlight both the promising synergies and the significant challenges at the intersection of these fields. This interdisciplinary exploration not only underscores the transformative potential of microwave technology in neuroscience but also addresses the ethical considerations and technological hurdles that accompany the integration of advanced quantum mechanics into biological contexts. The convergence of microwave technology with neural science opens a pathway for breakthroughs in understanding and treating complex brain disorders, advocating for a cautious yet optimistic approach towards future research and application.

Graph Neural Networks (GNNs) are powerful models capable of managing intricate connections in non-Euclidean data, such as social networks, physical systems, chemical structures, and communication networks. Despite their effectiveness, the large-scale and complex nature of graph data demands substantial computational resources and high performance during both training and inference stages, presenting significant challenges, particularly in the context of embedded systems. Recent studies on GNNs have investigated both software and hardware solutions to enhance computational efficiency. Earlier studies on Deep Neural Networks (DNNs) have indicated that methods like reconfigurable hardware and quantization are beneficial in addressing these issues. Unlike DNN research, studies on efficient computational methods for GNNs are less developed and require more exploration. This survey reviews the latest developments in quantization and FPGA-based acceleration for GNNs, showcasing the capabilities of reconfigurable systems (often FPGAs) to offer customized solutions in environments marked by significant sparsity and the necessity for dynamic load management. It also emphasizes the role of quantization in reducing both computational and memory demands through the use of fixed-point arithmetic and streamlined vector formats. This paper concentrates on low-power, resource-limited devices over general hardware accelerators and reviews research applicable to embedded systems. Additionally, it provides a detailed discussion of potential research gaps, foundational knowledge, obstacles, and prospective future directions.

We propose a neural-network-based watermarking method that introduces the quantized activation function that approximates the quantization of JPEG compression. Many neural-network-based watermarking methods have been proposed. Conventional methods have acquired robustness against various attacks by introducing an attack simulation layer between the embedding network and the extraction network. The quantization process of JPEG compression was replaced by the noise addition process in the attack layer of the conventional methods. In this paper, we propose a quantized activation function that can simulate the JPEG quantization standard as it is in order to improve the robustness against the JPEG compression. Our quantized activation function consists of several hyperbolic tangent functions and is applied as an activation function for neural networks. Our network was introduced in the attack layer of ReDMark proposed by Ahmadi et al. to compare it with their method. That is, the embedding and extraction networks had the same structure. We compared the usual JPEG compressed images and the images applying the quantized activation function. The results showed that a network with quantized activation functions can approximate JPEG compression with high accuracy. We also compared the bit error rate (BER) of estimated watermarks generated by our network with those generated by ReDMark. We found that our network was able to produce estimated watermarks with lower BERs than those of ReDMark. Therefore, our network outperformed the conventional method with respect to image quality and BER.

Convolutional Neural Networks (CNNs) present drawbacks for modeling geometric transformations, such as scaling and rotation, caused by the convolution operation’s locality. Deformable convolution (DCON), a mechanism that substitutes standard convolution, increasing the receptive field to capture relevant features, is a promising approach to solve this drawback and improve the robustness of CNNs. However, the optimal way to replace the standard convolution with its deformable counterpart in a CNN model is unclear. In this study, we clarify this aseveration by conducting several experiments using deformable convolutions applied in the layers that conform a small four-layer CNN model. We also use deformable convolutions on the four-layers of several ResNet CNNs with depths 18, 34, 50, and 101. The models were tested in binary balanced classes with 2D data for image classification: Cats & Dogs, EyesPACS, Spyders & Chickens, and Shapes. After this testing, we evaluated DCON in 3D data for action recognition: UCF101 and Human2 (a dataset we compiled to control movement, clothing and background). The contribution of this research lies in a guideline to use DCON. It can be summarized as follows: if DCON is used on the first layers of the proposal of model (with simple features), the computational resources expressed as the quantity of Flops will tend to increase and produce bigger misclassification than the standard CNN. However, if the DCON is used at the end layers, the quantity of Flops used in the training and testing will decrease, and the classification accuracy will improve by up to 20% about the base model. Moreover, it gains robustness when using deformable convolutions because it can adapt to the region of interest. Also, the best kernel size of the DCON is three. It showed better results than size five. In the last case, the quantity of Flops increase quadratically, but their performance does not increase significantly. With these results, we propose a guideline to use the DCON and contribute to understanding the impact of DCON on the robustness of CNNs.

The interaction between electromagnetic fields (EMFs) and biological systems has been a subject of intense research and debate. This study explores the potential influence of magnetic fields on neural circuits, which are the building blocks of the human brain. By developing a mathematical model and conducting computational simulations, we investigate how magnetic fields can affect the transmission of electrical signals within neural circuits. The results suggest that magnetic fields can alter the speed and direction of signal propagation, offering potential applications in medical treatments and brain-machine interfaces. However, the study also highlights the need for more comprehensive models that consider the complexity of real-world neural circuits and the multifaceted nature of magnetic fields. The interaction between EMFs and neural circuits is a rich and complex subject that requires a multidisciplinary approach, combining physics, biology, mathematics, and computer science. While this study provides valuable insights, further research is needed to fully understand the implications of this interaction and to realize its potential applications in medicine, neuroscience, and technology. The findings contribute to a growing body of knowledge that bridges the gap between physics and neuroscience, opening new horizons for understanding the human mind and its connection to the physical world.

Currently there are fewer depth models applied to pepper picking detection, while the existing generalized neural networks have problems such as large model parameters, long training time, and low model accuracy.In order to solve the above problems, this paper proposes a Yolo-chili target detection algorithm for chili pepper detection. First, the classical target detection algorithm yolov5 is used as a benchmark model, and an adaptive spatial feature pyramid structure combining the attention mechanism and the idea of multi-scale prediction is introduced to improve the model's detection effect on occluded peppers and small target peppers. Secondly, a three-channel attention mechanism module is introduced to improve the algorithm's long-distance recognition ability and reduce the interference of redundant testers. Finally, the quantized pruning method is used to reduce the model parameters and realize the lightweight processing of the model. Applying the method to the homemade chili pepper dataset, the AP value of chili pepper reaches 93.11%; the accuracy rate is 93.51% and the recall rate is 92.55%.The experimental results show that yolo-chili is able to achieve accurate and real-time pepper detection under complex orchards.

In cutting processes tool condition affects the quality of the manufactured parts. As such an essential component to prevent unplanned downtime and to assure machining quality is having information about the state of the cutting tool. The primary function of it is to alert the operator that the tool has reached or is reaching a level of ware beyond which behavior is unreliable. In this paper the tool condition is being monitored by analyzing the electric current on the main spindle via an artificial intelligence model utilizing a LSTM neural network. In the current study the tool is monitored while working on a cylindrical raw piece made of AA6013 aluminum alloy with a custom polycrystalline diamond tool, for the purposes of monitoring the ware of these tools. Spindle current characteristics were obtained using external measuring equipment to not influence the operation of the machine included in a larger production line. As a novel approach, an artificial intelligence model based on a LSTM neural network is utilized for the analysis of the spindle current obtained during a manufacturing cycle and assessing the tool ware range in real time. The neural network was designed and trained to notice significant char-acteristics of the captured current signal. The conducted research serves as a proof of concept for use of a LSTM neural network-based model as a method of monitoring the condition of cutting tools.

The article presents the operation of the automatic pine sawn timber inspection system, which was developed at the Woodinspector company and offered commercially. The vision inspection system is used to detect various wood defects, including knots, blue stain, and mechanical damage caused by worms. Blue stain is a defect that is difficult to detect based on the color of the wood, because it can be easily confused with wood defects or dirt that do not impair its strength properties. In particular, the issues of detecting blue stain in wood, the use of artificial neural networks and improving the operation of the system in production conditions were discussed.

Abstract：The brain often switches freely between focused attention and divergent thinking, and the default mode network (DMN) is activated during brain rest. The discovery, function and characteristics of default mode network all indicate that learning does not stop when the brain "rests". Mental disease can lead to dysfunctional default mode networks, which affects learning adversely. Therefore, default mode network plays an important role in learning. Neural activities such as β-wave rhythm regulation, "subconscious" divergence mode initiation, hippocampal function and neural replay occur during default mode, which also explain that "rest" promotes learning. This paper reveals the role and neural mechanism of default mode network in learning from the neural level, discusses the essential role default mode network plays in learning, and default mode network enables rest to promote learning.

The digital orthophoto is an image with geometric accuracy and no distortion. It is acquired through a top view of the scene and finds widespread applications in map creation, planning, and related fields.This paper classifies the algorithms for digital orthophoto generation into two groups: explicit methods and implicit methods. Explicit methods rely on traditional geometric methods, obtaining geometric structure presented by explicit parameters with Multi-View Stereo (MVS) theories, as seen in our proposed Top view constrained Dense Matching (TDM). Implicit methods rely on neural rendering, obtaining implicit neural representation of scenes through the training of neural networks, as exemplified by Neural Radiance Fields (NeRF). Both of them obtain digital orthophoto by rendering from a top view perspective. In addition, this paper conducts an in-depth comparative study between explicit and implicit methods. The experiments demonstrate that both algorithms meet the measurement accuracy requirements and exhibit a similar level of quality in terms of generated results. Importantly, the explicit method shows a significant advantage in terms of efficiency, with a time consumption reduction of two orders of magnitude under our latest CUDA version TDM algorithm. Although explicit and implicit methods differ significantly in their representation forms, they share commonalities in the implementation across algorithmic stages. These findings highlight the potential advantages of explicit methods in orthophoto generation, while also providing beneficial references and practical guidance for the fast digital orthophoto generation using implicit methods.

Squash is a sport where referee decisions are essential to the game. However, referee decisions in squash are very subjective in nature. Disputes, both from the players and the audience, regularly happen because the referee made a controversial call. In this study ,we proposed to automate the referee decision process through machine learning. We trained neural networks to predict squash referee decisions using data from 400 referee decisions acquired through extensive video footage reviewing and labeling. Six positional values were extracted, including the attacking player’s position, the retreating player’s position, the ball’s position in the frame, the ball’s projected first bounce, the ball’s projected second bounce, and the attacking player’s racket head position. We calculated nine additional distance values, such as the distance between players and the distance from the attacking player's racket head to the ball's path. Models were trained on Wolfram Mathematica and Python using these values. The best Wolfram Mathematica model achieved an 86% ± 3.03% accuracy, while the best Python model performed a 0.852 ± 0.051 accuracy (85.2% ± 5.1%). These accuracies surpass 85%, demonstrating near-human performances. Our model has great potential for improvement as it's currently trained with limited data (400 referee decisions) and lacks crucial data points such as time and speed. The performance of our model is almost surely going to improve significantly with a larger training data set. Unlike human referees, machine learning models follow a consistent standard, have unlimited attention spans, and make decisions instantly. If the accuracy is improved in the future, the model can potentially serve as an extra refereeing official for both professional and amateur squash matches. Both the analysis of referee decisions in squash and proposal to automate the process using machine learning is unique to this study.

For years, effort has been devoted to establishing an effective bull breeding soundness evaluation procedure; usual research on the subject is based on BBSE (Bull Breeding Soundness Examination) methodologies, which have significant limitations in terms of their evaluation procedure, such as high cost, time-consuming and administratively difficult. This research focuses on the creation of a prediction model to supplement and/or improve the BBSE approach, through the study of two algorithms, Clustering and Artificial Neural Network (ANN), to find the optimum Machine Learning (ML) approach for our application, with an emphasis on data categorization accuracy. The tool is designed to assist veterinary medicine and farmers in identifying key factors and increasing certainty in their decision-making during the selection of bulls for breeding purposes, providing data from a limited number of factors generated from a deep pairing study of bulls. Zebu Bulls, European Bulls, and Crossbred Bulls were the general groupings. The data utilized in the model's creation (N =359) considers five variables that influence improvement decisions. This approach enhances decision-making by 12%. ANN obtained an accuracy of 90%; Precision was 97% for satisfying, 92% for unsatisfying, and 85% for Bad.

Chromatographic separation is a critical technique in the manufacturing processes of both chemical products and biopharmaceuticals. Its principle relies on exploiting the differences in distribution between the stationary and mobile phases to achieve the separation of mixtures. The precision of substance concentration during separation directly impacts the quality and usability of the final product. Therefore, the development of an effective and precise separation control technique has long been a vital concern in the field of chromatographic separation control. Currently, the employment of Simulated Moving Bed (SMB) technology for chromatographic separation, which allows for continuous feed, has been recognized as a cutting-edge technique. SMB is a continuous process technology that enhances the efficiency of adsorbents within the bed. This sequential multi-column SMB technology not only increases production capacity but also reduces the consumption of solvents and water. It is acknowledged as one of the cleanest manufacturing technologies in the biopharmaceutical industry. However, multi-column SMB involves various variables such as flow rates in multiple sections and valve switching times, rendering its system control highly complex. Unlike traditional control objectives that aim to minimize control output errors, the control objective of SMB is to achieve a specific proportion of substance concentration. Consequently, designing and implementing traditional control theories for SMB is challenging, leading to SMB systems largely being controlled based on simple PLC controls. Moreover, these controls are often applicable only to single or a few-column SMB setups, limiting the effectiveness of high-capacity applications. To achieve effective control of SMB, this study employs an adjustable intelligent fuzzy controller with a structure like an approximate neural network (NN) for SMB control research. Simulation results demonstrate that the intelligent controller effectively achieves desirable control outcomes for the SMB system.

To improve the measurement accuracy of three-dimensional rotation angle of the spherical joint, a novel approach is proposed in this study, which combines the magnetic detection by Hall sensor and surface feature identification by eddy current sensor. Firstly, a permanent magnet is embedded in the ball head of spherical joint, and Hall sensors are set and distributed in the ball socket to measure the variation of magnetic flux density when spherical joint rotating, which are related to 3D rotation angle. In order to further improve measurement accuracy and robustness, we also set grooves on the ball head and use eddy current sensors to synchronously identify the rotation angle of the ball head. After the combination of two signals is adopted, a measurement model is established using the RBF neural network by training, and realized real-time measurement of the 3D rotation angle of spherical joint. The feasibility and superiority of this method are validated through experiments. The experimental results indicated that the measurement accuracy is promoted substantially compared to the preliminary measurement scheme based on spherical coding, the average measurement error of single axis is reduced by 9'9". The root mean square errors for the measurement of 3D rotation angles in this proposed method are as follows: the pitch angle α has an error of 1'8", the yaw angle β has an error of 2'15", and the roll angle γ has an error of 29'6".

This paper deals with the analysis of the cognitive functions of the cerebral cortex or cortex in the evolutionary context. The triune brain model is presented given its notorious popularity in fields that are not strictly neuroscientific, and its limitations and inaccuracies are also shown. Although it is an outdated theory, this one represented the passage to a new era, because it really was the model of the movement towards understanding the brain in evolutionary terms. Next, the paper illustrates the different areas of the cortex and their functions, as well as the evolution of the brain and the cortex in vertebrates. To date, the expansion of the cortex with the amniotes was placed 300 million years ago, although recent studies place it in the lampreys more than 500 million years ago. Evolutionary changes in mammalian brain and cortex size are discussed, showing the evolution from three to six cell layers and trends in different groups of mammals. Finally, the most recent contributions in the field of research are illustrated, such as the role of neurogenesis and the evolution of the connectivity of the cortex.

Image denoising has been one of the important problems in the field of computer vision, and it has a wide range of practical value in many applications, such as medical image processing, image enhancement, and computational photography. Traditional image denoising methods are usually based on hand-designed features and filters, but these methods perform poorly under complex noise and image structures. In recent years, the rapid development of neural network technology has revolutionized the image-denoising task. This paper introduces the knowledge about neural networks and image denoising, explores the impact of neural networks on image denoising, and how is it possible to denoise images by neural networks. It also summarises other image-denoising methods and finally points out the challenges and problems faced by image-denoising at present. Some possible new development directions are proposed to provide new solutions for image-denoising researchers and to promote the development of the field.

All kinds of vessels consist of dozens of complex machineries with rotating parts and electric motors that operate continuously in a harsh environment with excess temperature and humidity, vibration, fatigue and load. A breakdown or malfunction in one of these machineries can significantly impact the vessel’s operation and safety and consequently, the safety of the crew and the environment. To maintain operational efficiency and seaworthiness, the shipping industry invests substantial resources in preventive maintenance and repairs. This research presents the economic and technical benefits of predictive maintenance over to traditional preventive maintenance, and repair by replacement approaches in the maritime domain. By leveraging modern technology and Artificial Intelligence, we can analyze real-time operating conditions of machinery, enabling early detection of potential damages and allowing for effective planning of future maintenance and repair activities. In this paper, we propose and develop a Convolutional Neural Network that is fed with raw vibration measurements acquired in a laboratory environment from the ball bearings of a motor. Then, we investigate whether the proposed network can accurately detect the functional state of ball bearings and categorize any possible failures present, contributing to improved maintenance practices in the shipping industry.