Drawing inspiration from biological brain's energy-efficient information-processing mechanisms, photonic integrated circuits (PIC) have facilitated the development of ultrafast artificial neural networks. This in turn is envisaged to offer potential solutions to the growing demand for artificial intelligence employing machine learning in various domains, from nonlinear optimization and telecommunication to medical diagnosis. At the meantime, silicon photonics has emerged as a mainstream technology for integrated chip based application. However, challenges still need to be addressed in scaling it further for broader applications due to the requirement of co-integration of electronic circuitry for control and calibration. Leveraging physics in algorithms and nanoscale materials holds promise for achieving low-power, miniaturized chips capable of real-time inference and learning. In this back drop, we present the state of the art in neuromorphic photonic computing, focusing primarily on architecture, weighting mechanisms, photonic neurons, and training while giving an over-all view on recent advancements, challenges, and prospects. We also emphasize and high light the need for revolutionary hardware innovations to scale up neuromorphic systems while enhancing energy efficiency and performance.

Physics is imagined in the human brain which was formed in Darwin's Evolution by responding to certain threats for the survival of our evolutionary ancestors. The struggle to survive prevented us from wasting resources by paying attention to parts of reality that had no survival impact. These parts are of unknown scope and dimension. Can we negotiate this Darwin's barrier? As to reality within our reach, we suffer from imbalance between information absorption capacity and information analysis capacity which resulted in ignoring the overflow of information to match human capacity to make sense of it. Also James Clerk Maxwell suggested that reality has small scale phenomena beyond our human reach. Since we have no brain other than what Darwin equipped us with, this barrier looked unsurmountable. But lo and behold: much as we have built vehicles to carry us further than our biological legs, so we now build artificial intelligence machines that carry us beyond our Darwinist barrier. Physics may transform to building AI capability to ride on. This capability may require a more universal geometry and material representation to fit AI inference engines. Suggesting Depth Unbound Reality Architecture (DURA). AI connects raw data to its conclusion potential, by-passing a storied theory of nature. The objective of physics ahead may be to build theory-replacement AI machines.

Human Pose Estimation (HPE) is a critical technology in computer vision with diverse applications ranging from healthcare to sports analysis. This project presents a method for detecting the 2D stance of multiple persons in an image using a nonparametric representation known as Part Affinity Fields (PAFs). By leveraging the first 10 layers of the VGG-19 convolutional neural network and training on the COCO dataset, our model effectively identifies and associates key points of the human body.The architecture employs a two-branch system that jointly learns part locations and their associations through sequential prediction. This enables the model to maintain real-time performance while achieving high accuracy, regardless of the number of persons in the image. To enhance accessibility, we developed a mobile application using Flutter and TensorFlow Lite, allowing real-time pose estimation via a mobile device’s front camera. The app provides immediate feedback on physical exercises and yoga poses, making it an invaluable tool for fitness enthusiasts and healthcare professionals. Visual outputs such as heatmaps and PAFs confirm the model’s capability to accurately localize and connect key points. Despite potential challenges such as data quality and hyperparameter tuning, the results indicate that our approach is both reliable and practical for real-world deployment. This project not only advances the state-of-the-art in HPE but also opens up possibilities for future enhancements, including integrating 3D pose estimation and applying the technology in augmented and virtual reality applications.

Celiac disease is a gluten-sensitive immune-mediated enteropathy of the small intestine that occurs in genetically predisposed individuals. Abnormal immune response results in mucosal inflammation, villous atrophy, and crypt hyperplasia. This study was a proof-of-concept exercise that used a convolutional neural network to classify hematoxylin and eosin (H&E) histological images of celiac disease, normal small intestine control, and non-specified duodenal inflammation; 7294, 11,642, and 5966 images, respectively. The trained network classified celiac disease images with high performance (accuracy 99.7%, precision 99.6%, recall 99.3%, F1-score 99.5%, and specificity 99.8%). Interestingly, when the same network (already trained for the 3 class images), analyzed duodenal adenocarcinoma (3723 images), the new images were classified as duodenal inflammation in 63.65%, small intestine control in 34.73%, and celiac disease in 1.61% of the cases. Finally, when the network was retrained using the 4 histological subtypes of images, all performance parameters were above 99% for celiac disease. In conclusion, the convolutional neural network (CNN)-based deep neural system was able to classify medical histological images with high performance. Narrow artificial intelligence (AI) is designed to perform tasks that typically require human intelligence, but it operates within limited constraints and is task specific.

- Early and accurate detection of pneumonia from chest X-ray images is crucial for timely treatment and patient care. In study presents a robust computational framework leveraging the CheXnet algorithm, a deep learning model, to identify pneumonia from chest X-rays. Developed a neural network architecture trained on a substantial dataset of chest X- ray images labeled as 'Normal' and 'Pneumonia'. The user- friendly interface of the system allows for seamless uploading of images, with the model subsequently providing predictions, a confusion matrix, accuracy metrics, and layer activations visualizations. The algorithm's performance was rigorously evaluated, with a confusion matrix indicating a high number of true positives and true negatives. Specifically, the model detected pneumonia with an accuracy of 92.47%, as shown by the results displayed in the system's interface. The precision, recall, and F1-score for pneumonia detection were 0.90, 0.96, and 0.93 respectively, with the overall system achieving an accuracy of 0.91 across the test set of 624 images. Visualizations of the neural network layers reveal the complex feature mappings the model uses to differentiate between normal and pathological findings. These insights could be vital for enhancing the interpretability of deep learning models in medical diagnostics. The Results indicate that the CheXnet-based neural network is a promising tool for automating pneumonia detection in clinical settings, which can assist radiologists in the diagnostic process and potentially improve patient outcomes through earlier intervention.

Neural or mental simulation of actions is a powerful tool for allowing cognitive agents to develop Prospection Capabilities that are crucial for learning and memorizing key aspects for challenging skills. In previous studies we developed an approach based on the animation of the redundant human Body Schema based on the Passive Motion Paradigm (PMP). In this paper we show that this approach can be easily extended to hyper-redundant serpentine robots as well as to hybrid configurations where the serpentine robot is functionally integrated with a traditional skeletal infrastructure. A simulation model is analyzed in detail showing that it incorporates spatio-temporal features discovered in the biomechanical studies of biological hydrostats like the elephant trunk or the octopus tentacles. It is proposed that such generative internal model can be the basis for a cognitive architecture appropriate for serpentine robots, independent of the underlying design and control technologies. Although robotic hydrostats have received a lot of attention in the last decades, the great majority of research activities have been focused on the actuation/sensorial/material technologies that can support the design of hyperredundant soft robots as well as the related control methodologies. The cognitive level of analysis has been limited to motion planning, without addressing synergy formation and metal time travel. This is where the contribution of the paper is focused on.

This comprehensive review explores the advancements in processing-in-memory (PIM) techniques for deep learning applications. It addresses the challenges faced by monolithic chip architectures and highlights the benefits of chiplet-based designs in terms of scalability, modularity, and flexibility. The review emphasizes the importance of dataflow-awareness, communication optimization, and thermal considerations in designing PIM-enabled manycore architectures. It discusses different machine learning workloads and their tailored dataflow requirements. Additionally, the review presents a heterogeneous PIM system for energy-efficient neural network training and discusses thermally efficient dataflow-aware monolithic 3D (M3D) NoC architectures for accelerating CNN inferencing. The advantages of TEFLON (Thermally Efficient Dataflow-Aware 3D NoC) over performance-optimized SFC-based counterparts are highlighted. Overall, this review provides valuable insights into the development and evaluation of chiplet and PIM architectures, emphasizing improved performance, energy efficiency, and inference accuracy in deep learning applications.

Hybrid power plants have recently emerged as reliable and flexible electricity generation stations by combining multiple renewable energy sources, energy storage systems (ESS), and fossil-based output. However, the effective operation of the hybrid power plants to ensure continuous energy dispatch under challenging conditions is a complex task. This paper proposes a dispatch engine (DE) based on mixed-integer linear programming (MILP) for the planning and management of hybrid power plants. To maintain the committed electricity output, the dispatch engine will provide schedules for operation over extended time periods as well as monitor and reschedule the operation in real-time. Through precise prediction of the PV and wind power output, the proposed approach guarantees optimum scheduling. The precise prediction of the PV and wind power are achieved by employing a predictor of Feed-Forward Neural Network (FFNN) type. With such a dispatch engine, the operational cost of the hybrid power plants, and the use of diesel generators (DGs) are both minimized. A case study is carried out to assess the proposed dispatch engine feasibility. A real-time measurement data pertaining to load, wind, and PV power outputs is obtained from different locations in the Sultanate of Oman. The real-time data is utilized to predict the future output power from PV and the Wind farm over 24 hours. The predicted powers are then used in combination with a PV-Wind-DG-ESS-Grid hybrid plant to evaluate the performance of the proposed dispatch engine. The proposed approach is implemented and simulated using MATLAB. The results of the simulation reveal the proposed Feed-Forward Neural Network’s (FFNN) powerful forecasting abilities. In addition, the results demonstrate that adopting the proposed DE can minimize the use of DG units and reduce plant running expenses.

The paper aims to develop and test an algorithm for classifying Russian-language text reviews of patients’ experiences with medical facilities and physicians, extracted from social media. This is motivated by the limitations of conventional methods of surveying consumers to assess their satisfaction with the quality of services, which are being replaced by automatic processing of text data from social media. This approach enables to get more objective results due to the increased representativeness and independence of the sample of service consumers. The authors have tested machine learning methods using various neural network architectures. A hybrid method was developed to classify text reviews of medical facilities posted by patients on the two most popular physician review websites in Russia. Overall, more than 60,000 reviews were analysed. The main results are as follows: 1) the classification algorithm developed by the authors has a high efficiency, the best result being achieved by the GRU-based architecture (val_accuracy = 0.9271); 2) applying the named entity search method to text messages following their partitioning improved the classification efficiency for each of the classifiers based on artificial neural networks. To further enhance the classification quality, reviews need to be semantically partitioned by target and sentiment and the resulting fragments need to be analysed separately.

Although the statistical methods of downscaling climate data have progressed significantly, the development of high-resolution precipitation products continues to be a challenge. This is especially true when interest centres on downscaling value over several study sites. In this paper , we report a new downscaling method termed the multi-site Climate Generative Adversarial Network (MSCliGAN), which can simulate annual maximum precipitation to the regional scale during the 1950-2010 period in different cities in Canada by using different AOGCM's from the Coupled Model Inter-Comparison Project 6 (CMIP6) as input. Auxiliary information provided to the downscaling model included topography and land-cover. The downscaling framework uses a convolution encoder-decoder U-net network to create a generative network and a convolution encoder network to create a critic network. An adversarial training strategy is used to train the model. The critic/discriminator used Wasserstein distance as a loss measure and on the other hand the generator is optimized using a summation of content loss on Nash-Shutcliff Model Efficiency (NS), structural loss on structural similarity index (SSIM), and adversarial loss Wasserstein distance. Downscaling results show that downscaling AOGCMs by incorporating topography and land-use/land-cover can produce spatially coherent fields close to observation over multiple-sites. We believe the model has sufficient downscaling potential in data sparse regions where climate change information is often urgently needed.

Wildlife monitoring can be time-consuming and expensive, but the fast-developing technologies of uncrewed aerial vehicles, sensors, and machine learning pave the way for automated monitoring. In this study we trained YOLOv5 neural networks to detect Points of Interest, hare (Lepus europaeus), and roe deer (Capreolus capreolus) in thermal aerial footage and proposed a method to manually assess the parameter mean average precision (mAP), compared to the number of actual false positive and false negative detections in a subsample. This showed that a mAP close to 1 for a trained model does not necessarily mean perfect detection and provided a method to gain insights into the parameters affecting the trained models' precision. Furthermore, we provided a basic, conceptual algorithm for implementing real-time object detection in uncrewed aircraft systems equipped with thermal sensors, with high zoom capabilities, and a laser rangefinder. Real-time object detection is becoming an invaluable complementary tool for the monitoring of cryptic and nocturnal animals with the use of thermal sensors.

Alzheimer's disease (AD) is a progressive and evolving neurodegenerative disease with an insidious onset that can lead to memory loss and cognitive impairment. There is no effective treatment for this disease. However, early diagnosis plays an important role in treatment planning to slow down its progression, as treatment has the greatest impact in the early stages of the disease. Neurological images obtained through different imaging techniques provide powerful information and help diagnose the disease. With the wide application of deep learning techniques in disease diagnosis, especially the prominence of Convolutional Neural Networks (CNNs) in computer vision and image processing, more and more studies are proposing the use of this algorithm for the diagnosis of AD. In this paper, we first systematically introduce the impact of AD on people, detailing the biomarkers, early clinical symptoms, and risk factors of this disease. Secondly, it goes on to detail the development of CNNs, their form, and methods to help diagnose AD. It is proposed that CNNs can help diagnose AD by analyzing medical imaging data, particularly structural brain scans such as magnetic resonance imaging (MRI) and functional scans such as positron emission tomography (PET). Finally, it is concluded that CNNs are of great importance for the diagnosis of AD and that they are likely to play an increasingly important role in the early detection of the disease, the understanding of disease mechanisms, and ultimately, in the development of effective AD therapies and interventions. CNNs are playing an increasingly important role in the Their potential impact on healthcare emphasizes the importance of continued research and innovation in neural networks and medical imaging.

Applications for Wireless Sensor Networks (WSNs) range from monitoring the environment to automating factories. However, sustained and effective functioning is made more difficult by Sensor Nodes (SNs) limited energy supplies in which optimization is the main issue. So with the aim of increasing the lifespan by decreasing the energy consumption of WSN, Low-Energy Adaptive Clustering Hierarchy (LEACH) protocol with Deep Learning (DL) algorithm is analyzed in this paper. LEACH is a hierarchical mechanism that elects Cluster Heads (CHs) and regularly rotates their positions in order to allocate energy use effectively by using the same amount of energy. However, Deep Learning (DL) method is used to further improve energy optimization. In many applications, the types of Deep Learning methods like Artificial Neural Networks (ANNs) have shown to be very useful. Using this method, WSNs may make more efficient decisions that reduce energy consumption. Data aggregation, duty cycling, and transmission protocols may all be optimized by Deep Learning model's ability to recognize patterns and forecast network behavior. This results in lower energy consumption, a longer lifespan for the network, and better overall performance.

The unstable international economic situation is reflected in the supply chain stress, lack or increased cost of some raw materials, fuel or semi-finished products is forcing organizations to perform new optimization initiatives in the utilization of their equipment and assets pointed to obtain the maximum value from them, while maintaining and even improving the quality of their products. The achievement of these objectives involves the reduction or minimization of equipment downtime to maintain the advantage over their competitors and ensure the organization's competitiveness. The intelligent maintenance system (IMS) provides adequate support for decision-making related to equipment maintenance, since poor maintenance results in unplanned stoppages, with the consequent additional cost and increased customer dissatisfaction, and an over-maintenance can result in an additional labor cost, time and the replacement of parts that are in good conditions. The utilization of new tools and technologies introduced by Industry 4.0 offers multiple opportunities for enhancement through communication and computerized data processing, aiming to improve the maintainability of a hydrogen compressor using neural networks based on attention mechanisms combined with linear regression.

Computer vision models of salient object detection attempt to mimic the ability of the human visual system to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently made it possible to achieve high performance. However, it remains a challenge to develop deep neural network models of the same performance for devices with much more limited resources. In this work, we propose a new approach for a lightweight salient object detection neural network model, inspired by the cone and spatial opponent processes of the primary visual cortex (V1), that inextricably link color and shape in human color perception. Our proposed model, namely CoSOV1net, is trained from scratch, without using backbones from image classification or other tasks. Experiments, on the most widely used and challenging datasets for salient object detection, show that CoSOV1Net achieves competitive performance (i.e. Fβ=0.931 on the ECSSD dataset) with state-of-the-art salient object detection models, while having low number of parameters (1.14M), low FLOPS (1.4G) and high FPS (211.2) on GPU (nvidia Geforce RTX 3090 TI) compared to the state-of-the-art in the salient object detection or lightweight salient object detection task. Thus, CoSOV1net turns out to be a lightweight salient object detection that can be adapted to mobile environments and resource-constrained devices.

Gas bubbles present in liquids underpin many natural phenomena and human-developed technologies that improve the quality of life. Since all living organisms are predominantly made of water, they may also contain gas bubbles—introduced both naturally and artificially—that can serve as biomechanical sensors operating in hard-to-reach places inside a living body and emitting signals that can be detected by common equipment used in ultrasound and photoacoustic imaging procedures. This kind of biosensors is the focus of the present article, where we critically review the emergent sensing technologies based on acoustically driven oscillations of gas bubbles in liquids and bodily fluids. This review is intended for a broad biosensing community and transdisciplinary researchers translating novel ideas from theory to experiment and then to practice. To this end, all discussions in this review are written in a language that is accessible to non-experts in specific fields of acoustics, fluid dynamics and acousto-optics.

The rate of technical innovation, system interconnection, and advanced communications undoubtedly boost distributed energy networks' efficiency. However, when an additional attack surface is made available, the possibility of an increase in attacks is an unavoidable result. The energy ecosystem's significant variety draws attackers with various goals, making any critical infrastructure a threat, regardless of scale. Outdated technology and other antiquated countermeasures that worked years ago cannot address the complexity of current threats. As a result, robust artificial intelligence cyber-defense solutions are more important than ever. Based on the above challenge, this paper proposes an ensemble transfer learning spiking immune system for adaptive smart grid protection. It is an innovative Artificial Immune System (AIS) that uses a swarm of Evolving Izhikevich Neural Networks (EINN) in an Ensemble architecture, which optimally integrates Transfer Learning methodologies. The effectiveness of the proposed innovative system is demonstrated experimentally in multiple complex scenarios that optimally simulate the modern energy environment. In this way, the proposed system fully automates the strategic security planning of energy networks with computational intelligence methods. It allows the complete control of the digital strategies of the potential infrastructure that frames it, thus contributing to the timely and valid decision-making during cyber-attacks.

The widespread adoption of electromobility constitutes one of the measures designed to reduce air pollution caused by traditional fossil fuels. However, several factors are currently impending this process, ranging from insufficient charging infrastructure, battery capacity, long queueing and charging time, to psychological factors. On top of range anxiety, the frustration of the EV drivers is further fueled by the lack the uncertainty of finding an available charging point on their route. To address this issue, we propose a solution that comes to bypass the limitations of the Reserve now function of the OCPP standard, enabling drivers to make charging reservations for the upcoming days, especially when planning a longer trip. We created an algorithm that generates reservation intervals based on the charging station's reservation and transaction history. Subsequently, we ran a series of test cases that yielded promising results, with no overlapping reservations.

Machine learning (ML) has found increasing use in research on energy conversion and storage technologies, in particular, so-called sustainable technologies. While often ML is used to directly optimize the parameters or phenomena of interest in the space of features, in this perspective, we focus on using ML to construct objects and methods that help in or enable the modeling of the underlying phenomena. We highlight the need for machine learning from very sparse and unevenly distributed numeric data in multidimensional spaces in these applications. After a brief introduction of some common regression-type machine learning techniques, we will focus on more advanced ML techniques which use these known methods as building blocks of more complex schemes and thereby allow working with extremely sparse data and also allow generating insight. Specifically, we will highlight the utility of using representations with sub-dimensional functions by combining the high-dimensional model representation ansatz with machine learning methods like neural networks or Gaussian process regressions in applications ranging from heterogeneous catalysis to nuclear energy.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

Powder bed fusion (PBF) process is a metal additive manufacturing process which can build parts with any complexity from a wide range of metallic materials. PBF process research has predominantly focused on the impact of only a few parameters on product properties due to the lack of a systematic approach for optimizing a large set of process parameters simultaneously. The pivotal challenges regarding this process require a quantitative approach for mapping the material properties and process parameters onto the ultimate quality; this will then enable the optimization of those parameters. In this study, we propose a two-phase framework for optimizing the process parameters and developing a predictive model for 316L stainless steel material. We also discuss the correlation between process parameters -- i.e., laser specifications -- and mechanical properties and how to achieve parts with high density (> 98%) as well as better ultimate mechanical properties. In this paper, we introduce and test an innovative approach for developing AM predictive models, with a relatively low error percentage of 10.236% that are used to optimize process parameters in accordance with user or manufacturer requirements. These models use support vector regression, random forest regression, and neural network techniques. It is shown that the intelligent selection of process parameters using these models can achieve an optimized density of up to 99.31% with uniform microstructure, which improves hardness, impact strength, and other mechanical properties.

Deep learning classification is the state-of-the-art of machine learning approach. Earlier work proves that the deep convolutional neural network has successfully and brilliantly in different applications such as images or video data. Recognizing and clarifying the remote sensing aspect of the earth's surface and exploit land cover and land use (LCLU). First, this article summarized the remote sensing emerging application and challenges for deep learning methods. Second, we propose four approaches to learn efficient and effective CNNs to transfer image representation on the ImageNet dataset to recognize LCLU datasets. We use VGG16, Inception-ResNet-V2, Inception-V3, and DenseNet201 models to extract features from the EACC dataset. We use pre-trained CNNs on ImageNet to extract features. For feature selection we proposed principal component analysis (PCA) to improve accuracy and speed up the model. We train our model by multi-layer perceptron (MLP) as a classifier. Lastly, we apply the multi-granularity encoding ensemble model. We achieve an overall accuracy of 92.3% for the nine-class classification problem. This work will help remote sensing scientists understand deep learning tools and apply them in large-scale remote sensing challenges

Attackers are perpetually modifying their tactics to avoid detection and frequently leverage legitimate credentials with trusted tools already deployed in a network environment, making it difficult for organizations to proactively identify critical security risks. Network traffic analysis products have emerged in response to attackers’ relentless innovation, offering organizations a realistic path forward for combatting creative attackers. Additionally, thanks to the widespread adoption of cloud computing, Device Operators (DevOps) processes, and the Internet of Things (IoT), maintaining effective network visibility has become a highly complex and overwhelming process. What makes network traffic analysis technology particularly meaningful is its ability to combine its core capabilities to deliver malicious intent detection. In this paper, we propose a novel darknet traffic analysis and network management framework to real-time automating the malicious intent detection process, using a weight agnostic neural networks architecture. It is an effective and accurate computational intelligent forensics tool for network traffic analysis, the demystification of malware traffic, and encrypted traffic identification in real-time. Based on Weight Agnostic Neural Networks (WANNs) methodology, we propose an automated searching neural net architectures strategy that can perform various tasks such as identify zero-day attacks. By automating the malicious intent detection process from the darknet, the advanced proposed solution is reducing the skills and effort barrier that prevents many organizations from effectively protecting their most critical assets.

One of the key components of application performance monitoring (APM) software is 2 AI/ML empowered data analytics for predictions, anomaly detection, event correlations and root 3 cause analysis. Time series metrics, logs and traces are three pillars of observability and the valuable 4 source of information for IT operations. Accurate, scalable and robust time series forecasting and 5 anomaly detection are desirable capabilities of the analytics. Approaches based on neural networks 6 (NN) and deep learning gain increasing popularity due to their flexibility and ability to tackle complex 7 non-linear problems. However, some of the disadvantages of NN-based models for distributed cloud 8 applications mitigate expectations and require specific approaches. We demonstrate how NN-models 9 pretrained on a global time series database can be applied to customer specific data using transfer 10 learning. In general, NN-models adequately operate only on stationary time series. Application 11 to non-stationary time series requires multilayer data processing including hypothesis testing for 12 data categorization, category specific transformations into stationary data, forecasting and backward 13 transformations. We present the mathematical background of this approach and discuss experimental 14 results from the productized implementation in Wavefront by VMware (an APM software) while 15 monitoring real customer cloud environments.

In cricket, particularly the twenty20 format is most watched and loved by the people, where no one can guess who will win the match until the last ball of the last over. In India, The Indian Premier League (IPL) started in 2008 and now it is the most popular T20 league in the world. So we decided to develop a machine learning model for predicting the outcome of its matches. Winning in a Cricket Match depends on many key factors like a home ground advantage, past performances on that ground, records at the same venue, the overall experience of the players, record with a particular opposition, and the overall current form of the team and also the individual player. This paper briefs about the key factors that affect the result of the cricket match and the regression model that best fits this data and gives the best predictions. Cricket, the mainstream and widely played sport across India which has the most noteworthy fan base. Indian Premier League follows 20-20 format which is very unpredictable. IPL match predictor is a ML based prediction approach where the data sets and previous stats are trained in all dimensions covering all important factors such as: Toss, Home Ground, Captains, Favorite Players, Opposition Battle, Previous Stats etc, with each factor having different strength with the help of KNIME Tool and with the added intelligence of Naive Bayes network and Eulers strength calculation formula.

This paper presents the methodology to detect and identify the type of fault that occurs in shunt connected static synchronous compensator (STATCOM) transmission line using a combination of Discrete Wavelet Transform (DWT) and Naive Bayes classifier. To study this, the network model is designed using Mat-lab/Simulink. The different faults such as Line to Ground (LG), Line to Line (LL), Double Line to Ground (LLG) and three-phase (LLLG) fault are applied at different zones of system with and without STATCOM considering the effect of varying fault resistance. The three-phase fault current waveforms obtained are decomposed into several levels using daubechies mother wavelet of db4 to extract the features such as standard deviation and Energy values. The extracted features are used to train the classifiers such as Multi-Layer Perceptron Neural Network (MLP), Bayes and Naive Bayes (NB) classifier to classify the type of fault that occurs in the system. The results reveal that the proposed NB classifier outperforms in terms of accuracy rate, misclassification rate, kappa statistics, mean absolute error (MAE), root mean square error (RMSE), relative absolute error (RAE) and root-relative square error (RRSE) than MLP and Bayes classifier.

Eight amniote genera (representing four clades) became aquatic during the Permian. The four clades were mesosaurids, tangasaurids, the neodiapsid Claudiosaurus, and the procolophonid Barasaurus. Two of eight genera survived the end-Permian mass extinction, but did not last long into the Mesozoic. A previously undescribed specimen of Claudiosaurus germaini, preserved in a lacustrine concretion from the Sakamena Formation, Madagascar, bears seventeen vertebrae that has been split along an approximate horizontal plane to reveal sections of neural canal casted in white calcite. Enlargement of the neural canal in the sacral region of this specimen of Claudiosaurus (vertebral segments 22-26) is more similar to that of Tupinambis (segments 24-28) than it is to Testudo (segments 16-23). Claudiosaurus skeletal anatomy provides evidence for swim propulsion by both hind limbs and by undulation of a dorsal-ventrally flattened tail. Evidence for the latter includes elongate transverse processes on distal tail vertebrae. Other Permian aquatic reptile genera (Mesosaurus, Hovasaurus, Barasaurus) used snake-like side-to-side tail undulation, whereas Claudiosaurus used cetacean-like up-down tail undulation in the vertical plane. It seems unlikely that any of these animals were particularly fast swimmers.

Several studies have analyzed human gait data obtained from inertial gyroscope and accelerometer sensors mounted on different parts of the body. In this article, we take a step further in gait analysis and provide a methodology for predicting the movements of the missing parts of the legs. In particular, we propose a method, called GaIn, to control non-invasive, robotic, prosthetic legs. GaIn can infer the movements of both missing shanks and feet for humans suffering from double trans-femoral amputation using biologically inspired recurrent neural networks. Predictions are performed for casual walking related activities such as walking, taking stairs, and running based on thigh movement. In our experimental tests, GaIn achieved a 4.55 degree prediction error for shank movements on average. However, a patient's intention to stand up and sit down cannot be inferred from thigh movements. In fact, intention causes thigh movements while the shanks and feet remain roughly still. The GaIn system can be triggered by thigh muscle activities measured with electromyography (EMG) sensors to make robotic prosthetic legs perform standing up and sitting down actions. The GaIn system has low prediction latency and is fast and computationally inexpensive to be deployed on mobile platforms and portable devices.

The ongoing revolution in Deep Learning is redefining the nature of computing that is driven by the increasing amount of pattern classification and cognitive tasks. Specialized digital hardware for deep learning still holds its predominance due to the flexibility offered by the software implementation and maturity of algorithms. However, it is being increasingly desired that cognitive computing occurs at the edge, i.e. on hand-held devices that are energy constrained, which is energy prohibitive when employing digital von Neumann architectures. Recent explorations in digital neuromorphic hardware have shown promise, but offer low neurosynaptic density needed for scaling to applications such as intelligent cognitive assistants (ICA). Large-scale integration of nanoscale emerging memory devices with Complementary Metal Oxide Semiconductor (CMOS) mixed-signal integrated circuits can herald a new generation of Neuromorphic computers that will transcend the von Neumann bottleneck for cognitive computing tasks. Such hybrid Neuromorphic System-on-a-chip (NeuSoC) architectures promise machine learning capability at chip-scale form factor, and several orders of magnitude improvement in energy efficiency. Practical demonstration of such architectures has been limited as performance of emerging memory devices falls short of the expected behavior from the idealized memristor-based analog synapses, or weights, and novel machine learning algorithms are needed to take advantage of the device behavior. In this work, we review the challenges involved and present a pathway to realize ultra-low-power mixed-signal NeuSoC, from device arrays and circuits to spike-based deep learning algorithms, with ‘brain-like’ energy-efficiency.

The first part of the paper was aimed at analyzing the given nonlinear problem by different methods of computation of the Lyapunov exponents (Wolf method [1], Rosenstein method [2], Kantz method [3], method based on the modification of a neural network [4, 5], and the synchronization method [6, 7]) for the classical problems governed by difference and differential equations (Hénon map [8], hyper-chaotic Hénon map [9], logistic map [10], Rössler attractor [11], Lorenz attractor [12]) and with the use of both Fourier spectra and Gauss wavelets [13]. It was shown that a modification of the neural network method [4, 5] makes it possible to compute a spectrum of Lyapunov exponents, and then to detect a transition of the system regular dynamics into chaos, hyper-chaos, hyper hyper-chaos and deep chaos [14-16]. Different algorithms for computation of Lyapunov exponents were validated by comparison with the known dynamical systems spectra of the Lyapunov exponents. The carried out analysis helps comparatively estimate the employed methods in order to choose the most suitable/optimal one to study different kinds of dynamical systems and different classes of problems in both this and the next paper parts.

AI-driven applications are rapidly growing, and more applications are joining the market competition. As a result, the AI-as-a-Service (AIaaS) model is experiencing rapid growth. Many of these AIaas-based applications are not properly optimized initially. Once they start experiencing a large volume of traffic, different challenges start revealing themselves. One of these challenges is maintaining a profit margin for the sustainability of the AIaaS application-based business model, which depends on the proper utilization of computing resources. This paper introduces the Resource Award Predictive (RAP) model for AIaaS cost optimization called RAP-Optimizer. It is developed by combining a Deep Neural Network (DNN) with the simulated annealing optimization algorithm. It is designed to reduce resource underutilization and minimize the number of active hosts in cloud environments. It dynamically allocates resources and handles API requests efficiently. The RAP-Optimizer reduces the number of active physical hosts by an average of 5 per day, leading to a 45% decrease in server costs. The impact of the RAP-Optimizer has been observed over a 12-month period. The observational data show a significant improvement in resource utilization. It effectively reduces operational costs from $2,600 to $1,250 per month. Furthermore, the RAP-Optimizer increases the profit margin by 179%, from $600 to $1,675 per month. The inclusion of the Dynamic Dropout Control (DDC) algorithm in the DNN training process mitigates overfitting, achieving a 97.48% validation accuracy and a validation loss of 2.82%. These results indicate that the RAP-Optimizer effectively enhances resource management and cost-efficiency in AIaaS application, making it a valuable solution for modern cloud environments.

Short-circuit blowing is an important technical means to ensure the rapid surfacing of submersible. In order to study the impact of seven multiple manipulation factors of three levels on blowing, a proportional short-circuit blowing model test bench had been built and L18(37) orthogonal experiments were carried out; then, using Back propagation neural network and Pearson correlation analysis, the experimental data were trained and predicted, correlation between individual factor and blowing was further studied as supplement of orthogonal experiments. It had been proved that both multi-factor combination and individual including blowing duration, sea tank back pressure, the gas blowing pressure of the cylinder group, and sea valve flowing area had larger influence, whose correlation coefficients were 0.6535, 0.8105, 0.5569, 0.5373, of which the F-ratio of blowing duration is over critical value 3.24. And statistical evaluation indicators of Back propagation neural network were between 10e-2 and 10e-13, relative error was less than 3%, and prediction error accuracy was 100%. Based on the results above, a reasonable prediction method for submersible short-circuit blowing had been formed and suggestions on engineering design and operations were proposed, including advantage of short-circuit blowing method, initial condition settings and manipulation strategy.

Recommender Systems (RecSys) are crucial in managing information overload and enhancing user satisfaction across various digital platforms, including e-commerce and entertainment. Evolving from traditional models to Deep Neural Networks (DNNs) and, more recently, Large Language Models (LLMs), these systems leverage sophisticated algorithms to analyze user behaviors and preferences. LLMs, such as GPT-4, are trained on extensive datasets to comprehend and generate natural language, significantly advancing their ability to deliver personalized recommendations. This tutorial explores the transformative impact of LLMs on RecSys, discussing their development, application in handling complex datasets, and the integration of contextual insights. Real-world examples illustrate how LLMs enhance recommendation accuracy and user experience, highlighting challenges and future directions in the field.

This paper focuses on enhancing the object detection and decision-making capabilities of Autonomous Emergency Medical Response Systems (AEMRS). Using advanced sensors, Convolutional Neural Networks (CNN), and reinforcement learning, we propose a model that processes environmental data to identify obstacles and make optimal navigation decisions. The integration of these technologies aims to minimize response time and improve the efficiency of emergency medical services. The perception system utilizes radar, LiDAR, and camera inputs to create a comprehensive understanding of the environment. These data are processed through a series of CNN layers to detect and classify objects such as vehicles, pedestrians, and road signs. On the decision-making front, a Q-learning algorithm is employed to enable the ambulance to learn from its interactions with the environment, continuously improving its route planning and collision avoidance strategies. By combining these advanced AI techniques, the proposed AEMRS can significantly enhance the speed and reliability of emergency responses, ultimately saving more lives. This paper presents the design, implementation, and simulation results of the proposed system, demonstrating its potential to revolutionize emergency medical services.

: Schizophrenia and schizoaffective disorder are generally treated with second-generation antipsychotic drugs. These drugs are mostly D2 and 5-HT2A antagonists. They improve positive schizophrenia symptoms sufficiently well; however, they ameliorate negative schizophrenia symptoms and cognitive functions to a small extent. We review novel antipsychotic drugs exerting a partial agonism at dopaminergic and serotonergic receptors such as cariprazine, brexipiprazole and lumateperone. Besides, the mechanisms of actions of non-anti-dopaminergic antipsychotic drugs are pointed out. Updated neural networks are used to explain the mechanism of action of M4 and M1 receptor agonists, for example xanomeline combined with trospium or emraclidine, and trace-amine-associated receptor 1 agonists (TAAR1), for example ulataront. Phase 3 clinical trials of new third generation antipsychotic drugs are presented. Novel antipsychotic drugs with a partial agonism at D2 and D3 receptors improve positive and negative schizophrenia symptoms as well as cognitive symptoms better than second generation antipsychotic drugs. Besides, they are well tolerated. M4 and M1 receptor agonists, i.e. xanomeline combined with trospium or emraclidine, and TAAR1 agonists, i.e. ulataront, have promising results in clinical trials; they well improve negative schizophrenia symptoms and cognitive functions. Phase 3 clinical trials offer promising results for anti-dopaminergic and non-anti-dopaminergic novel antipsychotic drugs. These new non-anti-dopaminergic antipsychotic drugs better emend negative schizophrenia symptoms, and they better improve cognitive functions than second-generation antipsychotic drugs. Promising new antipsychotic drugs are cariprazine, brexipiprazole, lumateperone, ulataront, and xanomeline combined with trospium. Although phase 3 clinical studies are not yet completed, they showed a therapeutic effect superior to those achieved by second-generation antipsychotic drugs. They are tolerated very well, and they better treat negative schizophrenia symptoms and improve cognitive functions.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. In contemporary times, the transition from conventional electricity grids to Smart Grids constitutes an area where extensive research is conducted on a global scale. Among the research challenges, the investigation of Deep Transfer Learning (DTL) in the field of electricity load forecasting represents a fundamental effort that imparts generality to Artificial Intelligence applications, due to new capabilities, such as knowledge transfer and computational power reduction. In this paper a comprehensive study is conducted for day-ahead electricity load forecasting. For this purpose, three Sequence-to-Sequence (Seq2seq) Deep Learning (DL) models are used, namely the Multilayer Perceptron (MLP), the Convolutional Neural Network (CNN) and the Ensemble Learning Model (ELM), which is consisted of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL and emphasizing the way the datasets are trained and fine-tuning for higher forecasting accuracy. In order to implement the forecasting strategies using Deep Learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1-24 hours) for each month of the year for Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. After several trials, four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) contains the training of the DL models using Lesvos dataset, and the testing period performed directly on the Chios dataset without fine-tuning. The fourth strategy is a Multi-task Deep Learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. In this paper, we explore the performance of DTL and compare the results with those produced with MTDL. The results demonstrated that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, the two cases with fine-tuning (DTL Case 1 and 2) outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it has been concluded that the MLP model presents best monthly forecasts with a MAPE of 6.24% and 6.01% for the first two cases, the CNN model presents best monthly forecasts with a MAPE of 5.57% and 5.60% respectively and the ELM model achieves best monthly forecasts with a MAPE of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

This paper presents a comprehensive investigation into the applicability and performance of two prominent growth models, namely the Verhulst model and the Montroll model, in the context of modeling tumor cell growth dynamics. Leveraging the power of Physics-Informed Neural Networks (PINNs), we aim to assess and compare the predictive capabilities of these models against experimental data obtained from the growth patterns of tumor cells. We employ a dataset comprising detailed measurements of tumor cell growth to train and evaluate the Verhulst and Montroll models. By integrating PINNs, we not only account for experimental noise but also embed physical insights into the learning process, enabling the models to capture the underlying mechanisms governing tumor cell growth. Our findings reveal the strengths and limitations of each growth model in accurately representing tumor cell proliferation dynamics. Furthermore, the study sheds light on the impact of incorporating physics-informed constraints on the model predictions. The insights gained from this comparative analysis contribute to advancing our understanding of growth models and their applications in predicting complex biological phenomena, particularly in the realm of tumor cell proliferation.

The ever-evolving ways attacker continues to im prove their phishing techniques to bypass existing state-of-the-art phishing detection methods pose a mountain of challenges to researchers in both industry and academia research due to the inability of current approaches to detect complex phishing attack. Thus, current anti-phishing methods remain vulnerable to complex phishing because of the increasingly sophistication tactics adopted by attacker coupled with the rate at which new tactics are being developed to evade detection. In this research, we proposed an adaptable framework that combines Deep learning and Randon Forest to read images, synthesize speech from deep-fake videos, and natural language processing at various predictions layered to significantly increase the performance of machine learning models for phishing attack detection.

In recent times, using image-based deep learning techniques has been very useful for classifying fruits. However, mango is a particular challenge because its shelf life is directly related to the degree of maturity at the time of harvest, which is determined mainly through the visual assessment of the operators when sorting them, doing it incorrectly, coupled with the blows and compressions exposed during storage and transport, trigger the deterioration in their quality, hence the importance of this operation. In this sense, the purpose of this study focuses on designing a computational model based on Deep Learning that uses a convolutional neural network (CNN) parameterized to select mangoes according to their color tone based on their maturity stage. A dataset was established from 201 labeled images, then a CNN architecture was built, obtaining a model on which 3 criteria were evaluated: the number of convolution and grouping layers, the resolution of the input images and the number of training epochs required. As a result, an input image resolution of 32 x 32 pixels was achieved, the process included a convolution layer followed by pooling that fed another layer that processed the results and ended in an output layer with 2 neurons under the One Hot Encoding representation. The model required 20 epochs to perfect its training, achieving 96.04 % accuracy in mango image selection. This study supports the potential of CNNs in quality analysis through mango color selection, even in uncertainty scenarios.

As the world increasingly becomes more interconnected, the demand for safety and security is ever-increasing, particularly for industrial networks. This has prompted numerous researchers to investigate different methodologies and techniques suitable for intrusion detection systems (IDS) requirements. Over the years, many studies have proposed various solutions in this regard including signature-based and machine-learning (ML) based systems. More recently, researchers are considering deep learning (DL) based anomaly detection approaches. Most proposed works in this research field aimed to achieve either one or a combination of high accuracy, considerably low false alarm rates (FARs), high classification specificity and detection sensitivity, achieving lightweight DL models, or other ML and DL-related performance measurement metrics. In this study, we propose a novel method to convert a raw dataset to an image dataset to magnify patterns. Based on this we devise an anomaly detection for IDS using a lightweight convolutional neural network (CNN) that classifies denial of service and distributed denial of service. The proposed methods were evaluated using a modern dataset, CSE-CIC-IDS2018, and a legacy dataset, NSL-KDD. We have also applied a combined dataset to assess the generalization of the proposed model across various datasets. Our experimental results have demonstrated that the proposed methods achieved high accuracy and considerably low FARs with high specificity and sensitivity. The resulting loss and accuracy curves have also demonstrated the excellent generalization of the proposed lightweight CNN model, effectively avoiding overfitting. This holds for both the modern and legacy datasets, including their mixed version.

Amidst the burgeoning global concerns surrounding skin cancer, the quest for precise and efficient diagnostic methodologies has intensified. Conventional diagnostic approaches relying on subjective visual inspection by dermatologists often grapple with subjectivity and resource constraints. This predicament underscores the critical role of Artificial Intelligence (AI) in revolutionizing diagnostic paradigms by significantly enhancing accuracy and accessibility. This study embarks on an extensive exploration of skin cancer classification, specifically targeting the intricate task of 8-class skin cancer classification. Employing cutting-edge deep learning models on the ISIC2019 dataset, a comprehensive analysis was conducted utilizing a diverse array of pre-trained ImageNet architectures and Vision Transformer models. To counteract the inherent class imbalance in skin cancer datasets, a pioneering "Naturalize" augmentation technique was introduced, leading to the creation of indispensable tools—the Naturalized 2.4K ISIC2019 and groundbreaking Naturalized 7.2K ISIC2019 datasets—catalyzing advancements in classification accuracy. The pivotal role of AI in mitigating the risks of misdiagnosis and under-diagnosis in skin cancer becomes evident through this research. AI’s proficiency in analyzing vast datasets and discerning subtle patterns augments the diagnostic prowess of dermatologists significantly. Integration of AI-powered systems in skin cancer diagnosis holds immense promise in facilitating early detection and substantially improving patient outcomes. The meticulous evaluation employed quantitative measures such as confusion matrices, classification reports, and visual analyses using Score-CAM across diverse dataset variations. Astonishingly, the culmination of these endeavors culminated in an unprecedented achievement—100% average accuracy, precision, recall, and F1-Score—within the groundbreaking Naturalized 7.2K ISIC2019 dataset. This remarkable feat underscores the transformative potential of AI-driven methodologies, exemplifying their prowess in redefining the landscape of skin cancer diagnosis and management. In summary, this research represents a pivotal stride towards redefining dermatological diagnosis, showcasing the remarkable impact of AI-powered solutions in surmounting the challenges inherent in skin cancer diagnosis. The attainment of 100% across crucial metrics within the Naturalized 7.2K ISIC2019 dataset serves as a testament to the transformative capabilities of AI-driven approaches in reshaping the trajectory of skin cancer diagnosis and patient care.

Combustion parameters are the important aspects in the development and research of an internal combustion engines. Hence present work is an attempt to develop an artificial neural network (ANN) model for anticipating the combustion characteristics of computerized CI DI VCR, four strokes, single cylinder, and water cooled engine using mixture of two biodiesel and diesel blends as a fuel. The two biodiesel selected are Jatropha and Simarouba and mixed in the ratio of 75:25. Two biodiesel mixtures is used for the preparation of various blends with diesel. Experiments are carried out at different compression ratio, at different % load and blends B20, B40, B60and neat diesel (B00) fuel to accumulate the assorted combustion data. The input variables are % load, compression ratio, blends and crank angle. The outputs well thought-out are cylinder pressure (CP), net heat release rate (NHRR), cumulative heat release (CHR), rate of pressure rise (RPR), mass fraction burned (MFB) and maximum cylinder pressure. The assessment is focused on developing artificial neural network for the prediction and verifying the combustion characteristics of engine. MATLAB software is used for analysis of different combustion aspects of the engine. Multilayer neural network perceptions are used with Feed-Forward Back Propagation algorithm with performance function for mapping the input and output parameters. The experimental outcomes are compared with ANN estimated results for the analysis. The outcome from the study authenticate that experimental results are in match with ANN results. The accuracy of the ANN model shows the developed model can effectively predict the engine combustion characteristics with excellent regression coefficients ‘R’ and its values are close to unity and the mean square errors are extremely less. ANN model approach is competent towards predicting the combustion aspect of diesel engine with good accuracy

This study investigates the factors influencing the choice of online and offline shopping trips and their impacts on urban transportation, environment, and economy in Tehran, Iran. A questionnaire survey was conducted to collect data from 1,000 active e-commerce users who made successful orders in both online and offline services in the last 20 days of 2021 in areas 2 and 5 of Tehran. A deep neural network model was developed to estimate the type of shopping trip based on 10 indicators, such as age, gender, car ownership, delivery cost, product price, etc. The performance of the model was compared with three other algorithms: MLP, decision tree, and KNN. The results showed that the deep neural network model had the highest accuracy of 95.63%. The most important factors affecting the choice of shopping trips were delivery cost, delivery time, and product price. This study provides insights for transportation planners, e-commerce managers, and policymakers to design effective strategies for reducing transportation costs, pollutant emissions, urban traffic, and increasing user satisfaction and sustainable development.

This paper proposes two max-pooling engines, named the RTB-MAXP engine and the CMB-MAXP engine, with a scalable window size parameter for FPGA-based convolutional neural network (CNN) implementation. The max-pooling operation for the CNN can be decomposed into two stages, i.e., a horizontal axis max-pooling operation and a vertical axis max-pooling operation. These two one-dimensional max-pooling operations are performed by tracking the rank of the values within the window in the RTB-MAXP engine and cascading the maximum operations of the values in CMB-MAXP engine. Both the RBM-MAXP engine and the CMB-MAXP engine were implemented using VHSIC Hardware Description Language (VHDL) and verified by simulations. They have been employed for and tested in our CNN accelerator targeting at the CNN model YOLOv4-CSP-S-Leaky for object detection.

This paper presents a robust and efficient fault detection and diagnosis framework for handling small faults and oscillations in synchronous generator (SG) systems. The proposed framework utilizes the Brunovsky form representation of nonlinear systems to mathematically formulate the fault detection problem. A differential-flatness model of SG systems is provided to meet the conditions of the Brunovsky form representation. A combination of high-gain observer and group method of data handling neural network is employed to estimate the trajectory of the system and to learn/ approximate the fault and uncertainties associated functions. The fault detection mechanism is developed based on output residual generation and monitoring so that any unfavourable oscillation and/or fault occurrence can be detected rapidly. Accordingly, an average L1-norm criterion is proposed for rapid decision making of faulty situations. The performance of the proposed framework is investigated for two benchmark scenarios which are actuation fault and fault impact on system dynamics. The simulation results demonstrate the capacity and effectiveness of the proposed solution for rapid fault detection and diagnosis in SG systems in practice, and thus enhancing service maintenance, protection, and life cycle of SGs.

We discuss what we believe could be an improvement in future discussions of the ever-changing brain. We do so by distinguishing different types of brain variability and outlining methods suitable to analyse them. We argue that, when studying brain and behaviour data, classical methods such as regression analysis and more advanced approaches both aim to decompose the total variance into sensible variance components. In parallel, we argue that a distinction needs to be made between innate and acquired brain variability. For varying high-dimensional brain data, we present methods useful to extract their low-dimensional representations. Finally, to trace potential causes and predict plausible consequences of brain variability, we discuss how to combine statistical principles and neurobiological insights to make associative, explanatory, predictive, and causal enquires; but cautions are needed to raise association- or prediction-based neurobiological findings to causal claims.

Recent progress in deep learning has led to accurate and efficient generic object detection networks. Training of highly reliable models depends on large datasets with highly textured and rich images. However, in real-world scenarios, the performance of the generic object detection system decreases when (i) occlusions hide the objects, (ii) objects are present in low-light images, or (iii) they are merged with background information. In this paper, we refer to all these situations as challenging environments. With the recent rapid development in generic object detection algorithms, notable progress has been observed in the field of object detection in challenging environments. However, there is no consolidated reference to cover state-of-the-art in this domain. To the best of our knowledge, this paper presents the first comprehensive overview, covering recent approaches that have tackled the problem of object detection in challenging environments. Furthermore, we present the quantitative and qualitative performance analysis of these approaches and discuss the currently available challenging datasets. Moreover, this paper investigates the performance of current state-of-the-art generic object detection algorithms by benchmarking results on the three well-known challenging datasets. Finally, we highlight several current shortcomings and outline future directions.

One of the most rapidly advancing areas of deep learning research aims at creating models that learn to disentangle the latent factors of variation from a data distribution. However, modeling joint probability mass functions is usually prohibitive, which motivates the use of conditional models assuming that some information is given as input. In the domain of numerical cognition, deep learning architectures have successfully demonstrated that approximate numerosity representations can emerge in multi-layer networks that build latent representations of a set of images with a varying number of items. However, existing models have focused on tasks requiring to conditionally estimate numerosity information from a given image. Here we focus on a set of much more challenging tasks, which require to conditionally generate synthetic images containing a given number of items. We show that attention-based architectures operating at the pixel level can learn to produce well-formed images approximately containing a specific number of items, even when the target numerosity was not present in the training distribution.

This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person’s state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the Message Queue Telemetry Transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) System developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person’s face in the image captured by the UAV’s on-board camera and classify the emotion among seven possible ones (surprise, fear, happiness, sadness, disgust, anger or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.

COVID-19 is a severe global problem, and AI can play a significant role in preventing losses by monitoring and detecting infected persons in early-stage. This paper aims to propose a high-speed and accurate fully-automated method to detect COVID-19 from the patient's CT scan images. We introduce a new dataset that contains 48260 CT scan images from 282 normal persons and 15589 images from 95 patients with COVID-19 infections. At the first stage, this system runs our proposed image processing algorithm to discard those CT images that inside the lung is not properly visible in them. This action helps to reduce the processing time and false detections. At the next stage, we introduce a novel method for increasing the classification accuracy of convolutional networks. We implemented our method using the ResNet50V2 network and a modified feature pyramid network alongside our designed architecture for classifying the selected CT images into COVID-19 or normal with higher accuracy than other models. After running these two phases, the system determines the condition of the patient using a selected threshold. We are the first to evaluate our system in two different ways. In the single image classification stage, our model achieved 98.49% accuracy on more than 7996 test images. At the patient identification phase, the system correctly identified almost 234 of 245 patients with high speed. We also investigate the classified images with the Grad-CAM algorithm to indicate the area of infections in images and evaluate our model classification correctness.

Spherical harmonic (SH) interpolation is a commonly used method to spatially up-sample sparse Head Related Transfer Function (HRTF) datasets to denser HRTF datasets. However, depending on the number of sparse HRTF measurements and SH order, this process can introduce distortions in high frequency representation of the HRTFs. This paper investigates whether it is possible to restore some of the distorted high frequency HRTF components using machine learning algorithms. A combination of Convolutional Auto-Encoder (CAE) and Denoising Auto-Encoder (DAE) models is proposed to restore the high frequency distortion in SH interpolated HRTFs. Results are evaluated using both Perceptual Spectral Difference (PSD) and localisation prediction models, both of which demonstrate significant improvement after the restoration process.

The remaining capacity can only be measured with offline method. This brings great challenge for the online prediction of Li-ion battery’s RUL. A novel online prediction method for Li-ion battery’s RUL was proposed, which is based on multiple health indicators (HIs) and can be derived from the batteries’ historical operation data. Firstly, four indirect HIs were built according to the battery’s operation current, voltage and temperature data respectively. On that basis, a generalized regression neural network (GRNN) was developed to estimate the battery’s remaining capacity, and the non-linear autoregressive approach (NAR) was utilized to predict the battery’s RUL based on the estimated capacity value. Furthermore, to reduce the interference, twice wavelet denoising were performed with different thresholds. A case study is conducted with a NASA battery dataset to demonstrate the effectiveness of the method. The result shows that the proposed method can obtain Li-ion batteries’ RUL effectively.

This article introduces a new way of using a Fibre Bragg Grating (FBG) sensor for detecting the presence and number of occupants in the monitored space in a Smart Home (SH). CO₂ sensors are used to determine the CO₂ concentration of the monitored rooms in an SH. CO₂ sensors can also be used for occupancy recognition of the monitored spaces in SH. To determine the presence of occupants in the monitored rooms of the SH, the newly devised method of CO₂ prediction, by means of an Artificial Neural Network (ANN) with a Scaled Conjugate Gradient (SCG) algorithm using measurements of typical operational technical quantities (indoor temperature, relative humidity indoor and CO₂ concentration in the SH) is used. The goal of the experiments is to verify the possibility of using the FBG sensor in order to unambiguously detect the number of occupants in the selected room (R104) and, at the same time, to harness the newly proposed method of CO₂ prediction with ANN SCG for recognition of the SH occupancy status and the SH spatial location (rooms R104, R203, and R204) of an occupant. The designed experiments will verify the possibility of using a minimum number of sensors for measuring the non-electric quantities of indoor temperature and indoor relative humidity and the possibility of monitoring the presence of occupants in the SH using CO₂ prediction by means of the ANN SCG method with ANN learning for the data obtained from only one room (R203). The prediction accuracy exceeded 90% in certain experiments. The uniqueness and innovativeness of the described solution lie in the integrated multidisciplinary application of technological procedures (the BACnet technology control SH, FBG sensors) and mathematical methods (ANN prediction with SCG algorithm, the Adaptive Filtration with of LMS algorithm) employed for the recognition of number persons and occupancy recognition of selected monitored rooms of SH.

Cooperative non-orthogonal multi access communication is a promising paradigm for the future wireless networks because of its advantages in terms of energy efficiency, wider coverage and interference mitigating. In this paper, we study the secrecy performance of a downlink cooperative non-orthogonal multi access (NOMA) communication system under the presence of an eavesdropper node. Smart node selection based on feed forward neural networks (FFNN) is proposed in order to improve the physical layer security (PLS) of a cooperative NOMA network. The selected cooperative relay node is employed to enhance the channel capacity of the legal users, where the selected cooperative jammer is employed to degrade the capacity of the wiretapped channel. Simulations of the secrecy performance metric namely the secrecy capacity ($C_S$) are presented and compared with the conventional technique based on fuzzy logic node selection technique. Based on our simulations and discussions the proposed technique outperforms the existing technique in term the of secrecy performance.

In recent years, Parkinson's Disease (PD) as a progressive syndrome of the nervous system has become highly prevalent worldwide. In this study, a novel hybrid technique established by integrating a Multi-layer Perceptron Neural Network (MLP) with the Biogeography-based Optimization (BBO) to classify PD based on a series of biomedical voice measurements. BBO is employed to determine the optimal MLP parameters and boost prediction accuracy. The inputs comprised of 22 biomedical voice measurements. The proposed approach detects two PD statuses: 0– disease status and 1– reasonable control status. The performance of proposed methods compared with PSO, GA, ACO and ES method. The outcomes affirm that the MLP-BBO model exhibits higher precision and suitability for PD detection. The proposed diagnosis system as a type of speech algorithm detects early Parkinson’s symptoms, and consequently, it served as a promising new robust tool with excellent PD diagnosis performance.

Objective: This study aimed to explore longitudinal relationships between neurophysiological biomarkers and upper limb motor function recovery in stroke patients, focusing on electroencephalography (EEG) and transcranial magnetic stimulation (TMS) metrics. Methods: This longitudinal cohort study analyzed neurophysiological, clinical, and demographic data from 102 stroke patients enrolled in the DEFINE cohort. We investigated the associations between baseline and post-intervention changes in EEG Theta/Alpha Ratio (TAR) and TMS metrics with upper limb motor functionality, assessed by five outcomes: Fugl-Meyer Assessment (FMA), Handgrip Strength Test (HST), Pinch Strength Test (PST), Finger Tapping Test (FTT), and Nine-Hole Peg Test (9HPT). Results: Our multivariate models identified that a higher baseline TAR in the lesioned hemisphere was consistently associated with poorer motor outcomes across all five assessments. Conversely, a higher improvement in TAR was positively associated with improvements in FMA and 9HPT. Additionally, increased TMS Motor Evoked Potential (MEP) amplitude in the non-lesioned hemisphere correlated with greater FMA-diff, while lower TMS Intracortical Inhibition (ICI) in the non-lesioned hemisphere was linked to better PST improvements. These findings suggest the potential of TAR and TMS metrics as biomarkers for predicting motor recovery in stroke patients. Conclusion: Our findings highlight the significance of TAR in the lesioned hemisphere as a predictor of motor function recovery post-stroke and also a potential signature for compensatory oscillations. The observed relationships between TAR and motor improvements, as well as the associations with TMS metrics, underscore the potential of these neurophysiological measures in guiding personalized rehabilitation strategies for stroke patients.

Abstract: The future of transportation is being reshaped by autonomous vehicles (AVs), which promise to revolutionize road safety, accessibility, and environmental sustainability. Central to their evolution are advancements in artificial intelligence (AI), which enable real-time perception, decision-making, and control. This paper explores the future trajectory of AI in AVs, highlighting innovative AI paradigms such as explainable AI, federated learning, and adaptive regulatory frameworks. It delves into the development of sophisticated perception algorithms for environmental understanding, advanced decision-making systems employing reinforcement learning and deep neural networks, and precise control mechanisms through predictive modeling and optimization. By addressing current challenges, including regulatory hurdles and the complexity of AI algorithms, this paper provides a comprehensive outlook on the potential and implications of AV technology. It envisions a future where AI-driven AVs are seamlessly integrated into society, offering profound insights into their impact on transportation and societal dynamics.

This paper describes a Long Short-Term Memory (LSTM) neural network model used to simulate the dynamics of the OC3 reference design of a Floating Offshore Wind Turbine Spar unit. It crafts an advanced neural network with an encoder-decoder architecture capable of predicting the Spar’s motion and fairlead tensions time series. These predictions are based on wind and wave excitations across various operational and extreme conditions. The LSTM network, trained on an extensive dataset from over 300 fully coupled simulation scenarios using OpenFAST, ensures a robust framework that captures the complex dynamics of floating platform under diverse environmental scenarios. This framework’s effectiveness is further verified by thoroughly evaluating the model’s performance, leveraging comparative statistics and accuracy assessments to highlight its reliability. This methodology contributes to substantial reductions in computational time. This research aims to provide critical insights that facilitate the optimization of offshore wind turbines, marking a step forward in the quest for more efficient and dependable renewable energy solutions.

Photovoltaic (PV) systems, which are renewable energy sources, are increasingly being utilized in distributed generation. To maintain a stable energy balance, energy storage systems such as batteries (BAT) play a vital role. Electric vehicles (EVs) offer a promising solution with rechargeable battery systems for operation. The BATs must maintain their state of charge within design boundaries, despite intermittent PV and load power fluctuations, and advanced power control and management techniques are essential for their effective operation. The article evaluates an intelligent controller that uses a Sliding Mode Control adaptive deep learning algorithm Convolutional Neural Networks (SMC-CNN) and a unique Strategy for managing supervisory power. (SPMS) for photovoltaic systems with battery energy storage for better regulation of DC bus voltage. SMC-CNN offers exceptional resilience and seamless functionality, minimizing fluctuations in DC bus voltage in the control strategy design requirements. The primary goals are maintaining a consistent power supply and ensuring continuous service by preventing system components from exceeding capacity. This study aims to enhance the control of DC bus voltage in the PV and battery system, with the primary significance focusing on the following aspects. The advanced SPMS has been created, incorporating control system constraints to enhance SOC balancing speed and reduce fluctuations in DC bus voltage. Power flow management involves optimizing energy flow between the PV system, battery system, and load while minimizing battery capacity requirements. The proposed SMC-CNN and SPMS are demonstrated through real-time simulation using Matlab/Simulink, as demonstrated in comprehensive case studies.

The optimization of photovoltaic (PV) systems is vital for enhancing efficiency and economic viability, especially under Partial Shading Conditions (PSCs). This study focuses on the development and comparison of traditional and advanced algorithms, including Perturb and Observe (P&O), Incremental Conductance (IC), Fuzzy Logic Control (FLC), Grey Wolf Optimization (GWO), Particle Swarm Optimization (PSO), and Artificial Neural Networks (ANN), for efficient Maximum Power Point Tracking (MPPT). Simulations conducted in MATLAB/SIMULINK evaluated these algorithms’ performance under various shading scenarios. The results indicate that while traditional methods like P&O and IC are effective under uniform conditions, advanced techniques, particularly ANN-based MPPT, exhibit superior efficiency and faster convergence under PSCs. The study concludes that integrating AI and ML into MPPT algorithms significantly enhances the reliability and efficiency of PV systems, paving the way for broader adoption of solar energy technologies in diverse environmental conditions. These findings contribute to advancing renewable energy technology and support the green energy transition.

This study employs the reflection symmetry decomposition (RSD) method to extract polarization scattering features from ground object images, aiming to determine the optimal data input scheme for deep learning networks in polarimetric synthetic aperture radar classification. Eight distinct polarizing feature combinations are designed, and the classification accuracy of various approaches is evaluated using the classic convolutional neural networks(CNNs) AlexNet and VGG16. The findings reveal that the commonly employed 6-parameter input scheme, favored by many researchers, lacks the comprehensive utilization of polarization information and warrants attention. Intriguingly, leveraging the complete 9-parameter input scheme based on the polarization coherence matrix results in improved classification accuracy. Furthermore, the input scheme incorporating all 21 parameters from the RSD and polarization coherence matrix notably enhances overall accuracy and the Kappa coefficient compared to the other 7 schemes. This comprehensive approach maximizes the utilization of polarization scattering information from ground objects, emerging as the most effective CNN input data scheme in this study. Additionally, the classification performance using the second and third component total power values (P2 and P3) from the RSD surpasses the approach utilizing surface scattering power value (PS) and secondary scattering power value (PD) from the same decomposition.

The term `motor control´ encompasses a wide range of mechanisms thought to be implicated in the organization of movements. Their study, like that of any other scientific field, must use specific notions to get to grips with them. This review is therefore organized along a series of notions that are frequently used in motor control, and we will discuss them with particular emphasis on neurological conditions, which may disrupt normal motor functioning. We will start with a short description of the roles of space and time, in which movements take place. Subsequently we will deal with kinematics and kinetics (dynamics) of movements. Then, we will list the inputs to motoneurons (MNs), which, in different forms, convey signals from the central nervous system (CNS) to skeletal muscles and muscle spindles, including central pattern generators (CPGs), sensory inputs and supraspinal descending fiber systems. Some helpers in movement organization will be introduced, such as internal models and neuronal network models. A relatively brief section on sensory-motor learning will follow because learning abilities are required to endow the sensory-motor system with flexibility and adaptability. The major emphasis is placed on neurological processes, which result from genetic modifications, autoimmune diseases, neurodegenerative diseases, infections in the nervous system as well as vascular and traumatic lesions. These neurological diseases lead to a variety of impairments and symptoms, particularly movement derangements including cerebellar ataxia, spasticity, and (other) movement disorders such as Parkinson’s syndromes. The conclusion is that there is no unique top controller that controls ´motor control`.

In this perspective article, we ponder topographical enhancements of artificial neural networks. In our recent paper in JMLR, we proved a quasi-equivalence between the network width and depth and also discussed the power of intra-links, which can be viewed as network height. In 1982, Hopfield published a network to model human associative memory, which contains many loops for dynamic evolution toward fixed points. Based on noising-denoising loops, diffusion models are recently developed to enable Bayesian modeling and inference with big data. Furthermore, we envision development of multi-AI-agent systems through “netware” engineering as a quantum leap of software engineering for emergent behaviors and autonomous AI at individual and population levels. We believe that the novel use of links and loops in space and time via multi-scale coupling would catalyze the next-generation neural networks.

Building electric energy is characterized by a significant increase of its uses (e.g. vehicle charging), a rapidly declining cost of all related data collection and a proliferation of smart grid concepts, including diverse and flexible electricity pricing schemes. Not surprisingly, an increased number of approaches have been proposed for its modeling and forecasting. In this work, we place our emphasis on three forecasting related issues. First, on the forecasting explainability, i.e. the ability to understand and explain to the user what shapes the forecast. To this extent we rely on concepts and approaches that are inherently explainable, such as the evolutionary approach of genetic programming (GP) and its associated symbolic expressions, as well as the so-called SHAP (SHapley Additive eXplanations) values, which is a well established model agnostic approach for explainability, especially in terms of feature importance. Second, we investigate the impact of the training timeframe on the forecasting accuracy; this is driven by the realization that a fast training would allow for faster deployment of forecasting in real life solutions. And third, we explore the concept of counterfactual analysis on actionable features, i.e. features that the user can really act upon and which therefore present an inherent advantage when it comes to decision support. We have found that SHAP values can provide important insights into the model explainability. As for GP models, we have found comparable and in some cases superior accuracy when compared to its neural-network and time-series counterparts but a rather questionable potential to produce crisp and insightful symbolic expressions, allowing a better insight into the model performance. We have also found, and report here on an important potential especially for practical, decision support, solutions of counterfactuals built on actionable features and short training timeframes.

Electricity demand forecasting plays a significant role in energy markets. Accurate prediction of electricity demand is the key factor to optimize power generation, consumption, saving energy resources, and determining the energy prices. However, integrating energy mix scenarios, including solar and wind power which are highly non-linear and seasonal, into an existing grid increases uncertainty in generation, adds the challenges for precise forecast. To tackle these challenges, state-of-the-art methods and algorithms have been implemented in literature. We have developed Artificial Intelligence (AI) based deep learning models that can effectively handle the information of long time-series data. Based on the pattern of dataset, four different scenarios were developed and two best scenarios were selected for prediction. Dozens of models were developed and tested in deep AI networks. In the first scenario (Scenario1), data for weekdays excluding holidays was taken and in the second scenario (Scenario2) all the data in the basket was taken. Remaining two scenarios, weekends and holidays were tested and neglected because of their high prediction error. To find the optimal configuration, models were trained and tested within a large space of alternatives called hyper-parameters. In this study, an Aritificial Neural Network (ANN) based Feed-forward Neural Network (FNN) showed the minimum prediction error for Scenario1 while a Recurrent Neural Network (RNN) based Gated Recurrent Network (GRU) showed the minimum prediction error for Scenario2. While comparing the accuracy, the lowest MAPE of 2.47% was obtained from FNN for Scenario1. When evaluating the same testing dataset (non-holidays) of Scenario2, the RNN-GRU model achieved the lowest MAPE of 2.71%. Therefore, we can conclude that grouping of weekdays as Senario1 prepared by excluding the holidays provides better forecasting accuracy compared to the single group approach used in Scenario2, where all the dataset is considered together. However, Scenario2 is equally important to predict the demand for weekends and holidays.

In this article, we investigate the applicability of quantum machine learning for classification tasks using two quantum classifiers from the Qiskit Python environment: the Variational Quantum Classifier (VQC) and the Quantum Kernel Estimator (QKE). We evaluate the performance of these classifiers on six widely known and publicly available benchmark datasets and analyze how their performance varies with the number of samples on two artificially generated test classification datasets. As quantum machine learning is based on unitary transformations, this paper explores data structures and application fields that could be particularly suitable for quantum advantages. Hereby, we developed a data set based on concepts from quantum mechanics using the exponential map of a Lie algebra. This dataset will be made publicly available and contributes a novel contribution to the empirical evaluation of quantum supremacy. We further compared the performance of VQC and QKE on six widely applicable datasets to contextualize our results.\\ Our results demonstrate that the VQC and QKE perform better than basic machine learning algorithms such as advanced linear regression models (Ridge and Lasso). They do not match the accuracy and runtime performance of sophisticated modern boosting classifiers like XGBoost, LightGBM, or CatBoost. Therefore, we conclude that while quantum machine learning algorithms have the potential to surpass classical machine learning methods in the future, especially when physical quantum infrastructure becomes widely available, they currently lag behind classical approaches. Our investigations also show that classical machine learning approaches have superior performance classifying datasets based on group structures, compared to quantum approaches that particularly use unitary processes.\\ Furthermore, our findings highlight the significant impact of different quantum simulators, feature maps, and quantum circuits on the performance of the employed quantum estimators. This observation emphasizes the need for researchers to provide detailed explanations of their hyperparameter choices for quantum machine learning algorithms, as this aspect is currently overlooked in many studies within the field.\\ To facilitate further research in this area and ensure the transparency of our study, we have made the complete code available in a linked GitHub repository.

The aim of Predictive Maintenance, within the field of Prognostics and Health Management (PHM), is to identify and anticipate potential issues in the equipment before these become critical. The main challenge to be addressed is to assess the amount of time a piece of equipment will function effectively before it fails, which is known as Remaining Useful Life (RUL). Deep Learning (DL) models, such as Deep Convolutional Neural Networks (DCNN) and Long Short-Term Memory (LSTM) networks, have been widely adopted to address the task, with great success. However, it is well known that this kind of black box models are opaque decision systems, and it may be hard to explain its outputs to stakeholders (experts in the industrial equipment). Due to the large number of parameters that determine the behavior of these complex models, understanding the reasoning behind the predictions is challenging. This work presents a critical and comparative revision on a number of XAI methods applied on time series regression model for PM. The aim is to explore XAI methods within time series regression, which have been less studied than those for time series classification. The model used during the experimentation is a DCNN trained to predict the RUL of an aircraft engine. The methods are reviewed and compared using a set of metrics that quantifies a number of desirable properties that any XAI method should fulfill. The results show that GRAD-CAM is the most robust method, and that the best layer is not the bottom one, as is commonly seen within the context of Image Processing.

This article analyzes and compares the integration of two different maximum power point tracking (MPPT) control methods, which are tested under partial shading and fast ramp conditions. These MPPT methods are designed by Improved Particle Swarm Optimization (IPSO) and a combination technique between Neural Network and Perturb & Observe method (NN_P&O). These two methods are implemented and simulated for photovoltaic systems (PV), where various system responses, such as: voltage and power are obtained. The MPPT techniques were simulated using Matlab/Simulink environment. A comparison of the performance of IPSO and NN_P&O algorithms is carried out to confirm the best accomplishment of the two methods in terms of speed, accuracy and simplicity.

Oil spillage over a sea or ocean’s surface is a threat to marine and coastal ecosystems. Spaceborne synthetic aperture radar (SAR) data has been used efficiently for the detection of oil spills due to its operational capability in all-day all-weather conditions. The problem is often modeled as a semantic segmentation task. The images need to be segmented into multiple regions of interest such as sea surface, oil spill, look-alikes, ships and land. Training of a classifier for this task is particularly challenging since there is an inherent class imbalance. In this work, we train a convolutional neural network (CNN) with multiple feature extractors for pixel-wise classification; and introduce to use a new loss function, namely ‘gradient profile’ (GP) loss, which is in fact the constituent of the more generic Spatial Profile loss proposed for image translation problems. For the purpose of training, testing and performance evaluation, we use a publicly available dataset with selected oil spill events verified by the European Maritime Safety Agency (EMSA). The results obtained show that the proposed CNN trained with a combination of GP, Jaccard and focal loss functions can detect oil spills with an intersection over union (IoU) value of 63.95%. The IoU value for sea surface, look-alikes, ships and land class is 96.00%, 60.87%, 74.61% and 96.80%, respectively. The mean intersection over union (mIoU) value for all the classes is 78.45%, which accounts for a 13% improvement over the state of the art for this dataset. Moreover, we provide extensive ablation on different Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) based hybrid models to demonstrate the effectiveness of adding GP loss as an additional loss function for training. Results show that GP loss significantly improves the mIoU and F1 scores for CNNs as well as ViTs based hybrid models. GP loss turns out to be a promising loss function in the context of deep learning with SAR images.

Adult neural stem and progenitor cells (NSPCs) contribute to learning, memory, maintenance of homeostasis, energy metabolism and many other essential processes. They are highly heterogeneous populations that require input from a regionally distinct microenvironment including a mix of neurons, oligodendrocytes, astrocytes, ependymal cells, NG2+ glia, vasculature, cerebrospinal fluid (CSF), and others. The diversity of NSPCs is present in all three major parts of the CNS, i.e., the brain, spinal cord, and retina. Intrinsic and extrinsic signals, e.g., neurotrophic and growth factors, master transcription factors, and mechanical properties of the extracellular matrix (ECM), collectively regulate activities and characteristics of NSPCs: quiescence/survival, proliferation, migration, differentiation, and integration. This review discusses the heterogeneous NSPC populations in the normal physiology and highlights their potentials and roles in injured/diseased states for regenerative medicine.

An abdominal aortic aneurysm (AAA) is usually asymptomatic until rupture, which is associated with extremely high mortality. Consequently, early detection of AAAs is of paramount importance in reducing mortality; however, most AAAs are detected by medical imaging incidentally. The aim of this study was to investigate the feasibility of machine learning-based pulse wave (PW) analysis for the early detection of AAAs using a database of in silico PWs. PWs in the large systemic arteries were simulated using one-dimensional blood flow modelling. A database of in silico PWs representative of subjects (aged 55, 65 and 75 years) with different AAA sizes was created by varying the AAA-related parameters with major impacts on PWs – identified by parameter sensitivity analysis – in an existing database of in silico PWs representative of subjects without AAA. Then, a machine learning architecture for early detection of AAAs was proposed, which was trained and tested using the new in silico PW database. The parameter sensitivity analysis revealed that the AAA maximum diameter and stiffness of the large systemic arteries were the dominant AAA-related biophysical properties that significantly influence the PW. The simulated PW indexes extracted from the database showed that the PW was not only influenced by the presence of an AAA but was also significantly affected by multiple cardiovascular parameters that compromised the detection of AAAs by using individual PW indexes. Alternatively, the trained machine learning model performed well in classifying normal and AAA conditions using digital photoplethysmogram PWs from the database. These findings suggest that machine learning-based PW analysis is a promising approach for AAA screening using PW signals acquired by wearable devices.

The detection performance of small objects in remote sensing images has not been satisfactory compared to large objects, especially in low-resolution and noisy images. A generative adversarial network (GAN)-based model called enhanced super-resolution GAN (ESRGAN) showed remarkable image enhancement performance, but reconstructed images usually miss high-frequency edge information. Therefore, object detection performance showed degradation for small objects on recovered noisy and low-resolution remote sensing images. Inspired by the success of edge enhanced GAN (EEGAN) and ESRGAN, we applied a new edge-enhanced super-resolution GAN (EESRGAN) to improve the quality of remote sensing images and used different detector networks in an end-to-end manner where detector loss was backpropagated into the EESRGAN to improve the detection performance. We proposed an architecture with three components: ESRGAN, EEN, and Detection network. We used residual-in-residual dense blocks (RRDB) for both the ESRGAN and EEN, and for the detector network, we used a faster region-based convolutional network (FRCNN) (two-stage detector) and a single-shot multibox detector (SSD) (one stage detector). Extensive experiments on a public (car overhead with context) dataset and another self-assembled (oil and gas storage tank) satellite dataset showed superior performance of our method compared to the standalone state-of-the-art object detectors.

This paper introduces a model-free, "on-the-fly" learning control strategy for arrays of energy converters with adjustable generator damping. The devices are arranged so that they are affected simultaneously by the energy medium. Each device uses a different control strategy, of which at least one has to be the machine learning approach presented in this paper. During operation all energy converters record the absorbed power and control output; the machine learning device gets the data from the converter with the highest power absorption and so learns the best performing control strategy for each state. Consequently, the overall network has a better overall performance than each individual strategy. This concept is evaluated for wave energy converter (WEC) with numerical simulations and experiments with physical scale models in a wave tank. In the first of two numerical simulations, the learnable WEC works in an array with four WECs applying a constant damping factor. In the second simulation, two learnable WECs were learning with each other. It showed that in the first test the WEC was able to absorb as much as the best constant damping WEC, while in the second run it could absorb even slightly more. During the physical model test, the ANN showed its ability to select the better of two possible damping coefficients based on real world input data.

Given the high number of vehicle-crash victims, it has been established as a priority to reduce this figure in the transportation sector. For this reason, many of the recent researches are focused on including control systems in existing vehicles, to improve their stability, comfort and handling. These systems need to know in every moment the behavior of the vehicle (state variables), among others, when the different maneuvers are performed, to actuate by means of the systems in the vehicle (brakes, steering, suspension) and, in this way, to achieve a good behavior. The main problem arises from the lack of ability to directly capture several required dynamic vehicle variables, such as roll angle, from low-cost sensors. Previous studies demonstrate that low-cost sensors can provide data in real-time with the required precision and reliability. Even more, other research works indicate that neural networks are efficient mechanisms to estimate roll angle. Nevertheless, it is necessary to assess that the fusion of data coming from low-cost devices and estimations provided by neural networks can fulfill the reliability and appropriateness requirements for using these technologies to improve overall safety in production vehicles. Because of the increasing of computing power, the reduction of consumption and electric devices size, along with the high variety of communication technologies and networking protocols using Internet have yield to Internet of Things (IoT) development. In order to address this issue, this study has two main goals: 1) Determine the appropriateness and performance of neural networks embedded in low-cost sensors kits to estimate roll angle required to evaluate rollover risk situations. 2) Compare the low-cost control unit devices (Intel Edison and Raspberry Pi 3 Model B), to provide the roll angle estimation with this artificial neural network-based approach. To fulfil these objectives an experimental environment has been set up composed of a van with two set of low-cost kits, one including a Raspberry Pi 3 Model B, low cost Inertial Measurement Unit (BNO055 - 37€) and GPS (Mtk3339 - 53€) and the other having an Intel Edison System on Chip linked to a SparkFun 9 Degrees of Freedom module. This experimental environment will be tested in different maneuvers for comparison purposes. Neural networks embedded in low-cost sensor kits provide roll angle estimations very approximated to real values. Even more, Intel Edison and Raspberry Pi 3 Model B have enough computing capabilities to successfully run roll angle estimation based on neural networks to determine rollover risks situation fulfilling real-time operation restrictions stated for this problem.

The Bayes filters, such as Kalman and particle filters, have been used in sensor fusion to integrate two sources of information and obtain the best estimate of the unknowns. Efficient integration of multiple sensors requires deep knowledge of their error sources and it is not trivial for complicated sensors, such as Inertial Measurement Unit (IMU). Therefore, IMU error modelling and efficient integration of IMU and Global Navigation Satellite System (GNSS) observations has remained a challenge. In this paper, we develop deep Kalman filter to model and remove IMU errors and consequently, improve the accuracy of IMU positioning. In other words, we add modelling step to the prediction and update steps of Kalman filter and the IMU error model is learned during integration. Therefore, our deep Kalman filter outperforms Kalman filter and reaches higher accuracy.

In case of a discrete-time Hopfield neural network of two neurons with two delays and no self- connections at 23 bifurcation values 23 voltage trajectories appear.Among the 23 voltage trajectories 14 voltage trajectory are not what we call orbits in classic sense. The geometrical aspect of these trajectories suggest that they are fractals. Our conjecture is that the 14 trajectories in discussion are fractals having real couterpart. In case of a discrete-time Hopfield neural network of five neuron with delay and ring architecture at 9 bifurcation values 9 voltage trajectories appear.Among the 9 voltage trajectories we find 5 voltage trajectory which are not what we call orbits in classic sense.The geometrical aspect of these trajectories suggest that they are fractals.Our conjecture is that the 5 trajectories in discussion are fractals having real couterpart.. In case of a discrete-time Hopfield neural network of two neurons with a single delay and self- connections the computed trajectories are what we call orbits in classic sense. In case of a discrete-time Hopfield neural network of two neurons with two delays and self- connections the computed trajectories are what we call orbits in classic sense.

This article compares the predictive capabilities of six models namely the Linear Discriminant Analysis (LDA), Logistic Regression (LR), Support Vector Machine (SVM), XGBoost, Random Forest (RF) and Deep Neural Network (DNN) to predict the default behaviour of credit card holders in Taiwan using data from the UCI machine learning database. Python programming language was used for data analysis. Statistical methods were compared with machine learning algorithms using the confusion matrix measured in metric terms of prediction accuracy, sensitivity, specificity, precision, G-mean, F1 score, ROC and AUC. The dataset contains 30,000 credit card user’s information with 6636 default observations and 23,364 non-default cases. The study results found that modern machine learning methods outperformed traditional statistical methods in terms of predictive performance measured by F1 score, G-mean and AUC. Traditional methods like logistic regression were marginally better than linear discriminant analysis and support vector machines in terms of predictive performance measured by area under the receiver operating characteristic curve. In the modern machine learning methods, deep neural networks were better in most of the predictive performance metrics than XGBoost and Random Forest methods.

Recently, the destructive impact of wildfires has proliferated; for instance, the August Complex wildfire in 2020 burned around 4% of California's landmass. This has caused increased economic damage and risk to human life. Additionally, climate change is anticipated to increase the severity of wildfires, making it imperative for accurate and efficient detection of wildfires. Machine Learning approaches allow for the automatic detection of wildfires, simultaneously prioritizing accuracy and efficiency, with minimal human intervention, thus decreasing the likelihood of increased economic damage and increasing firefighting responses. Convolutional Neural Networks (CNNs), while showing promise, are often limited by their inability to learn and capture deep spatial dependencies in satellite imagery tasks. In this paper, we propose FlameViT, a novel wildfire detection architecture based on Vision Transformers (ViT). Satellite images are more efficient to obtain and can cover wide areas prone to wildfires. We obtain a dataset of 40K+ satellite images from Canada's Open Government Portal, allowing FlameViT to be optimized to detect wildfires in satellite imagery. FlameViT uses Patch Extractor and Patch Embedding layers, followed by multiple Transformer Encoder layers with Multi-Head Self-Attention and feed-forward neural networks. FlameViT is hyperparameter-tuned and achieves a validation accuracy of 95%, outperforming various baselines in the wildfire detection task. FlameViT shows the power of Vision Transformers for wildfire detection tasks, and in conjunction with the use of satellite imagery, can provide an efficient and accurate way of detecting wildfires.

Recent developments in microfluidics and biomaterials have enabled the creation of organs-on-chips (OoCs), which provide a controlled and lifelike in vitro microenvironment resembling an actual organ. Organ-on-a-chip technology offers a tremendous opportunity for efficient, cost-effective, and ethical drug testing and research. However, the high throughput and large quantities of data these complex microenvironments produce make it difficult for researchers to effectively analyze the data and draw valuable conclusions. Convolutional Neural Networks (CNNs) are most aptly positioned to address many of OoC’s challenges because of their ability to interpret microscopic images and facilitate the analytical process. Despite the growing field of AI, there have been a limited number of studies summarizing the various applications of CNNs in OoCs. This review aims to provide 1) an overview of the technology involved with CNNs and OoCs 2) an insight into the state-of-the-art applications of CNNs in OoCs including device parameters, predicting and tracking cell trajectories, super-resolution image segmentation, and image classification, and 3) an overview of existing challenges and opportunities ahead for clinical translation of this technology. Various applications of CNNs have been classified by the type of task. Different CNN models such as Faster R-CNNs, fully convolutional networks (FCNs), and Mask R-CNNs are explained and highlighted. This review article can be used as a resource for a better understanding of the potential of CNNs in biomedical research and clinical applications, particularly OoCs.

The temporo-spatial theory of consciousness postulates that the brain implements its own inner time and space for conscious processing of outside world. In line with this hypothesis, I present a mechanistic model of mutually connected processes that encode the inner space and time. The model is used to elaborate the binding mechanism between two sets of processes representing the inner space and time, respectively. Further, a stochastic version of the model is developed to investigate the interplay between the binding strength and noise. The spectral entropy is used to characterize the noise effects on the systems of processes when the binding strength is varied. The stochastic modeling results reveal that the spectral entropy values for strongly bound systems have similar entropy values for weakly bound or even decoupled systems. Thus, the analysis performed in this study allows to conclude that the binding mechanism is noise-resilient.

Background. Pose estimation based on deep learning has been expected to be a breakthrough method to increase the accuracy of clinical photographic evaluation and to decrease interobserver errors. The purpose is to quantify pose estimation from photography of patients with adolescent idiopathic scoliosis (AIS) using open-source software packages and determine correlations between parameters obtained by radiography and photography. Methods. We included 12 consecutive patients with AIS treated with spinal correction surgery. Photographs were taken preoperatively using a tripod-mounted camera (iPhone 13Pro) on an X-ray tube head. To assess photographic parameters obtained by photography, we defined 17 points to analyze posture and define parameters. Results. In the sagittal plane, there was a significant correlation between the radiographic trunk tilt angle and the photographic sagittal trunk tilt angle of the shoulder–hip and ear–hip. In the coronal plane, there was a significant correlation between the radiographic clavicle angle and the photographic shoulder height angle, and the radiographic C7–CSVL and the photographic coronal trunk tilt angle. Conclusions. Posture analysis by photography using popular mobile devices has clinical utility for improving and promoting the screening and early detection of AIS because it is simple, without patient exposure to X-ray radiation.

In any document, graphical elements like tables, figures, and formulas contain essential information. The processing and interpretation of such information require specialized algorithms. Off-the-shelf OCR components cannot process this information reliably. Therefore, an essential step in document analysis pipelines is to detect these graphical components. It leads to a high-level conceptual understanding of the documents that makes digitization of documents viable. Since the advent of deep learning, the performance of deep learning-based object detection has improved many folds. In this work, we outline and summarize the deep learning approaches for detecting graphical page objects in the document images. Therefore, we discuss the most relevant deep learning-based approaches and state-of-the-art graphical page object detection in document images. This work provides a comprehensive understanding of the current state-of-the-art and related challenges. Furthermore, we discuss leading datasets along with the quantitative evaluation. Moreover, it discusses briefly the promising directions that can be utilized for further improvements.

. In this article, a search for a calculation method and an analysis of performance indicators of mutual investment funds is carried out. Many factors can influence the return on investments in portfolio investments, which makes the choice of the fund incredibly difficult. However, in addition to the fact that it is difficult to determine which indicators should be given more attention and which should be omitted, it is not so easy to get these data. Some of them are publicly available on the Internet, while others can only be found in trading systems that are not accessible to people outside of this area. The article proves that a well-trained neural network can easily find existing patterns between risk and expected return on investment. It is a well-trained neural network that provides the ability to use the "what-if" function to justify your choice on real factors, as well as the ability to download available data and calculate the estimated income and its changes. This makes it much easier to choose a Fund, especially for inexperienced investors. The article also presents the results of a study of the dependence of estimated income on correlation, standard deviation, and volatility using a trained neural network. According to the theory, higher values of these three factors correspond to a higher amount of income. The obtained graphs of the calculated income dependence on correlation, standard deviation, and volatility confirmed the correctness of the neural network training and compliance with the relations described in the theory. The paper presents graphs of the dependence of the estimated income on the beta and alpha coefficients. The higher the beta and alpha indicators, the higher the expected return on investment. This corresponds to the dependency accepted in the model. When the values of the beta and alpha coefficients increase, the income also increases, which is completely consistent with the theory.

In this article, a search for a calculation method and an analysis of performance indicators of mutual investment funds is carried out. Many factors can influence the return on investments in portfolio investments, which makes the choice of the fund incredibly difficult. However, in addition to the fact that it is difficult to determine which indicators should be given more attention and which should be omitted, it is not so easy to get these data. Some of them are publicly available on the Internet, while others can only be found in trading systems that are not accessible to people outside of this area. The article proves that a well-trained neural network can easily find existing patterns between risk and expected return on investment. It is a well-trained neural network that provides the ability to use the "what-if" function to justify your choice on real factors, as well as the ability to download available data and calculate the estimated income and its changes. This makes it much easier to choose a Fund, especially for inexperienced investors. The article also presents the results of a study of the dependence of estimated income on correlation, standard deviation, and volatility using a trained neural network. According to the theory, higher values of these three factors correspond to a higher amount of income. The obtained graphs of the calculated income dependence on correlation, standard deviation, and volatility confirmed the correctness of the neural network training and compliance with the relations described in the theory. The paper presents graphs of the dependence of the estimated income on the beta and alpha coefficients. The higher the beta and alpha indicators, the higher the expected return on investment. This corresponds to the dependency accepted in the model. When the values of the beta and alpha coefficients increase, the income also increases, which is completely consistent with the theory.

In this paper, we study the performance of various deep reinforcement learning algorithms to enhance the energy management system of a microgrid. We propose a novel microgrid model that consists of a wind turbine generator, an energy storage system, a set of thermostatically controlled loads, a set of price-responsive loads, and a connection to the main grid. The proposed energy management system is designed to coordinate among the different flexible sources by defining the priority resources, direct demand control signals, and electricity prices. Seven deep reinforcement learning algorithms were implemented and are empirically compared in this paper. The numerical results show that the deep reinforcement learning algorithms differ widely in their ability to converge to optimal policies. By adding an experience replay and a semi-deterministic training phase to the well-known asynchronous advantage actor-critic algorithm, we achieved the highest model performance as well as convergence to near-optimal policies.

In recent years, demand has been increasing for target detection and tracking from aerial imagery via drones using onboard powered sensors and devices. We propose a very effective method for this application based on a deep learning framework. A state-of-art embedded hardware system empowers small flying robots to carry out the real-time onboard computation necessary for object tracking. Two types of embedded modules were developed: one is designed using a Jetson TX or AGX Xavier, and the other is based on an Intel Neural Compute Stick. These are suitable for real-time onboard computing power on small flying drones with limited space. A comparative analysis of current state-of-art deep-learning-based multi-object detection algorithms was carried out utilizing the designated GPU-based embedded computing modules to obtain detailed metric data about frame rates as well as the computation power. We also introduce an effective target tracking approach for moving objects. The algorithm for tracking moving objects is based on the extension of simple online and real-time tracking. It was developed by integrating a deep-learning-based association metric approach (Deep SORT), which uses a hypothesis tracking methodology with Kalman filtering and a deep-learning-based association metric. In addition, a guidance system that tracks the target position using a GPU-based algorithm is introduced. Finally, we demonstrate the effectiveness of the proposed algorithms by real-time experiments with a small multi-rotor drone.

An innovative approach is utilized in this paper to solve the Fractional Fokker–Planck–Levy (FFPL) equation. A hybrid technique is designed by combining the finite difference method (FDM), Adams numerical technique, and physics-informed neural network (PINN) architecture, namely, the FDM-APINN, to solve the fractional Fokker‒Planck‒Levy (FFPL) equation numerically. Two scenarios of the FFPL equation are considered by varying the value of α (i.e., 1.75,1.85). Moreover, three cases of each scenario are numerically studied for different discretized domains with 100,200 and 500 points in x∈[-1,1] and t∈[0,1]. For the FFPL equation, solutions are obtained via the FDM-APINN technique via 1000,2000, and 5000 iterations. The errors, loss function graphs, and statistical tables are presented to validate our claim that the FDM-APINN is a better alternative intelligent technique for handling fractional-order partial differential equations with complex terms. FDM-APINN can be extended by using nongradient-based bioinspired computing for higher-order fractional partial differential equations.

This paper presents a new means to control the processes, which involve the electric energy conversion. Electric machines fed by electronic converters provide the useful power defined by the inner product of two generalized energetic variables: the effort and the speed. The novelty of the paper idea is to control the desired energetics variables by a direct Data Driven Control (DDC) law in terms of the pair effort, speed and corresponding voltage controls of the electronic converter. It must be mentioned that the same desired useful power might be obtained with different controls at different efficiencies. The regularization problem was solved by selecting from a knowledge database, the maximum efficiency operation points. Knowing a reasonable number of optimal efficiency operation points, an interpolative Radial Base Function (RBF) control was built up. The RBF algorithm can find by interpolation the optimal controls for any admissible operation points of the process. The control scheme developed for this purpose has an inner DDC loop, that perform the converter control based on measured speed and demanded torque by the outer loop which handles the speed. A comparison of the DDC with the Model Predictive Control (MPC) schemas highlights the advantages of the new proposed control.

The development of innovative materials, based on the modern technologies and processes, is the key factor to improve the energetic sustainability and reduce the environmental impact of the electrical equipment. In particular, modeling of magnetic hysteresis is crucial for the design and construction of electrical and electronic devices. In recent years, additive manufacturing techniques are playing a decisive role in the project and production of magnetic elements and circuits for applications in various engineering fields. To this aim, the use of Deep learning paradigm, integrated with the most common models of the magnetic hysteresis process, has become increasingly present in recent years. Particularly in the paper, different Neural networks used in scientific literature, integrated with various hysteretic mathematical models, including the well-known Preisach model, are compared. It is shown that this hybrid approach not only improves the modelling of hysteresis by significantly reducing computational time and efforts, but also offers new perspectives for analysis and prediction of the behavior of magnetic materials, with significant implications for the production of advanced devices.

This paper presents a novel approach to predicting shot accuracy in badminton by analyzing Quiet Eye (QE) metrics such as QE duration, fixation points, and gaze dynamics. We develop a neural network model that combines visual data from eye-tracking devices with biomechanical data such as body posture and shuttlecock trajectory. Our model is designed to predict shot accuracy, providing insights into the role of QE in performance. The study involved 30 badminton players of varying skill levels from the Singapore Swimming Club. Using a combination of eye-tracking technology and motion capture systems, we collected data on QE metrics and biomechanical factors during a series of badminton shots. Key results include: 1. The neural network model achieved 85% accuracy in predicting shot outcomes, demonstrating the potential of integrating QE metrics with biomechanical data. 2. QE duration and onset were identified as the most significant predictors of shot accuracy, followed by racket speed and wrist angle at impact. 3. Elite players exhibited significantly longer QE durations (M = 289.5 ms) compared to intermediate (M = 213.7 ms) and novice players (M = 168.3 ms). 4. A strong positive correlation (r = 0.72) was found between QE duration and shot accuracy across all skill levels. These findings have important implications for badminton training and performance evaluation. The study suggests that QE-based training programs could significantly enhance players' shot accuracy. Furthermore, the predictive model developed in this study offers a framework for real-time performance analysis and personalized training regimens in badminton. By bridging cognitive neuroscience and sports performance through advanced data analytics, this research paves the way for more sophisticated, individualized training approaches in badminton and potentially other fast-paced sports. Future research directions include exploring the temporal dynamics of QE during matches and developing real-time feedback systems based on QE metrics.

Aural rehabilitation with hearing aids can decrease the attentional requirements of cognitive resources by amplifying the deteriorated-frequency sound in hearing loss patients and improve the auditory discrimination ability like speech-in-noise perception. As aural rehabilitation with an intelligible-hearing sound also can be hopeful, the aim of this study was to evaluate the effectiveness of the aural rehabilitation with intelligible-hearing sound for hearing loss patients. Adult native Japanese speakers (17 males and 23 females, 68.43±9.23 years) showed over 30 dB at 125, 250, 500, 1000, 2000, 3000, 4000, 8000, 10000, and 12000Hz on any side, were recruited and underwent Mini-Mental State Examination Japanese. we conducted self-evaluation questionnaire for hearing problems of voice, gap detection test, fast speech test, and speech-in-noise test, pure tone audiogram, speech perception test using Japanese 67-S, cortical auditory evoked fields, and magnetic mismatch negativity before and after the non-intelligible-hearing (N=20) and intelligible-hearing (N=20) sound therapy with listening to music for one hour a day for 35 days. Better hearing ear was defined using a four-frequency pure-tone average at the thresholds of 500, 1000, 2000 and 4000 Hz. After the sound therapy, speech-in-noise test with signal to noise ratio +10 in better hearing ear showed significant improvement (p<0.05), and N1m-P2m amplitudes showed the significant increase in Lt superior temporal gyrus at the stimulus from better hearing ear (p<0.05). The significant enhancement of the magnetic mismatch negativity amplitude at Lt superior temporal gyrus was exhibited after the sound therapy (p<0.01). Intelligible-hearing sound therapy can improve the ability of speech-in-noise perception in better hearing ear and the enhancement of central cortex response, which reflect the ability of working memory, was proved by cortical auditory evoked fields and magnetic mismatch negativity. Intelligible-hearing sound therapy can be a valuable aural rehabilitation method for sensory neural hearing loss as same as hearing aids.

Malware detection is a crucial pillar of cybersecurity and aims to identify and neutralize malware threats. This study investigates how three deep learning algorithms - Convolutional Neural Net-works with One-Dimensional Architecture (CNN1D), Neural Networks (NN), and a hybrid model of one dimensional convolutional neural networks (CNN1D) and Long Short-Term Memory (LSTM) - help detect malware in Portable Executable working (.exe) files. Using a large dataset of tagged malware and benign samples, the effectiveness of these algorithms in distinguishing dangerous from harmless executables is extensively tested. In addition, the study evaluates the computational efficiency of the proposed methods for a variety of hardware configurations, including Central Processing Units (CPU), Graphics Processing Units (GPU), Raspberry Pi (IoT device), and Tensor Processing Units (TPU). Performance metrics provide insight into the scalability and effectiveness of the model across different hardware configurations. The results of this study have significant impact on the development of malware detection, particularly in the context of IoT security. By demonstrating the capabilities and limitations of CNN1D, Neural Networks, and CNN1D with LSTM models, the study provides practitioners with efficient and scalable solutions to real-world malware detection difficulties. In addition, insights from performance tests on various hardware platforms provide important assistance in developing robust security measures in IoT contexts, strengthening cybersecurity defenses in an ever-changing digital landscape.

This work addresses the challenge of EEG visual multiclass classification into 40 classes for Brain-Computer interface applications, by using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage, since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, performing multiclassifiers based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and Minimum-Norm Estimate algorithms are implemented to select discriminant channels and enhance EEG data. Hence, deep EEGNet and Convolutional-recurrent neural networks are implemented separately to classify EEG data of image visualization into 40 labels. By using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures, respectively. Satisfactory results obtained with this method offer a new implementation opportunity for multi-task BCI applications by utilizing a reduced number of channels (<50%), compared to those presented in the related literature where the whole set of channels is used.

Deep Learning (DL) oriented document processing is widely used in different fields for extraction, recognition, and classification processes from raw corpora of data. The article examines the application of deep learning approaches, based on different neural network methods, including Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and Convolutional Neural Networks (CNN). The compared models were combined with two different word embedding techniques, namely: Bidirectional Encoder Representations from Transformers BERT and Gensim Word2Vec. The models are designed to evaluate the performance of architectures based on neural network techniques for the classification of CVs of Moroccan engineering students at ENSAK(National School of Applied Sciences of Kenitra, Ibn Tofail University). The used dataset included resumes collected from engineering students at ENSAK in 2023 for a project on the employability of Moroccan engineers in which new approaches were applied, especially machine learning, deep learning, and big data. Accordingly, 867 resumes were collected from five specialties of study (Electrical Engineering, Networks and Systems Telecommunications, Computer Engineering, Automotive Mechatronics Engineering, Industrial Engineering). The results revealed good performance of the proposed models based on the BERT embedding approach compared to models based on the Gensim Word2Vec embedding approach. Accordingly, the CNN-GRU/Bert model achieved slightly better accuracy with 0.9251 compared to other hybrid models.

This study investigates the application of regression neural networks, in particular the fitrnet model, in predicting the hardness of steels. The experiments involve extensive tuning of hyperparameters using Bayesian optimization and employ 5-fold and 10-fold cross-validation schemes. The trained models are rigorously evaluated, and their performances are compared using various metrics such as mean square error (MSE), root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). The results provide valuable insights into the effectiveness of the models and their ability to generalize to unseen data. In particular, Model 4208 (8-85-141-1) emerges as the top performer with an impressive RMSE of 1.0790 and an R² of 0.9900. The research paper contains an illustrative example that demonstrates the practical application of the developed model in determining the hardenability band for a specific steel grade and shows the effectiveness of the model in predicting and optimizing heat treatment results.

Online and offline shopping trip have different impacts on various aspects of urban life, such as e-commerce, transportation systems, and sustainability. Therefore, it is important to evaluate the factors that influence their choices. We use a hybrid machine learning model that combines a gray wolf optimization algorithm and a deep convolutional neural network to estimate shopping trip based on a survey of 1,000 active e-commerce users who made successful orders in both online and offline services in the last 20 days of 2021 in areas 2 and 5 of Tehran. The gray wolf optimization algorithm performs feature selection and hyperparameter tuning for the deep convolutional neural network, which is a powerful deep learning model for image recognition and classification. The results show that our model achieves an accuracy of 97.81% with an MSE of 0.325 by selecting seven out of ten features. The most important features are delivery cost, delivery time, product price, car ownership. In addition, comparing the performance of the proposed method with other methods showed that the proposed algorithm with an accuracy of 97.81%, the accuracies of the single deep learning model, MLP neural network, decision tree, and KNN models were 95.63%, 90.0%, 86.49%, and 80.16%, respectively.

In recent years, the unmanned aerial vehicle (UAV) synthetic aperture radar (SAR) has become a highly sought-after topic for its wide applications in the field of target recognition, detection, and tracking. However, SAR automatic target recognition (ATR) models based on deep neural networks (DNN) are suffering from adversarial examples. Generally, non-cooperators rarely disclose any information about SAR-ATR models, making adversarial attacks challenging. In this situation, we propose Transferable Adversarial Network (TAN) to attack these models with highly transferable adversarial examples. The proposed method improves the transferability via a two-player game, in which we simultaneously train two encoder-decoder models: a generator that crafts malicious samples through a one-step forward mapping from original data, and an attenuator that weakens the effectiveness of malicious samples by capturing the most harmful deformations. In particular, compared to traditional iterative methods, our approach is able to one-step map original samples to adversarial examples, thus enabling real-time attacks. Experimental results indicate that the proposed approach achieves state-of-the-art transferability with acceptable adversarial perturbations and minimum time costs compared to existing attack methods, i.e., it excellently realizes real-time transferable adversarial attacks.

The salt marshes, lying at the land-sea temperate interface, furnish a plethora of ecosystems services such as biodiversity niche support, ocean-climate change regulation, ornithology recreo-tourism or plant gathering by hand. They undergo significant worldwide losses due to their conversion into crop fields and to their spatial compression between the rising sea-level and the armoring shoreline. Their monitoring however requires to use a suite of remote sensing sensors to embrace the regional scale while capturing the plant details. This research innovatively adopts a multiscale approach using a cascading spaceborne and airborne process, from the 10-m Sentinel-2, through the 3-m Dove, to the 0.03-m unmanned airborne vehicle (UAV) imageries. The high to very high temporal resolution of the Sentinel-2 and Dove enabled to cover twenties and tens of km2 over five and four years, respectively, in the form of normalized difference vegetation index (NDVI) classes, associated with microphytobenthos, low, medium and high salt marsh vegetation, including the opportunistic Elyma genus. The NDVI was then modelled at the UAV scale (a few km2) using a three-layered NN prediction, providing the final near-infrared (NIR), and the intermediate red, green and blue reflectance imageries, calibrated/validated/tested with the Dove reflectance imageries (R2NIR=0.98, R2red=0.88, R2green=0.84, and R2blue=0.90). The 100fold increase in pixel size allowed to detect the decimeter-scale objects of the tidal flats and salt marshes, to enlarge the NDVI class ranges, and hold great promise to model other spectral bands at the UAV scale for further deeply enhancing the salt marsh mapping.

Table detection is a preliminary step in extracting reliable information from tables in scanned document images. We present CasTabDetectoRS, a novel end-to-end trainable table detection framework that operates on Cascade Mask R-CNN, including Recursive Feature Pyramid network and Switchable Atrous Convolution in the existing backbone architecture. By utilizing a comparatively lightweight backbone of ResNet-50, this paper demonstrates that superior results are attainable without relying on pre and post-processing methods, heavier backbone networks (ResNet-101, ResNeXt-152), and memory-intensive deformable convolutions. We evaluate the proposed approach on five different publicly available table detection datasets. Our CasTabDetectoRS outperforms the previous state-of-the-art results on four datasets (ICDAR-19, TableBank, UNLV, and Marmot) and accomplishes comparable results on ICDAR-17 POD. Upon comparing with previous state-of-the-art results, we obtain a significant relative error reduction of 56.36%, 20%, 4.5%, and 3.5% on the datasets of ICDAR-19, TableBank, UNLV, and Marmot, respectively. Furthermore, this paper sets a new benchmark by performing exhaustive cross-datasets evaluations to exhibit the generalization capabilities of the proposed method.

Tables in the document image are one of the most important entities since they contain crucial information. Therefore, accurate table detection can significantly improve information extraction from tables. In this work, we present a novel end-to-end trainable pipeline, HybridTabNet, for table detection in scanned document images. Our two-stage table detector uses the ResNeXt-101 backbone for feature extraction and Hybrid Task Cascade (HTC) to localize the tables in scanned document images. Moreover, we replace conventional convolutions with deformable convolutions in the backbone network. This enables our network to detect tables of arbitrary layouts precisely. We evaluate our approach comprehensively on ICDAR-13, ICDAR-17 POD, ICDAR-19, TableBank, Marmot, and UNLV. Apart from the ICDAR-17 POD dataset, our proposed HybridTabNet outperforms earlier state-of-the-art results without depending on pre and post-processing steps. Furthermore, to investigate how the proposed method generalizes unseen data, we conduct an exhaustive leave-one-out-evaluation. In comparison to prior state-of-the-art results, our method reduces the relative error by 27.57% on ICDAR-2019-TrackA-Modern, 42.64% on TableBank (Latex), 41.33% on TableBank (Word), 55.73% on TableBank (Latex + Word), 10% on Marmot, and 9.67% on UNLV dataset. The achieved results reflect the superior performance of the proposed method.