In this paper, we study the performance of various deep reinforcement learning algorithms to enhance the energy management system of a microgrid. We propose a novel microgrid model that consists of a wind turbine generator, an energy storage system, a set of thermostatically controlled loads, a set of price-responsive loads, and a connection to the main grid. The proposed energy management system is designed to coordinate among the different flexible sources by defining the priority resources, direct demand control signals, and electricity prices. Seven deep reinforcement learning algorithms were implemented and are empirically compared in this paper. The numerical results show that the deep reinforcement learning algorithms differ widely in their ability to converge to optimal policies. By adding an experience replay and a semi-deterministic training phase to the well-known asynchronous advantage actor-critic algorithm, we achieved the highest model performance as well as convergence to near-optimal policies.

The accurate state of health (SOH) estimation of lithium-ion batteries (LIBs) during operation is crucial to ensure optimal performance, prolonging battery life and preventing unexpected failure or safety hazards. This work presents a storage and performance optimised deep learning approach to predict the capacity based SOH of LIBs using raw sensor data from partial charging curves under constant current condition. The proposed model is based on a combination of a 1-dimensional convolutional and long-short term memory neural network and processes time, voltage and incremental capacity of partial charging curves as time series. The model is cross-validated on different aging scenarios reaching an overall MAE = 0.418% and RMSE = 0.531%, promising an accurate SOH estimation of LIBs under varying usage and environmental conditions in a real world application.

COVID-19 was a terrible worldwide pandemic that caused a global public health crisis, with numerous deaths and a severe economic depression. To suppress the spread of COVID-19 and initiate patient isolation and contact tracing to reduce its effect, early diagnosis was required, with real-time reverse transcriptase polymerase chain reaction (RT-PCR) swab test being the most widely used. However, the RT-PCR test was sometimes found to be lengthy and inaccurate and; for that reason, in many cases of severe complications of COVID-19 pneumonia, chest screening with radiography imaging was preferred. In this paper, we carried out a study for COVID-19 detection from computed tomography images, and compared the obtained results using deep learning (DL) and support vector machine (SVM). The findings showed that, despite the excellent results shown by deep learning, the accuracy in predicting COVID-19 using SVM, in the presence of small databases, was slightly higher than DL. The execution time using SVM was also shorter

This study challenges the prevailing belief in the necessity of complex models for accurate forecasting by demonstrating the effectiveness of parsimonious econometric models, namely ARCH(1) and GARCH(1,1), over deep learning robust approaches, such as LSTM and 1D-CNN neural networks, in modeling historical volatility within pre-emerging stock markets, specifically the Moroccan and Bahraini stock markets. The findings suggest reevaluating the balance between model complexity and predictive accuracy. Future research directions include investigating the potential existence of threshold effects in market capitalization for optimal model performance. This research contributes to a deeper understanding of volatility dynamics and enhances forecasting models’ effectiveness in diverse market conditions.

Vertical Indoor Farming (VIF) with hydroponics offers a promising perspective for sustainable food production. Intelligent control of VIF system components plays a key role in reducing operating costs and increasing crop yields. Modern machine vision (MV) systems use Deep Learning (DL) in combination with camera systems for various tasks in agriculture, such as disease and nutrient deficiency detection, and flower and fruit identification and classification for pollination and harvesting. This study presents the applicability of MV technology with DL modelling to detect the growth stages of chilli plants using YOLOv8 networks. The influence of different bird’s eye and side view datasets and different YOLOv8 architectures was analysed. To generate the image data for training and testing the YOLO models, chilli plants were grown in a hydroponic environment and imaged throughout their life cycle using four camera systems. The growth stages were divided into growing, flowering and fruiting classes. All trained YOLOv8 models showed reliable identification of growth stages with high accuracy. The results indicate that models trained with data from both views show better generalisation. YOLO’s middle architecture achieved the best performance.

This paper investigates the adaptability of four state-of-the-art Artificial Intelligence (AI) models to the Australian mammographic context through transfer learning, explores the impact of image enhancement on model performance and analyses the relationship between AI outputs and histopathological features for clinical relevance and accuracy assessment. A total of 1712 screening mammograms (n=856 cancer cases and n=856 matched normal cases) were used in this study. The 856 cases with cancer lesions were annotated by two expert radiologists and the level of concordance between their annotations was used to establish image subsets. The area under the receiver operating characteristic curve (AUC) was used to evaluate the performance of Globally aware Multiple Instance Classifier (GMIC), Global-Local Activation Maps (GLAM), I&H and End2End AI models, both in the pre-trained and transfer learning modes, with and without applying the Contrast Limited Adaptive Histogram Equalization (CLAHE) algorithm. The four AI models with and without transfer learning in the high-concordance subset outperformed those in the entire dataset. Applying the CLAHE algorithm to mammograms improved the performance of the AI models. In the high-concordance subset with transfer learning and CLAHE algorithm applied, the AUC of the GMIC model was highest (0.912), followed by GLAM model (0.909), I&H (0.893) and End2End (0.875). There were significant differences (P<0.05) in the performances of the four AI models between high-concordance subset and entire dataset. The AI models demonstrated significant differences in malignancy probability concerning different tumour size categories in mammograms. The performance of AI models was affected by several factors such as concordance classification, image enhancement and transfer learning. Mammograms with strong concordance of radiologists’ annotations, applying image enhancement and transfer learning could enhance the accuracy of AI models.

Landslide risk mitigation is limited by data scarcity. This could be improved using continuous landslide detection systems. In order to investigate which image types and machine learning (ML) models are most useful for landslide detection in a Norwegian setting, we compared the performance of five different ML models, for the Jølster case study (30-July-2019), in Western Norway. These included three globally pre-trained models; i) the Continuous Change Detection and Classification (CCDC) algorithm, ii) a combined k-means clustering and Random Forest classification model, and iii) a convolutional neural network (CNN), and two locally-trained models, including; iv) Classification and Regression Trees and v) a U-net CNN model. Images used included Sentinel-1, Sentinel-2, digital elevation model (DEM) and slope. The globally-trained models performed poorly in shadowed areas, and were all outperformed by the locally-trained models. A maximum Matthew’s correlation coefficient (MCC) score of 89% was achieved with model v, using combined Sentinel-1 and -2 images as input. This is one of the first attempts to apply deep-learning to detect landslides with both Sentinel-1 and -2 images. Using Sentinel-1 images only, the locally-trained deep-learning model significantly outperformed the conventional ML model. These findings contribute towards developing a national continuous monitoring system for landslides.

Recently, smart mobility intelligent traffic services have become a critical task in Intelligent Transportation Systems (ITS). This involves not only the use of advanced sensors and controllers but also the ability to respond to real-time traffic situations at intersections, alleviate congestion, and generate policies to prevent traffic jams. DRL (Deep Reinforcement Learning) provides a natural framework for processing tasks. In DRL, each intersection can control itself and coordinate with neighbors to achieve optimal network-wide policies. However, comparing approaches remains a challenging task due to the existence of numerous possible configurations. This research performs a critical comparison of various traffic controllers found in the literature. It demonstrates that using a nonlinear approximator for coordination mechanisms and enhancing observability at each intersection are key performance drivers.

Background: White matter hyperintensities (WMH), of presumed vascular origin, are visible and quantifiable neuroradiological markers of brain parenchymal change. These changes may range from damage secondary to inflammation and other neurological conditions, through to healthy ageing. Fully automatic WMH quantification methods are promising, but still, traditional semi-automatic methods seem to be preferred in clinical research. We systematically reviewed the literature for fully automatic methods developed in the last five years, to assess what are considered state-of-the-art techniques, as well as trends in the analysis of WMH of presumed vascular origin. Method: We registered the systematic review protocol with the International Prospective Register of Systematic Reviews (PROSPERO), registration number - CRD42019132200. We conducted the search for fully automatic methods developed from 2015 to July 2020 on Medline, Science direct, IEE Explore, and Web of Science. We assessed risk of bias and applicability of the studies using QUADAS 2. Results: The search yielded 2327 papers after removing 104 duplicates. After screening titles, abstracts and full text, 37 were selected for detailed analysis. Of these, 16 proposed a supervised segmentation method, 10 proposed an unsupervised segmentation method, and 11 proposed a deep learning segmentation method. Average DSC values ranged from 0.538 to 0.91, being the highest value obtained from an unsupervised segmentation method. Only four studies validated their method in longitudinal samples, and eight performed an additional validation using clinical parameters. Only 8/37 studies made available their method in public repositories. Conclusions: We found no evidence that favours deep learning methods over the more established k-NN, linear regression and unsupervised methods in this task. Data and code availability, bias in study design and ground truth generation influence the wider validation and applicability of these methods in clinical research.

In modern security situations, tracking multiple human objects in real-time within challenging urban environments is a critical capability for enhancing situational awareness, minimizing response time, and increasing overall operational effectiveness. Tracking multiple entities enables informed decision-making, risk mitigation, and the safeguarding of civil-military operations to ensure safety and mission success. This paper presents a multi-modal electro-optical/infrared (EO/IR) and radio frequency (RF) fused sensing (MEIRFS) platform for real-time human object detection, recognition, classification, and tracking in challenging environments. By utilizing different sensors in a complementary manner, the robustness of the sensing system is enhanced, enabling reliable detection and recognition results across various situations. Specifically designed Radar tag and thermal tag can be used to discriminate friendly and non-friendly objects. The system incorporates deep learning-based image fusion and human object recognition and tracking (HORT) algorithms to ensure accurate situation assessment. After integrating into an all-terrain robot, multiple ground tests were conducted to verify the consistent HORT in various environments. The MEIRFS sensor system has been designed to meet the Size, Weight, Power, and Cost (SWaP-C) requirements for installation on autonomous ground and aerial vehicles.

Stress has emerged as a major concern in modern society, significantly impacting human health and well-being. Statistical evidence underscores the extensive social influence of stress, especially in terms of work-related stress and associated healthcare costs. This work addresses the critical need for accurate stress detection, emphasising its far-reaching effects on health and social dynamics. Focusing on remote stress monitoring, this work proposes an efficient deep learning framework to discern stress from facial videos. In contrast to research on wearable devices, this paper investigates the application of *dl for stress detection based on *rppg. The methodology involves selecting suitable *dl models (*lstm, *gru, *1dcnn), optimising hyperparameters, and investigating augmentation techniques. 1D-CNNv1 model achieved the best performance compared to other approaches, particularly with augmentation techniques such as linear interpolation and white noise, achieving a stress classification accuracy of 95.83% while maintaining excellent computational efficiency. The experimental results demonstrate the use of *dl for stress detection based on *rppg, with the potential to make significant contributions to the international standard in the field.

We live in a complex world characterised by complex people, complex times, and complex social, technological, and ecological environments. There is clear evidence that governments are failing at most public matters. The recent COVID-19 pandemic is a high example of global governance failure both at preventing such pandemics and managing the COVID-19 pandemic. It is time that all of us take responsibility and look into ways of collaboratively improving the governance of public matters, our matters. While there are many reasons for government failures, we believe the lack of information availability is a fundamental reason that limits the government’s ability to act smartly and allows the lack of transparency to creep into policy and action leading to corruption and failure. To this end, this paper introduces the concept of deep journalism, a data-driven deep learning-based approach for discovering multi-perspective parameters related to a topic of interest. We build three datasets (a newspaper, a technology magazine, and a Web of Science dataset) and discover the academic, industrial, public, governance, and political parameters for the transportation sector as a case study to introduce deep journalism and our tool DeepJournal (Version 1.0) that implements our proposed approach. We elaborate on 89 transportation parameters and hundreds of dimensions reviewing 400 technical, academic, and news articles. The findings related to the multi-perspective view of transportation reported in this paper show that there are many important problems seen by the public that industry and academia seem to not place their focus on. On the other hand, academia produces much broader and deeper knowledge on the subject such as a wide range of pollutions affecting the people and planet do not get to reach the public eye. Our deep journalism approach could find the gaps and highlight them to the public and other stakeholders.

This paper explores the application of machine learning (ML) algorithms in predicting trends in the fixed bond market, where traditional analytical methods have proven inadequate. Focusing on various ML techniques such as supervised and unsupervised learning, neural networks, and deep learning, the study evaluates their effectiveness in forecasting market movements. It details a series of experiments in which different ML models are rigorously trained and tested against historical bond market data. The findings reveal that models employing time series analysis and advanced deep learning show marked potential in accurately predicting bond market trends. Additionally, the paper delves into the challenges and limitations inherent in these ML approaches, including data requirements and the risk of model overfitting. Finally, it proposes directions for future research, emphasizing the integration of ML into broader financial market analysis.

The coronavirus disease 2019 (COVID-19) is the fastest transmittable virus caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The detection of COVID-19 using artificial intelligence techniques and especially deep learning will help to detect this virus in early stages which will reflect in increasing the opportunities of fast recovery of patients worldwide. This will lead to release the pressure off the healthcare system around the world. In this research, classical data augmentation techniques along with CGAN based on a deep transfer learning model for COVID-19 detection in chest CT scan images will be presented. The limited benchmark datasets for covid-19 especially in chest CT images is the main motivation of this research. The main idea is to collect all the possible images for covid-19 that exists until the very writing of this research and use the classical data augmentations along with CGAN to generate more images to help in the detection of the COVID-19. In this study, five different deep convolutional neural network-based models (AlexNet, VGGNet16, VGGNet19, GoogleNet, and ResNet50) have been selected for the investigation to detect the coronavirus infected patient using chest CT radiographs digital images. The classical data augmentations along with CGAN improve the performance of classification in all selected deep transfer models. The Outcomes show that ResNet50 is the most appropriate deep learning model to detect the COVID-19 from limited chest CT dataset using the classical data augmentation with testing accuracy of 82.91%.

The coronavirus (covid-19) pandemic is putting healthcare systems across the world under unprecedented and increasing pressure according to the World Health Organization (WHO). With the advances in computer algorithms and especially Artificial Intelligence, the detection of this type of virus in the early stages will help in fast recovery and help in releasing the pressure off healthcare systems. In this paper, a GAN with deep transfer learning for coronavirus detection in chest x-ray images is presented. The lack of benchmark datasets for covid-19 especially in chest x-rays images is the main motivation of this research. The main idea is to collect all the possible images for covid-19 that exists until the writing of this research and use the GAN network to generate more images to help in the detection of the virus from the available x-rays images with the highest accuracy possible. The dataset used in this research was collected from different sources and it is available for researchers to download and use it. The number of images in the collected dataset is 307 images for four different types of classes. The classes are the covid-19, normal, pneumonia bacterial, and pneumonia virus. The dataset is divided into 90% for the GAN and the training and the validation phase, while 10% used in the testing phase. The GAN helps in generating more images from the original dataset to be 30 times larger than the originally collected dataset. The GAN also help in overcoming the overfitting problem and made the proposed model more robust. Three deep transfer models are selected in this research for investigation. The models are the Alexnet, Googlenet, and Restnet18. Those models are selected based on their small number of layers on their architectures, which will reflect in reducing the complexity of the models and the consumed memory and time. Using a combination of GAN and deep transfer models prove it is efficiency according to validation, testing accuracy, and performance measurements such as precision, recall, and F1 score. Three case scenarios are tested through the paper, the first scenario which includes 4 classes from the dataset, while the second scenario includes 3 classes and the third scenario includes 2 classes. All the scenarios include the covid-19 class as it is the main target of this research to be detected. In the first scenario, the Googlenet is selected to be the main deep transfer model as it achieves 80.6% in testing accuracy. In the second scenario, the Alexnet is selected to be the main deep transfer model as it achieves 85.2% in testing accuracy, while in the third scenario which includes 2 classes(covid-19, and normal), Googlenet is selected to be the main deep transfer model as it achieves 100% in testing accuracy and 99.9% in the validation accuracy. All the performance measurement strengthen the obtained results through the research. Finally, this research may be considered one of the first trails to use GAN and deep transfer models together to help in detecting coronaviruses (covid-19) within the absence of a benchmark dataset around the world, especially in x-rays chest images.

Building energy consumption plays an essential role in urban sustainability. The prediction of the energy demand is also of particular importance for developing smart cities and urban planning. Machine learning has recently contributed to the advancement of methods and technologies to predict demand and consumption for building energy systems. This paper presents a state of the art of machine learning models and evaluates the performance of these models. Through a systematic review and a comprehensive taxonomy, the advances of machine learning are carefully investigated and promising models are introduced.

This paper presents a proposal for a non-isolated bidirectional converter (NIBC) controlled by a deep neural network (DNN) to enable vehicle-to-vehicle (V2V) and vehicle-to-grid (V2G) charging, which contributes to the development of more efficient and sustainable transportation and energy systems. The DNN controller manages power flow in both directions, making it possible to charge electric vehicles (EVs) and discharge power from EVs to the grid with improved efficiency and performance compared to traditional control methods. The non-isolated topology used in this proposal offers several benefits, including reduced cost, smaller size, and higher efficiency. To train the DNN controller, a large dataset of simulations was used, and the results were validated with a hardware setup. The real-time performance of the DNN controller was compared to a proportional-integral (PI) based controller through simulated results. The findings of the study show that the DNN controller outperforms traditional PI controllers.

Industrial radiography is a pivotal non-destructive testing (NDT) method that ensures quality and safety in a wide range of industrial sectors. Conventional human-based approaches, however, are prone to challenges in defect detection accuracy and efficiency, primarily due to the high inspection demand from manufacturing industries with high production throughput. To solve this challenge, numerous computer-based alternatives have been developed, including Auto-mated Defect Recognition (ADR) using deep learning algorithms. At the core of training, these algorithms demand large volumes of data that should be representative of real-world cases. However, the availability of digital X-ray radiography data for open research is limited by non-disclosure contractual terms in the industry. This study presents a pipeline that is capable of modeling synthetic images based on statistical information acquired from X-ray intensity distribution from real digital X-ray radiography images. Through meticulous analysis of the intensity distribution in digital X-ray images, the unique statistical patterns associated with the exposure conditions used during image acquisition, type of component, thickness variations, beam divergence, anode heel effect, etc., are extracted. The realized synthetic images were utilized to train deep learning models, yielding an impressive model performance with mean intersection over union (IoU) of 0.93, and mean dice coefficient of 0.96, on real unseen digital X-ray radiography images. This methodology is scalable and adaptable, making it suitable for diverse industrial applications.

This multi-center retrospective study evaluated the diagnostic performance of a deep learning (DL)-based application for detecting, classifying, and highlighting suspected aortic dissections (ADs) on chest and thoraco-abdominal CT angiography (CTA) scans. CTA scans from over 200 U.S. and European cities acquired on 52 scanner models from 6 manufacturers were retrospectively collected and processed by CINA-CHEST (AD) (Avicenna.AI, La Ciotat, France) device. The di-agnostic performance of the device was compared with the ground truth established by the majority agreement of three US board-certified radiologists. Furthermore, the DL-algorithm's time-to-notification was evaluated to demonstrate clinical effectiveness. The study included 1,303 CTAs (mean age 58.8 ± 16.4 years old, 46.7% male, 10.5% positive). The device demonstrated a sensitivity of 94.2% [95% CI: 88.8% – 97.5%] and a specificity of 97.3% [95% CI: 96.2% - 98.1%]. The application classified positive cases by AD types with an accuracy of 99.5% [95% CI: 98.9% – 99.8%] for type A and 97.5 [95% CI: 96.4% – 98.3%] for type B. The application did not miss any type A cases. The device flagged 32 cases incorrectly, primarily due to acquisition artefacts and aortic pathologies mimicking AD. The mean time to process and notify of potential AD cases was 27.9 ± 8.7 seconds. This deep learning-based application demonstrated strong performance in detecting and classifying aortic dissection cases, potentially enabling faster triage of these urgent cases in clinical settings.

Magnetic resonance (MR) image acquisitions are usually time-consuming, limiting utilization in neuroimaging. For multiple sclerosis (MS) patients, MR imaging plays a major role in drug therapy decision-making. The purpose of this study was to evaluate whether an ultrafast, T2-weighted (T2w), deep-learning-enhanced (DL), echo-planar-imaging-based (EPI) fluid-attenuated inversion recovery (FLAIR) sequence (FLAIRUF) that has been targeting neurological emergencies so far might even be an option to detect MS lesions of the brain compared to conventional FLAIR sequences. Therefore, 17 MS patients were enrolled prospectively in this exploratory study. Standard MR protocols and ultrafast acquisitions were conducted at 3 tesla (T), including three-dimensional (3D)-FLAIR, turbo/fast spin echo (TSE)-FLAIR, and FLAIRUF. Inflammatory lesions were grouped by size and location. Lesion conspicuity and image quality were rated on an ordinal five-point Likert scale, and lesion detection rates were calculated. Statistical analyses were performed to compare results. Altogether, 568 different lesions were found. Data indicated no significant differences in lesion detection (sensitivity and positive predictive value [PPV]) between FLAIRUF and axially reconstructed 3D-FLAIR (lesion size ≥ 3 mm × ≥ 2 mm) and no differences in sensitivity between FLAIRUF and TSE-FLAIR (lesion size ≥ 3 mm total). Lesion conspicuity in FLAIRUF was similar in all brain regions except for superior conspicuity in the occipital lobe and inferior conspicuity in central brain regions. Further findings include location-dependent limitations of signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) as well as artifacts such as spatial distortions in FLAIRUF. In conclusion, FLAIRUF could potentially be an expedient alternative to conventional methods for brain imaging in MS patients since the acquisition can be performed in a fraction of time while maintaining good image quality.

Imaging systems mounted to ground vehicles are used to image fruit tree canopies for estimation of fruit load, but frequently need correction for fruit occluded by branches, foliage or other fruits. This can be achieved using an orchard ‘occlusion factor’, estimated from a manual count of fruit load on a sample of trees (referred to as the reference method). It was hypothesised that canopy images could hold information related to the number of occluded fruit. Five approaches to correct for occluded fruit based on canopy images were compared using data of three mango orchards in two seasons. However, no attribute correlates to the number of hidden fruit were identified. Several image features obtained through segmentation of fruit and canopy areas, such as the proportion of fruit that were partly occluded, were used in training Random forest and multi-layered perceptron (MLP) models for estimation of a correction factor per tree. In another approach, deep learning convolutional neural networks (CNNs) were directly trained against harvest fruit count on trees. The supervised machine learning methods for direct estimation of fruit load per tree delivered an improved prediction outcome over the reference method for data of the season/orchard from which training data was acquired. For a set of 2017 season tree images (n=98 trees), a R2 of 0.98 was achieved for the correlation of the number of fruits predicted by a Random forest model and the ground truth fruit count on the trees, compared to a R2 of 0.68 for the reference method. The best prediction of whole orchard (n = 880 trees) fruit load, in the season of the training data, was achieved by the MLP model, with an error to packhouse count of 1.6% compared to the reference method error of 13.6%. However, the performance of these models on new season data (test set images) was at best equivalent and generally poorer than the reference method. This result indicates that training on one season of data was insufficient for the development of a robust model. This outcome was attributed to variability in tree architecture and foliage density between seasons and between orchards, such that the characters of the canopy visible from the interrow that relate to the proportion of hidden fruit are not consistent. Training of these models across several seasons and orchards is recommended.

The ever-evolving ways attacker continues to im prove their phishing techniques to bypass existing state-of-the-art phishing detection methods pose a mountain of challenges to researchers in both industry and academia research due to the inability of current approaches to detect complex phishing attack. Thus, current anti-phishing methods remain vulnerable to complex phishing because of the increasingly sophistication tactics adopted by attacker coupled with the rate at which new tactics are being developed to evade detection. In this research, we proposed an adaptable framework that combines Deep learning and Randon Forest to read images, synthesize speech from deep-fake videos, and natural language processing at various predictions layered to significantly increase the performance of machine learning models for phishing attack detection.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Deep Learning (DL) and Machine Learning (ML) are widely used in many fields, but rarely used in Frequency Estimation (FE) and Slope Estimation (SE) of signals. Frequency and slope estimation for Frequency-Modulated (FM) and single-tone sinusoidal signals are essential in various applications, such as wireless communications, sonar, and radar measurements. In this work, artificial neural network (ANN) and convolutional neural network (CNN) are used in frequency and slope estimation for FM signals under Additive White Gaussian Noise (AWGN) and Additive Symmetric alpha Stable Noise (SαSN). SαS distributions are impulsive noise disturbances found in many communication environments like marine systems; their distribution lacks a closed-form Probability Density Function (PDF), except for specific cases, and infinite second-order statistic, hence Geometric SNR (GSNR) is used in this work to determine the impulsiveness of noise in a mixture of Gaussian and SαS noise processes. ANN is a machine learning classifier, designed with few layers for reducing FE and SE complexity while getting higher accuracy as compared with classical techniques. CNN is a deep learning classifier, designed with many layers for FE and SE, and proved to be more accurate than ANN when dealing with big data and finding optimal features. Simulation results show that SαS noise can be much more harmful for FE and SE of FM signals than Gaussian noise. DL and ML can significantly reduce FE complexity, memory cost, and power consumption, which is important in many systems such as some Internet of Things (IoT) sensor applications. After training DCNN for frequency and slope estimation of LFM signals, the performance of DCNN (in terms of accuracy) can give acceptable results at very low signal-to-noise ratios where TFD fails, giving more than 20dB difference in the GSNR working range.

The aim of this research is to expand recent developments in the mapping of pasture yield with remotely piloted aircraft systems to that of satellite-borne imagery. Up to date, spatially explicit and accurate information of the pasture resource base is needed for improved climate-adapted livestock rangeland grazing. This study developed deep learning predictive models of pasture yield, as total standing dry matter in tonnes per hectare (TSDM(tha−1)), from field measurements and both remotely piloted aircraft systems and satellite imagery. Repeated remotely piloted aircraft system structure measurements derived from structure from motion photogrammetry, provided measures of pasture biomass from many overlapping high-resolution images. Repeated remotely piloted aircraft system measures throughout a growing season, were modelled with persistent photosynthetic pasture responses from various Planet Dove high spatial resolution satellite image-derived vegetation indices. Pasture height modelling as an input to the modelling of yield was assessed against terrestrial laser scanning and reported correlation coefficients (R2) from 0.3 to 0.8 for both a coastal grassland and inland woodland pasture. Accuracy of the predictive modelling from both the remotely piloted aircraft system and the Planet Dove satellite image estimates of pasture yield ranged from 0.8 to 1.8 TSDM(tha−1). These results indicated that the practical application of repeated remotely piloted aircraft system derived measures of pasture yield can, with some limitations, be scaled-up to satellite-borne imagery to provide more temporally and spatially explicit measures of the pasture resource base.

The rising severity and frequency of wildfires in recent years in the United States have raised numerous concerns regarding the improvement in wildfire emergency response management and decision-making systems, which require operational high temporal and spatial resolution monitoring capabilities. Satellites are one of the tools that can be used for wildfire monitoring. However, none of the currently available satellite systems provide both high temporal and spatial resolution. For example, GOES-17 geostationary satellite fire products have high temporal (1-5 min) but low spatial resolution (2 km), and VIIRS polar orbiter satellite fire products have low temporal (~12 h) but high spatial resolution (375 m). This work aims to leverage currently available satellite data sources, such as GOES and VIIRS, along with Deep Learning (DL) advances to achieve an operational high-resolution, both spatially and temporarily, wildfire monitoring tool. Specifically, this study considers the problem of increasing the spatial resolution of high temporal but low spatial resolution GOES-17 data products using low temporal but high spatial resolution VIIRS data products. The main idea is using an Autoencoder DL model to learn how to map GOES-17 geostationary low spatial resolution satellite images to VIIRS polar orbiter high spatial resolution satellite images. In this context, several loss functions and DL architectures are implemented and tested to predict both the fire area and the corresponding brightness temperature. These models are trained and tested on wildfire sites from 2019 to 2021 in the western U.S. The results indicate that DL models can improve the spatial resolution of GOES-17 images, leading to images that mimic the spatial resolution of VIIRS images. Combined with GOES-17 higher temporal resolution, the DL model can provide high-resolution near-real-time wildfire monitoring capability as well as semi-continuous wildfire progression maps.

Downward short-wave (SW) solar radiation is the only essential energy source powering the atmospheric dynamics, ocean dynamics, biochemical processes, etc. on our planet. Clouds are the main factor limiting the SW flux over the land and the Ocean. For the accurate meteorological measurements of the SW flux one needs expensive equipment - pyranometers. For some cases where one does not need golden-standard quality of measurements, we propose estimating incoming SW radiation flux using all-sky optical RGB imagery which is assumed to incapsulate the whole information about the SW flux. We used DASIO all-sky imagery dataset with corresponding SW downward radiation flux measurements registered by an accurate pyranometer. The dataset has been collected in various regions of the World Ocean during several marine campaigns from 2014 to 2022, and it will be updated. We demonstrate the capabilities of several machine learning models in this problem, which are multilinear regression, Random Forests, Gradient Boosting and convolutional neural networks (CNN). We also applied the inverse target frequency (ITF) re-weighting of the training subset and the approach of pre-classification in order to raise the SW flux approximation quality. We found that the CNN is capable of approximating downward SW solar radiation with higher accuracy compared to existing empiric parameterizations. We also found that the ITF reweighting of the training subset increases the approximation quality substantially. The estimates of the SW radiation flux using all-sky imagery may be of particular use in case of the need for the fast radiative budgets assessment of a site.

“You should know the words by the company they keep!” has been one of the most famous slogans attributed to John Rubert Firth, 1957. This has ignited a whole school in linguistic research known as the British empiricist contextualism. Sixty years later, many un- or semi-supervised machine learning algorithms have been successfully designed and implemented aiming at extracting word meaning from within the context of a text corpus. These algorithms treat words, more or less, as vectors of real numbers representing frequencies of word occurrences within context and word meaning as positions of words in a high-dimensional vector space model. Word associations, in turn, are treated as calculated distances among them. With the rise of Deep Learning (DL) and other artificial neural networks based architectures, learning the positioning of words and extracting word associations as measured by their distances has further improved. In this paper, however, we revisited the main stream of algorithmic approaches and set the stage for a partly cross-disciplinary evaluation framework to judge about the nature of the extracted word associations by state-of-the-art machine learning algorithms. Our preliminary results are based on word associations extracted from the application of DL framework on a Google News text corpus, as well as on comparisons with human created word association lists such as word collocation dictionaries and psycholinguistic experiments. The results and conclusions provide some insights into the inherited limitations in interpreting the type of word associations and underpinning relations between words with inevitable consequences in other areas, such as extraction of knowledge graphs or image understanding.

Over a billion people around the world are disabled, among them, 253 million are visually impaired or blind, and this number is greatly increasing due to ageing, chronic diseases, poor environment, and health. Despite many proposals, the current devices and systems lack maturity and do not completely fulfill user requirements and satisfaction. Increased research activity in this field is required to encourage the development, commercialization, and widespread acceptance of low-cost and affordable assistive technologies for visual impairment and other disabilities. This paper proposes a novel approach using a LiDAR with a servo motor and an ultrasonic sensor to collect data and predict objects using deep learning for environment perception and navigation. We adopted this approach in a pair of smart glasses, called LidSonic V2.0, to enable the identification of obstacles for the visually impaired. The LidSonic system consists of an Arduino Uno edge computing device integrated into the smart glasses and a smartphone app that transmits data via Bluetooth. Arduino gathers data, operates the sensors on smart glasses, detects obstacles using simple data processing, and provides buzzer feedback to visually impaired users. The smartphone application collects data from Arduino, detects and classifies items in the spatial environment, and gives spoken feedback to the user on the detected objects. In comparison to image processing-based glasses, LidSonic uses far less processing time and energy to classify obstacles using simple LiDAR data, according to several integer measurements. We comprehensively describe the proposed system's hardware and software design, construct their prototype implementations, and test them in real-world environments. Using the open platforms, WEKA and TensorFlow, the entire LidSonic system is built with affordable off-the-shelf sensors and a microcontroller board costing less than $80. Essentially, we provide designs of an inexpensive, miniature, green device that can be built into, or mounted on, any pair of glasses or even a wheelchair to help the visually impaired. Our approach affords faster inference and decision-making using relatively low energy with smaller data sizes as well as faster communications for the edge, fog, and cloud computing.

Photovoltaic (PV) systems, which are renewable energy sources, are increasingly being utilized in distributed generation. To maintain a stable energy balance, energy storage systems such as batteries (BAT) play a vital role. Electric vehicles (EVs) offer a promising solution with rechargeable battery systems for operation. The BATs must maintain their state of charge within design boundaries, despite intermittent PV and load power fluctuations, and advanced power control and management techniques are essential for their effective operation. The article evaluates an intelligent controller that uses a Sliding Mode Control adaptive deep learning algorithm Convolutional Neural Networks (SMC-CNN) and a unique Strategy for managing supervisory power. (SPMS) for photovoltaic systems with battery energy storage for better regulation of DC bus voltage. SMC-CNN offers exceptional resilience and seamless functionality, minimizing fluctuations in DC bus voltage in the control strategy design requirements. The primary goals are maintaining a consistent power supply and ensuring continuous service by preventing system components from exceeding capacity. This study aims to enhance the control of DC bus voltage in the PV and battery system, with the primary significance focusing on the following aspects. The advanced SPMS has been created, incorporating control system constraints to enhance SOC balancing speed and reduce fluctuations in DC bus voltage. Power flow management involves optimizing energy flow between the PV system, battery system, and load while minimizing battery capacity requirements. The proposed SMC-CNN and SPMS are demonstrated through real-time simulation using Matlab/Simulink, as demonstrated in comprehensive case studies.

"Deep fake" technologies are often associated with face-swapping algorithms based on images or videos. Although much research is focused on developing these techniques, there is still room for improvement, especially in human and visual assessment. In this study, we present an innovative approach to the problem of face replacement based on one model while preserving background features. Our model uses the Adaptive Attentional Denormalization method from FaceShifter while integrating identity features from the ArcFace and BiSeNet models to support the attribute extraction process. We used Fast GAN as a generative model to optimize and accelerate the training process on smaller data sets. Our research proves the effectiveness of the proposed approach by combining innovative methods and architectures in one coherent solution.

In the evolving landscape of Portfolio Management (PM), the fusion of advanced machine 1 learning techniques with traditional financial methodologies has opened new avenues for innovation. 2 Our study introduces a cutting-edge model combining Deep Reinforcement Learning (DRL) with 3 a Non-stationary Transformer architecture. This model is specifically designed to decode complex 4 patterns in financial time series data, enhancing portfolio management strategies with deeper insights 5 and robustness. It effectively tackles the challenges of data heterogeneity and market uncertainty, 6 key obstacles in PM. Our approach integrates key macroeconomic indicators and targeted news 7 sentiment analysis into its framework, capturing a comprehensive picture of market dynamics. This 8 amalgamation of varied data types addresses the multifaceted nature of financial markets, enhancing 9 the model’s ability to navigate through the complexities of asset management. Rigorous testing 10 demonstrates the model’s efficacy, highlighting the benefits of blending diverse data sources and 11 sophisticated algorithmic approaches in mastering the nuances of PM.12

: Mistrust, amplified by numerous artificial intelligence (AI) related incidents, has caused the energy and industrial sectors to be amongst the slowest adopter of AI methods. Central to this issue is the black-box problem of AI, which impedes investments and fast becoming a legal hazard for users. Explainable AI (XAI) is a recent paradigm to tackle this challenge. Being the backbone of the industry, the prognostic and health management (PHM) domain has recently been introduced to XAI. However, many deficiencies, particularly lack of explanation assessment methods and uncertainty quantification, plague this young field. In this paper, we elaborate a framework on explainable anomaly detection and failure prognostic employing a Bayesian deep learning model to generate local and global explanations from the PHM tasks. An uncertainty measure of the Bayesian model is utilized as marker for anomalies expanding the prognostic explanation scope to include model’s confidence. Also, the global explanation is used to improve prognostic performance, an aspect neglected from the handful of PHM-XAI publications. The quality of the explanation is finally examined employing local accuracy and consistency properties. The method is tested on real-world gas turbine anomalies and synthetic turbofan data failure prediction. Seven out of eight of the tested anomalies were successfully identified. Additionally, the prognostic outcome showed 19% improvement in statistical terms and achieved the highest prognostic score amongst best published results on the topic.

Through the development of the metaverse concept from the Sumerian myth (5500 - 1800 BC) and mind-altering novel, “Snow Crash” in 1992, to today’s information age, human- and society-centred urban metaverse worlds, an extension of residents and urban society where the virtual and the physically real blend and are more organically integrated, are meant to mirror the fabric of urban life with no harm to their residents. The success of urban metaverse cybercommunities depends on the quality of data-driven Smart City (SC) Digital Twins (DTs), the seamless exchange of data between cyber and physical worlds (e.g. between residents and their counterpart “Avatars’’) and the processing of the data effectively and efficiently with no vicious interventions. The potential risks in this ecosystem that incorporates Web3 can be extremer than the ones in Web2 since users are immersed with multiple tightly coupled wearable sensor-rich devices perceiving the blend of the real and the virtual with possible imminent negative experiences. This study, by analysing potential cyberthreats in the urban metaverse cyberspaces, proposes a blockchain-based Decentralised Privacy-Preserving Machine Learning (DPPML) authentication and verification technique, which uses the metaverse immersive devices and can be instrumented effectively against identity impersonation and theft of credentials, identity, or avatars.

Byers Peninsula is considered one of the largest ice-free areas in Maritime Antarctica. Since 2006, the Spanish Polar Program has taken part in a large number of environmental studies involving effects of climate changes in lives cycles, limnology and microbiology. Soils from maritime Antarctica are generally weakly developed and have chemical, physical and morphological characteristics strongly influenced by the parent material. However, biological activity during the short Antarctic summer promotes intense transference of nutrients and organic matter in areas occupied by different species of birds and marine mammals. To mapping and monitoring those areas with high biological occupation, could be very useful to have models of edaphic properties prepared from satellite images. In this approach, Deep Learning and Linear Regression models of soil properties and spectral indexes as explicative variables were performed. We training models of soil properties closely related to biological activity such as Dissolved Organic Carbon (DOC) and the iron fraction associated with organic matter (Fe). We tested the best approach to model the spatial distribution of DOC, Fe and pH by training models of Linear Regression and Deep Learning over Sentinel2 and WorldView2 images. The most robust models were used to track possible areas with ornithogenic soils as well as areas of the Byers Peninsula that could support the highest biological development.

Background: Processing whole-slide images (WSI) to train neural networks can be intricate and laborious. We developed an open-source library covering recurrent tasks in processing of WSI and in evaluating the performance of the trained networks for classification tasks. Methods: Two histopathology use-cases were selected. First we aimed to train a CNN to distinguish H&E-stained slides obtained from neuropathologically classified low-grade epilepsy-associated dysembryoplastic neuroepithelial tumor (DNET) and ganglioglioma (GG). The second project we trained a convolutional neural network (CNN) to predict the hormone expression of pituitary adenoms only from hematoxylin and eosin (H&E) stained slides. In the same approach, we addressed the issue to also predict clinically silent corticotroph adenoma. We included four clinico-pathological disease conditions in a multilabel approach. Results: Our best performing CNN achieved an area under the curve (AUC) of 0.97 for the receiver operating characteristic (ROC) for corticotroph adenoma, 0.86 for silent corticotroph adenoma and 0.98 for gonadotroph adenoma. Our DNET-GG classifier achieved an AUC of 1.00 for the ROC curve. All scores were calculated with the help of our library on predictions on a case basis. Conclusions: Our comprehensive library is most helpful to standardize the work-flow and minimize the work-burden in training CNN. It is also compatible with fastai. Indeed, our new CNNs reliably extracted neuropathologically relevant information from the H&E staining only. This approach will supplement the clinico-pathological diagnosis of brain tumors, which is currently based on cost-intense microscopic examination and variable panels of immunohistochemical stainings.

In recent years, demand has been increasing for target detection and tracking from aerial imagery via drones using onboard powered sensors and devices. We propose a very effective method for this application based on a deep learning framework. A state-of-art embedded hardware system empowers small flying robots to carry out the real-time onboard computation necessary for object tracking. Two types of embedded modules were developed: one is designed using a Jetson TX or AGX Xavier, and the other is based on an Intel Neural Compute Stick. These are suitable for real-time onboard computing power on small flying drones with limited space. A comparative analysis of current state-of-art deep-learning-based multi-object detection algorithms was carried out utilizing the designated GPU-based embedded computing modules to obtain detailed metric data about frame rates as well as the computation power. We also introduce an effective target tracking approach for moving objects. The algorithm for tracking moving objects is based on the extension of simple online and real-time tracking. It was developed by integrating a deep-learning-based association metric approach (Deep SORT), which uses a hypothesis tracking methodology with Kalman filtering and a deep-learning-based association metric. In addition, a guidance system that tracks the target position using a GPU-based algorithm is introduced. Finally, we demonstrate the effectiveness of the proposed algorithms by real-time experiments with a small multi-rotor drone.

Physics-informed neural networks can be trained to serve as surrogate models by learning how spatial physical fields develop with change of parameters. This is an advantage over traditional numerical methods that can only be used to calculate a single solution field for a single discrete setting of a parameter. While many studies report accurate results of physics-informed deep learning of laminar flows, evaluations of surrogate modeling of high Reynolds number flows remain sparse. To contribute to this question, we here explore the capabilities and limits of physics-informed deep learning to solve the Reynolds-averaged Navier-Stokes equations for the flow around two airfoils under variable angles of attack. No labeled training data were provided and a single network was trained to simultaneously learn several solution fields in a single training run. The network captured essential flow features such as boundary layers and high and low pressure regions. Moreover, the qualitative correlations of lift and drag with the angle of attack and the higher drag of the thicker airfoil were captured. However, comparisons with reference simulations revealed an underestimation of the shear layer gradients as well as deviations of the fields' extrema. Thus, we also debate potential future improvements to increase the accuracy of the predicted flow. This work offers a prospect on the capabilities and current limitations of physics-informed neural networks for surrogate modeling of high Reynolds number flows. We argue that the method is promising and this work is aimed to encourage further research and development of the method when applied to Reynolds-averaged flows at high Reynolds numbers.

The sustainability of the planet and its inhabitants is in dire danger and is among the highest priorities on global agendas such as the Sustainable Development Goals (SDGs) of the United Nations (UN). Solar energy -- among other clean, renewable, and sustainable energies -- is seen as essential for environmental, social, and economic sustainability. Predicting solar energy accurately is critical to increasing reliability and stability, and reducing the risks and costs of the energy systems and markets. Researchers have come a long way in developing cutting-edge solar energy forecasting methods. However, these methods are far from optimal in terms of their accuracies, generalizability, benchmarking, and other requirements. Particularly, no single method performs well across all climates and weathers due to the large variations in meteorological data. This paper proposes SENERGY (an acronym for Sustainable Energy), a novel deep learning-based auto-selective approach and tool that, instead of generalising a specific model for all climates, predicts the best performing deep learning model for GHI forecasting in terms of forecasting error. The approach is based on carefully devised deep learning methods and feature sets through an extensive analysis of deep learning forecasting and classification methods using ten meteorological datasets from three continents. We analyse the tool in great detail through a range of metrics and methods for performance analysis, visualization, and comparison of solar forecasting methods. SENERGY outperforms existing methods in all performance metrics including Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Forecast Skills (FS), Relative Forecasting Error, and the normalised versions of these metrics. The proposed auto-selective approach can be extended to other research problems such as wind energy forecasting and predict forecasting models based on different criteria (in addition to the minimum forecasting error used in this paper) such as the energy required or speed of model execution, different input features, different optimisations of the same models, or other user preferences.

Despite the increasing role of machine learning in various fields, very few works considered artificial intelligence for frequency estimation (FE). This work presents a comprehensive analysis of deep-learning (DL) approach for frequency estimation of single-tones. It is shown that DL network with two layers having a few nodes can estimate frequency more accurately than well-known classical techniques. The study is comprehensive, filling gaps of existing works, where it analyzes error under different signal-to-noise ratios, numbers of nodes, and numbers of input samples; also, under missing SNR information. It is found that DL-based FE is not significantly affected by SNR bias or number of nodes. DL-based approach can work properly using minimal number of input nodes N at which classical methods fail. It is possible for DL to use as little as two layers with two or three nodes each, with complexity of O{N} versus O{Nlog2 (N)} for DFT-based FE, noting that less N is required for DL. Hence, DL can significantly reduce FE complexity, memory, cost, and power consumption, making DL-based FE attractive for resource-limited systems like some IoT sensor applications. Also, reduced complexity opens the door for hardware-efficient implementation using short word-length (SWL) or time-efficient software-defined radio (SDR) communications.

Deep networks-based hashing has gained significant popularity in recent years, particularly in the field of image retrieval. However, most existing methods only focus on extracting semantic information from the final layer, disregarding valuable structural information that contains important semantic details crucial for effective hash learning. To address this limitation and improve image retrieval accuracy, we propose a novel deep hashing method called Deep Supervised Hashing by Fusing Multiscale Deep Features (DSHFMDF). Our approach involves extracting multiscale features from multiple convolutional layers and fusing them to generate more robust representations for efficient image retrieval. Experimental results on CIFAR10 and NUS-WIDE datasets demonstrate that our method surpasses the performance of state-of-the-art hashing techniques.

Groundwater is the most extracted raw material in the world with global annual withdrawal rates of 800–1500 km3/year. In East and Southern Africa, 70 % of the population are reliant on shallow groundwater as their primary drinking water source. With increased population growth, intensification of agriculture and industrialization, conflicting demands on groundwater present a challenge to achieve the Sustainable Development Goals (6,3,11,12,15). Between 2015 and 2018, the Horn of Africa was affected by a series of climatic induced events, namely El Nino, La Nina and the Indian Ocean Diopole. These events modified the variability of rainfall patterns and resulted in long periods of low rainfall, low recharge and high evapotranspiration. As a result, shallow aquifers in alluvial deposits of Somali region have low yields and produce brackish and saline water. That situation prompted humanitarian water professionals to finance the transportation of water from selected locations with high groundwater potential through water trucks to areas facing groundwater depletion and drought. To address this challenge, UNICEF explored alternative, sustainable deeper groundwater sources that could be extracted using solar water pumping technology for multi water use. This paper describes a three-phase methodology of deep groundwater development of wells in the Ogaden Jesoma sandstone aquifers of the Somali region of the Horn of Africa to a depth of 600 meters below ground level. The results concluded that the deep sandstone aquifer of Jesoma can provide fresh water with yields of 15 l/s to the local population of Somali region. to the study provided insights into deep groundwater identification and development as well as adaptive deep boreholes drilling as a source for climate resilient water supplies.

When training deep neural networks tasks, the most popular choices are cross-entropy loss. On the other hand, in general speaking, a decent loss function can take on shapes that are considerably more flexible and ought to be adapted for different activities and datasets. In most of the classification tasks, generally if the true class is not correctly recognized by the network (top1), that class is placed among the five classes with the highest probability (top5). This shows that the network does not necessarily recognize the correct class with a low probability, but a class similar to it (such as 3 vs. 8 in mnist) assigns a higher probability and this causes a mistake in that task. Accordingly, we proposed a loss function deals with the error of class that the neural network incorrectly recognized as correct, in addition to the correct class error. We call our proposed loss as False Positive Loss (FPL), with the intention of viewing and designing loss functions not only through the utilization of true class but also through the utilization of the value of false positive classes. One of the core properties of our proposed loss is full adaptability, which makes False Positive Loss be fully capable of getting reformulated by using other widely used loss functions formulas based on the task or the need of the users. Extensive experimental results demonstrate that our suggested loss function outperforms other well-known losses on a variety of tasks and datasets. As can be observed, the performance of our False Positive Loss is superior to that of the cross-entropy loss when it comes to tasks involving 2D picture classification. We have compared our loss with cross entropy as the most common classification loss function on some models (such as ResNet-18, ResNet-50 and Efficientnet-V2) through classification known as a basic computer vision task. with both random or pre-trained initial weights. As a result, in some cases the models with our loss outperform the same tasks with cross entropy from the viewpoint of some metric (i.e. accuracy and FP). For example, the resnet-50 on cifar-10 dataset with random initialization indicated a top1 accuracy of 94.93 with cross entropy and 95.25 with our loss, while for top5 accuracy the results are 99.86 and 99.87, respectively.

We study the brain segmentation by dividing the brain into multiple tissues. Given possible brain segmentation by deep, machine learning can be efficiently exploited to expedite the segmentation process in the clinical practice. To accomplish segmentation process, a MRI and tissues transfer using generative adversarial networks is proposed. Given the better result, we propose the transfer model using GAN. For the case of the brain tissues, white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF) are segmented. Empirical results show that this proposed model significantly improved segmentation results compared to the stat-of-the-art results. Furthermore, a dice coefficient (DC) metric is used to evaluate the model performance.

Electricity demand prediction is vital for energy production management and proper exploitation of the present resources. Recently, several novel machine learning (ML) models have been employed for electricity demand prediction to estimate the future prospects of the energy requirements. The main objective of this study is to review the various ML models applied for electricity demand prediction. Through a novel search and taxonomy, the most relevant original research articles in the field are identified and further classified according to the ML modeling technique, perdition type, and the application area. A comprehensive review of the literature identifies the major ML models, their applications and a discussion on the evaluation of their performance. This paper further makes a discussion on the trend and the performance of the ML models. As the result, this research reports an outstanding rise in the accuracy, robustness, precision and the generalization ability of the prediction models using the hybrid and ensemble ML algorithms.

This study focuses on examining various approaches for Tensor Decompositions (TDs) and their potential applications in satellite imaging (SI) and deep learning (DL). The research highlights how these decompositions can contribute to the advancement of SI and DL, providing valuable insights for future utilization of TDs in research. It explores how these techniques contribute to the advancement of SI and DL methods, providing insights into their potential applications and suggesting future research directions. The study aims to enhance the use of TDs techniques to further advance research efforts in these fields. More importantly, the current investigation offers a thorough analysis of the potential advantages and reasons for employing TDs techniques in different domains, including satellite imaging and deep learning. The aim is to enhance research outcomes by utilizing TDs. The review also identifies unresolved issues and proposes future directions for further investigation in this field. Fundamentally, these proposed open problems will open new grounds to the research community to articulate, innovate, and provide more real-life applications to improve the current state of the art by delving into a wider vision for a higher-level performance of both satellite imaging (SI) and deep learning (DL). Looking at the bigger scenario, this also suggests that TDs could be potentially employed to revolutionize existing machine learning technologies as well as the current space AI industry.

Deep learning, specifically the supervised approach, has proved to be a breakthrough in depth prediction. However, the generalization ability of deep networks is still limited, and they cannot maintain a satisfactory performance on some inputs. Addressing a similar problem in the segmentation field, a scheme (f-BRS) has been proposed to refine predictions in the inference time. f-BRS adapts an intermediate activation function to each input by using user clicks as sparse labels. Given the similarity between user clicks and sparse depth maps, this paper aims at extending the application of f-BRS to depth prediction. Our experiments show that f-BRS, fused with a depth estimation baseline, is trapped in local optima, and fails to improve the network predictions. To resolve that, we propose a double-stage adaptive refinement scheme (DARS). In the first stage, a Delaunay-based correction module significantly improves the depth generated by a baseline network. In the second stage, a particle swarm optimizer (PSO) delineates the estimation through fine-tuning f-BRS parameters—that is, scales and biases. DARS is evaluated on an outdoor benchmark, KITTI, and an indoor benchmark, NYUv2 while for both the network is pre-trained on KITTI. The proposed scheme outperformed rival methods on both datasets.

Fracture analysis of reinforced concrete deep beam strengthened with carbon fiber-reinforced polymer (CFRP) plates was carried out. The present research aims to find out whether the crack propagation in a strengthened deep beam follows linear elastic fracture mechanics (LEFM) theory or nonlinear fracture mechanics theory. To do so, a new energy release rate based on nonlinear fracture mechanics theory was formulated on the finite element method and the discrete cohesive zone model (DCZM) was developed in deep beams. To validate and compare with numerical models, three deep beams with rectangular cross-sections were tested. The code results based on nonlinear fracture mechanics models were compared with experimental results and ABAQUS results carried out based on LEFM. The predicted values of initial stiffness, yielding point and failure load, energy absorption, and compressive strain in the concrete obtained by the proposed model were very close to the experimental results. However, the ABAQUS software results have greater differences with the experimental results. For example, the predicted failure load for the shear-strengthened deep beam using the proposed model has only 6.3% differences compared to the experimental result. However, the predicted failure load using ABAQUS software based on LEFM has greater differences (25.1%) compared to the experimental result.

GANs are well known for success in the realistic image gen-eration. However, they can be applied in tabular data generation as well.We will review and examine some recent papers about tabular GANs inaction. We will generate data to make train distribution bring closer tothe test. Then compare model performance trained on the initial traindataset, with trained on the train with GAN generated data, also wetrain the model by sampling train by adversarial training. We show thatusing GAN might be an option in case of uneven data distribution be-tween train and test data

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

Technological advances in DBS hardware and software represent a significant growth area in functional neurosurgery. These advancements have the potential to significantly enhance treatment outcomes and expand the scope of neurological disorders that can be effectively addressed through DBS interventions. The introduction of directional DBS marks a new phase in neuromodulation, offering extended benefits for patients with Parkinson's disease, more efficient optimization of clinical outcomes, and targeted treatment of refractory symptoms through data-driven approaches. Implementing a multimodal programming strategy, incorporating novel current fractionation technology and image-guided tools for lead localization and brain sensing, further reduces reliance on traditional trial-and-error programming methods, paving the way for a more predictive application of this therapy. These advancements are expected to drive the development of sophisticated closed-loop stimulation systems capable of integrating continuous data streams for improved patient care.

Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user’s voice, and can be used through methods, such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. however, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors, such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into 3 classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy. As a result, the conventional method achieved 92.94% accuracy and proposed method achieved 98.16% accuracy.

In Taiwan, peanuts are classified by hand. The kernel quality is judged based on the appearance of peanuts. The identification takes considerable time and labor. Fatigue can induce misrecogni-tion or grade cognition instability due. Peanut defects are generally divided into health, underde-velopment, insect bite, and rupture. This study employed two imaging methods push-boom FX10 and Snapshot. Deep learning was used to detect peanut defects. A push-broom instrument was used for testing. There were 1,560 peanuts, including 240 good and 240 bad ones. There were a total of 1,080 good peanuts and bad peanuts in the test set data, the band selection was used, and a CNN model was built. Based on the results from three methods, 3DCNN could classify with 97%accuracy. The Snapshot was used to achieve the real-time design of a lightweight CNN model. Finally, five bands were selected using PCA, and the screening could be accurate and efficient. The maximum overall accuracy was about 98.5%. Kappa was 97.3% with real-time recognition. This will be a major advantage in the future practical application and commercialization processes. This technique can reduce labor costs, achieve intelligent detection and intelligent grading, and bring breakthroughs to smart agriculture for other crops as well.

The paper is based on the research project P2Endure funded within the H2020-EE-2016-2017 call. The main aim of the research is to propose innovative solutions for deep renovation that are applicable and replicable for the widest range of building typologies, from public to residential and historic buildings. In this paper, the methodology adopted to perform the energy analyses and to verify the achievement of the expected targets in terms of savings is defined, based on a range of real case studies. The main aim is to promote a guideline for designers showing specific instruments to perform towards the attainment of the 60% threshold of the energy savings giving advice on how to further improve the energy performance of the buildings, basing on the overview of the energy analyses run for similar cases.

Plant-based protein sources derived from microalgae offer promise as low-carbon emission and nutrient-dense sources for human consumption. The current management of microalgae cultivation relies heavily on manual microscopic examination in order to identify desired and competing species, as well as predators. In this study, we trained and tested a transfer learning model modified from EfficientNetV2 B3 on 434 and 161 prospectively acquired images of the preferred Nannochloropsis sp microalgae and competitor Spirulina, respectively, and achieved >98% classification for both species on tenfold cross-validation. The model was further enhanced with gradient-weighted class activation mapping, which allowed visualization of regions of the input images that were relevant to the classification, thereby improving its explainability. In this paper, we demonstrate that a simple deep transfer learning model can be used to identify microalgae species. The application addresses the practical need for robust automated monitoring of microalgae populations on industrial microalgae farms.

In this work we introduce an end-to-end multi-modal neural network to segment the Gross Tumor Volume (GTV) from 3D-CBCT’s during radiotherapy. We improve the tumor segmentation by using a U-net which takes additional information such as the tumor mask generated at the planning phase along with the CBCT volume. The mask contains relevant information about the tumor’s location and can guide the model to use this knowledge appropriately to give a better prediction. This technique could become an alternative to produce segmentation masks of GTV in CBCT automatically during radiotherapy as in the traditional RT-pipeline, they are not segmented. We have evaluated our model on a dataset of 82 patients who have undergone radiotherapy. We compare the results of registered target volumes from planning CT as mask seed with 2 different types of multi-modal architectures. Our model shows a DSC of 0.706±0.002 with Late Fusion and 0.702±0.015 with Early Fusion using the GTV Mask. The performance of the two models on this mask is similar, so we perform further experiments with different types of masks which suggest that Late Fusion model produces a better segmentation of the tumor than the Early Fusion model. We also provide an ablation study consisting of a single modality U-net and a metric based on the Planning CT mask registration. It indicates a clear advantage of using our model to produce segmentation for this type of imaging.

Over the past decade, research in the field of Deep Learning has brought about novel improvements in image generation and feature learning; one such example being a Generative Adversarial Network. However, these improvements have been coupled with an increasing demand on mathematical literacy and previous knowledge in the field. Therefore, in this literature review, I seek to introduce Generative Adversarial Networks (GANs) to a broader audience by explaining their background and intuition at a more foundational level. I begin by discussing the mathematical background of this architecture, specifically topics in linear algebra and probability theory. I then proceed to introduce GANs in a more theoretical framework, along with some of the literature on GANs, including their architectural improvements and image-generation capabilities. Finally, I cover state-of-the-art image generation through style-based methods, as well as their implications on society.

This study evaluated the using of machine vision in combination with deep learning to identify weeds in real-time for wheat production system. PMAS-Arid Agriculture university research farm were selected for collection of images (6000 total images) of weeds and wheat crops under different weather condition. During growing season, the database was constructed to identify the weeds. For this study two framework were used TensorFlow and PyTorch under CNNs and Deep learning. Deep learning perfromed better with in PyTourch value as compared to another model in Tensorflow. comparing with other networks such as YOLOv4, we concluded that our network reaches a better result between speed and accuracy. Specifically, the maximum precision of weed and wheat plants were 0.89 and 0.91 respectively with 9.43 ms and 12.38 ms inference time per image (640 × 640) NVIDIA RTX2070 GPU.

Smartphones are prone to SMS phishing due to the rapid growth in the availability of smart mobile technologies driven by Internet connections. Also, detecting phishing SMS is a challenging task due to the unstructured nature of SMS text data with non-linear complex correlations. In this concern, considering the recent advancements in the domain of cybersecurity, we have proposed a hybrid deep learning framework that extracts robust features from SMS texts followed by an automatic detection of Phishing SMS. Due to combining the potential capability of individual models into one hybrid framework, it has outperformed various other individual machine learning and deep learning models. The proposed Phishing Detection framework is an effective hybrid combination of pretrained transformer model, MPNet (Masked and Permuted Language Modeling), with supervised ConvNets (CNN) and Bi-directional Gated Recurrent Units (GRU). It is intended to successfully detect unstructured short phishing text messages that contain complex patterns.

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge sources. Such systems are designed to cater the most prominent answer from this giant knowledge source to the user’s query using natural language understanding (NLU) and thus eminently depends on the Question-answering(QA) field. Question answering involves but not limited to the steps like mapping of user’s question to pertinent query, retrieval of relevant information, finding the best suitable answer from the retrieved information etc. The current improvement of deep learning models evince compelling performance improvement in all these tasks. In this review work, the research directions of QA field are analyzed based on the type of question, answer type, source of evidence-answer, and modeling approach. This detailing followed by open challenges of the field like automatic question generation, similarity detection and, low resource availability for a language. In the end, a survey of available datasets and evaluation measures is presented.

Semantic segmentation is a very popular topic in modern computer vision and it has applications to many fields. Researchers proposed a variety of architectures over time, but the most common ones exploit an encoder-decoder structure that aims to capture the semantics of the image and it low level features. The encoder uses convolutional layers, in general with a stride larger than one, to extract the features, while the decoder recreates the image by upsampling an using skip connections with the first layers. In this work, we use DeepLab as architecture to test the effectiveness of creating an ensemble of networks by randomly changing the activation functions inside the network multiple times. We also use different backbone networks in our DeepLab to validate our findings. We manage to reach a dice coefficient of 0.888, and a mean Intersection over Union (mIoU) of 0.825, in the competitive Kvasir-SEG dataset. Results in skin detection also confirm the performance of the proposed ensemble, which is ranked first with respect to other state-of-the-art approaches (including HardNet) in a large set of testing datasets. The developed code will be available at https://github.com/LorisNanni.

Classification of human actions from uni-modal and multi-modal datasets is an ongoing research problem in computer vision. This review is aimed to scope current literature on data-fusion and action-recognition techniques and to identify gaps and future research direction. Success in producing cost-effective and portable vision-based sensors has dramatically increased the number and size of datasets. The rise in number of action recognition datasets intersects with advances in deep-learning architectures and computational support, both of which offer significant research opportunities. Naturally, each action-data modality - such as RGB, depth, skeleton, and infrared - has distinct characteristics; therefore, it is important to exploit the value of each modality for better action recognition. In this article we will focus solely on areas such as data fusion and recognition techniques in the context of vision with a uni-modal and multi-modal perspective. We conclude by discussing research challenges, emerging trends, and possible future research directions.

An eruption of volcano is related to the past volcanic and tectonic seismicity. Recently, on November 29, 2020, a 1423 m Mount Ile Lewotolok in Lembata Island has erupted. In here, this paper aimed to assess the volcanic and tectonic seismicity as determinant factor and precursor of recent Mt Ile Lewotolok eruption. The assessment shows that Mt Ile Lewotolok volcanic activities were characterized by both tectonic and deep volcanic seismicity. Since 2010, mean tectonic quake magnitudes of M 4.133 (95%CI:M 3.205-5.062) have occurred at mean depth of 13.500 km (95%CI:8.201-18.799 km) within a distance of 3-4 km from the summit. Tectonic quake has occurred frequently in southwest of Ile Lewotolok and this has contributed to the past eruptions in 2012 and 2017. Recent eruption has been influenced by deep volcanic seismicity rather than local tectonic. Based on November 2020 record, mean of deep volcanic seismicity frequency was 2.190 events/day (95%CI:1.136-3.243 events/day km) that has outnumbered (t_test=2.665, P=0.013) the events of local tectonic quakes (mean 0.621 events/day; 95%CI:0.142-1.099events/day). Prior to the eruption there was significant increase of deep volcanic seismicity (P=0.023) while local tectonic quake was not showing an increasing trend (P=0.764). This result confirms that the deep volcanic seismicity frequency is a precursor that may trigger the eruption and deep volcanic seismicity data can be used as indicator of volcanic activities.

Mouthbrooding or oral incubation, the retention of early developmental stages inside of the mouth for an extended period of time, has evolved multiple times in bony fishes1,2. Though uncommon, this form of parental care has been documented and well-studied in several groups of freshwater fishes but is also known to occur in a small number of marine fishes, all inhabiting coastal waters1,2. A recent paper3, reported for the first time mouthbrooding in a deep-water fish species, the zeiform Parazen pacificus, which according to the authors “fills in a gap in the larval literature for this family of fishes and prompts further investigation into other novel reproductive modes of deep-sea fauna.”

This paper proposes a method for recognizing audio events in urban environments that combines handcrafted audio features with a deep learning architectural scheme (Convolutional Neural Networks, CNNs), which has been trained to distinguish between different audio context classes. The core idea is to use the CNNs as a method to extract context-aware deep audio features that can offer supplementary feature representations to any soundscape analysis classification task. Towards this end, the CNN is trained on a database of audio samples which are annotated in terms of their respective "scene" (e.g. train, street, park), and then it is combined with handcrafted audio features in an early fusion approach, in order to recognize the audio event of an unknown audio recording. Detailed experimentation proves that the proposed context-aware deep learning scheme, when combined with the typical handcrafted features, leads to a significant performance boosting in terms of classification accuracy. The main contribution of this work is the demonstration that transferring audio contextual knowledge using CNNs as feature extractors can significantly improve the performance of the audio classifier, without need for CNN training (a rather demanding process that requires huge datasets and complex data augmentation procedures).

A novel indole, microindolinone A (1), was isolated from a deep-sea-derived actinomycete Microbacterium sp. MCCC 1A11207, together with 18 known compounds (2–19). By detailed analysis of the ¹H, ¹³C, HSQC, COSY, HMBC, HRESIMS, and CD data, the absolute configuration of 1 was elucidated as 5R-hydroxy-4,5,6,7-tetrahydroindole-4-one. Noteworthily, 1 is the second example of a saturated indole isolated from nature.

Living in extreme environments, marine organisms face constant exposure to a range of stressors, such as high radiation levels, fluctuations in temperature, and oxidative stress. Understanding extremophile fishes is crucial because it gives us valuable insights into the biochemical, physiological, and developmental processes that govern life, by observing how they operate under natural stressors. Among the most fascinating adaptations is the existence of specialised enzymes and compounds that function as potent antioxidants, successfully counteracting reactive oxygen species' deleterious effects. In this review, we analysed the findings from several studies on Antarctic and deep-sea fish species, while highlighting the environmental stressors effects toward the antioxidant system. The antioxidant defences of the considered extremophile fishes have been extensively studied, but there is still much to learn to fully understand this complex system, while the relative research is still ongoing. Consequently, we are properly anticipating further advancements over the next few years about our understanding of crucial physiological processes that support cell survival.

Short-term energy consumption forecasting crucial for the operation of new electrical en-ergy grids, not only due to their own characteristics, but also due to the new elements pre-sent in the energy matrix. Many existing models are limited by their methodologies or by considering only a narrow set of factors influencing energy consumption. This study in-troduces a pipeline for developing an energy forecasting model and evaluates the signifi-cance of factors affecting energy consumption and, consequently, forecast accuracy. The study utilizes a dataset from ISO NE (Independent System Operator New England), span-ning the total electric load of various cities in New England from January 2017 to December 2019. This dataset comprises 23 independent variables, including weather data, economic indicators, and market information. The results outline the steps involved in constructing energy forecast models using time series analysis. By carefully selecting variables and rep-resenting external factors, the study demonstrates the feasibility of generating more accu-rate predictions with reduced computational resources.

In directional forming processes such as rolling and extrusion, the microstructure is strongly elongated in the forming direction. This results in a preferred alignment of the crystal orientations of the initially randomly oriented grains. These preferred orientations – the texture – and elongations of the grains are the cause of the material anisotropy. This anisotropy leads to phenomena such as earing, which occur during further forming processes, e.g., during deep drawing of sheet metal. Considering anisotropic properties in numerical simulations allows to investigate the effects of texture-dependent defects in forming processes and the development of possible solutions. Purely phenomenological models for modelling anisotropy work by fitting material parameters or applying measured R-values in experiments which are applied to all elements of the part and remain constant over the duration of the simulation. In contrast, methods such as the Visco-Plastic Self-Consistent (VPSC) model, which has been used in this work, provide a deeper insight into the development of the material microstructure. By experimentally measuring the initial texture and using it as an initial condition for the simulations, it is possible to predict the evolution of the microstructure and the resulting effect on the mechanical properties during forming operations. The results of the simulations with VPSC show good qualitative agreement with tests typically used for rolled stock.

We introduce a novel microscopic image dataset augmented with segmentation and detection labels specifically designed for microplastic analysis in sewage environments. Recognizing the increasing concern over microplastics — particles of synthetic polymers smaller than 5mm — and their detrimental effects on marine ecosystems and human health, our research focuses on enhancing detection and analytical methodologies through advanced computer vision and deep learning techniques. The dataset comprises high-resolution microscopic images of microplastics collected from sewage, meticulously labeled for both segmentation and detection tasks, aiming to facilitate accurate and efficient identification and quantification of microplastic pollution. In addition to dataset development, we present example deep learning models optimized for segmentation and detection of microplastics within complex sewage samples. The models demonstrate significant potential in automating the analysis of microplastic contamination, offering a scalable solution to environmental monitoring challenges. Furthermore, we ensure the accessibility and reproducibility of our research by making the dataset and model codes publicly available, accompanied by detailed documentation on GitHub and LabelBox. The dataset and example deep learning models are publicly available at the following GitHub link. https://anonymous.4open.science/r/Microplastics-in-Sewage-1BEF

Artificial intelligence (AI) refers to computer algorithms that replicate the cognitive function of humans. Machine learning is widely applicable using structured and unstructured data, while deep learning is derived from the neural networks of the human brain that process and interpret information. During the last decades, AI has been introduced in several aspects of healthcare. In this review, we aim to present the current application of AI in the neonatal intensive care unit. AI-based models have been applied to neurocritical care, including automated seizure detection algorithms and electroencephalogram-based hypoxic-ischemic encephalopathy severity grading systems. Moreover, AI models evaluating magnetic resonance imaging contributed to the progress of the evaluation of the neonatal developing brain and the understanding of how prenatal events affect both structural and functional network topologies. Furthermore, AI algorithms have been applied to predict the development of bronchopulmonary dysplasia and assess the extubation readiness of preterm neonates. Automated models have been also used for the detection of retinopathy of prematurity and the need for treatment. Among others, AI algorithms have been utilized for the detection of sepsis, the need for patent ductus arteriosus treatmnet, the evaluation of jaundice, and the detection of gastrointestinal morbidities. Finally, AI prediction models have been constructed for the evaluation of the neurodevelopmental outcome and the overall mortality of neonates. Although the application of AI in neonatology is encouraging, further research in AI models is warranted in the future including retraining clinical trials, validating the outcomes, and addressing serious ethics issues.

Agricultural crops productivity is heavily influenced by the strength of their seeds. Current methods for testing seed vigor, such as the germination rate and tetrazolium test, rely on time-consuming human visual inspections. Computer Vision, a crucial technology in smart production processes, offers an automated alternative and is increasingly applied in digital agriculture processes. Here we propose a method that combines YOLOv8 and morphological analysis of seeds using X-ray images to aid seed quality analysts in classifying seed lots based on their physiological potential. We examined the internal morphology of three seed lots and generated X-ray images to train a YOLOv8-based model with a post-segmentation module. This model assessed various parameters such as the total seed area, area filled by the embryo and endosperm, length, width, and calculated the percentage occupied by the embryo and endosperm in relation to the total seed area. Subsequently, seeds were classified into four categories based on the internal area occupied by the endosperm and embryo. Our findings reveal the robust performance of the YOLOv8 model in segmenting and classifying despite the challenges posed by a relatively small dataset. Notably, the proposed model achieved an impressive accuracy of up to 95.6% in identifying and segmenting the endosperm over 1,500 epochs with just 15 training images. The endosperm/seed area ratio, particularly within the 50-60% range covering over 50% of the samples, emerged as a significant metric for evaluating the viability of seed batches.

The combustion of fuel oil releases sulfur compounds, which react to form sulfur oxides that are harmful to the environment and pose a threat to human health. To mitigate these negative effects, it is crucial to pretreat fuel oil through desulfurization processes. One promising approach involves the use of deep eutectic solvents (DESs), carbon nanotubes (CNTs), and their composites (DESs/CNTs) to effectively reduce sulfur content in fuel oil.However, the conventional methods of DES-based extraction desulfurization and CNT-based adsorption desulfurization suffer from low desulfurization rates. Additionally, the composite material DESs/CNTs is in a semi-solidified form, resulting in high viscosity, complex operation procedures, and increased waste and environmental pollution. To address these challenges, this study focused on the preparation of CNTs/PEG-PVA hydrogel. This hydrogel not only maintains the high desulfurization rate observed in the DESs/CNTs composite material but also possesses several advantages. Firstly, it is convenient to use, offering ease of handling and application. Secondly, it is biodegradable, meaning it can break down naturally over time, reducing its impact on the environment. Lastly, the hydrogel is reusable, allowing for repeated use, thereby minimizing material waste. The desulfurization rate achieved with the CNTs/PEG-PVA hydrogel is remarkably high, reaching up to 99.8%. Moreover, the material utilization rate is close to 100%, meaning that almost all of the hydrogel is utilized in the desulfurization process, reducing unnecessary material consumption. In summary, the innovative CNTs/PEG-PVA hydrogel presents a highly efficient and environmentally friendly solution for desulfurization in fuel oil. Its superior desulfurization rate, alongside its convenience, biodegradability, and reusability, positions it as a promising alternative that not only ensures effective desulfurization but also contributes to sustainable practices in the energy industry.

Sustainable agriculture is at the forefront of modern farming practices, with a growing emphasis on optimizing crop production while minimizing environmental impact. The choice of fertilizer application technology plays a critical role in achieving these objectives. Soybean (Glycine max (L.) Merr.), a valuable crop globally, serves both as a source of human nutrition and livestock feed. To address the challenges of enhancing soybean production while minimizing ecological harm, this study evaluates and compares the performance of different fertilizer application technologies. In this study we combined remote and ground surveys to allow a comprehensive understanding of the impact of these technologies on soybean cultivation. The study focuses on deep placement of slow-release nitrogen fertilizers with coated urea at a 20 cm depth, conventional nitrogen fertilizer application, and manure organic fertilizer application. Remote surveys are conducted using advanced smart farming tools such as Unmanned Aerial Vehicle (UAV), ground surveys such as soil plant analysis development SPAD measurements, and soybean parameters to assess the impact of fertilizer application. This study revealed that deep placement fertilizer demonstrated better performance compared to other fertilizer application technologies for soybean cultivation. The findings from this study contribute to the advancement of sustainable agricultural practices and empower farmers with knowledge to make informed decisions for optimizing green soybean production.

The rate of accidents in Morocco is experiencing a significant increase. Automatic license plate detection and recognition (ALPR) is an essential road safety technology. It facilitates applications such as traffic control, law enforcement, and toll collection by allowing for the automated recognition of vehicles on the road. In this study, we incorporated ShuffleNet V2 into the end-to-end YOLOV5 object detection system. The objective was to develop a model capable of identifying Moroccan license plates with an accuracy of 87%. The proposed model is intended to attain a high processing performance of 60 frames per second (FPS) while maintaining a low weight of 1.3 megabytes (MB) and a parameter count of 0.44 million floating point operations (MGFLOP). Our model maintains superior performance and is highly compatible with embedded systems compared to other models utilized in the same context.

Hundreds of millions of people on the planet are affected by malnourishment. This contributes to the vulnerability of large swaths of the population, especially children under five years old extremely vulnerable to diseases and even death in the least developed countries. Today, by providing a substantial share of global protein intake, as well as fatty acids and micronutrients, fisheries contribute to global food security. As fish stocks in the upper sea levels have already been over-exploited, there might not be enough in supplying food security, deep-sea fisheries have been increasingly discussed to address this problem. Some mesopelagic fishes show the potential to provide important nutrients. Another way of supplying food security might be through using mesopelagic fish as fish feed. However, fishing in the mesopelagic zone could lead to severe ecological problems and the impact on the biological carbon pump is uncertain. This paper highlights and juxtaposes different perspectives regarding exploitation pathways of the fish riches of deep seas and reviews best practice model projects that deal with uncertainties related to fishery management in the mesopelagic zone.

Acanthopanax senticosus(rupr. rt. Maxim.; AS) is a medicinal plant used in the clinical treatment of cerebrovascular diseases and central nervous system disorders, significantly improving blood lipid levels and endothelial cell function in patients with acute cerebral infarction. Isofraxidin, one of the active ingredients of AS, is the core of the medical effects, and its extraction and purification depend on organic solvents. Deep eutectic solvents (DESs) is a new green solvent, synthesized by intermolecular hydrogen bonding between hydrogen bond donors (HBD) and hydrogen bond acceptors (HBA), which has non-toxic, high separation and purification efficiency, and environmentally friendly compared with traditional organic solvents. In this paper, DES was used for the extraction of isofraxidin from AS. The primary findings demonstrate that the DESs had a viscosity higher than that of ethanol, and even adding a tiny amount of water (about 10%) would trigger solvent redistribution, leading to a considerable reduction in solvent viscosity. In comparison to ethanol, the extraction rate of isofraxidin by DESs was 2-3 times higher. Thus, this work developed a new technique for using green extraction of isofraxidin that has some practical implications.

Face detection is an important problem in computer vision because it enables a wide range of applications, such as facial recognition and analysis of human behavior. The problem is challenging because of the large variations in facial appearance across different individuals and different lighting and pose conditions. One way to detect faces is to utilize a highly advanced face detection method, such as RetinaFace, which uses deep learning techniques to achieve high accuracy in various datasets. However, even the best face detectors can produce false positives, which can lead to incorrect or unreliable results. In this paper, we propose a method for reducing false positives in face detection by using information from a depth map. A depth map is a two-dimensional representation of the distance of objects in an image from the camera. By using the depth information, the proposed method is able to better differentiate between true faces and false positives. The authors evaluate their method on a combined dataset of 549 images, containing a total of 614 upright frontal faces. The results show that the proposed method is able to significantly reduce the number of false positives without sacrificing the overall detection rate. This indicates that the use of depth information can be a useful tool for improving face detection performance.

Tardive dyskinesia (TD) is a phenomenon predominantly observed as a result of the long-term use of dopamine receptor blockers (antipsychotics). TD is a group of involuntary, irregular hyperkinetic movements, mainly in the muscles of the face, eyelid muscles, lips, tongue, and cheeks, and less frequently in the limbs, neck, pelvis, and trunk. In some patients, TD takes on an extremely severe form, massively disrupting functioning, moreover, causing stigmatization and suffering. Deep brain stimulation (DBS), a method used, among others, in Parkinson's disease, is also an effective treatment for TD and often becomes a method of last resort, especially in severe, drug-resistant forms. The procedure is relatively new in TD, so the available reliable clinical studies are few and consist mainly of case reports. Unilateral and bilateral stimulation of two sites has proven efficacy in TD treatment. Most authors describe stimulation of the globus pallidus internus (GPi); less frequent descriptions involve the hypothalamic nucleus (STN). In the present paper, we provide up-to-date information on the stimulation of both mentioned brain areas. We also compare the efficacy of the two methods by comparing the two available studies, which included the largest groups of patients. Although GPi stimulation is more frequently used clinically, our initial analysis indicates comparable results (reduction of involuntary movements) with STN DBS.

Video editing is a high-required job, for it requires skilled artists or workers equipped with plentiful physical strength and multidisciplinary knowledge, such as cinematography, aesthetics. Thus gradually, more and more researches focus on proposing semi-automatical and even fully automatical solutions to reduce workloads. Since those conventional methods are usually designed to follow some simple guidelines, they lack flexibility and capability to learn complex ones. Fortunately, the advances of computer vision and machine learning make up the shortages of traditional approaches and make AI editing feasible. There is no survey to conclude those emerging researches yet. This paper summaries the development history of automatic video editing, and especially the applications of AI in partial and full workflows. We emphasizes video editing and discuss related works from multiple aspects: modality, type of input videos, methology, optimization, dataset, and evaluation metric. Besides, we also summarize the progresses in image editing domain, i.e., style transferring, retargeting, and colorization, and seek for the possibility to transfer those techniques to video domain. Finally, we give a brief conclusion about this survey and explore some open problems.

Documenting cultural heritage by using artificial intelligence (AI) is crucial for preserving the memory of the past and a key point for future knowledge. However, modern AI technologies make use of statistical learners that lead to self-empiricist logic, which, unlike human minds, use learned non-symbolic representations. Nevertheless, it seems that it is not the right way to progress in AI. If we want to rely on AI for these tasks, it is essential to understand what lies behind these models. Among the ways to discover AI there are the senses and the intellect. We could consider AI as an intelligence. Intelligence has an essence, but we do not know whether it can be considered “something” or “someone”. Important issues in the analysis of AI concern the structure of symbols -operations with which the intellectual solution is carried out- and the search for strategic reference points, aspiring to create models with human-like intelligence. For many years, humans, seeing language as innate, have carried out symbolic theories. Everything seems to have skipped with the advent of Machine Learning. In this paper, after a long analysis of history, the rule-based and the learning-based vision, we propose KERMIT as a unit of investigation for a possible meeting point between the different learning theories. Finally, we propose a new vision of knowledge in AI models based on a combination of rules, learning and human knowledge.

Foraminifera are single-celled marine organisms that construct shells that remain as fossils in the marine sediments. Classifying and counting these fossils are important in e.g. paleo-oceanographic and -climatological research. However, the identification and counting process has been performed manually since the 1800s and is laborious and time-consuming. In this work, we present a deep learning-based instance segmentation model for classifying, detecting, and segmenting microscopic foraminifera. Our model is based on the Mask R-CNN architecture, using model weight parameters that have learned on the COCO detection dataset. We use a fine-tuning approach to adapt the parameters on a novel object detection dataset of more than 7000 microscopic foraminifera and sediment grains. The model achieves a (COCO-style) average precision of 0.78±0.00 on the classification and detection task, and 0.80±0.00 on the segmentation task. When the model is evaluated without challenging sediment grain images, the average precision for both tasks increases to 0.84±0.00 and 0.86±0.00, respectively. Prediction results are analyzed both quantitatively and qualitatively and discussed. Based on our findings we propose several directions for future work, and conclude that our proposed model is an important step towards automating the identification and counting of microscopic foraminifera.

Deep neural networks are hegemonic approaches to many machine learning areas, including natural language processing (NLP). Thanks to the availability of large corpora collections and the capability of deep architectures to shape internal language mechanisms in self-supervised learning processes (also known as "pre-training"), versatile and performing models are released continuously for every new network design. But these networks, somehow, learn a probability distribution of words and relations across the training collection used, inheriting the potential flaws, inconsistencies and biases contained in such a collection. As pre-trained models have found to be very useful approaches to transfer learning, dealing with bias has become a relevant issue in this new scenario. We introduce bias in a formal way and explore how it has been treated in several networks, in terms of detection and correction. Also, available resources are identified and a strategy to deal with bias in deep NLP is proposed.

The world has been evolving with new technologies and advances day-by-day. With the advent of various learning technologies in every field, the research community is able to provide solution in every aspect of life with the applications of Artificial Intelligence, Machine Learning, Deep Learning, Computer Vision, etc. However, with such high achievements, it is found to lag behind the ability to provide explanation against its prediction. The current situation is such that these modern technologies are able to predict and decide upon various cases more accurately and speedily than a human, but failed to provide an answer when the question of why to trust its prediction is put forward. In order to attain a deeper understanding into this rising trend, we explore a very recent and talked-about novel contribution which provides rich insight on a prediction being made -- ``Explainability.'' The main premise of this survey is to provide an overview for researches explored in the domain and obtain an idea of the current scenario along with the advancements published to-date in this field. This survey is intended to provide a comprehensive background of the broad spectrum of Explainability.

The detection of coronavirus (COVID-19) is now a critical task for the medical practitioner. The coronavirus spread so quickly between people and approaches 100,000 people worldwide. In this consequence, it is very much essential to identify the infected people so that prevention of spread can be taken. In this paper, the deep feature plus support vector machine (SVM) based methodology is suggested for detection of coronavirus infected patient using X-ray images. For classification, SVM is used instead of deep learning based classifier, as the later one need a large dataset for training and validation. The deep features from the fully connected layer of CNN model are extracted and fed to SVM for classification purpose. The SVM classifies the corona affected X-ray images from others. The methodology consists of three categories of Xray images, i.e., COVID-19, pneumonia and normal. The method is beneficial for the medical practitioner to classify among the COVID-19 patient, pneumonia patient and healthy people. SVM is evaluated for detection of COVID-19 using the deep features of different 13 number of CNN models. The SVM produced the best results using the deep feature of ResNet50. The classification model, i.e. ResNet50 plus SVM achieved accuracy, sensitivity, FPR and F1 score of 95.33%,95.33%,2.33% and 95.34% respectively for detection of COVID-19 (ignoring SARS, MERS and ARDS). Again, the highest accuracy achieved by ResNet50 plus SVM is 98.66%. The result is based on the Xray images available in the repository of GitHub and Kaggle. As the data set is in hundreds, the classification based on SVM is more robust compared to the transfer learning approach. Also, a comparison analysis of other traditional classification method is carried out. The traditional methods are local binary patterns (LBP) plus SVM, histogram of oriented gradients (HOG) plus SVM and Gray Level Co-occurrence Matrix (GLCM) plus SVM. In traditional image classification method, LBP plus SVM achieved 93.4% of accuracy.

Restricted Boltzmann machines (RBMs) are the building blocks of some deep learning networks. However, despite their importance, it is our perception that some very important derivations about the RBM are missing in the literature, and a beginner may feel RBM very hard to understand. We provide here these missing derivations. We cover the classic Bernoulli-Bernoulli RBM and the Gaussian-Bernoulli RBM, but leave out the ``continuous'' RBM as it is believed not as mature as the former two. This tutorial can be used as a companion or complement to the famous RBM paper ``Training restricted Boltzmann machines: An introduction'' by Fisher and Igel.

With increasing electronic medical data and the development of artificial intelligence, Clinical Decision Support Systems (CDSSs) assist clinicians in diagnosis and prescription. Traditional knowledge-based CDSSs follow an accumulated medical knowledgebase and a predefined rule system, which clarifies the decision-making process; however, maintenance cost issues exist in the medical data quality control and standardization process. Non-knowledge-based CDSSs utilize vast amounts of data and algorithms to effectively decide; however, the deep learning black-box problem causes unreliable results. EXplainable Artificial Intelligence (XAI)-based CDSS provides a valid rationale and explainable results. It ensures trustworthiness and transparency by showing the recommendation and prediction results process through explainable techniques. However, existing systems have limitations, such as the scope of data utilization and the lack of explanatory power of AI models. This study proposes a new XAI-based CDSS framework to address these issues; introduce resources, datasets, and models that can be utilized; and provides a foundation model to support decision-making in various disease domains. Finally, we propose future directions for CDSS technology and highlight societal issues that need to be addressed to emphasize the potential of CDSS in the future.

Fluorescence microscopic images of cells contain a large number of morphological features that are used as an unbiased source of quantitative information about cell status, through which researchers can extract quantitative information about cells and study the biological phenomena of cells through statistical and analytical analysis. As an important research object of phenotypic analysis, images have a great influence on the research results. Saturation artifacts present in the image result in a loss of grayscale information that does not reveal the true value of fluorescence intensity. From the perspective of data post-processing, we propose a two-stage cell image recovery model based on generative adversarial network to solve the problem of phenotypic feature loss caused by saturation artifacts. The model is capable of restoring large areas of missing phenotypic features. In the experiment, we adopt the strategy of progressive restore to improve the robustness of the training effect, and add the contextual attention structure to enhance the stability of the restore effect. We hope to use deep learning methods to mitigate the effects of saturation artifacts to reveal how chemical, genetic, and environmental factors affect cell state, providing an effective tool for studying the field of biological variability and improving image quality in analysis.

High-power laser facilities necessitate predicting incremental damage to final optics to identify evolving damage trends. In this study, we propose a surface damage detection method utilizing image segmentation employing ResNet-18, and a damage area estimation network employing U-Net++. Paired sets of online and offline images of optics obtained from a large laser facility is used to train the network. The trends of varying damage could be identified by incorporating additional experimental parameters. A key advantage of the proposed method is that the network can be trained end-to-end on small samples, eliminating the need for manual labeling or feature extraction. The software developed based on these models can facilitate the daily inspection and maintenance of optics in large laser facilities.

In the era of Artificial Intelligence (AI), comprehending and responding to non-verbal communication is increasingly vital. This research extends AI's reach in bridging communication gaps, notably benefiting American Sign Language (ASL) and Taiwan Sign Language (TSL) communities. It focuses on employing various AI models, especially the Hierarchical Vision Transformer with Shifted Windows (Swin), for recognizing diverse sign language datasets. The study assesses Swin architecture's adaptability to different sign languages, aiming to create a universal platform for Unvoiced communities. Utilizing deep learning and transformer technologies, hybrid application prototypes have been developed for ASL-to-English translations and vice versa, with plans to expand this to multiple sign languages. The Swin models, trained on varied dataset sizes, show considerable accuracy, indicating their flexibility and effectiveness. This research underscores major advancements in sign language recognition and underlines a commitment to inclusive communication in the digital era. Future work will focus on enhancing these models and broadening their scope to include more sign languages, integrating multimodality and Large Language Models (LLMs), thereby fostering global inclusivity.

Background: Silent MRA has shown promising results in evaluating the stents used for intracranial aneurysm treatment. A deep learning-based algorithm was recently introduced by GE. The purpose of this study was to compare the performance of several MRA techniques in lumen visibility in silicone models with flow diverter stents. Methods: Two Surpass Evolve stents of different sizes were implanted in two silicone tubes. The tubes were placed in separate boxes in straight position and in two different curve configurations and connected to a pulsatile pump to construct a flow loop. Using a GE 3.0T scanner, TOF and silent MRA images were acquired, and deep learning reconstruction was applied to the silent MRA dataset. Intra-luminal signal intensity in the stent (SIin-stent), in the tube outside the stent (SIvessel) and of the background (SIbg) were measured for each scan. Results: The SIin-stent/SIbg and SIin-stent/SIv ratio were higher on silent scans and DL-based reconstructions than on TOF images. The stent tips created severe artefacts on TOF images, which could not be observed on silent scans. Conclusions: Our study demonstrated that the DL algorithm improved the quality of the silent technique in evaluating the flow diverter stent patency.

Document image binarization is a challenging task, especially when it comes to text segmentation in degraded document images. The binarization, as a pre-processing step of optical character recognition (OCR), is one of the most fundamental and commonly used segmentation methods. It separates the foreground text from the background of the document image to facilitate subsequent image processing. In view of the different degradation degree of document image, researchers have proposed a variety of solutions. This paper reviews the main binarization techniques, including both traditional algorithms and deep learning-based algorithms. We also summarize some difficulties and challenges in the field of document image binarization. Here, we evaluate various image binarization techniques to identify shortcomings in current methods and provide some help for future research.

Vulnerabilities in smart contracts may trigger serious security events, and the detection of smart contract vulnerabilities has become a significant problem. In this paper, by using the multi-scale cascade encoder architecture as the backbone, we propose a novel Multi-scale Encoder Vulnerability Detection (MEVD) approach to detect well-known high-risk vulnerabilities in smart contracts. Firstly, we use the gating mechanism to design a unique Surface Feature Encoder (SFE) to enrich the semantic information of code features. Then, by combining a Base Transformer Encoder (BTE) and a Detail CNN Encoder (DCE), we introduce a dual-branch encoder to capture the global structure and local detail features of the smart contract code, respectively. Finally, to focus the model's attention on vulnerability-related characteristics, we employ the Deep Residual Shrinkage Network (DRSN). Experimental results on three types of high-risk vulnerability datasets demonstrate performance compared to state-of-the-art methods, and our method achieves an average detection accuracy of 90%.

With the rapid development of space programs in various countries, the number of satellites in space is increasing, resulting in an increasingly complex space environment. Therefore, improving space object identification technology has become highly important. We proposes a method of applying deep learning to intelligent detection of space object. We utilize 49 authentic 3D satellite models including 16 scenarios to generate a dataset comprising 17,942 images, which contains over 500 actual satellite photos. Additionally, we acquired a substantial amount of annotated data using a semi-automatic labeling method, which resulted in significant labor cost savings, and obtained a total of 39,000 labels. We validate the feasibility of the dataset using YOLOv3 and YOLOv7 models. What's more, we optimize the YOLOv7 model by integrating deformable convolution RepPoint into the YOLOv7 backbone to obtain the YOLOv7-R model. Through training with these two models, experimental results show that YOLOv3 achieves an accuracy of 0.927, YOLOv7 reaches an accuracy of 0.964, and YOLOv7-R achieves the highest accuracy at 0.983. This provides an effective solution for intelligent space object detection.

In the realm of autonomous vehicle environment perception, the primary objective of point cloud target detection is to swiftly and accurately identify three-dimensional objects from point cloud data. To meet this requirement, the prevalent network architecture employed in the industry is the voxel-based PointPillars model. Nonetheless, this model faces challenges in maintaining detection accuracy when objects are obscured or diminutive in size. In response to this issue, we introduce AGPNet, a novel model that seamlessly integrates four key modules: Data Augmentation, Dynamic Graph CNN, Pillar Feature Net, and Detection Head (SSD). The Data Augmentation module enhances the adaptability of point cloud data to complex and ever-changing real-world environments. The Dynamic Graph CNN module endows the network structure with geometric features, which encapsulate not only the point itself but also its adjacent points. The Pillar Feature Net module translates three-dimensional point cloud data into pseudo-image data through the utilization of voxels. Subsequently, the Detection Head (SSD) module leverages this pseudo-image data to conduct target detection of three-dimensional objects. Our experiments, conducted on the KITTI dataset, demonstrate that our proposed method boosts object detection accuracy by 6-7 percentage points compared to the PointPillars model, while maintaining similar detection times.

CagY is the largest and most complex protein from Helicobacter pylori's type IV secretion system (T4SS) and may participate in the modulation of gastric tissue inflammation. A three-dimensional structure has been reported for only two segments of the protein. To build a more complete model, particularly the region that spans between the outer membrane (OM) and the inner membrane (IM), we employed different approaches, including homology modeling, ab initio, and deep learning techniques. For the long-middle repeat region (MRR), modeling was performed using deep learning techniques and Molecular Dynamics. The modeled segments were assembled into a chain of 1595 aa, and a 14-chain CagY multimer structure was composed by structural alignment. The final multimer structure correlated with previously published struc-tures and allows to show how the multimer may form the T4SS channel through which CagA and other molecules are translocated to gastric epithelial cells. The model further confirmed that MRR, the most polymorphic and complex region of CagY, presents numerous cysteine residues forming disulfide bonds that stabilize the protein and suggest this domain probably functions as a contractile region that may play an essential role in the modulatory activity of CagY on tissue inflammation.

Conservation tillage and deep side-fertilization both hold the potential to reduce nitrogen leaching and improve grain yield and nitrogen use efficiency in fragrant rice cultivation practices. However, the combined impact of different tillage practices with deep side-fertilization on nitrogen leaching remains uncertain. Therefore, this study conducted on-site experiments for four rice growing seasons in both early and late seasons in 2018 and 2019, using the fragrant rice varieties "Meixiangzhan 2"(MX) and "Xiangyaxiangzhan"(XY). The four experimental treatments included:conventional tillage with regular fertilization (T1), conventional tillage with simultaneous deep fertilization (T2), reduced tillage with simultaneous deep fertilization (T3) , and no-tillage with simultaneous deep fertilization (T4). Our results indicate that the T4 treatment exhibited higher nitrogen leaching rates and potential nitrogen losses throughout the entire rice growth cycle, with a 4.51% increase in total nitrogen leaching and a 1.86% increase in potential nitrogen leaching compared to T1. In contrast, the T2 treatment demonstrated the lowest nitrogen leaching rate, resulting in a 6.01% reduction in total nitrogen leaching and a 9.57% decrease in potential nitrogen leaching compared to T1, demonstrating the most optimal performance. For MX, the T1 treatment resulted in lower daily grain outputs compared to the other treatments, with disparities ranging from 5.35% to 9.94%. Similarly, for the XY, the T1 treatment yielded significantly lower daily grain outputs compared to the other treatments, with discrepancies ranging from 6.26% to 10.81% during the late season of 2019. Overall, this study shows that conventional tillage with deep fertilization effectively reduces nitrogen leaching and boosts fragrant rice yields. Minimizing nitrogen leaching enhances nitrogen utilization efficiency. These insights highlight the significance of strategic fertilization and cultivation for environmental conservation and agricultural sustainability.

This study proposes a method for image matching between infrared(IR)-RGB images using a deep learning network to estimate the deformation field. We propose a deformation field generator (DFG) that estimates the deformation field of the transformation matrix to match each pixel or IR image to the RGB image. DFG is a network that receives IR and RGB images as input; the output size is two channels and has the sample resolution as the input image. By warping the IR image through a grid-sampler that warps the image according to the value of the deformation field, we can obtain a warped IR image that matches the RGB image. Additionally, to check whether the warped IR image matched the RGB image, the masking images detecting the segmentation of objects were photographed in two images. Without directly comparing IR and RGB images, we proposed mask loss that warps the IR mask image through the deformation field and grid sampler and then compares the warped IR mask image with the RGB mask image. Mask loss solves the spatial similarity comparison problem with multi-modality images, such as IR and RGB images, by comparing the mask image with the same modality image as the mask image.

Deep reinforcement learning is one of the research hotspots in artificial intelligence and has been successfully applied in many research areas, however, the low training efficiency and high demand for samples are problems that limit the application To address these problems, a hierarchical episodic control model extending episodic memory to the domain of hierarchical reinforcement learning is proposed in this paper. The model is theoretically justified and employs a hierarchical implicit memory planning approach for counterfactual trajectory value estimation. Starting from the final step and recursively moving back along the trajectory, a hidden plan is formed within the episodic memory. Experience is aggregated both along trajectories and across trajectories, and the model is updated using a multi-headed backpropagation similar to bootstrapped neural networks. This model extends the parameterized episodic memory framework to the realm of hierarchical reinforcement learning and is theoretically analyzed to demonstrate its convergence and effectiveness. Experiments conducted in Four Room, Mujoco, and UE4-based active tracking , highlight that the hierarchical episodic control model effectively enhances training efficiency. It demonstrates notable improvements in both low-dimensional and high-dimensional environments, even in cases of sparse rewards.

This paper explores the potential of using the SAM segmentator to enhance the segmentation capability of known methods. SAM is a promptable segmentation system that offers zero-shot generalization to unfamiliar objects and images, eliminating the need for additional training. The open-source nature of SAM on GitHub allows for easy access and implementation. In our experiments, we aim to improve the segmentation performance by providing SAM with checkpoints extracted from the masks produced by DeepLabv3+, then merging the segmentation masks provided by these two networks. Additionally, we examine the \enquote{oracle} method (as upper bound baseline performance), where segmentation masks are inferred only by SAM with checkpoints extracted from ground truth. In addition, we tested in the CAMO datasets an ensemble of PVTv2 transformers; combining the ensemble and SAM yields state-of-the-art performance in that dataset. The results of our study provide valuable insights into the potential of incorporating the SAM segmentator into existing segmentation techniques. We release with this paper the open-source implementation of our method.