This study will lead to the development of a numerical data set that will assist in the design of Savonius wind turbines. A major objective of this study is to develop a better design for Savonius turbine blades in order to increase their torque coefficients, rotational speeds, and pressure coefficients. As part of the experimental design methodology, a full dataset was generated by simulating three-dimensional scale models utilizing computational fluid dynamics (CFD) simulations that were validated by wind tunnel data. This process is multi-objective optimization for optimizing turbine performance. The twist angle, aspect ratio, and overlap ratio are all important factors in determining the optimal torque and power coefficients. The group method of data handling (GMDH) algorithm was utilized to model objective functions based on input-output data. The Pareto fronts were plotted using polynomial models obtained from the evolutionary Pareto-based optimization approach (modified NSGA-II), and the optimal commercial points were determined using TOPSIS. A comparison of three- and two-objective optimization data revealed that two-objective optimization data lie within the boundaries of a three-objective optimization problem. The torque coefficient, rotational speed, and power coefficient are all improved by 13.74%, 0.071%, and 5.32%, respectively, using multi-objective optimization. As a result of the multi-objective optimization of the turbine, some significant characteristics of objective functions were discovered.

There has been considerable progress in implicit neural representation to upscale an image to any arbitrary resolution. However, existing methods are based on defining a function to predict the RGB value from just four specific loci. Relying on just four loci is insufficient as it leads to losing fine details from the neighboring region(s). We show that by taking into account the semi-local region leads to an improvement in performance. In this paper, we propose applying a new technique called Overlapping Windows on Semi-Local Region (OW-SLR) to an image to obtain any arbitrary resolution by taking the coordinates of the semi-local region around a point in the latent space. This extracted detail is used to predict the RGB value of a point. We illustrate the technique by applying the algorithm to the Optical Coherence Tomography-Angiography (OCT-A) images and show that it can upscale them to random resolution. This technique outperforms the existing state-of-the-art methods when applied to the OCT500 dataset. OW-SLR provides better results for classifying healthy and diseased retinal images such as diabetic retinopathy and normals from the given set of OCT-A images. The project page is available at https://rishavbb.github.io/ow-slr/index.html

This study focuses on the impact of weak partial discharges (PDs) on defect recognition accuracy in epoxy resin through phase-resolved partial discharge (PRPD) analysis. Two measurement conditions are compared until PRPD pattern saturation: one-minute and one-hour durations. The PD data specifically target three void types located at different positions within the epoxy material. The aim is to evaluate how the presence of weak PDs at the PD extinction voltage (PDEV) influences defect recognition accuracy. This research sheds light on the potential implications of neglecting the significance of weak PD signals in defect detection. A convolutional neural network (CNN) model is trained using PRPD data recorded at the PD inception voltage (PDIV) and tested using the new PRPD data from both conditions recorded from a lower PDIV to a PDEV. The trained CNN model achieves a defect recognition accuracy of 100% for a one-hour duration, highlighting the importance of not neglecting weak PD signals. This emphasizes the significance of extended measurement duration and pattern saturation in capturing and analyzing weak PD signals for improved defect recognition. This study contributes to the advancement of practical applications by understanding the behavior of the epoxy material and enhancing defect detection techniques.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

This paper presents the use of Graph Neural Networks (GNNs) to predict the tensile strength of Fused Deposition Modeling (FDM) specimens. In the present work, there are four main input parameters i.e. Infill percentage, Layer height, Print speed and Extrusion temperature while the Tensile Strength is an output parameter were considered. This study includes use of central composite design based response surface methodology to finalize the experimental layout. 3D printed specimen were manufactured as per the ASTM E8 standard on FDM printer using Polylactic Acid (PLA) as filament. Micro-tensile test were performed on the printed specimen as per ASTM E8 standard. The GNN algorithm was trained on a dataset of FDM specimens, achieving a mean squared error (MSE) of 2.47, mean absolute error (MAE) of 1.14, and R-squared value of 0.78. An adjacency matrix, which shows the connections between nodes in a graph. The obtained plot for nodes and weights in a GNN provide valuable information about the model and its performance. The results show the potential of using GNNs in predicting the mechanical properties of additively manufactured specimens and provide a promising direction for further research in this field.

Blasting pattern optimization is an attempt to optimize blast design parameters aiming to achieve optimum fragmentation, reduce mining operating costs as well as environmental side consequences. The present study aims to propose a multi-objective optimization model, employing artificial intelligence and metaheuristics, to simultaneously minimize the mine-to-crusher operating costs and the impact of blasting consequences including fly-rock and back-break. To achieve the purpose of the study, a multi-variable regression model was developed to model total costs from drilling to crushing. In addition to the costs, multilayer perception neural networks were implemented to predict the blast-induced back-break and fly-rock as a function of collected variables such as number of holes, hole length, burden, spacing, hole slope, stemming, blasted rock per hole, powder factor, and charge per delay. High-precise estimations for both back-break and fly-rock were achieved with the average of 99% coefficient of determination for train, test and validation data sets. Then, the developed regression model and the neural networks were used in an optimization framework, employing Grasshopper algorithm, to find the optimum blast design satisfying practical constraints. The proposed model was tested on a lead-zinc open-pit mine, where 1032 blasting patterns were recorded and analyzed. The results of the optimization model provide a Pareto set of solutions, such that any of these solutions can be implemented according to the strategy of the mining operation management team. The blast pattern with the lowest cost, result in a relatively high fly-rock and back-break, while the pattern with low fly-rock and back-break raises the cost by 20.13 % compared the minimum cost blast design.

This study aims to develop novel automated computer vision algorithms and systems for component replacement inspection for Printed Circuit Boards (PCBs). The proposed algorithms are able to identify locations as well as sizes of different components. They are object detection algorithms based on keypoints of the target components. The algorithms can be implemented as neural networks consisting of two portions: frontend networks and backend networks. The frontend networks are used for the feature extractions of input images. The backend networks are adopted for producing component inspection results. Each component class can has its own frontend and backend networks. In this way, the neural model for the component class can be effectively reused for different PCBs. To reduce the computation time for the inference of the networks, different component classes can share the same frontend networks. A two-stage training process is proposed for effectively exploring features of different components for accurate component inspection. The proposed algorithm has the advantages of the simplicity for training data collection, high accuracy for defect detection, and high reusability and flexibility for online inspection. The algorithm is an effective alternative for the automated inspection in smart factory with growing demand for product quality and diversification.

The total tree height (h) and diameter at breast height (dbh) relationship is an essential tool in forest management and planning. The height—diameter (h-dbh) relationship had been studied with several approaches and for several species worldwide. The nonlinear mixed effect modeling (NLMEM) has been extensively used and lately the resilient backpropagation artificial neural network (RBPANN) approach has been a trend topic for modeling this relationship. The artificial neural network (ANN) is a computing system based in artificial intelligence and inspired in biological neural network for supervised learning. In this study the NLMEN and RBPANN approaches were used for modeling the h—dbh relationship for Durango pine species (Pinus durangensis Martínez) in mixed-species forest from Mexico. The total dataset considered 1,000 (11,472 measured trees) randomly selected from 14,390 temporary forest inventory plots and the dataset was randomly divided into two parts; 50% for training and 50% for testing. An unsupervised clustering analysis was used to grouped the dataset into 10 clusters based on k-means clustering method and plot-variables like density, basal area, mean dbh, mean h, quadratic mean diameter, altitude and aspect. The RBPANN was performed for tangent hyperbolicus (RBPANN-tanh), softplus (RBPANN-softplus), and logistic (RBPANN-logistic) activation functions for functions in cross product of the covariate or neurons and the weights for the ANN analysis. For both training and testing, 10 classical statistics (e.g., RMSE, R2, AIC, BIC, logLik) were computed for the residual values and assess the approaches for h—dbh relationship. For training and testing, the ANNs approach outperformed the NLMEM approach, and the RBPANN-tanh has the best performance in both training and testing phases.

Hospital readmission and length of stay prediction provide info to manage hospitals’ bed capacity and the number of required staff, especially during pandemics. We present a hybrid deep model called Genetic Algorithm-Optimized Convolutional Neural Network (GAOCNN) with a unique preprocessing method to predict hospital readmission and the length of stay in patients having various conditions. GAOCNN uses one-dimensional convolutional layers to predict hospital readmission and length of stay. The parameters of the layers are optimized using a genetic algorithm. To show the performance of the proposed model in patients with various conditions, we evaluate the model under three healthcare datasets; the Diabetes 130-US hospitals dataset, the COVID-19 dataset, and the MIMIC-III dataset. The diabetes 130-US hospitals dataset has information on both readmission and the length of stay, while COVID-19 and MIMIC-III datasets just include information on the length of stay. Experimental results show that the proposed model’s accuracy for hospital readmission is 97.2% for diabetic patients. Also, the accuracy of the length of stay prediction is 89%, 99.4%, and 94.1% for diabetic, COVID-19, and ICU patients, respectively. These results confirm the superiority of the proposed model compared to existing methods. Our findings offer a platform for managing healthcare funds and resources for patients with various diseases.

Soil moisture maps are essential for hydrological, agricultural and risk assessment applications. To best meet these requirements, it is essential to develop soil moisture products at high spatial resolution which is now made possible using the free Sentinel-1 (S1) SAR (Synthetic Aperture Radar) data. Some soil moisture retrieval techniques using S1 data relied on the use of a priori weather information in order to increase the precision of soil moisture estimates, which required access to a weather forecasting framework. This paper presents an improved and fully automated solution for high-resolution soil moisture mapping in bare agricultural areas. The proposed solution derives a priori weather information directly from the original Sentinel images, thus bypassing the need for a weather forecasting framework. For soil moisture estimation, the neural network technique was implemented to ensure the optimum integration of radar information. The neural networks were trained using synthetic data generated by the modified Integral Equation Model (IEM) model and validated on real data from two study sites in France and Tunisia. Main findings showed that the use of radar signal averaged over grids of a few km2 in addition to radar signal at plot scale instead of a priori weather information, provides good soil moisture estimations. The accuracy is even slightly better comparatively to the accuracy obtained using a priori weather information.

Grapes are a globally popular fruit, with grape cultivation worldwide being second only to citrus. This article focuses on the low efficiency and accuracy of traditional manual grading of red grape external appearance and proposes a small-sample red grape external appearance grading model based on transfer learning with convolutional neural networks (CNNs). Initially, the CNN transfer learning method was used to transfer the pre-trained AlexNet, VGG16, GoogleNet, InceptionV3, and ResNet50 network models on the ImageNet image dataset to the red grape image grading task. By comparing the classification performance of the CNN models of these five different network depths with fine-tuning, ResNet50 with a learning rate of 0.001 and a loop number of 10 was determined to be the best feature extractor for red grape images. Moreover, given the small number of red grape image samples in this study, different convolutional layer features output by the ResNet50 feature extractor were analyzed layer by layer to determine the effect of deep features extracted by each convolutional layer on SVM classification performance. This analysis helped to obtain a ResNet50+SVM red grape external appearance grading model based on the optimal ResNet50 feature extraction strategy. Experimental data showed that the classification model constructed using the feature parameters extracted from the 10th node of the ResNet50 network achieved an accuracy rate of 95.08% for red grape grading. These research results provide a reference for the online grading of red grape clusters based on external appearance quality and have certain guiding significance for the quality and efficiency of grape industry circulation and production.

Effortful control (EC) describes individual differences in self-regulation, with a strong attentional basis. Moreover, during early childhood EC has a central role on children’s socio-emotional adjustment and academic achievement. The aim of the current study was to predict the development of EC at 36 months of age from early attentional and environmental measures taken in infancy using a machine learning approach. A sample of 75 infants participated in a longitudinal study running different waves of data collection at 6, 9 and 36 months of age. Attentional tasks were administered at 6 months of age and two additional measures were collected at 9 months of age. Parents reported household environment variables during wave 1, and their child’s EC at 36 months. A machine -learning algorithm was implemented to identify children with low EC scores at 36 months of age. An “attention only” model showed greater predictive sensitivity than the “environmental only” model. However, a model including both attentional and environmental variables was able to classify the groups (Low-EC vs Average-to-High EC) with 100% accuracy. Sensitivity analyses indicate that socio-economic variables together with attention control processes at 6-months, and self-restraint capacity at 9-months, are the most important predictors of EC. Results suggest a foundational role of executive attention processes in the development of EC in complex interaction with household environment and provide a new tool to identify early markers of socio-emotional regulation development.

Multivariate predictive analysis of the Stream-Water (SW) parameters (discharge, water level, temperature, dissolved oxygen, pH, turbidity, and specific conductance) is a pivotal task in the field of water resource management during the era of rapid climate change. The highly dynamic and evolving nature of the meteorological and climatic features have a significant impact on the temporal distribution of the SW variables in recent days making the SW variables forecasting even more complicated for diversified water-related issues. To predict the SW variables, various physics-based numerical models are used using numerous hydrologic parameters. Extensive lab-based investigation and calibration are required to reduce the uncertainty involved in those parameters. However, in the age of data-informed analysis and prediction, several deep learning algorithms showed satisfactory performance in dealing with sequential data. In this research, a comprehensive Explorative Data Analysis (EDA) and feature engineering were performed to prepare the dataset to obtain the best performance of the predictive model. Long Short-Term Memory (LSTM) neural network regression model is trained using over several years of daily data to predict the SW variables up to one week ahead of time (lead time) with satisfactory performance. The performance of the proposed model is found highly adequate through the comparison of the predicted data with the observed data, visualization of the distribution of the errors, and a set of error matrices. Higher performance is achieved through the increase in the number of epochs and hyperparameter tuning. This model can be transferred to other locations with proper feature engineering and optimization to perform univariate predictive analysis and potentially be used to perform real-time SW variables prediction.

In the current manuscript, a novel software application for Rapid Damage Assessment of RC buildings subjected to earthquake excitation is presented based on Artificial Neural Networks. The software integrates the use of a novel deep learning methodology for Rapid Damage Assessment into modern software development platforms, while the developed graphical user interface promotes the ease of use even from non-experts. The aim is to foster actions both in the pre- and post- earthquake phase. The structure of the source code permits the usage of the application either autonomously as a software tool for Rapid Visual Inspections of buildings prior to or after a strong seismic event or as a component of Building Information Modelling systems in the framework of digitizing building data and properties. The methodology implemented for the estimation of the RC buildings’ damage states is based on the theory and algorithms of Pattern Recognition problems. The effectiveness of the developed software is successfully tested using an extended, numerically generated database of RC buildings subjected to recorded seismic events

This paper presents a study of an automated system for identifying planktic foraminifera at the species level. The system uses a combination of deep learning methods, specifically Convolutional Neural Networks (CNNs), to analyze digital images of foraminifera taken at different illumination angles. The dataset is composed of 1437 groups of sixteen grayscale images, one group for each foraminifer, that are then converted to RGB images with various processing methods. These RGB images are fed into a set of CNNs, organized in an Ensemble Learning (EL) environment. The ensemble is built by training different networks using different approaches for creating the RGB images. The study finds that an ensemble of CNN models trained on different RGB images improves the system's performance compared to other state-of-the-art approaches. The proposed system was also found to outperform human experts in classification accuracy.

In this paper we propose a computational framework that merges mechanistic modeling with deep neural networks obeying the Systems Biology Markup Language (SBML) standard. Over the last 20 years, the systems biology community has developed a large number of mechanistic models in SBML that are currently stored in public databases. With the proposed framework, existing SBML mechanistic models may be upgraded to hybrid systems through the incorporation of deep neural networks into the model core, using a freely available python tool. The so-formed hybrid mechanistic/neural network models are trained with a deep learning algorithm based on the adaptive moment estimation method (ADAM), stochastic regularization and semidirect sensitivity equations. The trained hybrid models are encoded in SBML and stored back in model databases, where they can be further analyzed as regular SBML models. The application of this approach is illustrated with three well-known case studies: the threonine synthesis model in Escherichia coli, the P58IPK signal transduction model, and the Yeast glycolytic oscillations model. The proposed framework is expected to greatly facilitate the widespread use of hybrid modeling techniques for systems biology applications.

Working memory (WM) is a brain system for short-term storage and manipulation of information and plays an important role in complex cognitive tasks. In the synaptic theory of WM memorized elements are stored in the form of short-term potentiated connections in a sample population of neurons. In this paper, we show that such populations can be formed due to the mechanisms of spike-timing-dependent plasticity (STDP) – the phase dependence associated with the ratio of the pulse times of the interacting neurons. We propose a WM model considering two types of plasticity: short-term plasticity and STDP. We have shown formation of neuronal clusters encoding items in the WM model, that can be formed by external stimulation of a group of neurons due to the mechanisms of STDP and hold and reactivated by short-term plasticity mechanisms. The dynamic formation of neuronal clusters instead of pre-formed clusters gives additional flexibility to the model.

The Median American Sign Language Interpretation Software (ASL) Interpretation Software is a web application that is capable of interpreting American Sign Language in real-time, utilizing an internet connection and a primary web camera, complete with basic phrases and letters. Extensive use of Deep Learning and Neural Networks, specifically Convoluted Neural Networks, enables Median to interpret video inputs and generate accurate results directly displayed to the user in text format. The ultimate goal for Median is to have it act as a bridge between hearing people and members of the deaf community, allowing deaf people to communicate with non-signing people using American Sign Language. Furthermore, Median has been designed to benefit people who lack access to a human ASL Translator, as its format as a website allows it to be accessible anywhere at any time, giving increased availability over human interpreters. Median is designed to be a very versatile program with great potential for growth and expansion.

Neural networks require a large quantity of training spectra and detector responses in order to learn to solve the inverse problem of neutron spectrum unfolding. In addition, due to the under-determined nature of unfolding, non-physical spectra which would not be encountered in usage should not be included in the training set. While physically realistic training spectra are commonly determined experimentally or generated through Monte Carlo simulation, this can become prohibitively expensive when considering the quantity of spectra needed to effectively train an unfolding network. In this paper, we present three algorithms for the generation of large quantities of realistic and physically motivated neutron energy spectra. Using an IAEA compendium of 251 spectra, we compare the unfolding performance of neural networks trained on spectra from these algorithms, when unfolding real-world spectra, to two baselines. We also investigate general methods for evaluating the performance of and optimizing feature engineering algorithms.

Embedding representation models characterize each word as a vector of numbers with a fixed length. These models have been used in tasks involving text classification, such as recommen- dation and question-answer systems. Semantic relationships are words with a relationship between them providing a complete idea to a text. Therefore, it is hypothesized that an embedding model involving semantic relationships will provide better performance for tasks that use them. This paper presents three embedding models based on semantic relations extracted fromWikipedia to classify texts. The synonym, hyponym, and hyperonym semantic relationships were the ones considered in this work since previous experiments have shown that they are the ones that provide the most semantic knowledge. Lexical-syntactic patterns present in the literature were implemented and subsequently applied to the Wikipedia corpus to obtain the semantic relationships present in it. Several semantic relationships are used in different models: synonymy, hyponym-hyperonym, and a combination of the first two. A convolutional neural network was trained for text classification to evaluate the performance of each model. The results obtained were evaluated with the metrics of precision, accuracy, recall, and F1-measure. The best values obtained with the second model were accuracy of 0.79 for the 20-Newsgroup corpus. F1-measure and recall of 0.87 respectively for the Reuters corpus.

This paper presents the development and implementation of a machine learning model to estimate the future price of commodities in the Brazilian market from technical analysis indicators. For this, two databases were obtained regarding the commodities sugar, cotton, corn, soybean and wheat, which were submitted to the steps of data cleaning, pre-processing and subdivision. From the pre-processed data, recurrent neural networks of the long short-term memory type were used to perform the prediction of data in the interval of 1 and 3 days ahead. These models were evaluated using mean squared error, obtaining an accuracy between 0.00010 and 0.00037 on the test data for 1 day ahead and 0.00015 to 0.00041 for 3 days ahead. However, based on the results obtained, it can be stated that the developed model obtained a good prediction performance for all commodities evaluated.

Fog, haze, or smoke are usual atmospheric phenomena that dramatically compromise the overall visibility of any scene, critically affecting features such as illumination, contrast, and contour detection of objects. The decrease in visibility compromises the performance of computer vision algorithms such as pattern recognition and segmentation, some of them very relevant for decision-making for the security or autonomous vehicle industries. Several dehazing methods have been proposed, however, to the best of our knowledge, all proposed metrics compare the defogged image to its ground truth for evaluation of the defogging algorithms, or need to estimate parameters through physical models. This fact hinders progress in the field as obtaining proper ground truth images is costly and time-consuming, and physical parameters greatly depend on the scene conditions. This paper aims to tackle this issue by proposing a contour-based metric for image defogging evaluation that does not need a ground truth image. The proposed metric only requires the original hazy RGB image and the RGB image after the defogging procedure. A comparison of the proposed metric with metrics currently used in the NTIRE 2018 defogging challenge is performed to prove its effectiveness in a general situation, showing comparable results to conventional metrics.

We developed an artificial neural network as an air quality model and estimated the scope of the impact of climate change on future (until 2064) summertime trends of hourly Ozone (O3) concentrations at an urban air quality station in Tehran, Iran. Our developed scenarios assume that present-time emissions conditions of O3 precursors will remain constant in the future. Therefore, only the impact of climate change on future O3 concentrations is investigated in this study. GCM projections indicate more favorable climate conditions for O3 formation over the study area in the future: the surface temperature increases over all months of the year, solar radiation increases, and precipitation decreases in future summers, and summertime daily maximum temperature increases about 1.2 ∘C to 3 ∘C until 2064. In the scenario based on present-time O3 conditions in 2012 summer without any axceedances, the summertime exceedance days of 8-hr O3 standard are projected to increase in the future by about 4.2 days in the short term and about 12.3 days in the mid-term. Similarly, in the scenario based on present-time O3 conditions in 2010 summer with 58 days of exceedance from 8-hr O3 standard, exceedances are projected to increase about 4.5 days in the short term and about 14.1 days in the mid-term. Moreover, the number of Unhealthy and Very Unhealthy days in 8-hr AQI is also projected to increase based on pollution scenarios of both summers.

Recent biotechnological innovations make feasible the new paradigm of creating biological neural circuits de novo. With advances in protein, cell and tissue engineering techniques, as well as cellular reprogramming methods, we are entering an era where the construction of neural circuits can open completely new ways for studying nervous systems and for treating nervous system disorders. I explore here three technologies, namely cellular engraftment, neuronal reprogramming and transsynaptic molecule engineering, and delineate how they are being used in a variety of basic research and translational medicine contexts. In basic neuroscience, neural circuit construction methods are enabling ways to study causality in neural development (e.g. neural precursor differentiation and migration) and circuit function (e.g. excitation/inhibition balance, neural population dynamics). In translational neuroscience, they are providing opportunities for the targeted correction of circuit malfunction in brain disorders, both psychiatric (e.g. schizophrenia) and neurological (e.g. Parkinson’s, Huntington’s and Alzheimer’s disease, as well as epilepsy). I discuss the challenges that these methods currently face, such as targeting specificity and cell survival, and outline future paths and opportunities to realize the full potential of technologies for creating new biological neural circuits.

According to the risk investigations of being involved in an accident, alcohol-impaired driving is one of the major causes of motor-vehicles accidents. Preventing highly intoxicated persons from driving would potentially save many lives. This paper proposes a lightweight in-vehicle alcohol detection that processes the data generated from 6-alcohol sensors (MQ-3 Alcohol Sensors) using an optimizable shallow neural network (O-SNN). The experimental evaluation results exhibit a high-performance detection system scoring a 99.8% of detection accuracy with a very short inferencing delay of 2.22 µ seconds. Hence, the proposed model can be efficiently deployed and used to discover in-vehicle alcohol with high accuracy and low inference overhead as a part of the driver alcohol detection system for safety (DADSS) system aiming at massive deployment of alcohol sensing systems that could potentially save thousands of lives annually.

The fatigue life of concrete is affected by many interwoven factors whose effect is nonlinear. Be-cause of its unique self-learning ability and strong generalization capability, the Bayesian regu-larized backpropagation neural network (BR-BPNN) is proposed to predict concrete behavior in tensile fatigue. The optimal model was determined through various combinations of network parameters. The average relative impact value (ARIV) was constructed to evaluate the correla-tion between fatigue life and its influencing parameters (maximum stress level Smax, stress ratio R, static strength f, failure probability P). ARIV results were also compared with other factor as-sessment methods (weight equation and multiple linear regression analyses). Using BR-BPNN, S-N curves were then obtained for the combinations of R=0.1, 0.2, 0.5; f=5, 6, 7MPa; P=5%, 50%, 95%. The tensile fatigue results under different testing conditions were finally compared for compatibility. It was concluded that Smax has the most significant negative effect on fatigue life; the degree of influence of R, P, and f, which positively correlate with fatigue life, decreases suc-cessively. ARIV is confirmed as a feasible way to analyze the importance of parameters and could be recommended for future applications. The tensile fatigue performance of plain concrete under different stress states (flexural tension, axial tension, splitting tension) does not differ sig-nificantly. Besides utilizing the valuable fatigue test data scattered in the literature, insights gained from this work could provide a reference for subsequent fatigue test program design and fatigue evaluation.

Deep neural networks (DNNs), founded on the brain's neuronal organization, can extract higher-level features from raw input. However, complex intellect via autonomous decision-making is way beyond current AI design. Here we propose an autonomous AI inspired by the thermodynamic cycle of sensory perception, operating between two information density reservoirs. Stimulus unbalances the high entropy resting state and triggers a thermodynamic cycle. By recovering the initial conditions, self-regulation generates a response while accumulating an orthogonal, holographic potential. The resulting high-density manifold is a stable memory and experience field, which increases future freedom of action via intelligent decision-making.

Driver drowsiness is one of the leading causes of traffic accidents. This paper proposes a new method for classifying driver drowsiness using deep convolution neural networks trained by wavelet scalogram images of electrocardiogram (ECG) signals. Three different classes were de-fined for drowsiness based on video observation of driving tests performed in a simulator for manual and automated modes. The Bayesian optimization method is employed to optimize the hyperparameters of the designed neural networks, such as the learning rate and the number of neurons in every layer. To assess the results of the deep network method, Heart Rate Variability (HRV) data is derived from the ECG signals, some features are extracted from this data, and finally, random forest and k-nearest neighbors (KNN) classifiers are used as two traditional methods to classify the drowsiness levels. Results show that the trained deep network achieves balanced accuracies of about 77% and 79% in the manual and automated modes, respectively. However, the best obtained balanced accuracies using traditional methods are about 62% and 64%. We conclude that designed deep networks working with wavelet scalogram images of ECG signals significantly outperform KNN and random forest classifiers which are trained on HRV-based features.

Based on the satellite attitude control method, this paper proposes an attitude control method based on neural network disturbance compensation. The paper firstly analyzes the neural network algorithm and proposes an orthogonal least squares algorithm to implement network learning. In this paper, a set of high-precision directional neural network compensation controllers is designed for the attitude control of acupuncture small satellites. The feasibility of the improved orthogonal least-squared algorithm combined with the neural network supplementary control method in satellite attitude control is verified by experiments.

In the last few decades, glaucoma became the second biggest leading cause of irreversible vision loss. Because of its asymptotic growth, it is not properly diagnosed until the relatively late stage. To stop the severe damage by glaucoma it is needed to detect glaucoma in its early stages. Surprisingly diabetes also be the greatest cause of glaucoma. In the modern era, artificial intelligence makes great progress in the medical image processing field. Image analysis based on machine learning gives a huge success in diagnosis glaucoma without any misdiagnosis. The aim of this proposed paper is to create an automated process that can detect glaucoma and diabetic retinopathy. Here various Machine Learning models are used and results of these methods are presented.

The automatic classification of bird sounds is an ongoing research topic and several results have been reported for the classification of selected bird species. In this contribution we use an artificial neural network fed with pre-computed sound features to study the robustness of bird sound classification. We investigate in detail if and how classification results are dependent on the number of species and the selection of species in the subsets presented to the classifier. In more detail, a bag-of-birds approach is employed to randomly create balanced subsets of sounds from different species for repeated classification runs. The number of species present in each subset is varied between 10 and 300, randomly drawing sounds of species from a dataset of 659 bird species taken from Xeno-Canto database. We observe that the shallow artificial neural network trained on pre-computed sound features is able to classify the bird sounds relatively well. The classification performance is evaluated using several common measures such as precision, recall, accuracy, mean average precision and area under the receiver operator characteristics curve. All of these measures indicate a decrease in classification success as the number of species present in the subsets is increased. We analyze this dependence in detail and compare the computed results to an analytic explanation assuming dependencies for an idealized perfect classifier. Moreover, we observe that the classification performance depends on the individual composition of the subset and varies across 20 randomly drawn subsets.

Substances that can modify the androgen receptor pathway in humans and animals are entering the environment and food chain with the proven ability to disrupt hormonal systems and leading to toxicity and adverse effects on reproduction, brain development, and prostate cancer, among others. State-of-the-art databases with experimental data of human, chimp, and rat effects by chemicals have been used to build machine learning classifiers and regressors and evaluate these on independent sets. Different featurizations, algorithms, and protein structures lead to dif- ferent results, with deep neural networks (DNNs) on user-defined physicochemically-relevant features developed for this work outperforming graph convolutional, random forest, and large featurizations. The results show that these user-provided structure-, ligand-, and statistically-based features and specific DNNs provided the best results as determined by AUC (0.87), MCC (0.47), and other metrics and by their interpretability and chemical meaning of the descriptors/features. In addition, the same features in the DNN method performed better than in a multivariate logistic model: validation MCC = 0.468 and training MCC = 0.868 for the present work compared to evalu- ation set MCC = 0.2036 and training set MCC = 0.5364 for the multivariate logistic regression on the full, unbalanced set. Techniques of this type may improve AR and toxicity description and predic- tion, improving assessment and design of compounds. Source code and data are available at https://github.com/AlfonsoTGarcia-Sosa/ML

Satellite Image Time Series (SITS) is a data set which includes satellite images across several years with a high acquisition rate. Radiometric normalization is a fundamental and important preprocessing method for remote sensing applications using SITS due to the radiometric distortion caused by noise between images. Normalizing the subject image based on the reference image is a general strategy when using traditional radiometric normalization methods to normalize multi-temporal imagery (usually two scenes or three scenes in different time phases). However, these methods are not suitable for calibrating SITS because they cannot minimize the radiometric distortion between any pair of images in SITS. The existing relative radiometric normalization methods for SITS are based on linear assumptions which cannot effectively reduce nonlinear radiometric distortion caused by continuously changing noise in SITS. To overcome this problem and obtain a more accurate SITS, this study proposed a Nonlinear Radiometric Normalization Model (named NMAG) for SITS based on Artificial Neural Networks (ANN) and Greedy Algroithm (GA) . In this method, GA was used to determine the correction order of SITS and calculate the error between the image to be corrected and normalized images, which avoided the selection of a single reference image. ANN was used to obtain the optimal solution of error function, which minimized the radiometric distortion between different images in SITS. SITS composed of 21 Landsat-8 images in Tianjin City from October 2017 to January 2019 were selected to test the method. We compared NMAG with other two contrasting method (refered as CM1 and CM2), and found that the average of root mean square error $(\mu_{RMSE})$ of NMAG $(497.22)$ was significantly smaller than those of CM1 $(641.39)$ and CM2 $(543.47)$, and the accuracy of normalized SITS obtained by using NMAG has increased by 22.4\% and 8.5\% toward CM1 and CM2, respectively. These experimental results confirmed the effectiveness of NMAG in the reduction of radiometric distortion caused by continuously changing noise between images in SITS.

Considering the significant advancements in autonomous vehicle technology, research in this field is of interest to researchers. To drive vehicles autonomously, controlling steer angle, gas hatch, and brakes need to be learned. The behavioral cloning method is used to imitate humans’ driving behavior. We created a dataset of driving in different routes and conditions and using the designed model, the output used for controlling the vehicle is obtained. In this paper, the Learning of Self-driving Vehicles Based on Real Driving Behavior Using Deep Neural Network Techniques (LSV-DNN) is proposed. We designed a convolutional network which uses the real driving data obtained through the vehicle’s camera and computer. The response of the driver is during driving is recorded in different situations and by converting the real driver’s driving video to images and transferring the data to an excel file, obstacle detection is carried out with the best accuracy and speed using the Yolo algorithm version 3. This way, the network learns the response of the driver to obstacles in different locations and the network is trained with the Yolo algorithm version 3 and the output of obstacle detection. Then, it outputs the steer angle and amount of brake, gas, and vehicle acceleration. The LSV-DNN is evaluated here via extensive simulations carried out in Python and TensorFlow environment. We evaluated the network error using the loss function. By comparing other methods which were conducted on the simulator’s data, we obtained good performance results for the designed network on the data from KITTI benchmark, the data collected using a private vehicle, and the data we collected.

Periodontitis is microbial infection affecting periodontium, the tooth supporting structure and affects >743 million people worldwide. Neural crest-derived stem cells (NCSCs) hold the promise to regenerate the damaged periodontium. These cells have been identified within adult adipose tissue, periodontal ligament, and palatal tissue. Typical enzymatic isolation protocols are expensive, time consuming and often not clinically compliant. Enzyme-free, mechanical dissociation has been suggested as an alternative method of generating cell suspensions required for cell separation and subsequent expansion ex vivo. In our study, samples of rat skeletal muscle tissue were used to appraise the suitability of a novel mincing method of mechanical dissociation against enzymatic digestion with collagenase and dispase. Skeletal muscle is readily available and has been shown to contain NCSC populations. We used a Rigenera-Human Brain Wave^® prototype mincer to produce a suspension of skeletal muscle-derived cells modeling NCSCs. We have compared the resulting cell cultures produced via mechanical dissociation and enzymatic dissociation, producing single cell suspensions suitable for Magnetic Cell Sorting (MACs) and Fluorescence-activated cell sorting (FACS). Despite the Countess Automated Cytometry data demonstrating that cell suspensions produced by mechanical dissociation (n=24) contain on average 26.8 times as many viable cells as enzymatic cell suspensions (n=18), enzymatic suspensions produced more successful cell cultures. Spheroids and subsequently adherent cells formed from 4 enzymatic cell suspensions (44.4%) vs. 1 mechanical cell suspension (8.3%). Enzymatic digestion protocols formed spheroids faster and more plentifully than mechanical cell suspensions. Adherent cells and spheroids isolated via both methods appear morphologically similarly to NCSCs from our previous studies.

This study aims to develop a hybrid approach based on backpropagation Artificial Neural Network (ANN) and spatial analysis techniques to predict particulate matter of size 2.5 µm (PM2.5) from vehicle exhaust emissions in the State of California using Aerosol Optical Depth (AOD) and several climatic indicators (relative humidity, temperature, precipitation, and wind speed). The PM2.5 data were generated using Motor Vehicle Emission Simulator (MOVES), the measured climatic variables and AOD were obtained from the California Irrigation Management Information System (CIMIS), and NASA’s Moderate Resolution Spectroradiometer (MODIS). The data were resampled to a seasonal format and downscaled over grids of 10 by 10 to 150 by 150, and precipitation was determined to be the most important independent variable. Coefficient of determination ( ), Mean Absolute Percentage Error (MAPE), and Root Mean Square Error (RMSE) were used to assess the quality of the ANN prediction model. The model peaked at winter seasons with = 0.984, RMSE = 0.027, and MAPE = 25.311, whereas it had the lowest performance in summer with = 0.920, RMSE = 0.057, and MAPE = 65.214. These results indicate that the ANN model can accurately predict the PM2.5 concentration and can be used to forecast future trends.

In this paper, Lyapunov-Razumikhin technique, design of state-dependent switching laws, a fixed point theorem and variational methods are employed to derive the existence and the unique existence results of (globally) exponentially stable positive stationary solution of delayed reaction-diffusion cell neural networks under Dirichlet zero boundary value, including the global stability criteria \textbf{in the classical meaning}. Next, sufficient conditions are proposed to guarantee the global stability invariance of ordinary differential systems under the influence of diffusions. New theorems show that the diffusion is a double-edged sword in judging the stability of diffusion systems. Besides, an example is constructed to illuminate that any non-zero constant equilibrium point must be not in the phase plane of dynamic system under Dirichlet zero boundary value, or it must lead to a contradiction. Next, under Lipschitz assumptions on active function, another example is designed to prove that the small diffusion effect will cause the essential change of the phase plane structure of the dynamic behavior of the delayed neural networks via a Saddle point theorem. Finally, a numerical example illustrates the feasibility of the proposed methods.

The paper proposes a new principle of finding and removing elements of mathematical model, redundant in terms of parametric identification of the model. It allows reducing computational and time complexity of the applications built on the model. Especially this is important for AI based systems, systems based on IoT solutions, distributed systems etc. Besides, the complexity reduction allows increasing an accuracy of mathematical models implemented. Despite the model order reduction methods are well known, they are extremely depended however on the problem area. Thus, proposed reduction principles can be used in different areas, what is demonstrated in this paper. The proposed method for the reduction of mathematical models of dynamic systems allows also the assessment of the requirements for the parameters of the simulator elements to ensure the specified accuracy of dynamic similarity. Efficiency of the principle is shown on the ordinary differential equations and on the neural network model. The given examples demonstrate efficient normalizing properties of the reduction principle for the mathematical models in the form of neural networks.

This study aims to evaluate a new approach in modeling gully erosion susceptibility based on deep learning neural network (DLNN) model, ensemble Particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN) and comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shiran watershed, Iran. For this purpose, 13 independent variables affecting gully erosion susceptibility in the study area, including altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from river, land use, soil, lithology, rainfall, , stream power index (SPI), topographic wetness index (TWI), were prepared. Also, 132 gully erosion locations were identified during field visits. Data for modeling were divided into two categories of training (70%) and testing (30%). Receiver operating characteristic (ROC) parameters including sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and area under curve (AUC) were used to evaluate the performance of the models. The results showed that, the AUC values from ROC with considering testing datasets of PSO-DLNN is 0.89 and which is associated with superb accuracy. Rest of the models also associated with optimal accuracy and near about PSO-DLNN model; the AUC values from ROC of DLNN, SVM and ANN for testing datasets are 0.87, 0.85 and 0.84 respectively. The PSO algorithm has updated and optimized the weights of DLNN model, and as a result, the efficiency of this model in predicting gully erosion susceptibility has increased. Therefore, it can be concluded that the use of DLNN model and its ensemble with PSO algorithm can be used as a novel and practical method in predicting the susceptibility of gully erosion that helps planners and managers in managing and reducing the risk of this phenomenon.

An autonomous concrete crack inspection system is necessary for preventing hazardous incidents arising from deteriorated concrete surfaces. In this paper, we represent a concrete crack detection framework to aid the process of automated inspection. The proposed approach employs a deep convolutional neural network architecture for crack segmentation from concrete image. The proposed network alleviates the effect of gradient vanishing problem present in deep neural network architectures. A feature silencing module is incorporated in the crack detection framework, for eliminating unnecessary feature maps from the network. The overall performance of the network significantly improves as a result. Experimental results support the benefit of incorporating feature silencing within a convolutional neural network architecture for improving the network’s robustness, sensitivity, and specificity. An added benefit of the proposed architecture is its ability to accommodate for the trade-off between specificity (positive class detection accuracy) and sensitivity (negative class detection accuracy) with respect to the target application. Furthermore, the proposed framework achieves a high precision rate and processing time than crack detection architectures present in literature.

Banks are normally offered two kinds of deposit accounts. It consists of deposits like current/saving account and term deposits like fixed or recurring deposits. For enhancing the maximized profit from bank as well as customer perspective, term deposit can accelerate uplifting of finance fields. This paper focuses on likelihood of term deposit subscription taken by the customers. Bank campaign efforts and customer detail analysis can influence term deposit subscription chances. An automated system is approached in this paper that works towards prediction of term deposit investment possibilities in advance. This paper proposes deep learning based hybrid model that stacks Convolutional layers and Recurrent Neural Network (RNN) layers as predictive model. For RNN, Gated Recurrent Unit (GRU) is employed. The proposed predictive model is later compared with other benchmark classifiers such as k-Nearest Neighbor (k-NN), Decision tree classifier (DT), and Multi-layer perceptron classifier (MLP). Experimental study concludes that proposed model attains an accuracy of 89.59% and MSE of 0.1041 which outperform well other baseline models.

Lung cancer is known as lung carcinoma. It is a disease which is malignant tumor leading to the uncontrolled cell growth in the lung tissue. Lung Cancer disease is one of the most prominent cause of death in all over world. Early detection of this disease can assist medical care unit as well as physicians to provide counter measures to the patients. The objective of this paper is to approach an automated tool that takes influential causes of lung cancer as input and detect patients with higher probabilities of being affected by this disease. A neural network classifier accompanied by cross-validation technique is proposed in this paper as a predictive tool. Later, this proposed method is compared with another baseline classifier Gradient Boosting Classifier in order to justify the prediction performance.

Accurate and efficient traffic incident detection methods can effectively alleviate traffic congestion caused by traffic incidents, prevent secondary accidents and improve the safety of urban road traffic.Aiming at the problems that the traditional machine learning event detection method cannot fully extract the parameter characteristics of traffic flow and is not suitable formulti-dimensional and non-linear massive data, we propose a new traffic event detection method(CNN-XGBoost).This method combines the respective advantages of Convolution Neural Network(CNN) and Extreme Gradation Boosting (XGBoost). Firstly, we preprocessed the original freeway traffic incident detection data set by constructing initial variable set, data normalization, data balance processing and dimension reorganization. Secondly,we use CNN network to automatically extract the deep features of event detection data, and use XGBoost as a classifier to classify the extracted features for expressway traffic event detection.Finally, we use the data set of Hangzhou expressway microwave detector in China to carry out simulation experiments on CNN-XGBoost. The experimental results show that compared with XGBoost, CNN, Support Vector Machine (SVM) and Gradient Boosting Decision Tree (GBDT) and other methods, CNN-XGBoost method can effectively improve the accuracy of expressway traffic event detection and has better generalization ability.

In recent years, the field of deep learning achieved considerable success in pattern recognition, image segmentation and may other classification fields. There are a lot of studies and practical applications of deep learning on images, video or text classification. In this study, we suggest a method for changing the architecture of the most performing CNN models with the aim of designing new models to be used as stand-alone networks or as a component of an ensemble. We propose to replace each activation layer of a CNN (usually a ReLu layer) by a different activation function stochastically drawn from a set of activation functions: in this way the resulting CNN has a different set of activation function layers.

An application of deep convolutional neural network and recurrence plot for financial market movement prediction is presented. Though it is challenging and subjective to interpret its information, the pattern formed by a recurrence plot provide a useful insight into the dy- namical system. We used a recurrence plot of seven financial time series to train a deep neural network for financial market movement predic- tion. Our approach is tested on our dataset and achieved an average of 53.25% classification accuracy. The result suggests that a well trained deep convolutional neural network can learn a recurrence plot and pre- dict a financial market direction.

We present a new computing package Flagser, designed to construct the directed flag complex of a finite directed graph, and compute persistent homology for flexibly defined filtrations on the graph and the resulting complex. The persistent homology computation part of Flagser is based on the program Ripser [2], but is optimised specifically for large computations. The construction of the directed flag complex is done in a way that allows easy parallelisation by arbitrarily many cores. Flagser also has the option of working with undirected graphs. For homology computations Flagser has an Approximate option, which shortens compute time with remarkable accuracy. We demonstrate the power of Flagser by applying it to the construction of the directed flag complex of digital reconstructions of brain microcircuitry by the Blue Brain Project and several other examples. In some instances we perform computation of homology. For a more complete performance analysis, we also apply Flagser to some other data collections. In all cases the hardware used in the computation, the use of memory and the compute time are recorded.

Previously we demonstrated, in rats, that the treatment with growth hormone (GH) and rehabilitation, carried out immediately after a motor cortical ablation, significantly improved the motor affectation produced by the lesion and induced the re-expression of nestin in the contralateral motor cortex. Here we analyze cortical proliferation after ablation of the frontal motor cortex and investigate the re-expression of nestin in the contralateral motor cortex and the role of the striatum and thalamus in motor recovery. The rats were subjected to ablation of the frontal motor cortex in the dominant hemisphere or sham-operated and immediately treated with GH or vehicle (V), for five days. At 1 dpi (days after injury), 5 rats received daily injections (4 days) of bromodeoxyuridine and were sacrificed. The other 15 rats (n = 5 / group) underwent treatment and rehabilitation and were sacrificed at 25 dpi. GH induced the greatest number of proliferating cells in the perilesional cortex. GH and rehabilitation produced the functional recovery of the motor lesion and increased the expression of nestin in the striatum. In the thalamic ventral nucleus ipsilateral to the lesion, cells positive for nestin and actin were detected, but this was independent of GH. Our data suggest that GH-induced striatal nestin is involved in motor recovery.

The study concentrates on researching possibilities of using computer image analysis and neural modeling in order to assess selected quality discriminants of spray-dried chokeberry powder. The aim of the paper is quality identification of chokeberry powders on account of their highest dying power, the highest bioactivity as well as technologically satisfying looseness of powder. The article presents neural models with vision technique backed up by devices such as digital camera as well as electron microscope. Reduction in size of input variables with PCA has influence on improving the processes of learning data sets, thus increasing effectiveness of identifying chokeberry fruit powders included in digital pictures, which is shown in the results of the conducted research. The effectiveness of image recognition are presented by classifying abilities as well as low Root Mean Square Error (RMSE), for which the best results are achieved with typology of network type Multi-Layer Perceptron (MLP). The selected networks type MLP are characterized by the highest degree of classification at 0.99 and RMSE at 0.11 at most at the same time.

A novel method for finding linear mappings among word embeddings for several languages, taking as pivot a shared, universal embedding space, is proposed in this paper. Previous approaches learn translation matrices between two specific languages, but this method learn translation matrices between a given language and a shared, universal space. The system was first trained on bilingual, and later on multilingual corpora as well. In the first case two different training data were applied; Dinu’s English-Italian benchmark data, and English-Italian translation pairs extracted from the PanLex database. In the second case only the PanLex database was used. The system performs on English-Italian languages with the best setting significantly better than the baseline system of Mikolov et al. [1], and it provides a comparable performance with the more sophisticated systems of Faruqui and Dyer [2] and Dinu et al. [3]. Exploiting the richness of the PanLex database, the proposed method makes it possible to learn linear mappings among an arbitrary number of languages.

Recently, the environment is being put under constantly increasing pressure. Globally, water shortage is considered as one of the most serious environmental problems which affect human life and plant wealth. Iraq is highly affected by water deficit in many regions. In particular, Al-Najaf region is selected to be under evaluation for the current and future water resources shortage. This study is based on the collected data for rainfall, evaporation, flow-rate, groundwater, water needed for irrigation, and daily uses for the period between 2000 and 2018. The Artificial Neural Network, normal distribution, and lognormal distribution type III are applied for analyzing the collected data in addition to predict the water shortage for year 2050. Results show a water shortage in years 2002, 2004, 2005, and 2017 only for the selected period. A Simulink model is constructed using Matlab to increase the credibility of the estimated results and gives accurate results for the groundwater and surface water needed. Where in 2050, it is found that it needs to use the groundwater source by 0.024 x 10⁹ m³ to support the surface water source which is represented by the Euphrates River. The study shows the extent of inefficient management of water resources in Al-Najaf region.

Greenhouse Gases (GHGs) emission has considerable impact on global warming and climate change. Since energy systems and their features noticeably influence on the amount of GHGs emission, it can be modeled based on the specifications of energy sources utilized by the countries. In addition, economic activity is another factor which should be considered in GHG emission modeling. In this work, Artificial Neural Network (ANN) is used for estimating carbon dioxide emission, as one of the most abundant GHGs, on the basis of shares of various energy sources used as primary energy supply and GDP as an indicator for economic activities. Five countries including Iran, Kuwait, Qatar, Saudi Arabia and United Arab Emirates (UAE) are considered as case studies. Comparing between the estimated data by the achieved model and actual quantities showed acceptable precision of the ANN model for prediction of carbon dioxide emission. The average absolute relative error and the R-squared values of the GMDH model are approximately 2.28% and 0.9998, respectively. The obtained values for the mentioned statistical criteria show the precision of the model in forecasting the emission of Co2.

Cocoa is an important commodity crop not only to produce one of the most complex products such as chocolate from the sensory perspective, but one that commonly grows in developing countries close to the tropics. This paper presents novel techniques applied using cover photography and a novel computer application (VitiCanopy) to assess the canopy architecture of cocoa trees in a commercial plantation in Queensland, Australia. From the cocoa trees monitored, pod samples were collected, fermented, dried and grinded to obtain the aroma profile per tree using gas chromatography. The canopy architecture data were used as inputs in an artificial neural network (ANN) algorithm and the aroma profile considering six main aromas as targets. The ANN model rendered high accuracy (R = 0.82; MSE = 0.09) with no overfitting. The model was then applied to a satellite image from the whole cocoa field studied to produce canopy vigor and aroma profile maps up to the tree-by-tree scale. The tool developed could aid significantly the canopy management practices in cocoa trees that have a direct effect on cocoa quality.

Precipitation downscaling is widely employed for enhancing the resolution and accuracy of precipitation products from general circulation models (GCMs). In this study, we propose a novel statistical downscaling method to foster GCMs’ precipitation prediction resolution and accuracy for monsoon region. We develop a deep neural network composed of convolution and Long Short Term Memory (LSTM) recurrent module to estimate precipitation based on well-resolved atmospheric dynamical fields. The proposed model is compared against GCM precipitation product and classical downscaling methods in the Xiangjiang River Basin in South China. Results show considerable improvement compared to the ECMWF-Interim reanalysis precipitation. Also, the model outperforms benchmark downscaling approaches, including 1) quantile mapping, 2) support vector machine, and 3) convolutional neural network. To test the robustness of the model and its applicability in practical forecast, we apply the trained network for precipitation prediction forced by retrospective forecasts from ECMWF model. Compared to ECMWF precipitation forecast, our model makes better use of the resolved dynamical field for more accurate precipitation prediction at lead time from 1 day up to 2 weeks. This superiority decreases along forecast lead time, as GCM’s skill in predicting atmospheric dynamics being diminished by the chaotic effect. At last, we build a distributed hydrological model and force it with different sources of precipitation inputs. Hydrological simulation forced with the neural network precipitation estimation shows significant advantage over simulation forced with the original ERA-Interim precipitation (with NSE value increases from 0.06 to 0.64), and the performance is just slightly worse than the observed precipitation forced simulation (NSE=0.82). This further proves the value of the proposed downscaling method, and suggests its potential for hydrological forecasts.

The continuous and precise mapping of glacier calving fronts is essential for monitoring and understanding rapid glacier changes in Antarctica and Greenland, which have the potential for significant sea level rise within the current century. This effort has been mostly restricted to the slow and painstaking manual digitalization of the calving front positions in thousands of satellite imagery products. Here, we have developed a machine learning toolkit to robustly and automatically detect glacier calving front margins in satellite imagery. The toolkit is based on semantic image segmentation using Convolutional Neural Networks (CNN) with a modified U-Net architecture to isolate the calving fronts from satellite images after having been trained with a dataset of images and their corresponding manually-determined calving fronts. As a case study we train our neural network on a varied set Landsat images with lowered resolutions from Jakobshavn, Sverdrup, and Kangerlussuaq glaciers, Greenland and test the results on novel images from Helheim glacier, Greenland to evaluate the performance of the approach. The neural network is able to identify the calving front in new images with a mean deviation of 96.3 m from the true fronts, equivalent to 1.97 pixels on average, while the corresponding error for manually-determined fronts on the same resolution images is 92.5 m. We find that the trained neural network significantly outperforms common edge detection techniques, and can be used to continuously map out calving-ice fronts with a variety of data products.

Polar mesocyclones (MCs) are small marine atmospheric vortices. The class of intense MCs, called polar lows, are accompanied by extremely strong surface winds and heat fluxes and thus largely influencing deep ocean water formation in the polar regions. Accurate detection of polar mesocyclones in high-resolution satellite data, while challenging, is a time-consuming task, when performed manually. Existing algorithms for the automatic detection of polar mesocyclones are based on the conventional analysis of patterns of cloudiness and involve different empirically defined thresholds of geophysical variables. As a result, various detection methods typically reveal very different results when applied to a single dataset. We develop a conceptually novel approach for the detection of MCs based on the use of deep convolutional neural networks (DCNNs). As a first step, we demonstrate that DCNN model is capable of performing binary classification of 500x500km patches of satellite images regarding MC patterns presence in it. The training dataset is based on the reference database of MCs manually tracked in the Southern Hemisphere from satellite mosaics. We use a subset of this database with MC diameters falling in the range of 200-400 km. This dataset is further used for testing several different DCNN setups, specifically, DCNN built “from scratch”, DCNN based on VGG16 pre-trained weights also engaging the Transfer Learning technique, and DCNN based on VGG16 with Fine Tuning technique. Each of these networks is further applied to both infrared (IR) and a combination of infrared and water vapor (IR+WV) satellite imagery. The best skills (97% in terms of the binary classification accuracy score) is achieved with the model that averages the estimates of the ensemble of different DCNNs. The algorithm can be further extended to the automatic identification and tracking numerical scheme and applied to other atmospheric phenomena characterized by a distinct signature in satellite imagery.

Quantitative structure-activity relationship (QSAR) model is adopted to study the relationship between the chemical and physical properties of various substances and the structure. Through QSAR studies, the internal relationship between the invisible structure and the activity can be obtained. In this paper, a novel chaos-enhanced accelerate particle swarm algorithm (CAPSO) is proposed, which is used to molecular descriptors screening and optimization of the weights of back propagation artificial neural network (BP ANN). Then, the QSAR model based on CAPSO and BP ANN is put forward, hereinafter referred to as CAPSO BP ANN model. The prediction experiment showed that the CAPSO algorithm is a reliable method for screening molecular descriptors and the five molecular descriptors obtained by CAPSO algorithm could well characterize the molecular structure of each compound in pKa prediction. The experimental results also showed the CAPSO BP ANN model has a good performance in predicting the pKa values of various compounds, the absolute mean relative error, root mean square error, and square correlation coefficient are respectively 0.5364, 0.0632, and 0.9438, indicating the higher prediction accuracy and correlation. The proposed hybrid intelligent model can be applied in all kinds of engineering design, prediction of physical and chemical properties and intelligent calculation.

In the field of autonomous vehicles, lane detection and control plays an important role. In autonomous driving the vehicle has to follow the path to avoid the collision. A deep learning technique is used to detect the curved path in autonomous vehicles. In this paper a customized lane detection algorithm was implemented to detect the curvature of the lane. A ground truth labelling tool box for deep learning is used to detect the curved path in autonomous vehicle. By mapping point to point in each frame 80-90% computing efficiency and accuracy is achieved in detecting path.

Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks(CNN) for face verification. In this work, we explore to use identification signal to supervise one CNN and the combination of semi-verification and identification to train the other one. In order to estimate semi-verification loss at a low computation cost, a circle, which is composed of all faces, is used for selecting face pairs from pairwise samples. In the process of face normalization, we propose to use different landmarks of faces to solve the problems caused by poses. And the final face representation is formed by the concatenating feature of each deep CNN after PCA reduction. What's more, each feature is a combination of multi-scale representations through making use of auxiliary classifiers. For the final verification, we only adopt the face representation of one region and one resolution of a face jointing Joint Bayesian classifier. Experiments show that our method can extract effective face representation with a small training dataset and our algorithm achieves 99.71% verification accuracy on LFW dataset.

Energy transition is a major structural change in the whole social system, and the energy system must be changed globally to replace fossil fuels. Hydropower is one of the largest renewable energy in the world. However the involuntary resettlees due to the construction of hydropower projects are suffering from being far away from their native land, losing the land cultivated for generations and the houses they live in, and losing the social relationship network based on geography and blood ties. Based on the system evaluation theory of reservoir resettlement and referring to relevant research findings, this paper constructs a comprehensive evaluation index framework for assessing the implementation effect of the PostRelocation Support (PReS) policy. The research region is located in Zhijin County, Bijie City, Guizhou Province, China. Accordingly, a combined method of a structural equation model and a fuzzy comprehensive evaluationary model is used in this paper to analyze the implementation of the PReS policy. The results show that the total score of implementing effects of the PReS policy is 4.4, with dramatic significance. The subindex scores of the resettlers’ family income, living conditions, and production conditions; the local economy; and social stability are 4.3, 4.6, 4.4, 4.6, and 4.3, respectively, with dramatic significance. This paper has analyzed and summarized the successful practices of implementing the PReS policy for reservoir resettlers in three dimensions: poverty alleviation, beautiful home construction and accelerating rural revitalization. Research shows that China's rural reservoir resettlers' PReS policy has been more effective in restoring the livelihoods of reservoir resettlers.

Manufacturing corporations has the acceptance of the Outsourcing Process (OP) to improve industrial activities as well as to archive the revenue objectives, and with this, Risk Analysis (RA) tools are constantly used to assure expected results. Failure Mode and Effect Analysis (FMEA) is one of preferred RA tools, moreover, it is proven that FMEA adds uncertainty because of the human participation at the RA, afterward it is demonstrated that Pythagorean Fuzzy Dimensional Analysis – FMEA – Value Stream Mapping (PFDA-FMEA-VSM) method removes the uncertainty in RA, likewise it aids to the stakeholders for decision making, giving more advantages improving the use of the resources on the project. This document exhibits a real case scenario in a manufacturing firm applying PFDA-FMEA-VSM method adapted for manufacturing OP. The application of PFDA-FMEA-VSM shows solid RA results, removing the human intervention uncertainty added to the risk ranking, gives advantages to the stakeholders for visualize the main risks in detailed diagram, as well as make easier to take better decisions on where to apply resources and mitigate risks during OP.

The city administration of China planned numerous metro projects and more metros can hardly avoid undercrossing a bridge. While metro shield construction when undercrossing a bridge (MSCUB) is frequently located in complicated natural and social context, which made the construction process more susceptible to safety accidents. Therefore, it is crucial to look into safety risk of MSCUB. The paper identified the safety risk factors during SSCUR by using literature review and experts’ evaluation, proposed a novel safety risk assessment model by integrating CFA and FER, and then selected a project case to test the validity of the suggested model. Research results show that (a) a safety risk factors list of MSCUB was identified, including 4 first-level safety risks and 37 second-level safety risk factors; (b) the proposed safety risk assessment model can be used to measure the risk values of the overall worksite safety risk, the first-level safety risks and the safety risk factors of MSCUB; (c) environment-type safety risk and personnel-type safety risk have higher risk values when shield construction undercrossing a bridge; (d) when compared to worker-type safety risk, manager-type safety risk is the higher risk value. The research can enrich the theoretic knowledge of MSCUB safety risk assessment and provide references to safety managers for conducting scientific and effective safety management on the construction site when subway undercrossing a river.

Multi-stakeholder based construction projects are subject to various risk factors due to dynamic business environments. These risks affect project activities which indirectly impact construction costs, resulting in delays and poor building quality. So, managing these project risks requires suitable risk mitigation strategies to evaluate and analyse their severity. Hence, risk evaluation and assessment of construction projects is a multi-criteria decision making (MCDM) problem. In present real-life problems, evaluation of project risks is often uncertain and even incomplete, and the prevailing methodologies fail to handle such situations. To address the problem, this paper extends the analytical network process (ANP) methodology in the D number domain to handle three types of ambiguous evaluations, viz. complete, uncertain, and incomplete, and assesses the weight of risk criteria. The D number based approach overcomes the deficiencies of the exclusiveness hypothesis and completeness constraint of Dempster-Shafer (D-S) theory. Here, preference ratings of the decision matrix for each decision-maker are determined using a D number extended consistent fuzzy preference relation (D-CFPR). An extended multi-attributive border approximation area comparison (MABAC) method in D number is then developed to rank and select the best alternative risk response strategy. Finally, an illustrative example from construction sector is presented to check the feasibility of the proposed approach. For checking the reliability of alternative ranking, a comparative analysis is performed with different MCDM approaches (D-COPRAS, D-ARAS, D-MABAC, and D-TOPSIS). Based on different criteria weights, a sensitivity analysis of obtained ranking of the hybrid D-ANP-MABAC model is performed for verify the robustness of the proposed method.

Artificial intelligence methods, especially artificial neural networks (ANNs), have increasingly been utilized for the mathematical description of physical phenomena in (metallic) material processing. Traditional methods often fall short in explaining the complex, real-world data ob-served in production. While ANN models, typically functioning as "black boxes," improve pro-duction efficiency, a deeper understanding of the phenomena, akin to that provided by explicit mathematical formulas, could enhance this efficiency further. This article proposes a general framework that leverages (CAE) ANNs to explain predicted results alongside their graphical presentation, marking a significant improvement over previous approaches and those relied on expert assessments. Unlike existing Explainable AI (XAI) methods, the proposed framework mimics the standard scientific methodology, utilizing minimal parameters for the mathematical representation of physical phenomena and their derivatives. Additionally, it analyzes the relia-bility and accuracy of the predictions using well-known statistical metrics, transitioning from deterministic to probabilistic descriptions for better handling of real-world phenomena. The proposed approach addresses both aleatory and epistemic uncertainties inherent in the data. The concept is demonstrated through the hot extrusion of aluminum alloy 6082, where CAE ANN models and predicts key parameters, and ChatGPT explains the results, enabling researchers and/or engineers to better understand the phenomena and outcomes obtained by ANNs.

The abstract should be an objective representation of the article and it must not contain results that are not presented and substantiated in the main text and should not exaggerate the main conclusions. The study developed a novel method for evaluating the freshness of citrus fruits by integrating near-infrared spectroscopy with the nonlinear data processing capabilities of a BP neural network. This approach utilizes specific wavelength analysis to distinguish between fresh and non-fresh fruits effectively. Advanced preprocessing techniques are employed to remove spectral anomalies, enhancing the network's ability to accurately identify crucial quality indicators like sugar content. Concurrently, an experiment utilising a MATLAB-based BP neural network optimised the number of hidden layer nodes, identifying 61 as optimal. This configuration achieved impressive metrics, including a mean squared error of 0.0025665 and a root mean squared error of 49.8214, over 1000 training iterations with an 80% learning rate. The model demonstrated a high accuracy rate of 97.6275%, confirming its precision and reliability in assessing citrus freshness. This synergy between advanced neural network processing and spectroscopic techniques marks a significant advancement in agricultural quality assessment, setting new standards for speed and efficiency in data processing.

Timely and accurate acquisition of information on distribution of the crop planting structure in Loess Plateau of eastern Gansu Province, one of the most important agricultural areas in western China, is crucial for promoting fine management of agriculture and ensuring food security. In this study, the Object-Based Image Classification (OBIC), the Random Forest (RF) and Convolutional Neural Network (CNN) models were employed to classify the crop planting structure of four representative test areas in Qingyang City in a precise manner. Firstly, different optimal segmentation scales for various crops were selected using the Estimation of Scale Parameter 2 (ESP2) tool and the Ratio of Mean Difference to Neighbors(ABS) to Standard Deviation (RMAS)model. The images were then segmented through multiresolution segmentation combined with the Canny Edge Detection algorithm. Secondly, the L1 regularized logistic regression model was utilized to select and optimize 39 spatial feature factors including spectral, textural, geometric, and index features, in conjunction with phenological factors. Lastly, under the multi-level classification framework, the Random Forest (RF) classifier and Convolutional Neural Network (CNN) model, combined with object-based multiresolution segmentation, was used to classify the crop planting structure. The findings show that: Thanks to the Canny Edge Detection algorithm, we can obtain a more complete boundary of the segmented objects and improve the separability. The optimal segmentation scales for corn, vegetables, and buckwheat were found to be 55, 70, and 35, respectively, while wheat and apple had optimal segmentation scales of 65. In addition to phenological characteristics, the number of selected spatial features for corn, vegetables, buckwheat, wheat, and apple were 9, 7, 16, 12, and 10, respectively. The CNN model demonstrated high consistency with the RF model in the classification results, but the accuracy of RF model is higher than that of CNN model on the whole. The overall accuracy of classification using RF model in four test areas registered 91.93%, 94.92%, 89.37% and 90.68%, respectively. This paper introduced crop phenological factors, effectively improving the extraction precision of shattered agricultural planting structure in the Loess Plateau of eastern Gansu Province. Its findings have important application value in crop monitoring, management, food security and other related fields.

The deaf-mute and individuals with hearing disabilities who communicate through sign language should not be overlooked or excluded. It is a social responsibility to strive for an inclusive world without inequality. Advances in technology offer various solutions to address the communication gap, one of which is the use of computer-based sign language recognition systems. This project proposes a Malaysian Sign Language recognition model utilizing MobileNetV1, a convolutional neural network-based algorithm, to interpret sign language in real-time settings through a website application using Streamlit. The outcome of the model test shows that it has achieved a recognition rate of 96 percent. Although the proposed model has demonstrated the ability to recognize sign language, it is suggested that further improvement can be achieved by enhancing the quality and diversity of the dataset. The implementation of a more comprehensive dataset would lead to improved performance and increased accuracy of the model. This project underscores the importance of considering and accommodating the needs of the deaf-mute and individuals with hearing disabilities and highlights the potential of technology to bridge communication barriers and achieve a more inclusive society.

In response to the burgeoning global demand for premium agricultural products, particularly within the competitive nut market, this paper introduces an innovative methodology aimed at enhancing the grading process for almonds and their shells. Leveraging state-of-the-art Deep Convolutional Neural Networks (CNNs), specifically the AlmondNet-20 architecture, our study achieves exceptional accuracy exceeding 99%, facilitated by the utilization of a 20-layer CNN model. To bolster robustness in differentiating between almonds and shells, data augmentation techniques are employed, ensuring the reliability and accuracy of our classification system. Our model, meticulously trained over 1000 epochs, demonstrates remarkable performance, boasting an accuracy rate of 99% alongside a minimal loss function of 0.0567. Rigorous evaluation through test datasets further validates the efficacy of our approach, revealing impeccable precision, recall, and F1-score metrics for almond detection. Beyond its technical prowess, this advanced classification system offers tangible benefits to both industry experts and non-specialists alike, ensuring globally reliable almond classification. The application of deep learning algorithms, as showcased in our study, not only enhances grading accuracy but also presents opportunities for product patents, thereby contributing to the economic value of our nation. Through the adoption of cutting-edge technologies such as the AlmondNet-20 model, we pave the way for future advancements in agricultural product classification, ultimately enriching global trade and economic prosperity.

Immunotherapy, particularly Immune Checkpoint Blockade (ICB), has demonstrated significant efficacy in treating melanoma in recent years. However, accurately predicting treatment success and avoiding ineffective therapies remains an unresolved challenge. Therefore, this study aims to develop statistical models utilizing neural networks to forecast the effectiveness of immune checkpoint therapies for melanoma patients. Our models primarily rely on Artificial Neural Networks (ANN) to anticipate both Overall Survival (OS) and Progression-Free Survival (PFS) among melanoma patients undergoing anti-CTLA4 and anti-PD1/anti-PDL1 therapy. We incorporate gene expression data, measured in Transcripts per Million (TPM), derived from bulk tumor RNA-sequencing datasets. Additionally, clinical variables such as gender, age, and treatment type are factored into our analysis. The ANN underwent optimization to attain the highest feasible precision in anticipating the predetermined survival outcome. Issues stemming from high-dimensional data, such as overfitting, were tackled through regularization and feature selection methods. Consequently, the ANN-based model incorporating feature selection exhibited the capacity to forecast survival (PFS) in response to ICB therapy with a maximal precision of 86%. Conversely, the ANN lacking feature selection but incorporating regularization achieved accuracies of up to 72% for PFS and 71% for OS, correspondingly. In order to confront the challenge posed by limited patient samples and to assess replicability, the model underwent training and validation based on the amalgamation of all five datasets. However, this amalgamation failed to enhance predictive performance, necessitating further investigations.

The increasing growth in knowledge about functioning of the nervous system of mammals and humans, as well as the significant neuromorphic technologies development in recent decades, have led to the emergence of a large number of brain-computer interfaces and neuroprosthetics for the regenerative medicine tasks. Neurotechnologies have traditionally been developed for therapeutic purposes to help or replace motor, sensory or cognitive abilities damaged by injury or disease. They also have significant potential for memory enhancement. However, there are still no fully developed neurotechnologies and neural interfaces capable of restoring or expanding cognitive functions, in particular memory, in mammals or humans. In this regard, the search for new technologies in the field of restoration of cognitive functions is an urgent task of modern neurophysiology, neurotechnology and artificial intelligence. Hippocampus is an important brain structure connected to memory and information processing in the brain. The aim of this paper is to propose an approach based on deep neural networks for prediction of hippocampal signals in CA1 region based on received biological input in CA3 region. We compare results of prediction for two widely used deep architectures: reservoir computing (RC) and long short-term memory (LSTM) networks. Proposed study can be viewed as a first step in the complex task of the development of a neurohybrid chip, which allows one to restore memory functions in the damaged rodent hippocampus.

Smart City has emerged as the mainstream paradigm for urban governance innovation, sustainable development, and strategy upgrades, which is drawing attention from scholars worldwide. However, current frameworks for Smart City assessment remain incomplete and simplistic. In is paper, 30 national or provincial capitals in China were selected and we designed a tri-dimensional SPI model—Social, Physical, and Information Space—for smart city spatial development assessment. Utilizing methods such as entropy weighting, coupled coordination degree models, and the Dagum Gini coefficient, this study assesses the spatial development and coupled coordination of 30 cities from 2011 to 2019. Finally, by means of BP neural networks, the study examines the contribution of each indicator to the spatial coupled coordination. The results indicated that with a narrowing disparity in development speeds among different regions, the spatial coupled coordination development level of smart capitals in China has steadily increased, presenting a pattern of staggered distribution. Moreover, the IS subsystem plays the most significant role in coupled coordination. The significance of this research lies in its tri-dimensional spatial perspective of the spatial development and coupled coordination differences of the Smart City, providing evidence-based support for the regional layout and optimization in China.

Accurate cloud quantification is essential in climate change research. In this work, we construct an automated computer vision framework by synergistically incorporating deep neural networks and finite sector clustering to achieve robust whole sky image-based cloud classification, adaptive segmentation, and recognition under intricate illumination dynamics. A bespoke YOLOv8 architecture attains over 95% categorical precision across four archetypal cloud varieties curated from extensive annual observations (2020) at a Tibetan highland station. Tailor-made segmentation strategies adapted to distinct cloud configurations, allied with illumination-invariant image enhancement algorithms, effectively eliminate solar interference and substantially boost quantitative performance even in illumination-adverse analysis scenarios. Compared with the traditional threshold analysis method, the cloud quantification accuracy calculated within the framework of this paper is significantly improved. Collectively, the methodological innovations provide an advanced solution to markedly escalate cloud quantification precision levels imperative for climate change research, while offering a paradigm for cloud analytics transferable to various meteorological stations.

This study innovatively assesses the Mun River flow components in Thailand, integrating Artificial Neural Networks (ANN) and Isotopic (18O) End-Member Mixing Analysis (IEMMA). It quantifies the contributions of the Upper Mun River (UMR) and Chi River (CR) to the overall flow, revealing a discrepancy in their estimated contributions. ANN predicts the UMR and CR contribute approximately 70.1% and 29.5% respectively, while IEMMA indicates a more pronounced disparity with 84% from UMR and 16% from CR. This divergence highlights the distinct perspectives of ANN, focusing on hydrological data patterns, and IEMMA, emphasizing isotopic signatures. Despite discrepancies, both methods validate UMR as a significant contributor to the overall flow, highlighting their utility in hydrological research. The findings underscore the complexity of river systems and advocate for an integrated approach of river flow analysis for a comprehensive understanding, crucial for effective water resource management and planning.

This study demonstrates the efficacy of structured pruning and architectural fine-tuning on the YOLOv7-tiny model for eye state detection, emphasizing optimization for real-time applications. Structured pruning significantly reduced the model's complexity and storage size while maintaining high detection accuracy, as evidenced by stable precision, recall, and [email protected] metrics across iterations. Further fine-tuning adjusted the model's width and depth, optimizing efficiency and processing speed without compromising performance. These optimizations yielded YOLOv7-tiny variants that are both computationally efficient and accurate, suitable for resource-constrained environments. The findings highlight the critical role of model optimization in deploying effective neural networks for specific detection tasks in real-time scenarios.

Accurate detection of forest restoration sites using deep learning is crucial for effective ecosystem management, optimizing reforestation efforts, and ensuring environmental sustainability. While various deep learning-based systems have been developed for this purpose, the influence of different neural network architectures on model performance during the identification of forest restoration sites remains underexplored. This study aimed to address this gap by exploring the optimal methodology for extracting and classifying candidate sites for forest restoration based on Convolutional Neural Networks (CNNs), specialized for image recognition. Four categories—arable land, road and barren, quarry, and forest—were defined as candidate sites for forest restoration. A dataset comprising 17,043 samples was divided into training (11,929) and validation (5,114) sets at a ratio of 7:3 for model learning. Model accuracy was evaluated using pixel accuracy (PA) and mean intersection over union (mean IoU). The Resnet152-U-Net model demonstrated a pixel accuracy of 95.2% and a mean IoU of 61.3%, indicating excellent performance in extracting candidate sites for forest restoration. This approach offers spatial and temporal advantages over conventional field surveys or aerial image-based assessments, potentially serving as valuable data for selecting future forest restoration sites.

This paper analyses the application of deep learning techniques for predicting wave overtopping events in port environments using sea state and weather forecasts as inputs. The study was conducted in the outer port of Punta Langosteira, A Coruña, Spain. A video recording infrastructure was installed to monitor overtopping events from 2015 to 2022, identifying 3709 overtopping events. The data collected was merged with actual and predicted data for the sea state and weather conditions during the overtopping events, creating three datasets. We used these datasets to create several machine learning models to predict whether an overtopping event would occur based on sea state and weather conditions. The final models achieved a high accuracy level during the training and testing stages: 0.81, 0.73, and 0.84 average accuracy during training and 0.67, 0.48, and 0.86 average accuracy during testing, respectively. The results of this study have significant implications for port safety and efficiency, as wave overtopping events can cause disruptions and potential damage. Using deep learning techniques for overtopping prediction can help port managers take preventative measures and optimize operations, ultimately improving safety and helping to minimize the economic impact that overtopping events have on the port's activities.

Accurate and robust deep learning models for facial expression recognition are challenging to achieve, given the diversity of human faces and variations in images, including different facial poses and lighting conditions. In this work, we proposed a clock-driven convolutional Spiking Neural Network (SNN) and STDP fine-tune architecture, meticulously calibrated its hyperpa-rameters, and experimented with various optimization methods. The best model resulted was trained and evaluated on the Fer2013 and FER+ database, obtaining an accuracy of 61.87% and 79.97% without requiring auxiliary training data or face registration. To our best knowledge, the proposed SNN achieved comparable accuracy to CNNs of similar depth and possessed advantages of low energy consumption and high computational efficiency. The computational efficiency of the proposed SNN is approximately three times that of CNNs. Along with this, we introduced the very recent cumulative spike guided encoder visualization technique and revealed the strong encoding capability of the proposed SNN.

The article presents a hybrid method for calculating the chemical composition of steel with the required hardness after cooling from the austenitizing temperature. Artificial neural networks and genetic algorithms were used to develop the model. Based on 550 diagrams of continuous cooling transformation (CCT) of structural steels available in the literature, a dataset of experimental data was created. Artificial neural networks were used to develop a hardness model describing the relationship between the chemical composition of the steel, the austenitizing temperature, and the hardness of the steel after cooling. A genetic algorithm was used to identify the chemical composition of the steel with the required hardness. The value of the objective function was calculated using the neural network model. The developed method for identifying the chemical composition was implemented in a computer application. Examples of calculations of mass concentrations of steel elements with the required hardness after cooling from the austenitizing temperature are presented. The model proposed in this study can be a valuable tool to support chemical composition design by reducing the number of experiments and minimizing research costs.

Air quality is one of the most concerning problems in major industrialized cities in the world. Prediction of future air quality is highly relevant to public health. In some big cities, multiple air quality measurement stations are deployed at different locations to monitor air pollutants, such as NO2, CO, PM 2.5 and PM 10, over time. At every monitoring time stamp t, we observe one station×feature matrix xt of the pollutant data, which represents a spatio–temporal process. Traditional methods on prediction of air quality typically use data from one station or can only predict a single pollutant (such as PM 2.5) at a time, which ignores the spatial correlation among different stations. Moreover, the air pollution data are typically highly nonstationary, We propose a de-trending graph convolutional LSTM (long short term memory) to continuously predict the whole station×feature matrix in the next 1 to 48 hours, which not only captures the spatial dependency among multiple stations by replacing an inner product with convolution, but also incorporates the de-trending signals (transform a nonstationary process to a stationary one by differencing the data) into our model. Experiments on the air quality data of the city Chengdu and multiple major cities in China demonstrate the feasibility of our method and show promising results.

Autonomous target recognition (ATR) plays a crucial role in maintaining situational awareness during environmental monitoring. Unmanned aerial vehicles (UAVs) equipped with autonomous target recognition technology can gather and analyze real-time information about targets, including their locations, sizes, and types. However, UAV-captured images in complex real-world environments often display significant variations in perspective and scale due to changes in UAV altitude and distance. Existing methods for autonomous target recognition on UAVs struggle to capture targets from large field-of-view and multi-scale images, resulting in low recognition accuracy and high false-positive rates. This paper introduces two novel Slimmable neural network models, namely SE-YOLOv5s and ST-YOLOv5s, which are based on the YOLOv5s architecture. These models incorporate the Squeeze and Excitation and Swin-Transformer mechanisms to enhance the ability to extract features from large field-of-view and multi-scale images. To evaluate their performance, experiments were conducted on the Visdrone19 aerial dataset. Compared to the state-of-the-art YOLOv5s algorithm, the utilization of SE-YOLOv5s and ST-YOLOv5s for autonomous target recognition on low-altitude drones resulted in improvements in both accuracy and false-positive rates. These proposed methods combine Slimmable neural network design with feature enhancement mechanisms, addressing the challenges posed by complex real-world environments in UAV missions. The advancements in autonomous target recognition on low-altitude drones will significantly contribute to enhancing situational awareness in future environmental monitoring.

Multiple sclerosis is a chronic, autoimmune disease that mainly affects the central nervous system, including the brain, spinal cord, and optic nerve. This disease can cause clinical symptoms such as cognitive decline, muscle weakness, spasms, and fatigue in patients, and the onset tends to be younger. Current medication can only prevent or alleviate symptoms, so early diagnosis of this disease can increase patients' chances of treatment. Although the use of nuclear magnetic resonance detection can improve the efficiency of early auxiliary diagnosis, it still requires experienced doctors to spend too much time and energy on comprehensive judgment. To reduce the time cost and improve the efficiency of multiple sclerosis diagnosis, this article proposes a detection and recognition algorithm for multiple sclerosis based on wavelet entropy and self-adaptive particle swarm optimization. Firstly, a triple discrete wavelet transform is performed on the brain image of multiple sclerosis, and then 10 wavelet entropies are extracted from the decomposed wavelet subbands, which can reduce the feature dimensions of the image; Then, the algorithm of self-adaptive particle swarm optimization is used to optimize the feedforward neural network, in order to obtain the optimal connection weights and thresholds during the training process. The result of the model is with an average sensitivity of 92.29±1.89, specificity of 92.54±0.67, precision of 92.48±0.59, accuracy of 92.42±0.88, and F1 score of 84.85±1.74, Matthews correlation coefficient of 92.37±0.96, and Fowlkes223 Mallows Index of 92.38±0.96. The experimental results indicate that this algorithm has a very important data support role in detecting multiple sclerosis.

Arctic sea ice prediction holds significant importance for facilitating Arctic route planning, optimizing fisheries management, and advancing the field of sea ice dynamics research. While various deep learning models have been developed for sea ice prediction, they predominantly operate at the seasonal or sub-seasonal scale, often focusing on localized areas, and few cater to full-region daily scale prediction. This study introduces the use of spatiotemporal sequence data prediction models, namely, the convolutional LSTM (ConvLSTM) and predictive recurrent neural network (PredRNN), for the prediction of sea ice concentration (SIC). Our analysis reveals that, when solely utilizing SIC historical data as the input, the ConvLSTM model outperforms the PredRNN model in SIC prediction. To enhance the model's capacity to capture spatiotemporal relationships between multiple variables, we expanded the range of input data types to form the ConvLSTM-multi and PredRNN-multi models. Experimental findings demonstrate that the ConvLSTM-multi model excels in assimilating the influence of reanalysis data on sea ice within the sea ice edge region, thus exhibiting superior performance in predicting daily Arctic SIC over the subsequent 10 days. Furthermore, sensitivity tests on various model parameters highlight the substantial impact of sea surface temperature and prediction date on the accuracy of daily sea ice prediction. Additionally, meteorological and oceanographic parameters primarily affect the prediction accuracy of the thin ice region at the edge of the sea ice.

The Internet of Things (IoT) aims to connect all objects and facilitate data interchange, with data accuracy being paramount. While IoT has seen extensive adoption in conventional sectors, its application in the petroleum industry, especially with downhole equipment, poses challenges due to the extreme high-temperature and high-pressure conditions, making accurate measurements elusive. This Paper we aim to enhance the accuracy of downhole pressure measurements in slim-hole drilling parameter monitoring, mitigate the temperature influences on strain gauges, and surmount the intrinsic limitations of the traditional BP neural network, such as sluggish convergence speeds, high sensitivity to initial weights and biases, unstable learning rates, and a tendency to fall into local minima. This study introduces a temperature compensation model using a chaotic-initiated adaptive whale optimization algorithm (C-I-WOA) to optimize a BP neural network, which is henceforth referred to as the C-I-WOA-BP model. Initially, we harnessed chaotic mapping techniques to refine the initialization process of the whale optimization algorithm (WOA) population, thereby bolstering the heterogeneity of the algorithm. Subsequently, we integrated an adaptive weight recalibration mechanism, refined the encompassing methodology of the WOA, and bolstered its capabilities for expansive global scouting and meticulous local refinement in the solution arena. Subsequently, the WOA was used to optimize the weight coefficients of the BP neural network. Finally, we conducted a detailed comparative analysis by juxtaposing the performance metrics of the BP, C-WOA-BP, I-WOA-BP, and C-I-WOA-BP networks. The experimental results indicate that the C-I-WOA-BP model demonstrates faster convergence speed, superior global search capabilities, and enhanced local exploitation potential compared to the other models. Additionally, it provides a more stable and accurate reduction in temperature-induced errors in drilling pressure parameter measurements.

Accurate prediction of the degree of airport delays under the influence of convective weather is crucial for collaborative traffic management implementation and improving the efficiency of airport operations. However, existing studies usually only consider numerical-type quantitative features of weather-affected traffic in their models, and lack the introduction of spatial information to comprehensively portray the traffic operation scenarios under the influence of weather. In order to overcome this problem, this paper firstly designs a new image representation of weather-affected air traffic, and constructs a multi-channel traffic and weather scene image (MTWSI) by populating the airspace two-dimensional grid with traffic and meteorological information to represent the overall traffic operation situation in the terminal area under the influence of convective weather; then, a deep convolutional neural network-based airport delay prediction model ( ADLCNN), which takes MTWSI images as input and uses a specific CNN model to extract the deep features that affect traffic operation in it to input into the subsequent classification algorithm to predict the flight delay level; finally, a series of comparative experiments are carried out on the operational data of Guangzhou Baiyun Airport, and the experimental validation shows that, compared with the traditional machine learning methods, the proposed CNN-based airport delay prediction The experimental validation shows that the proposed CNN-based airport delay prediction model has satisfactory prediction performance compared with the traditional machine learning methods, which also proves that the proposed MTWSI method can more comprehensively respond to the real traffic conditions.

This article reviews the introduction of Alzheimer's Disease (AD), neural networks, training and learning of neural networks, applications of neural networks in early diagnosis of AD, applications of neural networks in AD drug discovery, other brain diseases, and challenges faced by AD. First, the paper introduces the background and characteristics of AD. AD is a degenerative neurological disorder characterized by impaired memory, decreased cognitive function, and loss of neurons. These characteristics place a huge burden on the lives and families of patients. Next, the basic principle and structure of neural network are discussed. A neural network is a computational model made up of multiple neurons that can perform tasks by learning and adapting to input data. In particular, the key concepts of neural network hierarchy, activation function and weight adjustment are discussed. Then, the training and learning methods of neural networks are discussed. Common techniques such as backpropagation algorithm and gradient descent optimizer are introduced in detail, as well as the importance of data preprocessing and model evaluation. Next, the paper focuses on the application of neural network in early diagnosis of AD. By extracting features from brain image data, neural networks can automatically identify differences between AD patients and healthy subjects, enabling early diagnosis and intervention. In addition, the application of neural networks in AD drug discovery is also discussed. By analyzing and predicting a database of known drugs, neural networks can help discover potential treatments for AD and speed up the drug discovery process. The paper further explores the application of neural networks in other brain diseases and highlights the challenges faced by AD, such as the lack of reliable biomarkers, complex pathological mechanisms, etc. In summary, this paper presents a systematic overview of AD, neural networks, training and learning of neural networks, applications of neural networks in early diagnosis of AD and drug discovery, and other brain diseases and challenges associated with AD.

Consciousness results from comprehending the living creature from its existence in time and space. Thought and consciousness are distinguishing factors between humans and machines having artificial intelligence. No algorithm has been offered for artificial self-awareness based on Thinking. Previous studies have not studied the relationship between consciousness, thinking and time. In this study, the relationship between consciousness, thinking, memories and speech over time has been studied. A deep logical connection exists between consciousness, thinking, and time. An algorithm can be designed for artificial consciousness based on this research findings.

Machine Learning (ML) has brought about a transformative era in reactor operations, reshaping monitoring, control, and optimization strategies. This survey comprehensively explores the diverse spectrum of ML applications in industrial reactors. From real-time sensor analysis ensuring reactor functionality to adaptive control algorithms ensuring stability, ML's impact is profound and multifaceted. The benefits of ML are equally evident in optimization, encompassing performance trend prediction, proactive maintenance, and fine-tuning of operations for enhanced efficiency. This review identifies dominant ML techniques, operations stages receptive to ML integration, core data sources, and critical input-output parameters. Aimed at both academics and practitioners, this exploration enriches reactor technologies, unlocking their full potential through insights driven by ML.

Neurogenesis in the adult brain plays a major role in the cognitive ability of animals including learning and memory. Poria cocos (Schw.) Wolf (P. cocos) has been known as a traditional Chinese edible medicinal herb with the potential effect to improve learning and memory. However, the effect mechanisms are still elusive. In this study, significant neuronal differentiation-promoting activities of the ethanol extracts of P. cocos (EEPC) were tested in Neuro-2a cells and mouse cortical neural stem/progenitor cells (NSPCs). Subsequently, 97 compounds of EEPC were identified using UHPLC-Q-Exactive-MS/MS. After investigation of neuronal differentiation-promoting activities of 4 major compounds (Ethyl palmitoleate, L-(-)-Arabitol, Choline and Adenosine), only Choline has significant neuronal differentiation-promoting activity. In summary, we investigated the neuronal differentiation-promoting activity and chemical compositions of EEPC, the study of the neuronal differentiation-promoting effect of ether extract of P. cocos indicated P. cocos’s positive effect on learning and memory functions. This is the first investigation of the neuronal differentiation-promoting effect of ether extract of P. cocos based on similar research references.

This paper studies the finite-time synchronization problem of fractional-order stochastic memristive bidirectional associative memory neural networks (MBAMNNs) with discontinuous jumps. A novel criterion for finite-time synchronization is obtained by utilizing the properties of quadratic fractional-order Gronwall inequality with time delay and the comparison principle. This criterion provides a new approach to analyze the finite-time synchronization problem of neural networks with stochasticity. Finally, numerical simulations are provided to demonstrate the effectiveness and superiority of the obtained results.

Generally, when cognitive radio users are in Underlay mode, through the analysis of the electromagnetic spectrum in time, frequency, space, and field of multiple dimensional data accounts for judging the inherent correlation of the radio spectrum used/idle state, this is the realization of cognitive radio users (secondary users, SUs) efficient access to the foundation of the limited spectrum resources. Therefore, how to efficiently use of spectrum status of each SU implementation of reception multidimensional combination forecasting is the core of this paper addressing the problem. In this paper, we propose a deep-learning hybrid model called TensorGCN-LSTM based on the tensor data structure. The model treats SUs deployed at different spatial locations under the same frequency and the spectrum status of SUs themselves under different frequencies in the task area as nodes and constructs two types of graph structures. Graph convolutional operations are used to sequentially extract corresponding spatial-domain and frequency-domain features from the two types of graph structures. Then, the long short-term memory (LSTM) model is used to fuse the spatial, frequency, and temporal features of the cognitive radio environment data. Finally, the prediction task of the spectrum distribution situation is accomplished through fully connected layers. Specifically, the model constructs a tensor graph based on the spatial similarity of SUs' locations and the frequency correlation between different frequency signals received by SUs, which describes the electromagnetic wave's dependency relationship in spatial and frequency domains. LSTM is used to capture the electromagnetic wave's dependency relationship in the temporal domain. To evaluate the effectiveness of the model, we conducted ablation experiments on LSTM, GCN, GC-LSTM, and TensorGCN-LSTM models using simulated data. The experimental results show that our model achieved better prediction performance in RMSE, and the correlation coefficient R2 of 0.8753 also confirmed the feasibility of the model.

This article presents a study on brain tumor detection using the VGG-16 model, a convolutional neural network known for its performance in computer vision tasks. The aim of the study is to classify magnetic resonance imaging (MRI) images and accurately identify the presence of brain tumors. The dataset used consists of brain tumor MRI images, categorized into two classes: "NO" (no tumor) and "YES" (tumor). The methodology involves setting up the environment, importing and preprocessing the data, building the VGG-16 model, and evaluating its performance using metrics such as accuracy, precision, and recall. The results demonstrate an accuracy of approximately 88% on the validation set and 80% on the test set, indicating the potential of the VGG-16 model in supporting healthcare professionals in diagnosing brain tumors. The study contributes to the field of medical image analysis and offers insights into the application of deep learning for brain tumor detection.

Abstract: The surge of diabetes poses a significant global health challenge, particularly in Oman and the Middle East. Early detection of diabetes is crucial for proactive intervention and improved patient outcomes. This research leverages the power of machine learning, specifically, Convolutional Neural Networks (CNNs), to develop an innovative 4D CNN model dedicated to early diabetes prediction. A region-specific dataset from Oman is utilized to enhance health outcomes for individuals at risk of developing diabetes. The proposed model showcases remarkable accuracy, achieving an average accuracy of 98.49% to 99.17% across various epochs. Additionally, it demonstrates excellent F1 score, recall, and sensitivity, highlighting its ability to identify true positive cases. The findings contribute to the ongoing effort to combat diabetes and pave the way for future research in using deep learning for early disease detection and proactive healthcare.

Event-related potentials (ERPs) are estimated by averaging time-locked single trial electroencephalography (EEG) signals in response to specific events or stimuli. Classifying ERPs accurately is a challenge because (a) single trials have poor signal-to-noise-ratios (SNRs) and (b) it is difficult to collect large single trial ensembles to generate high SNR ERPs for classifier training and testing. The m-subsample averaging (m-SA) strategy which generates small-sample ERPs by repeated averaging of a small number of single trials drawn without replacement, has been proposed as a solution to the two problems. An ERP formed by averaging m single trials is referred to as an m-ERP where m is referred to as the averaging parameter. In this study, we conduct thorough analyses of m-SA and focus on issues not addressed in previous studies to better understand the beneficial properties of m-SA and to further support its application for ERP classification. Specifically, we (a) analyze the improvement in SNR as a function of m using the mean-root-mean-square SNR and visual analyses of m-ERP plots with confidence intervals, (b) analyze the improvement in interclass separation as a function of m, (c) determine how the SNR and interclass separation analyses can help to select the averaging parameter m, (d) determine the number of distinct m-ERPs that can be drawn from a single-trial ensemble, and (e) determine several probabilities related to the generation of distinct m-ERPs. Furthermore, an extensive set of experiments are designed to analyze the performance of support vector machine and convolution neural network classifiers employing m-SA with various combinations of the averaging parameters used for generating the training and test sets. The results confirm that ERPs can be classified accurately using small subsample averaging. Most importantly, it is concluded that m-SA can be deployed in practice to accurately classify ERPs in brain activity research and in clinical applications without having to collect a prohibitively large number of single trials.

Fault detection is an important step for subsurface interpretation and reservoir characterization from 3D seismic images. Due to the numerous and complicated faulting structures of seismic images, manual seismic interpretation is time taking and need intensive work. To overcome this problem, geoscientists are coming up with productive computer-aided techniques for assisting in interpreter science for many years. However, in this paper, we used a pre-trained CNN model to predict faults from the 3D seismic volume of the Poseidon field of Browse Basin, Australia. Basically, this field is highly structured with complex normal faulting throughout the targeted Plover Formations. So, our motivation for this work in this field is to compare machine learning-based fault prediction to user interpreted faults identification with supported by seismic variance attribute. We found very satisfying result using DL with having an improved fault probability volume that outperform variance technology. Therefore, we propose that this workflow could reduce time and able to predict fault quite accurately in any field area.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

(1) Background: This study aimed to identify the recurrence and survival rates according to the mismatch repair (MMR), p53, and L1 cell adhesion molecule (L1CAM) states in patients with advanced and recurrent endometrial cancer receiving systemic chemotherapy.; (2) Methods: This single-center retrospective cohort study included chemotherapy-naïve patients (n=156) with advanced-stage (III/IV) or recurrent endometrial cancer who were administered chemotherapy as adjuvant therapy (n=112) or first-line palliative treatment (n=44) between January 2015 and June 2022. MMR and p53 states were assessed using PCR, and L1CAM was tested using immunohistochemistry in the no specific molecular profile (NSMP) group. The primary outcomes were progression-free survival (PFS) and overall survival (OS).; (3) Results: Of the 156 patients, 62 (39.7%), 53 (34.0%), and 41 (26.3%) had NSMP, abnormal p53 (p53abn), and an MMR deficiency (MMR-D), respectively. PFS and OS were longest in MMR-D, followed by NSMP, and were the least in p53abn tumors (PFS: p=0.0006, OS: p=0.0013). After NSMP was classified according to positive or negative L1CAM status, the L1CAM-negative group exhibited significantly lower survival rates than the L1CAM-positive group (PFS: p=0.0001, OS: p=0.0027); p53abn tumors were independent prognostic factors for poor PFS (p=0.039 on the multivariable analysis).; (4) Conclusions: In chemotherapy-naïve patients with advanced and recurrent endometrial cancer, the best prognosis after chemotherapy was obtained using MMR-D, followed by NSMP and p53abn tumors. The L1CAM status is a useful new marker for stratifying NSMP in advanced and recurrent patients.

Teeth segmentation plays a pivotal role in dental diagnosis, treatment, planning, and the development of computer-aided dental systems. It enables precise identification and analysis of dental structures, aiding in detecting dental abnormalities, measuring tooth dimensions, and assessing oral health conditions. Accurate teeth segmentation also facilitates the automation of dental workflows, leading to improved efficiency and reduced human error. Artificial Intelligence (AI) has witnessed rapid advancements, with various approaches developed or enhanced. While Convolutional Neural Networks (CNNs) have been widely used in medical image segmentation, the U-Net architecture has emerged as a standout performer due to its exceptional segmentation capabilities. This paper presents a proof of concept for the Attention U-Net architecture, as previously used in [1], applied to teeth segmentation. The study demonstrates the superior performance of this network in accurately segmenting teeth using a newly available benchmark dataset called Tufts Dental X-Ray Dataset. When trained and tested on 10-fold cross-validation, the model achieved an average dice coefficient of 95.01%, intersection over union of 90.6%, and pixel accuracy of 98.82%. These scores surpass those of all other networks implemented on the same dataset. By leveraging the Attention U-Net architecture, our research showcases the potential of advanced AI techniques in dental radiography. The findings contribute to the ongoing efforts to develop automated systems to assist dental professionals in their clinical practice.

Land Surface Temperature (LST) is significant for climatological and environmental studies. LST products from satellites, however, suffer from the tradeoff between spatial and temporal resolution. Spatial downscaling has emerged as a well explored field aiming to overcome limitations arising from this tradeoff. Previous research on regression based LST downscaling models focused on utilizing predictors derived from optical imagery. Weather-dependency of optical imagery data, however, can influence downscaling models by the weather conditions. To cope this issue, in this study, we involve predictors derived from the weather-independent Sentinel-1 Synthetic Aperture Radar (SAR) imagery to downscale Landsat-8 LST data. In this context, we propose to use machine learning techniques, namely Random Forest (RF) and Convolutional Neural Networks (CNN). To demonstrate the applicability and performance of the proposed method, extensive experimental analyses were conducted over Zuid-Holland in the Netherlands. From the experiments, we found that the results obtained with radar predictors were comparable to those achieved using optical predictors. This confirms that the proposed method indeed paves a new way for mapping land surface temperature using SAR images.

Change detection with heterogeneous remote sensing images (Hete-CD) plays an important role in practical applications, especially when homogenous remote sensing images are unavailable. However, bitemporal heterogeneous remote sensing images (HRSIs) cannot compare directly to measure change magnitude, and many deep learning methods require large amounts of samples to train the module. Moreover, labeling many samples for land cover change detection with HRSIs is time-consuming and labor-intensive. Therefore, acquiring satisfactory performance of Hete-CD remains a challenge for deep learning networks with very small training samples. In this study, we promote a novel deep-learning framework for Hete-CD to obtain satisfactory performance while the initial samples are very small. We initially design a multiscale network with select kernel-attention module to focus on capturing different change targets with various sizes and shapes. Then, a simple yet effective non-parametric sample-enhanced algorithm based on the Pearson correlation coeffi-cient is promoted to explore potential samples around each initial sample. Finally, the proposed network and sample-enhanced algorithm are fused into one iterative framework to improve the change detection performance with very small samples. Experimental results conducted on four pairs of actual HRSIs indicated that the proposed framework can achieve competitive accuracies with very small samples for initialization when compared with some state-of-the-art methods. For example, the improvement is approximately 3.38% and 1.99% when compared with the selected traditional methods and deep learning methods, respectively.

The used car market has a high global economic importance, with more than 35 million cars sold yearly. Accurately predicting prices is a crucial task for both buyers and sellers to facilitate informed decisions in terms of opportunities or potential problems. Although various Machine Learning techniques have been applied to create robust prediction models, a comprehensive approach has yet to be studied. This research introduces two datasets from different markets, one with over 300,000 entries from Germany to serve as a training base for deep prediction models and a second dataset from Romania containing more than 15,000 car quotes used mainly to observe local traits. As such, we include extensive cross-market analyses by comparing the emerging Romanian market versus one of the world’s largest and most developed car markets, Germany. Our study uses several neural network architectures that capture complex relationships between car model features, individual add-ons, and visual features to predict used car prices accurately. Our models achieved a high R2 score exceeding 0.95 on both datasets, indicating their effectiveness in estimating used car prices. Moreover, we experimented with advanced convolutional architectures to predict car prices based solely on visual features extracted from car images. This approach exhibited transfer-learning capabilities, leading to improved prediction accuracy, especially since the Romanian training dataset is limited. Our experiments highlight the most important factors influencing the price, while our findings have practical implications for buyers and sellers in assessing the value of vehicles. At the same time, the insights gained from this study enable informed decision-making and provide valuable guidance in the used car market.

The exponential growth of digital media content has introduced new challenges in managing and classifying internet traffic. Digital media traffic is composed of various applications such as video, audio, social media, and search, and its data structure is complex, incorporating a vast array of features. The classification of traffic data is a crucial aspect of internet traffic management and network security, and it forms the basis for several scenarios, including content distribution, advertising recommendations, and data analysis. Traditional classification methods rely mainly on deep packet inspection and port-based techniques, which have become increasingly ineffective due to the rapid evolution of network traffic. To address this issue, this study proposes a machine learning-based traffic classification method aimed at enhancing the accuracy and efficiency of digital media traffic classification to meet the current needs of traffic management and network security. The paper also analyzes and evaluates the classification effect and prediction capability of various algorithms under different training set sizes to validate the feasibility and effectiveness of the proposed method. The result demonstrates that the neural network algorithm has superior classification and prediction capabilities compared to the decision tree and support vector machine algorithms. Furthermore, our proposed method achieves the highest accuracy of 96.88% with a large training sample of 40,000 data streams, proving its superiority in handling high-dimensional data and complex datasets. The research results are significant for the development of digital media traffic classification and prediction methods and are expected to be applied in practical scenarios.