Blasting pattern optimization is an attempt to optimize blast design parameters aiming to achieve optimum fragmentation, reduce mining operating costs as well as environmental side consequences. The present study aims to propose a multi-objective optimization model, employing artificial intelligence and metaheuristics, to simultaneously minimize the mine-to-crusher operating costs and the impact of blasting consequences including fly-rock and back-break. To achieve the purpose of the study, a multi-variable regression model was developed to model total costs from drilling to crushing. In addition to the costs, multilayer perception neural networks were implemented to predict the blast-induced back-break and fly-rock as a function of collected variables such as number of holes, hole length, burden, spacing, hole slope, stemming, blasted rock per hole, powder factor, and charge per delay. High-precise estimations for both back-break and fly-rock were achieved with the average of 99% coefficient of determination for train, test and validation data sets. Then, the developed regression model and the neural networks were used in an optimization framework, employing Grasshopper algorithm, to find the optimum blast design satisfying practical constraints. The proposed model was tested on a lead-zinc open-pit mine, where 1032 blasting patterns were recorded and analyzed. The results of the optimization model provide a Pareto set of solutions, such that any of these solutions can be implemented according to the strategy of the mining operation management team. The blast pattern with the lowest cost, result in a relatively high fly-rock and back-break, while the pattern with low fly-rock and back-break raises the cost by 20.13 % compared the minimum cost blast design.

The total tree height (h) and diameter at breast height (dbh) relationship is an essential tool in forest management and planning. The height—diameter (h-dbh) relationship had been studied with several approaches and for several species worldwide. The nonlinear mixed effect modeling (NLMEM) has been extensively used and lately the resilient backpropagation artificial neural network (RBPANN) approach has been a trend topic for modeling this relationship. The artificial neural network (ANN) is a computing system based in artificial intelligence and inspired in biological neural network for supervised learning. In this study the NLMEN and RBPANN approaches were used for modeling the h—dbh relationship for Durango pine species (Pinus durangensis Martínez) in mixed-species forest from Mexico. The total dataset considered 1,000 (11,472 measured trees) randomly selected from 14,390 temporary forest inventory plots and the dataset was randomly divided into two parts; 50% for training and 50% for testing. An unsupervised clustering analysis was used to grouped the dataset into 10 clusters based on k-means clustering method and plot-variables like density, basal area, mean dbh, mean h, quadratic mean diameter, altitude and aspect. The RBPANN was performed for tangent hyperbolicus (RBPANN-tanh), softplus (RBPANN-softplus), and logistic (RBPANN-logistic) activation functions for functions in cross product of the covariate or neurons and the weights for the ANN analysis. For both training and testing, 10 classical statistics (e.g., RMSE, R2, AIC, BIC, logLik) were computed for the residual values and assess the approaches for h—dbh relationship. For training and testing, the ANNs approach outperformed the NLMEM approach, and the RBPANN-tanh has the best performance in both training and testing phases.

Multivariate predictive analysis of the Stream-Water (SW) parameters (discharge, water level, temperature, dissolved oxygen, pH, turbidity, and specific conductance) is a pivotal task in the field of water resource management during the era of rapid climate change. The highly dynamic and evolving nature of the meteorological and climatic features have a significant impact on the temporal distribution of the SW variables in recent days making the SW variables forecasting even more complicated for diversified water-related issues. To predict the SW variables, various physics-based numerical models are used using numerous hydrologic parameters. Extensive lab-based investigation and calibration are required to reduce the uncertainty involved in those parameters. However, in the age of data-informed analysis and prediction, several deep learning algorithms showed satisfactory performance in dealing with sequential data. In this research, a comprehensive Explorative Data Analysis (EDA) and feature engineering were performed to prepare the dataset to obtain the best performance of the predictive model. Long Short-Term Memory (LSTM) neural network regression model is trained using over several years of daily data to predict the SW variables up to one week ahead of time (lead time) with satisfactory performance. The performance of the proposed model is found highly adequate through the comparison of the predicted data with the observed data, visualization of the distribution of the errors, and a set of error matrices. Higher performance is achieved through the increase in the number of epochs and hyperparameter tuning. This model can be transferred to other locations with proper feature engineering and optimization to perform univariate predictive analysis and potentially be used to perform real-time SW variables prediction.

This paper presents a study of an automated system for identifying planktic foraminifera at the species level. The system uses a combination of deep learning methods, specifically Convolutional Neural Networks (CNNs), to analyze digital images of foraminifera taken at different illumination angles. The dataset is composed of 1437 groups of sixteen grayscale images, one group for each foraminifer, that are then converted to RGB images with various processing methods. These RGB images are fed into a set of CNNs, organized in an Ensemble Learning (EL) environment. The ensemble is built by training different networks using different approaches for creating the RGB images. The study finds that an ensemble of CNN models trained on different RGB images improves the system's performance compared to other state-of-the-art approaches. The proposed system was also found to outperform human experts in classification accuracy.

Working memory (WM) is a brain system for short-term storage and manipulation of information and plays an important role in complex cognitive tasks. In the synaptic theory of WM memorized elements are stored in the form of short-term potentiated connections in a sample population of neurons. In this paper, we show that such populations can be formed due to the mechanisms of spike-timing-dependent plasticity (STDP) – the phase dependence associated with the ratio of the pulse times of the interacting neurons. We propose a WM model considering two types of plasticity: short-term plasticity and STDP. We have shown formation of neuronal clusters encoding items in the WM model, that can be formed by external stimulation of a group of neurons due to the mechanisms of STDP and hold and reactivated by short-term plasticity mechanisms. The dynamic formation of neuronal clusters instead of pre-formed clusters gives additional flexibility to the model.

Neural networks require a large quantity of training spectra and detector responses in order to learn to solve the inverse problem of neutron spectrum unfolding. In addition, due to the under-determined nature of unfolding, non-physical spectra which would not be encountered in usage should not be included in the training set. While physically realistic training spectra are commonly determined experimentally or generated through Monte Carlo simulation, this can become prohibitively expensive when considering the quantity of spectra needed to effectively train an unfolding network. In this paper, we present three algorithms for the generation of large quantities of realistic and physically motivated neutron energy spectra. Using an IAEA compendium of 251 spectra, we compare the unfolding performance of neural networks trained on spectra from these algorithms, when unfolding real-world spectra, to two baselines. We also investigate general methods for evaluating the performance of and optimizing feature engineering algorithms.

Driver drowsiness is one of the leading causes of traffic accidents. This paper proposes a new method for classifying driver drowsiness using deep convolution neural networks trained by wavelet scalogram images of electrocardiogram (ECG) signals. Three different classes were de-fined for drowsiness based on video observation of driving tests performed in a simulator for manual and automated modes. The Bayesian optimization method is employed to optimize the hyperparameters of the designed neural networks, such as the learning rate and the number of neurons in every layer. To assess the results of the deep network method, Heart Rate Variability (HRV) data is derived from the ECG signals, some features are extracted from this data, and finally, random forest and k-nearest neighbors (KNN) classifiers are used as two traditional methods to classify the drowsiness levels. Results show that the trained deep network achieves balanced accuracies of about 77% and 79% in the manual and automated modes, respectively. However, the best obtained balanced accuracies using traditional methods are about 62% and 64%. We conclude that designed deep networks working with wavelet scalogram images of ECG signals significantly outperform KNN and random forest classifiers which are trained on HRV-based features.

In the last few decades, glaucoma became the second biggest leading cause of irreversible vision loss. Because of its asymptotic growth, it is not properly diagnosed until the relatively late stage. To stop the severe damage by glaucoma it is needed to detect glaucoma in its early stages. Surprisingly diabetes also be the greatest cause of glaucoma. In the modern era, artificial intelligence makes great progress in the medical image processing field. Image analysis based on machine learning gives a huge success in diagnosis glaucoma without any misdiagnosis. The aim of this proposed paper is to create an automated process that can detect glaucoma and diabetic retinopathy. Here various Machine Learning models are used and results of these methods are presented.

The paper proposes a new principle of finding and removing elements of mathematical model, redundant in terms of parametric identification of the model. It allows reducing computational and time complexity of the applications built on the model. Especially this is important for AI based systems, systems based on IoT solutions, distributed systems etc. Besides, the complexity reduction allows increasing an accuracy of mathematical models implemented. Despite the model order reduction methods are well known, they are extremely depended however on the problem area. Thus, proposed reduction principles can be used in different areas, what is demonstrated in this paper. The proposed method for the reduction of mathematical models of dynamic systems allows also the assessment of the requirements for the parameters of the simulator elements to ensure the specified accuracy of dynamic similarity. Efficiency of the principle is shown on the ordinary differential equations and on the neural network model. The given examples demonstrate efficient normalizing properties of the reduction principle for the mathematical models in the form of neural networks.

This study aims to evaluate a new approach in modeling gully erosion susceptibility based on deep learning neural network (DLNN) model, ensemble Particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN) and comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shiran watershed, Iran. For this purpose, 13 independent variables affecting gully erosion susceptibility in the study area, including altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from river, land use, soil, lithology, rainfall, , stream power index (SPI), topographic wetness index (TWI), were prepared. Also, 132 gully erosion locations were identified during field visits. Data for modeling were divided into two categories of training (70%) and testing (30%). Receiver operating characteristic (ROC) parameters including sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and area under curve (AUC) were used to evaluate the performance of the models. The results showed that, the AUC values from ROC with considering testing datasets of PSO-DLNN is 0.89 and which is associated with superb accuracy. Rest of the models also associated with optimal accuracy and near about PSO-DLNN model; the AUC values from ROC of DLNN, SVM and ANN for testing datasets are 0.87, 0.85 and 0.84 respectively. The PSO algorithm has updated and optimized the weights of DLNN model, and as a result, the efficiency of this model in predicting gully erosion susceptibility has increased. Therefore, it can be concluded that the use of DLNN model and its ensemble with PSO algorithm can be used as a novel and practical method in predicting the susceptibility of gully erosion that helps planners and managers in managing and reducing the risk of this phenomenon.

Banks are normally offered two kinds of deposit accounts. It consists of deposits like current/saving account and term deposits like fixed or recurring deposits. For enhancing the maximized profit from bank as well as customer perspective, term deposit can accelerate uplifting of finance fields. This paper focuses on likelihood of term deposit subscription taken by the customers. Bank campaign efforts and customer detail analysis can influence term deposit subscription chances. An automated system is approached in this paper that works towards prediction of term deposit investment possibilities in advance. This paper proposes deep learning based hybrid model that stacks Convolutional layers and Recurrent Neural Network (RNN) layers as predictive model. For RNN, Gated Recurrent Unit (GRU) is employed. The proposed predictive model is later compared with other benchmark classifiers such as k-Nearest Neighbor (k-NN), Decision tree classifier (DT), and Multi-layer perceptron classifier (MLP). Experimental study concludes that proposed model attains an accuracy of 89.59% and MSE of 0.1041 which outperform well other baseline models.

Lung cancer is known as lung carcinoma. It is a disease which is malignant tumor leading to the uncontrolled cell growth in the lung tissue. Lung Cancer disease is one of the most prominent cause of death in all over world. Early detection of this disease can assist medical care unit as well as physicians to provide counter measures to the patients. The objective of this paper is to approach an automated tool that takes influential causes of lung cancer as input and detect patients with higher probabilities of being affected by this disease. A neural network classifier accompanied by cross-validation technique is proposed in this paper as a predictive tool. Later, this proposed method is compared with another baseline classifier Gradient Boosting Classifier in order to justify the prediction performance.

An application of deep convolutional neural network and recurrence plot for financial market movement prediction is presented. Though it is challenging and subjective to interpret its information, the pattern formed by a recurrence plot provide a useful insight into the dy- namical system. We used a recurrence plot of seven financial time series to train a deep neural network for financial market movement predic- tion. Our approach is tested on our dataset and achieved an average of 53.25% classification accuracy. The result suggests that a well trained deep convolutional neural network can learn a recurrence plot and pre- dict a financial market direction.

The study concentrates on researching possibilities of using computer image analysis and neural modeling in order to assess selected quality discriminants of spray-dried chokeberry powder. The aim of the paper is quality identification of chokeberry powders on account of their highest dying power, the highest bioactivity as well as technologically satisfying looseness of powder. The article presents neural models with vision technique backed up by devices such as digital camera as well as electron microscope. Reduction in size of input variables with PCA has influence on improving the processes of learning data sets, thus increasing effectiveness of identifying chokeberry fruit powders included in digital pictures, which is shown in the results of the conducted research. The effectiveness of image recognition are presented by classifying abilities as well as low Root Mean Square Error (RMSE), for which the best results are achieved with typology of network type Multi-Layer Perceptron (MLP). The selected networks type MLP are characterized by the highest degree of classification at 0.99 and RMSE at 0.11 at most at the same time.

Recently, the environment is being put under constantly increasing pressure. Globally, water shortage is considered as one of the most serious environmental problems which affect human life and plant wealth. Iraq is highly affected by water deficit in many regions. In particular, Al-Najaf region is selected to be under evaluation for the current and future water resources shortage. This study is based on the collected data for rainfall, evaporation, flow-rate, groundwater, water needed for irrigation, and daily uses for the period between 2000 and 2018. The Artificial Neural Network, normal distribution, and lognormal distribution type III are applied for analyzing the collected data in addition to predict the water shortage for year 2050. Results show a water shortage in years 2002, 2004, 2005, and 2017 only for the selected period. A Simulink model is constructed using Matlab to increase the credibility of the estimated results and gives accurate results for the groundwater and surface water needed. Where in 2050, it is found that it needs to use the groundwater source by 0.024 x 10⁹ m³ to support the surface water source which is represented by the Euphrates River. The study shows the extent of inefficient management of water resources in Al-Najaf region.

Greenhouse Gases (GHGs) emission has considerable impact on global warming and climate change. Since energy systems and their features noticeably influence on the amount of GHGs emission, it can be modeled based on the specifications of energy sources utilized by the countries. In addition, economic activity is another factor which should be considered in GHG emission modeling. In this work, Artificial Neural Network (ANN) is used for estimating carbon dioxide emission, as one of the most abundant GHGs, on the basis of shares of various energy sources used as primary energy supply and GDP as an indicator for economic activities. Five countries including Iran, Kuwait, Qatar, Saudi Arabia and United Arab Emirates (UAE) are considered as case studies. Comparing between the estimated data by the achieved model and actual quantities showed acceptable precision of the ANN model for prediction of carbon dioxide emission. The average absolute relative error and the R-squared values of the GMDH model are approximately 2.28% and 0.9998, respectively. The obtained values for the mentioned statistical criteria show the precision of the model in forecasting the emission of Co2.

The continuous and precise mapping of glacier calving fronts is essential for monitoring and understanding rapid glacier changes in Antarctica and Greenland, which have the potential for significant sea level rise within the current century. This effort has been mostly restricted to the slow and painstaking manual digitalization of the calving front positions in thousands of satellite imagery products. Here, we have developed a machine learning toolkit to robustly and automatically detect glacier calving front margins in satellite imagery. The toolkit is based on semantic image segmentation using Convolutional Neural Networks (CNN) with a modified U-Net architecture to isolate the calving fronts from satellite images after having been trained with a dataset of images and their corresponding manually-determined calving fronts. As a case study we train our neural network on a varied set Landsat images with lowered resolutions from Jakobshavn, Sverdrup, and Kangerlussuaq glaciers, Greenland and test the results on novel images from Helheim glacier, Greenland to evaluate the performance of the approach. The neural network is able to identify the calving front in new images with a mean deviation of 96.3 m from the true fronts, equivalent to 1.97 pixels on average, while the corresponding error for manually-determined fronts on the same resolution images is 92.5 m. We find that the trained neural network significantly outperforms common edge detection techniques, and can be used to continuously map out calving-ice fronts with a variety of data products.

This study aimed to learn disturbance information to effectively control multiple small unmanned surface vehicles (USVs) for marine research purposes at sea. The learned disturbance information was used to investigate the control of multiple USV swarms based on the leading–following formation technique. Numerous studies have already been conducted on swarm control using drones in the air; however, there has been a paucity of studies on swarm control in the sea. Contrary to swarm control in aviation, the fluid density of the sea is high, and the environment is constantly changing; thus, a robot system would be significantly affected by disturbances. This ultimately influences the maintenance of swarm formations and the accomplishment of missions [1,2]. Therefore, it is difficult to control numerous moving objects while maintaining a formation at sea by using the existing aerial drone swarm control technology. To solve this problem, we learned a long short-term memory (LSTM) model with time-series marine environmental data to predict maritime disturbances. Thereafter, the model was applied to a mission-based position control algorithm of each USV constituting the swarm to design a marine unmanned floating vessel swarm control system that can be applied to various marine environments. Specifically, to effectively control numerous small USVs for marine research purposes, ocean currents are learned using the LSTM algorithm, and the predicted ocean currents are used to generate a swarm USV control system for USV formations. In this study, a control system model of several small USVs equipped with two rear thrusters and a front lateral thruster was designed. The LSTM algorithm was learned using the previous ocean current data, and the velocity of the following ocean currents was predicted. The predictions were then used as a system disturbance to determine the thrust of the controller. To measure ocean currents in the sea when each USV moves, the velocity, azimuth, and position (latitude, longitude) data from the GPS mounted on the USV were used to measure the velocity and direction of the hull's movement. Further, the flow rate was measured using a flow rate sensor on a small USV. The USV movement and position were controlled using an artificial neural network-PID (ANN-PID) controller. This study entailed a comparative analysis of the designed USV model results and those generated by the simulator, including the behavior control rule of the USV swarm and the path of the actual USV swarm at sea. It was verified that the effectiveness of the USV mathematical model and behavior control rules. By comparing the movement path of the swarm USV with and without the disturbance learning algorithm and ANN-PID control algorithm applied to the designed simulator, the position error and maintenance performance of the swarm formation were analyzed, and the application results were compared.

With the rapid development of Internet of Things (IoT)-based near-earth remote sensing technology, the problem of network intrusion for near-earth remote sensing systems has become more complex and large-scale. Therefore, it is essential to seek an intelligent, automated, and robust network intrusion detection method. In recent years, network intrusion detection methods based on graph neural networks (GNNs) have been proposed. However, there are still some practical issues with these methods. For example, they have not taken into consideration the characteristics of near-earth remote sensing systems, the state of the nodes, and the temporal features. Therefore, this article analyzes the characteristics of existing near-earth remote sensing systems and proposes a spatio-temporal graph attention network (N-STGAT) that considers the state of nodes. The proposed network applies spatiotemporal graph neural networks to the network intrusion detection of near-earth remote sensing systems and validates the effectiveness of the proposed method on the latest flow-based dataset.

Hyperspectral small target detection (HSTD) is a promising pixel-level detection task. However, due to the low contrast and imbalance number between the target and background spatially and high dimensions spectrally, it is a challenging one. To address these issues, this work proposes a representation learning-based graph and generative network for hyperspectral small target detection. The model builds a fusion network through frequency representation for HSTD, where the novel architecture incorporates irregular topological data and the spatial-spectral feature to improve its representation ability. Firstly, a graph convolutional network (GCN) module better models the non-local topological relationship between samples to represent the hyperspectral scene’s underlying data structure. The mini-batch-training pattern of the GCN decreases the high computational cost of building an adjacency matrix for high-dimensional data sets. In parallel, the generative model enhances the differentiation reconstruction and the deep feature representation ability with respect to the target spectral signature. Finally, a fusion module compensates for the extracted different types of HS features and integrates their complementary merits for hyperspectral data interpretation while increasing detection and background suppression capabilities. Experiments on different hyperspectral data sets demonstrate the advantages of the proposed architecture.

The concentration of data from multiple links to a single output is an essential task performed by High-Energy Physics (HEP) Data Acquisition Systems (DAQs). At high and varying data rates combined with the large width of the concentrator’s output interface, this task is non-trivial. This paper presents a concentrator based on the Beneš network, which provides efficient concentration without using a high-frequency clock internally. It warrants that empty data are eliminated and does not disturb the data time-ordering if the data rates significantly differ between inputs. Additionally, it is well suited to FPGA implementation. It is based on simple data-routing primitives and may be fully pipelined.

Formation in soccer is among the most important tactical choices for a successful match.Herein, the simulations of 420000 match-plays have been performed varying the formation, the number of opponents that are actively pressing the team, the speed of the opponents in attempting a pass interception. Dribbling has been neglected. The match-play ends either with a successful series of passes from a central back to the line of the strikers or with the opponents that steal the ball. In this work, I demonstrate that 3-4-3 formation, which is among the most employed formations, relates to the highest probability of success.

In this paper, we propose methods for brain tumor detection in MRI images based on ensemble learning. We build upon prior research on ensemble methods by testing the concatenation of pre-trained models: features extracted via transfer learning are merged and segmented by classification algorithms or a stacked ensemble of those algorithms. The proposed approach achieved accuracy scores of 0.98 , outperforming a benchmark VGG-16 model. Considerations to granular computing are given in the paper as well.

With the development of the city, a large number of water networks in the built-up areas of Bangkok have been filled and hardened, resulting in poor urban flooding and aggravating flooding, causing loss of life and property of citizens. In this paper, on the basis of combing the current water networks and open space potential flood storage points in the built-up areas of Bangkok, the complex network diagram of the water system in the built-up areas of Bangkok is constructed by combining the theory of complex networks and analyzing the attribute parameters of the network and the characteristic parameters of the open space storage nodes and water system paths, and finding that the water system network in the built-up area of Bangkok has complex network characteristics such as robustness, clustering and hierarchy. By exploring the key storage points and water system connection paths, the researchers initially constructed a flood safety pattern in the built-up area of Bangkok with 145 key nodes and 127 river paths as the backbone, and conceptualized the development study of the flood safety pattern in both horizontal and vertical directions. The urban flood safety pattern based on complex network theory proposed in this paper provides a case reference and methodological ideas to scientifically solve the game conflict between the demand for construction land for urban development and the construction area of urban open space storage points and water storage network under the increasingly severe flooding situation.

The Necessity of Human resources beyond perception of human understanding towards the Evaluation of video quality or Data screening methodology is conducted based on human perception level since it is concerned with how visual content is perceived by a observer based on observations with his/ her perception on a particular video sequence. Therefore, we considered that the subject has to grade the encoded video sequences under certain test environment conditions based on ITU-Recommendations. Since Human perception is considered as the true judgment and precise measurement of visual content, data screening has became quite essential and quite comfortable to general public due to introduction of User Experience(UX) concept by User Experience community. The translations of A recurrent neural network is based on certain principles, for instance we considered natural language processing which is certainly adaptable towards understanding sequential data and use patterns to predict the consistency within observers. In our research, we adapted principles based on Recurrent Neural Networks while assuming consistency within observers for predicting video quality within data screening environment towards subjective experiments. Moreover,this research work explores the trade offs between Human perception on visual content and consistency of observations within individual observer.

We construct hypergraphs to analyze functional brain connectivity, leveraging event-related coherence in magnetoencephalography (MEG) data during the visual perception of a flickering image. Principal network characteristics are computed for delta, theta, alpha, beta, and gamma frequency ranges. Employing a coherence measure, a statistical estimate of correlation between signal pairs across frequencies, we generate edge time series, depicting how an edge evolves over time. This forms the basis for constructing an edge-to-edge functional connectivity network. Emphasizing hyperedges as connected components in an absolute-valued functional connectivity network, we focus on exploring these hyperedges in the context of individual variability. Our coherence-based hypergraph construction specifically addresses functional connectivity among four brain lobes: frontal, parietal, temporal, and occipital. This approach enables a nuanced exploration of individual differences within diverse frequency bands, providing insights into the dynamical nature of brain connectivity during visual perception tasks. The results furnish compelling evidence supporting the hypothesis of cortico-cortical interactions occurring across varying scales. The derived hypergraph illustrates robust activation patterns in specific brain regions, indicative of their engagement across diverse cognitive contexts and different frequency bands. Our findings suggest potential integration or multifunctionality within the examined lobes, contributing valuable perspectives to our understanding of brain dynamics during visual perception.

In light of advancing technology, the conventional clock network architecture has become inadequate for addressing the intricacies inherent in modern System-on-Chip (SoC) designs. While clock mesh topology offers resilience against On-Chip Variation (OCV) fluctuations, it still necessitates manual intervention. Therefore, substantial scope exists for methodological enhancements and the refinement of rapid analytical techniques. This paper introduces a novel clock mesh synthesis approach, underpinned by dynamic programming algorithms, that guarantees latency constraints. Our experimental findings demonstrate that our algorithm achieves an additional 26.6% reduction in power consumption compared to the baseline methodology. Furthermore, it substantially reduces runtime by an average of 78.0% when contrasted with traditional simulation methods. These results highlight the potential of our methodology for enhancing the efficiency and power management of clock mesh.

The event camera generates an event stream based on changes in brightness, retaining only the characteristics of moving objects, addresses the high power consumption associated with using high-frame-rate cameras for high-speed eye tracking tasks. However, the asynchronous incremental nature of event camera output has not been fully utilized, and there are also issues related to missing event datasets. Combining the temporal information encoding and state-preserving properties of spiking neural network (SNN) with event camera, a near-range eye tracking algorithm is proposed as well as a novel event-based dataset for validation and evaluation. According to experimental results, the proposed solution outperforms artificial neural network (ANN) algorithms, while computational time remains only 12.5\% of that of traditional SNN algorithms. Furthermore, the proposed algorithm allows for self-adjustment of time resolution, with a maximum achievable resolution of 0.081ms, enhancing tracking stability while maintaining accuracy.

The proliferation of mobile and IoT devices, coupled with the advances in the wireless communication capabilities of these devices, have urged the need for novel communication paradigms for such heterogeneous hybrid networks. Researchers have proposed opportunistic routing as a means to leverage the potentials offered by such heterogeneous networks. While several proposals for multiple opportunistic routing protocols exist, only a few have explored fuzzy logic to evaluate wireless links status in the network to construct stable and faster paths towards the destinations. We propose FQ-AGO, a novel Fuzzy Logic Q-learning Based Asymmetric Link Aware and Geographic Opportunistic Routing scheme that leverages the presence of long-range transmission links to assign forwarding candidates towards a given destination. The proposed routing scheme utilizes fuzzy logic to evaluate whether a wireless link is useful or not by capturing multiple network metrics, the available bandwidth, link quality, node transmission power, and distance progress. Based on the fuzzy logic evaluation, the proposed routing scheme employs a Q-learning algorithm to select the best candidate set toward the destination. We implement FQ-AGO on the NS-3 simulator and compare the performance of the proposed routing scheme with three other relevant protocols: AODV, DSDV, and GOR. For precise analysis, we consider various network metrics to compare the performance of the routing protocols. Our simulation result validates our analysis and demonstrates remarkable performance improvements in terms of total network throughput, packet delivery ration, and end-to-end delay.

Object classification is a crucial task in deep learning, which involves the identification and categorization of objects in images or videos. Although humans can easily recognize common objects, such as cars, animals, or plants, performing this task on a large scale can be time-consuming and error-prone. Therefore, automating this process using neural networks can save time and effort while achieving higher accuracy. Our study focuses on the classification step of human chromosome karyotyping, an important medical procedure that helps diagnose genetic disorders. Traditionally, this task is performed manually by expert cytologists, which is a time-consuming process that requires specialized medical skills. Therefore, automating it through deep learning can be immensely useful. To accomplish this, we implemented and adapted existing preprocessing and data augmentation techniques to prepare the chromosome images for classification. We used ResNet-50 convolutional neural networks and an ensemble approach to classify the chromosomes, obtaining state-of-the-art performance in the tested dataset.

This comprehensive review explores the advancements in processing-in-memory (PIM) techniques for deep learning applications. It addresses the challenges faced by monolithic chip architectures and highlights the benefits of chiplet-based designs in terms of scalability, modularity, and flexibility. The review emphasizes the importance of dataflow-awareness, communication optimization, and thermal considerations in designing PIM-enabled manycore architectures. It discusses different machine learning workloads and their tailored dataflow requirements. Additionally, the review presents a heterogeneous PIM system for energy-efficient neural network training and discusses thermally efficient dataflow-aware monolithic 3D (M3D) NoC architectures for accelerating CNN inferencing. The advantages of TEFLON (Thermally Efficient Dataflow-Aware 3D NoC) over performance-optimized SFC-based counterparts are highlighted. Overall, this review provides valuable insights into the development and evaluation of chiplet and PIM architectures, emphasizing improved performance, energy efficiency, and inference accuracy in deep learning applications.

Although the statistical methods of downscaling climate data have progressed significantly, the development of high-resolution precipitation products continues to be a challenge. This is especially true when interest centres on downscaling value over several study sites. In this paper , we report a new downscaling method termed the multi-site Climate Generative Adversarial Network (MSCliGAN), which can simulate annual maximum precipitation to the regional scale during the 1950-2010 period in different cities in Canada by using different AOGCM's from the Coupled Model Inter-Comparison Project 6 (CMIP6) as input. Auxiliary information provided to the downscaling model included topography and land-cover. The downscaling framework uses a convolution encoder-decoder U-net network to create a generative network and a convolution encoder network to create a critic network. An adversarial training strategy is used to train the model. The critic/discriminator used Wasserstein distance as a loss measure and on the other hand the generator is optimized using a summation of content loss on Nash-Shutcliff Model Efficiency (NS), structural loss on structural similarity index (SSIM), and adversarial loss Wasserstein distance. Downscaling results show that downscaling AOGCMs by incorporating topography and land-use/land-cover can produce spatially coherent fields close to observation over multiple-sites. We believe the model has sufficient downscaling potential in data sparse regions where climate change information is often urgently needed.

To improve the current density distribution and electromagnetic performance of air-core inductors, a structural optimization method combining BP neural network and genetic algorithm was proposed for the study of axial and radial spiral multi-winding inductors. The Monte Carlo method was used to extract the structural size samples of the inductors, and the training dataset was obtained through finite element calculation of electromagnetic fields. Based on BP neural networks, nonlinear mapping models between the inductance value, volumetric inductance density, current distribution non-uniformity coefficient, and inductor structural parameters were constructed. The sensitivity analysis of the inductor inductance value affected by structural parameters was conducted through the Sobol index calculation. Using the current distribution non-uniformity coefficient as the fitness function and the volumetric inductance density as the constraint condition, the genetic algorithm was applied to optimize the structural parameters of the inductor globally. The optimization results were verified through finite element comparison. The results show that, under the requirement of satisfying the volumetric inductance density, the current distribution non-uniformity coefficient of AHI type inductor was reduced by 4.57% compared with the best sample in the sampling, while that of RHI type inductor was reduced by 5.33%, demonstrating the practicality of the BP-GA joint algorithm in the structural optimization design of inductors.

Accurate and robust deep learning models for facial expression recognition are challenging to achieve, given the diversity of human faces and variations in images, including different facial poses and lighting conditions. In this work, we proposed a clock-driven convolutional Spiking Neural Network (SNN) and STDP fine-tune architecture, meticulously calibrated its hyperparameters, and experimented with various optimization methods. The best model resulted was trained and evaluated on the Fer2013 and FER+ database, obtaining an accuracy of 61.87% and 79.97% without requiring auxiliary training data or face registration. To our best knowledge, the proposed SNN achieved comparable accuracy to CNNs of similar depth and possessed the advantages of low energy consumption and high computational efficiency. The computational efficiency of the proposed SNN is approximately three times that of CNNs. Along with this, we introduced the very recent cumulative spike guided encoder visualization technique and revealed the strong encoding capability of the proposed SNN.

This study demonstrates the efficacy of structured pruning and architectural fine-tuning on the YOLOv7-tiny model for eye state detection, emphasizing optimization for real-time applications. Structured pruning significantly reduced the model's complexity and storage size while maintaining high detection accuracy, as evidenced by stable precision, recall, and [email protected] metrics across iterations. Further fine-tuning adjusted the model's width and depth, optimizing efficiency and processing speed without compromising performance. These optimizations yielded YOLOv7-tiny variants that are both computationally efficient and accurate, suitable for resource-constrained environments. The findings highlight the critical role of model optimization in deploying effective neural networks for specific detection tasks in real-time scenarios.

Accurate detection of forest restoration sites using deep learning is crucial for effective ecosystem management, optimizing reforestation efforts, and ensuring environmental sustainability. While various deep learning-based systems have been developed for this purpose, the influence of different neural network architectures on model performance during the identification of forest restoration sites remains underexplored. This study aimed to address this gap by exploring the optimal methodology for extracting and classifying candidate sites for forest restoration based on Convolutional Neural Networks (CNNs), specialized for image recognition. Four categories—arable land, road and barren, quarry, and forest—were defined as candidate sites for forest restoration. A dataset comprising 17,043 samples was divided into training (11,929) and validation (5,114) sets at a ratio of 7:3 for model learning. Model accuracy was evaluated using pixel accuracy (PA) and mean intersection over union (mean IoU). The Resnet152-U-Net model demonstrated a pixel accuracy of 95.2% and a mean IoU of 61.3%, indicating excellent performance in extracting candidate sites for forest restoration. This approach offers spatial and temporal advantages over conventional field surveys or aerial image-based assessments, potentially serving as valuable data for selecting future forest restoration sites.

Air quality is one of the most concerning problems in major industrialized cities in the world. Prediction of future air quality is highly relevant to public health. In some big cities, multiple air quality measurement stations are deployed at different locations to monitor air pollutants, such as NO2, CO, PM 2.5 and PM 10, over time. At every monitoring time stamp t, we observe one station×feature matrix xt of the pollutant data, which represents a spatio–temporal process. Traditional methods on prediction of air quality typically use data from one station or can only predict a single pollutant (such as PM 2.5) at a time, which ignores the spatial correlation among different stations. Moreover, the air pollution data are typically highly nonstationary, We propose a de-trending graph convolutional LSTM (long short term memory) to continuously predict the whole station×feature matrix in the next 1 to 48 hours, which not only captures the spatial dependency among multiple stations by replacing an inner product with convolution, but also incorporates the de-trending signals (transform a nonstationary process to a stationary one by differencing the data) into our model. Experiments on the air quality data of the city Chengdu and multiple major cities in China demonstrate the feasibility of our method and show promising results.

Accurate prediction of the degree of airport delays under the influence of convective weather is crucial for collaborative traffic management implementation and improving the efficiency of airport operations. However, existing studies usually only consider numerical-type quantitative features of weather-affected traffic in their models, and lack the introduction of spatial information to comprehensively portray the traffic operation scenarios under the influence of weather. In order to overcome this problem, this paper firstly designs a new image representation of weather-affected air traffic, and constructs a multi-channel traffic and weather scene image (MTWSI) by populating the airspace two-dimensional grid with traffic and meteorological information to represent the overall traffic operation situation in the terminal area under the influence of convective weather; then, a deep convolutional neural network-based airport delay prediction model ( ADLCNN), which takes MTWSI images as input and uses a specific CNN model to extract the deep features that affect traffic operation in it to input into the subsequent classification algorithm to predict the flight delay level; finally, a series of comparative experiments are carried out on the operational data of Guangzhou Baiyun Airport, and the experimental validation shows that, compared with the traditional machine learning methods, the proposed CNN-based airport delay prediction The experimental validation shows that the proposed CNN-based airport delay prediction model has satisfactory prediction performance compared with the traditional machine learning methods, which also proves that the proposed MTWSI method can more comprehensively respond to the real traffic conditions.

Consciousness results from comprehending the living creature from its existence in time and space. Thought and consciousness are distinguishing factors between humans and machines having artificial intelligence. No algorithm has been offered for artificial self-awareness based on Thinking. Previous studies have not studied the relationship between consciousness, thinking and time. In this study, the relationship between consciousness, thinking, memories and speech over time has been studied. A deep logical connection exists between consciousness, thinking, and time. An algorithm can be designed for artificial consciousness based on this research findings.

This article presents a study on brain tumor detection using the VGG-16 model, a convolutional neural network known for its performance in computer vision tasks. The aim of the study is to classify magnetic resonance imaging (MRI) images and accurately identify the presence of brain tumors. The dataset used consists of brain tumor MRI images, categorized into two classes: "NO" (no tumor) and "YES" (tumor). The methodology involves setting up the environment, importing and preprocessing the data, building the VGG-16 model, and evaluating its performance using metrics such as accuracy, precision, and recall. The results demonstrate an accuracy of approximately 88% on the validation set and 80% on the test set, indicating the potential of the VGG-16 model in supporting healthcare professionals in diagnosing brain tumors. The study contributes to the field of medical image analysis and offers insights into the application of deep learning for brain tumor detection.

Fault detection is an important step for subsurface interpretation and reservoir characterization from 3D seismic images. Due to the numerous and complicated faulting structures of seismic images, manual seismic interpretation is time taking and need intensive work. To overcome this problem, geoscientists are coming up with productive computer-aided techniques for assisting in interpreter science for many years. However, in this paper, we used a pre-trained CNN model to predict faults from the 3D seismic volume of the Poseidon field of Browse Basin, Australia. Basically, this field is highly structured with complex normal faulting throughout the targeted Plover Formations. So, our motivation for this work in this field is to compare machine learning-based fault prediction to user interpreted faults identification with supported by seismic variance attribute. We found very satisfying result using DL with having an improved fault probability volume that outperform variance technology. Therefore, we propose that this workflow could reduce time and able to predict fault quite accurately in any field area.

Abstract: An attractive application of crude glycerol is in the generation of biomethane by means of anaerobic co-digestion, involving the decomposition of the organic matter in two or more substrates by bacteria and archaea, in the absence of oxygen. Thus, the objective of this work was to evaluate the potential of neural networks and fuzzy logic to predict the production of biomethane from the anaerobic co-digestion of glycerol and/or sugarcane molasses. Firstly, a reactor model was implemented using Scilab, with Monod kinetics involving two substrates and an intermediate (M2SI model), to generate a database for subsequent fitting and evaluation of neural and fuzzy models. The neural network package of Matlab was used. Fuzzy modeling was applied using the Takagi-Sugeno approach available in the ANFIS package of Matlab. The biomethane production results simulated by M2SI were used in neural network modeling, firstly employing a “generic” network applicable to all 8 scenarios. A very good fit was obtained (R²>0.99). Excellent performance was also observed for specific artificial neural networks (one for each condition). The parameters of the M2SI model for the 8 different conditions were also mapped using a neural network, as a function of the organic material composition. A fit with R²>0.99 was obtained using 25 neurons. In the case of the fuzzy logic, RMSE of 18.88 mL of methane was obtained with 216 rules, which was a value lower than 0.5% of the order of magnitude of the accumulated methane. It could be concluded from the results that fuzzy logic and artificial neural networks offer excellent ability to predict methane production, as well as to parameterize the M2SI kinetic model (using neural networks).

Change detection with heterogeneous remote sensing images (Hete-CD) plays an important role in practical applications, especially when homogenous remote sensing images are unavailable. However, bitemporal heterogeneous remote sensing images (HRSIs) cannot compare directly to measure change magnitude, and many deep learning methods require large amounts of samples to train the module. Moreover, labeling many samples for land cover change detection with HRSIs is time-consuming and labor-intensive. Therefore, acquiring satisfactory performance of Hete-CD remains a challenge for deep learning networks with very small training samples. In this study, we promote a novel deep-learning framework for Hete-CD to obtain satisfactory performance while the initial samples are very small. We initially design a multiscale network with select kernel-attention module to focus on capturing different change targets with various sizes and shapes. Then, a simple yet effective non-parametric sample-enhanced algorithm based on the Pearson correlation coeffi-cient is promoted to explore potential samples around each initial sample. Finally, the proposed network and sample-enhanced algorithm are fused into one iterative framework to improve the change detection performance with very small samples. Experimental results conducted on four pairs of actual HRSIs indicated that the proposed framework can achieve competitive accuracies with very small samples for initialization when compared with some state-of-the-art methods. For example, the improvement is approximately 3.38% and 1.99% when compared with the selected traditional methods and deep learning methods, respectively.

The problem of optimal scheduling in a system with parallel queues and a single server has been extensively studied in the queueing theory. However, such systems have mostly been studied by assuming homogeneous attributes of arrival and service processes, or in heterogeneous case a Markov random process was usually assumed. In this paper, we explore the possibility of combining simulation and neural network paradigms for optimal scheduling in a heterogeneous system with an arbitrary inter-arrival and service time distributions. The service of any queue by the server is exhaustive. Further routing of the server after the queue has been emptied is as instructed by the trained neural network. Any change in the queue that currently has a server is accompanied by a switching cost. The simulated annealing optimization algorithm which is used to optimize the parameters of the neural network was adapted for numerically evaluated average cost function. A Markov decision problem was formulated for the corresponding markovian queueing system to verify the results of solving the optimization problem. In addition to comparing the actual values of the average cost, the parameter values of the neural network trained on the optimal control policy of the Markov model are also used to determine the domains of parameters required for the simulated annealing defined on a finite discrete domain. Numerical analysis shows the effectiveness of this approach. Moreover, a comparison of the results for different distributions illustrates the insensitivity of the optimal control policy to the shape of the distributions for the same two first moments. Thus, the optimal control policy for an exponential model can be used as a suboptimal one for the general system.

Blind deconvolution (BD) is one of the effective methods that help pre-process vibration signals and assist in bearing fault diagnosis. Currently, most BD methods design an optimization criterion and use frequency or time domain information independently to optimize a deconvolution filter. It recovers weak periodic impulses related to incipient faults. However, the random noise interference may cause the optimizer to overfit. The time-domain-based BD methods tend to extract fault-unrelated single peak impulse, and the frequency-domain-based BD methods tend to retain the maximum energy frequency component, which will lose the fault-related harmonics frequency components. To solve the above issue, we propose a hybrid criterion that combines the kurtosis for time domain optimization and the $G-l_1/l_2$ norm for the frequency domain. These two criteria are monotonically increasing and decreasing, so they mutually constrain to avoid overfitting. After that, we design a multi-task one-dimensional convolutional neural network with time and frequency branches to achieve an optimal solution for this hybrid criterion. The multi-task neural network realizes the simultaneous optimization of two domains. Experimental results show that our proposed method outperforms other state-of-the-art methods.

In recent years, the demand for coffee has increased tremendously. During the production process, green coffee beans are traditionally screened manually for defective beans before they are packed into coffee bean packages; however, this method is not only time-consuming but also increases the rate of human error due to fatigue. Therefore, this paper proposed a lightweight deep convolutional neural network (LDCNN) for the quality detection system of green coffee beans, which combined depthwise separable convolution (DSC), squeeze-and-excite block (SE block), skip block, and other frameworks. To avoid the influence of low parameters of the lightweight model caused by the model training process, rectified Adam (RA), lookahead (LA), and gradient centralization (GC) were included to improve efficiency; the model was also put into the embedded system. Finally, the local interpretable model-agnostic explanations (LIME) model was employed to explain the predictions of the model. The experimental results indicated that the accuracy rate of the model could reach up to 98.38% and the F1 score could be as high as 98.24% when detecting the quality of green coffee beans. Hence, it can obtain higher accuracy, lower computing time, and lower parameters. Moreover, the interpretable model verified that the lightweight model in this work is reliable, providing the basis for screening personnel to understand the judgment through its interpretability, thereby improving the classification and prediction of the model.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

Damage detection based on modal parameter changes becomes popular in the last decades. Nowadays are available robust and reliable mathematical relations to predict the natural frequency changes if damage parameters are known. Using these relations, it is possible to create databases containing a large variety of damage scenarios. Damage can be thus assessed by applying an inverse method. The problem is the complexity of the database, especially for structures with more cracks. In this paper, we propose two machine learning methods, namely the random forest (RF) and the artificial neural network (ANN) as search tools. The databases we developed contain damage scenarios for a prismatic cantilever beam with one crack and ideal and non-ideal boundary conditions. The crack assessment is made in two steps. First, a coarse damage location is found from the networks trained for scenarios comprising the whole beam. Afterward, the assessment is made involving a particular network trained for the segment of the beam on which the crack is previously found. Using the two machine learning methods, we succeed to estimate the crack location and severity with high accuracy for both simulation and laboratory experiments. Regarding the location of the crack, which is the main goal of the practitioners, the errors are less than 0.6%. Based on these achievements, we concluded that the damage assessment we propose, in conjunction with the machine learning methods, is robust and reliable.

Decision tree algorithms have been among the most popular algorithms for interpretable (transparent) machine learning since the early 1980s. On the other hand, deep learning methods have boosted the capacity of machine learning algorithms and are now being used for non-trivial applications in various applied domains. But training a fully-connected deep feed-forward network by gradient-descent backpropagation is slow and requires arbitrary choices regarding the number of hidden units and layers. In this paper, we propose near-optimal neural regression trees, intending to make it much faster than deep feed-forward networks and for which it is not essential to specify the number of hidden units in the hidden layers of the neural network in advance. The key idea is to construct a decision tree and then simulate the decision tree with a neural network. This work aims to build a mathematical formulation of neural trees and gain the complementary benefits of both sparse optimal decision trees and neural trees. We propose near-optimal sparse neural trees (NSNT) that is shown to be asymptotically consistent and robust in nature. Additionally, the proposed NSNT model obtain a fast rate of convergence which is near-optimal up to some logarithmic factor. We comprehensively benchmark the proposed method on a sample of 80 datasets (40 classification datasets and 40 regression datasets) from the UCI machine learning repository. We establish that the proposed method is likely to outperform the current state-of-the-art methods (random forest, XGBoost, optimal classification tree, and near-optimal nonlinear trees) for the majority of the datasets.

Objectives: In order to solve the problem that most of the existing research focuses on the binary tactile attributes of objects,which ignores the tactile attribute strength and category recognition,an attribute strength and category recognition method based on convolutional neural network matrix-label is proposed. Methods:Firstly,in the data preparation stage,we preprocess the raw data and determine the matrix labels to build the haptic dataset.Secondly,in the feature extraction stage,we fuse the haptic data of two fingers and use the convolutional neural network to extract the attribute strength features.Finally,in the attribute strength and category recognition stage,all channel haptic data is fused to predict the attribute strength and category.Results:We compared with the multi-label convolutional neural network method in terms of elastic strength,hardness strength and category,and compared the attribute strength recognition capabilities of the two methods using novel objects outside the haptic dataset.The results show that the accuracy of the last 20 iterations of the matrix-label method has an average elastic strength of 96.73%,hardness strength of 97.34%,and category of 96.67%.The performance is better.When the Euclidean distance between the prediction of the novel object and the real label is less than 1,the accuracy of the elastic strength is best to reach 100%,and the hardness strength is best to reach 100%.The performance is better. Conclusions:The effectiveness of the method has been verified.Comparing with the convolutional neural network method,our method can effectively recognize the attribute strength and category of objects.

We propose a chemical language processing model to predict polymers’ glass transition temperature (Tg) through a polymer language (SMILES, Simplified Molecular Input Line Entry System) embedding and recurrent neural network. This model only receives the SMILES strings of polymer’s repeat units as inputs and considers the SMILES strings as sequential data at the character level. Using this method, there is no need to calculate any additional molecular descriptors or fingerprints of polymers, and thereby, being very computationally efficient and simple. More importantly, it avoids the difficulties to generate molecular descriptors for repeat units containing polymerization point `*’. Results show that the trained model demonstrates reasonable prediction accuracy on unseen polymer’s Tg. Besides, this model is further applied for high-throughput screening on an unlabeled polymer database to identify high-temperature polymers that are desired for applications in extreme environments. Our work demonstrates that the SMILES strings of polymer’s repeat units can be used as an effective feature representation to develop a chemical language processing model for predictions of Tg. The framework of this model is general and can be used to construct structure-property relationships for other polymer’s properties.

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane tracking. In this study, an autonomous driving system is developed and tested in the experimental environment designed for this purpose. In this system, a model vehicle having a camera is used to trace the lanes and avoid obstacles to experimentally study autonomous driving behavior. Convolutional Neural Network models were trained for Lane tracking. For the vehicle to avoid obstacles, corner detection, optical flow, focus of expansion, time to collision, balance calculation, and decision mechanism were created, respectively.

Different machine learning models (multiple linear regression, vector support machines, artificial neural networks and random forests) are applied to predict the monthly global irradiation (MGI) from different input variables (latitude, longitude and altitude of meteorological station, month, average temperatures, among others) of different areas of Galicia (Spain). The models were trained, validated and queried using data from three stations, and each best machine model was checked in two independent stations. The results obtained confirmed that the best ML methodology is the ANN model which presents the lowest RMSE value in the validation and querying phases 122.6·10kJ/(m2∙day) and 113.6·10kJ/(m2∙day), respectively, and predict conveniently for independent stations, 201.3·10kJ/(m2∙day) and 209.4·10kJ/(m2∙day), respectively. Given the good results obtained, it is convenient to continue with the design of artificial neural networks applied to the analysis of monthly global irradiation.

This article describes techniques employed in the production of a synthetic dataset of driver telematics emulated from a similar real insurance dataset. The synthetic dataset generated has 100,000 policies that included observations about driver’s claims experience together with associated classical risk variables and telematics-related variables. This work is aimed to produce a resource that can be used to advance models to assess risks for usage-based insurance. It follows a three-stage process using machine learning algorithms. The first stage is simulating values for the number of claims as multiple binary classifications applying feedforward neural networks. The second stage is simulating values for aggregated amount of claims as regression using feedforward neural networks, with number of claims included in the set of feature variables. In the final stage, a synthetic portfolio of the space of feature variables is generated applying an extended SMOTE algorithm. The resulting dataset is evaluated by comparing the synthetic and real datasets when Poisson and gamma regression models are fitted to the respective data. Other visualization and data summarization produce remarkable similar statistics between the two datasets. We hope that researchers interested in obtaining telematics datasets to calibrate models or learning algorithms will find our work valuable.

The paper demonstrates the analysis of Corona Virus Disease based on a CNN probabilistic model. It involves a technique for classification and prediction by recognizing typical and diagnostically most important CT images features relating to Corona Virus. The main contributions of the research include predicting the probability of recurrences in no recurrence (first time detection) cases at applying our proposed Convolution neural network structure. The Study is validated on 2002 chest X-ray images with 60 confirmed positive covid19 cases and (650 bacterial – 412 viral -880 normal) x-ray images. The proposed CNN compared with traditional classifiers with proposed CHFS feature extraction model. The experimental study has done with real data demonstrates the feasibility and potential of the proposed approach for the said cause. The result of proposed CNN structure has been successfully done to achieve 98.20% accuracy of covid19 potential cases with comparable of traditional classifiers.

The COVID-19 is a highly contagious viral infection which played havoc on everyone's life in many different ways. According to the world health organization and scientists, more testing potentially helps governments and disease control organizations in containing the spread of the virus. The use of chest radiographs is one of the early screening tests to determine the onset of disease, as the infection affects the lungs severely. This study will investigate and automate the process of testing by using state-of-the-art CNN classifiers to detect the COVID19 infection. However, the viral could of many different types; therefore, we only regard for COVID19 while the other viral infection types are treated as non-COVID19 in the radiographs of various viral infections. The classification task is challenging due to the limited number of scans available for COVID19 and the minute variations in the viral infections. We aim to employ current state-of-the-art CNN architectures, compare their results, and determine whether deep learning algorithms can handle the crisis appropriately. All trained models are available at https://github.com/saeed-anwar/COVID19-Baselines

Owing to the time-varying characteristics and nonlinearities of industrial processes, control has higher difficulties and results in challenges for advanced technology. In this paper, a self-tuning controller that includes a nonlinear proportional-integral-derivative (NPID) control function as well as a self-tuning function is proposed for first-order plus time delay (FOPTD) process control. The NPID control function is implemented using the nonlinear PID controller whose optimum parameters are adapted by a neural network (NN). The self-tuning function is able to identify the process dynamics using a short period of process behavior and tune NPID parameters based on the identified parameters. The advantage of the proposed method is validated with a set of simulation works on three processes and the comparison results are presented.

We first review the literature on machine behavior which may contain the interaction between machines, and then discuss the methodology and the related case involving collaboration between robots to instantiate the concept with AI empowerment. The navigation case aims to a security application with autonomous control and roadside agent embedded in a mobile edge computing structure. In the studied navigation based on the artificial potential field method, robots need to use position information to calculate the moving direction frequently. In the case of high motion speed as well as GPS positioning error, the path trajectory may show a sharp change of direction. In order to mitigate the trajectory oscillation, this paper proposes a path planning design where training process and motion direction prediction are integrated by using artificial neural network. The auxiliary navigation agent near multiple obstacles can first extract the past movement information of the robot and then determines whether there is a serious path jitter event. Computer simulation analysis shows that the combination of autonomous control and cooperative behavior can effectively reduce the path jitter so as to achieve a fast and safe path planning.

In this work we present the results obtained with an artificial neural network (ANN) which we trained to predict the expected output of high-order harmonic generation (HHG) process, while exploring a multi-dimensional parameter space. We argue on the utility and efficiency of the ANN model and demonstrate its ability to predict the outcome of HHG simulations. In this case study we present the results for a loose focusing HHG beamline, where the changing parameters are: the laser pulse energy, gas pressure, gas cell position relative to focus and gas cell length. The physical quantity which we predict here using ANN is directly related to the total harmonic yield in a specified spectral domain (20-40 eV). We discuss the versatility and adaptability of the presented method.

Multidisciplinary Design Optimization (MDO) is the most active field in the design of current complex system engineering, which is possessed with such two difficulties as subsystem information exchange and analytical and computational complexity of systems. Therefore, an improved collaborative optimization algorithm based on ANN (artificial neural network) response surface was proposed dependent on the consistency constraint algorithm and concurrent subspace algorithm. As an optimization method with secondary structure, it satisfied only local constraints in discipline layer, but provided a coordinated mechanism for interdisciplinary conflict in system layer. Finally, it was applied in the multidisciplinary design optimization of autonomous underwater vehicle (AUV). As shown from the result, the MDO convergence stability and reliability of low resistance, low noise and high maneuvering performance of the AUV shape can be ensured by the improved collaborative optimization algorithm, thus verifying the effectiveness of the algorithm.

The CAN protocol is widely adopted for in-vehicle networks due to its cost efficiency and reliable transmission. However, despite its popularity, the protocol lacks built-in security mechanisms, making it vulnerable to various attacks such as flooding, fuzzing, and DoS. These attacks can exploit vulnerabilities and disrupt the normal behavior of the in-vehicle network. One of the main reasons for these security concerns is that the protocol relies on broadcast frames for communication between ECUs within the network. To tackle this issue, this paper presents an intrusion detection system that leverages multiple LSTM-Autoencoders. The proposed system utilizes diverse features, including transmission interval and payload value changes, to capture various characteristics of normal network behavior. By analyzing different types of features separately using the LSTM-Autoencoder model, the system effectively detects anomalies. In our evaluation, we conducted experiments using real vehicle network traffic, and the results demonstrated the system's high precision with a 99% detection rate in identifying anomalies.

With the improvement of software copyright protection awareness, code obfuscation technology plays a crucial role in protecting key code segments. As the obfuscation technology becomes more and more complex and diverse, it has spawned a large number of malware variants, which make it easy to evade the detection of anti-virus software. Malicious code detection mainly depends on binary code similarity analysis. However, the existing software analysis technologies are difficult to deal with the growing complex obfuscation technologies. To solve this problem, this paper proposes a new obfuscation-resilient program analysis method, which is based on the data flow transformation relationship of the intermediate representation and the graph network model. In our approach, we first construct the data transformation graph based on LLVM IR. Then, we design a novel intermediate language representation model based on graph networks, named DFSGraph, to learn the data flow semantics from DTG. DFSGraph can detect the similarity of obfuscated code by extracting the semantic information of program data flow without deobfuscation. Extensive experiments prove that our approach is more accurate than existing deobfuscation tools when searching for similar functions from obfuscated code.

The root system plays an irreplaceable role in plant growth. Its improvement can increase crop productivity. However, such system is still mysterious for us. The underlying mechanism has not been fully uncovered. The investigation on proteins related to the root system is an important means to complete this task. In the previous time, lack of root-related proteins makes it impossible to adopt machine learning methods for designing efficient models for the discovery of novel root-related proteins. Recently, a public database on root-related proteins was set up and machine learning methods can be applied in this field. In this study, we proposed a machine learning based model, named Graph-Root, for identification of root-related proteins. The features derived from protein sequences and one network were extracted, where the former features were processed by graph convolutional neural network and multi-head attention, and the later features abstracted the linkage between proteins. These features were fed into the fully connected layer to make prediction. The 5-fold cross-validation and independent tests suggested its good performance. It also outperformed the only one previous model, SVM-Root. Furthermore, the importance of each feature type and component in the proposed model was investigated.

Aiming at the current optimization problem of electric vehicle charging path planning, a charging path optimization strategy for electric vehicles under the "Traffic-Price-Distribution" mode is proposed. This strategy builds an electric vehicle charging and navigation system based on road traffic network model, real-time electricity price model and distribution network model. Based on Dijkstra shortest path algorithm and Monte Carlo time-space prediction method, the goal is to minimize the charging cost of electric vehicles. Optimal charging path. The simulation results of MATLAB and MATPOWER show that the electric vehicle charging path optimization strategy can better solve the local traffic congestion problem and improve the safety and stability of the distribution network on the basic of fully considering the convenience of electric vehicle charging.

Depression is one of the psychiatric disorders characterized by anxiety, pessimism, and suicidal tendencies, which seriously affect the quality of life of patients and their families. In this paper, we used polynomial-based kernel Granger causality values as network node connectivity indicators to construct brain networks for 5 depressed patients and 11 healthy individuals’ magnetoencephalogram(MEG) under positive, neutral, and negative emotional stimuli, respectively, and found that depressed patients had closer information exchange between frontal and occipital regions compared to healthy individuals and other brain regions, and fewer causal connections in parietal and central regions. Further analysis of the topological properties of the network revealed that depressed patients had higher mean degrees under negative stimuli (p=0.008)and lower mean clustering coefficients than healthy individuals(p=0.034). Comparing the mean degree and mean clustering coefficient of the same sample under different emotional stimuli, we found that depressed patients had the greater mean degree and mean clustering coefficient under negative stimuli than neutral and positive stimuli. We also found that patients’ feature path lengths under negative and neutral stimuli significantly deviated from small-world attributes. The results suggest that analysis of nuclear Granger causality-based brain networks can effectively characterize depression pathology.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial & temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

In this paper, the Group Method of Data Handling (GMDH) type of neural networks is used for the inductance calculation of variable inductors. The relation between the inductance of the inductor in the linear and nonlinear regions is investigated, and parameters such as the voltage across the inductor, bias current, and ac current are taken into account. The experimental setup is used for generating the data needed for training the neural network. Over 800 experiments were conducted and were used for training and validation of the neural network results. The results are compared with the reluctance equivalent circuit method, and they show a much better accuracy. The proposed method can be used for the calculation of various magnetic components, and it is not limited to variable inductors.

For years, effort has been devoted to establishing an effective bull breeding soundness evaluation procedure; usual research on the subject is based on BBSE (Bull Breeding Soundness Examination) methodologies, which have significant limitations in terms of their evaluation procedure, such as high cost, time-consuming and administratively difficult. This research focuses on the creation of a prediction model to supplement and/or improve the BBSE approach, through the study of two algorithms, Clustering and Artificial Neural Network (ANN), to find the optimum Machine Learning (ML) approach for our application, with an emphasis on data categorization accuracy. The tool is designed to assist veterinary medicine and farmers in identifying key factors and increasing certainty in their decision-making during the selection of bulls for breeding purposes, providing data from a limited number of factors generated from a deep pairing study of bulls. Zebu Bulls, European Bulls, and Crossbred Bulls were the general groupings. The data utilized in the model's creation (N =359) considers five variables that influence improvement decisions. This approach enhances decision-making by 12%. ANN obtained an accuracy of 90%; Precision was 97% for satisfying, 92% for unsatisfying, and 85% for Bad.

Especially for drought periods, the higher the accuracy of reservoir inflow forecasting, the more reliable the water supply from a dam. The article focuses on probabilistic forecasting of seasonal inflow to reservoirs and determines estimates from the probabilistic seasonal inflow according to drought forecast results. The probabilistic seasonal inflow was forecasted by a copula-based Bayesian network employing a Gaussian copula function. Drought forecasting was performed by calculation of the standardized streamflow index value. The calendar year is divided into four seasons; the total inflow volume of water to a reservoir for a season is referred to as the seasonal inflow. Seasonal inflow forecasting curves conforming to drought stages produce estimates of probabilistic seasonal inflow according to the drought forecast results. The forecasted estimates of seasonal inflow were calculated by using the inflow records of Soyanggang and Andong dams in the Republic of Korea. Under the threshold probability of drought occurrence ranging from 50 to 55 %, the forecasted seasonal inflows reasonably matched critical drought records. Combining the drought forecasting with the seasonal inflow forecasting may produce reasonable estimates of drought inflow from the probabilistic forecasting of seasonal inflow to a reservoir.

In order to realize the performance degradation trend prediction accurately, a prediction method based on multi-domain features and temporal convolutional network (TCN) is proposed. Firstly, construct a high-dimensional feature set in the multi-domain of vibration signals, and use comprehensive evaluation indicators to preliminarily screen performance degradation indexes with good sensitivity and strong trend. Secondly, the kernel principal component analysis (KPCA) method is adopted to eliminate redundant information between multi-domain features, and construct a health index (HI) based on convolutional auto-encoder (CAE) network. Thirdly, a TCN-based performance degradation trend prediction model is constructed, and direct multi-step prediction is used to predict the performance degradation trend of the monitored object. On this basis, the validity of the proposed method is verified using the bearing public data, and it is successfully applied to performance degradation trend prediction of rolling contact fatigue specimen. The results show that the feature set can be reduced from 14 dimensions to 4 dimensions by using KPCA, while 98.33% of the information of the original feature set is retained. Furthermore, the method of constructing HI based on CAE network is effective. The change process of the HI constructed truly reflects the performance degradation process of the rolling contact fatigue specimen. Compared with the two commonly used HI construction methods, auto-encoding (AE) network and gaussian mixture model (GMM), this method has obvious advantages. At the same time, the prediction model based on TCN can accurately predict the performance degradation of the rolling contact fatigue specimen with the root mean square error 0.0146 and the mean absolute error 0.0105, which has better performance and higher prediction accuracy than the prediction model based on the long short-term memory (LSTM) network and the gated recurrent unit (GRU). This method has general significance and may be extended to the performance degradation prediction of other mechanical equipment/parts.

Traditional image steganography conceals secret messages into unprocessed natural images by modifying the pixel value, causing the obtained stego different from the original image in terms of statistical distribution, thereby could be detected by a well-trained classifier for steganalysis. To ensure the steganography is imperceptible and in line with the trend of art images produced by Artificial Intelligence Generated Content (AIGC) becoming popular in social networks, this paper proposes to embed hidden information throughout the process of the generation of an art-style image by designing an image style transformation neural network with steganography function. The proposed scheme takes a content image, an art-style image, and messages to be embedded as inputs, processing them with an encoder-decoder model, and finally generates a styled image containing the secret messages at the same time. An adversarial training technique is applied to enhance the imperceptibility of the generated art-styled stego image with from plain style-transferred images. The lack of the original cover image makes it difficult for the opponent learning a steganalyzer to identify the stego. The recommended approach can successfully withstand existing steganalysis techniques and attain the embedding capacity of 3 bits per pixel for a color image, according to experimental results.

Pedestrian detection is the core of driver assistance system, which collects the road conditions through the radars or cameras on the vehicle, judges whether there is a pedestrian in front of the vehicle, supports decisions such as raising the alarm, automatically slowing down or emergency stopping to keep pedestrians safe, and improves the security when the vehicle is moving. Suffered from weather, lighting, clothing, large pose variations and occlusion, the current pedestrian detection still has a certain distance from the practical applications. In recent years, deep networks have shown excellent performance for image detection, recognition and classification. Some researchers employed deep network for pedestrian detection and achieve great progress, but deep networks need huge computational resources which make it difficult to put into practical applications. In real scenarios of autonomous vehicle, the computation ability is limited. Thus, the shallow networks such as UDN (Unified Deep Networks) is a better choice since it performs well on consuming less computation resources. Base on UDN, this paper proposes a new deep network model named as two-stream UDN, which augments another branch for solving traditional UDN’s indistinction of the difference between trees / telegraph poles and pedestrians. The new branch accepts the upper third part of the pedestrian image as input, and the partial image has less deformation, stable features and more distinguished characters from other objects. For the proposed two-stream UDN, multi-input features including HOG feature, Sobel feature, color feature and foreground regions extracted by GrabCut segmentation algorithms are fed. Compared with the original input of UDN, the multi-input features are more conducive for pedestrian detection since the fused HOG features and significant objects are more significant for pedestrian detection. Two-stream UDN is trained through two steps: First, the two sub-networks are trained until converge; then we fuse results of the two subnets as the final result and feed it back to the two subnets to fine tune network parameters synchronously. To improve the performance, Softplus is adopted as activation function to obtain faster training speed, and positive samples are mirrored and rotated with small angle to make positive and negative samples more balanced.

Conventionally, partial differential equations (PDE) problems are solved numerically through discretization process by using finite difference approximations. The algebraic systems generated by this process are then finalized by using an iterative method. Recently, scientists invented a short cut approach, without discretization process, to solve the PDE problems, namely by using machine learning (ML). This is potential to make scientific machine learning as a new sub-field of research. Thus, given the interest in developing ML for solving PDEs, it makes an abundance of an easy-to-use methods that allows researchers to quickly set up and solve problems. In this review paper, we discussed at least three methods for solving high dimensional of PDEs, namely PyDEns, NeuroDiffEq, and Nangs, which are all based on artificial neural networks (ANNs). ANN is one of the methods under ML which proven to be a universal estimator function. Comparison of numerical results presented in solving the classical PDEs such as heat, wave, and Poisson equations, to look at the accuracy and efficiency of the methods. The results showed that the NeuroDiffEq and Nangs algorithms performed better to solve higher dimensional of PDEs than the PyDEns.

Calligraphy works have high artistic value, but there is a rampant problem of forgery. Indeed, authentication of traditional calligraphy heavily relies on calligraphers' subjective judgment. Therefore, spurred by the recent development of neural networks, this paper proposes a method for authenticating calligraphy works based on an improved EfficientNet network. Specifically, the developed method utilizes the character box algorithm and the centroid algorithm to extract individual calligraphy characters, which are then augmented and used as the training set for the model. The training process employs CBAM and Self-Attention modules to enhance the attention mechanism of the EfficientNet network. The model is tested on authentic works, imitated works, and works from other calligraphers and is compared with other networks. The experimental results demonstrate that the proposed method effectively achieves the authentication of calligraphy works, and the improved CBAM-EfficientNet network and SA-EfficientNet network achieve better authentication performance.

Wearing gloves while operating machinery in workshops is an essential precaution to prevent mechanical injuries and burns from high temperatures, among other potential hazards. Ensuring workers are properly equipped with gloves, which is a crucial measure in accident prevention. Glove images often occupy a minimal proportion of the frame and are easily obscured by cluttered backgrounds, especially with limited edge computing resources. Consequently, this study proposes a glove detection algorithm called YOLOv8-AFPN-M-C2f based on YOLOv8, offering swifter detection speeds, lower computational demands, and enhanced accuracy for workshop scenarios. This research innovates by substituting the head of YOLOv8 with the AFPN-M-C2f network, amplifying the pathways for feature vector propagation, and mitigating semantic discrepancies between non-adjacent feature layers. Additionally, the introduction of a superficial feature layer enriches surface feature information, augmenting the model's sensitivity to smaller objects. To assess the performance of the YOLOv8-AFPN-M-C2f model, we conducted multiple experiments using a factory glove detection dataset compiled for this study. The results indicate that the enhanced YOLOv8 model surpasses other network models. Compared to the baseline YOLOv8 model, the refined version shows a 2.6% increase in mAP@50%, a 90.1% rise in FPS, and a 13% reduction in the number of parameters. This research contributes an effective solution for the detection of glove adherence.

With the deepening of the diversification and openness of financial system, financial vulnerability, as an endogenous attribute of financial system, becomes an important measurement of financial security. Based on network analysis, we introduce network curvature indicator improved by Copula entropy as an innovative metric of financial vulnerability. Compared with previous network curvature analysis method, CE-based curvature proposed in this paper can measure market vulnerability and systematic risk with significant advantages.

Cooperative localization under complex urban environments has become a solution to replace the Global Navigation Satellite System (GNSS) positioning. Due to utilizing distance measured and information exchanged between vehicles, cooperative localization results in high computational complexity and heavy communication overhead. This paper proposes a cooperative localization method based on evolutionary coalitional game theory, which implements vehicles' location estimation with less communication cost. We select the neighboring vehicles to form a coalition based on the node's square position error bound and communication cost. The location is obtained via exchanging information between vehicles. It is evident from the simulations and results that the proposed method holds low communication overhead while maintaining localization accuracy.

In Brain-Computer Interface Motor Imagery (BCI-MI) systems, Convolutional Neural Networks (CNNs) have traditionally dominated as the deep learning method of choice, demonstrating significant advancements in state-of-the-art studies. Recently, Transformer models with attention mechanisms have emerged as a sophisticated technique, enhancing the capture of long-term dependencies and intricate feature relationships in BCI-MI. This research investigates the performance of EEG-TCNet and EEG-Conformer models, which are trained and validated using various hyperparameters and bandpass filters during preprocessing to assess improvements in model accuracy. Additionally, this study introduces the EEG-TCNTransformer, a novel model that integrates the convolutional architecture of EEG-TCNet with a series of self-attention blocks employing a multi-head structure. The EEG-TCNTransformer achieves an accuracy of 82.97% without the application of bandpass filtering. The source code of EEG-TCNTransformer is available on GitHub.

Emergency departments (EDs) are critical in urgent care, where accurate triage optimizes patient flow and resource allocation. Manual triage faces challenges due to increasing volume and com-plexity. This study compares logistic regression, gradient boosting, neural network, and random forest models in predicting Emergency Severity Index (ESI) triage levels for non-traumatic pa-tients at Lampang Hospital's ED. Using data from January 1, 2023, to April 30, 2024, we ana-lyzed 45,245 complete records. The gradient boosting model achieved the highest accuracy (0.81), significantly outperforming logistic regression (accuracy 0.64). Pain scale, sex, and mean arterial pressure were key predictors. This is the first comparison of these models for ESI triage in a Thai hospital, highlighting their potential to improve triage accuracy and efficiency. Implementing these models could enhance patient outcomes and resource management in ED.

Property valuation services using artificial intelligence (AI) have been developed, with more than 20 services available in Japan. However, since their algorithms and training data are not publicly available, the extent of differences in the AI property valuations among these services is not clear. This study focuses on the five services handling a lot of properties and uses a sample of 4,295 property valuations for 859 condominium units in six popular residential areas in Tokyo. (1) Multiple comparison tests of the AI property valuations among each service are conducted to confirm their statistical significance and to examine the degree of the difference and variation. (2) The business models of each service are compared to examine the factors contributing to these differences and variations. The results showed that there was a variation of approximately 0.15 in the coefficient of variation between the high and low valuation groups, and the service providers in the high valuation group guided the users to their sales, while those in the low valuation group focused on attracting users as their business models. The contribution of this study is to indicate the possibility that the business models may lead to the differences in the AI property valuations.

A suitable waste management strategy is crucial for a sustainable and efficient circular economy in the construction sector, and requires precise data on the volume of demolition waste (DW) gen-erated. Therefore, we developed an optimal machine learning (ML) model to forecast the quantity of recycling and landfill waste based on the characteristics of DW. A dataset comprising infor-mation on the characteristics of 150 buildings, demolition equipment utilized, and volume of five waste types generated (i.e., recyclable mineral, recyclable combustible, landfill specified, and landfill mix waste, and recyclable minerals) was constructed. ML models were developed to predict the quantities of such waste. Artificial neural network, decision tree, gradient boosting machine, k-nearest neighbors, linear regression, random forest (RF), and support vector regression were applied, and optimal models were derived via hyperparameter tuning. The RF model demonstrated superior performance. In both validation and test phases, the “recyclable mineral waste” and “recyclable combustible waste” models achieved accuracies of of 0.987 and 0.972, re-spectively. The “recyclable metals” and “landfill specified waste” models achieved accuracies of 0.953 and 0.858 or higher, respectively. Moreover, the “landfill mix waste” model exhibited an accuracy of 0.984 or higher. SHapley Additive exPlanations analysis highlighted floor area as the primary input variable influencing model performance. The type of equipment employed in demolition emerged as another crucial input variable impacting the volume of recycling and landfill wastes generated. The developed model can provide precise data on waste management, thereby facilitating the decision-making process for industry professionals.

This research project aimed to address the growing concern about methane emissions from seaweed by developing a Convolutional Neural Network (CNN) model capable of accurately predicting these emissions. The study used PANDAS to read and analyze the dataset, incorporating statistical measures like mean, median, and standard deviation to understand the dataset. The CNN model was trained using the ReLU activation function and mean absolute error as the loss function. Model performance was evaluated through MAPE graphs, comparing the mean absolute percentage error (MAPE) between training and validation sets and between true and predicted emissions, and analyzing trends in yearly greenhouse gas emissions. The results demonstrated that the CNN model achieved a high level of accuracy in predicting methane emissions, with a low MAPE between the expected and actual values. This approach should enhance our understanding of methane emissions from Sargassum, contributing to more accurate environmental impact assessments and effective mitigation strategies.

Ultrasound (US) has become a widely used imaging modality in clinical practice, characterized by its rapidly evolving technology, advantages, and unique challenges such as low imaging quality and high variability. There is a critical need to develop advanced automatic US image analysis methods to enhance diagnostic accuracy and objectivity. Vision transformer, a recent innovation in machine learning, has demonstrated significant potential in various research fields, including general image analysis and computer vision, due to its capacity to process large datasets and learn complex patterns. Its suitability for automatic US image analysis tasks, such as classification, detection, and segmentation, has been recognized. This review provides an introduction to vision transformer and discusses its applications in specific US image analysis tasks, while also addressing the open challenges and potential future trends in its application in medical US image analysis. Vision transformer has shown promise in enhancing the accuracy and efficiency of ultrasound image analysis and is expected to play an increasingly important role in the diagnosis and treatment of medical conditions using ultrasound imaging as technology progresses.

This paper introduces a novel ensemble adjustment Kalman filter (EAKF) that integrates a machine-learning approach. The approach employs nonlinear variable relationships established by a deep neural network (DNN) during the analysis stage of the EAKF. This process nonlinearly projects observation increments into the state variable space. The newly developed DNN-EAKF algorithm can be applied to coupled data assimilation using coupled ocean-atmosphere models. It enhances cross-component updates in strongly coupled data assimilation (SCDA) by diminishing errors in estimating cross-component error covariance arising from insufficient ensemble members, thereby improving the SCDA analysis. This paper employs a conceptual model to conduct twin experiments, validating the DNN-EAKF’s capability to utilize cross-component observation information in SCDA effectively. The approach is anticipated to offer insights for future methodological integrations of machine learning and data assimilation and provide methods for SCDA applications in coupled general circulation models.

Chinese calligraphy, revered globally for its therapeutic and mindfulness benefits, encompasses styles such as Regular (Kai Shu), Running (Xing Shu), Official (Li Shu), and Cursive (Cao Shu) scripts. Beginners often start with Regular script, advancing to more intricate styles like Cursive. Each style, marked by unique historical calligraphers' contributions, requires learners to discern distinct nuances. The integration of AI in calligraphy analysis, collection, recognition, and classification are pivotal. This study introduces an innovative Convolutional Neural Network (CNN) architecture, pioneering the application of CNN in the classification of Chinese calligraphy. Focusing on the four principal calligraphers' styles from the Tang dynasty (690-907 A.D), this research spotlights the era when the traditional regular script font (Kai Shu) was refined. A comprehensive dataset of 8282 samples from these calligraphers, representing the zenith of regular style, was compiled for CNN training and testing. The model distinguishes personal styles for classification, showing superior performance over existing networks. Achieving 89.5-96.2% accuracy in calligraphy classification, our approach underscores the significance of CNN in both font and artistic style categorization. This research paves the way for advanced studies in Chinese calligraphy and its cultural implications.

Eutrophication is a major environmental issue with many negative consequences, such as hypoxia and harmful cyanotoxins production. Monitoring coastal eutrophication is a crucial, especially for island countries like the Republic of Cyprus, which are economically dependent on the touristic sector. Additionally, the open-sea aquaculture industry in Cyprus has been exhibiting an increase in the last decades and environmental monitoring to identify possible signs of eutrophication is mandatory according to the legislation. Therefore, in this modelling study, two different types of Artificial Neural Networks (ANNs) are developed based on in situ-data collected from stations located in the coastal waters of Cyprus. Theses ANNs aim to model the eutrophication phenomenon based on two different data-driven modelling procedures. Firstly, the self-organizing map (SOM) ANN examines several water quality parameters (specifically water temperature, salinity, nitrogen species, ortho-phosphates, dissolved oxygen and electrical conductivity) interactions with the Chlorophyll-a parameter. The SOM model enables us to visualize the monitored parameters relationships and to comprehend complex biological mechanisms related to Chlorophyll-a production. A second feed-forward ANN model is also developed for predicting the Chlorophyll-a levels. Based on this ANN model, several scenarios associated to the eutrophication-related water quality parameters can be extracted. The combination of these two ANNs models is considered a holistic modelling approximation for the identification of eutrophication scenarios, since it enables not only the prediction of the Chlorophyll-a parameter levels, but also the “capturing” of hidden biological mechanisms associated with algal production.

Waste heat recovery stands out as a promising technique to tackle both energy shortages and environmental pollution. Currently, this valuable resource, generated from processes like fuel combustion or chemical reactions, is often dissipated into the environment, despite its potential to significantly contribute to the economy. To harness this untapped potential, a travelling-wave thermo-acoustic generator has been designed and subjected to comprehensive experimental analysis. Fifty-two data corresponding to different working conditions of the system were extracted to build ANN, ANFIS and ANN-PSO models. Evaluation of performance metrics reveals that the ANN-PSO model demonstrates the highest predictive accuracy (R^2=0.9959), particularly in relation to output voltage. This research demonstrates the potential of machine learning techniques for the analysis of thermo-acoustic systems. By doing so, it is possible to get an insight into nonlinearities inherent to thermo-acoustic systems. This advancement empowers researchers to forecast the performance characteristics of alternative configurations with a heightened level of precision.

The semantic segmentation of high-resolution remote sensing images (HR-RSI) is crucial for a wide range of applications, such as precision agriculture, urban planning, natural resource assessment, and ecological monitoring. However, accurately classifying pixels in HR-RSI faces challenges due to densely distributed small objects and scale variations. Existing techniques, including Convolutional Neural Networks (CNNs) and other methods for hierarchical feature extraction and fusion of remote sensing image, often do not achieve the desired accuracy. In this paper, we propose a novel approach called the Hierarchical Rich-scale Fusion Network (HRFNet) to address these challenges. HRFNet utilizes advanced information rating and image partition techniques to extract rich-scale features within image layers. This allows for the adaptive exploration of both local and global contextual information. Moreover, we introduce a structured intra-layer to inter-layer feature aggregation module, which enables the adaptive extraction of fine-grained details and high-level semantic information from multi-layer feature maps in a highly flexible manner. Extensive experimentation has been conducted to validate the effectiveness of our proposed method. Our results demonstrate that HRFNet outperforms existing techniques, achieving state-of-the-art (SOTA) results on benchmark datasets, specifically the ISPRS Potsdam and Vaihingen datasets.

In order to solve the problems of complicated steering control of unmanned vehicles in the field and difficult steering on complex roads, we designed a wheel-track composite vehicle equipped with a novel power differential steering mechanism with dual driving, which drove the steering of the vehicle through the differential rotation of the rear two wheels. The unmanned vehicle was simple to control, small in size, and able to work under the conditions of complex roads, such as hills, mountains, and muddy land. Firstly, a steering mechanism with both differential speed and force was designed to prevent the vehicle from skidding into muddy land and stopping motionless. Secondly, the kinematics model and dynamics model of the two drive shafts and the two output shafts (wheel shafts) were established. Thirdly, according to the relationship between the rotational speed of the two output shafts and the steering radius of the vehicle, the kinematic model of the rotational speed of the two input shafts and the steering radius of the wheel-track composite vehicle was obtained. Finally, according to the test data, the mathematical model of rotational speeds of the two input shafts and the actual steering radius of the vehicle was obtained by neural network fitting, and the maximum relative error between the model results and the actual steering radius value was 3.53%. The combination of power differential steering mechanism and wheel-track composite unmanned vehicle increased the adhesion with the ground and could better adapt to the complex road environment. In conclusion, the unmanned vehicle had the advantages of continuous radius steering, deceleration and torsion increase, differential lock, etc. It was suitable for all-terrain military and civilian vehicles and various special equipment mobile platforms of the walking device, and the research results could provide theoretical references for the steering control and structural optimization of the wheel-track composite vehicle under the environment of complex road surface.

Arrhythmia is a cardiac condition characterized by an irregular heart rhythm that hinders the proper circulation of blood, posing a severe risk to individuals’ lives. Globally, arrhythmias are recognized as a significant health concern, accounting for nearly 12 percent of all deaths. As a result, there has been a growing focus on utilizing artificial intelligence for the detection and classification of abnormal heartbeats. In recent years, self-operated heartbeat detection research has gained popularity due to its cost-effectiveness and potential for expediting therapy for individuals at risk of arrhythmias. However, building an efficient automatic heartbeat monitoring approach for arrhythmia identification and classification comes with several significant challenges. These challenges include addressing issues related to data quality, determining the range for heart rate segmentation, managing data imbalance difficulties, handling intra- and inter-patient variations, distinguishing supraventricular irregular heartbeats from regular heartbeats, and ensuring model interpretability. In this study, we propose the Reseek-Arrhythmia model, which leverages deep learning techniques to automatically detect and classify heart arrhythmia diseases. The model combines different convolutional blocks and identity blocks, along with essential components such as convolution layers, batch normalization layers, and activation layers. To train and evaluate the model, we utilized the MIT-BIH and PTB datasets. Remarkably, the proposed model achieves outstanding performance with an accuracy of 99.35% and 93.50% and an acceptable loss of 0.688 and 0.2564, respectively.

Efficient management of basal cell carcinoma (BCC) requires reliable assessments of both tumors and post-treatment scars. We aimed to estimate image similarity metrics that account for BCC's perceptual color and texture deviation from perilesional skin. 176 clinical photographs of BCC were assessed by six physicians using a visual deviation scale. Internal consistency and inter-rater agreement were estimated using Cronbach's α, weighted Gwet's AC2, and quadratic Cohen's Kappa. The mean visual scores were used to validate a range of similarity metrics employing different color spaces, distances, and image embeddings from pre-trained VGG16 neural network. The calculated similarities were transformed into discrete values using ordinal logistic regression models. The Bray-Curtis distance in the YIQ color model and rectified embeddings from the 'fc6' layer minimized the mean squared error and demonstrated strong performance in representing perceptual similarities. Box plot analysis and Wilcoxon rank-sum test were used to visualize and compare the levels of agreement, conducted on a random validation round between the two groups: ‘Human-System’ and ‘Human-Human’. The proposed metrics were comparable in terms of internal consistency and agreement with human raters. The findings suggest that the proposed metrics offer a robust, and cost-effective approach to monitoring BCC treatment outcomes in clinical settings.

A block-diagonal fuzzy neural network for short-term load forecasting is proposed. DBD-FELF consists of fuzzy rules with consequent parts that are neural networks with internal recurrence. These networks have a hidden layer which consists of pairs of neurons with feedback connections between them. The overall fuzzy model partitions the input space in partially overlapping fuzzy regions, where the recurrent neural networks of the respective rules operate. The partition of the input space and determination of the fuzzy rule base is performed by use of Fuzzy C-Means clustering algorithm and the RENNCOM constrained optimization method is applied for consequent parameter tuning. The electric load time-series of the Greek power system is examined, and hourly-based forecasting for the whole year is performed. The performance of DBD-FELF is tested via extensive experimental analysis and the results are promising, since an average percentage error of 1.18% is attained, along with an average yearly absolute error of 76.2 MW. Moreover, DBD-FELF is compared with Deep Learning, fuzzy and neurofuzzy rivals, such that its particular attributes are highlighted.

The deep energy method (DEM), a type of physics-informed neural network, is evolving as an alternative to finite element analysis. This method employs the principle of minimum potential energy to predict deformations under static loading conditions. However, the model’s accuracy is contingent upon choosing the appropriate architecture for the model, which can be challenging due to the high interactions between hyperparameters, large search space, difficulty in identifying objective functions, and non-convex relationships with the objective functions. To improve DEM’s accuracy, we first introduce random Fourier feature (RFF) mapping. RFF mapping helps with the training of the model by reducing bias towards high frequencies. The effects of six hyperparameters are then studied under compression, tension, and bending loads in planar linear elasticity. Based on this study, a systematic automated hyperparameter optimization approach is proposed. Due to the high interaction between hyperparameters and the non-convex nature of the optimization problem, Bayesian optimization algorithms are used. The models trained using optimized hyperparameters and having Fourier feature mapping can accurately predict deflections compared to finite element analysis. Additionally, the deflections obtained for tension and compression load cases are more sensitive to variations in hyperparameters than bending.

Nowadays, there is extensive production and use of plastic materials for different industrial activities. These plastics, either from their primary production sources or through degradation processes of the plastics themselves, can contaminate the ecosystem with micro and nanoplastics. Once in the aquatic environment, these microplastics can be the basis for the adsorption of chemical pollutants, favoring that these chemical pollutants disperse more quickly in the environment and can affect living beings. Due to the lack of information on adsorption, three machine learning models (random forest, support vector machine, and artificial neural network) to predict different microplastic/water partition coefficients (log Kd) were developed using two different approximations (based on the number of input variables). The best-selected machine learning models present, in general, correlation coefficients upper than 0.92 in the query phase, which indicate that these type of models could be used for a rapid estimation of the absorption of organic contaminants on microplastics.

Ion channels are integral membrane proteins that facilitate the movement of ions across cell membranes, playing a key role in a range of biological processes. The high cost and time required for wet lab experiments to characterize ion channels has spurred the development of computational methods for this purpose. In our previous work, we demonstrated the effectiveness of protein language models for ion channel prediction, using a logistic regression classifier to distinguish ion channels from non-ion channels (TooT-BERT-C) and transporters from non-transporters (TooT-BERT-T). In this study, we build upon this approach by using a combination of classical machine learning classifiers and a Convolutional Neural Network (CNN) with fine-tuned representations from ProtBERT, ProtBERT-BFD, and MembraneBERT to discriminate ion channels from non-ion channels. The results of our experiments demonstrate that TooT-BERT-CNN-C, a combination of the representations from ProtBERT-BFD and a CNN, outperforms existing state-of-the-art methods for predicting ion channels, with a Matthews Correlation Coefficient (MCC) of 0.86 and an accuracy of 98.35% on an independent test set.

The passenger prediction flow is very significant to transportation sustainability. This is due to some chaos of traffic jams encountered by the road users during their movement to the offices, schools, or markets at earlier of the days and during closing periods. This problem is peculiar to the transportation system of the Federal University of Technology Minna, Nigeria. However, the prevailing technique of passenger flow estimation is non-parametric which depends on the fixed planning and is easily affected by noise. In this research, we proposed the development of a hybrid intelligent passenger frequency prediction model using the Auto-Regressive Integrated Moving Average (ARIMA) linear model, Convolutional Neural Network (CNN), and Kalman Filter Algorithm (KFA). The passengers’ frequency of arrival at the bus terminals is obtained and enumerated through the closed-circuit television (CCTV) and demonstrated using the Markovian Queueing Systems Model (MQSM). The ARIMA model was used for learning and prediction and compared the result with the combined techniques of using CNN-KFA. The autocorrelation coefficient functions (ACF) and partial autocorrelation coefficient functions (PACF) are used to examine the stationary data with different features. The performance of the models was analyzed and evaluated in describing the short-term passenger flow frequency at each terminal using the Mean Absolute Percentage Error (MAPE) and Mean Squared Error (MSE) values. The CNN-Kalman-filter model was fitted into the short-term series and the MAPE values are below 10%. The Mean Square Error (MSE) shows that the CNN-Kalman Filter model has the overall best performance with 83.33% of the time better than the ARIMA model and provides high accuracy in forecasting.

Functional connectivity (FC) is a potential candidate that can increase the performance of brain-computer interfaces (BCIs) in the elderly because of its compensatory role in neural circuits. However, it is difficult to decode FC by current machine learning techniques because of a lack of its physiological understanding. To investigate the suitability of FC in BCI for the elderly, we propose the decoding of lower- and higher-order FCs using a convolutional neural network (CNN) in six cognitive-motor tasks. The layer-wise relevance propagation (LRP) method describes how age-related changes in FCs impact BCI applications for the elderly compared to younger adults. Seventeen younger (24.5±2.7 years) and twelve older (72.5±3.2 years) adults were recruited to perform tasks related to hand-force control with or without mental calculation. CNN yielded a six-class classification accuracy of 75.3% in the elderly, exceeding the 70.7% accuracy for the younger adults. In the elderly, the proposed method increases the classification accuracy by 88.3% compared to the filter-bank common spatial pattern (FBCSP). LRP results revealed that both lower- and higher-order FCs were dominantly overactivated in the prefrontal lobe depending on task type. These findings suggest a promising application of multi-order FC with deep learning on BCI systems for the elderly.

Accurate forecasts of ocean waves energy can not only reduce costs for investment but it is also essential for management and operation of electrical power. This paper presents an innovative approach based on the Long Short Term Memory (LSTM) to predict the power generation of an economical wave energy converter named “Searaser”. The data for analyzing is provided by collecting the experimental data from another study and the exerted data from numerical simulation of searaser. The simulation is done with Flow-3D software which has high capability in analyzing the fluid solid interactions. The lack of relation between wind speed and output power in previous studies needs to be investigated in this field. Therefore, in this study the wind speed and output power are related with a LSTM method. Moreover, it can be inferred that the LSTM Network is able to predict power in terms of height more accurately and faster than the numerical solution in a field of predicting. The network output figures show a great agreement and the root mean square is 0.49 in the mean value related to the accuracy of LSTM method. Furthermore, the mathematical relation between the generated power and wave height was introduced by curve fitting of the power function to the result of LSTM method.

Abstract: Polylactic acid (PLA) is brittle in nature with extensive deformation property. For improvement of the end-use quality, it is of significant importance to enhance the producibility of fused deposition modeling (FDM)-printed objects in PLA. The purpose of this investigation is to boost toughness and to reduce the production cost of the FDM-printed tensile test samples with the desired part thickness. To attain the research purpose number of experiments are designed and analyzed by the Response Surface Method (RSM). The statistical analysis is performed to deal with this concern considering layer thickness, infill percentage, and extruder temperature as controlled factors. The tensile test specimens are printed based on the designed experiments, and the tensile strength tests are conducted by SANTAM 150 universal testing machine based on ASTM D638. The honeycomb internal fill pattern is applied for the production of light-weight and high-strength specimens. The area under Force- Extension curve up to fracture is acquired as the toughness of the printed specimens. This study also developed a modeling process using ANN and ANN-GA techniques for developing an accurate estimation for toughness, part thickness, and production cost as dependant variables. Results were evaluated by correlation coefficient and RMSE values. According to the modeling results, ANN-GA as a hybrid ML technique could successfully improve the accuracy of modeling about 7.5, 11.5 and 4.5 % for toughness, part thickness, and production cost, respectively, in comparison with those for the single ANN method. In the other side, the optimization results confirm that the optimized specimen is cost-effective and able to comparatively undergo deformation, which develops the usability of printed PLA objects. The research is accomplished under the constraints of PLA compatibility with existing fused deposition modeling setup without changing the functional hardware/software of the machine. Although the mechanical properties and dimensional accuracy of PLA have already been studied, there is little literature on the toughness of the printed PLA with honeycomb internal fill pattern.

Indian cities are increasingly becoming susceptible to PM10 induced health effects which have become a matter of concern for the policymakers of the country. Air pollution is engulfing the comparatively smaller cities as the rapid pace of urbanization, and economic development seems not to lose steam ever. A review of air pollution of 28 cities of India, which includes tier-I, II, and III cities of India, found to have grossly violated both WHO and NAAQS standards in respect of acceptable daily average PM10 concentrations by a wide margin. Predicting the city level PM10 concentrations in advance and accordingly initiate prior actions is an acceptable solution to save the city dwellers from PM10 induced health hazards. Predictive ability of three models, linear MLR, nonlinear MLP (ANN), and nonlinear CART, for one day ahead PM10 concentration forecasting of tier-II Guwahati city, were tested with 2016-2018 daily average observed climate data, PM10, and gaseous pollutants. The results show that the non-linear algorithm MLP with feedforward backpropagation network topologies of ANN class, giving the best prediction value when compared with linear MLR and nonlinear CART model. ANN (MLP) approach, therefore, may be useful to effectively derive a predictive understanding of one day ahead PM10 concentration level and thus provide a tool to the policymakers for improving decision-making associated with air pollution and public health.