Predicting Length of Stay (LoS) and understanding its underlying factors is essential to minimize the risk of hospital-acquired conditions, improve financial, operational, and clinical outcomes, and to better manage future pandemics. The purpose of this study is to forecast patients’ LoS using a deep learning model and analyze cohorts of risk factors minimizing or maximizing LoS. We employed various pre-processing techniques, SMOTE-N to balance data, and Tab-Transformer model to forecast LoS. Finally, Apriori algorithm was applied to analyze cohorts of risk factors influencing LoS at hospital. The Tab-Transformer outperformed the base Machine Learning models with an F1-score (.92), precision (.83), recall (.93), and accuracy (.73) for discharge dataset, and F1-score (.84), precision (.75), recall (.98), and accuracy (.77) for deceased dataset. The association mining algorithm was able to identify significant risk factors/indicators belonging to lab, X-Ray, and clinical data such as elevated LDH, and D-Dimer, lymphocytes count, and comorbidities such as hypertension and diabetes responsible for extending patients LoS. It also reveals what treatments has reduced the symptoms of COVID-19 patients leading to reduction in LoS particularly when no vaccines or medication such as Paxlovid were available.

Ultrasound (US) is commonly used for the diagnosis of liver masses. Ensemble learning has been widely used for image classification, but its methods have not been fully optimized. This study was performed to investigate the usefulness of ensemble learning and compare a number of ensemble learning techniques using multiple convolutional neural network (CNN)-trained models for image classification of liver masses in US images. The US imaging data set was classified into four categories: benign liver tumor (BLT, 6320 images), liver cyst (LCY, 2320 images), metastatic liver cancer (MLC, 9720 images), and primary liver cancer (PLC, 7840 images). In this study, 250 test images were randomly selected for each class, for a total of 1000 images, and the remaining images were used for training. Sixteen different CNNs were used for to train and test the US images. All four types of ensemble learning—soft voting (SV), stacking (ST), weighted average voting (WAV), and weighted hard voting (WHV)—showed greater accuracy than the single CNN. All four types also showed significantly better deep learning performance than ResNeXt101 alone. For image classification of liver masses using US images, ensemble learning improved the performance of deep learning over a single CNN.

Prediction of protein-ligand binding affinities is crucial for computational drug discovery. A number of deep learning approaches have been developed in recent years to improve the accuracy of such affinity prediction. While the predicting power of these systems have advanced to some degrees depending on the dataset used for model training and testing, the effects of the quality and quantity of the underlying data have not been thoroughly examined. In this study, we employed erroneous datasets and data subsets of different sizes, created from one of the largest databases of experimental binding affinities, to train and evaluate a deep learning system based on convolutional neural networks. Our results show that data quality and quantity do have significant impacts on the prediction performance of trained models. Depending on the variations in data quality and quantity, the performance discrepancies could be comparable to or even larger than those observed among different deep learning approaches. In particular, the presence of proteins during model training leads to a dramatic increase in prediction accuracy. This implies that continued accumulation of high-quality affinity data, especially for new protein targets, is indispensable for improving deep learning models to better predict protein-ligand binding affinities.

Skin disease is a very common disease for humans. In the medical industry detecting skin disease and recognizing its type is a very challenging task. Due to the complexity of human skin texture and the visual closeness effect of the diseases, sometimes it is really difficult to detect the exact type. Therefore, it is necessary to detect and recognize the skin disease at its very first observation. In today's era, artificial intelligence (AI) is rapidly growing in medical fields. Different machine learning (ML) and deep learning(DL) algorithms are used for diagnostic purposes. These methods drastically improve the diagnosis process and also speed up the process. In this paper, a brief comparison between the machine learning process and the deep learning process was discussed. In both processes, three different and popular algorithms are used. For the machine Learning process Bagged Tree Ensemble, K-Nearest Neighbor (KNN), and Support Vector Machine(SVM) algorithms were used. For the deep learning process three pre-trained deep neural network models

Physical inactivity increases the risk of many adverse health conditions, including the world’s major non-communicable diseases, such as coronary heart disease, type 2 diabetes, and breast and colon cancers, shortening life expectancy. There are minimal medical care and personal trainers’ methods to monitor a patient’s actual physical activity types. To improve activity monitoring, we propose an artificial-intelligence-based approach to classify the physical movement activity patterns. In more detail, we employ two deep learning (DL) methods, namely a deep feed-forward neural network (DNN) and a deep recurrent neural network (RNN) for this purpose. We evaluate the proposed models on two physical movement datasets collected from several volunteers who carried tri-axial accelerometer sensors. The first dataset is from the UCI machine learning repository, which contains 14 different activities-of-daily-life (ADL) and is collected from 16 volunteers who carried a single wrist-worn tri-axial accelerometer. The second dataset includes ten other ADLs and is gathered from 8 volunteers who placed the sensors on their hips. Our experiment results show that the RNN model provides the accuracy performance compared to the state-of-the-art methods in classifying the fundamental movement patterns with an overall accuracy of 84.89% and an overall F1-score of 82.56%. Our results indicate that the proposed method will provide the medical doctors and trainers a promising way to precisely track and understand a patient’s physical activities for better treatment.

This paper provides the state of the art of data science in economics. Through a novel taxonomy of applications and methods advances in data science are investigated. The data science advances are investigated in three individual classes of deep learning models, ensemble models, and hybrid models. Application domains include stock market, marketing, E-commerce, corporate banking, and cryptocurrency. Prisma method, a systematic literature review methodology is used to ensure the quality of the survey. The findings revealed that the trends are on advancement of hybrid models as more than 51% of the reviewed articles applied hybrid model. On the other hand, it is found that based on the RMSE accuracy metric, hybrid models had higher prediction accuracy than other algorithms. While it is expected the trends go toward the advancements of deep learning models.

Electromyographic (EMG) signals provide information about a person's muscle activity. For hand movements, in particular, the execution of each gesture involves the activation of different combinations of the forearm muscles, which generate distinct electrical patterns. Conversely, the analysis of these muscle activation patterns, represented by EMG signals, allows recognizing which gesture is being performed. In this study, we aimed to implement an automatic identification system of hand or wrist gestures based on supervised Machine Learning (ML) techniques. We trained different computational models and determined which of these showed the best capacity to identify six hand or wrist gestures and generalize between different subjects. We used an open access database containing recordings of EMG signals from 36 subjects. Among the results obtained, we highlight the performance of the Random Forest model, with an accuracy of 95.39%, and the performance of a convolutional neural network with an accuracy of 94.77%.

Several researchers have contemplated deep learning-based post-filters to increase the quality of statistical parametric speech synthesis, which perform a mapping of the synthetic speech to the natural speech, considering the different parameters separately and trying to reduce the gap between them. The Long Short-term Memory (LSTM) Neural Networks have been applied successfully in this purpose, but there are still many aspects to improve in the results and in the process itself. In this paper, we introduce a new pre-training approach for the LSTM, with the objective of enhancing the quality of the synthesized speech, particularly in the spectrum, in a more efficient manner. Our approach begins with an auto-associative training of one LSTM network, which is used as an initialization for the post-filters. We show the advantages of this initialization for the enhancing of the Mel-Frequency Cepstral parameters of synthetic speech. Results show that the initialization succeeds in achieving better results in enhancing the statistical parametric speech spectrum in most cases when compared to the common random initialization approach of the networks.

In the wake of increasing digital fraud, this paper introduces an innovative application of Artificial Intelligence (AI) in detecting fraudulent activities across finance, healthcare, and e-commerce sectors. It presents a detailed analysis of machine learning methodologies, specifically focusing on the advantages of supervised, unsupervised, and deep learning techniques. The paper addresses the challenges such as data imbalance, model interpretability, and ethical implications in AI-based fraud detection. It also discusses the necessity of high-quality datasets and advocates for the integration of traditional and advanced machine learning methods to enhance accuracy and adaptability in fraud identification. However, it acknowledges the limitations including computational demands and overfitting risks. The study underscores the importance of collaborative efforts between AI experts and industry professionals to develop ethical, efficient, and reliable AI solutions for fraud detection.

Plasma technology shows tremendous potential for revolutionizing oncology research and treatment. Reactive oxygen and nitrogen species, electromagnetic emissions generated through gas plasma jets, have attracted significant attention due to their selective cytotoxicity towards cancer cells. To leverage the full potential of plasma medicine, researchers have explored the use of mathematical models and various subsets of machine learning, such as reinforcement learning, and deep learning. This review emphasizes the significant application of AI algorithms in the adaptive plasma system, paving the way for precision and dynamic cancer treatment. Realizing the full potential of AI in plasma medicine, requires research efforts, data sharing and interdisciplinary collaborations. Unravelling the complex mechanisms, developing real-time diagnostics, and optimizing AI models will be crucial to harness the true power of plasma technology in oncology. The integration of personalized and dynamic plasma therapies, alongside AI and diagnostic sensors, presents a transformative approach to cancer treatment with the potential to improve outcomes globally.

One of the most important challenges in the Machine and Deep Learning areas today is to build good models using small datasets, because sometimes it is not possible to have large ones. Several techniques have been proposed in the literature to address this challenge. This paper aims at studying the different available Deep Learning techniques and performing a thorough experimentation to analyze which technique or combination thereof improves the performance and effectiveness of the models. A complete comparison with classical Machine Learning techniques was carried out, to contrast the results obtained using both techniques when working with small datasets. Thirteen algorithms were implemented and trained using three different small datasets (MNIST, Fashion MNIST, and CIFAR-10). Each experiment was evaluated using a well-established set of metrics (Accuracy, Precision, Recall, F1, and the Matthews correlation coefficient). The experimentation allowed concluding that it is possible to find a technique or combination of them to mitigate a lack of data, but this depends on the nature of the dataset, the amount of data, and the metrics used to evaluate them.

Intertidal seagrass plays a vital role in estimating the overall health and dynamics of coastal environments due to its interaction with tidal changes. However, most seagrass habitats around the globe have been in steady decline due to human impacts, disturbing the already delicate balance in environmental conditions that sustain seagrass. Miniaturization of multi-spectral sensors has facilitated very high resolution mapping of seagrass meadows, which significantly improve the potential for ecologists to monitor changes. In this study, two analytical approaches used for classifying intertidal seagrass habitats are compared: Object-based Image Analysis (OBIA) and Fully Convolutional Neural Networks (FCNNs). Both methods produce pixel-wise classifications in order to create segmented maps, however FCNNs are an emerging set of algorithms within Deep Learning with sparse application towards seagrass mapping. Conversely, OBIA has been a prominent solution within this field, with many studies leveraging in-situ data and multiscale segmentation to create habitat maps. This work demonstrates the utility of FCNNs in a semi-supervised setting to map seagrass and other coastal features from an optical drone survey conducted at Budle Bay, Northumberland, England. Semi-supervision is also an emerging field within Deep Learning that has practical benefits of achieving state of the art results using only subsets of labelled data. This is especially beneficial for remote sensing applications where in-situ data is an expensive commodity. For our results, we show that FCNNs have comparable performance with standard OBIA method used by ecologists, while also noting an increase in performance for mapping ecological features that are sparsely labelled across the study site.

In this article, we analyse the computer aid screening method of COVID19 using Xray and CT scan images. The main objective is to set an analytical closure about the computer aid screening of COVID19 among the X-ray image and CT scan image. The computer aid screening method includes deep feature extraction, transfer learning and traditional machine learning image classification approach. The deep feature extraction and transfer learning method considered 13 pre-trained CNN model. The machine learning approach includes three sets of features and three classifiers. The pre-trained CNN models are alexnet, googlenet, vgg16, vgg19, densenet201, resnet18, resnet50, resnet101, inceptionv3, inceptionresnetv2, xception, mobilenetv2 and shufflenet. The features and classifiers in machine learning approaches are GLCM, LBP, HOG and KNN, SVM, Naive bay’s respectively. In addition, we also analyse the different paradigms of classifiers. In total, the comparative analysis is carried out in 65 classification models, i.e. 13 in deep feature extraction, 13 in transfer learning and 39 in machine learning approaches. Finally, all the classification models perform better in X-ray image set compare to CT scan image set.

In the present paper, an aerodynamic investigation of a high-speed train is performed. In the first section of this article, a generic high-speed train against a turbulent flow is simulated, numerically. The Reynolds-Averaged Navier-Stokes (RANS) equations combined with the SST turbulence model are applied to solve incompressible turbulent flow around a high-speed train. Flow structure, velocity and pressure contours and streamlines at some typical wind directions are the most important results of this simulation. The maximum and minimum values are specified and discussed. Also, the pressure coefficient for some critical points on the train surface is evaluated. In the following, the wind direction influence the aerodynamic key parameters as drag, lift, and side forces at the mentioned wind directions are analyzed and compared. Moreover, the effects of velocity changes (50, 60, 70, 80 and 90 m/s) are estimated and compared on the above flow and aerodynamic parameters. In the second section of the paper, various data-driven methods including Gene Expression Programming (GEP), Gaussian Process Regression (GPR), and random forest (RF), are applied for predicting output parameters. So, drag, lift and side forces and also minimum and a maximum of pressure coefficients for mentioned wind directions and velocity are predicted and compared using statistical parameters. Obtained results indicated that RF in all coefficients of wind direction and most coefficients of free stream velocity provided the most accurate predictions. As a conclusion, RF may be recommended for the prediction of aerodynamic coefficients.

(1) Background: Evidence-based policymaking requires data about the local population's socioeconomic status (SES) at detailed geographical level, however, such information is often not available, or is too expensive to acquire. Researchers have proposed solutions to estimate SES indicators by analyzing Google Street View images, however, these methods are also resource-intensive, since they require large volumes of manually labeled training data. (2) Methods: We propose a methodology for automatically computing surrogate variables of SES indicators using street images of parked cars and deep multiple instance learning. Our approach does not require any manually created labels, apart from data already available by statistical authorities, while the entire pipeline for image acquisition, parked car detection, car classification, and surrogate variable computation is fully automated. The proposed surrogate variables are then used in linear regression models to estimate the target SES indicators. (3) Results: We implement and evaluate a model based on the proposed surrogate variable at 30 municipalities of varying SES in Greece. Our model has $R^2=0.76$ and a correlation coefficient of $0.874$ with the true unemployment rate, while it achieves a mean absolute percentage error of $0.089$ and mean absolute error of $1.87$ on a held-out test set. Similar results are also obtained for other socioeconomic indicators, related to education level and occupational prestige. (4) Conclusions: The proposed methodology can be used to estimate SES indicators at the local level automatically, using images of parked cars detected via Google Street View, without the need for any manual labeling effort.

In order for robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities in order to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged on top of an object to securely grab it between the robotic gripper and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the application of deep learning methods in task generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. A number of the most promising approaches are evaluated and the most successful for grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is identified as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

Speech Emotion Recognition (SER) is an interesting and difficult problem to handle. In this paper, we deal with it through the implementation of deep learning networks. We have designed and implemented six different deep learning networks, a Deep Belief Network (DBN), a simple deep neural network (SDNN), a LSTM network (LSTM), a LSTM network with the addition of an attention mechanism (LSTM-ATN), a Convolutional neural network (CNN), and a Convolutional neural network with the addition of an attention mechanism (CNN-ATN), having in mind, apart from solving the SER problem, to test the impact of attention mechanism to the results. Dropout and Batch Normalization techniques are also used to improve the generalization ability (prevention of overfitting) of the models as well as to speed up the training process. The Surrey Audio-Visual Expressed Emotion database (SAVEE), and the Ryerson Audio-Visual Database (RAVDESS) database were used for training and evaluation of our models. The results showed that networks with the addition of the attention mechanism did better than the others. Furthermore, they showed that CNN-ATN was the best among tested networks, achieving an accuracy of 74% for the SAVEE and 77% for the RAVDESS dataset, and exceeded existing state-of-the-art systems for the same datasets.

The emergence of few-shot learning as a potential approach to address the problem of data scarcity by learning underlying pattern from a few training sample had so far given a mix-result especially on the suitability of model-agnostic meta learning, transfer learning, and optimization strategy to rapidly learn valid information from few sample. In this research, we did an in-depth evaluation of meta- learning to determine their plausibility and suitability for previously unknown cyberattack detection by first retrieving the original research artifacts of current state of the art meta learning to repeat the experiment with original dataset before replicating the experiment with two different malware dataset which had not been previously done with meta-transfer learning. On each of the experiments, meta-transfer learning gave good results on digital character recognition dataset but abysmal result on Malimg and Malevis malware images datasets thereby indicating its unreliability for detecting cyberattacks and the need for an improvement to the state-of-the-art meta transfer learning towards a better attack detection. Transfer learning performance is independent on imbalance and hence does not influence its performance since both malware dataset used for this experiment result in high validation loss and balancing the dataset doesn't result in reduced validation loss,the successful learning transfer seen on digital character recognition dataset is not unconnected to the fact that several languages have similar characters and digits thereby enhancing the successful learning transfer unlike malware datasets, and more importantly the finding that current meta-learning transfer approach doesn't generalize well on malware dataset and hence not suitable for detecting previously unseen out-of-distribution attack.

Despite the importance of few-shot learning, the lack of labeled training data in the real world, makes it extremely challenging for existing machine learning methods as this limited data set does not represent the data variance well. In this research, we suggest employing a generative approach using variational autoencoders (VAEs), which can be used specifically to optimize few-shot learning tasks by generating new samples with more intra-class variations. The purpose of our research is to increase the size of the training data set using various methods to improve the accuracy and robustness of the few-shot face recognition. Specifically, we employ the VAE generator to increase the size of the training data set, including the basic and the novel sets while utilizing transfer learning as the backend. Based on extensive experimental research, we analyze various data augmentation methods to observe how each method affects the accuracy of face recognition. We conclude that the face generation method we proposed can effectively improve the recognition accuracy rate to 96.47% using both the base and the novel sets.

In the recent years, with the advent of Artificial Intelligence (AI) traditional methods have seen a significant transformation in the agriculture sector, especially in soil management. Soil management involves practices that maintains and improves the physical, chemical as well as the biological properties of the soil. Soil health management is essential for both the environmental conservation and sustainable agriculture production, ensuring the soil productivity and functional aspects associated with the ecosystem. Soil health management is one of the most important aspects of agriculture and food production, hence preserving and enhancing the soil health is an essential factor for supporting agriculture. Integration of Artificial Intelligence (AI) technologies with soil health management offers the potential to enhance agricultural sustainability, productivity, adapt to the climatic changes and resource constraints. The study of AI tools that can help improve soil health management by providing more accurate and efficient monitoring, analysis and decision-making capabilities. This paper studies the potential AI technologies including machine learning, robotics, and remote sensing in enhancing soil health, raising crop yields, and lowering environmental concerns by examining previous research and case studies.

The present paper explored the possibility of discriminating between different malignant degrees of Chondrosarcoma (CS), a diffused bone tumor, and Enchondroma (EC), its benign version, through an approach based on the coupling between Confocal Raman Microscopy (CRM) and Machine Learning (ML) techniques. Recently, Raman Spectroscopy has proven to be a powerful tool for a complete grading of CS by distinguishing between grade 1, 2 and 3, and to distinguish CS from EC. In this paper, we tested some models, belonging either to ML or to the sub-type called Deep Learning (DL), showing excellent classification performances, especially the DL algorithms, with classification accuracy approaching to 100%, making the models promising for future implementations of Raman spectroscopy when applied to oncology diagnosis. In turn, we highlighted how some proper ML models result in worse classification performances but better resolution of specific chemical target compounds, possible candidate to become malignant markers, with relevant implication for a correct diagnosis.

The proliferation of fake news on social media platforms poses significant challenges to information authenticity and public trust. In this study, the impact of various word embedding techniques on the performance of both machine learning and deep learning models for fake news detection is systematically evaluated. The comprehensive TruthSeeker dataset, which spans over a decade of labeled news articles and social media posts, is utilized. Three popular word embedding techniques are analyzed: TF-IDF, Word2Vec, and FastText. These embeddings were tested with multiple machine learning classifiers, including logistic regression, naive Bayes, K-nearest neighbors, support vector machines, multilayer perceptrons, decision trees, and random forests, as well as deep learning models, specifically convolutional neural networks (CNNs). Among machine learning models, the Support Vector Machine (SVM) with TF-IDF achieved the highest accuracy of 99.03%, precision of 98.92%, recall of 99.15%, and F1 score of 99.03%. The Multilayer Perceptron (MLP) also demonstrated strong performance with Word2Vec, reaching an accuracy of 95.24%, precision of 94.95%, recall of 95.50%, and F1 score of 95.07%. For deep learning models, CNNs combined with TF-IDF embeddings showed outstanding results, achieving an accuracy of 98.99%, precision of 98.56%, recall of 99.48%, and F1 score of 99.02%. These results highlight the critical role of word embeddings in enhancing model accuracy and reliability in misinformation detection.

In recent years, cryptocurrencies have received substantial attention from investors, researchers and the media due to their volatile behaviour and potential for high returns. This interest has led to an expanding body of research aimed at predicting cryptocurrency prices, which are notably influenced by a wide array of technical, sentimental, and legal factors. This paper reviews scholarly content from 2014 to 2024, employing a systematic approach to explore advanced quantitative methods for cryptocurrency price prediction. It encompasses a broad spectrum of predictive models, from early statistical analyses to sophisticated machine and deep learning algorithms. Notably, this review identifies and discusses the integration of emerging technologies such as Transformers and hybrid deep learning models, which offer new avenues for enhancing prediction accuracy and practical applicability in real-world scenarios. By thoroughly investigating various methodologies and parameters influencing cryptocurrency price predictions, including market sentiment, technical indicators, and blockchain features, this review highlights the field’s complexity and rapid evolution. The analysis identifies significant research gaps and under-explored areas, providing a foundational guideline for future studies. These guidelines aim to connect theoretical advancements with practical, profit-driven applications in cryptocurrency trading, ensuring that future research is both innovative and applicable.

This literature review delves into the realm of fault detection techniques for transmission lines, aiming to provide a comprehensive overview of recent advancements and key trends in the field. Employing a structured approach, the review synthesizes a plethora of research spanning from 2019 to 2024, sourced from diverse databases including IEEE Xplore, ScienceDirect, ResearchGate, Scopus, Litmaps, and Google Scholar. The methodology encompasses a systematic literature search protocol, stringent inclusion and exclusion criteria, meticulous data extraction, and a multi-dimensional analysis framework. The literature review uncovers a spectrum of fault detection methodologies, ranging from traditional signal processing techniques like Discrete Wavelet Transform and phase angle-based methods to cutting-edge deep learning algorithms such as Capsule Networks and Convolutional Neural Networks. Insights gleaned from the review underscore the critical importance of fault detection in maintaining the reliability, safety, and efficiency of power grids, highlighting its role as a frontline defense against widespread outages and equipment damage. Key findings from the review shed light on the efficacy of different fault detection approaches, showcasing their strengths and limitations across diverse system conditions. Furthermore, the review identifies common trends and challenges, including the need for real-world validation, scalability, adaptability to various network configurations, and cybersecurity considerations. This literature provides valuable insights and recommendations for future research endeavors in fault detection for transmission lines. By embracing advancements in both traditional and emerging techniques, researchers can continue to enhance the resilience and dependability of power transmission systems, ensuring their ability to withstand evolving challenges and safeguard critical infrastructure.

Breast cancer stands as a predominant health concern for women globally. As mammography is the primary screening tool for breast cancer detection, improving the detection of breast cancer at screening could save more lives. This mammography re-view paper provides a systematic review of computer-aided techniques during a specific time frame for the segmentation and classification of microcalcification, evaluating image processing, machine learning, and deep learning techniques. The systematic review is meticulously carried out, adhering closely to the preferred reporting items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This article focuses on mammographic breast cancer detection approaches based on automated systems, discussed chronologically from 1970 through 2023. This article encompasses the breadth of artificial intelligence-based methods from the most primitive to the most sophisticated models. Image processing and machine learning-based methods are compre-hensively reviewed. The evaluation of a deep learning architecture based on self-extracted features for classification tasks demonstrated outclass performance. Large-scale datasets required for a broader and in-depth analysis of novel methods for breast cancer detection are also discussed in this article. This research work is aligned with the United Nations' sustainability de-velopment goals.

Recommendation systems are crucial in navigating the vast digital market. However, user data’s dynamic and non-stationary nature often hinders their efficacy. Traditional models struggle to adapt to the evolving preferences and behaviours inherent in user interaction data, posing a significant challenge for accurate prediction and personalisation. Addressing this, we propose a novel theoretical framework, the Non-stationary Transformer, designed to capture and leverage the temporal dynamics within data effectively. This approach enhances the traditional transformer architecture by introducing mechanisms accounting for non-stationary elements, offering a robust and adaptable solution for recommendation systems. Our experimental analysis, encompassing deep learning and reinforcement learning paradigms, demonstrates the framework’s superiority over benchmark models. The empirical results confirm the efficacy of our proposed framework, which not only provides significant performance enhancements, approximately 8% in Logloss reduction and up to 2% increase in F1 score but also underscores its potential applicability across accumulative reward scenarios. These findings advocate adopting Non-stationary Transformer models to tackle the complexities of today’s recommendation tasks.

Facial acne is a prevalent dermatological condition regularly observed in the general population. This study introduces a novel deep learning model for facial acne segmentation utilizing a semi-supervised learning method known as bidirectional copy-paste, which synthesizes images by interchanging foreground and background parts between labeled and unlabeled images during the training phase. To overcome the lower performance observed in the labeled image training part compared to the previous methods, a new framework was devised to directly compute the training loss based on labeled images. The effectiveness of the proposed method was evaluated against previous semi-supervised learning methods using images cropped from facial images at acne sites. The proposed method achieved a Dice score of 0.5205 in experiments utilizing only 3% of labels, marking an improvement of 0.0151 to 0.0473 Dice score over previous methods. The proposed semi-supervised learning approach for facial acne segmentation demonstrates improvement in performance, offering a novel direction for future acne analysis.

The term "code smell" refers to an indication of a problem with the quality of source code. Numerous studies have been conducted to identify problematic features in source code. Initially, the focus was on utilizing metric-based and heuristic-based approaches. In recent years, however, there has been a shift towards using machine learning and deep learning (DL) techniques for smell detection. Nevertheless, the current algorithms are still considered to be in the early stages of development. Recognizing the challenges associated with identifying smells using DL methods, both academics and software developers have made efforts to address these obstacles. This work involves constructing and evaluating new DL models for code smell detection. Two models are built upon stacked autoencoders, employing a hybrid architecture that combines bidirectional long short-term memory and convolutional neural network components.

Prostate cancer is the second most frequent malignancy (after lung cancer) in men worldwide. Prostate tissue biopsies are usually graded using scores according to the Gleason grading system. This Gleason score is the most popular prognostic marker that reveals the potential aggressiveness of the disease. However, inter-observer variability in rating by human assessors is a major limiting factor. Such variability could lead to missing a severe case or suggesting unnecessary treatments. This study explores the discriminative ability of artificial intelligence (deep learning models) for Gleason score assessment. The study was designed to use whole-slide images of digitized H&E-stained biopsies of prostate tissues to automate the grading process and provide a remotely accessible clinical decision support system. Custom convolutional neural network architectures were trained on 10,616 images of prostate tissues. Gaussian filters were applied to pre-process the images and improve model performance. Transfer learning was applied to train eight machine learning architectures namely: Xception, VGG16 & 19, ResNet101, MobileNet, DenseNet121, EfficientNetB5 & B7. Efficient NetB7 had the best performance 85.2% compared with ground-truth classification by experts. Performance improves as more data is available. The model was deployed and hosted as a web application API on Google cloud service to ensure remote access. Tissue biopsy images can be uploaded and the corresponding Gleason score recovered immediately. This system reduces diagnostics turnaround time, increase throughput, and compensate for limited skills, especially in low resource settings.

In areas where conventional fundus cameras are logistically unaffordable, the smartphone-based approach is considered as a promising future of glaucoma screening due to their affordability and ease-of-use. Optic disc localization is a critical stage during glaucoma screenings. For fundus images captured with standard fundus cameras, the majority of the models available out there can locate the optic disc with satisfactory performance. However, for images that are captured with smartphone-based fundus cameras, the inherent noise and lower quality of the fundus image makes it difficult for models to detect the optic disc region. In this study, we have proposed to utilize YOLOv8n for optic disc localization due to the model’s cutting-edge performance in diverse tasks and its lightweight nature. We have used a public dataset which has 2000 low quality fundus images that are captured using a smartphone-based fundoscopy device. From these, 60% of the data was used for fine-tuning the model, and 25% for testing. By using a confidence of 50% set as threshold, the model was able to detect the optic disc successfully on over 97% of test images with intersection over union of above 0.85. These results highlight the potential of the lightweight YOLOv8n model for deployment on resource-constrained environments, offering a promising performance on accurately localizing the OD and enhancing the feasibility of affordable glaucoma screening on smartphones.

The artificial intelligence (AI) is a machine or computing platform that is capable of making intelligent decision similarly to the human mind. The AI could improve diagnosis, treatment prognosis, and clinical workflow, particularly in the field of radiology. Concerning acute respiratory distress syndrome (ARDS) is a rather heterogeneous syndrome characterized by an inflammatory lung edema leading to an increased lung weight, decreased lung aeration with the presence of alveolar collapse and interstitial opacities mainly in the dependent area. Thus, lung imaging is an essential tool to assess not only the morphology but also the mechanical characteristics of ARDS patients. Chest computed tomography (CT) and ultrasound have a higher sensitivity and specificity than conventional chest radiography. This narrative review summarizes the state of art of AI in the field of lung imaging, focusing on CT and ultrasound technique in ARDS patients. A total number of 18 articles were retrieved. The application of AI in lung imaging was mainly devoted to assess the prediction of ARDS, the quantification of alveolar recruitment, the possible alternative diagnosis and the outcome. Although the presence of a physician is still essential to ensure a high quality of examinations the AI could assist the clinical team to provide the best possible care.

In bioinformatics research, traditional machine learning methods have demonstrated efficacy in addressing Euclidean data. However, real-world data often encompasses non-Euclidean forms, such as graph data, which contain intricate structural patterns or high-order relationships that elude conventional machine-learning approaches. Representation learning seeks to derive valuable data representations from enhancing predictive or analytic tasks, capturing vital patterns and structures. This method has proven particularly beneficial in bioinformatics and biomedicine, as it effectively handles high-dimensional, sparse data, detects complex biological patterns, and optimizes predictive performance. In recent years, graph representation learning has become a popular research direction. It embeds graphs into a low-dimensional space while preserving the structural and attribute information of the graph, enabling better feature extraction for downstream tasks. This study extensively reviews representation learning advancements, particularly in the research of representation methods since the emergence of COVID-19. We begin with an analysis and classification of neural network-based language model representation learning techniques as well as graph representation learning methods. Subsequently, we explore their methodological innovations in the context of COVID-19, with a focus on the domains of drugs, public health, and healthcare. Furthermore, we discuss the challenges and opportunities associated with graph representation learning. This comprehensive review presents invaluable insights for researchers as it documents the development of COVID-19 and offers experiential lessons to preempt future infectious diseases. Moreover, this study guides future bioinformatics and biomedicine research methodologies.

Remote sensing (RS) technology has significantly contributed to geological exploration and mineral resource assessment. However, its effective application in vegetated areas encounters various challenges. This paper aims to provide a comprehensive overview of the challenges and opportunities associated with RS-based lithological identification in vegetated regions. The article begins by introducing the sources and processing methods of RS data, which serve as the foundation for subsequent analysis. Moreover, it highlights the techniques and methodologies employed for lithological classification in vegetated areas. Notably, hyperspectral RS and Synthetic Aperture Radar (SAR) have emerged as prominent tools in lithological identification. In addition, this paper addresses the limitations inherent in RS technology, including issues related to vegetation cover and terrain effects, which significantly impact accurate lithological mapping. To propel further advancements in the field, the paper proposes promising avenues for future research and development. These include the integration of multi-source data to enhance classification accuracy and the exploration of novel RS technologies and algorithms. In summary, this paper presents valuable insights and recommendations for advancing the study of RS-based lithological identification in vegetated areas.

(1) Background: In the year of 2020 Covid-19 was declared epidemic by WHO. From that time millions of people were affected and died by this disease. The main detection process for this epidemic is RT-PCR test or reverse polymerase transcription chain reaction test. One of the reason of spreading of this disease so much is lack of efficiency in RT-PCR test. Sampling error and low viral load were two main reasons for what the testing process faced such problems. Lung infection is a very common symptom for covid-19 patients, so, CT scan and chest X-ray imaging technique can be applied to detect patient at a very early stage of infection. Which will be very effective and also can be a better option to RT-PCR test; (2) Methods: We searched data in Scopus for articles published between 2020 and 2023. The initial set of articles was 189, from which 21 articles will eventually be selected by exclusion criteria; (3) Results: A total of thirteen (61.90%) articles were found working on detecting Covid-19 by extracting the X-ray and CT scan data individually. Three (14.28%) of those articles focused on a hybrid model of CT scan and X-ray Image Data. Another four articles made a comparison between Covid-19, pneumonia and a normal person to identify a Covid-19 patient. Where others have worked on unsupervised learning methods or SVM to detect Covid-19.; (4) Conclusions: We have conducted a systematic review of the studies that have been published up to this time, with the purpose to present a summary of the evidence about the detection of COVID-19. In this article, we have summarized and critically reviewed literatures which worked on development or application or both of different AI or ML technique from chest CT and X-ray images to find a solution to detect covid-19.

This article presents a review of current advances and future prospects in the field of forecasting renewable energy generation using machine learning (ML) and deep learning (DL) techniques. With the increasing penetration of renewable energy sources (RES) into the electricity grid, accurate forecasting of their generation becomes crucial for efficient grid operation and energy management. Traditional forecasting methods have limitations, and thus ML and DL algorithms have gained popularity due to their ability to learn complex relationships from data and provide accurate predictions. This paper reviews the different approaches and models that have been used for renewable energy forecasting and discusses their strengths and limitations. It also highlights the challenges and future research directions in the field, such as dealing with uncertainty and variability in renewable energy generation, data availability, and model interpretability. Finally, this paper emphasizes the importance of developing robust and accurate renewable energy forecasting models to enable the integration of RES into the electricity grid and facilitate the transition towards a sustainable energy future.

Motor imagery(MI)-based Brain-Computer Interfaces (BCI) have shown increased potential for the rehabilitation of stroke patients; nonetheless, their implementation in clinical practice has been restricted due to their low accuracy performance. To date, although a lot of research has been made in benchmarking and highlighting the most valuable classification algorithms in BCI configurations, most of them are using offline data and not from real BCI performance during the closed-loop (or online) sessions. Since rehabilitation training relies on the availability of an accurate feedback system, we surveyed articles of current and past EEG-based BCI frameworks who report the online classification of the movement of two upper limbs in both healthy volunteers and stroke patients. We found that the recently developed Deep Learning methods do not outperform the traditional machine learning algorithms. In addition, patients and healthy subjects exhibit similar classification accuracy in current BCI configurations. Lastly, in terms of neurofeedback modality, Functional Electrical Stimulation (FES) yielded the best performance compared to non-FES systems.

Deep learning dominates automated animal activity recognition (AAR) tasks due to the high performance on large-scale datasets. However, constructing centralised data across diverse farms raises data privacy issues. Federated learning (FL) provides a distributed learning solution to train a shared model by coordinating multiple farms (clients) without sharing their private data. Whereas directly applying FL to AAR tasks often faces two challenges: client-drift during local training and gradient conflicts during global aggregation. In this study, we develop a novel FL framework called FedAAR to achieve AAR with sensor data. Specifically, we devise a prototype-guided local update module to alleviate the client-drift issue, which introduces global prototypes as shared knowledge to force clients to learn consistent features. To reduce gradient conflicts between clients, we design a gradient refinement-based aggregation module to eliminate conflicting components between client gradients during global aggregation, thereby improving the agreement between clients. Experiments are conducted on a public dataset to verify FedAAR’s effectiveness, which consists of 87,621 2-s motion data. The results demonstrate that FedAAR outperforms state-of-the-arts, with precision (75.23%), recall (75.17%), F1-score (74.70%), and accuracy (88.88%), respectively. The ablation experiments also show FedAAR’s robustness against various factors (i.e., different data sizes, communication frequency, and client numbers).

An electrocardiograph (ECG) reflects the health of the human heart and is used to help diagnose arrhythmia and myocardial infarction(MI) in clinical practice. Early diagnosis of arrhythmia helps implement preventive measures and plays a crucial role in saving a patient's life. With the increasing demand of clinicians for ECG analysis technology, intelligent detection and diagnosis of ECG signals has become a more efficient means to assist physicians in diagnosing cardiovascular diseases. This paper introduces an ECG diagnosis approach based on an ensemble deep learning combination of CNN(convolutional neural network) and SLAP(stacked-long short term memory architecture for prediction) architecture. ECG data is denoised and further divided into single heartbeats to achieve data standardization and sample diversity. Adam optimizer and BCEwithlogitsloss multi-classification loss function were used to enhance the model effect, and the system achieved the classification effect of 99.3% average accuracy, 99.0% F1-value, and 99.2% sensitivity in MIT-BIH standard database classification. It also shows good generalization ability on the Tianchi data set.

Over recent years, the importance of patent literature has become more recognized in the academic setting. In the context of artificial intelligence, deep learning, and data sciences, patents are relevant to not only industry but also academe and other communities. In this article, we focus on deep tomographic imaging and perform a preliminary landscape analysis of the related patent literature. Our search tool is PatSeer . Our patent bibliometric data is summarized in various figures and tables. In particular, we qualitatively analyze key deep tomographic patent literature.

Early diagnosis, prioritization, screening, clustering and tracking of COVID-19 patients, and production of drugs and vaccines are some of the applications that have made it necessary to use a new style of technology to involve, to manage and deal with this epidemic. Strategies backed by artificial intelligence (AI) and the Internet of Things (IoT) have been undeniable to understand how the virus works and try to prevent it from spreading. Accordingly, the main aim of this survey article is to highlight the methods of ML, IoT and the integration of IoT and ML-based techniques in the applications related to COVID-19 from the diagnosis of the disease to the prediction of its outbreak. According to the main findings, IoT provided a prompt and efficient approach of following the disease spread. Most of the studies developed by ML-based techniques for handling COVID-19 based dataset provided performance criteria. The most popular performance criteria, is related to accuracy factor. It can be employed for comparing the ML-based methods with different datasets. According to the results, CNN with SVM classifier, Genetic CNN and pre-trained CNN followed by ResNet, provided highest accuracy values. On the other hand, the lowest accuracy was related to single CNN followed by XGboost and KNN methods.

Studies have shown that STK11 mutation plays a critical role in affecting the lung adenocarcinoma (LUAD) tumor immune environment. By training an Inception-Resnet-v2 deep convolutional neural network model, we were able to classify STK11-mutated and wild type LUAD tumor histopathology images with a promising accuracy (per slide AUROC=0.795). Dimensional reduction of the activation maps before the output layer of the test set images revealed that fewer immune cells were accumulated around cancer cells in STK11-mutation cases. Our study demonstrated that deep convolutional network model can automatically identify STK11 mutations based on histopathology slides and confirmed that the immune cell density was the main feature used by the model to distinguish STK11-mutated cases.

Deep learning techniques are increasingly being recognized as effective image classifiers. Aside from their successful performance in past studies, the accuracies have varied in complex environments in comparison with the popularly applied machine learning classifiers. This study seeks to explore the feasibility for using a U-Net deep learning architecture to classify bi-temporal high resolution county scale aerial images to determine the spatial extent and changes of land cover classes that directly or indirectly impact tidal marsh. The image set used in the analysis is a collection of a 1-m resolution collection of National Agriculture Imagery Program (NAIP) tiles from 2009 and 2019 covering Beaufort County, South Carolina. The U-net CNN classification results were compared with two machine learning classifiers, the Random Trees (RT) and the Support Vector Machine (SVM). The results revealed a significant accuracy advantage in using the U-Net classifier (92.4%) as opposed to the SVM (81.6%) and RT (75.7%) classifiers for overall accuracy. From the perspective of a GIS analyst or coastal manager, the U-Net classifier is now an easily accessible nad powerful tool for mapping large areas. Change detection analysis indicated little areal change on marsh extent, though increased land development throughout the county has the potential to negatively impact the health of the marshes. Future work should explore applying the constructed U-Net classifier to coastal environments in large geographic areas, while also implementing other data sources (e.g., LIDAR, multispectral data) to enhance classification accuracy.

Although commercially-available low-cost air quality sensors have low accuracy, the sensor system are being used to collect the data for the regulation of PM2.5 emission caused by industrial activities or to estimate the personal exposure for PM2.5. In this work, to solve the accuracy problem of low-cost PM sensor, we developed a new PM2.5 calibration model by combining the deep neural network (DNN) optimized in calibration problem and a LSTM optimized in time-dependent characteristics. First, two datasets were generated to test the accuracy performance and generalization performance of the PM2.5 calibration machine learning (ML) model. The PM2.5 concentrations, temperature and humidity by low-cost sensor and gravimetric-based PM2.5 measuring instrument were sampled for a sufficiently long time. The proposed model was compared with benchmark (multiple linear regression model) and low-cost sensor results. For root mean square error (RMSE) for PM2.5 concentrations, the proposed model reduced 41-60% of error compared to the raw data of low-cost sensor, and reduced 30-51% of error compared to the benchmark model. R2 of ML model, MLR and raw data were 93, 80 and 59 %. Also, the developed model still showed consistent calibration performance when calibrated with new sensors in different locations. Low-cost sensors combined with ML model not only can improve the calibration performance of benchmark, but also can be applied to the sensor monitoring systems for various epidemiologic investigations and regulatory decisions.

Cardiovascular disease (CVD) may sometimes unexpected loss of life. It affects the heart and blood vessels of body. CVD plays an important factor of life since it may cause death of human. It is necessary to detect early of this disease for securing patients life. In this chpter two exclusively different methods are proposed for detection of heart disease. The first one is Pattern Recognition Approach with grammatical concept and the second one is machine learning approach. In the syntactic pattern recognition approach initially ECG wave from different leads is decomposed into pattern primitive based on diagnostic criteria. These primitives are then used as terminals of the proposed grammar. Pattern primitives are then input to the grammar. The parsing table is created in a tabular form. It finally indicates the patient with any disease or normal. Here five diseases beside normal are considered. Different Machine Learning (ML) approaches may be used for detecting patients with CVD and assisting health care systems also. These are useful for learning and utilizing the patterns discovered from large databases. It applies to a set of information in order to recognize underlying relationship patterns from the information set. It is basically a learning stage. Unknown incoming set of patterns can be tested using these methods. Due to its self-adaptive structure Deep Learning (DL) can process information with minimal processing time. DL exemplifies the use of neural network. A predictive model follows DL techniques for analyzing and assessing patients with heart disease. A hybrid approach based on Convolutional Layer and Gated-Recurrent Unit (GRU) are used in the paper for diagnosing the heart disease.

Phenotypes are driven by regulated gene expression, which in turn are mediated by complex interactions between diverse biological molecules. Protein-DNA interactions such as histone and transcription factor binding are well studied, along with RNA-RNA interactions in short RNA silencing of genes. In contrast, lncRNA-protein interaction (LPI) mechanisms are comparatively unknown, likely driven by the difficulties in studying LPI. However, LPI are emerging as key interactions in epigenetic mechanism, playing a role in development and disease. Their importance is further highlighted by their conservation across kingdoms. Hence, interest in LPI research is increasing. We therefore review the current state of the art in lncRNA-protein interactions. We specifically surveyed recent computational methods and databases which researchers can exploit for LPI investigation. We discovered that algorithm development is heavily reliant on a few generic databases containing curated LPI information. We show that early methods predict LPI using molecular docking, have limited scope and are slow, creating a data processing bottleneck. Recently, machine learning has become the strategy of choice in LPI prediction, likely due to the rapid growth in machine learning infrastructure and expertise. While many of these methods have notable limitations, machine learning is expected to be the basis of modern LPI prediction algorithms.

With the evolution of computing technology in many application like human robot interaction, human computer interaction and health-care system, 3D human body models and their dynamic motions has gained popularity. Human performance accompanies human body shapes and their relative motions. Research on human activity recognition is structured around how the complex movement of a human body is identified and analyzed. Vision based action recognition from video is such kind of tasks where actions are inferred by observing the complete set of action sequence performed by human. Many techniques have been revised over the recent decades in order to develop a robust as well as effective framework for action recognition. In this survey, we summarize recent advances in human action recognition, namely the machine learning approach, deep learning approach and evaluation of these approaches.

Prediction of stock groups values has always been attractive and challenging for shareholders. This paper concentrates on the future prediction of stock market groups. Four groups named diversified financials, petroleum, non-metallic minerals and basic metals from Tehran stock exchange are chosen for experimental evaluations. Data are collected for the groups based on ten years of historical records. The values predictions are created for 1, 2, 5, 10, 15, 20 and 30 days in advance. The machine learning algorithms utilized for prediction of future values of stock market groups. We employed Decision Tree, Bagging, Random Forest, Adaptive Boosting (Adaboost), Gradient Boosting and eXtreme Gradient Boosting (XGBoost), and Artificial neural network (ANN), Recurrent Neural Network (RNN) and Long short-term memory (LSTM). Ten technical indicators are selected as the inputs into each of the prediction models. Finally, the result of predictions is presented for each technique based on three metrics. Among all algorithms used in this paper, LSTM shows more accurate results with the highest model fitting ability. Also, for tree_based models, there is often an intense competition between Adaboost, Gradient Boosting and XGBoost.

Causality is the most important topic in the history of Western Science, and since the beginning of the statistical paradigm, it meaning has been reconceptualized many times. Causality entered into the realm of multi-causal and statistical scenarios some centuries ago. Despite of widespread critics, today Deep Learning and Machine Learning advances are not weakening causality but are creating a new way of finding indirect factors correlations. This process makes possible us to talk about approximate causality, as well as about a situated causality.

Preliminaries Convolutional Neural Network (CNN) applications have recently emerged in Structural Health Monitoring (SHM) systems focusing mostly on vibration analysis. However, the SHM literature shows clearly that there is a lack of application regarding the combination of PZT (Lead Zirconate Titanate) based method and CNN. Likewise, applications using CNN along with the Electromechanical Impedance (EMI) technique applied to SHM systems are rare. To encourage this combination, an innovative SHM solution through the combination of the EMI-PZT and CNN is presented here. To accomplish this, the EMI signature is split into several parts followed by computing the Euclidean distances among them to form a RGB (red, green and blue) frame. As a result, we introduce a dataset formed from the EMI-PZT signals of 720 frames, encompassing a total of 4 types of structural conditions for each PZT. In a case study, the CNN-based method was experimentally evaluated using three PZTs glued onto an aluminum plate. The results reveal an effective pattern classification; yielding a 100% hit rate which outperforms other SHM approaches. Furthermore, the method needs only a small dataset for training the CNN, providing several advantages for industrial applications.

The Mining Industry has changed significantly in recent decades with the introduction of advanced technologies such as Artificial Intelligence (AI) and Machine Learning (ML). These innovations contribute to the creation of expert systems that help in optimizing processes, increasing the safety and sustainability of operations. This article is a literature review of modern AI and ML methods and technologies used in the Mining Industry. Discusses various intelligent and expert systems used to improve productivity, reduce operating costs, improve occupational safety, environmental sustainability, machine automation, predictive analytics, quality monitoring and control, and inventory and logistics management. The advantages and disadvantages of different approaches are analyzed, as well as their potential impact on the future of the Mining Industry. The review highlights the importance of integrating AI and ML into mining processes to achieve more efficient and safer solutions.

Properties of spatially explicit data are often ignored or inadequately handled in machine learning for spatial domains of application. At the same time, resources that would identify these properties and investigate their influence and methods to handle them in machine learning applications are lagging behind. In this survey of the literature, we seek to identify and discuss spatial properties of data that influence the performance of machine learning. We review some of the best practices in handling such properties in spatial domains and discuss their advantages and disadvantages. We recognize two broad strands in this literature. In the first, the properties of spatial data are developed in the spatial observation matrix without amending the substance of the learning algorithm; in the other, spatial data properties are handled in the learning algorithm itself. While the latter have been far less explored, we argue they offer the most promising prospects for the future of spatial machine learning.

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for training. Secondly, deep neural networks need a very large amount of labelled training data to achieve good quality performance, yet in practice it is difficult to collect enough samples for most classes of interest. In this paper, we propose factorising the final task of audio transcription into multiple intermediate tasks in order to improve the training performance when dealing with this kind of low-resource datasets. We evaluate three data-efficient approaches of training a stacked convolutional and recurrent neural network for the intermediate tasks. Our results show that different methods of training have different advantages and disadvantages.

Diabetic retinopathy, a common complication of diabetes, is further exacerbated by factors such as hypertension and obesity. This study introduces the Diabetic Retinopathy Convolutional Transformer (DRCT) model, which combines convolutional and transformer techniques to enhance the classification of retinal images. The DRCT model achieved an impressive average F1 score of 0.97, reflecting its high accuracy in detecting true positives while minimizing false positives. Throughout 100 training epochs, the model exhibited strong generalization capabilities, achieving superior validation accuracy with minimal overfitting. On a newly evaluated dataset, the model attained precision and recall scores of 96.93% and 98.89%, respectively, indicating a well-balanced handling of false positives and false negatives. The model's ability to classify retinal images into five distinct diabetic retinopathy categories demonstrates its potential to significantly improve automated diagnosis and aid in clinical decision-making.

Automating pruning tasks entails overcoming several challenges, encompassing not only robotic manipulation but also environment perception and detection. To achieve efficient pruning, robotic systems must accurately identify the correct cutting points. A possible method to define these points is to choose the cutting location based on the number of nodes present on the targeted cane. For this purpose, in grapevine pruning, it is required to correctly identify the nodes present on the primary canes of the grapevines. In this paper, a novel method of node detection in grapevines is proposed with four distinct state-of-the-art versions of the YOLO detection model: YOLOv7, YOLOv8, YOLOv9 and YOLOv10. These models were trained on a public dataset with images containing artificial backgrounds and afterwards validated on different cultivars of grapevines from two distinct Portuguese viticulture regions with cluttered backgrounds. This allowed to evaluate the robustness of the algorithms on the detection of nodes in diverse environments, compare the performance of the YOLO models used, as well as create a publicly available dataset of grapevines obtained in Portuguese vineyards for node detection. Overall, all used models were capable of achieving correct node detection on images of grapevines from the three distinct datasets. Considering the trade-off between accuracy and inference speed, the YOLOv7 model demonstrated to be the most robust in detecting nodes in 2D images of grapevines, achieving F1-Score values between 70 % and 86.5 % with inference times of around 89 ms for an input size of 1280×1280 px. Considering these results, this work contributes with an efficient approach for real-time node detection for further implementation on an autonomous robotic pruning system.

Traditional classroom teaching model can no longer meet the needs of students' ability development. As a new model actively advocated in the modern education concept, personalized teaching focuses on the development needs of students and emphasizes respect for students' individualized growth. In this work, we utilize deep learning method to recommend teaching strategies for different features of students. Specifically, the proposed method includes the construction of a multi-layer neural network model, which can analyze students' multi-dimensional learning data and behavior patterns, so as to recommend the most suitable teaching strategies for individual students. Through data collection and preprocessing, model architecture design, model training and optimization, the model gradually improves the accuracy of prediction and recommendation. Experimental analysis verifies the effectiveness of the model through field teaching experiments, and the results show that the personalized teaching strategy based on deep learning can significantly improve the learning effect and participation of students.

Chip pad alignment inspection is of great importance in the industrial field. However, due to the fact that chip pads are usually small, problems such as misdetection and missed detection often occur. When applying deep learning methods for chip pad detection, it is necessary to ensure accurate detection of small target chips while meeting the requirements of lightweight detection models for industrial needs. To solve the above problems, this paper proposes a lightweight model based on improved YOLOv5s. Firstly, the feature extraction part is improved to increase the network's focus on the target. Secondly, the feature fusion layer is improved to double the resolution of the prediction head, and the context-aware network is designed to enhance the context-capture ability of key features of small targets. Finally, SIoU is adopted as the loss function to improve the speed and accuracy of the regression frame. The experimental results show that the improved YOLOv5s algorithm improves the detection accuracy by 2.3% and reduces the network parameters by 81.8% compared to the original algorithm. The improved algorithm is combined with image processing techniques to design correction methods for alignment anomalies and realize real-time alignment anomaly correction in industry.

Attention Deficit Hyperactivity Disorder (ADHD) diagnosis poses significant challenges due to its heterogeneous nature and reliance on subjective assessments. This study leverages deep learning to develop a robust diagnostic model by integrating a comprehensive set of EEG biomarkers. We incorporate parameters such as theta/beta ratio, coherency measures, delta power, event-related potentials (ERPs), power spectral density (PSD), microstates, entropy measures, fractal dimension, and source localization. Our convolutional neural network (CNN) model, designed to process these diverse features, demonstrates high accuracy and stability in distinguishing ADHD patients from controls, from all ages. The model's architecture includes convolutional layers for spatial feature extraction, followed by dense layers that integrate additional EEG parameters. The results indicate that deep learning, coupled with a rich feature set, can significantly enhance the predictive accuracy of ADHD diagnosis, offering a promising tool for clinical application.

The application of deep learning in autonomous vehicles has surged over the years with the advances in technologies. This research explores the integration of deep learning algorithms into autonomous vehicles (AVs), focusing on their role in perception, decision-making, localization, mapping, and navigation. It shows that deep learning, which as a part of machine learning, mimics the human brain's neural networks, enabling advancements in perception, decision-making, localization, mapping, and overall navigation. Techniques like convolutional neural networks are used for image detection and steering control, while deep learning is crucial for path planning, automated parking, and traffic maneuvering. Localization and mapping are essential for AVs' navigation, with deep learning-based object detection mechanisms like Faster R-CNN and YOLO proving effective in real-time obstacle detection. Apart from the roles, the study also revealed that integration of deep learning in AVs faces challenges such as dataset uncertainty, sensor challenges, and model training intricacies. However, these issues can be addressed through increased standardization of sensors, real-life testing for model training, and advancements in model compression technologies can optimize the performance of deep learning in AVs. The study concludes that deep learning plays a crucial role in enhancing the safety and reliability of AV navigation. This study contributes to the ongoing discourse on the optimal integration of deep learning in AVs, aiming to foster their safety, reliability, and societal acceptance.

Hyperspectral images (HSI) contain abundant spectral information. Efficient extraction and utilization of this information for image classification remain prominent research topics. Previously, hyperspectral classification techniques primarily relied on statistical attributes and mathematical models of spectral data. Deep learning classification techniques have recently been extensively utilized for hyperspectral data classification, yielding promising outcomes. This study proposes a deep learning approach that uses polarization feature maps for classification. Initially, the polar coordinate transformation method is employed to convert the spectral information of all pixels in the image into spectral feature maps. Subsequently, the proposed Deep Context Feature Fusion Network (DCFF-NET) is utilized to classify these feature maps. The model is validated using three open-source hyperspectral datasets: Indian Pines, Pavia University, and Salinas. The experimental results indicated that DCFF-NET achieves excellent classification performance. Experimental results on three public HSI datasets demonstrate that the proposed method accurately recognizes different objects with an overall accuracy (OA) of 86.68%, 94.73%, and 95.14% based on the pixel method, and 98.15%, 99.86%, and 99.98% based on the pixel-patch method.

With increasing electronic medical data and the development of artificial intelligence, Clinical Decision Support Systems (CDSSs) assist clinicians in diagnosis and prescription. Traditional knowledge-based CDSSs follow an accumulated medical knowledgebase and a predefined rule system, which clarifies the decision-making process; however, maintenance cost issues exist in the medical data quality control and standardization process. Non-knowledge-based CDSSs utilize vast amounts of data and algorithms to effectively decide; however, the deep learning black-box problem causes unreliable results. EXplainable Artificial Intelligence (XAI)-based CDSS provides a valid rationale and explainable results. It ensures trustworthiness and transparency by showing the recommendation and prediction results process through explainable techniques. However, existing systems have limitations, such as the scope of data utilization and the lack of explanatory power of AI models. This study proposes a new XAI-based CDSS framework to address these issues; introduce resources, datasets, and models that can be utilized; and provides a foundation model to support decision-making in various disease domains. Finally, we propose future directions for CDSS technology and highlight societal issues that need to be addressed to emphasize the potential of CDSS in the future.

Fluorescence microscopic images of cells contain a large number of morphological features that are used as an unbiased source of quantitative information about cell status, through which researchers can extract quantitative information about cells and study the biological phenomena of cells through statistical and analytical analysis. As an important research object of phenotypic analysis, images have a great influence on the research results. Saturation artifacts present in the image result in a loss of grayscale information that does not reveal the true value of fluorescence intensity. From the perspective of data post-processing, we propose a two-stage cell image recovery model based on generative adversarial network to solve the problem of phenotypic feature loss caused by saturation artifacts. The model is capable of restoring large areas of missing phenotypic features. In the experiment, we adopt the strategy of progressive restore to improve the robustness of the training effect, and add the contextual attention structure to enhance the stability of the restore effect. We hope to use deep learning methods to mitigate the effects of saturation artifacts to reveal how chemical, genetic, and environmental factors affect cell state, providing an effective tool for studying the field of biological variability and improving image quality in analysis.

Deep learning methods paired with sidescan sonar (SSS) are commonly used in underwater search and rescue operations for drowning victims, wrecks, and airplanes. However, these techniques are primarily designed to detect mine-like objects and are rarely applied to identifying features in dynamic dredge pit environments, due to a lack of datasets. In this study, we present a Sandy Point Dredge Pit (SPDP) dataset, in which high-resolution SSS data were collected from the west flank of Mississippi bird foot delta of the Louisiana inner shelf. This dataset contains a total of 385 SSS images. We introduce an Effective Geomorphology Classification model (EGC). By ablation studies, we analyze the utility of transfer learning on different model architectures and the impact of data augmentations on model performance. This EGC model will make geomorphic features identification in dredge pit environments quick and efficient which requires extensive experience and professional knowledge. The combination of SSS images and EGC model is a cost-effective and valuable toolkit for hazards monitoring in marine dredge pit environment. The SPDP SSS images dataset, especially the feature of pit wall without rotational slump, is also valuable for other machine learning modelers.

High-power laser facilities necessitate predicting incremental damage to final optics to identify evolving damage trends. In this study, we propose a surface damage detection method utilizing image segmentation employing ResNet-18, and a damage area estimation network employing U-Net++. Paired sets of online and offline images of optics obtained from a large laser facility is used to train the network. The trends of varying damage could be identified by incorporating additional experimental parameters. A key advantage of the proposed method is that the network can be trained end-to-end on small samples, eliminating the need for manual labeling or feature extraction. The software developed based on these models can facilitate the daily inspection and maintenance of optics in large laser facilities.

The Ebola virus disease (EVD) is an extremely contagious and fatal illness caused by the Ebola virus. Recently, Uganda witnessed an outbreak of EVD, which generated a lot of attention on various social media platforms. To ensure effective communication and implementation of targeted health interventions, it is crucial for stakeholders to comprehend the sentiments expressed in the posts and discussions on these online platforms. In this study, we used deep learning techniques to analyze the sentiments expressed in Ebola-related tweets during the outbreak. We explored the application of three deep learning techniques to classify the sentiments in 8,395 tweets as positive, neutral, or negative. The techniques examined included a 6-layer convolutional neural network (CNN), a 6-layer long-short-term memory model (LSTM), and an 8-layer Bidirectional Encoder Representations from Transformers (BERT) model. The study found that the BERT model outperformed both the CNN and LSTM-based models across all the evaluation metrics, achieving a remarkable classification accuracy of 95\%. These findings confirm the reported effectiveness of transformer-based architectures in tasks related to natural language processing, such as sentiment analysis.

The incessant evolution of online platforms has ushered in a multitude of shopping modalities. Within the food industry, however, assessing the delectability of meals can only be tentatively determined based on consumer feedback encompassing aspects such as taste, pricing, packaging, service quality, delivery timeliness, hygiene standards, and environmental considerations. Traditional text data mining techniques primarily focus on consumers' emotional traits, disregarding pertinent information pertaining to the online products themselves. In light of these aforementioned issues in current research methodologies, this paper introduces the Bert BiGRU Softmax model combined with multimodal features to enhance the efficacy of sentiment classification in data analysis. Comparative experiments conducted using existing data demonstrate that the accuracy rate of the model employed in this study reaches 90.9%. In comparison to single models or combinations of three models with the highest accuracy rate of 7.7%, the proposed model exhibits superior accuracy and proves highly applicable to online reviews.

In the era of Artificial Intelligence (AI), comprehending and responding to non-verbal communication is increasingly vital. This research extends AI's reach in bridging communication gaps, notably benefiting American Sign Language (ASL) and Taiwan Sign Language (TSL) communities. It focuses on employing various AI models, especially the Hierarchical Vision Transformer with Shifted Windows (Swin), for recognizing diverse sign language datasets. The study assesses Swin architecture's adaptability to different sign languages, aiming to create a universal platform for Unvoiced communities. Utilizing deep learning and transformer technologies, hybrid application prototypes have been developed for ASL-to-English translations and vice versa, with plans to expand this to multiple sign languages. The Swin models, trained on varied dataset sizes, show considerable accuracy, indicating their flexibility and effectiveness. This research underscores major advancements in sign language recognition and underlines a commitment to inclusive communication in the digital era. Future work will focus on enhancing these models and broadening their scope to include more sign languages, integrating multimodality and Large Language Models (LLMs), thereby fostering global inclusivity.

Background: Silent MRA has shown promising results in evaluating the stents used for intracranial aneurysm treatment. A deep learning-based algorithm was recently introduced by GE. The purpose of this study was to compare the performance of several MRA techniques in lumen visibility in silicone models with flow diverter stents. Methods: Two Surpass Evolve stents of different sizes were implanted in two silicone tubes. The tubes were placed in separate boxes in straight position and in two different curve configurations and connected to a pulsatile pump to construct a flow loop. Using a GE 3.0T scanner, TOF and silent MRA images were acquired, and deep learning reconstruction was applied to the silent MRA dataset. Intra-luminal signal intensity in the stent (SIin-stent), in the tube outside the stent (SIvessel) and of the background (SIbg) were measured for each scan. Results: The SIin-stent/SIbg and SIin-stent/SIv ratio were higher on silent scans and DL-based reconstructions than on TOF images. The stent tips created severe artefacts on TOF images, which could not be observed on silent scans. Conclusions: Our study demonstrated that the DL algorithm improved the quality of the silent technique in evaluating the flow diverter stent patency.

Document image binarization is a challenging task, especially when it comes to text segmentation in degraded document images. The binarization, as a pre-processing step of optical character recognition (OCR), is one of the most fundamental and commonly used segmentation methods. It separates the foreground text from the background of the document image to facilitate subsequent image processing. In view of the different degradation degree of document image, researchers have proposed a variety of solutions. This paper reviews the main binarization techniques, including both traditional algorithms and deep learning-based algorithms. We also summarize some difficulties and challenges in the field of document image binarization. Here, we evaluate various image binarization techniques to identify shortcomings in current methods and provide some help for future research.

Vulnerabilities in smart contracts may trigger serious security events, and the detection of smart contract vulnerabilities has become a significant problem. In this paper, by using the multi-scale cascade encoder architecture as the backbone, we propose a novel Multi-scale Encoder Vulnerability Detection (MEVD) approach to detect well-known high-risk vulnerabilities in smart contracts. Firstly, we use the gating mechanism to design a unique Surface Feature Encoder (SFE) to enrich the semantic information of code features. Then, by combining a Base Transformer Encoder (BTE) and a Detail CNN Encoder (DCE), we introduce a dual-branch encoder to capture the global structure and local detail features of the smart contract code, respectively. Finally, to focus the model's attention on vulnerability-related characteristics, we employ the Deep Residual Shrinkage Network (DRSN). Experimental results on three types of high-risk vulnerability datasets demonstrate performance compared to state-of-the-art methods, and our method achieves an average detection accuracy of 90%.

In recent years, Edge Intelligence (EI) has emerged, combining edge computing with AI, specifically deep learning, to run AI algorithms directly on edge devices. In practical applications, EI faces challenges related to computational power, power consumption, size, and cost, with the primary challenge being the trade-off between computational power and power consumption. This has rendered traditional computing platforms unsustainable, making heterogeneous parallel computing platforms a crucial pathway for implementing EI. In our research, we leveraged the Xilinx Zynq 7000 heterogeneous computing platform, employed High-Level Synthesis (HLS) for design, and implemented two different accelerators for LeNet-5 using loop unrolling and pipelining optimization techniques. The experimental results show that when running at a clock speed of 100 MHz, the PIPELINE accelerator, compared to the UNROLL accelerator, experiences an 8.09% increase in power consumption but speeds up by 14.972 times, making the PIPELINE accelerator superior in performance. Compared to the CPU, the PIPELINE accelerator reduces power consumption by 91.37% and speeds up by 70.387 times, while compared to the GPU, it reduces power consumption by 93.35%.This study provides two different optimization schemes for edge intelligence applications through design and experimentation, and demonstrates the impact of different quantization methods on FPGA resource consumption. These experimental results can provide a reference for practical applications, thereby providing a reference hardware acceleration scheme for edge intelligence applications.

Today, specific CNN models assigned to specific tasks are often used. In this article, the authors have investigated three models MobileNet, EfficientNetB0 and InceptionV3. Artificial intelligence methods for deep networks will be presented but implemented in a limited computer resource. Three types of training bases were investigated, starting with a simple base verifying five colors, followed by recognition of two different orthogonal elements, and then more complex images discriminating between elements. The research aimed to demonstrate the models' capabilities based on training base parameters such as the number of images and epoch types. The architectures proposed by the authors in these cases were chosen based on simulation studies conducted on a virtual machine with limited hardware parameters. The proposals present the advantages and disadvantages of different models based on TensorFlow, Keras libraries in the Jupiter environment written based on the Python language. The authors' proposal of the selected AI model enables further work on e.g. image classification, but in a limited computer resource for industrial implementation e.g. on a PLC.

This paper presents an approach to enhancing the clarity and intelligibility of speech in digital communications compromised by various background noises. Utilizing deep learning techniques, specifically a Variational Autoencoder (VAE) with 2D convolutional filters, we aim to suppress background noise in audio signals. Our method focuses on four simulated environmental noise scenarios: storms, wind, traffic, and aircraft. Training dataset has been obtained from public sources (TED-LIUM 3 dataset, which includes audio recordings from the popular TED-TALK series) combining with these background noises. The audio signals were transformed into 2D power spectrograms, upon which our VAE model was trained to filter out the noise and reconstruct clean audio. Our results demonstrate that the model outperforms existing state-of-the-art solutions in noise sup-pression. Although differences in noise types were observed, it was challenging to definitively conclude which background noise most adversely affects speech quality. Results have been assessed with objective methods (mathematical metrics) and subjective (listening to a set of audios by humans). Notably, wind noise showed the smallest deviation between the noisy and cleaned audio, perceived subjectively as the most improved scenario. Future work involves refining the phase calculation of the cleaned audio and creating a more balanced dataset to minimize differences in audio quality across scenarios. Additionally, practical ap-plications of the model in real-time streaming audio are envisaged. This research contributes significantly to the field of audio signal processing by offering a deep learning solution tailored to various noise conditions, enhancing digital communication quality.

With the rapid development of space programs in various countries, the number of satellites in space is increasing, resulting in an increasingly complex space environment. Therefore, improving space object identification technology has become highly important. We proposes a method of applying deep learning to intelligent detection of space object. We utilize 49 authentic 3D satellite models including 16 scenarios to generate a dataset comprising 17,942 images, which contains over 500 actual satellite photos. Additionally, we acquired a substantial amount of annotated data using a semi-automatic labeling method, which resulted in significant labor cost savings, and obtained a total of 39,000 labels. We validate the feasibility of the dataset using YOLOv3 and YOLOv7 models. What's more, we optimize the YOLOv7 model by integrating deformable convolution RepPoint into the YOLOv7 backbone to obtain the YOLOv7-R model. Through training with these two models, experimental results show that YOLOv3 achieves an accuracy of 0.927, YOLOv7 reaches an accuracy of 0.964, and YOLOv7-R achieves the highest accuracy at 0.983. This provides an effective solution for intelligent space object detection.

In the realm of autonomous vehicle environment perception, the primary objective of point cloud target detection is to swiftly and accurately identify three-dimensional objects from point cloud data. To meet this requirement, the prevalent network architecture employed in the industry is the voxel-based PointPillars model. Nonetheless, this model faces challenges in maintaining detection accuracy when objects are obscured or diminutive in size. In response to this issue, we introduce AGPNet, a novel model that seamlessly integrates four key modules: Data Augmentation, Dynamic Graph CNN, Pillar Feature Net, and Detection Head (SSD). The Data Augmentation module enhances the adaptability of point cloud data to complex and ever-changing real-world environments. The Dynamic Graph CNN module endows the network structure with geometric features, which encapsulate not only the point itself but also its adjacent points. The Pillar Feature Net module translates three-dimensional point cloud data into pseudo-image data through the utilization of voxels. Subsequently, the Detection Head (SSD) module leverages this pseudo-image data to conduct target detection of three-dimensional objects. Our experiments, conducted on the KITTI dataset, demonstrate that our proposed method boosts object detection accuracy by 6-7 percentage points compared to the PointPillars model, while maintaining similar detection times.

In this paper, we introduce an innovative approach to distinguish Gliosarcoma (GSM) from Glioblastoma (GBM). Our method combines causal fuzzy logic rules with the Big Bird architecture, a Transformer-based Deep Learning algorithm. Unlike prior research, which often relied on statistical models to reduce dataset dimensions before causal analysis, our approach harnesses the complete dataset in tandem with our causal fuzzy Big Bird architecture. Additionally, we benchmark our results not only against previous Gliosarcoma/Glioblastoma studies but also against GPT-2 for a comprehensive evaluation.

CagY is the largest and most complex protein from Helicobacter pylori's type IV secretion system (T4SS) and may participate in the modulation of gastric tissue inflammation. A three-dimensional structure has been reported for only two segments of the protein. To build a more complete model, particularly the region that spans between the outer membrane (OM) and the inner membrane (IM), we employed different approaches, including homology modeling, ab initio, and deep learning techniques. For the long-middle repeat region (MRR), modeling was performed using deep learning techniques and Molecular Dynamics. The modeled segments were assembled into a chain of 1595 aa, and a 14-chain CagY multimer structure was composed by structural alignment. The final multimer structure correlated with previously published struc-tures and allows to show how the multimer may form the T4SS channel through which CagA and other molecules are translocated to gastric epithelial cells. The model further confirmed that MRR, the most polymorphic and complex region of CagY, presents numerous cysteine residues forming disulfide bonds that stabilize the protein and suggest this domain probably functions as a contractile region that may play an essential role in the modulatory activity of CagY on tissue inflammation.

All kinds of vessels consist of dozens of complex machineries with rotating parts and electric motors that operate continuously in a harsh environment with excess temperature and humidity, vibration, fatigue and load. A breakdown or malfunction in one of these machineries can significantly impact the vessel’s operation and safety and consequently, the safety of the crew and the environment. To maintain operational efficiency and seaworthiness, the shipping industry invests substantial resources in preventive maintenance and repairs. This research presents the economic and technical benefits of predictive maintenance over to traditional preventive maintenance, and repair by replacement approaches in the maritime domain. By leveraging modern technology and Artificial Intelligence, we can analyze real-time operating conditions of machinery, enabling early detection of potential damages and allowing for effective planning of future maintenance and repair activities. In this paper, we propose and develop a Convolutional Neural Network that is fed with raw vibration measurements acquired in a laboratory environment from the ball bearings of a motor. Then, we investigate whether the proposed network can accurately detect the functional state of ball bearings and categorize any possible failures present, contributing to improved maintenance practices in the shipping industry.

Digital Microfluidic Biochips (DMFBs), used in various kinds of fields like DNA analysis, clinical diagnosis, and PCR testing, have made biochemical experiments more compact, efficient, and user-friendly than previous ways. However, their reliability is often compromised by their inability to adapt to all kinds of errors. All errors in biochips can be categorized into two types: known errors and unknown errors. Known errors are detectable before the start of the routing process through sensors or cameras. Unknown errors, in contrast, become apparent only during the routing process and remain undetected by sensors or cameras, which is the biggest issue to unexpectedly stop the routing process and diminishes the reliability of biochips. This paper introduces a deep reinforcement learning-based routing algorithm designed to manage not only known errors but also unknown errors. Our experiments demonstrate that our algorithm outperforms previous ones in terms of the success rate of the routing in the scenario including both known errors and unknown errors. Additionally, our algorithm contributes to detecting unknown errors during the routing process and identifying the most efficient routing path with high probability.

This study proposes a method for image matching between infrared(IR)-RGB images using a deep learning network to estimate the deformation field. We propose a deformation field generator (DFG) that estimates the deformation field of the transformation matrix to match each pixel or IR image to the RGB image. DFG is a network that receives IR and RGB images as input; the output size is two channels and has the sample resolution as the input image. By warping the IR image through a grid-sampler that warps the image according to the value of the deformation field, we can obtain a warped IR image that matches the RGB image. Additionally, to check whether the warped IR image matched the RGB image, the masking images detecting the segmentation of objects were photographed in two images. Without directly comparing IR and RGB images, we proposed mask loss that warps the IR mask image through the deformation field and grid sampler and then compares the warped IR mask image with the RGB mask image. Mask loss solves the spatial similarity comparison problem with multi-modality images, such as IR and RGB images, by comparing the mask image with the same modality image as the mask image.

Vehicle re-identification research under surveillance cameras has yielded impressive results. However, the challenge of Unmanned Aerial Vehicle (UAV)-based vehicle re-identification (ReID) presents a high degree of flexibility, mainly due to complicated shooting angles, occlusions, low discrimination of top-down features, and significant changes in vehicle scales. To address this, we propose a novel Dual Mixing Attention Network (DMANet) to extract discriminative features robust to variations in viewpoint. Specifically, we first present a plug-and-play Dual Mixing Attention Module (DMAM) to capture pixel-level pairwise relationships and channel dependencies, where DMAM is composed of Spatial Mixing Attention (SMA) and Channel Mixing Attention (CMA). First, the original feature is divided according to the dimensions of spatial and channel to obtain multiple subspaces. Then, a learnable weight is applied to capture the dependencies between local features in the mixture space. Finally, the features extracted from all subspaces are aggregated to promote their comprehensive feature interaction. Moreover, the DMAM can be readily inserted into backbone networks at any depth to improve vehicle discrimination. The experiments show that the proposed structure gains a better performance compared with the representative methods in the UAV-based vehicle ReID task. Our code and models will be publicly released.

Chlorophyll-a (Chla) is a crucial pigment in phytoplankton, playing a vital role in determining phytoplankton biomass and water nutrient status. However, in optically complex water bodies, Chla concentration is no longer the primary factor influencing remote sensing spectral reflectance signals, leading to significant errors in traditional Chla concentration estimation methods. With advancements in in-situ measurements, synchronized satellite data, and computer technology, machine learning algorithms have become popular in Chla concentration retrieval. Nevertheless, when using machine learning methods to estimate Chla concentration, abrupt changes in Chla values can disrupt the spatiotemporal smoothness of the retrieval results. Therefore, this study proposes a two-stage approach to enhance the accuracy of Chla concentration estimation in optically complex water bodies. In the first stage, a one-dimensional convolutional neural network (1DCNN) is employed for precise Chla retrieval, and in the second stage, the regression layer of the 1DCNN is replaced with Support Vector Regression (SVR). The research findings are as follows: (1) In the first stage, the performance metrics (R², RMSE, RMLSE, Bias, MAE) of the 1DCNN outperform state-of-the-art algorithms (OCI, SVR, RFR) on the test dataset. (2) After the second stage, the performance further improves, with the metrics achieving values of 0.892, 11.243, 0.052, 1.056, and 1.444, respectively. (3) In mid-to-high latitude regions, the inversion performance of 1DCNN\SVR is superior to other algorithms, exhibiting richer details and higher noise tolerance in nearshore areas. (4) 1DCNN\SVR demonstrates high inversion capabilities in water bodies with medium to high nutrient levels.

This paper explores the potential of using the SAM segmentator to enhance the segmentation capability of known methods. SAM is a promptable segmentation system that offers zero-shot generalization to unfamiliar objects and images, eliminating the need for additional training. The open-source nature of SAM on GitHub allows for easy access and implementation. In our experiments, we aim to improve the segmentation performance by providing SAM with checkpoints extracted from the masks produced by DeepLabv3+, then merging the segmentation masks provided by these two networks. Additionally, we examine the \enquote{oracle} method (as upper bound baseline performance), where segmentation masks are inferred only by SAM with checkpoints extracted from ground truth. In addition, we tested in the CAMO datasets an ensemble of PVTv2 transformers; combining the ensemble and SAM yields state-of-the-art performance in that dataset. The results of our study provide valuable insights into the potential of incorporating the SAM segmentator into existing segmentation techniques. We release with this paper the open-source implementation of our method.

Fractures of the talar neck and body are associated with spine fractures and scoliosis deformity, which affect cosmetic appearance and cause difficulty in ambulation. The implant design for talus surgery is thriving as a functional alternative in case of severe talar destruction, focusing on segmentation and reconstruction of the talus’s shape. However, manual segmentation of the talus is time-consuming and subjective. In this study we exploited the automatic segmentation framework to efficiently train a deep learning-based model to accurately segment the talus based on computed tomography imaging. We developed three model configurations with nnU-Net and investigated their Dice similarity coefficients (DSC) and 95% Hausdorff distances (HD95) for talus segmentation on a CT image dataset. The three configurations performed well (DSC > 0.95, HD95 < 0.6). When tested on the same samples, one of the configurations was more efficient while ensuring higher accuracy. We propose to focus on talus anatomic variations with increasing age based on this framework and apply it to clinical trials at the next stage.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

GNSS time series prediction plays a significant role in monitoring crustal plate motion, landslide detection, and maintenance of the global coordinate framework. Long Short-Term Memory (LSTM), a deep learning model has been widely applied in the field of high-precision time series prediction especially when combined with Variational Mode Decomposition (VMD) to form the VMD-LSTM hybrid model. To further improve the prediction accuracy of the VMD-LSTM model, this paper proposes a dual variational modal decomposition long short-term memory (DVMD-LSTM) model to effectively handle the noise in GNSS time series prediction. This model extracts fluctuation features from the residual terms obtained after VMD decomposition to reduce the prediction errors associated with residual terms in the VMD-LSTM model. Daily E, N, and U coordinate data recorded at multiple GNSS stations between 2000 and 2022 are used to validate the performance of the proposed DVMD-LSTM model. The experimental results demonstrate that compared to the VMD-LSTM model, the DVMD-LSTM model achieves significant improvements in prediction performance across all measurement stations. The average RMSE is reduced by 9.86%, and the average MAE is reduced by 9.44%. Furthermore, the average accuracy of the optimal noise model for the predicted results is improved by 36.50%, and the average speed accuracy of the predicted results is enhanced by 33.02%. These findings collectively attest to the superior predictive capabilities of the DVMD-LSTM model, thereby enhancing the reliability of the predicted results.

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

The ability to handle spatiotemporal information makes contribution for improving the prediction performance of machine RUL. However, most existing models for spatiotemporal information processing are not only complex in structure but also lack adaptive feature extraction capabilities. Therefore, a lightweight operator with adaptive spatiotemporal information extraction ability named Involution GRU (Inv-GRU) is proposed for aero-engine RUL prediction. Involution, the adaptive feature extraction operator, is replaced by the information connection in the gated recurrent unit for obtaining the adaptively spatiotemporal information extraction ability and reducing the parameters. Thus, Inv-GRU can well extract the degradation information the of aero-engine. Then for RUL prediction task, the Inv-GRU based deep learning (DL) framework is firstly constructed, where features extracted by Inv-GRU and several human-made features are separately processed to generate the health indicators (HIs) from multi-raw data of aero-engines. Finally, fully connection layers are adopted are adopted to reduce dimension and regress RUL based on the generated HIs. By applying the Inv-GRU based DL framework to the Commercial Modular Aero Propulsion System Simulation (C-MAPSS) datasets, successful predictions of aero-engines RUL have been achieved. Comparative analysis reveals that the proposed model exhibits superior overall prediction performance compared to recent public methods.

The COVID-19 pandemic has affected millions of people globally, with respiratory organs being strongly affected in individuals with comorbidities. Medical imaging-based diagnosis and prognosis have become increasingly popular in clinical settings to detect COVID-19 lung infections. Among various medical imaging modalities, ultrasound stands out as low-cost, mobile, and radiation-safe imaging technology. In this comprehensive review, we focus on ultrasound-based AI studies for COVID-19 detection that use public or private lung ultrasound datasets. We surveyed articles that used publicly available lung ultrasound datasets for COVID-19 and reviewed publicly available datasets and organize ultrasound-based AI studies per dataset. We analyzed and tabulated studies in several dimensions, such as data preprocessing, AI models, cross-validation, and evaluation criteria. In total, we reviewed 42 articles, where 28 articles used public datasets, and the rest used private data. Our findings suggest that ultrasound-based AI studies for the detection of COVID-19 have great potential for clinical use, especially for children and pregnant women. Our review also provides a useful summary for future researchers and clinicians who may be interested in the field.

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

Computer vision methods have shown to be effective in classifying garbage into recycling categories for waste processing, existing methods are costly, imprecise, and unclear. To tackle this issue, we introduce MWaste, a mobile application that uses computer vision and deep learning techniques to classify waste materials as trash, plastic, paper, metal, glass or cardboard. Its effectiveness was tested on various neural network architectures and real world images, achieving an average precision of 92% on the test set. This app can help combat climate change by enabling efficient waste processing and reducing the generation of greenhouse gases caused by incorrect waste disposal.

Auto-labeling is one of the main challenges in 3D vehicle detection. Auto-labeled datasets can be used to identify objects in LiDAR data, which is a challenging task due to the large size of the dataset. In this work, we propose a novel methodology to generate new 3D based auto-labeling datasets with a different point of view setup than the one used in the most recognized datasets (KITTI, WAYMO, etc.). The performance of the methodology has been further demonstrated with the development of our own dataset with the auto-generated labels and tested under boundary conditions on a bridge in a fixed position. The proposed methodology is based on the YOLO model trained with the KITTI dataset. From a camera-LiDAR sensory fusion, it is intended to auto-label new datasets while maintaining the consistency of the Ground Truth. The main contribution of this work is a novel methodology to auto-label autonomous driving datasets using YOLO as the main labelling system. The performance of this approach is measured retraining the contrast models of the KITTI benchmark.

Sometimes when diabetic retinopathy (DR) is found and treated quickly, vision loss can indeed be spared. This study deploys a deep learning (DL) model that can discover all 5 stages of DR more accurately than other methods. The proposed methodology shows two cases scenarios: case 1 with image enhancement using CLAHE and ESRGAN, and case 2 without image enhancement. Augmentation techniques are then employed to produce a balanced dataset with the identical criteria for both scenarios. The generated model using DenseNet-121 on the APTOS dataset outperformed other approaches for locating the 5 stages of DR, with an accuracy of 98.7 percent for case 1 and 81.2 percent for case 2. Using CLAHE and ESRGAN was shown to improve a model's performance and ability to learn.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Pulsed thermography is a vital technique in the nondestructive evaluation field. However, its data analysis can be complex and requires skilled experts. Advances in deep learning have yielded exceptional results, including image segmentation. Therefore, many efforts have been made to apply deep learning methods to data processing for nondestructive evaluation. Despite this, there is currently no public Pulsed thermographic dataset available for evaluating various spatial-temporal deep methods of segmenting pulsed thermographic data. This article aims to provide such a dataset and assess the performance of commonly used deep learning-based instance segmentation models on it. Additionally, the impact of the number of frames and data transformations on model performance is examined. The findings suggest that suitable preprocessing methods can effectively reduce the data size without compromising the deep models’ performance.

As AI models become more and more common in business and even in our daily lives, it is important to understand what the carbon impact of these models is. Recent papers have shown that this impact can be quite great, i.e., the training of a single high-end model can result in emissions of more than 500t of CO2eq. In this paper we discuss the factors that influence the carbon footprint of AI models, explore what impact different decisions have, and show how the footprint can be reduced. We also examine the footprint of different models to give a guideline on how urgent action is for different organizations.

One of the most common forms of dementia is Alzheimer’s disease (AD), which leads to progressive mental deterioration. Unfortunately, there is no definitive diagnosis and cure that can stop the condition progressing. The diagnosis is often performed based on the clinical history and neuropsychological data, including magnetic resonance imaging (MRI). Deep neural networks (DNN) algorithms are gaining popularity for medical diagnosis, and have been used widely for the analysis of MRI data. DNNs can extract hidden features from thousands of training images automatically. However, they cannot judge how confident they are about their predictions. To use DNNs in safety-critical applications such as medical diagnosis, uncertainty quantification of DNNs predictions is crucial. For this purpose, Monte Carlo dropout (MCD) has been widely used, however, it may lead to overconfident and miss calibrated results. This paper proposes a framework in which the MCD algorithm’s hyper-parameters are optimized during training using Bayesian optimization for the first time. The conducted optimization leads to assigning high predictive entropy to erroneous predictions and making it possible to recognize risky predictions. The proposed framework is used for AD diagnosis, which has not been done before. We compare our method with some existing methods in the literature based on different uncertainty quantification criteria. The results of comprehensive experiments on the Kaggle dataset using a deep model pre-trained on the ImageNet dataset show that the proposed algorithm can quantify uncertainty much better than the existing methods.

MicroRNAs (miRNAs) are small non-coding RNAs that play a central role in the post-transcriptional regulation of biological processes. miRNAs regulate transcripts by direct binding involving the Argonaute protein family. The exact rules of binding are not known, and several in silico miRNA target prediction methods have been developed to date. Deep Learning has recently revolutionized miRNA target prediction. However, the higher predictive power comes with decreased ability to interpret increasingly complex models. Here, we present a novel interpretation technique, called attribution sequence alignment, for miRNA target site prediction models that can interpret such Deep Learning models on a two-dimensional representation of miRNA and putative target sequence. Our method produces a human readable visual representation of miRNA:target interactions and can be used as a proxy for further interpretation of biological concepts learned by the neural network. We demonstrate applications of this method in clustering of experimental data into binding classes, as well as using the method to narrow down predicted miRNA binding sites on long transcript sequences. Importantly, the presented method works with any neural network model trained on a two-dimensional representation of interactions and can be easily extended to further domains such as protein-protein interactions.

Most machine learning and deep learning algorithms can only use low-dimensional data as input, but the data that must be processed in practical applications is diverse and irregular. There are two main problems with big dynamic data. (1) The size of the embedding table grows linearly with the vocabulary size, resulting in massive memory consumption. (2) For different newly added vocabularies. To solve these two problems, this paper proposes a novel embedding algorithm that can learn attribute associations with entities based on deep and hash algorithms. Taking movie data as an example, the encoding method and the specific flow of the algorithm are presented in detail, and the effect of dynamic reuse of data models is realized. Compared with the four existing embedding algorithms which can fuse entity attribute information, the deep hash embedding algorithm proposed in this paper has obvious optimization of time and space complexity.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

The classification of vessel types in SAR imagery is of crucial importance for maritime applications. However, the ability to use real SAR imagery for deep learning classification is limited, due to the general lack of such data and/or the labor-intensive nature of labeling them. Simulating SAR images can overcome these limitations, allowing the generation of an infinite number of datasets. In this contribution, we present a synthetic SAR imagery dataset with ship wakes, which comprises 46080 images for ten different real vessel models. The variety of simulation parameters includes 16 ship heading directions, 6 ship velocities, 8 wind directions, 2 wind velocities, and 3 incidence angles. In addition, we extensively investigate classification performance for noise-free, noisy, and denoised ship wake scenes. We utilize the standard AlexNet architecture and employ training from scratch. To achieve the best classification performance, we conduct Bayesian optimization to determine hyperparameters. Results demonstrate that the classification of vessel types based on their SAR signatures is highly efficient, with maximum accuracies of 96.16%, 92.7%, and 93.59%, when training using noise-free, noisy, and denoised datasets respectively. Thus, we conclude that the best strategy in practical applications should be to train convolutional neural networks on denoised SAR datasets. The results show that the versatility of the SAR simulator can open up new horizons in the application of machine learning to a variety of SAR platforms.