The upsurge of Generative Adversarial Networks (GANs) in the previous five years has led to advancements in unsupervised data manipulation, sourced feature translation, and precise input-output synthesis through a competitive optimization of the discriminator and generator networks. More specifically, the recent rise of cycle-consistent GANs enables style transfers from a discrete source (input A) to target domain (input B) by preprocessing object features for a multi-discriminative adversarial network. Traditionally, cyclical adversarial networks have been exploited for unpaired image-to-image translation and domain adaptation by determining mapped relationships between an input A graphic and an input B graphic. However, this integral mechanism of domain adaptation can be applied to the complex acoustical features of human speech. Although well-established datasets, such as the 2018 Voice Conversion Challenge repository, paved way for female-male voice transformation, cycle-GANs have rarely been re-engineered for voices outside the datasets. More critically, cycle-GANs have massive potential to extract surface-level and hidden feature to distort an input A source into a texturally unrelated target voice. By preprocessing, compressing, and packaging unique acoustical voice properties, CycleGANs can learn to decompose speech signals and implement new translation models while preserving emotion, the intent of words, rhythm, and accents. Due to the potential of CycleGAN’s autoencoder in realistic unsupervised voice-voice conversion/feature adaptation, the researchers raise the ethical implications of controlling source input A to manipulate target voice B, particularly in cases of defamation and sabotage of target B’s words. This paper analyzes the potential of cycle-consistent GANs in deceptive voice-voice conversion by manipulating interview excerpts of political candidates.

This research presents a novel methodology for classifying MRI images into two categories: tumor and non-tumor. The study utilizes a combination of two advanced Convolutional Neural Network (CNN) architectures, VGG16 and ResNet50, to address the challenges in analyzing the complexity and variability of brain MRI scans. The approach begins with a comprehensive preprocessing phase, where the MRI images are enhanced through techniques such as resizing, grayscale conversion, Gaussian blurring, and brain area isolation. Central to the approach is the application of the Multi-verse Optimizer (MVO), a metaheuristic algorithm inspired by theories of the multi-verse in physics. The MVO is utilized to optimize the parameters for data augmentation and to fine-tune the combination of trainable layers within the VGG16 and ResNet50 models. The results of this study indicate a high level of effectiveness of the combined CNN models, significantly enhanced by the MVO, in classifying MRI images. These models show marked improvements in accuracy, precision, and recall, underscoring their potential utility in enhancing brain tumor diagnosis. The paper concludes with an analysis of these findings, emphasizing the importance of this approach in medical imaging and suggesting potential avenues for future research in the area of automated MRI classification.

Objectives: To evaluate the possible long-term cerebral deposition of amyloid-β in PD patients treated with subthalamic nucleus deep brain stimulation (STN-DBS) and its possible influence on axial and cognitive variables. Methods: Consecutive PD patients treated with bilateral STN-DBS with a long-term follow-up were included. Amyloid-β deposition was evaluated postoperatively through a 18F-flutemetamol positron emission tomography (PET) study. Axial symptoms have been assessed using a standardized clinical-instrumental approach. Speech was assessed by perceptual and acoustic analysis while gait by means of the instrumented timed up and go test (iTUG). Motor severity was evaluated applying the UPDRS part III score and subscores while cognitive functions through a complete neuropsychological assessment. Different stimulation and drug conditions were assessed: on-stimulation/off-medication, off-stimulation/off-medication, on-stimulation/on-medication conditions (single and dual task). Results: 19 PD patients (male: 11; age: 63.52 years; on-stimulation/on-medication UPDRS-III: 17.05) with a five-year postoperative follow-up were included. Amyloid-β deposition was found in 21% of patients (4/19) with a prevalent involvement of prefrontal, limbic and parietal areas. Compared with patients without amyloid-β deposition, PD patients with positive 18F-flutemetamol PET study showed higher preoperative UPDRS-I (p=.037) score and lower postoperative Raven's matrices scores (p=.05). Conclusions: Our results suggest that in the long-term after STN-DBS a significant percentage of PD patients may present brain amyloid-β deposition. However, larger samples are needed to evaluate the possible role of amyloid-β deposition in the development of axial and cognitive alterations after surgery.

Solar ultraviolet (UV) is among the most important ecological factors shaping the composition of biota on the planet surface, including upper layers of waterbodies. Inhabitants of dark environments recently descending from surface organisms provide natural opportunities to study the evolutionary losses of UV adaptation mechanisms and better understand how those mechanisms function at the biochemical level. Ancient Lake Baikal is the only freshwater reservoir, where deep-water fauna emerged, and its diverse endemic amphipods (Amphipoda, Crustacea) now inhabit the whole range from highly transparent littoral to dark depths of over 1600 m, which makes them a convenient model to study UV adaptation. Here we show that adults of deep-water Baikal amphipods Ommatogammarus flavus and O. albinus indeed have high sensitivity to environmentally relevant UV levels in contrast to littoral species Eulimnogammarus cyaneus and E. verrucosus. The UV intolerance was more pronounced in deeper-dwelling O. albinus and was explainable by lower levels of carotenoids and carotenoid-binding proteins. Signs of oxidative stress were not found but specifically UV-B seemingly led to accumulation of toxic compounds. Overall, the obtained results demonstrate that UV is an important factor limiting distribution of deep-water amphipods into the littoral zone of Lake Baikal.

Thanks to the rapid advancements in Connected and Automated Vehicles (CAVs) and vehicular communication, the concept of the Internet of Vehicles (IoV) combined with Artificial Intelligence (AI) and big data technologies promotes the vision of an Intelligent Transportation System (ITS). By enabling a comprehensive data exchange platform, ITS is critical in enhancing road safety, traffic efficiency, and the overall driving experience. However, the open and dynamic nature of IoV networks brings significant performance and security challenges to IoV data acquisition, storage, and usage. To comprehensively tackle these challenges, this paper proposes a Decentralized Digital Watermarking framework for smart Vehicular networks (D2WaVe). Specifically, D2WaVe consists of two core components: FIAE-GAN, a novel feature-integrated and attention-enhanced robust image watermarking model based on a Generative Adversarial Network (GAN), and BloVA, a Blockchain-based Video frames Authentication scheme. By leveraging an encoder-noise-decoder framework, trained FIAE-GAN watermarking models can achieve the invisibility and robustness of watermarks that can be embedded in video frames to verify the authenticity of video data. Then, BloVA ensures the integrity and auditability of IoV data in the storing and sharing stages. Experimental results based on a proof-of-concept prototype implementation validate the feasibility and effectiveness of our D2WaVe scheme for securing and auditing video data exchange in smart vehicular networks.

(1) Background: Efficient detection and rectification of defects or post-processing manufacturing conditions such as sharp edges and burrs on metal components are crucial for quality control in precision manufacturing industries. (2) Methods: This paper describes a lab-scale integrated system for real-time and automated metal edge image detection using a customized YOLOv5 ma-chine vision algorithm. The YOLOv5 algorithm and model were developed and embedded in the NVIDIA Jetson Nano microprocessor. The YOLOv5 model can detect three different image types for classification i.e., normal, sharp, and burrs edge on aluminum workpiece blocks. An integrated system connects the NVIDIA Jetson Nano with an embedded YOLOv5 model to a Mitsubishi Electric Melfa RV-2F-1D1-S15 manipulator to perform selective automated chamfer-ing and grinding when certain condition defects are detected. (3) Results: The model demonstrates durable performance, achieving a mean average precision of 0.886 across defect classes with minimal misclassifications. The Mitsubishi Electric Melfa RV-2F-1D1-S15 manipulator received input from the machine vision system and performed an automated chamfering and grinding process accordingly; (4) Conclusions: By integrating camera, embedded deep learning in the microprocessor and manipulator, automated chamfering and grinding process in metal component shapes can be efficiently rectified. This tailored solution promises to improve productivity and consistency in metal manufacturing and remanufacturing.

In this study, we propose a scalable deep learning approach to automated phenotyping using UAV multispectral imagery, exemplified by yellow rust detection in winter wheat. We adopt a high granularity scoring method (1 to 9 scale) to align with international standards and plant breeders’ needs. Using a lower spatial resolution (60m flight height at 2.5cm GSD), we reduce the data volume by a factor of 3.4, making large-scale phenotyping faster and more cost-effective while obtaining results comparable to those of the state-of-the-art. Our model incorporates explainability components to optimise spectral bands and flight schedules, achieving top-3 accuracies of 0.87 for validation and 0.67 and 0.70 on two separate test sets. We demonstrate that a minimal set of bands (EVI, Red, and GNDVI) can achieve results comparable to more complex setups, highlighting the potential for cost-effective solutions. Additionally, we show that high performance can be maintained with fewer time steps, reducing operational complexity. Our interpretable model components improve performance through regularisation and provide actionable insights for agronomists and plant breeders. This scalable and explainable approach offers an efficient solution for yellow rust phenotyping and can be adapted for other phenotypes and species, with future work focusing on optimising the balance between spatial, spectral, and temporal resolutions.

Deep convolutional neural networks (CNNs) have revolutionised computer vision technology by automatically learning hierarchical representations of image data, leading to state-of-the-art performance in visual recognition tasks. This article presents a comprehensive review of deep CNNs, from their evolution and architectures to the current state-of-the-art research. The review also provides the core concepts and building blocks of CNNs and their concise mathematical representations. Furthermore, it explores applications of deep CNNs in three popular domains, including medical diagnosis, remote sensing, and facial recognition. This review will benefit researchers and practitioners in computer vision and artificial intelligence, as well as industry professionals seeking to leverage the latest advancements in deep learning technologies.

As the use of AI in medical imaging has increased, so has the need to explain a model’s results. Segmentation models are one technique used to produce explainable results. Due to larger size and sophistication, segmentation models which operate on 2D data can often produce better results than models operating on 3D data. In the real world, imaging is combined with clinical factors for diagnosis. To replicate this, multimodal models are used which combine image and text modalities. I propose a multimodal arrangement that converts 3D scans to 2D and uses a 2D segmentation model (DeepLabV3) to analyze the images. This is combined with clinical biomarkers to achieve a complete confidence score. Using the Medical Segmentation Decathlon Lung (MSDL) dataset and the LUng CAncer Screening dataset (LUCAS), I achieved a testing Dice coefficient of 0.91 on segmentation with a receiver operating characteristic (ROC), average precision (AP), and F-Score of 0.89, 0.91, and 0.85 respectively on the final multimodal results. This approach raises the F-score from the previously achieved value of 0.508 to 0.85, creating a new baseline of what is achievable with multimodal lung cancer diagnostics and possible methods to achieve these accuracies.

Background: Gliomas, including the most severe form known as glioblastomas, are primary brain tumors arising from glial cells, with significant impact on adults, particularly men aged 45 to 70. Recent advancements in the WHO classification now correlate genetic markers with glioma phenotypes, enhancing diagnostic precision and therapeutic strategies. Aims and Methods: This scoping review aims to evaluate the current state of deep learning (DL) applications in the genetic characterization of adult gliomas, addressing the potential of these technologies for a reliable virtual biopsy. Results: We reviewed 17 studies, analyzing the evolution of DL algorithms from fully convolutional networks to more advanced architectures (ResNet and DenseNet). The methods involved various validation techniques, including k-fold cross-validation and external dataset validation. Conclusions: Our findings highlight significant variability in reported performance, largely due to small, homogeneous datasets and inconsistent validation methods. Despite promising results, particularly in predicting individual genetic traits, the lack of robust external validation limits the generalizability of these models. Future efforts should focus on developing larger, more diverse datasets and integrating multidisciplinary collaboration to enhance model reliability. This review underscores the potential of DL in advancing glioma characterization, paving the way for more precise, non-invasive diagnostic tools.

The integration of sign language recognition systems into digital platforms has the potential to bridge communication gaps between the deaf community and the broader population. This paper introduces an advanced Israeli Sign Language (ISL) recognition system designed to interpret dynamic motion gestures, addressing a critical need for more sophisticated and fluid communication tools. Unlike conventional systems that focus solely on static signs, our approach incorporates both Deep Learning and Computer Vision techniques to analyze and translate dynamic gestures captured in real-time video. We provide a comprehensive account of our preprocessing pipeline, detailing every stage from video collection to the extraction of landmarks using MediaPipe, including the mathematical equations used for preprocessing these landmarks and the final recognition process. The dataset utilized for training our model is unique in its comprehensiveness and is publicly accessible, enhancing the reproducibility and expansion of future research. The deployment of our model on a publicly accessible website allows users to engage with ISL interactively, facilitating both learning and practice. We discuss the development process, the challenges overcome, and the anticipated societal impact of our system in promoting greater inclusivity and understanding.

Traffic anomaly detection is crucial for urban management, yet current research is often confined to small-scale endeavors. This study collected nine months of real-time Wuhan traffic monitoring data from Amap. We proposed Traffic-ConvLSTM, a multi-scale spatial-temporal technique based on long and short-term memory networks (LSTM) and convolutional neural networks (CNN) to effectively achieve long-term anomaly detection at the city level. First, we convert the traffic flow data into image representation, which enables the capture of the spatial correlation between traffic flow and roads and the correlation between traffic flow and roads, as well as the surrounding environment. Second, The model utilizes convolution kernels of different sizes to extract spatial features at road-level, regional-level, and city-level scales, while incorporating temporal features of different time steps to capture hourly, daily, and weekly dynamics. Additionally, varying weights are assigned to the convolution kernels and temporal features of varying spatio-temporal scales to capture the heterogeneous strengths of spatio-temporal correlations within patterns of traffic anomalies. The proposed Traffic-ConvLSTM model exhibits improved performance over existing techniques in the task of identifying long-term and large-scale traffic anomaly occurrences. Furthermore, the analysis reveals significant traffic anomalies during holidays and urban sporting events. The diverse travel patterns observed in response to various activities offer insights for large-scale urban traffic anomaly management, providing recommendations for city-level traffic control strategies.

Underwater imaging presents unique challenges, notably color distortions and reduced contrast due to light attenuation and scattering. Most underwater image enhancement methods, first use linear transformations for color compensation and then enhance the image. We observed that linear transformation for color compensation is not suitable for certain images. For such images, a non-linear mapping is a better choice. Our paper introduces a unique underwater image restoration approach leveraging a streamlined convolutional neural network (CNN) for dynamic weight learning for linear and non-linear mapping. In the first phase, a classifier is applied that classifies the input images into Type-I or Type-II. In the second phase, depending on the classification, the Deep Line Model (DLM) for Type-I images or the Deep Curve Model (DCM) for Type-II images. For mapping an input image to an output image, DML creatively combines color compensation and contrast adjustment in a single step and uses deep lines for transformation, whereas DCM employs higher-order curves. Both models utilize lightweight neural networks that learn per-pixel dynamic weights based on the input image’s characteristics. Comprehensive evaluations on benchmark datasets using metrics like peak signal-to-noise ratio(PSNR) and root mean squares error (RMSE) affirm our method’s effectiveness in accurately restoring underwater images, outperforming existing techniques.

The development of new turbomachinery designs requires numerous time-consuming and computationally intensive computational fluid dynamics (CFD) calculations. However, most of the generated high spatial resolution data remains unused at later development steps. That is also the case with automated optimization processes that use only a few integral values to determine objectives and constraints. Therefore the development of a data-driven AI model was initiated to ensure the potential of further use of the CFD data which is also used to train the AI model. The presented method subsequently provides a fast approximation of the 3D flow for new designs. In this paper, the structure of the developed AI model is presented and the approximation quality is analysed using a complex, state-of-the-art compressor test case. It is shown that the AI model can reproduce many characteristics of the 3D flow of new designs, and performance measures such as efficiency can be derived from these flow predictions. In addition, the complex test case revealed that greater design variation reduces the AI approximation quality which can lead to undesirable exploratory behaviour in an optimisation setup. Overall, the test case has shown promising results and has provided hints for further improvements of the AI model.

Visualising textual content could be helpful to professionals as well as amateurs across several fields. However, training a text-to-image generator in the mainstream domain requires large amounts of paired text-image and data, which is too expensive to collect since labeling millions of images and videos can be tiresome. GANs like StackGAN and StyleGAN can be considered as solutions to generate images from text. But the images generated may be of low accuracy and resolution, and the entire processing can be highly time-consuming. Moreover, image generation is a notion that is still being researched. Hence, the process of developing a Video Generation model necessitates substantial research. Despite the need for such a model, modern technology has lagged behind the solutions to this problem. This proposal suggests combining two methods, Text modification for Action Definition (TexAD) and SeQuential Image Generation for Video Synthesis (SQIGen). The proposed solution synthesises a sequence of images from textual information feeds and combines these images to create a video. TexAD uses Natural Language Processing and Deep Learning techniques to process, classify and modify text data. SQIGen is an extension of the VQGAN+CLIP neural network architecture that generates a sequence of images from the modified text data

Objectives: The study aimed to develop a deep learning-based edge AI model deployed on electrocardiograph (ECG) devices for real-time detection of atrial fibrillation (AF)-risk during sinus rhythm (SR) using standard 10-second 12-lead electrocardiograms (ECGs). Methods: A novel approach was used to convert standard 12-lead ECGs into binary images for model input, and a lightweight convolutional neural network (CNN)-based model was trained using data collected by the Japan Agency for Medical and Research Development (AMED) between 2019 and 2022. Patients over 40 years old with digital, SR ECGs were retrospectively enrolled and divided into AF and non-AF groups. Data labeling was supervised by cardiologists. The dataset was randomly allocated into training, validation, and internal testing datasets. External testing was conducted on data collected from other hospitals.　Results: The best-trained model achieved an AUC of 0.82 and 0.80, sensitivity of 79.5% and 72.3%, specificity of 77.8% and 77.7%, precision of 78.2% and 76.4%, and overall accuracy of 78.6% and 75.0% in the internal and external testing datasets, respectively. The deployed model and app package utilized 2.5MB and 40MB of the available ROM and RAM capacity on the edge ECG device, correspondingly. Processing time for AF-risk detection was approximately 2 seconds.　Conclusion: The model maintains comparable performance and improves its suitability for deployment on resource-constrained ECG devices, thereby expanding its potential impact to a wide range of healthcare settings. Its successful deployment enables real-time AF-risk detection during SR, allowing for timely intervention to prevent AF-related serious consequences like stroke and premature death.

Industrial hemp (Cannabis sativa L.) is an attractive candidate for sustainable pest management due to its abundance of bioactive compounds with potential pesticidal properties. Solvent choice has a significant impact on the extraction efficiency of bioactive compounds. Deep Eutectic Solvents (DESs) are gaining popularity in extraction because they are safe and environmentally friendly, making them viable alternatives to organic solvents (OSs). This research first compared the extraction efficiency of OSs on the extraction of phytochemicals from the infloresences of two hemp varieties, Citrus and Cherry Dwarf. Inflorescences were extracted using three OSs, ethanol, ethyl acetate, and hexane. The highest level of cannabidiol (CBD; 0.69%) was extracted from Cherry Dwarf using ethanol while the level of delta-9 tetrahydrocannabinol THC (0.19%) was essentially the same in both. Therefore, Cherry Dwarf was selected to compare the extraction efficiency of DESs to the OSs. The DESs were choline chloride/ethylene glycol, citric acid/ethylene glycol, menthol/lauric acid, choline chloride/urea and choline chloride/glycerol. In the targeted analysis, choline chloride/ethylene glycol extracted the highest amount of CBD (0.87%) followed by choline chloride/urea (0.78%). As some DESs outperformed ethanol, the popular solvent for extracting cannabinoids, DESs are viable candidates to replace organic solvents.

The task of human action recognition (HAR) based on skeleton data is a challenging yet crucial technique owing to its wide-ranging applications in numerous domains, including patient monitoring, security surveillance, and observation of human-machine interactions. While numerous algorithms have been proposed in an attempt to distinguish between a myriad of activities, most practical applications necessitate highly accurate detection of specific activity types. This study proposes a novel and highly accurate spatiotemporal graph autoencoder network for HAR based on skeleton data. Furthermore, an extensive investigation was conducted employing diverse modalities. To this end, a spatiotemporal graph autoencoder was constructed to automatically learn both spatial and temporal patterns from human skeleton datasets. The powerful graph convolutional network, designated as GA-GCN, developed in this study, notably outperforms the majority of existing state-of-the-art methods when evaluated on two common datasets, namely NTU RGB+D and NTU RGB+D 120. On the first dataset, the proposed approach achieved accuracies of 92.3\% and 96.8\% for the cross-subject and cross-view evaluations, respectively. On the more challenging NTU RGB+D 120 dataset, GA-GCN attained accuracies of 88.8\% and 90.4\% for the cross-subject and cross-set evaluations, respectively.

Ultrasound (US) has become a widely used imaging modality in clinical practice, characterized by its rapidly evolving technology, advantages, and unique challenges such as low imaging quality and high variability. There is a critical need to develop advanced automatic US image analysis methods to enhance diagnostic accuracy and objectivity. Vision transformer, a recent innovation in machine learning, has demonstrated significant potential in various research fields, including general image analysis and computer vision, due to its capacity to process large datasets and learn complex patterns. Its suitability for automatic US image analysis tasks, such as classification, detection, and segmentation, has been recognized. This review provides an introduction to vision transformer and discusses its applications in specific US image analysis tasks, while also addressing the open challenges and potential future trends in its application in medical US image analysis. Vision transformer has shown promise in enhancing the accuracy and efficiency of ultrasound image analysis and is expected to play an increasingly important role in the diagnosis and treatment of medical conditions using ultrasound imaging as technology progresses.

The content of this paper is a very significant contribution to the heritage regional reconstruction and conservation interventions. The results about the iconographic analysis of the Early-Renaissance frescoes of St. Leocadia Church, in Chaves, in the north-east of Portugal, were presented for the first time. This paper aims to study facial similarity analysis applied to identification of the personages represented in the 1511-1513 mural paintings of the apse of St. Leocadia Church, in Chaves Municipality (North of Portugal) and those ones in the oil paintings by the Proto-Renaissance Portuguese painter Nuno Gonçalves. In this work, it was explored the feasibility of face recognition technologies in answering many ambiguities concerning Manueline stylistic identity and iconography. A proposal was made to identify the characters, fundamental to the meaning of the frescoes. It has been experimentally proved on 7 characters of St. Leocadia Church’s paintings, in comparison with the referred old master portraits. It was used an in-house trained deep face recognition model to extract facial features from images of 15th and 16th century portraits to compare their degree of similarity. It was undertaken facial similarity analysis of the faces in the formidable portrait gallery of the 15th century Portuguese society represented in the Panels of St. Vicent, which has been subject of national and international research for 130 years. On the other, in the oil painting of St. Peter and St. Paul and Infanta St. Joana, of the same old master. The iconographic interpretation of the mural paintings of St. Leocadia, based in the deep facial features of the images, is plausible: a catechetical purpose; the ritual practices of royal ancestor worship in royal portrait apses of the churches; the Portuguese maritime expansion and the macro-imperial ideology of D. Manuel I.

In the wake of increasing digital fraud, this paper introduces an innovative application of Artificial Intelligence (AI) in detecting fraudulent activities across finance, healthcare, and e-commerce sectors. It presents a detailed analysis of machine learning methodologies, specifically focusing on the advantages of supervised, unsupervised, and deep learning techniques. The paper addresses the challenges such as data imbalance, model interpretability, and ethical implications in AI-based fraud detection. It also discusses the necessity of high-quality datasets and advocates for the integration of traditional and advanced machine learning methods to enhance accuracy and adaptability in fraud identification. However, it acknowledges the limitations including computational demands and overfitting risks. The study underscores the importance of collaborative efforts between AI experts and industry professionals to develop ethical, efficient, and reliable AI solutions for fraud detection.

This paper introduces a novel ensemble adjustment Kalman filter (EAKF) that integrates a machine-learning approach. The approach employs nonlinear variable relationships established by a deep neural network (DNN) during the analysis stage of the EAKF. This process nonlinearly projects observation increments into the state variable space. The newly developed DNN-EAKF algorithm can be applied to coupled data assimilation using coupled ocean-atmosphere models. It enhances cross-component updates in strongly coupled data assimilation (SCDA) by diminishing errors in estimating cross-component error covariance arising from insufficient ensemble members, thereby improving the SCDA analysis. This paper employs a conceptual model to conduct twin experiments, validating the DNN-EAKF’s capability to utilize cross-component observation information in SCDA effectively. The approach is anticipated to offer insights for future methodological integrations of machine learning and data assimilation and provide methods for SCDA applications in coupled general circulation models.

Chinese calligraphy, revered globally for its therapeutic and mindfulness benefits, encompasses styles such as Regular (Kai Shu), Running (Xing Shu), Official (Li Shu), and Cursive (Cao Shu) scripts. Beginners often start with Regular script, advancing to more intricate styles like Cursive. Each style, marked by unique historical calligraphers' contributions, requires learners to discern distinct nuances. The integration of AI in calligraphy analysis, collection, recognition, and classification are pivotal. This study introduces an innovative Convolutional Neural Network (CNN) architecture, pioneering the application of CNN in the classification of Chinese calligraphy. Focusing on the four principal calligraphers' styles from the Tang dynasty (690-907 A.D), this research spotlights the era when the traditional regular script font (Kai Shu) was refined. A comprehensive dataset of 8282 samples from these calligraphers, representing the zenith of regular style, was compiled for CNN training and testing. The model distinguishes personal styles for classification, showing superior performance over existing networks. Achieving 89.5-96.2% accuracy in calligraphy classification, our approach underscores the significance of CNN in both font and artistic style categorization. This research paves the way for advanced studies in Chinese calligraphy and its cultural implications.

Natural fibers have attracted increasing interest as an alternative to produce environmentally friendly and sustainable materials. Particularly, hemp fibers have revealed to be widely used in various industrial applications due to their extremely unique properties. However, hemp can generate a large amount of agro-waste, and results in an attractive source of biopolymers for the development of low-cost materials in alternative to the raw materials and conventional petroleum-based plastics. In addition, deep eutectic solvents (DESs), a new type of truly green solvents, have been tested to remove gums, lignin, and other non-cellulosic components from hemp fibers. Reusing these components dissolved into the DESs to fabricate new materials directly by electrospinning is a very attractive but still unexplored endeavor. Thus, this innovative research to venture new upcycling pathways is focused on the fabrication of composite nanofibers by electrospinning of a gel-based blend of Poly(vinyl alcohol) (PVA) and hemp agro-waste (HW) dissolved into choline chloride (ChCl) : Glycerol (1:2) and ChCl : Urea (1:2) DES mixtures. The results obtained revealed that the produced nanofibers displayed uniform appearance with diameters ranging from 257.72 ± 65.63 nm to 380.78 ± 133.98 nm. In addition, the mechanical properties of the electro-spun composite nanofibers produced from the gel-based blends of HW dissolved in DESs and PVA (HW-DESs_PVA) were found to be superior, resulting in an enhanced tensile strength and Young’s modulus. Furthermore, the incorporation of HW into the nanofibers was able to provide bioactive antioxidant and antibacterial properties. Overall, this study demonstrated a promising, more sustainable, and eco-friendly way to produce electrospun composite nanofibers using HW in a circular economy perspective.

Estimating Visual Quality of Street Space (VQoSS) is pivotal for urban design, environmental sustainability, civic engagement, etc. Recent advancements, notably in deep learning, have enabled large-scale analysis. However, traditional deep learning approaches are hampered by extensive data annotation requirements and limited adaptability across diverse VQoSS tasks. Multimodal Large Language Models (MLLMs) have recently demonstrated proficiency in various computer vision tasks, positioning them as promising tools for automated VQoSS assessment. In this paper, we pioneer the application of MLLMs to VQoSS change estimation, with our empirical findings affirming their effectiveness. In addition, we introduce Street Quality GPT (SQ-GPT), a model that distills knowledge from the current most powerful but inaccessible (not free) GPT-4, requiring no human efforts. SQ-GPT approaches GPT-4’s performance and is viable for large-scale VQoSS change estimation. In a case study of Nanjin, we showcase the practicality of SQ-GPT and knowledge distillation pipeline. Our work promises to be a valuable asset for future urban studies research.

Deep learning is emerging in many industrial sectors in hand with big data analytics to streamline production. In the biomanufacturing sector, big data infrastructure is lagging comparatively to other industries. A promising approach is to combine Deep Neural Networks (DNN) with prior knowledge in Hybrid Neural Network (HNN) workflows that are less dependent on the quality and quantity of data. This paper reviews published articles over the past 30 years on the topic of HNN applications to bioprocesses. It revealed that HNNs were applied to various bioprocesses, including microbial cultures, animal cells cultures, mixed microbial cultures, and enzyme biocatalysis. HNNs were mainly applied for process analysis, process monitoring, development of software sensors, open- and closed-loop control, batch-to-batch control, model predictive control, intensified design of experiments, quality-by-design, and recently for the development of digital twins. Most previous HNN studies combined shallow Feedforward Neural Networks (FFNNs) with physical laws, such as macroscopic material balance equations, following the semiparametric design principle. Only recently, deep HNNs based on deep FFNNs, Convolution Neural Networks (CNN), Long Short-Term Memory (LSTM) networks and Physics Informed Neural Networks (PINNs) have been reported. The biopharma sector is currently a major driver but applications to biologics quality attributes, new modalities, and downstream processing are significant research gaps.

When analyzing user geospatial information through deep learning methods, it is typically necessary to annotate existing geospatial data. Currently, manual annotation methods are commonly employed, suffering from issues related to low efficiency and accuracy. This design is based on the TensorFlow deep learning framework and first realizes the BiLSTM+CRF+AGG deep learning model. Among the models, AGG is the aggregation layer, which is introduced to solve the problem of solid particle size equilibrium. Secondly, based on the characteristics of original data and professional data, an automatic labeling algorithm is proposed. The algorithm first preprocesses the acquired original data set and professional data set, The most valuable unlabeled data set which can make the training model converge quickly is selected from the original data set as the target data set. Sort the target data set based on preset rules and set annotation parameters for the sorted target data set. Based on the set annotation parameters, the corpus is synthesized and used as the annotation result. Thirdly, based on the active learning strategy, a manual annotation auxiliary scheme is proposed, and an Excel generation module that is convenient for manual annotation correction is designed and developed to further improve the efficiency and quality of annotation through iterative processing. The combination of the BiLSTM+CRF+AGG deep learning model and high-quality annotation can accurately identify non-standard, incomplete, or even incorrect geographical information entities. This annotation method has found successful practical application within the context of the research project and has been granted an invention patent.

Plasma technology shows tremendous potential for revolutionizing oncology research and treatment. Reactive oxygen and nitrogen species, electromagnetic emissions generated through gas plasma jets, have attracted significant attention due to their selective cytotoxicity towards cancer cells. To leverage the full potential of plasma medicine, researchers have explored the use of mathematical models and various subsets of machine learning, such as reinforcement learning, and deep learning. This review emphasizes the significant application of AI algorithms in the adaptive plasma system, paving the way for precision and dynamic cancer treatment. Realizing the full potential of AI in plasma medicine, requires research efforts, data sharing and interdisciplinary collaborations. Unravelling the complex mechanisms, developing real-time diagnostics, and optimizing AI models will be crucial to harness the true power of plasma technology in oncology. The integration of personalized and dynamic plasma therapies, alongside AI and diagnostic sensors, presents a transformative approach to cancer treatment with the potential to improve outcomes globally.

Taiwan is highly susceptible to global warming, experiencing a 1.4°C increase in air temperatures from 1911-2005, which is twice the average for the Northern Hemisphere. This has led to higher rates of respiratory and cardiovascular mortality. Accurately predicting maximum temperatures during the summer season is crucial, but numerical weather models become less accurate and more uncertain beyond five days. To improve forecast reliability, statistical post-processing is needed to address systematic errors. In September 2020, NOAA NCEP implemented the Global Ensemble Forecast System version 12 (GEFSv12) to help manage climate risks. This study developed a Hybrid statistical post-processing method that combines Artificial Neural Networks (ANN) and Quantile mapping (QQ) approaches to predict daily maximum temperatures and extremes in Taiwan during the summer season. The Hybrid technique, utilizing deep learning techniques, was applied to the GEFSv12 reforecast data and evaluated against ERA5 reanalysis. The Hybrid technique was the most effective among the three techniques tested. It had the lowest bias, RMSE, and highest correlation coefficient. It successfully reduced the warm bias and overestimation of Tmax extreme days. This led to improved prediction skills for all forecast lead times. Compared to ANN and QQ, the Hybrid method was more effective in predicting summer daily Tmax and its extremes on an extended-range time scale deterministic and ensemble probabilistic forecasts over Taiwan.

Interactions between proteins and ions are essential for various biological functions like structural stability, metabolism, and signal transport. Given that more than half of all proteins bind to ions, it becomes crucial to identify ion-binding sites. Accurate identification of protein-ion binding sites helps us to understand proteins’ biological functions and plays a significant role in drug discovery. While several computational approaches have been proposed, this remains a challenging problem due to the small size and high versatility of metals and acid radicals. In this study, we propose IonPred, a sequence-based approach that employs ELECTRA (Efficiently Learning an Encoder that Classifies Token Replacements Accurately) to predict ion binding sites using only raw protein sequences. We successfully fine-tuned our pretrained model to predict the binding sites for nine metal ions (Zn2+, Cu2+, Fe2+, Fe3+, Ca2+, Mg2+, Mn2+, Na+, and K+) and four acid radical ion ligands (CO32−, SO42−, PO43−, NO2−). IonPred surpassed six current state-of-the-art tools by over 44.65% and 28.46% respectively in F1 score and MCC when compared on an independent test dataset. Our method is more computationally efficient than existing tools producing prediction results for a hundred sequences for a specific ion in under ten minutes.

Arrhythmia is a cardiac condition characterized by an irregular heart rhythm that hinders the proper circulation of blood, posing a severe risk to individuals’ lives. Globally, arrhythmias are recognized as a significant health concern, accounting for nearly 12 percent of all deaths. As a result, there has been a growing focus on utilizing artificial intelligence for the detection and classification of abnormal heartbeats. In recent years, self-operated heartbeat detection research has gained popularity due to its cost-effectiveness and potential for expediting therapy for individuals at risk of arrhythmias. However, building an efficient automatic heartbeat monitoring approach for arrhythmia identification and classification comes with several significant challenges. These challenges include addressing issues related to data quality, determining the range for heart rate segmentation, managing data imbalance difficulties, handling intra- and inter-patient variations, distinguishing supraventricular irregular heartbeats from regular heartbeats, and ensuring model interpretability. In this study, we propose the Reseek-Arrhythmia model, which leverages deep learning techniques to automatically detect and classify heart arrhythmia diseases. The model combines different convolutional blocks and identity blocks, along with essential components such as convolution layers, batch normalization layers, and activation layers. To train and evaluate the model, we utilized the MIT-BIH and PTB datasets. Remarkably, the proposed model achieves outstanding performance with an accuracy of 99.35% and 93.50% and an acceptable loss of 0.688 and 0.2564, respectively.

Accurate prediction of crop production is essential in effectively managing agricultural countries' food security and economic resilience. This study evaluates the performance of statistical and machine learning-based methods for large-scale crop production forecasting. We predict the quarterly production of 325 crops (including fruits, vegetables, cereals, non-food, and industrial crops) across 83 provinces in the Philippines. Using a comprehensive dataset of 10,949 time series over 13 years, we demonstrate that a global forecasting approach using a state-of-the-art deep learning architecture, the transformer, significantly outperforms traditional local forecasting approaches built on statistical and baseline methods. By leveraging cross-series information, our proposed way is scalable and works well even with time series that are short, sparse, intermittent, or exhibit structural breaks/regime shifts. The results of this study further advance the field of applied forecasting in agricultural production and provide a practical and effective decision-support tool for policymakers that oversee the farm sector on a national scale.

Bone metastasis detection and quantification on bone scintigraphy is challenging and clinical important for treatment and patient’s life quality. To develop a CNN based diagnostic system for automated segmentation on bone metastasis regions is non-trivial, especially for a small dataset. A dataset in house comprising 100 breast cancer patients and 100 prostate cancer patients is utilized for this research. The Double U-Net model is adapted through the integration of background removal, adding negative samples, and transfer learning methods for bone metastasis detection. The performance is investigated via 10-fold cross-validation and computed in pixel-wise scale. The best model we achieved has precision of 63.08%, sensitivity of 70.82%, and F1-score of 66.72%. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.

Brain-computer interfaces (BCI) from electroencephalography (EEG) provide a practical approach to support human-technology interaction. In particular, motor imagery (MI) is a widely-used BCI paradigm that guides the mental trial of motor tasks without physical movement. Here, we present a deep learning methodology, named Kernel-based Regularized EEGNet (KREEGNet), leveled on Centered Kernel Alignment and Gaussian Functional Connectivity, explicitly designed for EEG-based MI classification. The approach proactively tackles the challenge of intra-subject variability brought on by noisy EEG records and the lack of spatial interpretability within end-to-end frameworks applied for MI classification. KREEGNet is a refinement of the widely accepted EEGNet architecture, featuring an additional kernel-based layer for regularized Gaussian functional connectivity estimation based on CKA. The superiority of KREEGNet is evidenced by our experimental results from binary and multi-class MI classification databases, outperforming the baseline EEGNet and other state-of-the-art methods. Further exploration of our model’s interpretability is conducted at individual and group levels, utilizing classification performance measures and pruned functional connectivities. Our approach is a suitable alternative for interpretable end-to-end EEG-BCI based on deep learning.

Deep-Brain Stimulation (DBS) is a a highly effective and safe medical treatment that improves the lives of patients with a wide range of neurological and psychiatric deceases, and has been consolidated as a first-line tool in the treatment of these conditionsin the last two decades. Closed Loop Deep-Brain Stimulation (CLDBS) pushes this tool further by automatically adjusting the stimulation parameters to the brain response in real time. In this context, this paper presents a Low-Noise Amplifier (LNA) and a Neurostimulator circuits fabricated in the low-power/low-voltage 65 nm CMOS process from the TSMC, which were designed targeting implantable applications. To achieve the best trade-off between input-referred noise and power consuption, metaheuristic algorithms were employed to determine and optimizes the dimentions of the LNA devices during the design phase. The measurement results showed that the LNA had a gain of 40.6 dB, a 3 dB bandwidth spanning over three decades from 10 Hz to 8.6 kHz, and a power consumption of 6.19 uW. Simulations results indicated an input-referred noise of 4.86 uVrms for the LNA. The circuit of the Neurostimulator is a programmable Howland Current-Pump, whose measurements showed its ability to generate currents with arbitrary shapes ranging from between 325 uA to +318 uA. The simulations showed a quiescent power consumption of 0.13 W with a zero neurostimulation current. The LNA and the Neurostimulator circuits are supplied with 1.2 V voltage and occupy a microdevice area of 145 um x 311 um and 88 um x 89 um, respectively, making them suitable for implantation in applications involving Closed Loop Deep-Brain Stimulation.

Topic discovery is finding the main idea of large amounts of textual data. It indicates the recurring topics in the documents, allowing an overview of the texts. Current topic discovery models receive the texts, with or without pre-processing of Natural Language Processing. The processing consists of stopwords removal, text cleaning and normalization (lowercase conversion). A topic discovery model that receives texts with or without processing generates general topics since the input data is many uncategorized texts. The general topics do not offer a detailed overview of the input texts, and manual text categorization is a time-consuming and tedious task. Accordingly, it is necessary to integrate an automatic text classification task in the topic discovery process to obtain specific topics with their top words that contain relevant relationships based on belonging to a class. Text classification performs a word analysis that makes up a document to decide what class or category is being identified; then, integrating the text classification before a topic discovery process will provide latent topics depicted by top words with a high coherence in each topic based on the previously obtained classes. Therefore, this paper exposes a approach that integrates text classification into topic discovery from large amounts of English textual data, such as 20-Newsgroup and Reuters corpora. The text classification is accomplished with a Convolutional Neural Network(CNN) incorporating three embedding models based on semantic relationships. The topic discovery over categorized texts is realized with Latent Dirichlet Analysis(LDA), Probabilistic Latent Semantic Analysis(PLSA), and Latent Semantic Analysis(LSA) algorithms. An evaluation process was performed based on the normalized topic coherence metric. The 20-Newsgroup corpus was classified, and twenty topics with ten top words were discovered for each class, obtaining 0.1723 normalized topic coherence when applying LDA, 0.1622 with LSA, and 0.1716 with PLSA. The Reuters corpus was also classified, obtaining 0.1441 normalized topic coherence when applying the LDA algorithm to obtain 20 topics for each class.

Recent advancements in Artificial Intelligence (AI), Deep Learning (DL), and computer vision have revolutionized various industrial processes through image classification and object detection. State-of-the-art Optical Character Recognition (OCR) and Object Detection (OD) technologies, such as YOLO and PaddleOCR, have emerged as powerful solutions for addressing challenges in recognizing textual and non-textual information on printed stickers. However, a well-established framework integrating these cutting-edge technologies for industrial applications still needs to be discovered. In this paper, we propose an innovative framework that combines advanced OCR and OD techniques to automate visual inspection processes in an industrial context. Our primary contribution is a comprehensive framework adept at detecting and recognizing textual and non-textual information on printed stickers within a company, harnessing the latest AI tools and technologies for sticker information recognition. Our experiments reveal an overall macro accuracy of 0.88 for the sticker OCR across three distinct patterns. Furthermore, the proposed system goes beyond traditional Printed Character Recognition (PCR) by extracting supplementary information, such as barcodes and QR codes present in the image, significantly streamlining industrial workflows and minimizing manual labor demands.

The appropriate maintenance of highway roads is critical for the safe operation of road networks and conserves maintenance costs. Multiple methods have been developed to investigate the surface of roads for various types of cracks and potholes, among other damage. Like road surface damage, the condition of expansion joints in concrete pavement is important to avoid unexpected hazardous situations. Thus, in this study, a new system is proposed for autonomous expansion joint monitoring using a vision-based system. The system consists of the following three key parts: (1) a camera-mounted vehicle, (2) indication marks on the expansion joints, and (3) a deep learning-based automatic evaluation algorithm. With paired marks indicating the expansion joints in a concrete pavement, they can be automatically detected. An inspection vehicle is equipped with an action camera that acquires images of the expansion joints in the road. You Only Look Once (YOLO) automatically detects the expansion joints with indication marks, which has a performance accuracy of 95%. The width of the detected expansion joint is calculated using an image processing algorithm. Based on the calculated width, the expansion joint is classified into the following two types: normal and dangerous. The obtained results demonstrate that the proposed system is very efficient in terms of speed and accuracy.

The administration of regional neuraxial analgesia for pain relief during labor is widely recognized as a safe and effective method involving medication delivery into the epidural or subarachnoid space in the lower back. This study proposes an innovative semantic image segmentation methodology emphasizing enhanced interpretability using convolutional Random Fourier Features and layer-wise weighted class-activation maps tailored explicitly for foot segmentation in regional analgesia monitoring. Namely, our contribution is twofold: i) a novel Random Fourier Features layer is introduced to deal with image data to enhance three well-known architectures (FCN, UNet, and ResUNet); ii) three novel quantitive measures are presented to evaluate the interpretability of a given deep learning model devoted to segmentation tasks. Our approach is rigorously evaluated on a demanding dataset of foot thermal images from pregnant women who received epidural anesthesia. Its small size and considerable variability characterize the dataset. Our validation results demonstrate that the proposed methodology not only achieves competitive foot segmentation performance but also significantly enhances the explainability of the process, rendering it well-suited for applications such as epidural insertion during labor.

The current neural networks for tomato leaf disease recognition have problems such as large model parameters, long training time, and low model accuracy. To solve these problems, a lightweight convolutional neural network LBFNet is proposed in this paper.First, a lightweight convolutional neural network LBFNet is established as the base model. Secondly, a three-channel attention mechanism module is introduced to learn the disease features in tomato leaf disease images and reduce the interference of redundant features. Finally, a cascade module is introduced to increase the depth of the model, solve the gradient descent problem, and reduce the loss caused by increasing the depth of the model. The quantized pruning technique is also used to further compress the model parameters and optimize the model performance. The results show that the LBFNet model achieves 99.06% accuracy on the LBFtomato dataset, with a training time of 996s and a single classification accuracy of over 94%. Further training using the saved weight file after quantized pruning makes the model accuracy reach 97.66%. Compared with the base model, the model accuracy was improved by 28%, and the model parameters were reduced by 96.7% compared with the traditional Resnet50. It was found that LBFNet can quickly and accurately identify tomato leaf diseases in complex environments, providing effective assistance to agricultural producers.

Global models have been developed to tackle the challenge of forecasting sets of series that are related or share similarities, but not for heterogeneous datasets. Various methods of partitioning by relatedness have been introduced to enhance the similarities of the set, resulting in improved forecasting accuracy but often at the cost of a reduced sample size, which could be harmful. To shed light on how the relatedness between series impacts the effectiveness of global models in real-world demand forecasting problems we perform an extensive empirical study using the M5 competition dataset. We examined cross-learning scenarios driven by the product hierarchy commonly employed in retail planning, which allow global models to capture interdependencies across products and regions more effectively. Our findings show that global models outperform state-of-the-art local benchmarks by a considerable margin, indicating that they are not inherently more limited than local models and can handle unrelated time series data effectively. The accuracy of data partitioning approaches increases, as the size of the data pools and the models' complexity decrease. However, there is a trade-off between data availability and data relatedness. Smaller data pools lead to increased similarity among time series, making it easier to capture cross-product and cross-region dependencies, but this comes at the cost of a reduced sample, which may not be beneficial. Finally, it's worth noting that the successful implementation of global models for heterogeneous datasets can significantly impact forecasting practice.

The keyless systems have replaced the old fashion methods of inserting physical keys in the keyhole to, i.e., unlock the door, because they are inconvenient and easy to be exploited by the threat actors. Keyless systems use the technology of radio frequency (RF) as an interface to transmit signals from the key fob to the vehicle. However, Keyless systems are susceptible to being compromised by a thread actor who intercepts the transmitted signal and performs a reply attack. In this paper, we propose a transfer learning-based model to identify the replay attacks launched against remote keyless controlled vehicles. Specifically, the system makes use of a pre-trained ResNet50 deep neural network to predict the wireless remote signals used to lock or unlock doors of a remote-controlled vehicle system remotely. The signals are finally classified into three classes: real signal, fake signal high gain, and fake signal low gain. We have trained our model with 100 epochs (3800 iterations) on a KeFRA 2022 dataset, a modern dataset. The model has recorded a final validation accuracy of 99.71% and a final validation loss of 0.29% at a low inferencing time of 50 ms for the model-based SGD solver. The experimental evaluation revealed the supremacy of the proposed model.

The use of digital twins for the development of Autonomous Maritime Surface Vessels (AMSVs) has enormous potential to resolve the increasing need for water-based navigation and safety at the seas. Aiming at the problem of lack of broad and integrated digital twin implementations with live data along with the absence of a digital twin-driven framework for AMSV design and development, an application framework for the development of a fully autonomous vessel using an integrated digital twin in a 3D simulation environment has been presented. Our framework has four layers to ensure that the simulation and the real-world boat as well as the environment are as close as possible. Åboat, an experimental research platform for maritime automation and autonomous surface ship applications, equipped with two trolling electric motors, cameras, LiDARs, IMU and GPS has been used as the case study to provide a proof of concept. Åboat and its sensors, alongwith the environment have been replicated in a 3D simulation environment. Using the proposed application framework, we develop obstacle detection and path planning systems based on machine learning which leverage live data from a 3D simulation environment to mirror the complex dynamics of the real world.

Lesion studies are crucial in establishing brain-behavior relationships, and accurately segmenting the lesion represents the first step in achieving this. Manual lesion segmentation is the gold standard for chronic strokes. However, it is labor-intensive, subject to bias, and limits sample size. Therefore, our objective is to develop an automatic segmentation algorithm for chronic stroke lesions on T1-weighted MR images. Methods: To train our model, we utilized an open-source dataset: ATLAS v2.0 (Anatomical Tracings of Lesions After Stroke). We partitioned the dataset of 655 T1 images with manual segmentation labels into five subsets and performed a 5-fold cross-validation to avoid overfitting of the model. We used a deep neural network (DNN) architecture for model training. Results: To evaluate the model performance, we used three metrics that pertain to diverse aspects of volumetric segmentation including shape, location, and size. The Dice similarity coefficient (DSC) compares the spatial overlap between manual and machine segmentation. The average DSC was 0.65 (0.61- 0.67; 95% bootstrapped CI). Average symmetric surface distance (ASSD) measures contour distances between the two segmentations. ASSD between manual and automatic segmentation was 12mm. Finally, we compared the total lesion volumes and the Pearson correlation coefficient (ρ) between the manual and automatically segmented lesion volumes, which was 0.97(p-value < 0.001). Conclusions: We present the first automated segmentation model trained on a large multicentric dataset. This model will enable automated on-demand processing of MRI scans and quantitative chronic stroke lesion assessment.

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important for accurately identifying breast cancer from unregistered multi-view mammograms. This motivates us to leverage the architecture of Vision Transformers to capture long-range relationships of multiple mammograms from the same patient. For this purpose, we employ local Transformer blocks to separately learn patch relationships within a specific view (CC/MLO) of one side (right/left) of mammogram. The outputs from different views and sides are concatenated and fed into global Transformer blocks, to jointly learn patch relationships between two different views of the left and right breasts. To evaluate the proposed model, we retrospectively assembled a dataset involving 949 sets of CC and MLO view mammograms, which include 470 malignant cases and 479 normal or benign cases. We trained and evaluated the model using a five-fold cross-validation method. Without any arduous preprocessing steps (e.g., optimal window cropping, chest wall or pectoral muscle removal, two-view image registration, etc.), our two-view Transformer-based model achieves lesion classification accuracy of 77.0% and area under ROC curve (AUC = 0.814), outperforming state-of-the-art multi-view CNNs by 3.1% and 3%, respectively. Meanwhile, the new two-view model improves mammographic case classification accuracies of two single-view models by 7.4% (CC) and 4.5% (MLO), respectively. The promising results unveil the great potential of using Transformers to develop high-performing computer-aided diagnosis (CADx) schemes of mammography.

Melanoma is considered to be the most aggressive form of skin cancer. Due to the similar shape of malignant and benign cancerous lesions, doctors spend considerably more time when diagnosing these findings. At present, the evaluation of malignancy is performed primarily by invasive histological examination of the suspicious lesion. Developing an accurate classifier for early and efficient detection can minimize and monitor the harmful effects of skin cancer and increase patient survival rates. This paper proposes a multi-class classification task using the CoAtNet architecture, a hybrid model that combines the depthwise convolution matrix operation of traditional convolutional neural networks with the strengths of Transformer models and self-attention mechanics to achieve better generalization and capacity. The proposed multi-class classifier achieves an overall precision of 0.901, recall 0.895, and AP 0.923, indicating high performance compared to other state-of-the-art networks.

The dynamic effects observed in collisions represent a specific area of high-energy interaction located at the boundary of mechanics, hydrodynamics, shock wave physics, and alternating high-pressure regions. The paper shows that in the volume of a solid metal body, as a result of dynamic alloying by a high-speed stream of powder particles in the super-deep penetration mode (SDP), fibre structures of altering material arise, forming the framework of the composite material. The stream of powder particles in the metal obstacle following the path of least resistance and the impact of shock waves on particles results in a volumetric framework from the products of interaction between the injected and matrix materials. When using SDP, defective structural elements (channelled) - germs of reinforcing fibres arise. At the subsequent heat treatment, there is an intensive diffusion. The growth process of reinforcing fibres shifts to higher temperatures (as compared to the standard mode), leading to an increase in the bending strength of the fibre material up to 13 times for high-speed tool W6Mo5Cr4V2 steel. As a result of the completion of the growth of reinforcing fibres in the volume of the W6Mo5Cr4V2 steel, the material's bending strength in 1.2 times is realised. Simultaneously, it provides an increase of wear resistance 1.7-1.8 times.

This work aims to develop an autonomous system for the unmanned aerial vehicle (UAV) to land on a moving platform such as the automobile or marine vessels, providing a promising solution for a long-endurance flight operation, a large mission coverage range, and a convenient recharging ground station. Different from most state-of-the-art UAV landing frameworks which rely on UAV’s onboard computers and sensors, the proposed system fully depends on the computation unit situated on the ground vehicle/marine vessel to serve as a landing guidance system. Such novel configuration can therefore lighten the burden of the UAV and computation power on the ground vehicle/marine vessel could be enhanced. In particular, we exploit a sensor fusion-based algorithm for the guidance system to perform UAV localization, whilst a control method based upon trajectory optimization is integrated. Indoor and outdoor experiments are conducted and the result shows that a precise autonomous landing on a 43 X 43 cm platform could be performed.

As a relatively high percentage of adenoma polyps are missed, a computer-aided diagnosis (CAD) tool based on deep learning can aid the endoscopist in diagnosing colorectal polyps or colorectal cancer in order to decrease polyps missing rate and prevent colorectal cancer mortality. Convolutional Neural Network (CNN) is a deep learning method and has achieved better results in detecting and segmenting specific objects in images in the last decade than conventional models such as regression, support vector machines or artificial neural networks. In recent years, based on the studies in medical imaging criteria, CNN models have acquired promising results in detecting masses and lesions in various body organs, including colorectal polyps. In this review, the structure and architecture of CNN models and how colonoscopy images are processed as input and converted to the output are explained in detail. In most primary studies conducted in the colorectal polyp detection and classification field, the CNN model has been regarded as a black box since the calculations performed at different layers in the model training process have not been clarified precisely. Furthermore, I discuss the differences between the CNN and conventional models, inspect how to train the CNN model for diagnosing colorectal polyps or cancer, and evaluate model performance after the training process.

While the foundations of climate science and ethics are well established, fine-grained climate predictions, as well as policy-decisions, are beset with uncertainties. This chapter maps climate uncertainties and classifies them as to their ground, extent and location. A typology of uncertainty is presented, centered along the axes of scientific and moral uncertainty. This typology is illustrated with paradigmatic examples of uncertainty in climate science, climate ethics and climate economics. Subsequently, the chapter discusses the IPCC’s preferred way of representing uncertainties and evaluates its strengths and weaknesses from a risk management perspective. Three general strategies for decision-makers to cope with climate uncertainty are outlined, the usefulness of which largely depends on whether or not decision-makers find themselves in a context of deep uncertainty. The chapter concludes by offering two recommendations to ease the work of policymakers, faced with the various uncertainties engrained in climate discourse.

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines, using machine learning, deep learning and neural networks. AI enables machines to learn from experience and perform human-like tasks. The field of AI research has been developing fast over the past five to ten years, due to the rise of ‘big data’ and increasing computing power. In the medical area, AI can be used to improve diagnosis, prognosis, treatment, surgery, drug discovery, or for other applications. Therefore, both academia and industry are investing a lot in AI. This review investigates the biomedical literature (in the PubMed and Embase databases) by looking at bibliographical data, observing trends over time and occurrences of keywords. Some observations are made: AI has been growing exponentially over the past few years; it is used mostly for diagnosis; COVID-19 is already in the top-5 of diseases studied using AI; the United States, China, United Kingdom, South Korea and Canada are publishing the most articles in AI research; MIT is the world’s leading university in AI research; and convolutional neural networks are by far the most popular deep learning algorithms at this moment. These trends could be studied in more detail, by studying more literature databases or by including patent databases. More advanced analyses could be used to predict in which direction AI will develop over the coming years. The expectation is that AI will keep on growing, in spite of stricter privacy laws, more need for standardization, bias in the data, and the need for building trust.

Although automated Acute Lymphoblastic Leukemia (ALL) detection is essential, it is challenging due to the morphological correlation between malignant and normal cells. The traditional ALL classification strategy is arduous, time-consuming, often suffers inter-observer variations, and necessitates experienced pathologists. This article has automated the ALL detection task, employing deep Convolutional Neural Networks (CNNs). We explore the weighted ensemble of deep CNNs to recommend a better ALL cell classifier. The weights are estimated from ensemble candidates' corresponding metrics, such as accuracy, F1-score, AUC, and kappa values. Various data augmentations and pre-processing are incorporated for achieving a better generalization of the network. We train and evaluate the proposed model utilizing the publicly available C-NMC-2019 ALL dataset. Our proposed weighted ensemble model has outputted a weighted F1-score of 88.6%, a balanced accuracy of 86.2%, and an AUC of 0.941 in the preliminary test set. The qualitative results displaying the gradient class activation maps confirm that the introduced model has a concentrated learned region. In contrast, the ensemble candidate models, such as Xception, VGG-16, DenseNet-121, MobileNet, and InceptionResNet-V2, separately produce coarse and scatter learned areas for most example cases. Since the proposed ensemble yields a better result for the aimed task, it can experiment in other domains of medical diagnostic applications.

Intertidal seagrass plays a vital role in estimating the overall health and dynamics of coastal environments due to its interaction with tidal changes. However, most seagrass habitats around the globe have been in steady decline due to human impacts, disturbing the already delicate balance in environmental conditions that sustain seagrass. Miniaturization of multi-spectral sensors has facilitated very high resolution mapping of seagrass meadows, which significantly improve the potential for ecologists to monitor changes. In this study, two analytical approaches used for classifying intertidal seagrass habitats are compared: Object-based Image Analysis (OBIA) and Fully Convolutional Neural Networks (FCNNs). Both methods produce pixel-wise classifications in order to create segmented maps, however FCNNs are an emerging set of algorithms within Deep Learning with sparse application towards seagrass mapping. Conversely, OBIA has been a prominent solution within this field, with many studies leveraging in-situ data and multiscale segmentation to create habitat maps. This work demonstrates the utility of FCNNs in a semi-supervised setting to map seagrass and other coastal features from an optical drone survey conducted at Budle Bay, Northumberland, England. Semi-supervision is also an emerging field within Deep Learning that has practical benefits of achieving state of the art results using only subsets of labelled data. This is especially beneficial for remote sensing applications where in-situ data is an expensive commodity. For our results, we show that FCNNs have comparable performance with standard OBIA method used by ecologists, while also noting an increase in performance for mapping ecological features that are sparsely labelled across the study site.

Annotating training data is a time consuming and labor intensive process in deep learning, especially for images with many objects present. In this paper, we propose a method to allow deep networks to be trained on data with reduced numbers of annotations (per image) in heatmap regression tasks (e.g. object detection and counting), by applying an asymmetric loss function. In a real scenario, this reduction of annotations can be imposed by the researchers (e.g. ask the annotators to label only 50% of what they see in each image), or can potentially counteract unintentionally missing labels from the annotators. To demonstrate the effectiveness of our method, we conduct experiments in two domains, crowd counting and wheat spikelet detection, using different deep network architecture. We drop various percentages of instance annotations per image in training. Results show that an asymmetric loss function is effective across different models and datasets, even in very extreme cases with limited annotations provided (e.g. 90% of the original annotations reduced). Whilst tuning of the key parameters are required, we find that setting conservative parameter values can help more realistic situations, where only small amounts of data have been missed by annotators.

The small satellite market continues to grow year after year. A compound annual growth rate of 17% is estimated during the period between 2020 and 2025. Low-cost satellites can send a vast amount of images to be post-processed at the ground to improve the quality and extract detailed information. In this domain lies the resolution enhancement task, where a low-resolution image is converted to a higher resolution automatically. Deep learning approaches to Super-Resolution (SR) reached the state-of-the-art in multiple benchmarks; however, most of them were studied in a single-frame fashion. With satellite imagery, multi-frame images can be obtained at different conditions giving the possibility to add more information per image and improve the final analysis. In this context, we developed and applied to the PROBA-V dataset of multi-frame satellite images a model that recently topped the European Space Agency’s Multi-frame Super Resolution (MFSR) competition. The model is based on proven methods that worked on 2D images tweaked to work on 3D: the Wide Activation Super Resolution (WDSR) family. We show that with a simple 3D CNN residual architecture with WDSR blocks and a frame permutation technique as data augmentation better scores can be achieved than with more complex models. Moreover, the model requires few hardware resources, both for training and evaluation, so it can be applied directly from a personal laptop.

In software development, developers received bug reports that describe the software bug. Developers find the cause of bug through reviewing the code and reproducing the abnormal behavior that can be considered as tedious and time-consuming processes. The developers need an automated system that incorporates large domain knowledge and recommends a solution for those bugs to ease on developers rather than spending more manual efforts to fixing the bugs or waiting on Q&A websites for other users to reply to them. Stack Overflow is a popular question-answer site that is focusing on programming issues, thus we can benefit knowledge available in this rich platform. This paper, presents a survey covering the methods in the field of mining software repositories. We propose an architecture to build a recommender System using the learning to rank approach. Deep learning is used to construct a model that solve the problem of learning to rank using stack overflow data. Text mining techniques were invested to extract, evaluate and recommend the answers that have the best relevance with the solution of this bug report.

In this article, we analyse the computer aid screening method of COVID19 using Xray and CT scan images. The main objective is to set an analytical closure about the computer aid screening of COVID19 among the X-ray image and CT scan image. The computer aid screening method includes deep feature extraction, transfer learning and traditional machine learning image classification approach. The deep feature extraction and transfer learning method considered 13 pre-trained CNN model. The machine learning approach includes three sets of features and three classifiers. The pre-trained CNN models are alexnet, googlenet, vgg16, vgg19, densenet201, resnet18, resnet50, resnet101, inceptionv3, inceptionresnetv2, xception, mobilenetv2 and shufflenet. The features and classifiers in machine learning approaches are GLCM, LBP, HOG and KNN, SVM, Naive bay’s respectively. In addition, we also analyse the different paradigms of classifiers. In total, the comparative analysis is carried out in 65 classification models, i.e. 13 in deep feature extraction, 13 in transfer learning and 39 in machine learning approaches. Finally, all the classification models perform better in X-ray image set compare to CT scan image set.

Hydrogen gas is seeping from the sedimentary basin of São Franciso, Brazil. The seepages of H₂ are accompanied by helium whose isotopes reveal a strong crustal signature. Geophysical data indicates that this intra-cratonic basin is characterized by i) a relatively high geothermal gradient, ii) deep faults delineating a horst and graben structure and affecting the entire sedimentary sequence, iii) an archean to paleoproterozoïc basements enriched in radiogenic elements and displaying mafic and ultramafic units, and iv) a possible karstic reservoir located 400 m below the surface. The high geothermal gradient could be due to a thin lithosphere enriched in radiogenic elements, which can also contribute to a massive radiolysis process of water at depth, releasing an important amount of H₂. Alternatively, ultramafic rocks that may have generated H₂ during their serpentinization are also documented in the basement. The seismic profiles show that the faults seen at the surface are deeply rooted in the basement, and can drain deep fluids to shallow depths in a short time scale. The carbonate reservoirs within the Bambuí group which forms the main part of the sedimentary layers are crossed by the fault system and represent good candidates for temporary H₂ accumulation zones. The formation by chemical dissolution of sinkholes located at 400 m depth might explain the presence of sub-circular depressions seen at the surface. These sinkholes might control the migration of gas from temporary storage reservoirs in the upper layer of the Bambuí formation to the surface. The very high fluxes of H₂ escaping out of these structures which have been recently documented are, however, in disagreement with the newly developed H₂ production model in the Precambrian continental crust. They either question the validity of these models or the measurement methodology.

This article presents an automated vision-based algorithm for the die-scale inspection of wafer images captured using scanning acoustic tomography (SAT). This algorithm can find defective and abnormal die-scale patterns, and produce a wafer map to visualize the distribution of defects and anomalies on the wafer. The main procedures include standard template extraction, die detection through template matching, pattern candidate prediction through clustering, and pattern classification through deep learning. To conduct the template matching, we first introduce a two-step method to obtain a standard template from the original SAT image. Subsequently, a majority of the die patterns are detected through template matching. Thereafter, the columns and rows arranged from the detected dies are predicted using a clustering method; thus, an initial wafer map is produced. This map is composed of detected die patterns and predicted pattern candidates. In the final phase of the proposed algorithm, we implement a deep learning-based model to determine defective and abnormal patterns in the wafer map. The experimental results verified the effectiveness and efficiency of our proposed algorithm. In conclusion, the proposed method performs well in identifying defective and abnormal die patterns, and produces a wafer map that presents important information for solving wafer fabrication issues.

With the development of information technology and the popularization of mobile devices, collecting various types of customer data such as purchase history or behavior patterns became possible. As the customer data being accumulated, there is a growing demand for personalized recommendation services that provide customized services to customers. Currently, global e-commerce companies offer personalized recommendation services to gain a sustainable competitive advantage. However, previous research on recommendation systems has consistently raised the issue that the accuracy of recommendation algorithms does not necessarily lead to the satisfaction of recommended service users. It also claims that customers are highly satisfied when the recommendation system recommends diverse items to them. In this study, we want to identify the factors that determine customer satisfaction when using the recommendation system which provides personalized services. To this end, we developed a recommendation system based on Deep Neural Networks (DNN) and measured the accuracy of recommendation service, the diversity of recommended items and customer satisfaction with the recommendation service. The experimental results of is the study showed that both recommendation system accuracy and diversity would have a positive effect on customer satisfaction. These results can further improve customer satisfaction with the recommendation system and promote the sustainable development of e-commerce.

Deep behavioral covariates (DBCs) introduced in this perspective form a new class of covariates that have the potential to enhance the performance of predictive models and improve analytics in clinical decision support applications. DBCs can measure how engaged a patient tends to be and how he or she tends to respond to events, and they may be highly predictive of the patient’s outcomes for a planned treatment. DBCs may potentially serve as a standard to measure patient engagement and activation and may form highly efficient mechanisms for improving patient outcomes.

Alzheimer's is a disease for which there is no cure. Diagnosing Alzheimer's Disease (AD) early facilitates family planning and cost control. The purpose of this study is to predict the presence of AD using socio-demographic, clinical, and Magnetic Resonance Imaging (MRI) data. Early detection of AD enables family planning and may reduce costs by delaying long-term care. Accurate, non-imagery methods also reduce patient costs. The Open Access Series of Imaging Studies (OASIS-1) cross-sectional MRI data were analyzed. A gradient boosted machine (GBM) predicted the presence of AD as a function of gender, age, education, socioeconomic status (SES), and Mini-Mental State Exam (MMSE). A Residual Network with 50 layers (ResNet-50) predicted CDR presence and severity from MRI's (multi-class classification). The GBM achieved a mean 91.3% prediction accuracy (10-fold stratified cross validation) for dichotomous CDR using socio-demographic and MMSE variables. MMSE was the most important feature. ResNet-50 using image generation techniques based on an 80% training set resulted in 98.99% three class prediction accuracy on 4,139 images (20% validation set) at Epoch 133 and nearly perfect multi-class predication accuracy on the training set (99.34%). Machine Learning methods classify AD with high accuracy. GBM models may help provide initial detection based on non-imagery analysis, while ResNet-50 network models might help identify AD patients automatically prior to provider review.

The basal ganglia (BG) are a central component of the brain, crucial to the initiation, execution and learning of adaptive actions. The BG are the major site of the action of dopamine. An important aspect of the BG architecture is the existence of two paths, direct and indirect, having different projection targets and dopamine receptor expression. To understand the BG, dopamine, and related disorders, it is imperative to understand the two paths. The standard account used in neuroscience research for decades posits that the role of the direct path is to support movements, while that of the indirect path is to suppress unselected or completed movements. This account is contradicted by converging evidence. Here, we explain why the arguments supporting the standard account are flawed, and present a new account, in which the role of the indirect path is completely opposite: to support automated execution. During acute events, the direct path allows coarse responses. These are refined by competition, and the resulting focused response is executed and learned by the indirect path, assisted by cholinergic interneurons and the subthalamic nucleus (STN). The new account allows a novel understanding of the symptoms of Parkinson's disease, in particular tremor and rigidity, and of its treatment by STN deep brain stimulation.

The time required to reach a correct diagnosis is one of the most important problems for rare disease (RD) patients. Diagnostic delay can be intolerably long, to the point that it is usually described as a “diagnostic odyssey” and, sometimes, a diagnosis might never occur. The International Rare Disease Research Consortium proposed, as ultimate goal for 2017-2027, to enable all people with a suspected RD to be diagnosed within one year if the disorder is known, and to enter a globally coordinated diagnostic and research pipeline for the unsolved cases. In-depth analysis of the genotype through next generation sequencing, together with a standardized in-depth phenotype description and sophisticated high-throughput approaches, have been applied as diagnostic tools to increase the chance of a timely and accurate diagnosis. This approach is very fruitful as, according to the Orphanet database, from 2010 to March 2017 more than 600 new RDs have been described and about 3600 genes linked to RDs have been identified. However, combination of -omics and phenotype data and international sharing of this information raise ethical concerns. Values to be assessed include not only patient autonomy but also family implications, beneficence, non-maleficence, justice, solidarity and reciprocity, which must be respected and promoted and, at the same time, balanced among each other. In this work we suggest that, to maximise patients involvement in the search for a diagnosis and identification of new causative genes, undiagnosed patients should have the possibility to: 1) actively participate in the description of their phenotype; 2) choose the level of visibility of their profile in matchmaking databases; 3) express their preferences regarding return of new findings, in particular which level of Variant of Unknown Significance (VUS) significance should be considered relevant to them. The quality of the relation between individual patients and physicians, and between the patient community and the scientific community is critically important for making the best use of available data and combining efforts in the search for matches with similar cases worldwide that will help to solve unsolved cases. The contribution of patients to collecting and coding data comprehensively is critical for efficient use of data downstream of data collection.

Failure characteristics induced by unloading disturbance and the corresponding mechanical mechanism of the coal seam floor are important theoretical bases for water-bursting prevention from the floor of the coal seam and rock burst alarm in deep mining. However, the existing two-dimensional ground-pressure-control theory based on shallow mining cannot sufficiently guide deep-mining practices. In this study, the redistribution of mining-induced stress field in rocks surrounding the longwall face and mechanical behaviors of strata in deep mining are investigated through a combination of numerical simulation, physical simulation, and field measurement. Results demonstrate that mining-induced stress fields in the floor of the longwall face differ in space and time. Vertical stress unloading from top to bottom of the floor and horizontal stress unloading are relatively low. A concentration zone of high horizontal stress exists at stope boundaries. The critical yield load of rock stratum in the floor is determined through thin plate yield theory. Under the combined effect of concentrated high horizontal and vertical resilience stresses, strata in the floor fracture from seam to seam if the load increases to the minimum critical buckling value. Fractured strata slide along the fracture surface, which leads to floor heave. The stope floor shows evident time-delay progressive failure characteristics. The stress shell in the stope floor in deep mining is found to be a sensitive mechanical parameter that produces three-dimensional ground-pressure behavior in the floor. This ground-pressure behavior in the stope floor is controlled by the existence of the corresponding stress shell and effects induced by its space–time evolution. This study provides theoretical basis for the dynamic control of a hazard-inducing environment in engineering and minimizing or altering disaster-occurrence conditions during the construction engineering of the coal seam floor.

Deep learning has recently attracted much attention due to its excellent performance in processing audio, image, and video data. However, few studies are devoted to the field of automatic modulation classification (AMC). It is one of the most well-known research topics in communication signal recognition, which remains challenging for traditional methods due to the complex disturbance from other sources. This paper proposes a heterogeneous deep model fusion (HDMF) method to solve the problem in a unified framework. The contributions include: 1) The convolutional neural network (CNN) and long short-term memory (LSTM) are combined by two different ways without prior knowledge involved; 2) A large database, including eleven types of single-carrier modulation signals with various noises as well as a fading channel, is collected with various signal-to-noise ratios (SNRs) based on a real geographical environment; and 3) Experimental results demonstrate that HDMF is super capable of copping with the AMC problem, and achieves much better performance when compared with the independent network. The source code and the database will be publically available.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

In modern and dynamic electricity market, ensuring reliable, sustainable and efficient electricity distribution are pillars of primary importance for grid operation. The high penetration of renewable energy sources and the formation of competitive prices for utility, play a critical role in the wider economic development. Electricity load and price forecasting has been a key focus of researchers in the last decade due to the substantial economic implications for both producers, aggregators and end consumers. Many forecasting techniques and methods have emerged during this period. This paper conducts a extensive and analytical review of the prevailing load and electricity price forecasting methods in the context of the modern wholesale electricity market. The study is separated into three main sections. First, the first section delves into the workings of the electricity market, providing a detailed analysis of the three markets that have evolved, their functions and the key factors influencing overall market dynamics. The second section offers a comprehensive review of the existing literature focusing on load forecasting, highlighting various methodologies, models and their applications in load demand forecasting. This section emphasizes the advances that have been made in all categories of forecasting models and their practical application in different market scenarios. The third section focuses on electricity price forecasting methods, summarizing important research papers investigating various modeling approaches to price forecasting. By examining both traditional and cutting-edge forecasting methods, this review identifies key trends, challenges, and future directions in the field. Overall, this paper provides an in-depth analysis leading to the understanding of the state-of-the-art models in load and price forecasting, being an important resource for researchers and professionals in the energy industry.

General Theory of Information (GTI) offers a groundbreaking framework for designing "mindful machines" that bridge the divide between biological intelligence and digital automation. GTI reimagines traditional computing by introducing cognitive, autopoietic (self-regulating) capabilities in digital systems, enabling them to perceive, adapt, and respond autonomously to changing conditions. Unlike conventional AI and AGI models that operate within predefined algorithmic constraints, GTI-based systems go beyond by incorporating self-awareness and a resilient digital "self," capable of storing interaction histories and learning from them. This paper explores GTI’s practical applications in systems requiring resilience, cognition, and ethical safeguards. In video streaming and medical assistance, GTI-based digital genomes enable systems to function independently, actively self-correct, and conform to policy-driven ethical standards. These mindful machines embody unique traits rarely achieved with traditional AI: robust resilience through self-corrective mechanisms, adaptive learning from accumulated experiences, and alignment with ethical principles that govern system behavior. In demonstrating how GTI can cultivate resilience, autonomy, and ethical decision-making, this paper reveals GTI’s potential to empower digital automata with human-like adaptability and values. As such, GTI emerges as a bridge to a new generation of digital systems designed not merely to execute but to understand, adapt, and ethically engage within complex real-world environments.

Despite the increasing number of placenta accreta spectrum (PAS) cases in recent years, its im-pact on neonatal outcomes and respiratory morbidity has not yet been extensively studied. In this context, it is crucial to understand the underlying mechanisms of neonatal complications. Moreover, no study has yet demonstrated the effectiveness of antenatal corticosteroid therapy (CT) for prevention of the respiratory distress syndrome (RDS) in newborns of mothers with PAS at the molecular level. In this regard, miRNA profiling was performed on 160 blood plasma sam-ples from preterm infants (gestational age 33–36 weeks) and their mothers diagnosed with or without PAS. The samples with PAS were categorized into groups: without antenatal RDS prophylaxis, and with CT admin-istered either 2–7 days, 7–14 days, or more than 14 days before delivery. These groups were compared to a control group without PAS in the absence of antenatal CT. Deep sequencing was conducted using the NEB-Next® Multiplex Small RNA Library Prep Set for Illumina® on the NextSeq 500/550 platform, followed by validation by quantitative real-time PCR. A significant increase in hsa-miR-199a-3p and hsa-miR-382-5p levels was observed in the blood plasma of newborns with PAS (placenta accreta and increta) compared to the control group. In maternal blood, hsa-miR-199a-3p levels were markedly higher than hsa-miR-382-5p. The timing of antenatal CT significantly influenced the levels of hsa-miR-199a-3p and hsa-miR-382-5p in neonatal plasma from mothers with placenta accreta or increta. A clear trend toward normalization was observed when CT was administered within 14 days before delivery, particularly in the seven days before delivery, but not beyond 14 days. Among newborns with PAS, higher levels of hsa-miR-382-5p were significantly associated with increased Neomod scale severity scores of 2, 4, and 5 compared to a score of 0. Additional-ly, a direct correlation was found between hsa-miR-382-5p level in neonatal plasma and hsa-miR-199a-3p level in the same sample (r = 0.49; p = 0.0001), oxygen requirements in the NICU (r = 0.41; p = 0.0016), duration of NICU stay (r = 0.31; p = 0.019), and the severity of the newborn’s condition based on the NEOMOD scale (r = 0.36; p = 0.0051). Logistic regression mod-els based on maternal plasma levels of hsa-miR-199a-3p and hsa-miR-382-5p predicted the need for cardiotonic therapy, invasive mechanical ventilation, or high-frequency oscillatory ventila-tion in newborns during the early neonatal period, with a sensitivity of 95-100%. It was con-cluded that elevated circulating levels of miRNAs, hsa-miR-199a-3p and hsa-miR-382-5p, in ma-ternal and fetal blood are crucial in the development of respiratory and cardiac complications in newborns from pregnancies affected by PAS. These miRNAs regulate surfactant synthesis in al-veolar cells, fetal organogenesis via IGF-1, the formation of proper lung tissue architecture, and vascular tone.

This paper presents a comprehensive review of the You Only Look Once (YOLO) framework, a transformative one-stage object detection algorithm renowned for its remarkable balance between speed and accuracy. Since its inception, YOLO has evolved significantly, with versions spanning from YOLOv1 to the most recent YOLOv11, each introducing pivotal innovations in feature extraction, bounding box prediction, and optimization techniques. These advancements, particularly in the backbone, neck, and head components, have positioned YOLO as a leading solution for real-time object detection across a variety of domains. In this review, we explore YOLO's diverse applications, including its critical role in medical imaging for COVID-19 detection, breast cancer identification, and tumor localization, where it has significantly enhanced diagnostic efficiency. YOLO's robust performance in autonomous vehicles is also highlighted, as it excels in challenging conditions like fog, rain, and low-light environments, thereby contributing to improved road safety and autonomous driving systems. In the agricultural sector, YOLO has transformed precision farming by enabling early detection of pests, diseases, and crop health issues, promoting more sustainable farming practices. Additionally, we provide an in-depth performance analysis of YOLO models—such as YOLOv9, YOLO-NAS, YOLOv10, and YOLOv11—across multiple benchmark datasets. This analysis compares their suitability for a range of applications, from lightweight embedded systems to high-resolution, complex object detection tasks. The paper also addresses YOLO's challenges, such as occlusion, small object detection, and dataset biases, while discussing recent advancements that aim to mitigate these limitations. Moreover, we examine the ethical implications of YOLO's deployment, particularly in surveillance and monitoring applications, raising concerns about privacy, algorithmic biases, and the potential to perpetuate societal inequities. These ethical considerations are critical in domains like law enforcement, where biased object detection models can have serious repercussions. Through this detailed review of YOLO's technical advancements, applications, performance, and ethical challenges, this paper serves as a valuable resource for researchers, developers, and policymakers looking to understand YOLO’s current capabilities and future directions in the evolving field of object detection.

Welding spot defect detection using deep learning methods provides an effective way of body-in-white quality monitoring. Based on the existing Faster R-CNN model, this paper proposed an improved faster R-CNN model for resistance welding spot surface defect inspection to improve inspection efficiency and accuracy. The model contains the following improvements. Firstly, the improved algorithm uses anchor box with higher confidence output by the RPN network to locate welding spots. When a defect is detected and the detection system is in a suspended state, the Fast R-CNN network is used to confirm the defect category and details. Secondly, a new pruning model is proposed to replace the entire backbone neural network, which unnecessary convolutional layers and connection layers are deleted, and some parameters of each hidden layer are further reduced. On the premise of ensuring detection accuracy, the parameter quantity is extremely reduced, and the speed is improved. Experiments show that the model proposed in this paper took about 15ms for one single image test, and both the detection accuracy and recall rate reached over 90% according to the test on our dataset. This deep learning model meets the requirements of welding spot defect detection.

Background and Objectives: Acute aortic dissection (AD) is a life-threatening condition and early detection can significantly improve patient outcomes and survival. This study evaluates the clinical benefits of integrating a deep-learning (DL)-based application for automated detection and prioritisation of AD on chest CT angiographies (CTAs), focusing on the reduction of scan-to-assessment (STAT) and interpretation times (IT). Materials and Methods: This retrospective Multi-Reader, Multi-Case (MRMC) study compared AD detection with and without artificial intelligence-(AI) assistance. Ground truth was established by two U.S. board-certified radiologists, while three additional expert radiologists participated as readers. All participants assessed the same CTAs without AI-assistance (pre-AI arm) and, after a 1-month washout period, with the help of the device outputs (post-AI arm). STAT and IT were compared between the two phases. Results: The study included 285 CTAs (95 per reader, per arm), with a mean patient age of 58.5 years ±14.7(SD), 52% men, 37% prevalence. AI assistance significantly reduced STAT for detecting 33 true positive AD cases, from 15.84 minutes (95% CI: 13.37–18.31min) without AI to 5.07 minutes (95% CI: 4.23–5.91min) with AI, a 68% reduction (p<0.01). IT also decreased significantly, from 21.22 seconds (95% CI: 19.87–22.58s) without AI to 14.17 seconds (95% CI: 13.39–14.95s) with AI (p<0.05). Conclusions: Integrating a DL-based algorithm for AD detection on chest CTAs significantly reduces both STAT and IT. By prioritising the most urgent cases, AI ensures faster diagnosis and improves the workflow efficiency in clinical radiology practice, compared to standard First-In First-Out (FIFO) workflow.

Atherosclerosis remains a major driver for cardiovascular disease (CVD), despite advancements in traditional risk factor management therapies. Recent evidence emphasizes the crucial role of the gut microbiome in the progression of atherosclerosis and plaque rupture, highlighting a promising therapeutic avenue. This review focuses on the intertwined relationship between the gut microbiome, its metabolites, and atherosclerosis and CVD, also highlighting the potential therapeutic role of probiotics and prebiotics. Given the diverse and unique gut microbiota signatures among individuals, a one-size-fits-all therapeutic approach is unlikely to be effective. Personalized treatment strategies are therefore necessary. Here we discussed how Artificial Intelligence (AI) can be leveraged to analyze individual gut microbiome profiles from microbiome sequencing, predict treatment response, and optimize therapeutic strategies based on individual patients which would significantly improve outcomes of the treatment for atherosclerosis/CVD patients.

The article describes the use of deep neural networks to detect small floating objects located in the own vessel’s path. The research aimed to evaluate the performance of deep neural networks by classifying sea surface images and assigning the level of threat resulting from the detection of objects floating on the water, such as fishing nets, plastic debris or buoys. Such a solution could function as a decision support system capable of detecting and informing the watch officer or helmsman about possible threats and reducing the risk of overlooking them at a critical moment. Several neural network structures were compared to find the most efficient solution, taking into account the speed and efficiency of network training and its performance during testing. Additional time measurements have been made to test real-time capabilities of the system. The research results confirm that it is possible to create a practical lightweight detection system with Convolutional Neural Networks that calculates safety level in real time.

Reliable prediction of building-level energy demand is crucial for the building managers to optimize and regulate energy consumption. Conventional prediction models omit the uncertainties associated with demand over time; hence, they are mostly inaccurate and unreliable. In this study, a Bayesian neural network (BNN)-based probabilistic prediction model is proposed to tackle this challenge. By quantifying the uncertainty, BNNs provide probabilistic predictions that capture the variations in the energy demand. The proposed model is trained and evaluated on a subset of the building operations dataset of Lawrence Berkeley National Laboratory (LBNL), Berkeley, California, which includes diverse attributes related to climate and key building performance indicators. We have performed thorough hyperparameter tuning and used fixed-horizon validation to evaluate trained models on various test data to assess generalization ability. To validate the results, quantile random forest (QRF) was used as a benchmark. The study compared BNN with LSTM, showing that BNN outperformed LSTM in uncertainty quantification.

Deep brain stimulation (DBS) is currently a promising technique for psychiatric patients with severe and treatment-resistant symptoms. However, the results to date have been quite heterogeneous, and the indications for psychosurgery with DBS remain in an experimental phase. One of the major challenges limiting the advancement of DBS in psychiatric disorders is the lack of objective criteria for diagnosing certain conditions, which are often based more on clinical scales rather than measurable biological markers. Additionally, there is a limited capacity to objectively assess treatment outcomes. This overview examines the literature on the available biomarkers in psychosurgery in relation to DBS, as well as other relevant biomarkers in psychiatry with potential applicability for this treatment modality. There are five types of biomarkers: clinical/behavioral, omic, neuroimaging, electrophysiological, and neurobiochemical. The information provided by each biomarker within these categories is highly variable and may be relevant for diagnosis, response prediction, target selection, program adjustment, etc. A better understanding of biomarkers and their applications would allow DBS in psychosurgery to advance on a more objective basis, guided by the information provided by them and within the context of precision psychiatry.

Deflectometry is a key component in the precise measurement of specular (mirrored) surfaces, however traditional methods often lack an end-to-end approach that performs 3D reconstruction in a single shot with high accuracy and generalizes across different free-form surfaces. This paper introduces a novel deep neural network (DNN)-based approach for end-to-end 3D reconstruction of free-form specular surfaces using single-shot deflectometry. Our proposed network, VUDNet, innovatively combines discriminative and generative components to accurately interpret orthogonal fringe patterns and generate high-fidelity 3D surface reconstructions. By leveraging a hybrid architecture integrating a Variational Autoencoder (VAE) and a modified U-Net, VUDNet excels in both depth estimation and detail refinement, achieving superior performance in challenging environments. Extensive data simulation using Blender, leading to a dataset which we are making available, ensures robust training and enables the network to generalize across diverse scenarios. Experimental results demonstrate the strong performance of VUDNet, setting a new standard for 3D surface reconstruction. The implementation of VUDNet is available on GitHub at https://github.com/hadious/VUDNet.

Crowd abnormal behavior recognition is one of the research hotspots in computer vision. Its goal is to use computer vision technology and abnormal behavior detection models to accurately perceive, predict, and intervene in potential abnormal behaviors of the crowd, and monitor the status of the crowd system in public places in real-time, to effectively prevent and deal with public security risks and ensure public life safety and social order. To this end, focusing on the crowd abnormal behavior recognition technology in the computer vision system, a systematic review study of its theory and cutting-edge technology is conducted. First, the crowd level and abnormal behaviors in public places are defined, and the challenges faced by crowd abnormal behavior recognition are expounded. Then, from the dimensions based on traditional methods and based on deep learning, the mainstream technologies of abnormal behavior recognition are discussed, and the design ideas, advantages, and limitations of various methods are analyzed. Next, the mainstream software tools are introduced to provide a comprehensive reference for the technical framework; Secondly, typical abnormal behavior datasets at home and abroad are sorted out, and the characteristics of these datasets are compared in detail from multiple perspectives such as scale, characteristics and uses, and the performance indicators of different algorithms on the datasets are compared and analyzed; Finally, the full text is summarized and the future development direction of crowd abnormal behavior recognition technology is prospected.

As the adoption of deep learning models continues to surge across various applications, the need for efficient deployment architectures becomes increasingly critical. This paper presents a novel approach to enhance the deployment of deep learning models by leveraging serverless architecture. Serverless computing has been popular for its auto-scaling, cost-effectiveness, and simplified management characteristics. However, the intense resource demands of deep learning models pose challenges in maintaining low response times and effective load balancing within serverless environments. The proposed architecture addresses these challenges by integrating principles from both deep learning model optimization and serverless computing. Through systematic experimentation and analysis, we demonstrate that by appropriately designing and tuning the deployment architecture, significant improvements in response time, performance, resource utilization, and load distribution can be achieved.

In this study, a novel and efficient method was developed for the extraction of total flavonoids from Flos Sophorae Immaturus (FSI) using ultrasound-assisted deep eutectic solvent (UAE-DES). Different DES formulations were first investigated and choline chloride/1,2-propanediol (ChCl/PD) was identified as the optimal solvent due to its highest flavonoid yield. The extraction process was optimized through single factor experiments and response surface methodology (RSM). An extraction temperature of 68 °C, a sonication time of 41 minutes, a water content of 21% and a liquid-solid ratio of 21 mL/g were identified as the optimal conditions. Under these conditions, a maximum flavonoid yield of 378.77 mg RE/g DW was achieved. The crude extract was further purified using a macroporous D-101 resin, resulting in a flavonoid extract with a purity of 83.11 ± 3.54%. The antioxidant activity of the purified extract (FSPE) was evaluated using DPPH and ABTS radical scavenging assays, showing significant antioxidant properties with IC50 values of 52.50 μg/mL and 49.47 μg/mL, respectively. The UAE-DES method developed in this study not only significantly improves the extraction yield of flavonoids from FSI, but is also in line with sustainable and environmentally friendly practices. This method offers an environmentally friendly, efficient and scalable approach for the extraction of bioactive compounds from medicinal plants and has potential applications in the food, pharmaceutical and dietary supplement industries.

Background: Ovarian, cervical, and endometrial cancers stand as fatal health killers for women's mental and physical health, especially affecting female reproductive systems. Exploiting weakly supervised learning and explainable AI techniques are crucial for fast, accurate, and robust automatic marker detection, efficient prevention, and primary treatment of gynecological tumors. Methods: With respect to the PRIMSA methodology, weakly supervised learning schemes and deep learning-based schemes are investigated in the cross-subject fields of clinical diagnostic imaging and explainable AI technology. Related methods, opening research problems, and challenging subjects are explored in the screening and treatment of gynecological tumors and performing cancer image diagnosis in the latest study. Results: Keynote approaches combining ultrasound medicine, explainable AI, and clinical imaging technology are summarized. In combination with learning-based methods with medical imaging, prospective insights are put forward for refreshed concepts on treatments in the area of gynecological oncology, with a feasible range of applications for their corresponding AI techniques. Conclusions: Explainable AI and deep learning-based approaches are capable of performing accurate classification between benign and malignant tumors, yielding a pathway to care for women's health, improving the survival rate of patients, pacing with disease prediction, and matching the strategic goal of "Healthy China 2030".

Accurate forecasting of available energy portion that corresponds to the reservoir inflow of the month(s) ahead provides important decision support for the hydropower plants in energy pro-duction planning for revenue maximization, as well as for the environmental impact prevention, and flood control at the upstream and downstream of a basin. Therefore, a reliable forecasting tool or model is deemed necessary and crucial. Considering the fluctuation and nonlinearity of data which significantly influence the forecasting results, this study develops an effective hybrid model by integrating Artificial Neural Network (ANN) and Particle Swarm Optimization (PSO) called “PSO-ANN” model based on the hydrological and meteorological data pre-processed by cross-correlation function (CCF), autocorrelation function (AFC), and normalization techniques for predicting the available energy portion corresponding to the reservoir inflow mentioned above for a case study hydropower plant in Laos namely, Theun-Hinboun hydropower plant (THHP). The model was evaluated by using correlation coefficient (r), relative error (RE), root mean square error (RMSE), and Taylor diagram plots in comparison with the popular single algorithm approaches such as ANN, and NARX models. Results demonstrated the superiority of the proposed PSO-ANN approach over the other two models.

Amidst the escalating demands for efficient Intelligent Transportation Systems (ITS) management, the significance of accurate Origin-Destination (OD) data prediction has emerged as a paramount concern, given its indispensable role in the ITS domain. This paper introduces a groundbreaking integrated model, creatively fusing the unique strengths of Graph Convolutional Network (GCN), Residual Neural Network (ResNet), and Long Short-Term Memory Network (LSTM) into a single architecture, which we name GraphResLSTM, to exploit road segment average speed data for OD prediction. Compared with conventional road segment traffic volume data, average speed data is more readily available, significantly reducing the data accessibility barrier for OD prediction. We underscore the critical role of selection of key road segments and employs a combination of Entropy Weight Method and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) to identify 41 representative road segments from the experimental road network. In the experimental phase, we simulate 86400000 seconds of traffic conditions, generating a total of 1440000 data records. Utilizing these simulated data, we design and conduct comparative experiments between models as well as data types. The results demonstrate that both the GraphResLSTM model and road segment average speed data outperform other models and data types notably in OD prediction tasks.

Deep learning has increasingly been employed to identify minerals. However, deep learning can only be used to identify minerals in the distribution of the training set, while any mineral outside the spectrum of the training set is inevitably categorized erroneously within a predetermined class from the training set. To solve this problem, the study introduces the approach that amalgamates One-Class Support Vector Machines (OCSVM) with the ResNet architecture for the out-of-distribution mineral detection. Initially, ResNet undergoes training using a training set comprising well-defined minerals. Subsequently, the earlier layers of the trained ResNet are employed to extract the discriminative features of the mineral under consideration. These extracted mineral features then become the input for OCSVM. When OCSVM discerns the mineral in the training set's distribution, it triggers the subsequent layers within the trained ResNet, facilitating the accurate classification of the mineral into one of the predefined categories encompassing the known minerals. In the event OCSVM identifies the mineral out of the training set's distribution, it is unequivocally categorized as an unclassified or 'unknown' mineral. Empirical results substantiate the method's capability to identify out-of-distribution minerals while concurrently maintaining a commendably high accuracy rate for the classification of the 36 in-distribution minerals.

How many different writers authored the huge number of texts attributed to Galen of Pergamum (129~216 AD), medical doctor and philosopher, a giant in the history of medicine? To find out which texts were his and which ones were written by others is known as the “Galenic Question”. We propose a “solution” to it through a multidisciplinary approach based: (a) on historical research and (b) on a mathematical analysis of the Greek texts. The historical approach has considered historical independent sources and anachronisms. The mathematical approach has been based on a mathematical theory concerning deep–language variables, rarely consciously controlled by any author, therefore capable of giving indications on similarity of texts, with little or no bias. The multidisciplinary approach has convinced us that at least three authors wrote the texts attributed to Galen. The first two very likely were real historical persons: (a) a certain Galen living between the end of the I century BC and the second half of the I century AD; (b) the historical Galen of Pergamum (II–III centuries AD) and (c) several unknown authors hiding under the name Galen, but surely living after Galen of Pergamum’s death.

Non-neural Machine Learning (ML) and Deep Learning (DL) are used to predict system failures in industrial maintenance. However, only a few studies have assessed the effect of varying the amount of past data used to make a prediction and the extension in the future of the forecast. This study evaluates the impact of the size of the reading window and of the prediction window on the performances of models trained to forecast failures in three data sets of (1) an industrial wrapping machine working in discrete sessions, (2) an industrial blood refrigerator working continuously and (3) a nitrogen generator working continuously. A binary classification task assigns the positive label to the prediction window based on the probability of a failure to occur in such an interval. Six algorithms (logistic regression, random forest, support vector machine, LSTM, ConvLSTM and Transformers) are compared using multivariate time series. The dimension of the prediction windows plays a crucial role and the results highlight the effectiveness of DL approaches in classifying data with diverse time-dependent patterns preceding a failure and the effectiveness of ML approaches in classifying similar and repetitive patterns preceding a failure.

All types of sports are potential application scenarios for automatic and real-time visual object and event detection. In rink hockey, the popular roller quad skate variant of hockey team sports, it is of great interest to automatically track player’s movements and positions, player’s sticks and, also, making other judgments, such as being able to locate the ball. In this work, we introduce a real-time pipeline composed by an object detection model, created specifically for rink hockey games, followed by a knowledge-based event detection module. Even in the presence of occlusions and quick motions, our deep learning object detection model effectively identifies and tracks, in real-time, important visual elements such as: ball; players; sticks; referees; crowd; goalkeeper; and goal. Using a curated dataset composed by a collection of videos of rink hockey, comprising 2525 annotated frames, we trained and evaluated the algorithm performance and compare it to state of the art object detection techniques. Our object detection model, based on YOLOv7, presents a global accuracy of 80%, and presents a good performance in terms of accuracy and speed, according to our results, making it a good choice for rink hockey applications. In our initial tests, the event detection module successfully detected one important event type in rink hockey games, the occurrence of penalties.

This research introduces a pioneering solution to the challenges posed by gastrointestinal tract (GI) cancer in radiation therapy, focusing on the imperative task of precise organ segmentation for minimizing radiation-induced damage. GI imaging has historically used manual demarcation, which is laborious and uncomfortable for patients. We address this by introducing the ResECA-U-Net deep learning model, a novel combination of the UNet and ResNet34 architectures. Furthermore, we further augment its functionality by incorporating the Efficient Channel Attention (ECA-Net) methodology. By utilizing data from the UW-Madison Carbone Cancer Centre, we carefully investigate several image processing techniques designed to capture critical local characteristics. With its foundation in computer vision concepts, the ResECA-U-Net model is excellent at extracting fine details from GI images. Sophisticated metrics such as intersection over union (IoU) and the dice coefficient are used to evaluate performance. Our study's outcomes demonstrate the effectiveness of the suggested method, yielding an impressive 96.27% Dice coefficient and 91.48% IoU. These results highlight the significant contribution that our strategy has made to the advancement of cancer therapy. Beyond its scientific merits, this work has the potential to significantly enhance cancer patients' quality of life and provide better long-term outcomes. Our work is a significant step towards automating and optimizing the segmentation process, which can potentially change how GI cancer is treated completely.

The importance of detecting and diagnosing the imminence of aneurysm rupture before it occurs cannot be overstated. However, this process is often time-consuming and challenging, with variability in conclusions not uncommon among experts. Furthermore, current state-of-the-art models in medical image segmentation suffer from limited availability of large annotated datasets for training, exacerbated by an immense data imbalance. In most segmentation tasks, 3D segmentation is preferred due to its capacity to leverage more contextual information. However, these models require more data, which is constrained by the aforementioned issues. In the realm of current diagnosis models, those lacking geographic context are notably ineffective. To address these issues, the aim is to develop a model pipeline to accurately detect cerebral intracranial aneurysms and diagnose rupture imminence through 3D magnetic resonance angiography (MRA) and tabular input, augmented with the implementation of neuro-symbolic ai. The utilization of data fusion to tackle the lack of context in tabular models is proposed, leveraging extracted geographical features from a segmentation model. To enhance segmentation results and tackle the data imbalance in aneurysm segmentation, a two-stage model pipeline that extracts contextual geographic features before aneurysm segmentation is suggested. Segmentation results are additionally improved through ensemble techniques and novel preprocessing techniques. Finally, a neuro-symbolic aspect is introduced to enhance model diagnosis, interpretability and performance. The multi-step Integrated Neuro-Symbolic Analysis Pipeline for Cerebral Aneurysm Rupture Diagnosis is introduced.

This research investigates the application of deep learning in sentiment analysis of Canadian maritime case law. It offers a framework for improving maritime law and legal analytics policy-making procedures. The automation of legal document extraction takes center stage, underscoring the vital role sentiment analysis plays at the document level. Therefore, this study introduces a novel strategy for sentiment analysis in Canadian maritime case law, combining sentiment case law approaches with state-of-the-art deep learning techniques. The overarching goal is to systematically unearth hidden biases within case law and investigate their impact on legal outcomes. Employing Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) based models, this research achieves a remarkable accuracy of 98.05% for categorizing instances. In contrast, Conventional Machine Learning techniques such as Support Vector Machines (SVM) yield an accuracy rate of 52.57%, Naive Bayes at 57.44 %, and Logistic Regression at 61.86%. The superior accuracy of the CNN and STM model combination underscores its usefulness in legal sentiment analysis, offering promising future applications in diverse fields like legal analytics and policy design. These findings mark a significant choice for AI-powered legal tools, presenting more sophisticated and sentiment-aware options for the legal profession.

With the popularity of solar energy in the electricity market, demand arises for data such as precise locations of solar panels for efficient energy planning, management, and distribution. However, this data is not easily accessible and in some cases, information such as precise locations does not exist. Furthermore, existing data sets for training semantic segmentation models of PV installations are limited, and their annotation is time-consuming and labor-intensive. Therefore, for additional remote sensing (RS) data creation, the pix2pix generative adversarial network (GAN) is utilized, enriching the original resampled training data of varying GSDs without compromising its integrity. Experiments done with the DeepLabV3 model, ResNet-50 backbone, and pix2pix GAN architecture were conducted to find the optimal configuration for an accurate RS imagery segmentation model. The result is a fine-tuned solar panel semantic segmentation model, trained using transfer learning and utilizing an optimal amount – 60% of generated RS imagery for additional training data, increasing model accuracy. The findings demonstrate the benefits of using GAN-generated images as additional training data, increasing the size of small data sets, and improving the capabilities of the segmentation model for solar panel detection in RS images.

The integration of Artificial Intelligence (AI) with Digital Twins (DTs) has emerged as a promising approach to revolutionize healthcare, particularly in the diagnosis and management of thoracic disorders. This study proposes a comprehensive framework, named Lung-DT, which leverages IoT sensors and AI algorithms to establish a digital representation of a patient’s respiratory health. Using the YOLOv8 neural network, the Lung-DT system accurately classifies chest X-Rays into five distinct categories of lung diseases, including "Normal," "Covid," "Lung Opacity," "Pneumonia," and "Tuberculosis". The system’s performance was evaluated on a chest X-Ray dataset, demonstrating an impressive average accuracy of 96.6% across all classes. Further tests (prediction) were conducted on the trained network using a third dataset available in the literature and completely unknown to the network, yielding an average accuracy of 98% across three classes. The proposed Lung-DT framework offers several advantages over conventional diagnostic methods. Firstly, it enables real-time monitoring of lung health through continuous data acquisition from IoT sensors, facilitating early diagnosis and intervention. Secondly, the AI-powered classification module provides automated and objective assessments of chest X-Rays, reducing dependence on subjective human interpretation. Thirdly, the twin digital representation of the patient’s respiratory health allows for comprehensive analysis and correlation of multiple data streams, providing valuable insights for personalized treatment plans. The integration of IoT sensors, AI algorithms, and DT technology within the Lung-DT system demonstrates a significant step towards improving thoracic healthcare. By enabling continuous monitoring, automated diagnosis, and comprehensive data analysis, the Lung-DT framework has enormous potential to enhance patient outcomes, reduce healthcare costs, and optimize resource allocation.

Underwater robotics equipped with visual detection systems have the function of detecting un-derwater artifacts, which is of great significance to deep-sea archaeology. Underwater artifacts are located in complex environments with poor imaging conditions, and the targets have chal-lenging problems such as breakage, stacking, and sediment burial, which causes the marine cul-tural target detection failures. To solve these problems, this paper proposes an underwater cul-tural target detection algorithm based on the deformable deep aggregation network model for underwater robotics exploration. To fully extract the target feature information of underwater targets in complex environments, this paper designs a multi-scale deep aggregation network with deformable convolutional layers. Besides, the BAM attention module is designed for fea-ture optimization, which enhances the potential feature information of the target while weak-ening the background interference information. Finally, the target prediction is achieved through feature fusion at different scales. The proposed algorithm has been extensively validat-ed and analyzed on the collected underwater artifact datasets, and the precision, recall, and mAP of the algorithm have reached 93.1%, 91.4%, and 92.8%, respectively. In addition, the present al-gorithm has been practically deployed on the underwater robotics. In the deep-sea tests, the ar-tifact detection frame rate reaches up to 19 fps, which satisfies the real-time target detection。

Micro-nanoparticles' characteristics in geothermal fluids can be applied to detect of deep hidden geothermal resources. Observations using a nanoparticle tracking analyzer (NTA) indicated that the karst geothermal water collected in the central area of Shandong Province (Jinan and Zibo) contains many natural micro-nanoparticles with sizes primarily ranging between 100 nm and 5 μm. The micro-nanoparticles’ type, shape, crystal form, and chemical composition in the samples were analyzed using transmission electron microscopy (TEM). TEM images and energy dispersive spectroscopy showed that the micro-nanoparticles in geothermal water samples were mostly amorphous, irregular, or nearly spherical, with rough edges. The micro-nanoparticles were mainly carbonates, sulfates, and chlorine-containing Fe, Ca, Na, and Mg. The characteristics of the particles can reveal the properties of the deep, hot reservoirs and aquifers from where they originate. Therefore, we believe that natural micro-nanoparticles can be essential to detecting and studying deep, hidden geothermal resources, which is a novel approach to exploring deep, hidden geothermal resources.

Endovascular techniques are currently considered as a first line treatment options for lower limb chronic limb-threatening ischemia (CLTI), defined by the presence of ischemic rest pain and severe tissue loss such as ulcers or gangrene. Although the technical success rate of endovascular revascularization is high, in specific patients with advanced infrapopliteal disease and absence of run-off tibial vessels ("desert foot"), the chance of successful revascularization is minimal. In order to avoid primary amputation several treatment option are currently being investigated, including different strategies such as gene therapy or venous arterialization techniques. This review focuses on the percutaneous deep venous arterialization technique, recently introduced in everyday clinical practice, as a promising, minimally invasive treatment option for limb salvage in CLTI patients presenting with “desert foot”.

An accurate, economical, and reliable device for detecting falls in persons ambulating with the assistance of an orthopedic walker is crucially important for the elderly and patients with limited mobility. Existing wearable devices such as wristbands are not designed for walker users, and patients may not wear them at all times. This research proposes a novel idea of attaching an internet-of-things (IoT) device with an inertial measurement unit (IMU) sensor directly to an orthopedic walker to perform real-time fall detection as well as activity logging. A dataset is collected and labeled for walker users in four activities, including idle, motion, step, and fall. Classic machine learning algorithms are evaluated using the dataset by comparing their classification performance. Deep learning with convolutional neural network (CNN) is also explored. Furthermore, the hardware prototype is designed by integrating a low-power microcontroller for onboard machine learning, an IMU sensor, a rechargeable battery, and Bluetooth wireless connectivity. The research results show the promise of improved safety and well-being of walker users.

Requirements Engineering (RE) is an important step in the whole software development lifecycle. The problem in RE is to determine the class of the software requirements as functional and non-functional. Proper and early identification of these requirements is vital for the entire development cycle. On the other hand, manual government of requirement classes is a timewasting task, and it needs intensive effort. Automatic requirement classification techniques through advanced Machine Learning (ML) strategies are started to be developed to address this problem. Basically, software requirements are generated as natural language explanations and therefore requirement classification may be handled as a particular Natural Language Processing (NLP) problem. From ML point of view, classification strategies require dataset to be used in the training/learning phase. For this goal, we generated a unique Turkish dataset having collected the requiremenst from real-world software projects with 4600 samples. Of these requirements, 3000 and 1600 were labeled as functional and non-functional, respectively. The data set has been evaluated using (i) traditional machine learning algorithms, (ii) deep learning algorithms, and (iii) transformer models respectively. As a result BERTurk was found to be the most successful algorithm to discriminate functional and non-functional requirements in terms of 95% f-score metric.

This paper presents a two-stage hierarchical neural network using image classification and object detection algorithms as key building blocks for a system that automatically detects a potential design right infringement. This neural network is trained to return the Top-N original design right records that highly resemble the input image of a counterfeit. Design rights specify the unique aesthetic characteristics of a product. Due to the rapid change of trends, new design rights are continuously generated. This work proposes an Ensemble Neural Network (ENN), an artificial neural network model that aims to deal with a large amount of counterfeit data and design right records that are frequently added and deleted. At first, we performed image classification and objection detection learning per design right using the existing models with a proven track record of high accuracy. The distributed models form the backbone of the ENN and yield intermediate results aggregated at a master neural network. This master neural network is a deep residual network paired with a fully connected network. This ensemble layer is trained to determine the sub-models that return the best result for a given input image of a product. In the final stage, the ENN model multiples the inferred similarity coefficients to the weighted input vectors produced by the individual sub-models to assess the similarity between the test input image and the existing product design rights to see any sign of violation. Given 84 design rights and the sample product images taken meticulously under various conditions, our ENN model achieved average Top-1 and Top-3 accuracies of 98.409% and 99.460%, respectively. Upon introducing new design rights data, a partial update of the inference model was done an order of magnitude faster than the single model. ENN maintained a high level of accuracy as it scaled out to handle more design rights. Therefore, the ENN model is expected to offer practical help to the inspectors in the field, such as the customs at the border that deal with a swarm of products.

Agriculture is one of the indispensable fields for the survival of mankind. Potatoes also have a significant role in the field of agriculture. The quality and quantity of potatoes are significantly impacted by several diseases, such as early blight and late blight, and manual interpretation of these leaf diseases is time-consuming and inconvenient. Fortunately, leaf appearance is used to detect diseases in potato plants. Productivity will considerably rise if the infections are detected early. Different types of image processing methods and machine learning methods are used for early recognition of those diseases from leaf images so that the product losses are decreased significantly. For the incredible and marvelous performance of CNN, it is the most popular deep learning method that is used immensely for the recognition of leaf diseases from images. Several pretrained deep learning models, such as VGG16, ResNet50, InceptionV3, MobileNetV2, Xception, and a deep learning model developed using CNN, are employed for potato leaf disease classification and recognition on the same dataset. The transfer learning technique is applied to the pretrained model and the data augmentation technique is applied to the Proposed CNN model for potato disease classification from leaf samples. Compared to pretrained models, the proposed CNN model offers the lowest loss and highest accuracy for potato leaf disease detection while using fewer parameters and layers. It achieves the best performance with a test accuracy of 99.33% compared to other Pretrained models used in the diagnosis of potato leaf disease.