The art of representing source code is pivotal in numerous programming analysis applications. Recent strides in neural networks have marked notable successes in this realm. However, the peculiar structural characteristics inherent in programming languages have not been fully exploited in existing models. While neural models based on abstract syntax trees (ASTs) adeptly manage the tree-like nature of source codes, they fall short in discerning the diverse substructural nuances within programs. This paper introduces the Dynamic Syntax Tree Model (DSTM), an innovative approach that fuses various neural network modules into tree architectures tailored to the specific AST of the input. Distinct from preceding tree-based neural models, DSTM adeptly discerns the semantic variances across different AST substructures. We validate DSTM through rigorous testing in program classification and code clone detection, outperforming contemporary methods and demonstrating the benefits of harnessing intricate source code structures.

To identify objects in images, a complex set of skills is needed that includes understanding the context and being able to determine the borders of objects. In computer vision, this task is known as semantic segmentation and it involves categorizing each pixel in an image. It is crucial in many real-world situations: for autonomous vehicles, it enables the identification of objects in the surrounding area; in medical diagnosis, it enhances the ability to detect dangerous pathologies early, thereby reducing the risk of serious consequences. In this study, we compare the performance of various ensembles of convolutional and transformer neural networks. Ensembles can be created, e.g, by varying the loss function, data augmentation method or the learning rate strategy. Our proposed ensemble, which is based on the simple average rule, demonstrates exceptional performance on several datasets. All the resources used in this study are available online at the following GitHub repository: https://github.com/LorisNanni.

Polar Mesospheric Summer Echoes (PMSEs) are radar echoes that are observed in the mesosphere during the Arctic summer months in the polar regions. By studying PMSE, researchers can gain insights into physical and chemical processes that occur in the upper atmosphere specifically in the 80 to 90 km altitude range. In this paper, we employ fully convolutional networks such as UNET and UNET++ for the purposes of segmenting PMSE from the EISCAT VHF dataset. First, experiments are performed to find suitable weights and hyperparameters for UNET and UNET++. Second, different loss functions are tested to find one suitable for our task. Third, as the number of PMSE samples used is relatively small that can lead to poor generalization. To address this, image-level and object-level augmentation methods are employed. Four, we briefly explain our findings by employing layerwise relevance propagation.

In the field of low power wireless networks, one of the techniques on which many researchers are putting their efforts is related to positioning methodologies such as fingerprinting in dense urban areas. This paper presents an experimental study aimed at quantifying the mean location estimation error in densely urbanized areas.Using a dataset made available by the University of Antwerp, a neural network was implemented with the aim of providing the position of the end-devices. In this way it was possible to measure the mean location estimation error in an area with high urban density. The results obtained show an accuracy in the localization of the end-device of less than 150 meters.This result would make it possible to use the fingerprint instead of alternative, energy consuming, methodologies such as GPS in IoT (Internet of Things) applications where battery life is the primary requirement to be met.

Deep learning, specifically the supervised approach, has proved to be a breakthrough in depth prediction. However, the generalization ability of deep networks is still limited, and they cannot maintain a satisfactory performance on some inputs. Addressing a similar problem in the segmentation field, a scheme (f-BRS) has been proposed to refine predictions in the inference time. f-BRS adapts an intermediate activation function to each input by using user clicks as sparse labels. Given the similarity between user clicks and sparse depth maps, this paper aims at extending the application of f-BRS to depth prediction. Our experiments show that f-BRS, fused with a depth estimation baseline, is trapped in local optima, and fails to improve the network predictions. To resolve that, we propose a double-stage adaptive refinement scheme (DARS). In the first stage, a Delaunay-based correction module significantly improves the depth generated by a baseline network. In the second stage, a particle swarm optimizer (PSO) delineates the estimation through fine-tuning f-BRS parameters—that is, scales and biases. DARS is evaluated on an outdoor benchmark, KITTI, and an indoor benchmark, NYUv2 while for both the network is pre-trained on KITTI. The proposed scheme outperformed rival methods on both datasets.

The Coronavirus outbreak that began in December, 2019 became a worldwide pandemic by March, 2020. The education industry had to adapt to this new change in a speedy and most feasible way by shifting to virtual classes over the internet and other available resources. WhatsApp has turned out to be a boon in academic’s section where in all the teachers have their own subject-wise groups on the said application. This not only helps them to share the necessary information resources but also to have discussion regarding the subject matter. On the other side, this application allows easy access for the students to all the resources shared by the teacher, and they can share their assignments without much difficulty with their subject teachers. Therefore, it has become a primary tool for conducting teaching, learning and evaluation online. The researchers have tried to analyze impact of online classes and the efforts required by the students to learn online with the help of survey conducted with the sample size of 514. The survey questionnaire was grouped into 4 categories namely; Opinion on Information and Communications Technology (ICT) based Teaching, Changes in communication behavior due to ICT using WhatsApp, the main hindrance for integration of ICT (Information Communication Technology) in the teaching-learning process and disadvantages of using ICT for teaching and learning.

GANs are well known for success in the realistic image gen-eration. However, they can be applied in tabular data generation as well.We will review and examine some recent papers about tabular GANs inaction. We will generate data to make train distribution bring closer tothe test. Then compare model performance trained on the initial traindataset, with trained on the train with GAN generated data, also wetrain the model by sampling train by adversarial training. We show thatusing GAN might be an option in case of uneven data distribution be-tween train and test data

In this paper, we propose a novel network representation learning model TransPath to encode heterogeneous information networks (HINs). Traditional network representation learning models aim to learn the embeddings of a homogeneous network. TransPath is able to capture the rich semantic and structure information of a HIN via meta-paths. We take advantage of the concept of translation mechanism in knowledge graph which regards a meta-path, instead of an edge, as a translating operation from the first node to the last node. Moreover, we propose a user-guided meta-path sampling strategy which takes users' preference as a guidance, which could explore the semantics of a path more precisely, and meanwhile improve model efficiency via the avoidance of other noisy and meaningless meta-paths. We evaluate our model on two large-scale real-world datasets DBLP and YELP, and two benchmark tasks similarity search and node classification. We observe that TransPath outperforms other state-of-the-art baselines consistently and significantly.

This study aims to evaluate the potential of machine learning algorithms (Random Forest and Support Vector Machine) in predicting the open porosity of a general-use industrial mortar applied to different substrates based on the characteristics of both the mortar and substrates. For this purpose, an experimental database comprising 1592 samples of industrial mortar applied to five different substrates (hollowed ceramic brick, solid ceramic brick, concrete block, concrete slab, and lightweight concrete block) was generated by an experimental program. The samples were characterized by bulk density, open porosity, capillary water absorption coefficient, drying index, and compressive strength. This database was then used to train and test the machine learning algorithms to predict the open porosity of the mortar. The results indicate that it is possible to predict the open porosity of the mortar with good prediction accuracy and that both Random Forest (RF) and Support Vector Machine (SVM) algorithms (RF =0.880; SVM = 0.896) are suitable for this task. Regarding the main characteristics that influence the open porosity of the mortar, bulk density and the open porosity of the substrate are significant factors. Furthermore, the study employs a straightforward methodology with a machine learning no-code platform, enhancing the replicability of its findings for future research and practical implementations.

Machine unlearning, the process of selectively forgetting or removing the influence of specific data points from a machine learning model, is increasingly important for privacy and compliance with regulations like the GDPR. This paper explores the concept of exact unlearning, focusing on its implementation in models trained using convex and non-convex functions. Convex functions, due to their well-behaved optimization landscapes, lend themselves to efficient unlearning through methods such as inverse optimization, duality-based approaches, and incremental learning. In contrast, non-convex functions, common in deep learning models, present more complex challenges due to their multiple local minima and high-dimensional parameter spaces. Techniques like checkpoint-based retraining, gradient inversion, and meta-learning are discussed as viable, though computationally expensive, methods for non-convex exact unlearning. The paper also highlights real-world applications in fields such as finance and healthcare, where exact unlearning can enhance privacy and security without compromising model performance. Finally, it outlines key challenges and future research directions, particularly the need for more efficient unlearning algorithms in non-convex settings and the development of secure, adversarial-resistant methods for sensitive data removal.

Machine unlearning is a critical process designed to allow machine learning models to forget or remove specific data upon request, particularly for privacy protection. While the primary objective of unlearning is to safeguard sensitive information, it introduces substantial privacy and security risks. This paper explores the two major categories of threats to machine unlearning: privacy attacks and security attacks. Privacy attacks, such as membership inference and model inversion, exploit residual information to infer or reconstruct sensitive data that should have been erased. Security attacks, particularly specific data poisoning, involve the injection of malicious data into the training process, which may leave lingering effects even after the unlearning process. In this paper, we provide an in-depth examination of these threats and propose several defense mechanisms. Differential privacy, adversarial training, and query limitations are highlighted as key defenses against privacy attacks, while data validation, adversarial examples, and post-unlearning audits are critical in mitigating security risks. Additionally, we discuss emerging methodologies like data provenance tracking and fine-tuning as crucial for ensuring unlearning processes are thorough and effective. Through these analyses, we aim to provide a comprehensive framework for strengthening the security and privacy of machine unlearning systems, enabling their broader adoption across industries such as healthcare, finance, and AI-driven technologies.

Recent advancements in neural machine translation (NMT) offer promising potential for generating cross-language clinical natural language processing (NLP) resources. There is a pressing need to be able to foster the development of clinical NLP tools that extract key clinical entities in a comparable way for a multitude of medical application scenarios, hindered by lack of multilingual annotated data. This study explores the efficacy of using NMT and annotation projection techniques with expert in the loop validation to develop named entity recognition (NER) systems for an under resourced target language (Catalan) by leveraging Spanish clinical corpora annotated by domain experts. We employed a state-of-the-art NMT system to translate three clinical case corpora. The translated annotations were then projected onto the target language texts and subsequently validated and corrected by clinical domain experts. The efficacy of the resulting NER systems was evaluated against manually annotated test sets in the target language. Our findings indicate that this approach not only facilitates the generation of high-quality training data for the target language (Catalan) but also demonstrates the potential to extend this methodology to other languages, thereby enhancing multilingual clinical NLP resource development. The generated corpora and components are publicly accessible, providing potentially a valuable resource for further research and application in multilingual clinical settings: https://zenodo.org/doi/10.5281/zenodo.13133124.

Background: In recent years, computational aesthetics and neuroaesthetics have provided novel insights into understanding beauty. Building upon the findings of traditional aesthetics, this study aims to combine these two research methods to explore an interdisciplinary approach to studying aesthetics; Method: Abstract artworks were used as experimental materials. Based on traditional aesthetics and in combination, features of composition, tone, and texture were selected. Computational aesthetic methods were then employed to correspond these features to physical quantities: blank space, gray histogram, GLCM, LBP, and Gabor filters. An EEG experiment was carried out, in which participants conducted aesthetic evaluations of the experimental materials in different contexts (genuine, fake), and their EEG data was recorded to analyze the impact of various feature classes in the aesthetic evaluation process. Finally, a SVM was utilized to model the feature data, EEG data, context data, and subjective aesthetic evaluation data; Result: Behavioral data revealed that higher aesthetic ratings in the genuine context. EEG data indicated that genuine contexts elicited more negative deflections in the prefrontal lobes between 200-1000ms. Class II compositions demonstrated more positive deflections in the parietal lobes at 50-120ms, while Class I tones evoked more positive amplitudes in the occipital lobes at 200-300ms. Gabor features showed significant variations in the parieto-occipital area at an early stage. Class II LBP elicited a prefrontal negative wave with a larger amplitude. The results of the SVM models indicated that the model incorporating aesthetic subject and context data (ACC=0.76866) outperforms the model using only parameters of the aesthetic object (ACC=0.68657); Conclusion: A positive context tends to provide participants with a more positive aesthetic experience, but abstract artworks may not respond to this positivity. During aesthetic evaluation, the ERP data activated by different features show a trend from global to local. The SVM model based on multimodal data fusion effectively predicts aesthetics, further demonstrating the feasibility of the combined research approach of computational aesthetics and neuroaesthetics.

A typical orchard's mechanical operation consists of three or four stages: lining, digging for plantation, moving the seedling from nurseries to the farm, moving the seedling to the planting hole, and planting the seedling in the hole. However, the digging the planting hole is the most time-consuming operation. In fruit orchards, robots' usage is increasingly becoming more prevalent to increase operational efficiency. They offer practical and effective services to both industry and people, whether they are assigned to plant trees, reduce the use of chemical fertilizers, or carry heavy loads to relieve staff. Robots can operate for extended periods of time and can highly adept at repetitive tasks like planting many trees. The present study aims to identify the locations for planting trees in orchards using geographic information systems (GIS), to develop an autonomous drilling machine and use the developed robot to open planting holes. There isn't a comparable study on autonomous hole planting in the literature in this regard. The agricultural mobile robot is a four wheeled nonholonomic robot with differential steering and forwarding capability to stable target positions. The designed mobile robot can be used in fully autonomous, partially autonomous, or fully manual modes. The drilling system, which is a y-axis shifter driven by a DC motor with reducer includes an auger with a 2.1 HP gasoline engine. SOLIDWORKS software was used for designing and drawing of the mobile robot and drilling system. The Microsoft Visual Basic.NET programming language was used to create the robot navigation system and drilling mechanism software. The cross-track error (XTE), which determines the distances between the actual and desired holes positions, was utilized to analyze the steering accuracy of the mobile robot to the drilling spots. Consequently, the average of the arithmetic means was determined to be 4.35 cm, and the standard deviation was 1.73 cm. This figure indicates that the suggested system is effective for drilling plant holes in orchards.

In this project the EEG – electroencephalogram - channel(s) will be characterized to diagnose PTSD – Post-traumatic stress disorder – cases. For this aim, we applied boosting methods including a combination of K-mean and Support Vector Machine (SVM) models to find the feature weights to detect the PTSD cases. We classified 32 channels of 12 subjects including 6 PTSD and 6 healthy controls using a 6-mean classifier. The linear SVM found the weights of distinguished channels within each subject for each cluster. It was found that the significant SVM weights of F4, F8, and Pz are smaller in PTSD than in healthy subjects. This new method can be used as a tool to better understand the interaction of EEG signals and diagnosis.

Like the most of crops, especially sugarcane needs to be kept upright until it is harvested. Because, lodging of sugarcane has a significant negative effect on cane yield and sugar content of sugarcane. To keep sugarcane upright earthing up is an utmost intercultural operation. In Bangladesh, most of the operations for sugarcane cultivation including earthing up are generally done in traditional method using human labor which increases production costs as well as reduces the income of sugarcane growers. So, a cost effective two-wheeled tractor (2WT) mounted earthing up machine was developed in Bangladesh Sugarcrop Research Institute (BSRI), Pabna to reduce drudgery and cost of sugarcane production. Field tests were conducted in experimental sugarcane field at BSRI and technical and economic performances of the developed earthing up machine were also carried out based on the field test. Average effective field capacity and field efficiency were found 0.16 ha/hr and 77.41 %, respectively for the developed earthing up machine. The earthing up machine was not found economically viable when it is used only for earthing up operation. Besides, when the 2WT was being used as the main driver for other activities including earthing up operation, then the earthing up machine becomes economically beneficial with net cash flow, net present value, internal rate of return, benefit-cost ratio and payback period of BDT 148497/ha, BDT 23184, 3%, 3.81:1 and approximately 1 year, respectively. On the contrary, considering cost of only earthing up tool without 2WT, then it was found economically beneficial with net cash flow, internal rate of return, net present value, benefit-cost ratio and payback period of BDT 16428/ha, BDT 3053, 4.7%, 2.71:1 and approximately 2 years, respectively. Since 2WT is commonly used for versatile farming purposes. Therefore, versatile use of 2WT as prime mover for other machines including earthing up machine can make earthing up machine economically viable and beneficial for sugarcane growers.

Conducting related research is crucial since there are still many problems that need to be resolved in the research on soft robots in the areas of material selection, structure design and manufacture, and drive control. Soft manipulators, a subset of soft robots, are now a popular area of study for many researchers. In comparison to typical manipulators, soft manipulators feature a high degree of gripping flexibility and a basic morphological structure. They are composed of flexible materials. It has a wide range of potential applications in healthcare, rehabilitation, bionics, and detection, and it can compensate for the drawbacks of rigid manipulators in some use scenarios. A modular soft-body torsional gripping system is developed after a torsional and gripping actuator is conceived, constructed, and its performance is examined. The torsion actuator and the grasping actuator can be combined in the system in a modular fashion. With the help of RGB-D vision algorithms, this multi-modular setup makes it possible to combine soft actuators with various twisting degrees and achieve exact gripping. Through pneumatic control, the target object is precisely grasped and rotated at various angles, enabling rotation of the target object in three dimensions.

Background: There is an increasing interest in the role of EEG in neurorehabilitation. We primarily aimed to identify the knowledge base through highly influential studies. Our secondary aims were to imprint the relevant thematic hotspots, research trends, and social networks within the scientific community. Methods: We performed an electronic search in Scopus looking for studies reporting on rehabilitation in patients with neurological disabilities. The most influential papers outlined the knowledge base, while a word co-occurrence analysis imprinted the research hotspots. Likewise, co-citation analyses highlighted collaboration networks between Universities, authors, and countries. The results were presented in summary tables, burst detection plots, and geospatial maps. Finally, a content review based on the top-20 most cited articles completed our study. Results: Our current bibliometric study was based on 874 records from 420 sources. There was a vivid research interest in EEG use for neurorehabilitation, with an annual growth rate as high as 14.3%. The most influential paper was the study titled "Brain-computer interfaces, a review" by Nicolas-Alfonso LF and Gomez-Gill J, with 997 citations, followed by "Brain-computer interfaces in neurological rehabilitation" by Daly J. and Wolpaw JR (708 citations). The USA, Italy, and Germany were among the most productive countries. The research hotspots shifted with time from the use of “functional magnetic imaging” to EEG-based “brain-machine interface”, “motor imagery”, and “deep learning”. Conclusions: EEG constitutes the most significant input in brain-computer interfaces (BCI) and can be successfully used in the neurorehabilitation of patients with stroke, amyotrophic lateral sclerosis, and traumatic brain and spinal injury. EEG-based BCI facilitates training, communication, and control of wheelchair and exoskeletons. However, research is limited to specific scientific groups from developed countries. Evidence is expected to change with the broader availability of BCI and improvement in EEG filtering algorithms.

Stripe rust ​​(caused by Puccinia striiformis f. sp. tritici) is one of the most devastating diseases of wheat and causes large-scale epidemics and severe yield loss. Applying fungicides during early epidemic development is crucial to controlling the disease but is often challenged by resource-limited human visual scouting. Deep learning has the potential to process images and videos captured from affordable devices to empower high-throughput phenotyping for early detection of stripe rust for timely application of fungicides and improve control efficiency. Here, we developed RustNet, a neural network-based image classifier, for efficiently monitoring fields for stripe rust. RustNet was built on a ResNet-18 architecture pre-trained with ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) dataset using transfer learning. RGB images and videos of multiple wheat fields with different wheat types (winter and spring wheat), conditions (irrigated and non-irrigated), and locations were acquired using smartphones or unmanned aerial vehicles near the canopy. A semi-automated image labeling approach was conducted to improve labeling efficiency by combining automated machine labeling and human correction. Cross-validations across multiple categories (sensor platforms, wheat types, and locations) achieved Area Under Curve from 0.72 to 0.87. Independent validation on a published dataset from Germany achieved accuracies ranging from 0.79 to 0.86. The visualization of the last convolutional layer of RustNet demonstrated the identification of pixels with stripe rust. RustNet is freely available at https://zzlab.net/RustNet.

In the present study, we investigate the post-editese phenomenon, i.e., the unique features that set machine translated post-edited texts apart from human-translated texts. We use two literary texts, namely, the English children's novel by Lewis Carroll Alice’s Adventures in Wonderland (AW) and Paula Hawkins' popular book The Girl on the Train (TGOTT) translated from English into Brazilian-Portuguese to investigate whether the post-editese features can be found on the surface of the post-edited (PE) texts. In addition, we examine how the features found in the PE texts differ from the features encountered in the human-translated (HT) and machine translation (MT) versions of the same source text. Results revealed evidence for post-editese for TGOTT only with PE versions being more similar to the MT output than to the HT texts.

Background: Gastric cancer (GC) is one of the leading malignancy diseases worldwide, especially in Asian. CAST is a potential oncogene in GC carcinogenesis process. The character of macrophage infiltration in GC microenvironment was also unaddressed. Methods: We first applied machine searching in gene candidate evaluation of GC. CAST expression was analyzed via the Human Protein Atlas (HPA) and Gene Expression Profiling Interactive Analysis 2 (GEPIA2) database. Protein-protein interaction (PPI) network was downloaded from STRING. We investigated the impact of CAST on clinical prognosis using Kaplan-Meier plotter. The correlations between CAST and Lgr5 and macrophage infiltration in GC was surveyed via TIMER 2.0. Finally, GeneMANIA was also used to evaluate the possible functional linkage between genes. Results: After machine-assisted searching, CAST expression was found signicant difference in the overall survival of GC patients. STRING revealed CAST related proteomics and transcriptomics associations, mainly about CAPN family. Moreover, CAST significantly impacts the prognosis of GC from other datasets validation. Notably, high CAST expression was correlated with worse overall survival in GC patients (hazard ratio = 1.59; logrank P = 9.4 x 10-8). CAST and Lgr5 expressions were both positively correlated with WNT 2 and WNT 2B. Among GC patients in several datasets, CAST and macrophage infiltration evaluated together showed no obvious trend toward poor clinical overall survival. Conclusion: CAST plays an important role in GC clinical prognosis and is associated with WNT 2/WNT 2B/Lgr5. Our study denmostrated that CAST in GC overall survival is regulated by macrophage infiltration.

The color and NIR spectrum are key to build an oil estimation model, thus it requires individual olives clustering before the Sohlext oil extraction method can be applied. The objective was to analyze an OC estimation model of individual olives, based on cluster of similar color and NIR spectrum in different combination of the first and/or the second season. This study was performed with Chilean Arbequina olives in 2016 and 2017. The descriptor of the cluster consisted of the 3 color channels of c1, c2, c3 color model plus 11 reflectance points between 1710 and 1735 nm of each olive, normalized with the Z-score index. Clusters of similar color and NIR spectrum were formed with the k-means++ algorithm, leaving a sufficient amount of olives to be able to perform the Sohlext analysis of OC, as reference value. The estimation models were based on the Support Vector Machine. The test was carried out with the Leave One-Out Cross Validation in different training-testing combinations. The best model predicted the OC with 6% and 13%deviation respect to the real value in one season by itself and when one season tested with another season, respectively. The use of clustering in estimation model is discussed.

Precision agriculture is a technology used by farmers to help food sustainability amidst growing population. One of the tools of precision agriculture is yield monitoring, which helps a farmer manage his production. Yield monitoring is usually done during harvest, however it could also be done early in the growing season. Early prediction of yield, specifically for fruit trees, aids the farmer in the marketing of their product and assists in managing production logistics such as labor requirement and storage needs. In this study, a machine vision system is developed to estimate fruit yield early in the season. The machine vision system uses a color camera to capture images of fruit trees during the full bloom period. An image segmentation algorithm based on an artificial neural network was developed to recognize and count the blossoms on the tree. The artificial neural network segmentation algorithm uses color information and position as input. The resulting correlation between the blossom count and the actual number of fruits on the tree shows the potential of this method to be used for early prediction of fruit yield.

In the fashion field, the use of electroplated small metal parts such as studs, clips and buckles is widespread. The plate is often made of precious metal, such as gold or platinum. Due to the high cost of these materials, it is strategically relevant and of primary importance for manufacturers to avoid any waste by depositing only the strictly necessary amount of material. To this aim, Companies need to be aware of the overall number of items to be electroplated so that it is possible to properly set the parameters driving the galvanic process. Accordingly, the present paper describes a Machine Vision-based method able to automatically count small metal parts arranged on a galvanic frame. The devised method relies on the definition of a proper acquisition system and on the development of image processing-based routines. Such a system is then implemented on a counting machine is meant to be adopted in the galvanic industrial practice to properly define a suitable set or working parameters (such as current, voltage and deposition time) for the electroplating machine and, thereby, to assure the desired plate thickness from one side and to avoid material waste on the other.

In this paper, modification of dual-Halbach permanent magnet (PM) array is investigated to improve performance of tubular linear machine, in terms of flux density and output power. Instead of a classical Halbach array with only radial and axial PMs, proposed model involves insertion of mig-magnets, which have magnetized angle shifted from the reference magnetized angles of axial and radial PMs. This structure leads to elimination of flux leakage and concentration of flux linkage in middle of the coil; therefore, the performance of machine is increased.

Neural microprobes represent an important component of neural prosthetic systems where implanted microprobes record the electro-potentials generated by specific thoughts in the brain and convey the signals to algorithms trained to interpret these thoughts. Here, we present novel elongated multi-site neural probe that can reach depths greater than 10mm. We hypothesize that reaching such depth allows the recording of cognitive signals required to drive cognitive prosthetics. The impedance of the recording sites on the probes was on the order of 500 kΩ at 1 kHz, which is consistent with probes used for neurophysiological recordings. The probes were made porous using Xenon Difluoride (XeF₂) dry etching to improve the biocompatibility and their adherence to the surrounding neural tissue. Numerical studies were performed to determine the reliability of the porous probes. We implanted the elongated probe in rats and show that the elongated probes are capable of simultaneously recording both spikes and local field potentials (LFPs) from various recording sites.

COVID-19 was a terrible worldwide pandemic that caused a global public health crisis, with numerous deaths and a severe economic depression. To suppress the spread of COVID-19 and initiate patient isolation and contact tracing to reduce its effect, early diagnosis was required, with real-time reverse transcriptase polymerase chain reaction (RT-PCR) swab test being the most widely used. However, the RT-PCR test was sometimes found to be lengthy and inaccurate and; for that reason, in many cases of severe complications of COVID-19 pneumonia, chest screening with radiography imaging was preferred. In this paper, we carried out a study for COVID-19 detection from computed tomography images, and compared the obtained results using deep learning (DL) and support vector machine (SVM). The findings showed that, despite the excellent results shown by deep learning, the accuracy in predicting COVID-19 using SVM, in the presence of small databases, was slightly higher than DL. The execution time using SVM was also shorter

This study explored the incidence of metaphorical virtual classrooms and interactive learning objects in the interaction of students in online mode. The main objective was to analyze how these digital tools, driven by a set of strategies to promote their use, affect the interaction of students in the virtual classroom system and their derived effects. To this end, the latest version of Moodle was implemented in conjunction with gamification plugins and interactive tools in the higher education institution used as a case study. The methodology consisted of data collection through ordinal instruments applied to the teachers and student performance metrics gathered using a plugin developed to extract accurate metrics of each student's usage and performance through direct queries to the Moodle database and its processing through a neural network. This facilitated the collection of standardized data on the actual metrics of each virtual classroom at the end of the teaching of each subject from both the previous LMS and the newly implemented one. This data was then analyzed using advanced statistical techniques, including Mahalanobis distances, confirmatory factor analysis, and the Wilcoxon signed-rank test. These methods provided a compelling comparison between the old and new systems, revealing significant improvements in the metrics and factors evaluated. The results showed a significant improvement in teachers' perceptions of the usability of the virtual classroom system and an increase in students' academic performance, interaction, progress, and time spent learning in virtual contexts. These results provide solid empirical evidence of the added value of these educational tools as effective strategies for improving student interaction, performance, and motivation in online education.

The advent of deep learning (DL) has revolutionized medical imaging, offering unprecedented avenues for accurate disease classification and diagnosis. DL models have shown remarkable promise for classifying brain tumor from Magnetic Resonance Imaging (MRI) scans. However, despite their impressive performance, the opaque nature of DL models poses challenges in understanding their decision-making processes, particularly crucial in medical contexts where interpretability is essential. This paper explores the intersection of medical image analysis and DL interpretability, aiming to elucidate the decision-making rationale of DL models in brain tumor classification. Leveraging state-of-the-art DL frameworks with transfer learning, we conduct a comprehensive evaluation encompassing both classification accuracy and interpretability. Using state-of-the-art DL frameworks with transfer learning, we conduct a thorough evaluation covering both classification accuracy and interpretability. We employ adaptive path-based techniques to understand the underlying decision-making mechanisms of these models. Grad-CAM and Grad-CAM++ highlight critical image regions where the tumors are located.

In recent years, the viability of employing multi-agent reinforcement learning technology for adaptive traffic signal control has been extensively validated. However, owing to restricted communication among agents and the partial observability of the traffic environment, the process of mapping road network states to actions encounters numerous challenges. To address this problem, this paper proposes a multi-agent deep reinforcement learning model with an emphasis on communication content (CMARL). The model decouples the complex relationships between multi-signal agents through centralized training and decentralized execution. Specifically, we first pass the traffic state through an improved deep neural network to achieve the extraction of high-dimensional semantic information and the learning of the communication matrix. Then the agents selectively interact with each other based on the learned communication matrix and generate the final state features. Finally, the features are inputted to the QMIX network to achieve the final action selection. We compare the CMARL model with 6 other baseline algorithms in real traffic networks. The results show that CMARL can significantly reduce vehicle congestion, and run stably in various scenarios.

This study addressed the need for efficient data collection in micro-mobility using low-end hardware, focusing on developing a system capable of handling large real-time data streams. We proposed a novel data collection system that leverages incremental learning techniques, enabling AI-based services for micro-mobility passengers through smartphones. Our approach utilizes 3-axis acceleration sensors integrated into micro-mobility devices, collecting motion data in real-time. This data is processed through an incremental learning pre-processing server, employing the Broad Learning System algorithm, to ensure robust performance in noisy, real-world environments. The use of incremental learning is pivotal, allowing our system to adapt continuously to new data, enhancing the accuracy and relevance of the AI services provided to passengers. This research not only advances the technical capabilities in micro-mobility data handling but also has the potential to enhance the overall passenger experience through improved AI-based services.

When analyzing user geospatial information through deep learning methods, it is typically necessary to annotate existing geospatial data. Currently, manual annotation methods are commonly employed, suffering from issues related to low efficiency and accuracy. This design is based on the TensorFlow deep learning framework and first realizes the BiLSTM+CRF+AGG deep learning model. Among the models, AGG is the aggregation layer, which is introduced to solve the problem of solid particle size equilibrium. Secondly, based on the characteristics of original data and professional data, an automatic labeling algorithm is proposed. The algorithm first preprocesses the acquired original data set and professional data set, The most valuable unlabeled data set which can make the training model converge quickly is selected from the original data set as the target data set. Sort the target data set based on preset rules and set annotation parameters for the sorted target data set. Based on the set annotation parameters, the corpus is synthesized and used as the annotation result. Thirdly, based on the active learning strategy, a manual annotation auxiliary scheme is proposed, and an Excel generation module that is convenient for manual annotation correction is designed and developed to further improve the efficiency and quality of annotation through iterative processing. The combination of the BiLSTM+CRF+AGG deep learning model and high-quality annotation can accurately identify non-standard, incomplete, or even incorrect geographical information entities. This annotation method has found successful practical application within the context of the research project and has been granted an invention patent.

Abstract:The objects of fine-grained image categories(e.g., bird species) are various subclass under different categories. Because the differences between subclass are very subtle and most of them are concentrated in multiple local areas, the task of fine-grained image recognition is very challenging. At the same time, some fine-grained networks tend to focus on a certain region when judging the target category, resulting in the lack of other auxiliary regional features. To this end, Inception V3 is used as the backbone network, and an enhanced and complementary fine-grained image classification network is designed. While adopting the method of reinforcement learning to obtain more detailed fine grain image features, the complementary network can obtain the complementary discriminant area of the target through the method of attention erasure to increase the network's perception of the overall target. Finally, experiments are conducted on CUB-200-2011, FGVC Aircraft and Stanford dogs three open datasets. The experimental results show that the proposed model has better performance.

A topic of growing interest in urban remote sensing is the automated extraction of geometrical building information for 3D city modeling. Roof geometry information is useful for applications such as urban planning, solar potential estimation and telecommunication installation planning, and wind flow simulations for pollutant diffusion analysis. Recent research has proven that the advance in remote sensing technologies and deep learning methods offer the prospects of deriving the roof structure information accurately and efficiently. In this study, we propose a Vectorized Roof Extractor- method based on Fully Convolutional Networks (FCNs) and advanced polygonization method to extract roof structure from aerial imagery and a normalized Digital Surface Models (nDSM) in a regularized vector format. The roof structure consists of building outlines, external edges of the building roof, inner rooflines, internal intersections of the main roof planes. The methodology is comprised of segmentation, vectorization and post-processing for outer rooflines, external edges of the building roof, and inner rooflines, and internal intersections of the main roof planes. For the comparison, we adapt the Frame field Learning (FFL) method originally designed to extract building polygons [1]. Our experiments are conducted on a custom data set derived for the city of Enschede, The Netherlands, using aerial imagery, nDSM and manually digitized training polygons. The results show that the proposed Vectorized Roof Extractor outperformed adapted FFL on PoLiS distance with values of 3.5 m and 1.2 m for outlines and inner rooflines, respectively. Furthermore, the model surpassed the adapted FFL on PoLiS-thresholded F-score for outlines and inner rooflines, with 0.31 and 0.57, respectively. The Vectorized Roof Extractor produced adequate visual results, with straighter walls and fewer missed inner roofline detections. It can predict buildings with common walls thanks to skeleton graph computation. To summarize, the proposed method is suitable for urban applications and has the potential to be improved further.

"Finding fresh water in the ocean of data." is a challenge that all deep learning domains struggle with, especially in the area of hyperspectral image analysis. As hyperspectral remote sensing technology advances by leaps and bounds, there are increasing amounts of hyperspectral images(HSIs) can be available. Whereas in fact, these unlabeled HSIs are powerless to be used as material to driven a supervised learning task due to the extremely expensive labeling costs and some unknown regions. Although learning-based methods have achieved remarkable performance due to their superior ability to represent features, at the cost, these methods are complex, inflexible and tough to carry out transfer learning. In this paper, we propose the "Instructional Mask AutoEncoder"(IMAE), which is a simple and powerful self-supervised learner for HSI classification that uses a transformer-based mask autoencoder to extract the general features of HSIs through a self-reconstructing agent task. Moreover, we utilize the metric learning to perform an instructor which can direct the model focus on the human interested region of the input so that we can alleviate the defects of transformer-based model such as local attention distraction, lack of inductive bias and tremendous training data requirement. In downstream forward propagation, instead of global average pooling, we employ a learnable aggregation to put the tokens into fullplay. The obtained results illustrate that our method effectively accelerates the convergence rate and promotes the performance in downstream task.

The Kuwaiti dialect is a particular dialect of Arabic spoken in Kuwait; it differs significantly from standard Arabic and the dialects of neighboring countries in the same region. Few research papers with a focus on the Kuwaiti dialect have been published in the field of NLP. In this study, we created Kuwaiti dialect language resources using Q8VaxStance, a vaccine stance labeling system for a large dataset of tweets. This dataset will fill this gap and provide a valuable resource for researchers studying vaccine hesitancy in Kuwait. Furthermore, it will contribute to the Arabic natural language processing field by providing a dataset for developing and evaluating machine learning models for stance detection in the Kuwaiti dialect. The proposed vaccine stance labeling system combines the benefits of weak supervised learning and zero-shot learning; for this purpose, we implemented 52 experiments on 42815 unlabeled tweets extracted between December 2020 and July 2022. The results of the experiments show that using keyword detection in conjunction with zero-shot model labeling functions is significantly better than using only keyword detection labeling functions or just zero-shot model labeling functions. Furthermore, using the Arabic language in both the labels and prompt or a mix of Arabic labels and an English prompt is statistically significant compared to using English in both the labels and prompt for the total number of generated labels evaluation metric. Finally, the best accuracy for Macro-F1 values were found in the experiments KHZSLF-EE4 and KHZSLF-EA1, with values of 0.83 and 0.83, respectively. And, for the total automatically labeled data evaluation metric, experiment KHZSLF-EE4 labeled 42,270 tweets, while experiment KHZSLF-EA1 was able to generate 42,764 labels.

Bone metastasis detection and quantification on bone scintigraphy is challenging and clinical important for treatment and patient’s life quality. To develop a CNN based diagnostic system for automated segmentation on bone metastasis regions is non-trivial, especially for a small dataset. A dataset in house comprising 100 breast cancer patients and 100 prostate cancer patients is utilized for this research. The Double U-Net model is adapted through the integration of background removal, adding negative samples, and transfer learning methods for bone metastasis detection. The performance is investigated via 10-fold cross-validation and computed in pixel-wise scale. The best model we achieved has precision of 63.08%, sensitivity of 70.82%, and F1-score of 66.72%. The developed system has the potential to provide pre-diagnostic reports for physicians in final decisions and the calculation of the bone scan index (BSI) with the combination with bone skeleton segmentation.

Industrial data scarcity is one of the largest factors holding back the widespread use of machine learning in manufacturing. To overcome this problem, the concept of transfer learning was developed and it achieved high attention in recent industrial research. Our paper focuses on the problem of time series segmentation and presents the first in-depth research about transfer learning for deep-learning based time series segmentation on the example of industrial end-of-line pump testing. In particularly, we investigate if the performance of deep learning models can be increased by pretraining the network with data from other domains. Three different scenarios are analyzed: source and target data being closely related, source and target data being distantly related, and source and target data being non-related. The results demonstrate that transfer learning can enhance the performance of time series segmentation models in respect to accuracy and training speed. The benefit is most clearly seen in scenarios where source and training data are closely related and the number of target training data samples is lowest. However, in the scenario of non-related datasets, cases of negative Transfer Learning were observed as well. Thus, the research emphasizes the potential, but also the challenges of industrial Transfer Learning.

Protein phosphorylation and ADP-ribosylation (ADPr), as two types of post-translational modifications (PTM), are the process of adding phosphate group and ADP-ribose moieties to proteins, respectively. Although both PTM types can occur on many amino acid types, serine is the most common. Serine phosphorylation (pS), serine ADPr (SADPr), and their in situ crosstalks (pSADPr) play essential roles in biological processes. Although in silico classifiers have been developed for predicting pS and SADPr sites, the classifier for predicting pSADPr sites is unavailable. In this study, we developed classifiers to predict pSADPr sites. Specifically, we collected 3250 human pSADPr, 7520 SADPr, 151,227 pS and 80,096 unmodified serine sites. Based on them, we investigated the characteristics of pSADPr sites and constructed three classifiers to predict pSADPr sites from the pS dataset, the SADPr dataset and the protein sequences separately. We built and evaluated five deep-learning classifiers in ten-fold cross-validation and independent test datasets. Three of them (e.g. Convolutional Neural Network with the One-Hot encoding, dubbed CNNOH) performed better than the rest two. For instance, CNNOH had the AUC values of 0.700, 0.914 and 0.954 for recognizing pSADPr sites from the SADPr, pS and unmodified serine sites.Therefore, it is challenging to distinguish pSADPr sites from SADPr sites compared to the other two. It is consistent with our observation that pSADPr's characteristics are more similar to those of SADPr than the rest. Furthermore, we used the classifiers as base classifiers to develop a few stacking-based ensemble classifiers to improve performance. However, none of the ensemble classifiers showed better performances, suggesting that the base classifiers have good enough performances. Finally, we developed an online tool for extensively predicting human pSADPr sites based on the CNNOH classifier, dubbed EdeepSADPr. It is freely available through http://edeepsadpr.bioinfogo.org/.

Coronavirus disease since December 2019 has significantly affected millions of people. Given the effect this disease has on the pulmonary systems of humans, there is a need for chest radiographic imaging (CXR) for monitoring the disease and preventing further deaths. Several studies have been shown that Deep Learning models can achieve promising results for COVID-19 diagnosis towards the CXR perspective. However, this research field is at an initial stage since there is a limited number of large CXR repositories regarding COVID-19. In this study, five deep learning models were analyzed and evaluated with the aim of identifying COVID-19 from chest X-Ray images. More specifically, we utilized the ResNet50, ResNet101, DenseNet121, DenseNet169 and InceptionV3 using Transfer Learning. All models were trained and validated on the largest publicly available repository for COVID-19 CXR images. Furthermore, they were evaluated on unknown data as well, that was not used for training or validation, authenticating their performance, and clarifying their usage in a medical scenario. All models achieved satisfactory performance where ResNet101 was the superior model achieving 96% in Precision, Recall, and Accuracy. Our outcomes show the potential of deep learning models on COVID-19 medical offering a promising way for the deeper understanding of COVID-19.

The keyless systems have replaced the old fashion methods of inserting physical keys in the keyhole to, i.e., unlock the door, because they are inconvenient and easy to be exploited by the threat actors. Keyless systems use the technology of radio frequency (RF) as an interface to transmit signals from the key fob to the vehicle. However, Keyless systems are susceptible to being compromised by a thread actor who intercepts the transmitted signal and performs a reply attack. In this paper, we propose a transfer learning-based model to identify the replay attacks launched against remote keyless controlled vehicles. Specifically, the system makes use of a pre-trained ResNet50 deep neural network to predict the wireless remote signals used to lock or unlock doors of a remote-controlled vehicle system remotely. The signals are finally classified into three classes: real signal, fake signal high gain, and fake signal low gain. We have trained our model with 100 epochs (3800 iterations) on a KeFRA 2022 dataset, a modern dataset. The model has recorded a final validation accuracy of 99.71% and a final validation loss of 0.29% at a low inferencing time of 50 ms for the model-based SGD solver. The experimental evaluation revealed the supremacy of the proposed model.

Online reinforcement learning (RL) algorithms are increasingly used to personalize digital interventions in the fields of mobile health and online education. Common challenges in designing and testing an RL algorithm in these settings include ensuring the RL algorithm can learn and run stably under real-time constraints, and accounting for the complexity of the environment, e.g., a lack of accurate mechanistic models for the user dynamics. To guide how one can tackle these challenges, we extend the PCS (Predictability, Computability, Stability) framework, a data science framework that incorporates best practices from machine learning and statistics in supervised learning (Yu and Kumbier, 2020), to the design of RL algorithms for the digital interventions setting. Further, we provide guidelines on how to design simulation environments, a crucial tool for evaluating RL candidate algorithms using the PCS framework. We illustrate the use of the PCS framework for designing an RL algorithm for Oralytics, a mobile health study aiming to improve users' tooth-brushing behaviors through the personalized delivery of intervention messages. Oralytics will go into the field in late 2022.

Regardless of country and age, the importance of history education is always being emphasized. Although the importance of history education is being emphasized in Korea, there are many difficulties in getting students to understand history properly through school classes alone, and it is also difficult to attract students to participate in classes. The effectiveness of education using games has been proven 20 years ago, and the demand for game-based education is gradually increasing in the current education world, which is becoming more open. In this paper, based on the effects proven through research on the existing game-based education, the improvement of historical thinking ability, experiential history learning, and the problems of game-based education introduced in the ESN report and the discomfort of teachers who participated in the education were improved. A plan was suggested to select and use games suitable for basic education. In this thesis, we selected a history game with a clear historical and periodic background and without distortion of history, and experimented with teaching using games focusing on historical thinking and empirical history learning. The learning achievement of textbook-based education was compared.

Regardless of country and age, the importance of history education is always being emphasized. Although the importance of history education is being emphasized in Korea, there are many difficulties in getting students to understand history properly through school classes alone, and it is also difficult to attract students to participate in classes. The effectiveness of education using games has been proven 20 years ago, and the demand for game-based education is gradually increasing in the current education world, which is becoming more open. In this paper, based on the effects proven through research on the existing game-based education, the improvement of historical thinking ability, experiential history learning, and the problems of game-based education introduced in the ESN report and the discomfort of teachers who participated in the education were improved. A plan was suggested to select and use games suitable for basic education. In this thesis, we selected a history game with a clear historical and periodic background and without distortion of history, and experimented with teaching using games focusing on historical thinking and empirical history learning. The learning achievement of textbook-based education was compared.

In software development, developers received bug reports that describe the software bug. Developers find the cause of bug through reviewing the code and reproducing the abnormal behavior that can be considered as tedious and time-consuming processes. The developers need an automated system that incorporates large domain knowledge and recommends a solution for those bugs to ease on developers rather than spending more manual efforts to fixing the bugs or waiting on Q&A websites for other users to reply to them. Stack Overflow is a popular question-answer site that is focusing on programming issues, thus we can benefit knowledge available in this rich platform. This paper, presents a survey covering the methods in the field of mining software repositories. We propose an architecture to build a recommender System using the learning to rank approach. Deep learning is used to construct a model that solve the problem of learning to rank using stack overflow data. Text mining techniques were invested to extract, evaluate and recommend the answers that have the best relevance with the solution of this bug report.

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher accuracy than a strong baseline trained on 8 times more data. Our method leverages knowledge contained in pre-trained speech representations extracted from models trained on a more general self-supervised task which doesn’t require human annotations, such as the wav2vec model. We provide detailed insights on the benefits of our approach by varying the training data size, which can help labeling teams to work more efficiently. We compare performance with other popular methods on the IEMOCAP dataset, a well-benchmarked dataset among the Speech Emotion Recognition (SER) research community. Furthermore, we demonstrate that results can be greatly improved by combining acoustic and linguistic knowledge from transfer learning. We align acoustic pre-trained representations with semantic representations from the BERT model through an attention-based recurrent neural network. Performance improves significantly when combining both modalities and scales with the amount of data. When trained on the full IEMOCAP dataset, we reach a new state-of-the-art of 73.9% unweighted accuracy (UA).

Deep learning models are part of the family of artificial neural networks and, as such, it suffers of catastrophic interference when they learn sequentially. In addition, most of these models have a rigid architecture which prevents the incremental learning of new classes. To overcome these drawbacks, in this article we propose the Self-Improving Generative Artificial Neural Network (SIGANN), a type of end-to-end Deep Neural Network system which is able to ease the catastrophic forgetting problem when leaning new classes. In this method, we introduce a novelty detection model to automatically detect samples of new classes, moreover an adversarial auto-encoder is used to produce samples of previous classes. This system consists of three main modules: a classifier module implemented using a Deep Convolutional Neural Network, a generator module based on an adversarial autoencoder; and a novelty detection module, implemented using an OpenMax activation function. Using the EMNIST data set, the model was trained incrementally, starting with a small set of classes. The results of the simulation show that SIGANN is able to retain previous knowledge with a gradual forgetfulness for each learning sequence. Moreover, SIGANN can detect new classes that are hidden in the data and, therefore, proceed with incremental class learning.

In order for robots to attain more general-purpose utility, grasping is a necessary skill to master. Such general-purpose robots may use their perception abilities in order to visually identify grasps for a given object. A grasp describes how a robotic end-effector can be arranged on top of an object to securely grab it between the robotic gripper and successfully lift it without slippage. Traditionally, grasp detection requires expert human knowledge to analytically form the task-specific algorithm, but this is an arduous and time-consuming approach. During the last five years, deep learning methods have enabled significant advancements in robotic vision, natural language processing, and automated driving applications. The successful results of these methods have driven robotics researchers to explore the application of deep learning methods in task generalised robotic applications. This paper reviews the current state-of-the-art in regards to the application of deep learning methods to generalised robotic grasping and discusses how each element of the deep learning approach has improved the overall performance of robotic grasp detection. A number of the most promising approaches are evaluated and the most successful for grasp detection is identified as the one-shot detection method. The availability of suitable volumes of appropriate training data is identified as a major obstacle for effective utilisation of the deep learning approaches, and the use of transfer learning techniques is identified as a potential mechanism to address this. Finally, current trends in the field and future potential research directions are discussed.

The current study characterizes the transient M/M/1 queue manifold info-geometrically, through devising Fisher Information matrix(FIM) and its inverse(IFIM). Additionally, the impact of stability on the existence of IFIM and explore the geodesic equations of motion has been revealed. More potentially, the paper discusses some info-geometric applications to Machine Learning are highlighted. Closing remarks with some challenging open problems combined with the next phase of research are given.

The combination of artificial intelligence algorithms and numerical methods has recently become popular in the prediction of macroscopic and microscopic hydrodynamics parameters of bubble column reactors. The multi inputs and outputs machine learning can cover small phase interactions or large fluid behavior in industrial domains. This numerical combination can develop the smart multiphase bubble column reactor with the ability of low-cost computational time. It can also decrease case studies for the optimization process when big data is appropriately used during learning. There are still many model parameters that need to be optimized for a very accurate artificial algorithm, including data processing and initialization, the combination of inputs and outputs, number of inputs and model tuning parameters. For this study, we aim to train four inputs big data during learning process by an adaptive neuro-fuzzy inference system or adaptive-network-based fuzzy inference system (ANFIS) method, and we consider the superficial gas velocity as one of the input variables, while for the first time, one of the computational fluid dynamics (CFD) outputs named gas velocity is used as an output of the artificial algorithm. The results show that the increasing number of input variables improves the intelligence of the ANFIS method up to , and the number of rules during learning process has a significant effect on the accuracy of this type of modeling. The results also show that propper selection of model parameters results in more accuracy in prediction of the flow characteristics in the column structure.

Recently, there has been, on the one hand, an increase in the complexity of digital device designs and, on the other hand, an increase in the requirements for the development time and the reliability of the designs. One of the directions of solving this problem is developing new techniques for designing digital devices.This paper proposes a new technique for designing digital devices based on finite state machines with datapath (FSMD), when the functioning of the device is described in the form of an algorithm state machine with datapath (ASMD) charts. The new technique is called ASMD-FSMD. Different digital device design techniques are compared to each other using design examples of a synchronous multiplier on field programmable gate array (FPGA). The efficiency of the ASMD-FSMD technique compared to the traditional approach in terms of area and performance was investigated. The ASMD-FSMD technique, compared to the traditional one, reduces the area from 28.6% to 39.7% and increases the speed for some designs to 17.6%. In addition, using the ASMD-FSMD technique significantly reduces design time and increases design reliability. In conclusion, recommendations for using the ASMD-FSMD technique are made.

Robotic systems are crucial in modern manufacturing. Complex assembly tasks require the collaboration of multiple robots. Their orchestration is challenging due to tight tolerances and precision requirements. In this work we set up two Franka Panda robots performing a peg-in-hole insertion task. We structure the control system hierarchically, planning the robots’s trajectories feedback-based with a central policy trained with reinforcement learning. These trajectories are executed by a low-level impedance controller on each robot. To enhance training convergence, we use reverse curriculum learning incorporating domain randomization, varying initial configurations of the task. After training, we test the system in a simulation, studying the impact of curriculum parameters on emerging process characteristics like process time and variance. Finally, we transfer the trained model to a real-world setup, comparing results with simulation as well as classical path planning and control approaches.

Background: Ovarian, cervical, and endometrial cancers stand as fatal health killers for women's mental and physical health, especially affecting female reproductive systems. Exploiting weakly supervised learning and explainable AI techniques are crucial for fast, accurate, and robust automatic marker detection, efficient prevention, and primary treatment of gynecological tumors. Methods: With respect to the PRIMSA methodology, weakly supervised learning schemes and deep learning-based schemes are investigated in the cross-subject fields of clinical diagnostic imaging and explainable AI technology. Related methods, opening research problems, and challenging subjects are explored in the screening and treatment of gynecological tumors and performing cancer image diagnosis in the latest study. Results: Keynote approaches combining ultrasound medicine, explainable AI, and clinical imaging technology are summarized. In combination with learning-based methods with medical imaging, prospective insights are put forward for refreshed concepts on treatments in the area of gynecological oncology, with a feasible range of applications for their corresponding AI techniques. Conclusions: Explainable AI and deep learning-based approaches are capable of performing accurate classification between benign and malignant tumors, yielding a pathway to care for women's health, improving the survival rate of patients, pacing with disease prediction, and matching the strategic goal of "Healthy China 2030".

Hyperspectral small target detection (HSTD) is a promising pixel-level detection task. However, due to the low contrast and imbalance number between the target and background spatially and high dimensions spectrally, it is a challenging one. To address these issues, this work proposes a representation learning-based graph and generative network for hyperspectral small target detection. The model builds a fusion network through frequency representation for HSTD, where the novel architecture incorporates irregular topological data and the spatial-spectral feature to improve its representation ability. Firstly, a graph convolutional network (GCN) module better models the non-local topological relationship between samples to represent the hyperspectral scene’s underlying data structure. The mini-batch-training pattern of the GCN decreases the high computational cost of building an adjacency matrix for high-dimensional data sets. In parallel, the generative model enhances the differentiation reconstruction and the deep feature representation ability with respect to the target spectral signature. Finally, a fusion module compensates for the extracted different types of HS features and integrates their complementary merits for hyperspectral data interpretation while increasing detection and background suppression capabilities. Experiments on different hyperspectral data sets demonstrate the advantages of the proposed architecture.

This research presents the Cross-Cultural Intelligent Language Learning System (CILS), a novel approach integrating Artificial Intelligence (AI) into language education to enhance cross-cultural communication. CILS utilizes advanced AI technologies to provide adaptive, personalized learning experiences that cater to the unique linguistic and cultural backgrounds of each learner. By dynamically adjusting content and methodology, CILS significantly improves linguistic proficiency and cultural understanding, essential for effective global interactions. The implementation of CILS in platforms such as Busuu and HelloTalk has demonstrated marked improvements in engagement and communication skills among learners. Empirical studies validate the system's effectiveness in real-world settings, showing enhanced learner performance and increased intercultural competence. Additionally, the Technology Acceptance Model (TAM) applied confirms that the usability and perceived usefulness of AI-driven systems strongly influence learner acceptance and sustained use. This study not only underscores the potential of AI in transforming language education but also highlights the critical role of cultural sensitivity in designing educational technologies.

This research introduces a pioneering solution to the challenges posed by gastrointestinal tract (GI) cancer in radiation therapy, focusing on the imperative task of precise organ segmentation for minimizing radiation-induced damage. GI imaging has historically used manual demarcation, which is laborious and uncomfortable for patients. We address this by introducing the ResECA-U-Net deep learning model, a novel combination of the UNet and ResNet34 architectures. Furthermore, we further augment its functionality by incorporating the Efficient Channel Attention (ECA-Net) methodology. By utilizing data from the UW-Madison Carbone Cancer Centre, we carefully investigate several image processing techniques designed to capture critical local characteristics. With its foundation in computer vision concepts, the ResECA-U-Net model is excellent at extracting fine details from GI images. Sophisticated metrics such as intersection over union (IoU) and the dice coefficient are used to evaluate performance. Our study's outcomes demonstrate the effectiveness of the suggested method, yielding an impressive 96.27% Dice coefficient and 91.48% IoU. These results highlight the significant contribution that our strategy has made to the advancement of cancer therapy. Beyond its scientific merits, this work has the potential to significantly enhance cancer patients' quality of life and provide better long-term outcomes. Our work is a significant step towards automating and optimizing the segmentation process, which can potentially change how GI cancer is treated completely.

With the popularity of solar energy in the electricity market, demand arises for data such as precise locations of solar panels for efficient energy planning, management, and distribution. However, this data is not easily accessible and in some cases, information such as precise locations does not exist. Furthermore, existing data sets for training semantic segmentation models of PV installations are limited, and their annotation is time-consuming and labor-intensive. Therefore, for additional remote sensing (RS) data creation, the pix2pix generative adversarial network (GAN) is utilized, enriching the original resampled training data of varying GSDs without compromising its integrity. Experiments done with the DeepLabV3 model, ResNet-50 backbone, and pix2pix GAN architecture were conducted to find the optimal configuration for an accurate RS imagery segmentation model. The result is a fine-tuned solar panel semantic segmentation model, trained using transfer learning and utilizing an optimal amount – 60% of generated RS imagery for additional training data, increasing model accuracy. The findings demonstrate the benefits of using GAN-generated images as additional training data, increasing the size of small data sets, and improving the capabilities of the segmentation model for solar panel detection in RS images.

With the widespread Application of Virtual Reality (VR) in education, optimizing foreign language learning in VR has become a focal point of research. This paper introduces a comprehensive theoretical framework (VR-CCL) based on constructivism and cognitive load theory to enhance foreign language learning in VR. Through a literature review, we explore the applications of VR in education, foreign language learning theories, and prior works on technology-assisted language learning. We further detail the three main components of the VR-CCL framework and validate its effectiveness through two case studies: Duolingo VR and Rosetta Stone VR. Finally, we discuss the strengths and limitations of the framework and its implications for educators and developers.

This paper presents a two-stage hierarchical neural network using image classification and object detection algorithms as key building blocks for a system that automatically detects a potential design right infringement. This neural network is trained to return the Top-N original design right records that highly resemble the input image of a counterfeit. Design rights specify the unique aesthetic characteristics of a product. Due to the rapid change of trends, new design rights are continuously generated. This work proposes an Ensemble Neural Network (ENN), an artificial neural network model that aims to deal with a large amount of counterfeit data and design right records that are frequently added and deleted. At first, we performed image classification and objection detection learning per design right using the existing models with a proven track record of high accuracy. The distributed models form the backbone of the ENN and yield intermediate results aggregated at a master neural network. This master neural network is a deep residual network paired with a fully connected network. This ensemble layer is trained to determine the sub-models that return the best result for a given input image of a product. In the final stage, the ENN model multiples the inferred similarity coefficients to the weighted input vectors produced by the individual sub-models to assess the similarity between the test input image and the existing product design rights to see any sign of violation. Given 84 design rights and the sample product images taken meticulously under various conditions, our ENN model achieved average Top-1 and Top-3 accuracies of 98.409% and 99.460%, respectively. Upon introducing new design rights data, a partial update of the inference model was done an order of magnitude faster than the single model. ENN maintained a high level of accuracy as it scaled out to handle more design rights. Therefore, the ENN model is expected to offer practical help to the inspectors in the field, such as the customs at the border that deal with a swarm of products.

Agriculture is one of the indispensable fields for the survival of mankind. Potatoes also have a significant role in the field of agriculture. The quality and quantity of potatoes are significantly impacted by several diseases, such as early blight and late blight, and manual interpretation of these leaf diseases is time-consuming and inconvenient. Fortunately, leaf appearance is used to detect diseases in potato plants. Productivity will considerably rise if the infections are detected early. Different types of image processing methods and machine learning methods are used for early recognition of those diseases from leaf images so that the product losses are decreased significantly. For the incredible and marvelous performance of CNN, it is the most popular deep learning method that is used immensely for the recognition of leaf diseases from images. Several pretrained deep learning models, such as VGG16, ResNet50, InceptionV3, MobileNetV2, Xception, and a deep learning model developed using CNN, are employed for potato leaf disease classification and recognition on the same dataset. The transfer learning technique is applied to the pretrained model and the data augmentation technique is applied to the Proposed CNN model for potato disease classification from leaf samples. Compared to pretrained models, the proposed CNN model offers the lowest loss and highest accuracy for potato leaf disease detection while using fewer parameters and layers. It achieves the best performance with a test accuracy of 99.33% compared to other Pretrained models used in the diagnosis of potato leaf disease.

Aiming at the problem of hypersonic morphing vehicle avoiding no-fly zones and reaching the target, an improved predictor-corrector guidance method is proposed. Firstly, the aircraft motion model and the constraint model are established. Then, the basic algorithm is given, the Q-learning method is used to design the attack angle and sweep angle scheme to ensure that the aircraft can fly over the low-altitude zones. The B-spline curve is used to design the location of flight path points and the bank angle scheme is designed according to the predictor-corrector method, so that the aircraft can fly around to avoid high-altitude zones. Next, Monte Carlo reinforcement learning(MCRL) method is used to improve predictor-corrector method and Deep Neural Network(DNN) is used to fit reward function. The improved method can generate trajectory with better performance. Simulation results verify the effectiveness of the proposed algorithm.

This study investigates how digital alchemy can enhance literature and language teaching through a combination of online and face-to-face learning. It uses constructivist learning theory and the SAMR model to examine how digital tools and resources can transform learner engagement, critical thinking, and creativity. The study gathered data from interviews, focus groups, and document analysis with 30 participants from private HEI schools. The results show that digital alchemy through blended learning allows learners to personalize and collaborate in their exploration of various literary texts. However, the study also identifies some challenges related to resource availability and educator training. The study emphasizes the importance of using digital alchemy in literature and language teaching and suggests some ways for educators, administrators, and policymakers to effectively use digital tools and resources for student-centered teaching methods in the digital era.

Every month teachers face the dilemma of what exercises should their students practice, and what their consequences are on long-term learning. Since teachers prefer to pose their own exercises, this generates a large number of questions, each one attempted by a small number of students. Thus, we couldn’t use models based on big data such as deep learning. Instead, we developed a simple to understand state-space model that predicts end-of-year national test scores. We used 2,386 online fourth-grade mathematic questions designed by teachers and each attempted by some of the 500 students in 24 low socioeconomic schools. We found that the state-space model predictions improved month-by-month and that in most months it outperformed linear regression models. Moreover, the state-space estimator provides for each month a direct mechanism to simulate different practice strategies and compute their impact on the end-of-year standardized national test. We built iso-impact curves based on two critical variables: the number of questions solved correctly in the first attempt and the total number of exercises attempted. This allows the teacher to visualize the trade-off between asking students to do exercises more carefully or doing more exercises. To the best of our knowledge, this model is the first of its kind in education. It is a novel tool that supports teachers drive whole classes to achieve long-term learning targets.

Freezing of Gait (FOG) is an impairment that affects the majority of patients in the advanced stages of Parkinson’s Disease (PD). FOG can lead to sudden falls and injuries, negatively impacting the quality of life for the patients and their families. Rhythmic Auditory Stimulation (RAS) can be used to help patients recover from FOG and resume normal gait. RAS might be ineffective due to the latency between the start of a FOG event, it’s detection and initialization of RAS. We propose a system capable of both FOG prediction and detection using signals from tri-axial accelerometer sensors that will be useful in initializing RAS with minimal latency. We compared the performance of several time frequency analysis techniques, including moving windows extracted from the signals, handcrafted features, Recurrence Plots (RP), Short Time Fourier Transform (STFT), Discreet Wavelet Transform (DWT) and Pseudo Wigner Ville Distribution (PWVD) with Deep Learning (DL) based Long Short Term Memory (LSTM) and Convolutional Neural Networks (CNN). We also propose three Ensemble Network Architectures that combine all the time frequency representations and DL architectures. Experimental results show that our ensemble architectures significantly improve the performance compared with existing techniques. We also present the results of applying our method trained on publicly available dataset to data collected from patients using wearable sensors in collaboration with A.T. Still University.

Language learners often face communication problems when they need to express themselves and do not have this ability. On the other hand, continuous advances in technology create new opportunities to improve second language (L2) acquisition through context-aware ubiquitous learning (CAUL) technology. Since vocabulary is the foundation of all language acquisition, this article presents the ULearnEnglish, an open-source system to allow ubiquitous English learning focused on incidental vocabulary acquisition. To evaluate the proposal, 15 learners used the system developed, and 10 answered a survey based on the Technology Acceptance Model (TAM). Results indicate a favorable response to the use of the learner context to assist them in their learning. The ULearnEnglish achieved an acceptance of 78.66% for the perception of the utility, 96% for the perception of ease of use, 86% for user context assessment, and 88% for ubiquity. This study presented a positive response in using the location of users to assist their learning. Among the main contributions, this study demonstrates an opportunity for ubiquity use in future research in language learning. Also, furthers studies can use the source available to evolve the model and system.

The COVID-19 pandemic forced the transition to emergency online learning without prior preparation or guidelines. This transition has been particularly challenging in developing countries and low-resource contexts and hindered student engagement. We aim to identify the engagement strategies which students, engaging in emergency online learning in low-resource contexts, perceive to be effective. We conducted a sequential mixed-methods study based on Moore’s interaction framework for distance education. First, we conducted a literature review and interviewed ten teachers and ten students to identify a list of engagement strategies. Then, we designed a questionnaire that examines student perceptions of these strategies. We administered the questionnaire to 313 students engaging in emergency online learning in low-resource contexts. Our analysis results showed that student-content engagement strategies, e.g. screen sharing, summaries, and class recordings, are perceived as the most effective, closely followed by student-teacher strategies, e.g. Q&A sessions and reminders. Student-student strategies, e.g. group chat and collaborative work, are perceived as the least effective. The perceived effectiveness of engagement strategies depends on the context and the students’ characteristics, e.g. gender, major, and technology access. To support instructors, instructional designers, and researchers we propose a ten-level guide for engaging students during emergency online classes in low-resource contexts.

Metabolomics analysis generates vast arrays of data, necessitating comprehensive workflows involving expertise in analytics, biochemistry and bioinformatics, in order to provide coherent and high-quality data that enables discovery of robust and biologically significant metabolic findings. In this protocol article, we introduce NoTaMe, an analytical workflow for non-targeted metabolic profiling approaches utilizing liquid chromatography–mass spectrometry analysis. We provide an overview of lab protocols and statistical methods that we commonly practice for the analysis of nutritional metabolomics data. The paper is divided into three main sections: the first and second sections introducing the background and the study designs available for metabolomics research, and the third section describing in detail the steps of the main methods and protocols used to produce, preprocess and statistically analyze metabolomics data, and finally to identify and interpret the compounds that have emerged as interesting.

This study assesses the development of professional skills in university students using serious games (SG), from a sustainability perspective. The Sustainable Development Goals (SDGs) were set by the United Nations’ 2030 Agenda for Sustainable Development. Universities are strategic agents in the transformation process towards sustainability. This way, they should be committed to promoting such sustainable values in the students through curricular sustainability, implementing active methodologies and SG for that purpose. Transversal skills are essential for the development of future graduates. The objective of this study was to assess which professional skills should be developed through the SG called The Island, to improve the degree of student satisfaction with the incorporation of a sustainable curriculum. The data were obtained using a questionnaire, and then analysed using linear regression models, with their inference estimated through the goodness of fit and ANOVA. The first results indicated that the implementation of the SG promoted a strengthening of the students' sustainable curriculum through the development of those skills. It was concluded that the key to success in education for sustainable development is improving the development of strategic thinking, collaborative thinking, and self-awareness, in addition to encouraging systemic, critical, and problem-solving thinking.

Automatic Milking Systems (AMS) are revolutionizing the dairy industry by boosting herd effi-ciency, primarily through increased milk yield per cow and reduced labor costs. The performance of milking machines, whether traditional or automated, can be evaluated using advanced vacuum meters through dynamic testing. This process involves scrutinizing the system and milking rou-tine to identify critical points, utilizing the VaDia™ logger (BioControl AS, Rakkestad, NO). Vacuum recordings were downloaded and analyzed using the VaDia Suite™ software under the guidance of a milking specialist. Access to data from AMS across various manufacturers and herds facilitated a retrospective study aimed at describing and comparing key milk emission parameters for different AMS brands while identifying potential mastitis risk factors. Using proper statistical procedures of SPSS 29.1 (IBM Corp, USA), researchers analyzed data from 4,878 individual quarter milkings from cows in 48 dairy herds. Results indicated significant variability in milking pa-rameters associated to quarter milk yield and AMS brand. Notably, despite AMS standardizing teat preparation and stimulation, the study revealed a surprisingly high frequency of two major mastitis risk factors—bimodality and irregular vacuum fluctuations—occurring more frequently than in conventional milking systems. This study, one of the few comparing different AMS brands and their performance, highlights the crucial role of dynamic testing in evaluating AMS perfor-mance under real-world conditions.

Hypertension is a major risk factor for cardiovascular and cerebrovascular diseases. Previous studies have indicated that the presence of heavy metals in the air may be a risk factor for hypertension. This study examined the combined effects of heavy metals on blood pressure considering, sex differences. A health impact survey was conducted with 561 residents near waste incineration facilities in Buki-myeon, Cheongju, Korea. Blood samples were analyzed for heavy metal concentrations, and the blood pressure was measured. Multiple linear and Bayesian kernel machine regressions (BKMR) were used to assess the association between heavy metal exposure and blood pressure. Men had higher blood mercury and lead concentrations, while women had higher cadmium levels. The multiple linear regression analysis revealed no significant associations between heavy metals and systolic blood pressure. However, cadmium was significantly associated with increased diastolic blood pressure in the total group and women, whereas lead was associated with the same in men. In the BKMR analysis, the joint effect of the three metals was significantly associated with diastolic blood pressure below the 45th percentile and above the 55th percentile only in men. These findings underscore the importance of considering sex differences in environmental health studies and public health strategies.

The paper concerns with the identification of current communication technologies and software functionalities from the field of digitalization and Industry 4.0, from the point of view of benefits and applicability for the machine manufacturer. In order to identify the relevant technologies and functionalities, both a descriptive and statistical literature research was carried out. As a result, both the currently most widespread technologies and eleven IT functionalities relevant to mechanical engineers were identified and described in terms of their application and implementation. In addition, a knowledge gap in the area of industry transfer in the field of Industry 4.0 / Digitalization was identified

The importance of performance excellence and operator’s safety is fundamental not only when operators perform repetitive and controlled industrial tasks, but also in case of abrupt gestures due to inattention and unexpected circumstances. Since optical systems work at too low frequencies and they are not able to detect gestures as early as possible, combining the use of wearable magneto-inertial measurement units (MIMUs) with the adoption of deep learning techniques can be useful to instruct the machine about human motion. To improve the initial training phase of neural networks for high classification performance, gestures repeatability over time has to be verified. Since test-retest approach has been poorly applied based on MIMUs signals in a context of human-machine interaction, the aim of this work was to evaluate the repeatability of pick-and-place gestures composed of both normal and abrupt movements. Overall, results demonstrated an excellent test-retest repeatability for normal movements and a fair-to-good test-retest repeatability for abrupt movements. Moreover whereas the reduction of time between test and retest sessions increased repeatability indices.. In detail, results of the test suggested how to improve the reinforcement learning for the identification of gestures onset, whereas results of the retest gave important information about the time necessary to retrain the network.

Water pollution is a common problem for dams situated within an urban or agricultural catchment. This can negatively affect the hydro ecosystem, drinking, recreational and other uses of water. In this study, the drinking water quality class of the Roodeplaat Dam, South Africa which faces pollution problems was modeled using machine learning algorisms in Python Jupyter Notebook 6.0.0. Eleven monthly water quality parameters recorded at five sampling stations from January 1981 to September 2017 were used for training and testing the model. Five machine learning classifiers: Gaussian Naïve Bayes (GNB), K-nearest neighbors (KNN), Decision Tree (DT), Support Vector Machines (SVM), and Linear Regression (LR) at a test size of 20%, 25%, 30%, and 40% were used to classify water into five classes (Excellent to Very bad). It was investigated that the dam water has only three classes good, medium, and bad. The prediction accuracies of machine learning algorithms from the highest to the lowest were 96.39%, 96.17%, 92.25%, 90.20, and 54.19% for KNN, DT, SVM, GNB, and LR, respectively. Therefore, KNN at a test size of 30% was recommended to classify the water quality of Roodeplat Dam accurately. Hence, machine learning algorithms can be used to identify the class of water quality before the water is treated and distributed for drinking use.

Multimodal user interfaces promise a natural and intuitive human machine interactions. But is the extra effort for the development of a complex multi-sensor system justified, or can users also be satisfied with one input modality already? This study investigates interactions in an industrial weld inspection workstation. Three unimodal interfaces, including spatial interaction with buttons augmented on a workpiece or a worktable, and speech commands, were tested individually and in a multimodal combination. Within the unimodal conditions, users preferred the augmented worktable, but overall, the interindividual usage of all input technologies in the multimodal condition was ranked best. Our findings indicate that the implementation and use of multiple input modalities is valuable, and that it is difficult to predict the usability of individual input modalities for complex systems.

We consider the problem of scheduling tasks on a single machine subject to an uncertain breakdown to minimize the flowtime. Assume the machine is unavailable during the breakdown; the starting time of the breakdown is a random variable s with distribution function D(s) and the terminating time of the breakdown has no any other information; jobs are non-resumable. Under the assumptions, starting from the perspective of statistical optimization, we first define the expected competitive ratio of an algorithm to find the optimized solution with the considered problem. Further, we propose and prove a certain result on the expected competitive ratio of the SPT rule. In particular, we show that under a quite loose condition the expected competitive ratio of the SPT rule is no more than 5/4. Meanwhile, we also make some discussions about our studies. What we have done will rich and improve the studying results on the area of scheduling to minimize flowtime and advance the development of online optimization and statistical optimization.

The electrical stimulation of the visual cortices has the potential to restore vision to blind individuals. Until now, the results of visual cortical prosthetics has been limited as no prosthesis has restored a full working vision but the field has shown a renewed interest these last years thanks to wireless and technological advances. However, several scientific and technical challenges are still open in order to achieve the therapeutic benefit expected by these new devices. One of the main challenges is the electrical stimulation of the brain itself. In this review, we analyze the results in electrode-based visual cortical prosthetics from the electrical point of view. We first briefly describe what is known about the electrode-tissue interface and safety of electrical stimulation. Then we focus on the psychophysics of prosthetic vision and the state-of-the-art on the interplay between the electrical stimulation of the visual cortex and phosphene perception. Lastly, we discuss the challenges and perspectives of visual cortex electrical stimulation and electrode array design to develop the new generation implantable cortical visual prostheses.

In current efforts to digitize manufacturing and move it into the fourth stage of the industrial revolution, a wide range of integration solutions is being considered to enable manufacturing to adapt to change. In transforming a factory into a self-organized, autonomous factory, companies are currently struggling with rapidly changing requirements and production factors, among other things. This is a particular problem for the human being as an actor within the factory, as the amount of new technologies and protocols increases the training effort. Proprietary interfaces of the control providers, a wide range of different communication protocols, complicate the understanding of the production processes, the evaluation and testability of new use cases and increase the danger of creating silos of knowledge as well as building collaboration barriers. As a solution to these problems, we propose an open software platform and define a way to model use case driven domain specific asset representation (DSA) that focuses on the human being and his needs for representing the factory in a way that it meets his requirements for the current production needs. We therefore conducted research on google scholar on human factors in industry 4.0 and used technologies as well as already existing platforms and their architecture.

Recognition of the human interaction on the unconstrained videos taken from cameras and remote sensing platforms like a drone is a challenging problem. This study presents a method to resolve issues of motion blur, poor quality of videos, occlusions, the difference in body structure or size, and high computation or memory requirement. This study contributes to the improvement of recognition of human interaction during disasters such as an earthquake and flood utilizing drone videos for rescue and emergency management. We used Support Vector Machine (SVM) to classify the high-level and stationary features obtained from Convolutional Neural Network (CNN) in key-frames from videos. We extracted conceptual features by employing CNN to recognize objects from first and last images from a video. The proposed method demonstrated the context of a scene, which is significant in determining the behaviour of human in the videos. In this method, we do not require person detection, tracking, and many instances of images. The proposed method was tested for the University of Central Florida (UCF Sports Action), Olympic Sports videos. These videos were taken from the ground platform. Besides, camera drone video was captured from Southwest Jiaotong University (SWJTU) Sports Centre and incorporated to test the developed method in this study. This study accomplished an acceptable performance with an accuracy of 90.42%, which has indicated improvement of more than 4.92% as compared to the existing methods.

Dynamic measurement error correction is an effective method to improve the sensor precision. Dynamic measurement error prediction is an important part of error correction, support vector machine (SVM) is often used to predicting the dynamic measurement error of sensors. Traditionally, the parameters of SVM were always set by manual, which can not ensure the model’s performance. In this paper, a method of SVM based on an improved particle swarm optimization (NAPSO) is proposed to predict the dynamic measurement error of sensors. Natural selection and Simulated annealing are added in PSO to raise the ability to avoid local optimum. To verify the performance of NAPSO-SVM, three types of algorithms are selected to optimize the SVM’s parameters, they are the particle swarm optimization algorithm (PSO), the improved PSO optimization algorithm (NAPSO), and the glowworm swarm optimization (GSO). The dynamic measurement error data of two sensors are applied as the test data. The root mean squared error and mean absoluter percentage error are employed to evaluate the prediction models’ performances. The experiment results show that the NAPSO-SVM has a better prediction precision and a less prediction errors among the three algorithms, and it is an effective method in predicting dynamic measurement errors of sensors.

A novel method based on a hybrid incremental modeling approach has been designed and applied to imbalance detection in ultra-high precision rotating machines. The model is obtained by a two-step iterative process that combines an overall model (least-squares fitting) with a local model (fuzzy k-nearest-neighbour) to take advantage of their complementary capacities. Three normalization strategies of evaluating the effect on accuracy are analyzed. A comparative study demonstrates that the hybrid incremental model provides better error-based performance indices for detecting imbalance than a nonlinear regression model and an adaptive neural-fuzzy inference system model. The suitability of Mahanolobis normalization for hybrid incremental modeling is also demonstrated in this case study. The proposed strategy for imbalance detection is simple, fast, and non-intrusive, reducing the deterioration in the performance of ultra-high precision rotating machines due to vibrations.

In this paper, a new approach to retrieve semantic images based on shape and geometric features of image in conjunction with multi-class support vector machine is proposed. Zernike moment as shape feature is to verify the invariance of objects for silhouette image. In addition, a set of geometrical features is to explore the objects shape using two features of rectangularity and circularity. Then the extracted features are normalized and employed for multi-class support vector machine either for learning or retrieving processes. The retrieving process relies on three main tasks which namely Query Engine, Matching Module and Ontology Manger, respectively. Query Engine is to build the input text or image query using SPARQL language. The matching module extracts the shape and geometric features of image’s objects and employ them to Ontology Manger which in turn inserts them in ontology knowledge base. Benchmark mammals have been conducted to empirically conclude the outcome of proposed approach. Our experiment on text and image retrieval yields efficient results to problematic phenomena than previously reported.

One of the tools for optimal crop production is regular monitoring and assessment of crops. During the growing season of fruit trees, the bloom period has increased photosynthetic rates that correlate with the fruiting process. This paper presents the development of an image processing algorithm to detect peach blossoms on trees. Images of an experimental peach orchard were acquired from the Parma Research and Extension Center of the University of Idaho using an off-the-shelf unmanned aerial system (UAS), equipped with a multispectral camera (Near-infrared, Green, Blue). The orchard has different stone fruit varieties and different plant training system. Individual tree images (high-resolution) and arrays of trees images (low-resolution) were acquired to evaluate the detection capability. The image processing algorithm was based on different vegetation indices. Initial results showed that the image processing algorithm could detect peach blossoms and demonstrate good potential as a monitoring tool for orchard management.

Breast cancer is the most prevalent type of disease among women. It has become one of the foremost causes of death among women globally. Early detection plays a significant role in administering personalized treatment and improving patient outcomes. Mammography procedures are often used to detect early-stage cancer cells. This traditional method of mammography while valuable has limitations of potential for false positives and negatives, patient discomfort, and radiation exposure. Therefore, there is a probe for more accurate techniques required in detecting breast cancer, leading to exploring the potential of machine learning in the classification of diagnostic images due to its efficiency and accuracy. This study conducted a comparative analysis of pre-trained CNNs (ResNet50 and VGG16) and Vision Transformers (ViT-Base and SWIN Transformer) with the inclusion of ViT-Base trained from scratch model architectures to effectively classify breast cancer mammographic images into benign and malignant cases. The Swin transformer exhibits superior performance with 99.8% accuracy and a precision of 99.8%. These findings demonstrate the efficiency of deep learning to accurately classify breast cancer mammographic images for the diagnosis of breast cancer, leading to improvement in patient outcomes.

The advancement of autonomous driving technology is becoming increasingly vital in the modern technological landscape, promising notable enhancements in safety, efficiency, traffic management, and energy use. Despite these benefits, conventional deep reinforcement learning algorithms often struggle to navigate complex driving environments effectively. To tackle this challenge, we propose a novel network called DynamicNoise, designed to significantly boost algorithmic performance by introducing noise into the Deep Q-Network (DQN) and Double Deep Q-Network (DDQN). Drawing inspiration from the NoiseNet architecture, DynamicNoise uses stochastic perturbations to improve the exploration capabilities of these models, leading to more robust learning outcomes. Our experiments demonstrate a 57.25% improvement in navigation effectiveness within a 2D experimental setting. Moreover, by integrating noise into the action selection and fully connected layers of the Soft Actor-Critic (SAC) model in the more complex 3D CARLA simulation environment, our approach achieved an 18.9% performance gain, substantially surpassing traditional methods. These results confirm that the DynamicNoise network significantly enhances the performance of autonomous driving systems across various simulated environments, regardless of their dimensionality and complexity, by improving their exploration capabilities rather than just their efficiency.

Magnetic resonance imaging (MRI) is crucial for its superior soft tissue contrast and high spatial resolution. Integrating deep learning algorithms into MRI reconstruction enhances image quality and efficiency, but a comprehensive review of optimization-based deep learning models for MRI reconstruction has been missing. This study fills that gap by examining the latest optimization-based algorithms in deep learning for MRI reconstruction, including gradient descent algorithms, proximal gradient descent algorithms, ADMM, PDHG, and diffusion models combined with gradient descent. Learnable optimization algorithms (LOA) are highlighted for their ability to map optimization processes to structured neural networks, improving model interpretability and performance. The study demonstrates significant advancements in MRI reconstruction through deep learning, with successful clinical applications. These findings provide valuable insights and resources for researchers aiming to advance medical imaging using innovative deep learning techniques.

This study presents the Distilled MixUp Squeeze ResNet (DMSResNet), an optimized variant of the Residual Network architecture designed for high accuracy and computational efficiency. By integrating Squeeze-and-Excitation blocks, MixUp data augmentation, and knowledge distillation, it achieves competitive performance within strict parameter constraints and limited training resources. Evaluated on the CIFAR-10 dataset, the model attains a 96.56% accuracy with only 4.3 million total parameters. The results demonstrate that optimization of established architectures can yield performance comparable to newer models, especially in resource-limited scenarios. This work contributes to the development of efficient deep learning models for applications in constrained computational environments.

This survey provides a comprehensive overview of in-context learning (ICL) in large language models (LLMs), a phenomenon where models can adapt to new tasks without parameter updates by leveraging task-relevant information within the input context. We explore the definition and mechanisms of ICL, investigate the factors contributing to its emergence, and discuss strategies for optimizing and effectively utilizing ICL in various applications. Through a systematic review of recent literature, we first clarify what ICL is, distinguishing it from traditional fine-tuning approaches and highlighting its unique characteristics. We then delve into the underlying causes of ICL, examining theories ranging from implicit meta-learning during pre-training to the emergence of task vectors in LLMs. The survey also covers various approaches to enhance ICL performance, including prompt engineering techniques, demonstration selection strategies, and methods for improving generalization across diverse tasks. Additionally, we discuss the limitations and challenges of ICL, such as its sensitivity to demonstration ordering and potential biases. By synthesizing findings from numerous studies, we aim to provide researchers and practitioners with a clear understanding of the current state of ICL research, its practical implications, and promising directions for future investigation. This survey serves as a valuable resource for those seeking to leverage ICL capabilities in LLMs and contributes to the ongoing discourse on the remarkable adaptability of these models.

Market crises pose significant challenges for businesses, emphasizing the importance of effective crisis management strategies. Central to these strategies is the ability to identify and retain loyal customers, who often serve as the bedrock of stability during tumultuous times. This paper investigates the application of deep meta-learning analysis to predict loyal customers as a cornerstone of market crisis management. Drawing upon an extensive literature review, the study explores previous research on market crises, customer loyalty, and the evolution of deep learning and meta-learning in crisis management contexts. Methodologically, the paper outlines data collection, model development, and evaluation procedures tailored for deep meta-learning-based customer prediction. In results, the overall accuracy of model 85%, a precision 0.88, recall 0.82, and F1-score 0.85 were obtained. The analysis demonstrates the effectiveness of deep meta-learning models in accurately identifying loyal customers during market crises, offering insights into their performance and applicability compared to traditional methods. Practical implications include potential applications in crisis management for businesses and considerations for real-world implementation.

In the age of digital revolution technology is being used more and more in education around the world to improve student learning. By enabling ongoing skill development and knowledge acquisition through digital platforms e-learning has become a crucial tool. Through E-Learning online learning is becoming increasingly popular and effective in addition to traditional methods of instruction as highlighted by the latest statistics from Badan Pusat Statistik Indonesia (BPS). In order to address the issues of scalability, interactivity and security in e-learning platforms. This study introduces a web-based learning environment that is focused on teaching programming. Leveraging the MERN stack, while also integrating TypeScript for improved code reliability, Next.js for accelerated React.js functionality, Tailwind CSS for responsive design. Backend features include media management with Cloudinary, secure video streaming with VdoCipher, data storage with MongoDB, and caching with Redis. Iterative development will be following agile methodology. In order to create a vibrant and encouraging learning environment the platform includes interactive course pages multimedia content real-time feedback mechanisms and community-building tools. Despite some early difficulties the implementation phase effectively achieved development goals. To further support international online learning initiatives further efforts will be directed toward improving platform security and functionality.

Divulsuperbac (DSB) is a Service Learning project targeted at the educational community. It started in 2019 and has engaged Biology degree students in a Microbiology-focused initiative in the Valencian Community (Spain), for four academic years. The DSB project comprises various outreach activities intending to raise awareness of the superbugs' threat to pre-university students. We created an exhibition that contained 14 infographics on the topic of antimicrobial resistance which was presented every week in high schools. The infographics were presented by university students, who explained the problem to the pre-university students and subsequently assessed their comprehension of the topic. The surveys conducted yielded satisfactory results, which motivated us to extend this project to other regions of the world.

Deforestation through land-use conversion, illegal logging, and timber trafficking is believed to cause ~10% of the annual human carbon dioxide emissions at the global level. Given the large contribution, local and national policies have been set in place in the effort to reduce deforestation and support reforestation. However, accurate assessment of forest carbon stock is expensive and challenging in remote areas and on large geographical scales. To improve carbon stock monitoring and evaluation of fine-scale forest loss, we developed a rapid, automatic, scalable, and cost-efficient generalized deep learning framework that uses diverse remote sensing data and satellite imagery to derive aboveground carbon density from accurate estimates of tree canopy heights at fine-grained resolution (30x30 meters) in remote tropical rainforests. The remote sensing data is composed of Landsat-8, Sentinel-1, land cover, digital elevation model, and NASA CMS airborne LiDAR, as well as vegetation indices, texture metrics, and climatic data. Data sources were compiled into a data pipeline which produced >300 features and 2 million observations over forests in Indonesian Borneo. Using LiDAR swath data on canopy forest high for ~100,000 hectares in Indonesian Borneo to create a training and validation datasets, our neural network model produced aboveground carbon density estimates with R2 of 0.82, which is a significant improvement from comparable works by using Random Forest (R2 of 0.3-0.5). This deep learning framework can be used to facilitate further carbon stock modeling in other forest regions (e.g., Brazil) as well as for the general purpose of climate change mitigation.

In this study, a comprehensive review on production scheduling based on reinforcement learning (RL) techniques using bibliometric analysis has been carried out. The aim of this work is, among other things, to point out the growing interest in this domain and to outline the influence of RL as a type of machine learning on production scheduling. To achieve this, the paper explores production scheduling using RL by investigating the descriptive metadata of all pertinent publications contained in the Web of Science database. The study focuses on a wide spectrum of publications spanning the years between 1998 and 2023. The findings and recommendations of this study can serve as new insights for future research endeavors in the realm of production scheduling using RL techniques.

Emotion detection holds significant importance in facilitating human-computer interaction, enhancing the depth of engagement. By integrating this capability, we pave the way for forthcoming AI technologies to possess a blend of cognitive and emotional understanding, bridging the divide between machine functionality and human emotional complexity. This progress has the potential to reshape how machines perceive and respond to human emotions, ushering in an era of empathetic and intuitive artificial systems. This paper introduces a novel approach to multimodal emotion recognition, seamlessly integrating speech and text modalities to accurately infer emotional states. Employing CNNs, we meticulously analyze speech using Mel spectrograms, while a BERT-based model processes the textual component, leveraging its bidirectional layers for profound semantic comprehension. The outputs from both modalities are combined using an attention-based fusion mechanism that optimally weighs their contributions. The proposed method undergoes meticulous testing on two distinct datasets: Carnegie Mellon University’s Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI) dataset and the Multimodal Emotion Lines Dataset (MELD). The results demonstrate superior efficacy compared to existing frameworks, achieving an accuracy of 88.4% and an F1-score of 87.9% on the CMU-MOSEI dataset, and a notable weighted accuracy (WA) of 67.81% and a weighted F1 (WF1) score of 66.32% on the MELD dataset. This comprehensive system offers precise emotion detection and introduces several significant advancements in the field.

The problem addressed in this article consists of the motion control of a quadrotor, comprising model disturbances and uncertainties. In order to tackle model uncertainty, adaptive control based on reinforcement learning is used. The distinctive feature of this article, in comparison with other works on quadrotor control using reinforcement learning is the exploration of the underlying optimal control problem in which a quadratic cost and a linear dynamics allow an algorithm that runs in real time. Instead of identifying a plant model, adaptation is obtained by approximating the performance index given by the Q-function using directional forgetting recursive least squares that rely on a linear regressor build from quadratic functions of input/output data. The adaptive algorithm proposed is tested in simulation in a cascade control structure that drives a quadrotor. Simulations show the improvement in performance that results when the proposed algorithm is turned on.

With the increased emphasis on competition in academic settings, anxiety is becoming more common, which inevitably has some impact on students’ learning process and result. This study aimed to explore how competition-induced anxiety influences the subjective cognitive load (SCL), attention level and test score. Meanwhile, we investigated the mediating role of the behavioral inhibition system/behavioral activation system (BIS/BAS) in those processes. A total of 101 college students were recruited in Study 1 to learn five micro-lectures from massive open online courses (MOOC) under with and without competitive conditions. The results showed that participants’ state anxiety (SA) scores were higher after the experiment, participants in the competition condition had higher test scores, and the relationship between SA/ trait anxiety (TA) and SCL could be mediated by the BIS. To obtain more objective data on learning processes (attention levels), we conducted Study 2, which collected behavioral and EEG data from 42 college students during the online learning. The results showed that the competition group had higher SA, lower attention levels, and worse test scores, and the relationship between SA/TA and attention levels could be mediated through the BIS. The present study not only expands previous research by finding that BIS functioning plays an important role in the effects of anxiety on cognitive load and attention, but also offers implications for using competitive strategies to motivate students according to their aptitude.

In recent years the field of computer science has experienced great changes, due to the incredible advances in the field of artificial intelligence. Deep Learning models are responsible for most of them since the biggest milestones occurred in 2012 when AlexNet won the image classification challenge called ImageNet. These models have demonstrated great performances in different types of complex tasks like image restoration, medical diagnosis or object recognition. Their disadvantages are related to their high data dependency, which forces experts in the field to follow a precise methodology to obtain accurate models. In this paper, we describe a complete workflow that begins with the management of the raw data until the in-depth interpretation of the performance of the models. This should be taken as a high-level consultation document describing good practices that should be applied. Apart from the step-by-step methodology, we present different use cases that correspond to the two main problems of the field: classification and regression.

Neurodegenerative illnesses, such as Parkinson’s disease (PD), have a substantial impact on the overall well-being of those who are affected. This study investigates and contrasts the capabilities of convolutional neural networks (CNN) in detecting Parkinson’s disease (PD) by utilising hand-drawn images alongside wave and spiral images as input data. This study employs pre-trained CNN models, specifically MobileNet, ResNet50, EfficientNet-B1, and InceptionV3, to classify Parkinson’s disease (PD). The findings demonstrate that MobileNet surpasses other architectural designs, as evidenced by the F1-Score of the four classes: Spiral Normal (0.87), Spiral Parkinson (0.86), Wave Normal (0.97), and Wave Parkinson (0.97). MobileNet has also shown a remarkable accuracy of 0.92 in diagnosing Parkinson’s disease. The result demonstrates the efficacy of MobileNet in extracting features from images. The results of this study enhance the application of deep learning methods in the early detection of PD, as well as help indicate the effectiveness of patient therapy and exercise, promising better patient outcomes through timely intervention and treatment.

In federated learning (FL), clients train models locally without sharing raw data, ensuring data privacy. In particular, federated distillation transfers knowledge to clients regardless of the model architecture. However, when groups of clients with different data distributions exist, sharing the same knowledge among all clients becomes impractical. To address this issue, this paper presents an approach that clusters clients based on the output of a client model trained using their own data. The clients are clustered based on the predictions of their models for each label on a public dataset. Prior knowledge of the number of groups is not required. Evaluations on the MNIST dataset showed that our method accurately identified these group structures and improved accuracy by 15–75% compared with traditional federated distillation algorithms when distinct group structures were present. Additionally, we observed significant performance improvements in smaller client groups, bringing us closer to fair FL.

A remarkable strengths of deep neural networks lies in their ability to discover patterns and representations from complex data. Deep learning models can learn and refine features at different levels of abstraction, enabling them to handle complex tasks in computer vision recognition, natural language processing, and speech recognition. The ability to generalize from examples, coupled with the capacity to process vast amounts of data, empowers deep learning to achieve state-of-the-art results across a wide spectrum of applications. An argument for this ability is based on similarities between deep neural networks and the nervous system. In this report, we argue that despite the remarkable performance of deep learning, there are still gaps between deep learning and the nervous system that needs to be closed to enable deep learning doing tasks that currently only the nervous system can perform

Voice spoofing attempts to break into a specific automatic speaker verification (ASV) system by forging the user’s voice, and can be used through methods, such as text-to-speech (TTS), voice conversion (VC), and replay attacks. Recently, deep learning-based voice spoofing countermeasures have been developed. however, the problem with replay is that it is difficult to construct a large number of datasets because it requires a physical recording process. To overcome these problems, this study proposes a pre-training framework based on multi-order acoustic simulation for replay voice spoofing detection. Multi-order acoustic simulation utilizes existing clean signal and room impulse response (RIR) datasets to generate audios, which simulate the various acoustic configurations of the original and replayed audios. The acoustic configuration refers to factors, such as the microphone type, reverberation, time delay, and noise that may occur between a speaker and microphone during the recording process. We assume that a deep learning model trained on an audio that simulates the various acoustic configurations of the original and replayed audios can classify the acoustic configurations of the original and replay audios well. To validate this, we performed pre-training to classify the audio generated by the multi-order acoustic simulation into 3 classes: clean signal, audio simulating the acoustic configuration of the original audio, and audio simulating the acoustic configuration of the replay audio. We also set the weights of the pre-training model to the initial weights of the replay voice spoofing detection model using the existing replay voice spoofing dataset and then performed fine-tuning. To validate the effectiveness of the proposed method, we evaluated the performance of the conventional method without pre-training and proposed method using an objective metric, i.e., the accuracy. As a result, the conventional method achieved 92.94% accuracy and proposed method achieved 98.16% accuracy.