To solve the problem that the common long-tailed classification method does not use the semantic features of the original label text of the image, and the difference between the classification accuracy of most classes and minority classes is large, the long-tailed image classification method based on enhanced contrast visual language trains the head class and tail class samples separately, uses text image to pre-train the information, and uses enhanced momentum contrast loss function and RandAugment enhancement to improve the learning of tail class samples. On the ImageNet-LT long-tailed dataset, the enhanced contrastive visual-language based long-tailed image classification method has improved all class accuracy, tail class accuracy, middle class accuracy, and F1 values by 3.4%, 7.6%, 3.5%, and 11.2%, respectively, compared to the BALLAD method. The difference in accuracy between the head class and tail class is reduced by 1.6% compared to the BALLAD method. The results of three comparative experiments indicate that the long-tailed image classification method based on enhanced contrastive visual-language has improved the performance of tail classes and reduced the accuracy difference between majority and minority classes.

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

Integrating artificial intelligence (AI) and natural language processing (NLP) technologies with project-based learning experiences in Science,Technology, Reading, Engineering, Arts, and Mathematics (STREAM) education offers the potential to enhance student engagement, critical thinking,problem-solving, and interdisciplinary learning. This paper presents a comprehensive approach to implementing AI and NLP technologies, such as ChatGPT, in STREAM project-based learning experiences, highlighting the potential advantages and challenges of this innovative educational approach. The proposed method encompasses personalized learning pathways, AI-powered research assistance, collaborative AI tools, real-time feedback, virtual mentoring, advanced simulation, and objective assessment. We also discuss the implications of this integration for educators, institutions, and students, along with recommendations for future research and development in this emerging field.

Effective healthcare relies on accurate and timely diagnosis; however, obtaining large amounts of training data while maintaining patient privacy remains challenging. This study introduces a novel approach utilizing federated learning (FL) and a cross-device multi-modal model for clin-ical event classification using vital signs data. Our architecture leverages FL to train machine learning models, including Random Forest, AdaBoost, and SGD ensemble model, on vital signs data from a diverse clientele at a Boston hospital (MIMIC-IV dataset). The FL structure preserves patient privacy by training directly on each client's device without transferring sensitive data. The study demonstrates the potential of FL in privacy-preserving clinical event classification, achieving an impressive accuracy of 98.9%. These findings underscore the significance of FL and cross-device ensemble technology in healthcare applications, enabling the analysis of large amounts of sensitive patient data while safeguarding privacy.

The ability to handle spatiotemporal information makes contribution for improving the prediction performance of machine RUL. However, most existing models for spatiotemporal information processing are not only complex in structure but also lack adaptive feature extraction capabilities. Therefore, a lightweight operator with adaptive spatiotemporal information extraction ability named Involution GRU (Inv-GRU) is proposed for aero-engine RUL prediction. Involution, the adaptive feature extraction operator, is replaced by the information connection in the gated recurrent unit for obtaining the adaptively spatiotemporal information extraction ability and reducing the parameters. Thus, Inv-GRU can well extract the degradation information the of aero-engine. Then for RUL prediction task, the Inv-GRU based deep learning (DL) framework is firstly constructed, where features extracted by Inv-GRU and several human-made features are separately processed to generate the health indicators (HIs) from multi-raw data of aero-engines. Finally, fully connection layers are adopted are adopted to reduce dimension and regress RUL based on the generated HIs. By applying the Inv-GRU based DL framework to the Commercial Modular Aero Propulsion System Simulation (C-MAPSS) datasets, successful predictions of aero-engines RUL have been achieved. Comparative analysis reveals that the proposed model exhibits superior overall prediction performance compared to recent public methods.

Mild traumatic brain injury (mTBI) is the most common brain injury, seen in sports, falls, vehicle, or workplace injuries. Concussion is the most common type of mTBI. Assessment of impairments from concussion are evolving, with oculomotor testing suggested as a key component in a multi-modality diagnostic protocol. The aim of this study was to evaluate the reliability of one eye-tracking system, the EyeGuide Focus. Seventy-five healthy adolescent and adult participants (adolescents: n=28; female=11, male=17, mean age 16.5 ± 1.4 years; adults n=47; female=22; male=25, mean age 26.7 ± 7.0 years) completed three repetitions of the EyeGuide Focus within the one session. Intraclass correlation coefficient (ICC) analysis showed the EyeGuide Focus had overall good reliability (ICC 0.79, 95%CI: 0.70, 0.86). However, a familiarization effect showing improvements in subsequent trials was noticeable in both cohorts (p<0.001) with adolescent participants showing greater familiarisation effects than adults. No differences were observed between sexes (p=0.69). Overall, the EyeGuide Focus was found to be reliable, but the observation of familiarization effects suggests that a standardized protocol of a minimum of three trials be employed, similar to other eye-movement testing applications.

The COVID-19 pandemic has affected millions of people globally, with respiratory organs being strongly affected in individuals with comorbidities. Medical imaging-based diagnosis and prognosis have become increasingly popular in clinical settings to detect COVID-19 lung infections. Among various medical imaging modalities, ultrasound stands out as low-cost, mobile, and radiation-safe imaging technology. In this comprehensive review, we focus on ultrasound-based AI studies for COVID-19 detection that use public or private lung ultrasound datasets. We surveyed articles that used publicly available lung ultrasound datasets for COVID-19 and reviewed publicly available datasets and organize ultrasound-based AI studies per dataset. We analyzed and tabulated studies in several dimensions, such as data preprocessing, AI models, cross-validation, and evaluation criteria. In total, we reviewed 42 articles, where 28 articles used public datasets, and the rest used private data. Our findings suggest that ultrasound-based AI studies for the detection of COVID-19 have great potential for clinical use, especially for children and pregnant women. Our review also provides a useful summary for future researchers and clinicians who may be interested in the field.

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

Alzheimer’s disease has become a major concern in the healthcare domain as it is growing rapidly. Many researches have been conducted to detect it from MRI images through various deep-learning approaches. However, the problem of the availability of medical data and the privacy of the patients still exists. To mitigate this issue in Alzheimer’s disease detection, we have implemented the federated approach which is found to be more efficient, robust, and consistent compared to the conventional approach. For this, we needed deep excavation on various orientations of MRI images and transfer learning architectures. Then, we utilized the publicly available two datasets (OASIS, and ADNI), and designed various cases to evaluate the performance of the federated approach. In almost all of them, the federated approach achieved better accuracy and sensitivity. In distinguishing between two classes equally, the capability of the models was better in the found model when trained with federated approach compared to the conventional approach. In this approach. MobileNet, which is a low-cost transfer learning architecture, achieved the highest 95.24%, 81.94%, and 83.97% accuracy in OASIS, ADNI, and merged (ADNI+OASIS) test set, which was way higher than the achieved performance in Conventional approach. Moreover, in this approach, only the weights of the model were shared which keeps the original MRI images in their respective hospital or institutions, mitigating the privacy concern in the healthcare domain.

With the increasing use of intelligent mobile devices for online inspection of electrical equipment in smart grids, the limited computing power and storage of these devices pose challenges for carrying large algorithm models and it’s hard to obtain a large number of images of electrical equipment in public. In this paper, we propose a novel distillation method that compresses the knowledge of teacher networks into a small few-shot classification network using a global and local knowledge distillation strategy. Central to our method is exploiting the global and local relationship between the features exacted by the backbone of the teacher network and student network. We compare our method with recent state-of-the-art methods in three public datasets and achieve the best performance. We also contribute a new dataset, EEI-100, specifically designed for classification of electrical equipment, and demonstrate that our method achieves a prediction accuracy of 94.12% with only 5-shot images.

Computer vision methods have shown to be effective in classifying garbage into recycling categories for waste processing, existing methods are costly, imprecise, and unclear. To tackle this issue, we introduce MWaste, a mobile application that uses computer vision and deep learning techniques to classify waste materials as trash, plastic, paper, metal, glass or cardboard. Its effectiveness was tested on various neural network architectures and real world images, achieving an average precision of 92% on the test set. This app can help combat climate change by enabling efficient waste processing and reducing the generation of greenhouse gases caused by incorrect waste disposal.

Communication is a key method of expressing one's thoughts and opinions. Amongst many modalities, speech and writing are the most powerful and common forms of human communication. Analysing what and how people think has inherently been an interesting and progressive research domain. This includes bimodal sentiment analysis which is an emerging area in natural language processing (NLP) and has received a great deal of attention in recent years in a variety of areas including social opinion mining, health care, banking, and so on. At present, there are limited studies on bimodal conversational sentiment analysis as it proves to be a challenging area given the complex nature of the way humans express sentiment cues across various modalities. To address this gap, a comparison of the performance of multiple data modality models has been conducted on the MELD dataset, a widely-used dataset for benchmarking sentiment analysis within the research community. Our work then demonstrates the results of combining acoustic and linguistic representations. Lastly, our proposed neural network-based ensemble learning technique is employed over six transformer and deep learning-based models, achieving a State-Of-The-Art (SOTA) accuracy.

This study utilised an ensemble of pre-trained networks and digital mammograms to develop a supplementary diagnostic tool for radiologists. Digital mammograms and their associated information were collected from the department of radiology and pathology, Hospital Universiti Sains Malaysia. Thirteen pre-trained networks were selected and explored in this study. ResNet101V2 and ResNet152 had the highest mean PR-AUC, MobileNetV3Small and ResNet152 had the highest mean precision, ResNet101 had the highest mean F1 score, and ResNet152 and ResNet152V2 had the highest mean Youden J index. Subsequently, three ensemble models were developed using the top three pre-trained networks based on PR-AUC, precision, and F1 score. The final ensemble model had a mean precision, F1 score, and Youden J index of 0.82, 0.68, and 0.12, respectively. Additionally, the final model demonstrated a balanced performance across mammographic density. In conclusion, this study exhibited the good performance of the ensemble transfer learning on digital mammograms for the purpose of breast cancer risk estimation. This model can be utilised as a supplementary diagnostic tool for radiologists, thus, reducing their workloads.

Auto-labeling is one of the main challenges in 3D vehicle detection. Auto-labeled datasets can be used to identify objects in LiDAR data, which is a challenging task due to the large size of the dataset. In this work, we propose a novel methodology to generate new 3D based auto-labeling datasets with a different point of view setup than the one used in the most recognized datasets (KITTI, WAYMO, etc.). The performance of the methodology has been further demonstrated with the development of our own dataset with the auto-generated labels and tested under boundary conditions on a bridge in a fixed position. The proposed methodology is based on the YOLO model trained with the KITTI dataset. From a camera-LiDAR sensory fusion, it is intended to auto-label new datasets while maintaining the consistency of the Ground Truth. The main contribution of this work is a novel methodology to auto-label autonomous driving datasets using YOLO as the main labelling system. The performance of this approach is measured retraining the contrast models of the KITTI benchmark.

Sometimes when diabetic retinopathy (DR) is found and treated quickly, vision loss can indeed be spared. This study deploys a deep learning (DL) model that can discover all 5 stages of DR more accurately than other methods. The proposed methodology shows two cases scenarios: case 1 with image enhancement using CLAHE and ESRGAN, and case 2 without image enhancement. Augmentation techniques are then employed to produce a balanced dataset with the identical criteria for both scenarios. The generated model using DenseNet-121 on the APTOS dataset outperformed other approaches for locating the 5 stages of DR, with an accuracy of 98.7 percent for case 1 and 81.2 percent for case 2. Using CLAHE and ESRGAN was shown to improve a model's performance and ability to learn.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Pulsed thermography is a vital technique in the nondestructive evaluation field. However, its data analysis can be complex and requires skilled experts. Advances in deep learning have yielded exceptional results, including image segmentation. Therefore, many efforts have been made to apply deep learning methods to data processing for nondestructive evaluation. Despite this, there is currently no public Pulsed thermographic dataset available for evaluating various spatial-temporal deep methods of segmenting pulsed thermographic data. This article aims to provide such a dataset and assess the performance of commonly used deep learning-based instance segmentation models on it. Additionally, the impact of the number of frames and data transformations on model performance is examined. The findings suggest that suitable preprocessing methods can effectively reduce the data size without compromising the deep models’ performance.

As AI models become more and more common in business and even in our daily lives, it is important to understand what the carbon impact of these models is. Recent papers have shown that this impact can be quite great, i.e., the training of a single high-end model can result in emissions of more than 500t of CO2eq. In this paper we discuss the factors that influence the carbon footprint of AI models, explore what impact different decisions have, and show how the footprint can be reduced. We also examine the footprint of different models to give a guideline on how urgent action is for different organizations.

One of the most common forms of dementia is Alzheimer’s disease (AD), which leads to progressive mental deterioration. Unfortunately, there is no definitive diagnosis and cure that can stop the condition progressing. The diagnosis is often performed based on the clinical history and neuropsychological data, including magnetic resonance imaging (MRI). Deep neural networks (DNN) algorithms are gaining popularity for medical diagnosis, and have been used widely for the analysis of MRI data. DNNs can extract hidden features from thousands of training images automatically. However, they cannot judge how confident they are about their predictions. To use DNNs in safety-critical applications such as medical diagnosis, uncertainty quantification of DNNs predictions is crucial. For this purpose, Monte Carlo dropout (MCD) has been widely used, however, it may lead to overconfident and miss calibrated results. This paper proposes a framework in which the MCD algorithm’s hyper-parameters are optimized during training using Bayesian optimization for the first time. The conducted optimization leads to assigning high predictive entropy to erroneous predictions and making it possible to recognize risky predictions. The proposed framework is used for AD diagnosis, which has not been done before. We compare our method with some existing methods in the literature based on different uncertainty quantification criteria. The results of comprehensive experiments on the Kaggle dataset using a deep model pre-trained on the ImageNet dataset show that the proposed algorithm can quantify uncertainty much better than the existing methods.

Biology is so complex that it has to be studied in different ways and focuses on processes. Self-regulation skills in learning are important metacognitive skills for students in studying Biology. Learning models that train strategic students in learning are a must so that they gain meaningful learning experiences through the process of exploration, analysis of new information carried out in learning by applying self-questioning strategies to monitor why new information can be trusted. The results of the synthesis between old knowledge and new knowledge are enhanced through peer coaching in class. This research was conducted to develop an EAQD-PC learning model (exploring, analyzing, questioning, defining peer coaching) and tools that are valid, practical, and effective. The model development procedure includes the preliminary research stage, the prototype stage, and the assessment stage. Model validation data was collected using expert validation instruments. While the practicality of the model components is measured by the implementation observation sheet. The effectiveness of the model was measured using a metacognitive skill test and a questionnaire. This model is applied to students majoring in Biology Education at Muhammadiyah University of Bone, even semester 2019/2020. The results showed that the components of the EAQD-PC model (a) with a value of 3.87, and valid learning model supporting tools with a value of 3.83, (b) practicality with a value of 3.89 and (c) effectiveness with a value of 3, 97 . This study proves that the EAQD-PC model is practical and effective for training students' metacognitive skills.

MicroRNAs (miRNAs) are small non-coding RNAs that play a central role in the post-transcriptional regulation of biological processes. miRNAs regulate transcripts by direct binding involving the Argonaute protein family. The exact rules of binding are not known, and several in silico miRNA target prediction methods have been developed to date. Deep Learning has recently revolutionized miRNA target prediction. However, the higher predictive power comes with decreased ability to interpret increasingly complex models. Here, we present a novel interpretation technique, called attribution sequence alignment, for miRNA target site prediction models that can interpret such Deep Learning models on a two-dimensional representation of miRNA and putative target sequence. Our method produces a human readable visual representation of miRNA:target interactions and can be used as a proxy for further interpretation of biological concepts learned by the neural network. We demonstrate applications of this method in clustering of experimental data into binding classes, as well as using the method to narrow down predicted miRNA binding sites on long transcript sequences. Importantly, the presented method works with any neural network model trained on a two-dimensional representation of interactions and can be easily extended to further domains such as protein-protein interactions.

Locomotor impairment is a high-prevalent and significant source of disability and significantly impacts a large population’s quality of life. Despite decades of research in human locomotion, the challenges of simulating human movement to study the features of musculoskeletal drivers and clinical conditions remain. Most recent efforts in utilizing reinforcement learning (RL) techniques are promising to simulate human locomotion and reveal musculoskeletal drives. However, these simulations often failed to mimic natural human locomotion because most reinforcement strategies have yet to consider any reference data regarding human movement. To address these challenges, in this study, we designed a reward function based on the trajectory optimization rewards (TOR), and bio-inspired rewards, which includes the rewards obtained from reference motion data captured by a single Intertial Moment Unit (IMU) sensor. The sensor was equipped on the participants’ pelvis to capture reference motion data. Also, we adapted the reward function by leveraging previous research in walking simulation for TOR. The experimental results showed that the simulated agents with the modified reward function performed better in mimicking the collected IMU data from participants, which means the simulated human locomotion was more realistic. Also, as this bio-inspired defined cost, IMU data enhanced the agent’s capacity to converge during the training process. As a result, the models’ convergence is faster than those developed without reference motion data. Consequently, human locomotion can be simulated more quicker and in a broader range of environments with a better simulation performance.

Most machine learning and deep learning algorithms can only use low-dimensional data as input, but the data that must be processed in practical applications is diverse and irregular. There are two main problems with big dynamic data. (1) The size of the embedding table grows linearly with the vocabulary size, resulting in massive memory consumption. (2) For different newly added vocabularies. To solve these two problems, this paper proposes a novel embedding algorithm that can learn attribute associations with entities based on deep and hash algorithms. Taking movie data as an example, the encoding method and the specific flow of the algorithm are presented in detail, and the effect of dynamic reuse of data models is realized. Compared with the four existing embedding algorithms which can fuse entity attribute information, the deep hash embedding algorithm proposed in this paper has obvious optimization of time and space complexity.

With the rapid development of the Internet of Things (IoT), there are dramatic increasing number of devices in the network, which causes the challenge that only using infrastructure such as based station cannot provide service with all devices with high quality. Therefore, due to their flexibility and economy, unmanned aerial vehicles (UAV) are widely used to increase the performance of IoT networks. UAVs can not only provide communication services for IoT devices in the absence of a network, but they can also perform video surveillance, cargo transportation, pesticide spraying, and other specialized tasks. However, due to the complexity of the scenario and the need for real-time decision making, it is challenging to schedule UAVs in the network using traditional optimization methods, and growing attention has focused on using AI to optimize UAVs in the network. In this paper, we focus on the AI-enabled UAV optimization method in IoT networks and give a comprehensive scope on what and how to use AI-enabled methods to increase the performance of UAV-assisted IoT networks. Moreover, a brief analysis of the challenges of using AI methods in IoT networks and some potential research directions are given.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

This article is a theoretical contribution to mental model research, which currently has different threads. Whereas some researchers focus on the perceived causal structure, others also include decision policies and decisions. We focus on the link between recognized causal structure (“mental models of dynamic systems”) and policies, proposing Johnson-Laird’s theory of mental models as the link. The resulting framework hypothesizes two types of systematic mental model errors: (1) misrepresentation of the system’s structure and (2) failure to deploy relevant mental models of possibilities. Examination of three experiments through this lens reveals errors of both types. Therefore, we propose that the cognitive theory of mental models opens a path to better understand how people construct their decision policies and develop interventions to reduce such mental model errors. The article closes by raising several questions for empirical studies of the reasoning process leading from mental models of dynamic systems to decision policies.

The prediction of drug-target interactions plays a fundamental role in facilitating drug discovery, where the goal is to find prospective drug candidates. With the increase in the number of drug-protein interactions, machine learning techniques, especially deep learning methods, have become applicable for drug-target interaction discovery because they significantly reduce the required experimental workload. In this paper, we present a spontaneous formulation of the drug-target interaction prediction problem as an instance of multi-instance learning. We address the problem in three stages, first organizing given drug and target sequences into instances via a private-public mechanism, then identifying the predicted scores of all instances in the same bag, and finally combining all the predicted scores as the output prediction. A comprehensive evaluation demonstrates that the proposed method outperforms other state-of-the-art methods on three benchmark datasets.

Segmentation is an important step in medical imaging. In particular, machine learning, especially deep learning, has been widely used to efficiently improve and speed up the segmentation process in clinical practice. Despite the acceptable segmentation results of multi-stage models, little attention was paid to the use of deep learning algorithms for brain image segmentation, which could be due to the lack of training data. Therefore, in this paper, we propose a Generative Adversarial Network (GAN) model that performs transfer learning to segment MRI brain images.Our model enables the generation of more labeled brain images from existing labeled and unlabeled images. Our segmentation targets brain tissue images, including white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We evaluate the performance of our GAN model using a commonly used evaluation metric, which is Dice Coefficient (DC). Our experimental results reveal that our proposed model significantly improves segmentation results compared to the standard GAN model. We observe that our model is 2.1–10.83 minutes faster than stat-of-the-art-models.

The classification of vessel types in SAR imagery is of crucial importance for maritime applications. However, the ability to use real SAR imagery for deep learning classification is limited, due to the general lack of such data and/or the labor-intensive nature of labeling them. Simulating SAR images can overcome these limitations, allowing the generation of an infinite number of datasets. In this contribution, we present a synthetic SAR imagery dataset with ship wakes, which comprises 46080 images for ten different real vessel models. The variety of simulation parameters includes 16 ship heading directions, 6 ship velocities, 8 wind directions, 2 wind velocities, and 3 incidence angles. In addition, we extensively investigate classification performance for noise-free, noisy, and denoised ship wake scenes. We utilize the standard AlexNet architecture and employ training from scratch. To achieve the best classification performance, we conduct Bayesian optimization to determine hyperparameters. Results demonstrate that the classification of vessel types based on their SAR signatures is highly efficient, with maximum accuracies of 96.16%, 92.7%, and 93.59%, when training using noise-free, noisy, and denoised datasets respectively. Thus, we conclude that the best strategy in practical applications should be to train convolutional neural networks on denoised SAR datasets. The results show that the versatility of the SAR simulator can open up new horizons in the application of machine learning to a variety of SAR platforms.

A common spinal condition, spondylolisthesis is the presence of a relative back or forth displacement between the upper and lower vertebra due to one vertebra being oriented away from the smooth curvature of a normal spine. Aging-related illnesses such as degenerative spondylolisthesis are especially burdensome on social welfare and health-care systems in an aging society, especially radiologists and clinical physicians. Therefore, we proposed a computer aided diagnosis algorithm, named LumbarNet, for vertebral slippage detection on clinical X-ray images. Collaborating with i) a P-grade, ii) a piecewise slope detection scheme, and iii) a dynamic shift detection routine, LumbarNet was thus specialized for analyzing complex structural patterns in lumbar spine X-ray images and outcompeted other U-Net based methods. Extensive experiments on lumbar spine X-ray images in standard clinical practices showed that LumbarNet achieved a mean intersection over union value of 0.88 in vertebral region detection and an accuracy of 88.83% in vertebral slippage detection.

Recently, the use of drones/unmanned aerial vehicles (UAVs) has notably increased due to their broad commercial spread and low cost. The wide diffusion of drones increases the hazards of their misuse in illegitimate actions such as drug smuggling and terrorism. Thus, the surveillance and automated detection of drones are crucial for safeguarding restricted regions or special zones from illegal drone interventions. One of the most challenging issues in drone detection in surveillance videos is the apparent similarity of drones and birds against complex backgrounds. In this work, an automated image-based drone-detection system utilizing an advanced deep-learning-based object-detection method known as you only look once (YOLOv5) is introduced for protecting restricted regions or special zones from unlawful drone interventions. Due to the lack of sufficient data, transfer learning was utilized to pretrain the object-detection method to increase the performance. The experiments showed outstanding results, and an average precision of 94.7% was accomplished.

This paper presents an extension of the results obtained in previous work concerning the application of global optimization techniques to the design of finite strategic games with mixed strategies. In that publication the Fuzzy ASA global optimization method was applied to many examples of synthesis of strategic games with one previously specified Nash equilibrium, evidencing its ability in finding payoff functions whose respective games present those equilibria, possibly among others. That is to say, it was shown it is possible to establish in advance a Nash equilibrium for a generic finite state strategic game and to compute payoff functions that will make it feasible to reach the chosen equilibrium, allowing players to converge to the desired profile, con- sidering that it is an equilibrium of the game as well. Going beyond this state of affairs, the present article shows that it is possible to ”impose” multiple Nash equilibria to finite strategic games by following the same reasoning as before, but with a fundamental change: using the same fundamental theorem of Richard McKelvey, modifying the originally prescribed objective function and globally minimizing it. The proposed method, in principle, is able to find payoff functions that result in games featuring an arbitrary number of Nash equilibria, paving the way to a substantial number of potential applications.

Habituation, the most ancient and fundamental form of learning, manifests already before birth. Neuroscientists have been fascinated for decades by its function as a firewall protecting our brains from sensory information overload and its indispensability for higher cognitive processing. Evidence that habituation learning is affected in autism and related monogenic neurodevelopmental syndromes and their animal models has exponentially grown, but the potential of this convergence to advance both fields is still largely unexploited.In this review, we provide a systematic overview of the genes that to date have been demonstrated to underlie habituation across species. We describe the biological processes they converge on, and highlight core regulatory pathways and repurposable drugs that may alleviate the habituation deficits associated with their dysregulation. We also summarize currently used habituation paradigms and extract the most important arguments from literature that support the crucial role of habituation for cognition in health and disease. We conclude that habituation is a powerful tool to overcome current bottlenecks in research, diagnostics and treatment of neurodevelopmental disorders.

Scientists and astronomers have attached Scientists and astronomers have attached great importance to the task of discovering new exoplanets, even more so if they are in the habitable zone. To date, more than 4300 exoplanets have been confirmed by NASA, using various discovery techniques, including planetary transits, in addition to the use of various databases provided by space and ground-based telescopes. This article proposes the development of a deep learning system for detecting planetary transits in Kepler Telescope lightcurves. The approach is based on related work from the literature and enhanced to validation with real lightcurves. A CNN classification model is trained from a mixture of real and synthetic data, and validated only with real data and different from those used in the training stage. The best ratio of synthetic data is determined by the perform of an optimisation technique and a sensitivity analysis. The precision, accuracy and true positive rate of the best model obtained are determined and compared with other similar works. The results demonstrate that the use of synthetic data on the training stage can improve the transit detection performance on real light curves.

Convolutional Neural Networks (CNNs) have gained prominence in the research literature on image classification over the last decade. One shortcoming of CNNs, however, is their lack of generalizability and tendency to overfit when presented with small training sets. Augmentation directly confronts this problem by generating new data points providing additional information. In this paper, we investigate the performance of more than ten different sets of data augmentation methods, with two novel approaches proposed here: one based on the Discrete Wavelet Transform and the other on the Constant-Q Gabor transform. Pretrained ResNet50 networks are finetuned on each augmentation method. Combinations of these networks are evaluated and compared across three benchmark data sets of images representing diverse problems and collected by instruments that capture information at different scales: a virus data set, a bark data set, and a LIGO glitches data set. Experiments demonstrate the superiority of this approach. The best ensemble proposed in this work achieves state-of-the-art performance across all three data sets. This result shows that varying data augmentation is a feasible way for building an ensemble of classifiers for image classification (code available at https://github.com/LorisNanni).

Online social networks (OSNs) play an integral role in facilitating social interaction; however, these social networks increase antisocial behavior, such as cyberbullying, hate speech, and trolling. Aggression or hate speech that takes place through short message service (SMS) or the Internet (e.g., in social media platforms) is known as cyberbullying. Therefore, automatic detection utilizing natural language processing (NLP) is a necessary first step that helps prevent cyberbullying. This research proposes an automatic cyberbullying method to detect aggressive behavior using a consolidated deep learning model. This technique utilizes multichannel deep learning based on three models, namely, the bidirectional gated recurrent unit (BiGRU), transformer block, and convolutional neural network (CNN), to classify Twitter comments into two categories: aggressive and not aggressive. Three well-known hate speech datasets were combined to evaluate the performance of the proposed method. The proposed method achieved promising results. The accuracy of the proposed method was approximately 88%.

Electroencephalograms (EEGs) of children with reading disorder (RD) are characterized by higher power and coherence in slow frequencies (delta and theta bands) and lower power and coherence in the alpha band compared to EEGs of typically developed children. Neurofeedback (NFB) is useful for treating learning disorders by reinforcing the reduction of the theta/alpha ratio. This efficacy is supported by EEG power normalization and cognitive-behavioral improvement. To further explore brain changes in isolated areas, this study aimed to explore the effects of this NFB protocol on functional connectivity (coherence) in children with RD. Twenty children with RD and an abnormally high theta/alpha ratio underwent 30 sessions of NFB. After treatment, 90% of par-ticipants learned to decrease their theta/alpha ratio, and on average, children increased their reading accuracy and comprehension scores. Interhemispheric coherence diminished in the delta, theta and beta bands, mainly between frontopolar regions. Intrahemispheric coherence decreased in delta, theta and beta bands and increased in alpha band. The reduction in theta coherence be-tween the left frontal area and other regions of the left hemisphere had particular relevance for reading. These results suggest that this NFB treatment could positively impact reading-related functions in the brain networks of children with RD.

This paper presents a study on the development of the cross-curricular learning outcome (CCLO) "Ethical, environmental and professional responsibility" by the students of different Bache-lor’sDegrees taught at Universitat Politècnica de València. The work and development of this learning outcome entails great complexity, given the double dimension of responsibility that it involves. At the end of their training at the university, students are expected to show ethical, en-vironmental, and professional responsibility towards themselves and others. Interviews have been conducted with lecturers who work and assess this outcome in their subjects, most/all of them related to science and engineering. The objective was to identify the learning approach used at the different subjects to guarantee the acquisition of this CCLO by the students. A focus group has also been carried out with students to determine the importance they give to this learning outcome, and to know their degree of satisfaction with the training received. The methodology used to obtain the data from lecturers and students and to process the information to get a precise diagnosis is fully described in the paper. Results are satisfactory to some extent: most of the lecturers carry out appropriate activities and most of students achieve the expected proficiency level. Finally, recommendations are given to improve the development of this cross-curricular learning outcome.

The novel coronavirus disease (COVID-19) has created immense threats to public health on various levels around the globe. The unpredictable outbreak of this disease and the pandemic situation are causing severe depression, anxiety and other mental as physical health related problems among the human beings. To combat against this disease, vaccination is essential as it will boost the immune system of human beings while being in the contact with the infected people. The vaccination process is thus necessary to confront the outbreak of COVID-19. This deadly disease has put social, economic condition of the entire world into an enormous challenge. The worldwide vaccination progress should be tracked to identify how fast the entire economic as well as social life will be stabilized. The monitor ofthe vaccination progress, a machine learning based Regressor model is approached in this study. This tracking process has been applied on the data starting from 14^th December, 2020 to 24^th April, 2021. A couple of ensemble based machine learning Regressor models such as Random Forest, Extra Trees, Gradient Boosting, AdaBoost and Extreme Gradient Boosting are implemented and their predictive performance are compared. The comparative study reveals that the AdaBoostRegressor outperforms with minimized mean absolute error (MAE) of 9.968 and root mean squared error (RMSE) of 11.133.

Due to the unanticipated, forced migration of classroom activities to a fully remote format because of the coronavirus pandemic, there is a critical need for progress in the online education system. Not only that, but online education is the way of the future, and its infrastructure must be enhanced for teaching and learning to be effective. Engaging the students and enhancing their focus is one of the major concerns in the current video calling-based system. In this research, we propose a VR and AR-based virtual classroom environment system called "Edu VR" which encourages students to learn with a high level of involvement and attentiveness. We have divided the system into 2 distinct categories. one amongst which incorporates the virtual reality classroom, wherever the students can have a similar feel of actual school with peer-to-peer-based interactions and student-to-teacher interactions with Unity3D. We are able to conjointly deploy AR models with Vuforia, which permits the teachers to take classes more efficiently with student’s engagement. The other category involves the AI-based classroom assessment system, which enables teachers to produce assessments, which in turn are proctored by Artificial Intelligence. The results are automatically sent to the student within a short period, with the assistance of text similarity analysis for evaluating the answer scripts with Machine learning. This approach solves the drawbacks of video call-based systems with enhanced focus and engagement.

History learning is often regarded as something that is considered unimportant and boring to be taught in the modern era like now. The existence of history learning itself is still important enough to be studied in the 21st century with all its benefits and uses. One of the uses of history is as a reasoning education. The research questions are how do we take advantage of history learning as reasoning and critical thinking education in the 21st century and how the usage of new media can make historical learning looks more interesting. The method used in this article is literature review with data obtained and analyzed from several journals and research results related to history learning and reasoning education, especially forms of critical thinking in the 21st century. From the results of the research, it was found that there was a link between learning history and its relation as a form of critical thinking in the 21st century, in several ways, such as teaching history based on historical thinking, and the usage of new media in history learning.

Clubhouse is an auditory app that allows users to host various rooms surrounding a diverse range of topics from Artificial Intelligence to Philosophy. Along with its educational and serene approach, it is known for its popularity amongst celebrities, including Elon Musk, Mark Zuckerburg, CEO of Shopify, and its elusive invite and ios-only pass into gaining access into Clubhouse. Waiting lists are available in the case of not achieving an invite, but to further speed the process, various sellers on eBay, Reddit, Twitter, etc., charging invites from $10-$200. This research paper covers the phenomenon of Clubhouse and the emergence of audio-only rooms, along with a hypothesis of why Clubhouse and other apps of a similar kind are experiencing a harsh downfall despite its seemingly successful business model.

This paper proposes a neural network which fuses the data received from a camera system on a gantry, to detect moving objects and calculate relative position and velocity of the vehicles traveling on a freeway, this information is used to estimate the traffic flow. To estimate the traffic flow at both microscopic and macroscopic view, this paper used YOLO v4 and DeepSORT for vehicle detection and tracking, then counting the number of vehicles pass through the freeway by drawing virtual lines and hot zones, also counting the velocity of each vehicles. The information is then pass to the traffic control center, in order to monitoring and control traffic flow on freeways, and analyzing freeway conditions.

The study aimed to identify different molds that grow on various food surfaces. As a result, we conducted a case study for the detection of mold on food surfaces based on the “you only look once (YOLO) v5” principle. In this context, a dataset of 2050 food images with mold growing on their surfaces was created. The dataset was trained using the pre-trained YOLOv5 algorithm. In comparison to YOLOv3 and YOLOv4, this current YOLOv5 model had better precision, recall, and average precision (AP), which were 98.10%, 100%, and 99.60%, respectively. The YOLOv5 algorithm was used for the first time in this study to detect mold on food surfaces. In conclusion, the proposed model successfully recognizes any kind of mold present on the food surface. Using YOLOv5, we are currently conducting research to identify the specific species of the detected mold.

Children’s learning of place value is critical to their future study of mathematics. However, its learning presents a huge challenge for many learners. As result they develop misconceptions and thencommit errors that become an encumbrance to their understanding of place value. It is therefore important to identify these misconceptions and their associated errors early and help children to overcome them. This article reports the findings from literature on what misconceptions learners display in the learning of place value and how they can best be supported to overcome them. The results show that despite the importance of this topic there are limited studies devoted to its research. The dearth of these studies creates a gap in the study of place value.

There is a crucial need for advancement in the online educational system due to the unexpected, forced migration of classroom activities to a fully remote format, due to the coronavirus pandemic. Not only this, but online education is the future, and its infrastructure needs to be improved for an effective teaching-learning process. One of the major concerns with the current video call-based online classroom system is student engagement analysis. Teachers are often concerned about whether the students can perceive the teachings in a novel format. Such analysis was involuntarily done in the offline mode, however, is difficult in an online environment. This research presents an autonomous system for analyzing the students' engagement in the class by detecting the emotions exhibited by the students. This is done by capturing the video feed of the students and passing the detected faces to an emotion detection mode. The emotion detection model in the proposed architecture was designed by finetuning VGG16 pre-trained image classifier model. Lastly, the average student engagement index is calculated. We received considerable performance setting reliability of the use of the proposed system in real-time giving a future scope to this research.

In bilingual communities, social interactions take place in both single- and mixed-language con-texts. Some of the information shared in multilingual conversations is often required in conse-quent social encounters, like interlocutors’ personal information. In this study we explored whether the autobiographical information provided in a single-language context is better re-membered than in an equivalent mixed-language situation. More than 400 Basque-Spanish bilin-gual (pre-)teenagers were presented with new persons who introduced themselves by either using only Spanish or only Basque, or by inter-sententially mixing both languages. Different memory measures were collected immediately after the initial exposure to the new pieces of information (immediate recall and recognition) and on the day after (delayed recall and recognition). In none of the time points was the information provided in a mixed-language fashion worse remembered than that provided in a strict one-language context. Interestingly, the variability across partici-pants in their sociodemographic and linguistic variables had a negligible impact on the effects. These results are discussed considering their social and educational implications for bilingual communities.

We confirm that energy dissipation weighting provides the most accurate approach to determining the effective hydraulic conductivity (Keff) of a binary K grid. A deep learning algorithm (UNET) can infer Keff with extremely high accuracy (R2 > 0.99). The UNET architecture could be trained to infer the energy dissipation weighting pattern from an image of the K distribution with high fidelity, although it was less accurate for cases with highly localized structures that controlled flow. Furthermore, the UNET architecture learned to infer the energy dissipation weighting even if it was not trained on this information directly. However, the weights were represented within the UNET in a way that was not immediately interpretable by a human user. This reiterates the idea that even if ML/DL algorithms are trained to make some hydrologic predictions accurately, they must be designed and trained to provide each user-required output if their results are to be used to improve our understanding of hydrologic systems most effectively.

High-throughput screening technologies continues to produce large amounts of multiomics data from different populations and cell types for various diseases, such as cancer. However, analysis of such data encounters difficulties due to cancer heterogeneity, further exacerbated by human biological complexity and genomic variability. There is a need to redefine the drug discovery development pipeline, bringing an Artificial Intelligence (AI)-powered informational view that integrates relevant biological information and explores new ways to develop effective anticancer approaches. Here, we show SynPred, an interdisciplinary approach that leverages specifically designed ensembles of AI-algorithms, links omics and biophysical traits to predict synergistic anticancer drug synergy. SynPred exhibits state-of-the-art performance metrics: accuracy – 0.85, precision – 0.77, recall – 0.75, AUROC – 0.82, and F1-score - 0.76 in an independent test set. Moreover, data interpretability was achieved by deploying the most current and robust feature importance approaches. A simple web-based application available online at http://www.moreiralab.com/resources/synpred/ was constructed to predict synergistic anticancer drug combinations requiring only the upload of the two drug SMILES to be tested, allowing easy access by non-expert researchers.

White matter hyperintensity (WMH) has been considered the primary biomarker from small-vessel cerebrovascular disease to Alzheimer’s disease (AD) and has been reported for its correlation of brain structural changes. To perform WMH related analysis with brain structure, both T1-weighted (T1w) and (Fluid Attenuated Inversion Recovery(FLAIR) are required. However, in a clinical situation, it is limited to obtain 3D T1w and FLAIR images simultaneously. Also, the most of brain segmentation technique supports 3D T1w only. Therefore, we introduced the semi-supervised learning method that can perform brain segmentation using FLAIR image only. Our method achieved a dice overlap score of 0.86 for brain tissue segmentation on FLAIR, with the relative volume difference between T1w and FLAIR segmentation under 4.8%, which is just as reliable as the segmentation done by its paired T1w image. We believe our semi-supervised learning method has a great potential to be used to other MRI sequences and provide encouragement to people who seek brain tissue segmentation from a non-T1w image.

The rapid development of information and communication technologies has led to the use of new and digital technologies in education which involves combinations of text, graphics, audio, video, animations and other eLearning resources such as authoring tools, Learning Management System (LMS), Mobile learning and others. Arguably, using LMS leaves much to be desired. The inherent problem here is that the future of extensive adoption of ICT via LMS to enhance and promote classroom interaction in Open and Distance Learning (ODL) is bleak. This is worrisome given that the country is lagging far behind in the innovative use of this web 2.0 technology to impart knowledge. Further, the low-level application of LMS in instruction connotes the loss of inherent advantages in its adoption. Also, the online setting which makes students less nervous and interactive, sharing of ideas and viewpoints; and a host of other benefit will be lost. While evidence has shown that LMS is not a new phenomenon, the use of LMS in ODL is still at its infancy, particularly in Nigeria. Research in this area is rare. A quick search on prominent research databases could testify that. It is on this thrust that this study investigates University of Ibadan undergraduate students’ perceived roles and readiness towards integration of learning management system into teaching and learning.

This paper proposes a forecast-centric adaptive learning model that engages with the past studies on the order book and high-frequency data, with applications to hypothesis testing. In line with the past literature, we produce brackets of summaries of statistics from the high-frequency bid and ask data in the CSI 300 Index Futures market and aim to forecast the one-step-ahead prices. Traditional time series issues, e.g. ARIMA order selection, stationarity, together with potential financial applications are covered in the exploratory data analysis, which pave paths to the adaptive learning model. By designing and running the learning model, we found it to perform well compared to the top fixed models, and some could improve the forecasting accuracy by being more stable and resilient to non-stationarity. Applications to hypothesis testing are shown with a rolling window, and further potential applications to finance and statistics are outlined.

It’s always a challenge for a teacher to get their students to be more engaged or active in the classroom. Engagement happens when students are interested in the subject, have fun, and feel welcome in the classroom. But how do we make students more engaged? To make this happen, Educational escape rooms were introduced into studies. In this paper, we will discuss about the creation and evaluation of educational escape rooms within an engineering learning context. As part of our research project, four educational escape rooms were created for students and surveys were conducted among them to evaluate the success of our project. Our findings indicate that the escape room learning model is well accepted by the students. As a result of the activity, high levels of dedication and enthusiasm are recorded and students shows the eagerness to do more escape room activities.

Traditional education, particularly at a university level isn’t necessarily very engaging1 or strong at building teamwork skills. Educational escape rooms are a recent game based learning2 approach which combines team based problem solving with a story-line and cryptic clues. In this3 paper we apply the concept of educational escape rooms to the telecommunications engineering4 classroombycreatingaseriesoftwoseparatescenarios,eachcontainingthreepuzzles. Ourevaluation5 is based on beta tester survey results which suggest that this will be an engaging and challenging6 tool for teaching telecommunications engineering. Although educational escape rooms are rapidly7 being deployed in education, these are the first educational escape rooms that specifically addresses8 the field of telecommunications engineering.

Semantically meaningless strings that are associated with affective attributes (US) can become emotionally valenced CS. Jurchiș et al (2020) recently demonstrated CS-US associations may influence evaluations towards previously-unseen letter strings if the latter share grammar construction rules with CS. We replicated those authors' findings in a modified extension (Experiment 1; N₁ = 108), where happy/angry faces (US) were differentially associated with letter strings (CS) constructed using familiar (English) or non-familiar (Phoenician) alphabets. CS-US sequences were sandwiched by evaluations of strings that never appeared as CS, but shared grammar construction rules. However, post-hoc tests indicated valence effects were restricted to participants classified as 'high awareness' or those who had been exposed to longer stimulus durations, suggesting resource-intense deliberations were central during evaluations. Qualitative awareness checks additionally showcased many participants had attributed valences to recurring elements across conditioned and evaluated exemplars. These limitations were collectively addressed in Experiment 2 (N₂ = 140), where participants viewed Phoenician (/English) CS during conditioning but viewed English (/Phoenician) strings during evaluations, meaning no strings nor elements recurred between phases. We found credible valence effects across English and Phoenician strings, with the latter observed across all awareness categories. Because participants were unable to consciously specify any evaluative strategies while evaluating Phoenician strings, we speculate grammar construction rules (organizing relations) may have been non-consciously acquired during conditioning.

Artificial Intelligence (AI) has seen increased application and widespread adoption over the past decade despite, at times, offering a limited understanding of its inner working. AI algorithms are, in large part, built on weights, and these weights are calculated as a result of large matrix multiplications. Computationally intensive processes are typically harder to interpret. Explainable Artificial Intelligence (XAI) aims to solve this black box approach through the use of various techniques and tools. In this study, XAI techniques are applied to chronic wound classification. The proposed model classifies chronic wounds through the use of transfer learning and fully connected layers. Classified chronic wound images serve as input to the XAI model for an explanation. Interpretable results can help shed new perspectives to clinicians during the diagnostic phase. The proposed method successfully provides chronic wound classification and its associated explanation. This hybrid approach is shown to aid with the interpretation and understanding of AI decision-making processes.

The COVID-19 pandemic is shifting teaching to an online setting all over the world. The Galaxy framework facilitates the online learning process and makes it accessible by providing a library of high-quality community-curated training materials, enabling easy access to data and tools, and facilitates sharing achievements and progress between students and instructors. By combining Galaxy with robust communication channels, effective instruction can be designed inclusively, regardless of the students' environments.

Reinforcement learning (RL) is an extensively applied control method for the purpose of designing intelligent control systems to achieve high accuracy as well as better performance. In the present article, the PID controller is considered as the main control strategy for brushless DC (BLDC) motor speed control. For better performance, the fuzzy Q-learning (FQL) method as a reinforcement learning approach is proposed to adjust the PID coefficients. A comparison with the adaptive PID (APID) controller is also performed for the superiority of the proposed method, and the findings demonstrate the reduction of the error of the proposed method and elimination of the overshoot for controlling the motor speed. MATLAB/SIMULINK has been used for modeling, simulation, and control design of the BLDC motor.

The evolution in imaging technologies and artificial intelligence algorithms, coupled with improvements in UAV technology, has enabled the use of unmanned aircraft in a wide range of applications. The feasibility of this kind of approach for cattle monitoring has been demonstrated by several studies, but practical use is still challenging due to the particular characteristics of this application, such as the need to track mobile targets and the extensive areas that need to be covered in most cases. The objective of this study was to investigate the feasibility of using a tilted angle to increase the area covered by each image. Deep Convolutional Neural Networks (Xception architecture) were used to generate the models for the experiments, which covered aspects like ideal input dimensions, effect of the distance between animals and sensor, effect of classification error on the overall detection process, and impact of physical obstacles on the accuracy of the model. Experimental results indicate that oblique images can be successfully used under certain conditions, but some practical limitations need to be addressed in order to make this approach appealing.

The explosion of data has transformed the world since much more information is available for collection and analysis than ever before. To extract valuable information from the data in different dimensions, various deep learning models have been developed in the past years. Although these models have demonstrated their strong capability on improving products and services in various applications, training them is still a time-consuming and resource-intensive process. Presently, cloud, one of the most powerful computing infrastructures, has been used for the training. However, how to manage cloud computing resources and to perform the training efficiently is still challenging current techniques. For example, general resource scheduling approaches, such as spread priority and balanced resource schedulers, actually do not work well with deep learning workloads. Besides, the resource allocation problem on a cluster can be divide into two subproblems: (1) local resource optimization: improve resource configuration for a single machine; (2) global resource optimization: improve the cluster-wide resource allocation. In this thesis, we propose two novel container schedulers, FlowCon and SpeCon, that are designed to address these two subproblems respectively and specifically to optimize performance of short-lived deep learning applications in the cloud. FlowCon focuses on resource configuration of single-node in a cluster, as show that it efficiently improves deep learning tasks completion time and resource utilization, and reduces the completion time of a specific job by up to 42.06\% without sacrificing the overall system time. SpeCon targets on cluster-wide resource configuration that speculatively migrate slow-growing models to release resources for fast-growing ones. Based on our experiments, SpeCon improves makespan for up to 24.7\%, compared to current approaches.

The advent of deep learning has completely reshaped our world. Now, our daily life is fulfilled with many well-known applications that adopt deep learning techniques, such as self-driving cars and face recognition. Furthermore, robotics developed more forms of technology which share the same principle with face recognition, such as hand pose recognition and fingerprint recognition. Image recognition technology requires a huge database and various learning algorithms, such as convolutional neural network and recurrent neural network, that requires lots of computational power, such as CPUs and GPUs. Thus, clients could not be satisfied with the computational resource of the local machine. The cloud resource platform emerged at a historic moment. Docker containers play a significant role of microservices-based applications in the next generation. However, it could not guarantee the quality of service. From clients’ perspective, they have to balance the budget and quality of experiences (e.g. response time). The budget leans on individual business owners and the required Quality of Experience (QoE) depends on usage scenarios of different applications, for instance, an autonomous vehicle requires real-time response, but, unlocking your smartphone can tolerate delays. Plenty of on-going projects developed user-oriented optimization resource allocation to improve the quality of the service. Considering the users’ specifications, including accelerating the training process and specifying the quality of experience, this thesis proposes two differentiate containers scheduling for deep learning applications: TRADL and DQoES .

The flipped classroom is gaining prominence as an active learning pedagogy to engage a new generation of students. However, all courses do not lend themselves to a fully flipped design and instructors are often reluctant to flip lectures. In this study, I experimented with a “partial” flipped classroom design in a first-year undergraduate economics course. In this partial flipped format, traditional lectures were substituted with micro-lectures and the remaining class time was devoted to activities like quizzes, group work and student presentations. The full lectures were panopto recorded and put up on the e-learning site, Blackboard. This format enabled me to combine the benefits of a traditional lecture with a flipped classroom design. In order to evaluate the effectiveness of the partial flipped classroom format, I compared the final exam scores of students in the partial flipped classroom with those in the control group, which followed a traditional lecture-based approach. The key results from the analysis revealed that students in the partial flipped classroom performed better in the final exams vis-à-vis students in the traditional classroom format. Furthermore, the partial flipped classroom format was associated with lower odds of students failing in the module. This format also resulted in better student engagement, more flexibility and enhanced student-tutor interaction within the classroom.

The commercial popularity of Virtual Reality attracted educators’ interest and brought new opportunities to the educational landscape. At the same time, Learning Analytics emerged with the promise to revolutionise the traditional practices by introducing ways to systematically assess and improve the effectiveness of instruction. However, the collection of ‘big’ educational data is mostly associated with web-based platforms as they offer direct access to learners’ activities with minimal effort. On the antipode, the nature of VR limits the opportunities for such data collection. Hence, in the context of this work, we present a four-dimensional theoretical framework, that accounts the information that can be gathered from VR-supported instruction, and propose a set of structural elements which can be utilised for the development of a Learning Analytics prototype system. The outcomes of this work are expected to support practitioners to maximise the potential of their interventions and provide inspiration for new ones.

Invasive species are significant threats to global agriculture and food security being the major causes of crop loss. An operative biosecurity policy requires full automation of detection and habitat identification of the potential pests and pathogens. Unmanned Aerial Vehicles (UAVs) mounted thermal imaging cameras can observe and detect pest animals and their habitats, and estimate their population size around the clock. However, their effectiveness becomes limited due to manual detection of cryptic species in hours of captured flight videos, failure in habitat disclosure and the requirement of expensive high-resolution cameras. Therefore, the cost and efficiency trade-off often restricts the use of these systems. In this paper, we present an invasive animal species detection system that uses cost-effectiveness of consumer-level cameras while harnessing the power of transfer learning and an optimised small object detection algorithm. Our proposed optimised object detection algorithm named Optimised YOLO (OYOLO) enhances YOLO (You Only Look Once) by improving its training and structure for remote detection of elusive targets. Our system, trained on the massive data collected from New South Wales and Western Australia, can detect invasive species (rabbits, Kangaroos and pigs) in real-time with a higher probability of detection (85–100 %), compared to the manual detection. This work will enhance the visual analysis of pest species while performing well on low, medium and high-resolution thermal imagery, and equally accessible to all stakeholders and end-users in Australia via a public cloud.

Background and motivation: Combining Deep Reinforcement Learning (Deep RL) and Health Systems Simulations has significant potential, for both research into improving Deep RL performance and safety, and in operational practice. While individual toolkits exist for Deep RL and Health Systems Simulations, no framework to integrate the two has been established. Aim: Provide a framework for integrating Deep RL Networks with Health System Simulations, and to ensure this framework is compatible with Deep RL agents that have been developed and tested using OpenAI Gym. Methods: We developed our framework based on the OpenAI Gym framework, and demonstrate its use on a simple hospital bed capacity model. We built the Deep RL agents using PyTorch, and the Hospital Simulation using SimPy. Results: We demonstrate example models using a Double Deep Q Network or a Duelling Double Deep Q Network as the Deep RL agent. Conclusion: SimPy may be used to create Health System Simulations that are compatible with agents developed and tested on OpenAI Gym environments. GitHub repository of code: https://github.com/MichaelAllen1966/learninghospital

Face recognition is one of the most active research fields of computer vision and pattern recognition, with many practical and commercial applications including identification, access control, forensics, and human-computer interactions. However, identifying a face in a crowd raises serious questions about individual freedoms and poses ethical issues. Significant methods, algorithms, approaches, and databases have been proposed over recent years to study constrained and unconstrained face recognition. 2D approaches reached some degree of maturity and reported very high rates of recognition. This performance is achieved in controlled environments where the acquisition parameters are controlled, such as lighting, angle of view, and distance between the camera-subject. However, if the ambient conditions (e.g., lighting) or the facial appearance (e.g., pose or facial expression) change, this performance will degrade dramatically. 3D approaches were proposed as an alternative solution to the problems mentioned above. The advantage of 3D data lies in its invariance to pose and lighting conditions, which has enhanced recognition systems efficiency. 3D data, however, is somewhat sensitive to changes in facial expressions. This review presents the history of face recognition technology, the current state-of-the-art methodologies, and future directions. We specifically concentrate on the most recent databases, 2D and 3D face recognition methods. Besides, we pay particular attention to deep learning approach as it presents the actuality in this field. Open issues are examined and potential directions for research in facial recognition are proposed in order to provide the reader with a point of reference for topics that deserve consideration.

Learning to maintain postural balance while standing requires a significant fine coordination effort between the neuromuscular system and the sensory system. It is one of the key contributing factors towards fall prevention, especially in the older population. Using artificial intelligence (AI), we can similarly teach an agent to maintain a standing posture, and thus teach the agent not to fall. In this paper, we investigate the learning progress of an AI agent and how it maintains a stable standing posture through reinforcement learning. During training, the AI agent learnt three policies. First, it learnt to maintain the Centre-of-Gravity and Zero-Moment-Point in front of the body. Then, it learnt to shift the load of the entire body on one leg while using the other leg for fine tuning the balancing action. Finally, it started to learn the coordination between the two pre-trained policies. This study shows the potentials of using deep reinforcement learning in human movement studies. The learnt AI behaviour also exhibited attempts to achieve an unplanned goal because it correlated with the set goal (e.g. walking in order to prevent falling). The failed attempts to maintain a standing posture is an interesting by-product which can enrich the fall detection and prevention research efforts.

In the past years, various intelligent machine learning and deep learning algorithms have been developed and widely applied for gearbox fault detection and diagnosis. However, the real-time application of these intelligent algorithms has been limited, mainly due to the fact that the model developed using data from one machine or one operating condition has serious diagnosis performance degradation when applied to another machine or the same machine with a different operating condition. The reason for poor model generalization is the distribution discrepancy between the training and testing data. This paper proposes to address this issue using a deep learning based cross domain adaptation approach for gearbox fault diagnosis. Labelled data from training dataset and unlabeled data from testing dataset is used to achieve the cross-domain adaptation task. A deep convolutional neural network (CNN) is used as the main architecture. Maximum mean discrepancy is used as a measure to minimize the distribution distance between the labelled training data and unlabeled testing data. The study proposes to reduce the discrepancy between the two domains in multiple layers of the designed CNN to adapt the learned representations from the training data to be applied in the testing data. The proposed approach is evaluated using experimental data from a gearbox under significant speed variation and multiple health conditions. An appropriate benchmarking with both traditional machine learning methods and other domain adaptation methods demonstrates the superiority of the proposed method.

In this paper, our goal is to perform a virtual restoration of an ancient coin from its image. The present work is the first one to propose this problem, and it is motivated by two key promising applications. The first of these emerges from the recently recognised dependence of automatic image based coin type matching on the condition of the imaged coins; the algorithm introduced herein could be used as a pre-processing step, aimed at overcoming the aforementioned weakness. The second application concerns the utility both to professional and hobby numismatists of being able to visualise and study an ancient coin in a state closer to its original (minted) appearance. To address the conceptual problem at hand, we introduce a framework which comprises a deep learning based method using Generative Adversarial Networks, capable of learning the range of appearance variation of different semantic elements artistically depicted on coins, and a complementary algorithm used to collect, correctly label, and prepare for processing a large numbers of images (here 100,000) of ancient coins needed to facilitate the training of the aforementioned learning method. Empirical evaluation performed on a withheld subset of the data demonstrates extremely promising performance of the proposed methodology and shows that our algorithm correctly learns the spectra of appearance variation across different semantic elements, and despite the enormous variability present reconstructs the missing (damaged) detail while matching the surrounding semantic content and artistic style.

Robots for communication are developed extensively with emphasis on sympathy. This study deals with the growth of character and the control of its operation accordingly. The child has time to be alone with the nature of his/her robot friend. The child can interact with other people's emotional expressions through a robot. Step by step, the robot character will grow as the child grows. Through design studies, qualitative processes such as {customer experience audit, eye tracking, mental model diagrams, semantic differences} have been executed for the results. The participatory behavior research approach through user travel is mapped from the user's lead to the evidence-based design. This research considers how the synthetic characteristics can be applied to the physical growth of robot toys through the product design process. With the development of robot toy "Buddy", we tried making two variations on the robot to achieve recognizable growth. (1) A one-dimensional height scaling and (2) facial expression including the distance between two eyes on the screen. Observations represented children's reactions when "Buddy" was released to with the children. As an independent synthetic character, the robot was recognized by children who had the designed function. Robots for training may require more experimentation.

Speech signals are degraded in real-life environments, product of background noise or other factors. The processing of such signals for voice recognition and voice analysis systems presents important challenges. One of the conditions that make adverse quality difficult to handle in those systems is reverberation, produced by sound wave reflections that travel from the source to the microphone in multiple directions.To enhance signals in such adverse conditions, several deep learning-based methods have been proposed and proven to be effective. Recently, recurrent neural networks, especially those with long and short-term memory (LSTM), have presented surprising results in tasks related to time-dependent processing of signals, such as speech. One of the most challenging aspects of LSTM networks is the high computational cost of the training procedure, which has limited extended experimentation in several cases. In this work, we present a proposal to evaluate the hybrid models of neural networks to learn different reverberation conditions without any previous information. The results show that some combination of LSTM and perceptron layers produce good results in comparison to those from pure LSTM networks, given a fixed number of layers. The evaluation has been made based on quality measurements of the signal's spectrum, training time of the networks and statistical validation of results. Results help to affirm the fact that hybrid networks represent an important solution for speech signal enhancement, with advantages in efficiency, but without a significan drop in quality.

Previously, we described the initial use of Flipped Team‐Based learning (FTBL) defined as TBL approach combined with flipped classroom learning methodology, in which students previewed online lectures and applied their knowledge in different in-class activities. The purpose of the present study is to review the progress within this approach and to investigate how constant changes in team allocation can affect student’s perception regarding this modified FTBL approach. Although students showed reluctance initially to get out of their ‘comfort zone’, our findings show that learners perceived the adoption of the continued random allocation, and became accustomed to this learning approach, which finally assisted them to enhance their team-work skills and classroom performance, to develop their reflective capabilities as well as improving their rapport building skills, learning and academic performance. Learners also believed that this learning strategy that creates critical incidents can simulate their future work environment as they might be expected to work in unfamiliar situations. Therefore, the present study indicated strong support for the modified FTBL method and was seen to work exceptionally well, despite some minor problems that students can experience working in a team and/or with different teammates in every session.

With the increase of the Artificial Neural Network (ANN), machine learning has taken a forceful twist in recent times. One of the most spectacular kinds of ANN design is the Convolutional Neural Network (CNN). The Convolutional Neural Network (CNN) is a technology that mixes artificial neural networks and up to date deep learning strategies. In deep learning, Convolutional Neural Network is at the center of spectacular advances. This artificial neural network has been applied to several image recognition tasks for decades and attracted the eye of the researchers of the many countries in recent years as the CNN has shown promising performances in several computer vision and machine learning tasks. This paper describes the underlying architecture and various applications of Convolutional Neural Network.

The Wester coastal Delta zone of the Netherlands is the relatively more crowded area of the country where ten of the seventeen million people live. The governmental prognosis is that this number of people will increase steadily in the coming decennia, unless the threat of climate-change seawater level rising. This is the picture in more Delta zones globally what makes the topic of resiliency for these delta-areas of importance. Approaches of resiliency are often dominated by governmental rescue planning and believe in technology solutions, while in the process the behaviour of people can make the difference in overcoming climate-change impact disasters. In the struggle against high water storming and flooding, the Dutch people prove this by developing societal resilient behaviour in a broad spectrum of activities. Post-PhD research on Dutch resilient behaviour in the in 1016-flooded Zaanstreek-Waterland area near the city of Amsterdam confirms that. Recently research by questionnaire among citizens in this region shows that people have favour for shared responsibility with government and related professional organizations. The Dutch examples of societal resiliency carried by people also show a action-learning perspective intertwined with governmental contingency planning. Therewith the Dutch practice shows a positive cross-fertilization of practice and knowledge development.

To generate a probability density function (PDF) for fitting probability distributions of real data, this study proposes a deep learning method which consists of two stages: (1) a training stage for estimating the cumulative distribution function (CDF) and (2) a performing stage for predicting the corresponding PDF. The CDFs of common probability distributions can be adopted as activation functions in the hidden layers of the proposed deep learning model for learning actual cumulative probabilities, and the differential equation of trained deep learning model can be used to estimate the PDF. To evaluate the proposed method, numerical experiments with single and mixed distributions are performed. The experimental results show that the values of both CDF and PDF can be precisely estimated by the proposed method.

Here we present a fast and highly scalable community structure preserving network module detection that recursively integrates graph sparsification and clustering. Our algorithm, called SparseClust, participated in the most recent DREAM community challenge on disease module identification, an open competition to comprehensively assess module identification methods across a wide range of biological networks.

This paper focuses on the new users cold-start issue in the context of recommender systems. New users who do not receive pertinent recommendations may abandon the system. In order to cope with this issue, we use active learning techniques. These methods engage the new users to interact with the system by presenting them with a questionnaire that aim to understand their preferences to the related items. Example of questions may include "do you like this book?" and the users answer,"yes", "no", "I have not read it (unknown)", will reflect the degree of interest for the item by the users. As a consequence, the system can learn the users' preferences from these answers. The goal of active learning is to correctly choose the questions (items) for users. Thus it is necessary to personalize the questionnaires to retrieve the maximum information by avoiding "unknown" answers. In this paper, we propose an active learning technique that exploits past users' interests and past users' predictions in order to identify the best questions to ask.

There has been widespread criticism about the rates of participation of students enrolled on MOOCs (Massive Open Online Courses), more importantly, the percentage of students who actively consume course materials from beginning to the end. This study sought to investigate this trend by examining the factors that influence MOOC adoption and use by students in selected Ghanaian universities. The Unified Theory of Acceptance and Use of Technology (UTAUT) was extended to develop a research model. A survey was conducted with 270 questionnaires administered to students who had been assigned MOOCs; 204 questionnaires were retrieved for analysis. Findings of the study show that MOOC usage intention is influenced by computer self-efficacy, performance expectancy, and system quality. Results also showed that MOOC usage is influenced by facilitating conditions, instructional quality, and MOOC usage intention. Social influence and effort expectancy were found not to have a significant influence on MOOC usage intention. The authors conclude that universities must have structures and resources in place to promote the use of MOOCs by students. Computer skills training should also be part of the educational curriculum at all levels. MOOC designers must ensure good instructional quality by using the right pedagogical approaches and also ensure that the sites and learning materials are of good quality.

This work provides an update to the Erasmus Plus TEALEAF project The outcomes of a week-long EU-funded / Irish Government-recognized teacher course in July 2016 is described within the context of a qualitative small scale study investigating teachers' progress in the course. The explicit aim of the teacher course was to equip a diverse group of teachers with the initial tools to work to produce simple digital apps for learning about biodiversity in their respective domains. A community of practice seeks to establish a new concept of the pre-existing generalised collective conscience through triangulated conversation between the generalised and particularised collective and individual consciences. In particular to revise the generalised collective conscience that teachers can program apps for learning about biodiversity. A number of features of teaching and learning were selected in general and their relationship to constructivism delineated. The teachers were prompted for their responses to each day of the course through a self evaluation tool and the responses were ranked according the the rubric. The data was analyzed using multidimensional scaling - ASCAL procedure - in SPSS 23TM and within the repertory grid domain according to the RepSocio tool in Rep 5TM. The plots show a gradual development throughout the week in terms of specific features becoming 'stronger' or exerting more influence towards the middle of the course and fragmenting after that. Analyses were able to show which participants correlated most closely with the hypothetical IDEAL within the community of practice. Concerning this community of practice, one determine the interrelationships within the community are determined using a social mapping exercise moving from the individual consciences to a particularised collective conscience.

Loss of function of the hippocampus or frontal cortex is associated with reduced performance on memory tasks in which subjects are incidentally exposed to cues at specific places in the environment and are subsequently asked to recollect the location at which the cue was experienced. Here, we examined the roles of the rodent hippocampus and frontal cortex in cue-directed attention during encoding of memory for the location of a single incidentally experienced cue. During a spatial sensory preconditioning task, rats explored an elevated platform while an auditory cue was incidentally presented at one corner. The opposite corner acted as an unpaired control location. The rats demonstrated recollection of location by avoiding the paired corner after the auditory cue was in turn paired with shock. Damage to either the dorsal hippocampus or the frontal cortex impaired this memory ability. However, we also found that hippocampal lesions enhanced attention directed towards the cue during the encoding phase while frontal cortical lesions reduced cue-directed attention. These results suggest that the deficit in spatial sensory preconditioning caused by frontal cortical damage may be mediated by inattention to the location of cues during the latent encoding phase, while deficits following hippocampal damage must be related to other mechanisms such as generation of neural plasticity.

This article seeks to strengthen efforts in technological developments based on the classification of PET plastic that positively impacts sustainable development and contributes to suitable solutions in collection centers in Mexico. Three experiment designs and machine learning tools for data processing were developed. For the experimentation, three factors were considered: the bottle's size, the amount of liquids inside the bottle, and the label on the bottle. The first experiment was to identify the distance of the sensor from post-consumer PET bottles. The second experiment was to determine the detection ability of the sensor with different levels of liquids inside the bottles, and the third was to determine the detection ability on the bottle labels. A digital lux meter on a microcontroller was developed to monitor illuminance on post-consumer PET plastic when it contains liquid as it passes through a conveyor belt for processing at an average rate of three bottles per second. With the implemented methodology, liquids were satisfactorily detected inside the transparent PET bottles when they had beverages between 25% and 100% of their capacity. Finally, this paper highlights that it is possible to implement an affordable design to identify bottles with liquids for collection centers.

Physics-informed neural networks can be trained to serve as surrogate models by learning how spatial physical fields develop with change of parameters. This is an advantage over traditional numerical methods that can only be used to calculate a single solution field for a single discrete setting of a parameter. While many studies report accurate results of physics-informed deep learning of laminar flows, evaluations of surrogate modeling of high Reynolds number flows remain sparse. To contribute to this question, we here explore the capabilities and limits of physics-informed deep learning to solve the Reynolds-averaged Navier-Stokes equations for the flow around two airfoils under variable angles of attack. No labeled training data were provided and a single network was trained to simultaneously learn several solution fields in a single training run. The network captured essential flow features such as boundary layers and high and low pressure regions. Moreover, the qualitative correlations of lift and drag with the angle of attack and the higher drag of the thicker airfoil were captured. However, comparisons with reference simulations revealed an underestimation of the shear layer gradients as well as deviations of the fields' extrema. Thus, we also debate potential future improvements to increase the accuracy of the predicted flow. This work offers a prospect on the capabilities and current limitations of physics-informed neural networks for surrogate modeling of high Reynolds number flows. We argue that the method is promising and this work is aimed to encourage further research and development of the method when applied to Reynolds-averaged flows at high Reynolds numbers.

The past is an important lesson for facing the future with greater awareness. In this context, school plays a key role to spread knowledge on natural phenomena and to promote behavior change. Together with researchers, teachers can be strong allies to build more resilient future citizens. The Istituto Nazionale di Geofisica e Vulcanologia (INGV) school training activities provide tools to get ready for the next earthquake and/or tsunamis. About 5000 students from both Middle schools (ISCED 2) and High schools (ISCED 3) were involved in active learning activities based on a flipped-up approach during special online scientific events in the Pandemic. Online lab activities were conducted respectively during the European Researchers’ Night (“Earthquakes: history teaches us the future: researchers for a day with experimentation in didactics for ESL”) and during the World Water Day 2021 and the World Earth Day 2021 (“Tsunamis: history teaches us the future researchers for a day with experimentation in didactics for ESL”). These two Episodes of Situated Learning (ELS) experiences triggered students’ interest, favoring remote learning, developing life skills, focusing on historical seismic studies of both past earthquakes and tsunamis.

Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level of com- pression strength while two points on the article are pushed towards each otherand include objects such as ropes (1D), fabrics (2D) and bags (3D). In general, CDOs’ many degrees of freedom (DoF) introduce severe self-occlusion and complex state-action dynamics as significant obstacles for perception and manipulation systems. These challenges exacerbate existing issues of modern robotic control methods such as imitation learning (IL) and reinforcement learning (RL). This review focuses on the application details of data-driven control methods on four major task families in this domain: cloth-shaping, rope manipulation, dressing and bag manip- ulation. Furthermore, we identify specific inductive biases in these four domains that present challenges for more general IL and RL algorithms, and summarise the future direction for the development of the field.

The rate of technical innovation, system interconnection, and advanced communications undoubtedly boost distributed energy networks' efficiency. However, when an additional attack surface is made available, the possibility of an increase in attacks is an unavoidable result. The energy ecosystem's significant variety draws attackers with various goals, making any critical infrastructure a threat, regardless of scale. Outdated technology and other antiquated countermeasures that worked years ago cannot address the complexity of current threats. As a result, robust artificial intelligence cyber-defense solutions are more important than ever. Based on the above challenge, this paper proposes an ensemble transfer learning spiking immune system for adaptive smart grid protection. It is an innovative Artificial Immune System (AIS) that uses a swarm of Evolving Izhikevich Neural Networks (EINN) in an Ensemble architecture, which optimally integrates Transfer Learning methodologies. The effectiveness of the proposed innovative system is demonstrated experimentally in multiple complex scenarios that optimally simulate the modern energy environment. In this way, the proposed system fully automates the strategic security planning of energy networks with computational intelligence methods. It allows the complete control of the digital strategies of the potential infrastructure that frames it, thus contributing to the timely and valid decision-making during cyber-attacks.

The widespread adoption of electromobility constitutes one of the measures designed to reduce air pollution caused by traditional fossil fuels. However, several factors are currently impending this process, ranging from insufficient charging infrastructure, battery capacity, long queueing and charging time, to psychological factors. On top of range anxiety, the frustration of the EV drivers is further fueled by the lack the uncertainty of finding an available charging point on their route. To address this issue, we propose a solution that comes to bypass the limitations of the Reserve now function of the OCPP standard, enabling drivers to make charging reservations for the upcoming days, especially when planning a longer trip. We created an algorithm that generates reservation intervals based on the charging station's reservation and transaction history. Subsequently, we ran a series of test cases that yielded promising results, with no overlapping reservations.

Machine reading comprehension is a crucial area of research in natural language processing, aiming to enable machines to read and understand text as humans do, and to answer questions related to the text content. The pre-trained language model, represented by BERT, has achieved superior results compared to traditional models in many NLP tasks, leading to the rise of the pre-trained paradigm in the field of natural language processing. This paper addresses the issue that the pre-trained language model lacks the ability to extract long-distance semantic relations and make efficient use of linguistic features. Firstly, the recent developments of the pre-trained language model are described. Then, two feature maps are used to intuitively express the structured long-distance semantic correlation features, and the traditional sequence structure features are integrated. The influence of different feature map construction methods on machine reading comprehension is compared. Finally, the application of the pre-trained language model in machine reading comprehension is summarized and prospected. By fusing graph structure features, the model can learn more abundant language knowledge, thus further improving its reasoning ability.

In this paper, a new axial-type magnetic gear with auxiliary flux-enhancing structure (AFS-AMG) is proposed. Compared to conventional AFS-AMG, it has the higher torque density and higher permanent magnet (PM) utilization factor. Firstly, the design rules and operating principles of proposed AFS-AMG are elaborated. Then, the mapping relation between the radial-type magnetic gears (RMGs) and AMGs are elucidated. Compared to its counterpart in RMGs, AFS-AMGs achieve small size. Then, the geometrical parameters of AFS-AMGs are optimized to obtain the better electromagnetic performances, where the torque density per volume and per PM volume is adopted as the evaluation standard. Finally, three different AMG topologies are constructed in finite element analysis (FEA) software for comparison. It is proven that the AFS-AMG has the largest torque density per volume and per PM volume.

Due to the rapid development of unmanned aerial vehicles (UAVs) communication technology, UAVs are gradually competing with primary users (PUs) for spectrum resources. Cognitive radio (CR) is a promising solution to meet the needs. Cooperative spectrum sensing (CSS) is considered as an effective method to detect the PU signal and identify available spectrum resources for UAVs in a cognitive UAV network (CUAVN). However, the cooperative mode among multiple UAVs may incur a high overhead, resulting in performance degradation. Therefore, we introduce a differential sequential 1 (DS1), which incorporates a differential mechanism and leverages the sequential idea based on the classical voting rule to enhance cooperative performance and efficiency. In view of this, we formulate three scenarios to characterize the PU activity and introduce a multi-slot cooperative mode within a single UAV to realize cooperative gain. Further, only the information change about the PU status is sequentially calculated in DS1, and combined with a sequential idea, the efficiency of the voting rule is greatly improved. Moreover, the application of support vector machines (SVM) in dynamic selection enables the selection of the most suitable voting rule based on diverse sensing parameters. This dynamic selection process ensures optimal performance and efficiency by adapting the voting rule to the specific characteristics of the given scenario. Finally, simulation results demonstrate that the superiority of our proposal with respect to the detection performance, sample size and the energy efficiency is evident, which proves the high performance of the proposed policy.

We develop new theory from a broad case-study approach to explore a better understanding of what constitutes knowledge and its value as identifiable to human-machine teams. From past research, this trail of exploration will lead to these initial questions: What is the value of debate in the furtherance of knowledge? Will machines with AI be able to contribute to a debate if we humans cannot define it or determine its value sufficiently for a machine’s understanding, contribution, exploration and identification? Like humans, as teammates, machines must be able to determine with AI what constitutes the usable knowledge that contributes to a team’s success in the field (e.g., testing "knowledge" in the field, identifying new knowledge, using knowledge to develop innovation) or its failure (viz., trouble shooting; identifying weaknesses; discovering vulnerabilities, hiding by deception). It matters not whether a debate is public, private or unexpressed by an individual human or machine agent alone; we speculate in this exploration that the process advances the science of autonomous human-machine teams and assists in interpretable machine learning. We conclude with questions and a speculation: How does a human become aware or express its awareness of knowledge? Can a machine be as expressive as its human teammates? And how does a human-machine teammate become aware that its teammates possess sufficient knowledge to perform a task? We speculate that the structure of “knowledge," once found, is resistant to alternatives (i.e., it is ordered); that its functional utility is generalizable; and that its applications are multifaceted (akin to maximum entropy production). The complexity of the team is taken into consideration in our search for knowledge, which can also be used as an information metric.

The paper presents the basic structural parts, a 3D model and the overall design of a laboratory machine, which was created to detect vibrations generated by the casing of a conveyor roller ro-tating at different speeds. The intention of the authors was to verify whether plastic brackets in-serted into the structurally modified trestles of a fixed conveyor idler can reduce the vibration values transmitted from the rotating conveyor roller to the trestle of a fixed idler. Experimental vibration measurements taken on the non-rotating parts of conveyor rollers, performed on a laboratory machine according to ISO 10816, are suitable for characterizing their operating condi-tions with regard to trouble-free operation. The aim of this paper is to detect the vibrations of a rotating conveyor roller on a laboratory machine in the defined places of a fixed conveyor idler and also on the steel frame of a laboratory machine that represents the supporting track of a belt conveyor. Vibrations detected by piezoelectric acceleration sensors were recorded by a measur-ing apparatus and displayed in the environment of Dewesoft X software. The measurements show that the vibration values grow with the increasing speed of the conveyor roller rotation. Experimental measurements have proven the correctness of the assumption that the vibrations transmitted to the trestle of a fixed conveyor idler are lower by up to 40% when using plastic brackets into which the axle of the conveyor roller is attached, compared to the solution where the axle of the conveyor roller is inserted into the notches of a steel trestle.

In this review, our goal is to design and test quantum-like algorithms for Artificial Intelligence (AI) in open systems to structure a human-machine team to be able to reach its maximum performance. Unlike the laboratory, in open systems, teams face complexity, uncertainty and conflict. All task domains have complexity levels, some have low, and others high levels. Complexity in this new domain is affected by the environment and the task, which are both affected by uncertainty and conflict. We contrast the individual and interdependence approaches to teams. The traditional and individual approach focuses on building teams and systems by aggregating the best available information for individuals, their thoughts, behaviors and skills. Its concepts are characterized chiefly by one-to-one relations between mind and body, a summation of disembodied individual mental and physical attributes, and degrees of freedom corresponding to the number of members in a team; however, this approach is characterized by the many researchers who have invested in it for almost a century with few effects that can be generalized to human-machine interactions; by the replication crisis of today (e.g., the invalid scales for self-esteem, implicit racism, and honesty); and by its many disembodied concepts. In contrast, our approach is based on the quantum-like nature of interdependence. It allows us to theorize about the bistability of mind and body, but it proposes a measurement problem and a non-factorable nature. Bistability addresses team structure and performance; the measurement problem solves the replication crisis; and the non-factorable aspect of teams reduces the degrees of freedom and the information derivable from teammates to match findings by the National Academies of Science. We begin with a review of the science of teams and a focus on human-machine team research in the laboratory versus the open; justifications for rejecting traditional social science while supporting our approach; a full understand of the complexity of the domain, tasks in the domain, and how teams address both; the mathematics involved; a review of results from our model versus the open field; a discussion of the results; conclusions; and the path forward to successfully advance the science of interdependence and autonomy.

According to a recent study by OpenAI, Open Research, and the University of Pennsylvania, large language models (LLMs) based on artificial intelligence (AI), such as Generative Pretrained Transformers (GPTs), may have potential implications on the job market, specifically regarding job occupations that demand writing or programming skills. The research points out Interpreters and Translators as one of the main job occupations with greater exposure to AI in the US job market (76.5%). This article, following a mixed-methods survey-based research, provides insights into the Portuguese Language Service Providers (LSPs) awareness and knowledge about AI, specifically regarding neural machine translation (NMT) and large language models (LLM), its actual use and usefulness, as well as their potential influence on work performance and labour market. The results show that most professionals are unable to identify if AI and/or automation technologies support the tools that are most used in the profession. The usefulness of AI is essentially low to moderate and the professionals who are less familiar with it and less knowledgeable also demonstrate lack of trust in it. Two thirds of the sample estimate negative or very negative effects of AI in the profession, expressing as main concerns the devaluation and replacement of experts, the reduction of income, and the reconfiguration of the career of translator to mere post-editors.

This paper presents a cascade predictive control structure based on the field-oriented control (FOC) in the dq rotor reference frame for the synchronous reluctance machine (SynRM). The constant d-axis current control strategy was used and thus, the electromagnetic torque was directly controlled by the q-axis current. Because the model of the two axes currents from the inner loop is a coupled non-linear multivariable one, to non-interaction linear control the two currents, their decoupling was achieved through feedforward components. Following the decoupling, two independent monovariable linear systems resulted for the two currents dynamics that were controlled using model predictive control (MPC) algorithms, considering their ability to automatically handle the state bounds. The most important bounds for SynRM are the limits imposed on currents and voltages, which in the dq plane correspond to a circular limit. To avoid computational effort, linear limitations were adopted through polygonal approximations, resulting in rectangular regions in the dq plane. For the outer loop that controls the angular speed with a constrained MPC algorithm, as plant was considered the q-axis current closed loop dynamics and the torque linear equation. To evaluate the performances of the proposed cascade predictive control structure, a simulation study using MPC controllers versus PI ones was conducted.

Cytosine (C) to uracil (U) RNA editing is one of the most important post-transcriptional processes, however exploring C-to-U editing events efficiently within the crop mitochondrial genome remains a challenge. An improving predictive RNA editor for crop mitochondrial genomes, iPReditor-CMG, was proposed, which was based on SVM, three common crop mitochondrial genomes and self-sequenced tobacco mitochondrial ATPase. After multi-combination feature extracting, high-dimension feature screening and multi-test independent predicting, the results showed that the average accuracy of intraspecific prediction was 0.85, and the highest value even up to 0.91, which outperformed the previous reference models. While the prediction accuracies were 0.78 between dicotyledons and no more than 0.56 between dicotyledons and monocotyledons, implying a possible similarity in C-to-U editing mechanisms among close relatives. The best model was finally identified with an independent test accuracy of 0.91 and an area under the curve of 0.88, and further suggested that five unreported feature sequences TGACA, ACAAC, GTAGA, CCGTT and TAACA were closely associated with the editing phenomenon. Multiple evaluation findings supported that the iPReditor-CMG could be effectively applied to predict crop mitochondrial editing sites, which may contribute to insight into their recognition mechanisms and even other post-transcriptional events in crop mitochondria.

ClinVar is a web platform that stores around 774k curated entries, which allows exploring genetic variants and their associations with complex phenotypes. A partial set of ClinVar’s genetic associations were reported with conflict of interpretation or uncertain clinical impact significance, which currently challenges clinicians and geneticists. Here, we evaluate the performance of data pre-processing methods combined with classical prediction methods, such as Naive Bayes, Random Forest, and Support Vector Machine to build a meta-prediction model aiming to improve genetic pathogenicity interpretation. Models were trained with ClinVar data (September 2020), and genetic variants were annotated with eight functional impact predictors catalogued with SnpEff/SnpSift (v4.3). A 10-fold cross-validation strategy was performed for evaluation by accuracy, F1-Score, Receiver Operating Characteristic, Area Under Curve. The best meta-prediction model raises by combining one-hot encoding with tree-based classifiers as Random Forest, which shows Area Under Curve ≥ 0,93. We predict pathogenicity for 109k genetic variants, which were found labeled as uncertain significance or conflict of interpretation. Additionally, we implemented AmazonForest (https://www.lghm.ufpa.br/amazonforest), a web tool to query data for a set of 5k variants that were predicted with high pathogenic probability (RFprob >= 0.9).

This paper presents a multi-year research study conducted at the University of Toledo, aimed at improving human-machine teaming (HMT) methods and technologies. With the incorporation of artificial intelligence (AI) into 21st-century machines, collaboration between humans and machines has become highly complicated for real-time applications. The penetration of intelligent and synthetic assistants (IA/SA) in virtually every field has opened a path for the new area of HMT. When it comes to crucial tasks such as patient treatment and care, defense, and industrial production, the use of non-standardized HMT technologies may pose a risk to human lives as well as up to billions of taxpayer dollars. A thorough literature survey revealed that there are not many established standards or benchmarks for HMT. In this paper, we aim to address the lack of HMT design and development standards. We propose a method to design an HMT based on a generalized architecture. This design includes the development of an intelligent collaborative system and human team. Followed by processes and metrics to test and validate the proposed model, we present a novel human-in-the-loop (HIL) simulation method using two controlled HMT scenarios; first, emergency care provider (ECP) training, and second, patient treatment by an experienced medic. Both scenarios include humans processing visual data and performing actions that represent real-world applications while responding to a Voice-Based Synthetic Assistant (VBSA) as a collaborator that keeps track of actions. As part of these HMT simulation studies, the impact of each parameter related to machines, humans, and HMT (such as errors made by humans and by the VBSA) is presented from the perspective of performance, rules, roles, and operation limitations. In addition, based on the analysis of results from two case studies, we presented guidelines for designing future HMT. Our conclusions indicate that the proposed HIL can be used to perform standardization studies in the pursuit of developing techniques for benchmarking HMT that can be used in critical situations.

We first review the literature on machine behavior which may contain the interaction between machines, and then discuss the methodology and the related case involving collaboration between robots to instantiate the concept with AI empowerment. The navigation case aims to a security application with autonomous control and roadside agent embedded in a mobile edge computing structure. In the studied navigation based on the artificial potential field method, robots need to use position information to calculate the moving direction frequently. In the case of high motion speed as well as GPS positioning error, the path trajectory may show a sharp change of direction. In order to mitigate the trajectory oscillation, this paper proposes a path planning design where training process and motion direction prediction are integrated by using artificial neural network. The auxiliary navigation agent near multiple obstacles can first extract the past movement information of the robot and then determines whether there is a serious path jitter event. Computer simulation analysis shows that the combination of autonomous control and cooperative behavior can effectively reduce the path jitter so as to achieve a fast and safe path planning.

This paper evaluates the feasibility of applying Massive MIMO to tackle the uplink mixed-service communication problem. Under the assumption of an available physical narrowband shared channel (PNSCH), devised to exclusively consume data traffic from Machine Type Communications (MTC) devices, the capacity (i:e:, number of connected devices) of MTC networks and, in turn, that of the whole system, can be increased by clustering such devices and letting each cluster share the same time-frequency physical resource blocks. Following this research line, we study the possibility of employing sub-optimal linear detectors to the problem and present a simple and practical channel estimator that works without previous knowledge of the large-scale channel coefficients. Our simulation results suggest that the proposed channel estimator performs asymptotically as well as the MMSE estimator with respect to the number of antennas and the uplink transmission power. Furthermore, the results also indicate that, as the number of antennas is made progressively larger, the performance of sub-optimal linear detection methods approaches the perfect interference-cancellation bound. The findings presented in this paper shed light on and motivate for new and exciting research lines towards a better understanding of the use of massive MIMO in MTC networks.

While the mobile phone is the world’s most popular media device, it is actually not one single medium, but is effectively used as a different medium by different user groups. The article characterizes polymodal differences in mobile apps usage among different user groups, including gender, education, occupation, screen size, and price. We monitored the complete app usage of 10,725 smartphone users for one month each (56 million sessions, recording almost 1 million hours). Our key contribution consists in developing and analyzing a theoretical framework to classify the over 16,000 apps used into five categories. Exploring nine research questions we provide a broad characterization by asking who, with which characteristics, uses which kinds of apps in what extensity and intensity? For example, it is not the young and high occupational grades that use the mobile phone as a human-to-machine computer (including gaming and artificial intelligence tools). Large screen size is related to extensive long sessions, while a small screen size is related to intensive frequent usage. The results go beyond providing ample empirical evidence for the inherently polymodal nature of the mobile phone, but also proposes a framework on how to possibility deal with it analytically.