Cybersecurity plays a relevant role in the new digital age in aerospace industry. Predictive algorithms are necessary to interconnect complex systems within the cyberspace. In this context, where security protocols do not apply, challenges to maintain data privacy and security arise for the organizations. Thus, the need of cybersecurity is required. The four main categories to classify threats are interruption, fabrication, modification and interception. They all share a common thing, soften the three pillars which cybersecurity needs to guarantee. These pillars are confidentiality, availability and integrity of data (CIA). Data injection can contribute to this event by creation of false indicators which can lead to errors creation during the manufacturing engineering process. In this paper, the impact of data injection on existing dataset used on manufacturing process is shown. The design model synchronizes the following mechanisms developed within machine learning techniques which are, the risk matrix indicator to assess the probability of producing an error, the dendrogram to clusters the dataset in groups with similarities, the logistic regression to predict the potential outcomes and the confusion matrix to analyze the performance of the algorithm. The results presented in this study, which was carried out using a real dataset related to the electrical harnesses installed in a C295 military aircraft, estimate that injection of false data indicators increase the probability of errors creation in 24.22 % on the predicted outcomes required for the generation of the manufacturing process. Overall, implementing cybersecurity measures and advanced methodologies to detect and prevent cyberattacks are necessary.

The Dst index is the geomagnetic storm index used to measure the energy level of geomagnetic storms, and the prediction of this index is of great significance for the geomagnetic storm study and the solar activity. In contrast to traditional numerical modelling techniques, machine learning, which has emerged in decades ago based on rapidly developing computer hardware and software and artificial intelligence methods, has been unprecedentedly developed in geophysics, especially solar-terrestrial space physics. This study chooses two machine learning models, the LSTM (Long-Short Time Memory, LSTM) and EMD-LSTM model (Empirical Mode Decomposition, EMD), to model and predict the Dst index. By building the Dst index data series from 2018-2023, two models were built to fit and predict the data. Firstly, we evaluated the influences of the learning rate and the amount of training data on the prediction accuracy of the LSTM model, and finally, 10-3 was thought as the optimal learning rate; secondly, the two models were used to predict the Dst index in the solar active and quiet periods, respectively, and the RMSE (Root Mean Square Error) of the LSTM model in the active period is 7.34 nT, the CC (correlation coefficient) is 0.96, those of the quiet period are 2.64nT and 0.97; the RMSE and r of EMD-LSTM model are 8.87nT and 0.93 in active time and 3.29nT and 0.95 in the quiet time. Finally, the prediction accuracy of the LSTM model in short time period is slightly better than the EMD-LSTM model. However, there will be a problem of prediction lag, which the EMD-LSTM model can then solve, and can better predict the geomagnetic storm.

The construction enterprise is a essential zone that contributes considerably to the worldwide financial system. but it faces numerous challenges, together with inefficiency in electric and electronics engineering tasks. This inefficiency results in delays, expanded charges, and decreased productivity. Device learning strategies have the capacity to deal with those challenges through optimizing the making plans and execution of electrical and electronics engineering tasks within the construction industry. This study paper targets to discover using machines gaining knowledge of strategies to maximise efficiency in electrical and electronics engineering projects inside the production industry. Mainly, the paper will be conscious of developing and imposing gadget mastering algorithms to optimize project scheduling, fabric procurement, and system utilization. The paper will even look at the ability of using predictive analytics to identify and mitigate dangers related to electric and electronics engineering tasks. The study could be based on a combination of literature review and empirical analysis. The literature evaluation will provide a top-level view of the demanding situations going through the development industry and the capability advantages of the usage of system getting to know strategies to deal with those challenges. The empirical evaluation will involve the improvement and testing of device mastering models on real-world information from electrical and electronics engineering initiatives inside the construction industry. The predicted results of this research are the development of a fixed of sensible recommendations for the use of machine gaining knowledge of strategies to optimize electric and electronics engineering projects within the construction industry. These suggestions will be beneficial for venture managers, engineers, and other stakeholders within the creation enterprise who're inquisitive about maximizing performance and decreasing charges of their tasks. Ordinary, this studies paper aims to contribute to the continued efforts to enhance the efficiency and productiveness of the development enterprise via exploring the ability of system studying techniques to optimize electrical and electronics engineering tasks.

This study proposes a method for image matching between infrared(IR)-RGB images using a deep learning network to estimate the deformation field. We propose a deformation field generator (DFG) that estimates the deformation field of the transformation matrix to match each pixel or IR image to the RGB image. DFG is a network that receives IR and RGB images as input; the output size is two channels and has the sample resolution as the input image. By warping the IR image through a grid-sampler that warps the image according to the value of the deformation field, we can obtain a warped IR image that matches the RGB image. Additionally, to check whether the warped IR image matched the RGB image, the masking images detecting the segmentation of objects were photographed in two images. Without directly comparing IR and RGB images, we proposed mask loss that warps the IR mask image through the deformation field and grid sampler and then compares the warped IR mask image with the RGB mask image. Mask loss solves the spatial similarity comparison problem with multi-modality images, such as IR and RGB images, by comparing the mask image with the same modality image as the mask image.

Snow parameters have traditionally been retrieved using discontinuous, multi-band sensors; however, continuous hyperspectral sensor are now being developed as an alternative. In this paper we investigate the performance of various sensor configurations using machine learning neural networks trained on a simulated dataset. Our results show improvements in accuracy of retrievals of snow grain size and impurity concentration for continuous hyperspectral channel configurations. Retrieval accuracy of snow albedo was found to be similar for all channel configurations.

Vehicle re-identification research under surveillance cameras has yielded impressive results. However, the challenge of Unmanned Aerial Vehicle (UAV)-based vehicle re-identification (ReID) presents a high degree of flexibility, mainly due to complicated shooting angles, occlusions, low discrimination of top-down features, and significant changes in vehicle scales. To address this, we propose a novel Dual Mixing Attention Network (DMANet) to extract discriminative features robust to variations in viewpoint. Specifically, we first present a plug-and-play Dual Mixing Attention Module (DMAM) to capture pixel-level pairwise relationships and channel dependencies, where DMAM is composed of Spatial Mixing Attention (SMA) and Channel Mixing Attention (CMA). First, the original feature is divided according to the dimensions of spatial and channel to obtain multiple subspaces. Then, a learnable weight is applied to capture the dependencies between local features in the mixture space. Finally, the features extracted from all subspaces are aggregated to promote their comprehensive feature interaction. Moreover, the DMAM can be readily inserted into backbone networks at any depth to improve vehicle discrimination. The experiments show that the proposed structure gains a better performance compared with the representative methods in the UAV-based vehicle ReID task. Our code and models will be publicly released.

Chlorophyll-a (Chla) is a crucial pigment in phytoplankton, playing a vital role in determining phytoplankton biomass and water nutrient status. However, in optically complex water bodies, Chla concentration is no longer the primary factor influencing remote sensing spectral reflectance signals, leading to significant errors in traditional Chla concentration estimation methods. With advancements in in-situ measurements, synchronized satellite data, and computer technology, machine learning algorithms have become popular in Chla concentration retrieval. Nevertheless, when using machine learning methods to estimate Chla concentration, abrupt changes in Chla values can disrupt the spatiotemporal smoothness of the retrieval results. Therefore, this study proposes a two-stage approach to enhance the accuracy of Chla concentration estimation in optically complex water bodies. In the first stage, a one-dimensional convolutional neural network (1DCNN) is employed for precise Chla retrieval, and in the second stage, the regression layer of the 1DCNN is replaced with Support Vector Regression (SVR). The research findings are as follows: (1) In the first stage, the performance metrics (R², RMSE, RMLSE, Bias, MAE) of the 1DCNN outperform state-of-the-art algorithms (OCI, SVR, RFR) on the test dataset. (2) After the second stage, the performance further improves, with the metrics achieving values of 0.892, 11.243, 0.052, 1.056, and 1.444, respectively. (3) In mid-to-high latitude regions, the inversion performance of 1DCNN\SVR is superior to other algorithms, exhibiting richer details and higher noise tolerance in nearshore areas. (4) 1DCNN\SVR demonstrates high inversion capabilities in water bodies with medium to high nutrient levels.

Previous research has explored different models of synchronous remote learning environments supported by videoconferencing and virtual reality platforms. However, few studies have evaluated the preference and acceptance of synchronous remote learning in a course streamed in an immersive or augmented reality platform. This case study uses ANOVA analysis to examine the engineering students´ preferences for receiving instruction during the COVID19 pandemic in three classroom types: face-to-face, conventional virtual (mediated by videoconferencing) and an immersive virtual classroom (IVC). Likewise, structural equation modeling, was used to analyze the acceptance of the IVC perceived by students, this includes four latent factors: ease of receiving a class, perceived usefulness, attitude towards IVC and IVC use. The findings showed that the IVC used in synchronous remote learning has a similar level of preference to the face-to-face classroom, and higher than the conventional virtual one. Despite the high preference for receiving remote instruction in IVC, aspects such as audio delays that affect interaction still need to be resolved. On the other hand, a key aspect for a good performance of these environments is the dynamics associated with the teaching-learning processes and the instructor´ qualities.

Transformative learning is an emerging and unique learning theory for adults. Foreign adult education scholars, represented by Mezirow, have produced significant research results in this field. However, research in this area in China is relatively lacking. This paper interprets the personal story of an English teacher through six stages and combines transformative learning theory to position the roles of adult learners in transformative learning. The author believes that adult learners today must take on six missions and play the roles of discerners, reflectors, communicators, integrators, aspirers, and resilient individuals in the transformative learning process.

Tracking temperature changes in certain geographic regions is a current task in modern research on Earth's climate changes. One of the global problems in solving this task is related to the large volume of measured data and the search for appropriate methods for effective determination of changes. The purpose of this research is to track climate temperature changes using a machine learning-based automated change detection method. The presented method includes training of a two-level structure of neural networks, with measured temperatures for a ten-year period of time for a certain geographical region. In the testing phase, the neural structure classifies measured temperatures for two three-year periods, before and after the ten-year time period, respectively, for the same geographic region. An algorithm was developed to visualize the studied regions by creating a map with their geographic coordinates. The classification results in the neural structure outputs are presented and analyzed as possible temperature changes. Suggestions for continuing and expanding the research in the future are discussed.

Breast cancer (BC) is the second leading cause of death in the United States in women. 1 in 8 women in their lifetime has a risk of developing breast cancer. With advances in omics technology, more data is available for diagnosis, treatment, and prognosis. The help of Machine Learning algorithms, a subdomain of Artificial Intelligence, would allow for a better clinical support tool. Machine Learning could be the key to answering a complex problem in BC. The methodology of this research question involves collecting and finding data such as RNA-Seq datasets, selecting and training appropriate machine learning algorithms, and evaluating the performance of the algorithms in predicting BC prognosis. Also, the study explores and tries to identify the most relevant genes and pathways through feature selection extraction and dimensionality reduction techniques. After applying feature extraction, the top 10 genes were extracted using the Univariate Feature Selection (UFS) method, precisely the SelectKBest technique. After employing different machine learning algorithms, such as Networks, Random Forest, Linear SVM, Logistic Regression, and Quadratic Discriminant Analysis (QDA), we found QDA was the best model in classifying the RNA-seq dataset with a 96% accuracy rate and 94% ROC AUC. This study suggests that AK2 and CD68 have a positive correlation with each other, and it could potentially be a biomarker and therapeutic target for BC.

It is crucial to select the right machine learning classifier for image classification and face recog-nition. This study examines the effectiveness of four different face recognition classifiers - Support Vector Machines (SVM), Random Forest, K-Nearest Neighbors (KNN), and Neural Networks. An analysis of the Large Faces in the Wild (LFW) dataset was carried out using Principal Component Analysis (PCA). Classifiers are rigorously trained and evaluated based on the extracted features. Comparison of classifier performance is an insightful way to figure out their strengths and weaknesses. Having a visual representation of the classifier's performance gives a complete understanding of its capabilities. Through the selection of the most appropriate classifier, study results contribute to advancements in image classification, recognition, and biometric identification. The comparison study demonstrated that the Neural Network classifier was exceptionally accurate and proficient in recognizing faces from the LFW dataset when used in conjunction with PCA for feature extraction. According to the comparative analysis, the Neural Network classifier proved exceptionally accurate and proficient at identifying faces from the LFW dataset when combined with PCA for feature extraction.

This study focused on the predictive models incorporating machine learning techniques that induce new dynamics for forecasting energy generation, enabling effective planning, financing, and system monitoring. The research developed a machine learning-based power generation prediction model tailored explicitly for Kenya's Garissa solar power plant. The selected model demonstrated a root mean squared error of 5.23 during evaluation, resulting in a prediction accuracy of 90.42%. This high accuracy indicates that the model can be relied upon for precise generation prediction, facilitating effective planning, and system performance monitoring

Recent advances in mathematical modelling and artificial intelligence have challenged the use of traditional regression analysis in biomedical research. This study examined artificial and cancer research data using binomial and multinomial logistic regression and compared its performance with other machine learning models such as random forests, support vector machines, Bayesian classifiers, k-nearest neighbours and repeated incremental clipping (RIPPER). The alternative models often outperformed regression in accurately classifying new cases. Logistic regression had a structural problem similar to early single-layer neural networks, which limited its ability to identify variables with high statistical significance for reliable class assignment. Therefore, regression is not always the best model for class prediction in biomedical datasets. The study emphasises the importance of validating selected models and suggests that a mixture of experts approach may be a more advanced and effective strategy for analysing biomedical datasets.

(1) Background: Colon polyps are common protrusions in the colon’s lumen with potential risks of developing colorectal cancer. Early detection and intervention of these polyps are vital for reducing colorectal cancer incidence and mortality rates. This research aims to evaluate and compare the performance of three machine-learning image classification models’ performance in detecting and classifying colon polyps. (2) Methods: The performance of three machine learning image classification models, Google Teachable Machine (GTM), Roboflow3 (RF3), and You Only Look Once version 8 (YOLOV8), in the detection and classification of colon polyps were evaluated. The study used a dataset of colonoscopy images of normal colon, polyps, and resected polyps. The study assessed the models’ ability to correctly classify the images into their respective classes using precision, recall, and F1 score generated from confusion matrix analysis and performance graphs. (3) Results: All three models successfully distinguished between normal colon, polyps, and resected polyps in colonoscopy images. GTM achieved the highest accuracies: 0.99, with consistent precision, recall, and F1 scores of 1.00 for the `normal’ class, 0.97 - 1.00 for `polyps,’ and 0.97 - 1.00 for `resected polyps.’ While GTM exclusively classified images into these three categories, both YOLOV8 and RF3 extended their capabilities to detect normal colonic tissue, polyps, and resected polyps, with YOLOV8 and RF3 achieving overall accuracies of 0.84 and 0.87, respectively. (4) Conclusions: Machine learning, particularly models like GTM, shows promising results in ensuring comprehensive detection of polyps during colonoscopies.

For adolescents, high aggression is often associated with suicide, physical injury, worse academic performance, and crime. Therefore, there is a need for early identification and intervention for highly aggressive adolescents. The Buss-Warren Aggression Questionnaire (BWAQ) consists of 34 items, and the longer the scale, the more likely participants are to make an insufficient effort response (IER), which reduces the credibility of the results and increases the cost of implementation. The study aimed to develop a shorter BWAQ using machine learning (ML) techniques to reduce the frequency of IER and decrease implementation costs meantime. First, an initial version of the short-form questionnaire was determined using Stepwise Regression and ANOVA F-test. Then, a machine learning algorithm determined the optimal short-form questionnaire (BWAQ-ML). Finally, the reliability and validity of the optimal short-form questionnaire were tested using independent samples. The BWAQ-ML has 88% fewer items than the BWAQ. It has AUC, accuracy, recall, precision, and F1 scores of 0.85, 0.85, 0.89, 0.83, and 0.86, respectively, and good psychometric properties. The BWAQ-ML can effectively measure individual aggression and can be used as a simplified version of BWAQ.

: Innovative solutions are now being researched to manage the ever-increasing amount of data required to optimize the performance of internal combustion engines. Machine Learning ap-proaches have shown to be a valuable tool for signal prediction due to their real-time and cost-effective deployment. Among them, the architecture consisting of Long Short-Term Memory (LSTM) and one-dimensional Convolutional Neural Networks (1DCNN) has emerged as a highly promising and effective option for replacing the role of physical sensors. The architecture com-bines the capacity of LSTM to detect patterns and relationships in smaller segments of the signal with the ability of 1DCNN to detect patterns and relationships in larger segments of the signal. The purpose of this work is to assess the feasibility of substituting a physical device dedicated to calculating the torque supplied by a spark-ignition engine. The suggested architecture was trained and tested using signals from the field during a test campaign conducted under transient operating conditions. The results reveal that LSTM+1DCNN is particularly well suited for signal prediction with considerable variability. It constantly outperforms other architectures used for comparison, with average error percentages of less than 2%, proving the architecture's ability to replace physical sensors.

Academic performance and capabilities were greatly influenced by creativity. It has also contributed to comprehending academic skill development independent of motivation and intelligence. This study examines the relationship between student creativity and academic skills. This is the systematic literature review for 2016 to 2022. The main criteria for including an article in the research were that it was written in English, that it was pertinent to the topic of the study, that its sample consisted of students aged 5 to 16 with regular, typical development, that it was a descriptive, exploratory, or longitudinal study, and that it was accessible to the public. Seven articles were included in the study following a critical and systematic analysis and evaluation. As the results indicate, creativity and its characteristics correlate substantially with academic skills such as reading, comprehension, academics, word processing, and written assignments. Additionally, creativity contributed considerably to children’s academic performance, both currently and in the future. The present study concludes that creativity is essential for enhancing and promoting children’s academic performance.

Advancements in computing technology have resulted in significant changes in education, healthcare, and manufacturing fields. Thus, personnel training in computer-related fields is directly related to national competitiveness. Therefore, the importance of programming education has been emphasized worldwide. Programming education has been conducted since the 1980s, however beginners often find programming tedious and difficult because of the cognitive burden of using text commands. Therefore, block-based programming environments, such as Scratch and Code.org, and beginner-oriented programming environments, such as Blockly and Pencil Code, have been de-veloped. However, they have limitations when transitioning from block to text-based programming. In this study, we conducted one semester of classes for 128 middle school, high school, and uni-versity students to determine whether an environment that allows using a text-based programming language in a block-based programming environment aids beginners’ understanding of program-ming instructions, command usage confidence, and programming usefulness. The results confirm that the usability of a block-based environment positively influences programming perception. This study is significant because it verifies the necessity and effectiveness of a block-based environment that employs a text-based programming language in programming education for beginners.

Teachability has been extensively studied under the context of making industrial robots to be programmable and reprogrammable. However, it is only recently that the artificial intelligence (AI) research community is accelerating the research works with the objective of making humanoid robots and many other robots to be teachable under the context of using natural languages. We human beings spend many years to learn knowledge and skills despite our extraordinary mental capabilities of being teachable with the use of natural languages. Therefore, if we would like to develop human-like robots such as humanoid robots, it is inevitable for us to face the issue of making future humanoid robots to be teachable with the use of natural languages as well. In this paper, we present the key details of a top-down design for achieving a teachable mind which consists of two major processes: the first one is the process which enables humanoid robots to gain innate mental capabilities of transforming incoming signals into meaningful crisp data, and the second one is the process which enables humanoid robots to gain innate mental capabilities of undertaking incremental and deep learning with the main focus of associating conceptual labels in a natural language to meaningful crisp data. These two processes consist of the two necessary and sufficient conditions for future humanoid robots to be teachable with the use of natural languages. In addition, this paper outlines a very likely new finding underlying human brain’s neural systems as well as the obvious mathematics underlying artificial deep neural networks. These outlines provide us the strong reason to separate the study of mind from the study of brain. Hopefully, the content discussed in this paper will help the AI research community to venture into the right direction which is to make future humanoid robots, non-humanoid robots, and many other systems to achieve human-like self-intelligence at cognitive level with the use of natural languages.

This paper explores the potential of using the SAM segmentator to enhance the segmentation capability of known methods. SAM is a promptable segmentation system that offers zero-shot generalization to unfamiliar objects and images, eliminating the need for additional training. The open-source nature of SAM on GitHub allows for easy access and implementation. In our experiments, we aim to improve the segmentation performance by providing SAM with checkpoints extracted from the masks produced by DeepLabv3+, then merging the segmentation masks provided by these two networks. Additionally, we examine the \enquote{oracle} method (as upper bound baseline performance), where segmentation masks are inferred only by SAM with checkpoints extracted from ground truth. In addition, we tested in the CAMO datasets an ensemble of PVTv2 transformers; combining the ensemble and SAM yields state-of-the-art performance in that dataset. The results of our study provide valuable insights into the potential of incorporating the SAM segmentator into existing segmentation techniques. We release with this paper the open-source implementation of our method.

Accurate detection and state analysis of traffic flows are essential for effectively reconstructing traffic flows and reducing the risk of severe injury and fatality. For this reason, several studies on resolving traffic problems have proposed the use of crowdsourcing, in which drivers provide real-time traffic information using mobile devices, to monitor traffic conditions. Using data collected via crowdsourcing for traffic event detection has advantages in terms of improved accuracy and reduced time cost in collecting relevant data. In this paper, we propose a technique that employs crowdsourcing to collect traffic-related data and uses these data to detect events that influence traffic. The proposed technique uses various machine-learning methods to more accurately identify events and find accurate location information. Therefore, it is able to resolve problems typically encountered with conventionally provided location information, such as broadly defined locations or inaccurate location information. The proposed technique has advantages in terms of reducing time and cost while increasing accuracy. Its validity and effectiveness were also demonstrated through various performance evaluations.

Decision support systems based on machine learning models should be able to help users identify opportunities and threats. Popular model-agnostic explanation models can identify factors that support various predictions, answering questions like “What factors affect sales?” or “Why did sales decline?”, but do not highlight what a person should or could do to get a more desirable outcome. Counterfactual explanation approaches address intervention, and some even consider feasibility, but there has been no evaluation of their suitability for real-time applications, such as question answering. Here we address this gap by introducing a novel model-agnostic method that provides specific, feasible changes that would impact the outcomes of a complex black-box AI model for a given instance and assess its real-world utility by measuring its real-time performance and ability to find achievable changes. The method uses the instance of concern to generate high-precision explanations and then applies a secondary method to find minimally contrastive and maximally probable high-precision counterfactual explanations, while limiting contrasted features to changes that are achievable. We demonstrate that using this method, it is possible to find such explanations quickly enough for use in real-time systems. High-precision achievable minimally contrastive explanations would be useful in applications where people seek remedial actions or question how effective a proposed remedy is likely to be.

The coronaviral pandemic has led to a shift in traditional teaching methods to more innovative approaches, such as high-fidelity patient simulation (HFPS), which can improve students’ clinical judgement and decision-making for quality patient care. A modified guideline was introduced to enhance students’ satisfaction and self-confidence in learning through HFPS. The study involved 189 baccalaureate nursing students, with 92 in the intervention group and 97 in the control group. The intervention group received the modified HFPS guideline, while the control group received standard treatment with basic instruction. After the HFPS debriefing session, students provided narrative feedback on their learning experience. The quantitative results showed that students in the intervention group reported a significant improvement in satisfaction and self-confidence in learning compared to the control group. The modified HFPS guideline provided clear guidance for students to learn and apply knowledge and skills more effectively, leading to increased engagement during interactive simulation sessions. The results suggest that the HFPS guideline should be added to the curriculum to enhance students’ satisfaction and self-confidence in learning, even in junior students. Innovative teaching methods, such as HFPS, can be necessary and beneficial for healthcare professional training, after the pandemic.

This paper describes preliminary results of measuring the impact of human body movements on plants. In particular, we analyze the influence of eurythmic gestures of human actors on lettuce and beans. In an eight week experiment, we exposed rows of lettuce and beans to weekly eurythmic movements (similar to Qi Gong) of a eurythmist, while at the same time measuring changes in voltage between the roots and leaves of lettuce and beans using the plant spikerbox (https://backyardbrains.com/products/plantspikerbox). We compared this experimental group of vegetables with a control group of vegetables whose voltage differential was also measured while never being exposed to eurythmy. Using t-tests, we found a clear difference between the experimental and the control group which was also verified with a machine learning model. In other words, the vegetables showed a noticeably different pattern in electric potentials in response to eurythmic gestures.

Fractures of the talar neck and body are associated with spine fractures and scoliosis deformity, which affect cosmetic appearance and cause difficulty in ambulation. The implant design for talus surgery is thriving as a functional alternative in case of severe talar destruction, focusing on segmentation and reconstruction of the talus’s shape. However, manual segmentation of the talus is time-consuming and subjective. In this study we exploited the automatic segmentation framework to efficiently train a deep learning-based model to accurately segment the talus based on computed tomography imaging. We developed three model configurations with nnU-Net and investigated their Dice similarity coefficients (DSC) and 95% Hausdorff distances (HD95) for talus segmentation on a CT image dataset. The three configurations performed well (DSC > 0.95, HD95 < 0.6). When tested on the same samples, one of the configurations was more efficient while ensuring higher accuracy. We propose to focus on talus anatomic variations with increasing age based on this framework and apply it to clinical trials at the next stage.

The goal was to create a novel machine learning (ML) model which can predict the magnitude and direction of pubertal mandibular growth in males with Class II malocclusion. Lateral cephalometric radiographs of 123 males at three time points (T1: 12, T2: 14, T3: 16 years old) were collected from an online database of longitudinal growth studies. Each radiograph was traced, and 7 different ML models were trained using 38 data points obtained from 92 subjects. 31 subjects were used as a test group, to predict post-pubertal mandibular length and Y-axis using input data from T1 and T2 combined (2-year prediction), and T1 alone (4-year prediction). Mean absolute errors (MAEs) were used to evaluate the accuracy of each model. For all ML methods tested using the 2-year prediction, the MAEs for post-pubertal mandibular length ranged from 2.11-6.07mm and 0.85-2.74° for the Y-axis. For all ML methods tested with 4-year prediction, the MAEs for post-pubertal mandibular length ranged from 2.32-5.28 mm and 1.25-1.72° for the Y-axis. Besides its initial length, the most predictive factors for mandibular length were found to be chronological age, upper and lower face heights, upper and lower incisor positions and inclinations. For the Y-axis, the most predictive factors were found to be Y-axis at earlier time points, SN-MP, SN-Pog, SNB and SNA. Whilst the potential of ML techniques to accurately forecast future mandibular growth in Class II cases is promising, a requirement for more substantial sample sizes exists to further enhance the precision of these predictions.

This report gives a comprehensive summary of two problems about graph convolutional networks (GCNs): over-smoothing and heterophily challenges, and outlines future directions to explore.

Protein molecules show varying degrees of flexibility throughout their three-dimensional structures. This flexibility is associated with the fluctuation of the torsion angle in proteins. The protein backbone can be defined mainly by two torsion angles, phi (φ) and psi (ψ). The fluctuation of torsion angles is derived from different NMR models’ variations in backbone torsion angles. The angle fluctuations in the cartesian coordinate space are used to characterize the protein’s structural flexibility. Fluctuation of torsion angle is useful in predicting protein function and structure when the torsion angles are used as restraints. This study aims to develop a machine learning method to predict torsion angle fluctuations directly from protein sequences. It explores various useful features such as disorder probability, position-specific scoring matrix profiles, secondary structure probabilities, monograms, bigram, position-specific estimated energy, half-sphere exposures, etc. Likewise, it explores well-known machine learning methods and proposes an optimized Light Gradient Boosting Machine Regressor (LightGBM) method, named TAFPred, to predict torsion angle fluctuations with the selected features. The proposed method achieves ten-fold cross-validated correlation coefficients of 0.746 and 0.737 and mean absolute errors of 0.114 and 0.123 for the angle fluctuation of φ and ψ, respectively, and attains an improvement of 10.08% in MAE, 24.83% in PCC in the phi angle, and 9.93% in MAE, 22.37% in PCC in psi angle compared to the state-of-the-art method proposed by Zhang et al.

The aim of this study was to create a novel machine learning (ML) algorithm for predicting the post-pubertal mandibular length and Y-axis in females. Cephalometric data from 176 females with Angle Class I occlusion were used to train and test 7 ML algorithms. For all ML methods tested, the mean absolute errors (MAEs) for the 2-year prediction ranged from 2.78-5.40 mm and 0.88-1.48 degrees, respectively. For the 4-year prediction, MAEs of mandibular length and Y-axis ranged from 3.21-4.00 mm and 1.19-5.12 degrees, respectively. The most predictive factors for post-pubertal mandibular length were mandibular length at previous timepoints, age, sagittal positions of the maxillary and mandibular skeletal bases, mandibular plane angle, and anterior and posterior face heights. The most predictive factors for post-pubertal Y-axis were Y-axis at previous timepoints, mandibular plane angle, and sagittal positions of the maxillary and mandibular skeletal bases. ML methods were identified as capable of predicting mandibular length within 3 mm, and Y-axis within 1 degree. Compared to each other, all of the ML algorithms were similarly accurate, with the exception of MLP regressor.

It is difficult to obtain necessary information accurately from Social Networking Service (SNS) while raising children, and it is thought that there is a certain demand for the development of a system that presents appropriate information to users according to the child's developmental stage. There are still few examples of research on knowledge extraction that focuses on childcare. This research aims to develop a system that extracts and presents useful knowledge for people who are actually raising children, using texts about childcare posted on Twitter. In many systems numbers in text data are just strings like words and are normalized to zero or simply ignored. In this paper, we created a set of tweet texts and a set of profiles created according to the developmental stages of infants from "0-year-old child" to "6-year-old child". For each set, we used ML algorithms such as NB (Naive Bayes), LR (Logistic Regression), ANN (Approximate Nearest Neighbor algorithms search), XGboost, RF (random forest), decision trees, and SVM (Support Vector Machine) to compare with BERT, a neural language model, to construct a classification model that predicts numbers from "0" to "6" from sentences. The accuracy rate predicted by the BERT (Bidirectional Encoder Representations from Transformers) classifier was slightly higher than that of the NB, LR, ANN, XGboost, RF, decision trees, and SVM classifiers, indicating that the BERT classification method was better.

Magnesium matrix composites have attracted significant attention due to their lightweight nature and impressive mechanical properties. However, the fabrication process for these alloy compo-sites is often time-consuming, expensive, and labor-intensive. To overcome these challenges, this study employed machine learning (ML) techniques to predict the mechanical properties of magnesium matrix composites. Regression models were utilized to forecast the yield strength of magnesium alloy composites reinforced with various materials. The study incorporated previous research on matrix type, reinforcement type, heat treatment, and mechanical working. The re-gression models employed in this study included decision tree regression, random forest re-gression, extra tree regression, and XGBoost regression. Model performance was assessed using metrics such as RMSE and R2. The XGBoost Regression model out-performed others, exhibiting an R2 value of 0.94 and the lowest error rate. Feature importance analysis indicated that the rein-forcement particle form had the greatest influence on the mechanical properties. The study iden-tified the optimized parameters for achieving the highest yield strength, which was 186.99 MPa. Overall, this study successfully demonstrates the effectiveness of ML as a valuable tool for opti-mizing the production parameters of magnesium matrix composites.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

GNSS time series prediction plays a significant role in monitoring crustal plate motion, landslide detection, and maintenance of the global coordinate framework. Long Short-Term Memory (LSTM), a deep learning model has been widely applied in the field of high-precision time series prediction especially when combined with Variational Mode Decomposition (VMD) to form the VMD-LSTM hybrid model. To further improve the prediction accuracy of the VMD-LSTM model, this paper proposes a dual variational modal decomposition long short-term memory (DVMD-LSTM) model to effectively handle the noise in GNSS time series prediction. This model extracts fluctuation features from the residual terms obtained after VMD decomposition to reduce the prediction errors associated with residual terms in the VMD-LSTM model. Daily E, N, and U coordinate data recorded at multiple GNSS stations between 2000 and 2022 are used to validate the performance of the proposed DVMD-LSTM model. The experimental results demonstrate that compared to the VMD-LSTM model, the DVMD-LSTM model achieves significant improvements in prediction performance across all measurement stations. The average RMSE is reduced by 9.86%, and the average MAE is reduced by 9.44%. Furthermore, the average accuracy of the optimal noise model for the predicted results is improved by 36.50%, and the average speed accuracy of the predicted results is enhanced by 33.02%. These findings collectively attest to the superior predictive capabilities of the DVMD-LSTM model, thereby enhancing the reliability of the predicted results.

To solve the problem that the common long-tailed classification method does not use the semantic features of the original label text of the image, and the difference between the classification accuracy of most classes and minority classes is large, the long-tailed image classification method based on enhanced contrast visual language trains the head class and tail class samples separately, uses text image to pre-train the information, and uses enhanced momentum contrast loss function and RandAugment enhancement to improve the learning of tail class samples. On the ImageNet-LT long-tailed dataset, the enhanced contrastive visual-language based long-tailed image classification method has improved all class accuracy, tail class accuracy, middle class accuracy, and F1 values by 3.4%, 7.6%, 3.5%, and 11.2%, respectively, compared to the BALLAD method. The difference in accuracy between the head class and tail class is reduced by 1.6% compared to the BALLAD method. The results of three comparative experiments indicate that the long-tailed image classification method based on enhanced contrastive visual-language has improved the performance of tail classes and reduced the accuracy difference between majority and minority classes.

Time series (TS)-based predictions are made by examining the behaviour of historical data to forecast future values. Multiple industries; such as stock market trading, power load forecasting, medical monitoring, and intrusion detection; frequently use it. Several variables; such as the performance of other markets as well as the economic situation of a country which affect its market performance; significantly affect the prediction of stock market prices. Therefore, this present study uses numerous variables; such as the opening, lowest, highest, and closing prices; to predict the indices of the stock market of the Kingdom of Saudi Arabia (KSA). Successfully accomplishing an investment goal largely depends on choosing the right stocks to buy, sell, or maintain. The project's output is the projected closing prices (regression) over the next seven days, which helps investors make the best decisions. This present study used exponential smoothing (ES) to remove noise from the input data obtained from the Saudi Stock Exchange, or Tadawul, before using a multivariate long short-term memory (LSTM) deep learning (DL) algorithm to forecast stock market prices. The proposed multivariate LSTMDL model had satisfactory prediction rates of 97.49% and 92.19% for the univariate model. Therefore, it can be used to effectively predict stock market prices. The results also indicate that DL as well as multiple sources of information can be used to accurately predict stock markets.

Integrating artificial intelligence (AI) and natural language processing (NLP) technologies with project-based learning experiences in Science,Technology, Reading, Engineering, Arts, and Mathematics (STREAM) education offers the potential to enhance student engagement, critical thinking,problem-solving, and interdisciplinary learning. This paper presents a comprehensive approach to implementing AI and NLP technologies, such as ChatGPT, in STREAM project-based learning experiences, highlighting the potential advantages and challenges of this innovative educational approach. The proposed method encompasses personalized learning pathways, AI-powered research assistance, collaborative AI tools, real-time feedback, virtual mentoring, advanced simulation, and objective assessment. We also discuss the implications of this integration for educators, institutions, and students, along with recommendations for future research and development in this emerging field.

High efficiency and safety are critical factors in ensuring optimal performance and reliability of systems and equipment across various industries. Fault Monitoring (FM) techniques play a pivotal role in this regard by continuously monitoring system performance and identifying the presence of faults or abnormalities. However, traditional FM methods face limitations in fully capturing the complex interactions within a system and providing real-time monitoring capabilities. To overcome these challenges, Digital Twin (DT) technology has emerged as a promising solution to enhance existing FM practices. By creating a virtual replica or digital copy of a physical equipment or system, DT offers the potential to revolutionize fault monitoring approaches. This paper aims to explore and discuss the diverse range of predictive methods utilized in DT and their implementations in FM across industries. Furthermore, it will showcase successful implementations of DT in FM across a wide array of industries, including manufacturing, energy, transportation, and healthcare The utilization of DT in FM enables a comprehensive understanding of system behavior and performance by leveraging real-time data, advanced analytics, and machine learning algorithms. By integrating physical and virtual components, DT facilitates the monitoring and prediction of faults, providing valuable insights into the system’s health and enabling proactive maintenance and decision-making.

Effective healthcare relies on accurate and timely diagnosis; however, obtaining large amounts of training data while maintaining patient privacy remains challenging. This study introduces a novel approach utilizing federated learning (FL) and a cross-device multi-modal model for clin-ical event classification using vital signs data. Our architecture leverages FL to train machine learning models, including Random Forest, AdaBoost, and SGD ensemble model, on vital signs data from a diverse clientele at a Boston hospital (MIMIC-IV dataset). The FL structure preserves patient privacy by training directly on each client's device without transferring sensitive data. The study demonstrates the potential of FL in privacy-preserving clinical event classification, achieving an impressive accuracy of 98.9%. These findings underscore the significance of FL and cross-device ensemble technology in healthcare applications, enabling the analysis of large amounts of sensitive patient data while safeguarding privacy.

The ability to handle spatiotemporal information makes contribution for improving the prediction performance of machine RUL. However, most existing models for spatiotemporal information processing are not only complex in structure but also lack adaptive feature extraction capabilities. Therefore, a lightweight operator with adaptive spatiotemporal information extraction ability named Involution GRU (Inv-GRU) is proposed for aero-engine RUL prediction. Involution, the adaptive feature extraction operator, is replaced by the information connection in the gated recurrent unit for obtaining the adaptively spatiotemporal information extraction ability and reducing the parameters. Thus, Inv-GRU can well extract the degradation information the of aero-engine. Then for RUL prediction task, the Inv-GRU based deep learning (DL) framework is firstly constructed, where features extracted by Inv-GRU and several human-made features are separately processed to generate the health indicators (HIs) from multi-raw data of aero-engines. Finally, fully connection layers are adopted are adopted to reduce dimension and regress RUL based on the generated HIs. By applying the Inv-GRU based DL framework to the Commercial Modular Aero Propulsion System Simulation (C-MAPSS) datasets, successful predictions of aero-engines RUL have been achieved. Comparative analysis reveals that the proposed model exhibits superior overall prediction performance compared to recent public methods.

Mild traumatic brain injury (mTBI) is the most common brain injury, seen in sports, falls, vehicle, or workplace injuries. Concussion is the most common type of mTBI. Assessment of impairments from concussion are evolving, with oculomotor testing suggested as a key component in a multi-modality diagnostic protocol. The aim of this study was to evaluate the reliability of one eye-tracking system, the EyeGuide Focus. Seventy-five healthy adolescent and adult participants (adolescents: n=28; female=11, male=17, mean age 16.5 ± 1.4 years; adults n=47; female=22; male=25, mean age 26.7 ± 7.0 years) completed three repetitions of the EyeGuide Focus within the one session. Intraclass correlation coefficient (ICC) analysis showed the EyeGuide Focus had overall good reliability (ICC 0.79, 95%CI: 0.70, 0.86). However, a familiarization effect showing improvements in subsequent trials was noticeable in both cohorts (p<0.001) with adolescent participants showing greater familiarisation effects than adults. No differences were observed between sexes (p=0.69). Overall, the EyeGuide Focus was found to be reliable, but the observation of familiarization effects suggests that a standardized protocol of a minimum of three trials be employed, similar to other eye-movement testing applications.

The COVID-19 pandemic has affected millions of people globally, with respiratory organs being strongly affected in individuals with comorbidities. Medical imaging-based diagnosis and prognosis have become increasingly popular in clinical settings to detect COVID-19 lung infections. Among various medical imaging modalities, ultrasound stands out as low-cost, mobile, and radiation-safe imaging technology. In this comprehensive review, we focus on ultrasound-based AI studies for COVID-19 detection that use public or private lung ultrasound datasets. We surveyed articles that used publicly available lung ultrasound datasets for COVID-19 and reviewed publicly available datasets and organize ultrasound-based AI studies per dataset. We analyzed and tabulated studies in several dimensions, such as data preprocessing, AI models, cross-validation, and evaluation criteria. In total, we reviewed 42 articles, where 28 articles used public datasets, and the rest used private data. Our findings suggest that ultrasound-based AI studies for the detection of COVID-19 have great potential for clinical use, especially for children and pregnant women. Our review also provides a useful summary for future researchers and clinicians who may be interested in the field.

An accurate and timely precipitation forecast is essential for water resources management in hydropower, irrigation, and reservoir control. The conventional methods are limited by their inability to capture the high precipitation variability in time and space. In the present work, a wavelet-based deep learning approach is adopted to forecast precipitation using the lagged monthly rainfall, local climate variables, and global teleconnections such as IOD, PDO, NAO, and Nino 3.4 as predictors. The method was tested and validated over the Krishna River Basin in India. Overall, the forecasting accuracy was higher using the wavelet-based hybrid models than the single-scale models. The proposed multi-scale model was then applied to the different climatic regions of the country, and it was shown that the model could forecast the rainfall at reasonable accuracy for different climate zones of the country.

In this study, machine learning was used to predict and analyze the behavior of occupants in Gifu City residences during winter. Global warming is currently progressing worldwide, and it is important to control greenhouse gas emissions from the perspective of adaptation and mitigation. Occupant behavior is highly individualized and must be analyzed to accurately determine a building's energy consumption. The accuracy of heating behavior prediction has been studied using three different methods: logistic regression, support vector machine (SVM), and deep neural network (DNN). The generalization ability of the support vector machine and the deep neural network was improved by parameter tuning. Parameter tuning of the SVM showed that the values of C and gamma affected the prediction accuracy. The prediction accuracy improved by approximately 11.9 %, confirming the effectiveness of parameter tuning on SVM. Parameter tuning of the DNN showed that the values of layer and neuron affected the prediction accuracy. Although parameter tuning also improved the prediction accuracy of DNN, and the rate of increase was lower than that of SVM.

Selecting the optimal activation function for training deep neural networks has always been challenging because it significantly impacts the neural network’s performance and training speed. At this point, researchers are more likely to employ RELU than other well-known activation functions. After RELU, researchers have proposed many activation functions to improve RELU. None of them was capable of surpassing RELU as their most significant rival. SWISH outperformed RELU in several challenging experiments like classification, object detection, and tracking. Replacing RELU units with SWISH, which improves performance in many tasks. This paper proposed a new activation function surpassing Google’s brain’s SWISH function, Which we named AIF. Experiments indicate that our proposed activation function outperforms SWISH in various tasks.

Porous materials can be characterized by well-trained neural networks. In this study, fibrous paper-type gas diffusion layers were trained with artificial data created by a stochastic geometry model. The features of the data were calculated by means of transport simulations using the Lattice–Boltzmann method based on stochastic micro-structures. A convolutional neural network was developed that can predict the permeability and tortuosity of the material, through-plane and in-plane. The characteristics of real data, both uncompressed and compressed, were predicted. The data was represented by reconstructed images of different sizes and image resolutions. Image artifacts are also a source of potential errors in the prediction. The Kozeny–Carman trend was used to evaluate the prediction of permeability and tortuosity of compressed real data. Using this method, it was possible to decide if the predictions on compressed data were appropriate.

Alzheimer’s disease has become a major concern in the healthcare domain as it is growing rapidly. Many researches have been conducted to detect it from MRI images through various deep-learning approaches. However, the problem of the availability of medical data and the privacy of the patients still exists. To mitigate this issue in Alzheimer’s disease detection, we have implemented the federated approach which is found to be more efficient, robust, and consistent compared to the conventional approach. For this, we needed deep excavation on various orientations of MRI images and transfer learning architectures. Then, we utilized the publicly available two datasets (OASIS, and ADNI), and designed various cases to evaluate the performance of the federated approach. In almost all of them, the federated approach achieved better accuracy and sensitivity. In distinguishing between two classes equally, the capability of the models was better in the found model when trained with federated approach compared to the conventional approach. In this approach. MobileNet, which is a low-cost transfer learning architecture, achieved the highest 95.24%, 81.94%, and 83.97% accuracy in OASIS, ADNI, and merged (ADNI+OASIS) test set, which was way higher than the achieved performance in Conventional approach. Moreover, in this approach, only the weights of the model were shared which keeps the original MRI images in their respective hospital or institutions, mitigating the privacy concern in the healthcare domain.

With the increasing use of intelligent mobile devices for online inspection of electrical equipment in smart grids, the limited computing power and storage of these devices pose challenges for carrying large algorithm models and it’s hard to obtain a large number of images of electrical equipment in public. In this paper, we propose a novel distillation method that compresses the knowledge of teacher networks into a small few-shot classification network using a global and local knowledge distillation strategy. Central to our method is exploiting the global and local relationship between the features exacted by the backbone of the teacher network and student network. We compare our method with recent state-of-the-art methods in three public datasets and achieve the best performance. We also contribute a new dataset, EEI-100, specifically designed for classification of electrical equipment, and demonstrate that our method achieves a prediction accuracy of 94.12% with only 5-shot images.

It is difficult to obtain necessary information accurately from Social Networking Service (SNS) while raising children, and it is thought that there is a certain demand for the development of a system that presents appropriate information to users according to the child's developmental stage. There are still few examples of research on knowledge extraction that focuses on childcare. This research aims to develop a system that extracts and presents useful knowledge for people who are actually raising children, using texts about childcare posted on Twitter. In many systems numbers in text data are just strings like words and are normalized to zero or simply ignored. In this paper, we created a set of tweet texts and a set of profiles created according to the developmental stages of infants from "0-year-old child" to "6-year-old child". For each set, we used Support Vector Machine (SVM), and Bidirectional Encoder Representations from Transformers (BERT), a neural language model, to construct a classification model that predicts numbers from "0" to "6" from sentences. The accuracy rate predicted by the BERT classifier was slightly higher than that of the SVM classifier, indicating that the BERT classification method was better.

The growth in the Internet of Things (IoT) devices in the healthcare sector enables the new era of the Internet of Medical Things (IoMT). However, IoT devices are susceptible to diverse cybersecurity attacks and threats that lead to negative consequences. Cyberattacks can harm not just the IoMT devices being used but also human life. Currently, several security solutions are proposed to enhance the security of the IoMT, which uses machine learning (ML) and blockchain. ML can be used to develop detection and classification methods to identify cyberattacks targeting IoMT devices in the healthcare sector. In addition, blockchain technology enables a decentralized approach to the healthcare system and eliminates some disadvantages of a centralized system, such as a single point of failure. This paper proposes a resilient security framework integrating a Tri-layered Neural Network (TNN) and blockchain technology in the healthcare domain. The TNN detects anomalies in data measured by medical sensors to find fraudulent data. Therefore, cyberattacks are detected and discarded from the IoMT system before data is processed at the fog layer. In addition, a blockchain network is used in the fog layer to ensure that the data is not altered, boosting the integrity and privacy of the medical data. The experimental results show that the TNN and blockchain models produce the expected result. Furthermore, the accuracy of the TNN model reached 99.99% on the F1-score accuracy metric.

Computer vision methods have shown to be effective in classifying garbage into recycling categories for waste processing, existing methods are costly, imprecise, and unclear. To tackle this issue, we introduce MWaste, a mobile application that uses computer vision and deep learning techniques to classify waste materials as trash, plastic, paper, metal, glass or cardboard. Its effectiveness was tested on various neural network architectures and real world images, achieving an average precision of 92% on the test set. This app can help combat climate change by enabling efficient waste processing and reducing the generation of greenhouse gases caused by incorrect waste disposal.

Communication is a key method of expressing one's thoughts and opinions. Amongst many modalities, speech and writing are the most powerful and common forms of human communication. Analysing what and how people think has inherently been an interesting and progressive research domain. This includes bimodal sentiment analysis which is an emerging area in natural language processing (NLP) and has received a great deal of attention in recent years in a variety of areas including social opinion mining, health care, banking, and so on. At present, there are limited studies on bimodal conversational sentiment analysis as it proves to be a challenging area given the complex nature of the way humans express sentiment cues across various modalities. To address this gap, a comparison of the performance of multiple data modality models has been conducted on the MELD dataset, a widely-used dataset for benchmarking sentiment analysis within the research community. Our work then demonstrates the results of combining acoustic and linguistic representations. Lastly, our proposed neural network-based ensemble learning technique is employed over six transformer and deep learning-based models, achieving a State-Of-The-Art (SOTA) accuracy.

Aerosol Optical Thickness (AOT) is one of the critical factors for global atmospheric conditions, climate change, and air pollution. AOT has been exposed as a major component of air pollution in Bangladesh. This paper aims to map the seasonal distribution of AOT from 2002-2022 and to explore the internal relationship between AOT and ten air pollutants using remote sensing and machine learning tools. These ten air pollutants are Particulate matter (PM2.5), Methane (CH4), Carbon monoxide (CO), Nitrogen dioxide (NO2), Formaldehyde (HCHO), Ozone (O3), Sulfur dioxide (SO2), Aerosol Particulate Radius (APR), Nitrogen oxide (NOx) and Black carbon (BC). The results show that the concentrations of AOT were higher in December-January-February (mean value 0.50) and March-April-May (mean value 0.50) seasons, mostly in the central, western, and southern parts of Dhaka, Narayanganj, and Munshiganj districts. AOT was a bit less in June-July-August (mean value 0.33) and September-October-November (mean value 0.37). This paper also revealed that the AOT was correlated positively with PM2.5 (0.60), CH4 (0.80), NO (0.76), and BC (0.83) while correlated negatively with CO (-0.66), HCHO (-0.16), SO2 (-0.41), APR (-0.48), and NOx (-0.20). From the machine learning, the Rational quadratic GPR (RME-0.0024, MAE-0.0015, R2-0.96), Matern 5/2 GPR (RMSE-0.0023, MAE-0.0015, R2-0.96), and Squared Exponential GPR (RMSE-0.0015, MAE-0.0015, R2-0.96) were found good classifiers to predict AOT. UN agencies, government line departments, and local and regional development councils for air pollution mitigation and long-term protective measures may use the paper's key results.

The performance of modern wireless communication systems is highly dependent on the adoption of multiple antennas and the associated signal processing. In 5G and 6G networks, beamforming and beam management become challenging tasks due to aspects such as user mobility, increased number of antennas, and the adoption of higher frequencies. Artificial intelligence, and more specifically, machine learning, are efficient tools to reduce the complexity involved in generating beams and the overhead associated with beam management without sacrificing system performance. Therefore, AI-aided beamforming and beam management have received a lot of attention recently. This article presents a complete survey on this topic, emphasizing open problems and promising directions. The discussion includes architectural and signal processing aspects of modern beamforming and beam management. The article presents communication problems and respective solutions using centralized/decentralized, supervised/unsupervised, semi-supervised, active, federated, and reinforcement learning.

This study utilised an ensemble of pre-trained networks and digital mammograms to develop a supplementary diagnostic tool for radiologists. Digital mammograms and their associated information were collected from the department of radiology and pathology, Hospital Universiti Sains Malaysia. Thirteen pre-trained networks were selected and explored in this study. ResNet101V2 and ResNet152 had the highest mean PR-AUC, MobileNetV3Small and ResNet152 had the highest mean precision, ResNet101 had the highest mean F1 score, and ResNet152 and ResNet152V2 had the highest mean Youden J index. Subsequently, three ensemble models were developed using the top three pre-trained networks based on PR-AUC, precision, and F1 score. The final ensemble model had a mean precision, F1 score, and Youden J index of 0.82, 0.68, and 0.12, respectively. Additionally, the final model demonstrated a balanced performance across mammographic density. In conclusion, this study exhibited the good performance of the ensemble transfer learning on digital mammograms for the purpose of breast cancer risk estimation. This model can be utilised as a supplementary diagnostic tool for radiologists, thus, reducing their workloads.

Auto-labeling is one of the main challenges in 3D vehicle detection. Auto-labeled datasets can be used to identify objects in LiDAR data, which is a challenging task due to the large size of the dataset. In this work, we propose a novel methodology to generate new 3D based auto-labeling datasets with a different point of view setup than the one used in the most recognized datasets (KITTI, WAYMO, etc.). The performance of the methodology has been further demonstrated with the development of our own dataset with the auto-generated labels and tested under boundary conditions on a bridge in a fixed position. The proposed methodology is based on the YOLO model trained with the KITTI dataset. From a camera-LiDAR sensory fusion, it is intended to auto-label new datasets while maintaining the consistency of the Ground Truth. The main contribution of this work is a novel methodology to auto-label autonomous driving datasets using YOLO as the main labelling system. The performance of this approach is measured retraining the contrast models of the KITTI benchmark.

An artificial intelligence (AI)-based conversational large language model (LLM) was launched in November 2022 namely, “ChatGPT”. Despite the wide array of potential applications of LLMs in healthcare education, research and practice, several valid concerns were raised. The current systematic review aimed to investigate the possible utility of ChatGPT and to highlight its limitations in healthcare education, research and practice. Using the PRIMSA guidelines, a systematic search was conducted to retrieve English records in PubMed/MEDLINE and Google Scholar under the term “ChatGPT”. Eligibility criteria included the published research or preprints of any type that discussed ChatGPT in the context of healthcare education, research and practice. A total of 280 records were identified, and following full screening, a total of 60 records were eligible for inclusion. Benefits/applications of ChatGPT were cited in 51/60 (85.0%) records with the most common being the utility in scientific writing followed by benefits in healthcare research (efficient analysis of massive datasets, code generation and rapid concise literature reviews besides utility in drug discovery and development). Benefits in healthcare practice included cost saving, documentation, personalized medicine and improved health literacy. Concerns/possible risks of ChatGPT use were expressed in 58/60 (96.7%) records with the most common being the ethical issues including the risk of bias, plagiarism, copyright issues, transparency issues, legal issues, lack of originality, incorrect responses, limited knowledge, and inaccurate citations. Despite the promising applications of ChatGPT which can result in paradigm shifts in healthcare education, research and practice, the embrace of this application should be done with extreme caution. Specific applications of ChatGPT in health education include the promising utility in personalized learning tools and shift towards more focus on critical thinking and problem-based learning. In healthcare practice, ChatGPT can be valuable for streamlining the workflow and refining personalized medicine. Saving time for the focus on experimental design and enhancing research equity and versatility are the benefits in scientific research. Regarding authorship in scientific articles, as it currently stands, ChatGPT does not qualify to be listed as an author unless the ICJME/COPE guidelines are revised and amended. An initiative involving all stakeholders involved in healthcare education, research and practice is urgently needed to set a code of ethics and conduct on the responsible practices involving ChatGPT among other LLMs.

Sometimes when diabetic retinopathy (DR) is found and treated quickly, vision loss can indeed be spared. This study deploys a deep learning (DL) model that can discover all 5 stages of DR more accurately than other methods. The proposed methodology shows two cases scenarios: case 1 with image enhancement using CLAHE and ESRGAN, and case 2 without image enhancement. Augmentation techniques are then employed to produce a balanced dataset with the identical criteria for both scenarios. The generated model using DenseNet-121 on the APTOS dataset outperformed other approaches for locating the 5 stages of DR, with an accuracy of 98.7 percent for case 1 and 81.2 percent for case 2. Using CLAHE and ESRGAN was shown to improve a model's performance and ability to learn.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Pulsed thermography is a vital technique in the nondestructive evaluation field. However, its data analysis can be complex and requires skilled experts. Advances in deep learning have yielded exceptional results, including image segmentation. Therefore, many efforts have been made to apply deep learning methods to data processing for nondestructive evaluation. Despite this, there is currently no public Pulsed thermographic dataset available for evaluating various spatial-temporal deep methods of segmenting pulsed thermographic data. This article aims to provide such a dataset and assess the performance of commonly used deep learning-based instance segmentation models on it. Additionally, the impact of the number of frames and data transformations on model performance is examined. The findings suggest that suitable preprocessing methods can effectively reduce the data size without compromising the deep models’ performance.

As AI models become more and more common in business and even in our daily lives, it is important to understand what the carbon impact of these models is. Recent papers have shown that this impact can be quite great, i.e., the training of a single high-end model can result in emissions of more than 500t of CO2eq. In this paper we discuss the factors that influence the carbon footprint of AI models, explore what impact different decisions have, and show how the footprint can be reduced. We also examine the footprint of different models to give a guideline on how urgent action is for different organizations.

One of the most common forms of dementia is Alzheimer’s disease (AD), which leads to progressive mental deterioration. Unfortunately, there is no definitive diagnosis and cure that can stop the condition progressing. The diagnosis is often performed based on the clinical history and neuropsychological data, including magnetic resonance imaging (MRI). Deep neural networks (DNN) algorithms are gaining popularity for medical diagnosis, and have been used widely for the analysis of MRI data. DNNs can extract hidden features from thousands of training images automatically. However, they cannot judge how confident they are about their predictions. To use DNNs in safety-critical applications such as medical diagnosis, uncertainty quantification of DNNs predictions is crucial. For this purpose, Monte Carlo dropout (MCD) has been widely used, however, it may lead to overconfident and miss calibrated results. This paper proposes a framework in which the MCD algorithm’s hyper-parameters are optimized during training using Bayesian optimization for the first time. The conducted optimization leads to assigning high predictive entropy to erroneous predictions and making it possible to recognize risky predictions. The proposed framework is used for AD diagnosis, which has not been done before. We compare our method with some existing methods in the literature based on different uncertainty quantification criteria. The results of comprehensive experiments on the Kaggle dataset using a deep model pre-trained on the ImageNet dataset show that the proposed algorithm can quantify uncertainty much better than the existing methods.

MicroRNAs (miRNAs) are small non-coding RNAs that play a central role in the post-transcriptional regulation of biological processes. miRNAs regulate transcripts by direct binding involving the Argonaute protein family. The exact rules of binding are not known, and several in silico miRNA target prediction methods have been developed to date. Deep Learning has recently revolutionized miRNA target prediction. However, the higher predictive power comes with decreased ability to interpret increasingly complex models. Here, we present a novel interpretation technique, called attribution sequence alignment, for miRNA target site prediction models that can interpret such Deep Learning models on a two-dimensional representation of miRNA and putative target sequence. Our method produces a human readable visual representation of miRNA:target interactions and can be used as a proxy for further interpretation of biological concepts learned by the neural network. We demonstrate applications of this method in clustering of experimental data into binding classes, as well as using the method to narrow down predicted miRNA binding sites on long transcript sequences. Importantly, the presented method works with any neural network model trained on a two-dimensional representation of interactions and can be easily extended to further domains such as protein-protein interactions.

Background: Painful spinal bone metastases (PSBMs) patients regularly receive palliative radiation therapy (RT) with response rates in about 2 of 3 patients. In this exploratory study, we evaluated the value of machine learning (ML) models based on radiomic, semantic and clinical features to predict complete pain response. Methods: Gross tumour volumes (GTV) and clinical target volumes (CTV) of 261 PSBMs were segmented on planning computed tomography (CT) scans. Radiomic, semantic and clinical features were collected for all patients. Random forest (RFC) and support vector machine (SVM) classifiers were compared using repeated nested cross-validation.Results: The best radiomic classifier was trained on CTV with an area under the receiver-operator curve (AUROC) of 0.62 ± 0.01 (RFC; 95% confidence interval). The semantic model achieved a comparable AUROC of 0.63 ± 0.01 (RFC), significantly below the clinical model (SVM, AUROC: 0.80 ± 0.01); and slightly lower than the spinal instability neoplastic score (SINS; LR, AUROC: 0.65 ± 0.01). A combined model did not improve performance (AUROC: 0,74 ± 0,01).Conclusions: We could demonstrate that radiomic and semantic analyses of planning CTs allowed for limited prediction of therapy response to palliative RT. ML predictions based on established clinical parameters achieved the best results.

With the rise of Blockchain technology, the cryptocurrency market has been gaining significant interest. In particular, the number of cryptocurrency traders and the market capitalization have grown tremendously. However, predicting cryptocurrency price is very challenging and difficult due to the high price volatility. In this paper, we propose a classification machine learning approach in order to predict the direction of the market (i.e., if the market is going up or down). We identify key features such as Relative Strength Index (RSI) and Moving Average Convergence Divergence (MACD) to feed the machine learning model. We illustrate our approach through the analysis of Bitcoin close price. We evaluate the proposed approach via different simulations. Particularly, we provide a backtesting strategy. The evaluation results show that the proposed machine learning approach provides buy and sell signals with more than 86% accuracy.

Locomotor impairment is a high-prevalent and significant source of disability and significantly impacts a large population’s quality of life. Despite decades of research in human locomotion, the challenges of simulating human movement to study the features of musculoskeletal drivers and clinical conditions remain. Most recent efforts in utilizing reinforcement learning (RL) techniques are promising to simulate human locomotion and reveal musculoskeletal drives. However, these simulations often failed to mimic natural human locomotion because most reinforcement strategies have yet to consider any reference data regarding human movement. To address these challenges, in this study, we designed a reward function based on the trajectory optimization rewards (TOR), and bio-inspired rewards, which includes the rewards obtained from reference motion data captured by a single Intertial Moment Unit (IMU) sensor. The sensor was equipped on the participants’ pelvis to capture reference motion data. Also, we adapted the reward function by leveraging previous research in walking simulation for TOR. The experimental results showed that the simulated agents with the modified reward function performed better in mimicking the collected IMU data from participants, which means the simulated human locomotion was more realistic. Also, as this bio-inspired defined cost, IMU data enhanced the agent’s capacity to converge during the training process. As a result, the models’ convergence is faster than those developed without reference motion data. Consequently, human locomotion can be simulated more quicker and in a broader range of environments with a better simulation performance.

Most machine learning and deep learning algorithms can only use low-dimensional data as input, but the data that must be processed in practical applications is diverse and irregular. There are two main problems with big dynamic data. (1) The size of the embedding table grows linearly with the vocabulary size, resulting in massive memory consumption. (2) For different newly added vocabularies. To solve these two problems, this paper proposes a novel embedding algorithm that can learn attribute associations with entities based on deep and hash algorithms. Taking movie data as an example, the encoding method and the specific flow of the algorithm are presented in detail, and the effect of dynamic reuse of data models is realized. Compared with the four existing embedding algorithms which can fuse entity attribute information, the deep hash embedding algorithm proposed in this paper has obvious optimization of time and space complexity.

With the rapid development of the Internet of Things (IoT), there are dramatic increasing number of devices in the network, which causes the challenge that only using infrastructure such as based station cannot provide service with all devices with high quality. Therefore, due to their flexibility and economy, unmanned aerial vehicles (UAV) are widely used to increase the performance of IoT networks. UAVs can not only provide communication services for IoT devices in the absence of a network, but they can also perform video surveillance, cargo transportation, pesticide spraying, and other specialized tasks. However, due to the complexity of the scenario and the need for real-time decision making, it is challenging to schedule UAVs in the network using traditional optimization methods, and growing attention has focused on using AI to optimize UAVs in the network. In this paper, we focus on the AI-enabled UAV optimization method in IoT networks and give a comprehensive scope on what and how to use AI-enabled methods to increase the performance of UAV-assisted IoT networks. Moreover, a brief analysis of the challenges of using AI methods in IoT networks and some potential research directions are given.

The electroretinography (ERG) is a diagnostic test that measures the electrical activity of the retina in response to a light stimulus. This test has a long history and has been extensively studied among years. Dr. James Dewar recorded the first electroretinogram signal in 1873. Later he described signal analysis using 4 components, namely amplitude, and latency of a-wave and b-wave. Nowadays, the international electrophysiology community has established the standard for electroretinography in 2008. However, from the point of view of signal analysis, the major change did not happen. ERG analysis is still based on the 4 components evaluation. The article describes ERG database including the classification of signals by using advanced analysis of electroretinograms based on wavelet scalogram processing. To implement an extended analysis of the ERG, the parameters extracted from the wavelet scalogram of the signal were obtained using digital image processing and machine learning methods. The results of the study show that the proposed algorithm implements the classification of adult electroretinogram signals by 19% more accurately and pediatric signals by 20% more accurately than the classical algorithm. The promising use of ERG is differential diagnostics, which may also be used in preclinical toxicology and experimental modeling. The problem of developing methods for electrophysiological signals analysis in ophthalmology is associated with the complex morphological structure of electrophysiological signals components, due to the generation of retina cell electrical responses to light stimulus.

Convolutional neural network architectures have become increasingly complex, which has improved the performance slowly on well-known benchmark datasets in the recent years. In this research, we have analyzed the true need for such complexity. We have introduced G-Net light, a lightweight modified GoogleNet with improved filter count per layer to reduce feature overlaps and complexity. Additionally, by limiting the amount of pooling layers in the proposed architecture, we have exploited the skip connections to minimize the spatial information loss. The investigations on the proposed architecture are evaluated on three retinal vessel segmentation publicly available datasets. The proposed G-Net light outperforms other vessel segmentation architectures by reducing the number of trainable parameters..

This article is a theoretical contribution to mental model research, which currently has different threads. Whereas some researchers focus on the perceived causal structure, others also include decision policies and decisions. We focus on the link between recognized causal structure (“mental models of dynamic systems”) and policies, proposing Johnson-Laird’s theory of mental models as the link. The resulting framework hypothesizes two types of systematic mental model errors: (1) misrepresentation of the system’s structure and (2) failure to deploy relevant mental models of possibilities. Examination of three experiments through this lens reveals errors of both types. Therefore, we propose that the cognitive theory of mental models opens a path to better understand how people construct their decision policies and develop interventions to reduce such mental model errors. The article closes by raising several questions for empirical studies of the reasoning process leading from mental models of dynamic systems to decision policies.

The prediction of drug-target interactions plays a fundamental role in facilitating drug discovery, where the goal is to find prospective drug candidates. With the increase in the number of drug-protein interactions, machine learning techniques, especially deep learning methods, have become applicable for drug-target interaction discovery because they significantly reduce the required experimental workload. In this paper, we present a spontaneous formulation of the drug-target interaction prediction problem as an instance of multi-instance learning. We address the problem in three stages, first organizing given drug and target sequences into instances via a private-public mechanism, then identifying the predicted scores of all instances in the same bag, and finally combining all the predicted scores as the output prediction. A comprehensive evaluation demonstrates that the proposed method outperforms other state-of-the-art methods on three benchmark datasets.

Segmentation is an important step in medical imaging. In particular, machine learning, especially deep learning, has been widely used to efficiently improve and speed up the segmentation process in clinical practice. Despite the acceptable segmentation results of multi-stage models, little attention was paid to the use of deep learning algorithms for brain image segmentation, which could be due to the lack of training data. Therefore, in this paper, we propose a Generative Adversarial Network (GAN) model that performs transfer learning to segment MRI brain images.Our model enables the generation of more labeled brain images from existing labeled and unlabeled images. Our segmentation targets brain tissue images, including white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). We evaluate the performance of our GAN model using a commonly used evaluation metric, which is Dice Coefficient (DC). Our experimental results reveal that our proposed model significantly improves segmentation results compared to the standard GAN model. We observe that our model is 2.1–10.83 minutes faster than stat-of-the-art-models.

The classification of vessel types in SAR imagery is of crucial importance for maritime applications. However, the ability to use real SAR imagery for deep learning classification is limited, due to the general lack of such data and/or the labor-intensive nature of labeling them. Simulating SAR images can overcome these limitations, allowing the generation of an infinite number of datasets. In this contribution, we present a synthetic SAR imagery dataset with ship wakes, which comprises 46080 images for ten different real vessel models. The variety of simulation parameters includes 16 ship heading directions, 6 ship velocities, 8 wind directions, 2 wind velocities, and 3 incidence angles. In addition, we extensively investigate classification performance for noise-free, noisy, and denoised ship wake scenes. We utilize the standard AlexNet architecture and employ training from scratch. To achieve the best classification performance, we conduct Bayesian optimization to determine hyperparameters. Results demonstrate that the classification of vessel types based on their SAR signatures is highly efficient, with maximum accuracies of 96.16%, 92.7%, and 93.59%, when training using noise-free, noisy, and denoised datasets respectively. Thus, we conclude that the best strategy in practical applications should be to train convolutional neural networks on denoised SAR datasets. The results show that the versatility of the SAR simulator can open up new horizons in the application of machine learning to a variety of SAR platforms.

Background: Machine learning has revolutionized situational awareness during disaster management by classifying, clustering, and predicting impacted locations and people. Despite its importance, no review has been conducted on machine learning tools for food assistance efforts during emergency or non-emergency situations. The purpose of this scoping review is to address that gap. Methods: Keywords were defined within the concepts of food assistance and machine learning. After the database searches, PRISMA guidelines were followed to perform a partnered, two-round scoping literature review. Text mining and Latent Dirichlet Allocation topic modeling algorithms were used to determine trends. Results: 28 articles met criteria and were included in the analysis. The types of study designs included: model development (42.9%), non-study (i.e., text and opinion) (28.6%), qualitative research (14.3%), case study (10.7%), and meta-analysis (3.6%). There were no quantitative studies. The machine learning tools’ main functions were improving SNAP programs (32.1%), detecting needs and resources (25%), predicting food insecurity (21.4%), and situational awareness of current food insecurity issues (21.4%). None of these studies took place during a disaster or explicitly addressed emergency mitigation, preparedness, or recovery. All of the studies were in early phases of development and implementation. Conclusion: Machine learning tools for improving situational awareness, resource allocation, policymaking, and prediction have the potential to improve food assistance, but there is a lack of implementation and evaluation during all disaster phases. Also needed is more formative work on generating food-related queries and defining variables and features of food security.

A common spinal condition, spondylolisthesis is the presence of a relative back or forth displacement between the upper and lower vertebra due to one vertebra being oriented away from the smooth curvature of a normal spine. Aging-related illnesses such as degenerative spondylolisthesis are especially burdensome on social welfare and health-care systems in an aging society, especially radiologists and clinical physicians. Therefore, we proposed a computer aided diagnosis algorithm, named LumbarNet, for vertebral slippage detection on clinical X-ray images. Collaborating with i) a P-grade, ii) a piecewise slope detection scheme, and iii) a dynamic shift detection routine, LumbarNet was thus specialized for analyzing complex structural patterns in lumbar spine X-ray images and outcompeted other U-Net based methods. Extensive experiments on lumbar spine X-ray images in standard clinical practices showed that LumbarNet achieved a mean intersection over union value of 0.88 in vertebral region detection and an accuracy of 88.83% in vertebral slippage detection.

The urgency of the COVID19 pandemic caused a surge in related scientific literature. This surge made the manual exploration of scientific articles time-consuming and inefficient. Therefore, a range of exploratory search applications have been created to facilitate access to the available literature. In this survey, we give a short description of certain efforts in this direction and explore the different approaches that they used.

Electroencephalography (EEG) is a brain imaging technique in which electrodes are placed on the scalp. EEG signals are commonly decomposed into frequency bands called delta, theta, alpha, and beta.While these bands have been shown to be useful for characterizing various brain states, their utility as a one-size-fits-all analysis tool remains unclear. We present a two-part data-driven methodology for objectively determining the best EEG bands for a given dataset in this paper. First, a decision tree is used to estimate the optimal frequency band boundaries for reproducing the signal’s power spectrum for a predetermined number of bands. The optimal number of bands is then determined using an Akaike Information Criterion (AIC)-inspired quality score that balances goodness-of-fit with a small band count. Data-driven EEG band discovery may aid in objectively capturing key signal components and uncovering new indices of brain activity.

Inertial navigation system (INS) is a basic component for obtaining a continuous navigation solution in various applications. The INS navigation solution suffers from a growing error over time. In particular, its navigation solution depends mainly on the quality and grade of the inertial measuring unit (IMU) that provides the INS with both accelerations and angular rates. However, low-cost small micro-electro-mechanical systems (MEMS) suffer from tremendous error sources such as bias, scale factor, scale factor instability, and highly non-linear noise. Therefore, MEMS-IMU measurements lead to drifted solutions when used as a control input to the INS. Accordingly, several approaches have been introduced to model and mitigate the errors associated with IMU. In this paper, a machine learning-based adaptive neuro-fuzzy inference system (ML-ANFIS) is proposed to leverage the performance of low-grade IMUs in two phases. The first phase is training 50% of the low-grade IMU measurements with a high-end IMU to generate a suitable error model. The second phase involved testing the developed model on the remaining low-grade IMU measurements. A real road trajectory was conducted to evaluate the performance of the proposed algorithm. The results show the effectiveness of utilizing the proposed ML-ANFIS algorithm in removing errors and improving the INS solution compared to the traditional one. An improvement of 70% in the 2D-positioning and 92% in the 2D-velocity INS solution is attained when the proposed algorithm was applied compared to the traditional INS solution.

Recently, the use of drones/unmanned aerial vehicles (UAVs) has notably increased due to their broad commercial spread and low cost. The wide diffusion of drones increases the hazards of their misuse in illegitimate actions such as drug smuggling and terrorism. Thus, the surveillance and automated detection of drones are crucial for safeguarding restricted regions or special zones from illegal drone interventions. One of the most challenging issues in drone detection in surveillance videos is the apparent similarity of drones and birds against complex backgrounds. In this work, an automated image-based drone-detection system utilizing an advanced deep-learning-based object-detection method known as you only look once (YOLOv5) is introduced for protecting restricted regions or special zones from unlawful drone interventions. Due to the lack of sufficient data, transfer learning was utilized to pretrain the object-detection method to increase the performance. The experiments showed outstanding results, and an average precision of 94.7% was accomplished.

This paper presents an extension of the results obtained in previous work concerning the application of global optimization techniques to the design of finite strategic games with mixed strategies. In that publication the Fuzzy ASA global optimization method was applied to many examples of synthesis of strategic games with one previously specified Nash equilibrium, evidencing its ability in finding payoff functions whose respective games present those equilibria, possibly among others. That is to say, it was shown it is possible to establish in advance a Nash equilibrium for a generic finite state strategic game and to compute payoff functions that will make it feasible to reach the chosen equilibrium, allowing players to converge to the desired profile, con- sidering that it is an equilibrium of the game as well. Going beyond this state of affairs, the present article shows that it is possible to ”impose” multiple Nash equilibria to finite strategic games by following the same reasoning as before, but with a fundamental change: using the same fundamental theorem of Richard McKelvey, modifying the originally prescribed objective function and globally minimizing it. The proposed method, in principle, is able to find payoff functions that result in games featuring an arbitrary number of Nash equilibria, paving the way to a substantial number of potential applications.

Covid-19 has caused infections and deaths worldwide. While research in the field of Data Science has contributed good predictions of positive Covid-19 case numbers, this study's review of literature shows there is little research in the use of variants of the virus in predictions. We set out to define and evaluate novel variant features. We find that features relating to variant trends, thresholds and amino acid substitutions are especially powerful in two tasks. In the first task, predicting Covid-19 case numbers, accuracy improved from 71.53% without variant features to 82.12% with variant features. In the second task, predicting transmission severity of variants between two classes, we created a method to build some variable ensembles through selecting appropriate models that are generated with variant features. The test results showed that our ensembles are more accurate and reliable. One particular ensemble of 14 models correctly classified 90.91% of variants, outperforming other models including the popular Random Forest ensemble. In addition, as the variant features have represented more underlying information about Covid-19 pathophysiology, our ensemble methods use only a few data samples to achieve an accurate prediction. The ensemble of 14 models uses only 50 cases of each variant, an ability that could be exploited for early detection of highly infectious variants. These research findings may benefit public health professionals, policy makers, and the research community in the collective efforts to overcome this disease.

Habituation, the most ancient and fundamental form of learning, manifests already before birth. Neuroscientists have been fascinated for decades by its function as a firewall protecting our brains from sensory information overload and its indispensability for higher cognitive processing. Evidence that habituation learning is affected in autism and related monogenic neurodevelopmental syndromes and their animal models has exponentially grown, but the potential of this convergence to advance both fields is still largely unexploited.In this review, we provide a systematic overview of the genes that to date have been demonstrated to underlie habituation across species. We describe the biological processes they converge on, and highlight core regulatory pathways and repurposable drugs that may alleviate the habituation deficits associated with their dysregulation. We also summarize currently used habituation paradigms and extract the most important arguments from literature that support the crucial role of habituation for cognition in health and disease. We conclude that habituation is a powerful tool to overcome current bottlenecks in research, diagnostics and treatment of neurodevelopmental disorders.

Scientists and astronomers have attached Scientists and astronomers have attached great importance to the task of discovering new exoplanets, even more so if they are in the habitable zone. To date, more than 4300 exoplanets have been confirmed by NASA, using various discovery techniques, including planetary transits, in addition to the use of various databases provided by space and ground-based telescopes. This article proposes the development of a deep learning system for detecting planetary transits in Kepler Telescope lightcurves. The approach is based on related work from the literature and enhanced to validation with real lightcurves. A CNN classification model is trained from a mixture of real and synthetic data, and validated only with real data and different from those used in the training stage. The best ratio of synthetic data is determined by the perform of an optimisation technique and a sensitivity analysis. The precision, accuracy and true positive rate of the best model obtained are determined and compared with other similar works. The results demonstrate that the use of synthetic data on the training stage can improve the transit detection performance on real light curves.

Convolutional Neural Networks (CNNs) have gained prominence in the research literature on image classification over the last decade. One shortcoming of CNNs, however, is their lack of generalizability and tendency to overfit when presented with small training sets. Augmentation directly confronts this problem by generating new data points providing additional information. In this paper, we investigate the performance of more than ten different sets of data augmentation methods, with two novel approaches proposed here: one based on the Discrete Wavelet Transform and the other on the Constant-Q Gabor transform. Pretrained ResNet50 networks are finetuned on each augmentation method. Combinations of these networks are evaluated and compared across three benchmark data sets of images representing diverse problems and collected by instruments that capture information at different scales: a virus data set, a bark data set, and a LIGO glitches data set. Experiments demonstrate the superiority of this approach. The best ensemble proposed in this work achieves state-of-the-art performance across all three data sets. This result shows that varying data augmentation is a feasible way for building an ensemble of classifiers for image classification (code available at https://github.com/LorisNanni).

This article presents a systematic mapping study dedicated to conduct a literature review on machine learning and IoT applied in the identification of diseases through heart sounds. This research was conducted between January 2010 and July 2021, considering IEEE Xplore, PubMed Central, ACM Digital Library, JMIR- Journal of Medical Internet Research, Springer Library, and Science Direct. The initial search resulted in 4,372 papers, and after applying the inclusion and exclusion criteria, 58 papers were selected for full reading to answer the research questions. The main results are: of the 58 articles selected, 46 (79.31%) mention heart rate observation methods with wearable sensors and digital stethoscopes, and 34 (58.62%) mention care with machine learning algorithms. The analysis of the studies based on the bibliometric network generated by the VOSviewer showed in 13 studies (22.41%) a trend related to the use of intelligent services in the prediction of diagnoses related to cardiovascular disorders.

Online social networks (OSNs) play an integral role in facilitating social interaction; however, these social networks increase antisocial behavior, such as cyberbullying, hate speech, and trolling. Aggression or hate speech that takes place through short message service (SMS) or the Internet (e.g., in social media platforms) is known as cyberbullying. Therefore, automatic detection utilizing natural language processing (NLP) is a necessary first step that helps prevent cyberbullying. This research proposes an automatic cyberbullying method to detect aggressive behavior using a consolidated deep learning model. This technique utilizes multichannel deep learning based on three models, namely, the bidirectional gated recurrent unit (BiGRU), transformer block, and convolutional neural network (CNN), to classify Twitter comments into two categories: aggressive and not aggressive. Three well-known hate speech datasets were combined to evaluate the performance of the proposed method. The proposed method achieved promising results. The accuracy of the proposed method was approximately 88%.

Recently, spam emails have become a significant problem with the expanding usage of the Internet. It is to some extend obvious to filter emails. A spam filter is a system that detects undesired and malicious emails and blocks them from getting into the users' inboxes. Spam filters check emails for something "suspicious" in terms of text, email address, header, attachments, and language. However, we have used different features such as word2vec, word n-grams, character n-grams, and a combination of variable length n-grams for comparative analysis in our proposed approach. Different machine learning models such as support vector machine (SVM), decision tree (DT), logistic regression (LR), and multinomial naïve bayes (MNB) are applied to train the extracted features. We use different evaluation metrics such as precision, recall, f1-score, and accuracy to evaluate the experimental results. Among them, SVM provides 97.6 \% of accuracy, 98.8\% of precision, and 94.9\% of f1-score using a combination of n-gram features.

CVDs are a leading cause of death globally. In CVDs, the heart is unable to deliver enough blood to other body regions. Since effective and accurate diagnosis of CVDs is essential for CVD prevention and treatment, machine learning (ML) techniques can be effectively and reliably used to discern patients suffering from a CVD from those who do not suffer from any heart condition. Namely, machine learning algorithms (MLAs) play a key role in the diagnosis of CVDs through predictive models that allow us to identify the main risks factors influencing CVD development. In this study, we analyze the performance of ten MLAs on two datasets for CVD prediction and two for CVD diagnosis. Algorithm performance is analyzed on top-two and top-four dataset attributes/features with respect to five performance metrics –accuracy, precision, recall, f1-score, and roc-auc – using the train-test split technique and k-fold cross-validation. Our study identifies the top two and four attributes from each CVD diagnosis/prediction dataset. As our main findings, the ten MLAs exhibited appropriate diagnosis and predictive performance; hence, they can be successfully implemented for improving current CVD diagnosis efforts and help patients around the world, especially in regions where medical staff is lacking.

Electroencephalograms (EEGs) of children with reading disorder (RD) are characterized by higher power and coherence in slow frequencies (delta and theta bands) and lower power and coherence in the alpha band compared to EEGs of typically developed children. Neurofeedback (NFB) is useful for treating learning disorders by reinforcing the reduction of the theta/alpha ratio. This efficacy is supported by EEG power normalization and cognitive-behavioral improvement. To further explore brain changes in isolated areas, this study aimed to explore the effects of this NFB protocol on functional connectivity (coherence) in children with RD. Twenty children with RD and an abnormally high theta/alpha ratio underwent 30 sessions of NFB. After treatment, 90% of par-ticipants learned to decrease their theta/alpha ratio, and on average, children increased their reading accuracy and comprehension scores. Interhemispheric coherence diminished in the delta, theta and beta bands, mainly between frontopolar regions. Intrahemispheric coherence decreased in delta, theta and beta bands and increased in alpha band. The reduction in theta coherence be-tween the left frontal area and other regions of the left hemisphere had particular relevance for reading. These results suggest that this NFB treatment could positively impact reading-related functions in the brain networks of children with RD.

Fatigue cracks in a wide array of industrial components and structures pose a significant threat to their integrity. Detecting fatigue cracks using ultrasonic inspection techniques is a widespread activity for economic reasons but there are limitations to the techniques due to the morphology of fatigue cracks. In addition to detection there is a need to measure the size of the cracks which are often within the volume of the material. Ultrasonic techniques are well-suited to look inside the volume of the material but achieving sufficient sensitivity to the tip of the cracks in particular is practically difficult. Without an accurate knowledge of where the tip of the crack lies there can be significant uncertainty in sizing measurements. Machine Learning (ML) techniques are being developed to aid in the inspection and monitoring tasks but presenting the ultrasonic data in a suitable way for machine learning is very important. This paper presents a new approach to condition the ultrasonic data for machine learning settings so that they can be used effectively and confidently to detect and size fatigue cracks. The new approach, using images termed parameter-spaces, will also aid in conventional inspections as they are able to give information to human operators as to the existence or not of these very dangerous cracks.

This paper presents a study on the development of the cross-curricular learning outcome (CCLO) "Ethical, environmental and professional responsibility" by the students of different Bache-lor’sDegrees taught at Universitat Politècnica de València. The work and development of this learning outcome entails great complexity, given the double dimension of responsibility that it involves. At the end of their training at the university, students are expected to show ethical, en-vironmental, and professional responsibility towards themselves and others. Interviews have been conducted with lecturers who work and assess this outcome in their subjects, most/all of them related to science and engineering. The objective was to identify the learning approach used at the different subjects to guarantee the acquisition of this CCLO by the students. A focus group has also been carried out with students to determine the importance they give to this learning outcome, and to know their degree of satisfaction with the training received. The methodology used to obtain the data from lecturers and students and to process the information to get a precise diagnosis is fully described in the paper. Results are satisfactory to some extent: most of the lecturers carry out appropriate activities and most of students achieve the expected proficiency level. Finally, recommendations are given to improve the development of this cross-curricular learning outcome.

The novel coronavirus disease (COVID-19) has created immense threats to public health on various levels around the globe. The unpredictable outbreak of this disease and the pandemic situation are causing severe depression, anxiety and other mental as physical health related problems among the human beings. To combat against this disease, vaccination is essential as it will boost the immune system of human beings while being in the contact with the infected people. The vaccination process is thus necessary to confront the outbreak of COVID-19. This deadly disease has put social, economic condition of the entire world into an enormous challenge. The worldwide vaccination progress should be tracked to identify how fast the entire economic as well as social life will be stabilized. The monitor ofthe vaccination progress, a machine learning based Regressor model is approached in this study. This tracking process has been applied on the data starting from 14^th December, 2020 to 24^th April, 2021. A couple of ensemble based machine learning Regressor models such as Random Forest, Extra Trees, Gradient Boosting, AdaBoost and Extreme Gradient Boosting are implemented and their predictive performance are compared. The comparative study reveals that the AdaBoostRegressor outperforms with minimized mean absolute error (MAE) of 9.968 and root mean squared error (RMSE) of 11.133.

Due to the unanticipated, forced migration of classroom activities to a fully remote format because of the coronavirus pandemic, there is a critical need for progress in the online education system. Not only that, but online education is the way of the future, and its infrastructure must be enhanced for teaching and learning to be effective. Engaging the students and enhancing their focus is one of the major concerns in the current video calling-based system. In this research, we propose a VR and AR-based virtual classroom environment system called "Edu VR" which encourages students to learn with a high level of involvement and attentiveness. We have divided the system into 2 distinct categories. one amongst which incorporates the virtual reality classroom, wherever the students can have a similar feel of actual school with peer-to-peer-based interactions and student-to-teacher interactions with Unity3D. We are able to conjointly deploy AR models with Vuforia, which permits the teachers to take classes more efficiently with student’s engagement. The other category involves the AI-based classroom assessment system, which enables teachers to produce assessments, which in turn are proctored by Artificial Intelligence. The results are automatically sent to the student within a short period, with the assistance of text similarity analysis for evaluating the answer scripts with Machine learning. This approach solves the drawbacks of video call-based systems with enhanced focus and engagement.

History learning is often regarded as something that is considered unimportant and boring to be taught in the modern era like now. The existence of history learning itself is still important enough to be studied in the 21st century with all its benefits and uses. One of the uses of history is as a reasoning education. The research questions are how do we take advantage of history learning as reasoning and critical thinking education in the 21st century and how the usage of new media can make historical learning looks more interesting. The method used in this article is literature review with data obtained and analyzed from several journals and research results related to history learning and reasoning education, especially forms of critical thinking in the 21st century. From the results of the research, it was found that there was a link between learning history and its relation as a form of critical thinking in the 21st century, in several ways, such as teaching history based on historical thinking, and the usage of new media in history learning.

Clubhouse is an auditory app that allows users to host various rooms surrounding a diverse range of topics from Artificial Intelligence to Philosophy. Along with its educational and serene approach, it is known for its popularity amongst celebrities, including Elon Musk, Mark Zuckerburg, CEO of Shopify, and its elusive invite and ios-only pass into gaining access into Clubhouse. Waiting lists are available in the case of not achieving an invite, but to further speed the process, various sellers on eBay, Reddit, Twitter, etc., charging invites from $10-$200. This research paper covers the phenomenon of Clubhouse and the emergence of audio-only rooms, along with a hypothesis of why Clubhouse and other apps of a similar kind are experiencing a harsh downfall despite its seemingly successful business model.

This paper proposes a neural network which fuses the data received from a camera system on a gantry, to detect moving objects and calculate relative position and velocity of the vehicles traveling on a freeway, this information is used to estimate the traffic flow. To estimate the traffic flow at both microscopic and macroscopic view, this paper used YOLO v4 and DeepSORT for vehicle detection and tracking, then counting the number of vehicles pass through the freeway by drawing virtual lines and hot zones, also counting the velocity of each vehicles. The information is then pass to the traffic control center, in order to monitoring and control traffic flow on freeways, and analyzing freeway conditions.

The study aimed to identify different molds that grow on various food surfaces. As a result, we conducted a case study for the detection of mold on food surfaces based on the “you only look once (YOLO) v5” principle. In this context, a dataset of 2050 food images with mold growing on their surfaces was created. The dataset was trained using the pre-trained YOLOv5 algorithm. In comparison to YOLOv3 and YOLOv4, this current YOLOv5 model had better precision, recall, and average precision (AP), which were 98.10%, 100%, and 99.60%, respectively. The YOLOv5 algorithm was used for the first time in this study to detect mold on food surfaces. In conclusion, the proposed model successfully recognizes any kind of mold present on the food surface. Using YOLOv5, we are currently conducting research to identify the specific species of the detected mold.

Researchers are concerned about the impact of fake news on democracy, while it could also escalate to life-threatening problems. Fake news continues to spread, so does people's behaviour and emotions about fake news via social media. This opens up the back door for cyber-criminals to entice people (i.e. taking advantage of victims' emotional and behavioural aspects) to click on fraudulent links (e.g. phishing links) associated with fake news when reading. Therefore, we investigate how people's emotional and behavioural features influence reading and diffusing fake news on social media. We proposed a classification model incorporating people's behavioural features and their emotions to better detect fake news in social media. Our results reveal that fake news has more negative emotions than legitimate ones and both title and the content of the news/posts are equally important. Furthermore, we have identified that there exist strong correlations between some of the behavioural and emotional features. Finally, we concluded that emotional and behavioural features are important for fake news classifications as they improve the accuracy of detecting fake news, and the findings of our study can ultimately be used to develop a risk score prediction model for fake news in social media.

Children’s learning of place value is critical to their future study of mathematics. However, its learning presents a huge challenge for many learners. As result they develop misconceptions and thencommit errors that become an encumbrance to their understanding of place value. It is therefore important to identify these misconceptions and their associated errors early and help children to overcome them. This article reports the findings from literature on what misconceptions learners display in the learning of place value and how they can best be supported to overcome them. The results show that despite the importance of this topic there are limited studies devoted to its research. The dearth of these studies creates a gap in the study of place value.