Over the past decade, Deep Learning (DL) had been applied in a large number of optical sensors’ applications. DL algorithms can improve the accuracy and reduce the noise level in optical sensors. Optical sensors are considered as promise technology for the modern intelligent sensing platforms. These sensors are widely used to process monitoring, quality prediction, pollution, defense, security and many other applications. However, they suffer major challenges such as the large generated data and low processing speed for that data and moreover the much cost of these sensor. These challenges can be mitigated by integrating deep learning system with the optical sensor technologies. This paper presents recent studies that integrate DL algorithms with optical sensors applications. This paper also highlights several of DL algorithms directions that promise a considerable impact on use for optical sensor applications. Moreover, this study provides new directions for the future related research development.

Chickpea is one of the most widely consumed pulses globally because of its high protein content. The morphological features of chickpea seed, such as colour, texture, are observable and play a major role in classifying different chickpea varieties. This process is often carried out by human experts, and is time-consuming, inaccurate, and expensive. The objective of the study was to design an automated chickpea classifier using an RGB colour image-based model by considering the morphological features of chickpea seed. As part of the data acquisition process, five hundred and fifty images were collected per variety for four varieties of chickpea (CDC-Alma, CDC-Consul, CDC-Cory, and CDC-Orion) using an industrial RGB camera and a mobile phone camera. Three CNN-based models such as NasNet-A (mobile), MobileNetV3 (small), and EfficientNetB0 were evaluated using a transfer learning-based approach. The classification accuracy was 97%, 99%, and 98% for NasNet-A (mobile), MobileNetV3 (small), and EfficientNetB0 models, respectively. The MobileNetV3 model was used for further deployment on an Android mobile and Raspberry Pi 4 devices based on its higher accuracy and light-weight architecture. The classification accuracy for the four chickpea varieties was 100% while the MobileNetV3 model was deployed on both Android mobile and Raspberry Pi 4 platforms.

This study compares the performance of existing studies on multimodal emotion recognition, and proposes a model that fuses two modalities with the speaker's text and voice signals as input values and detects depression. Based on the DAIC-WOZ dataset, voice features were extracted using CNN, text features were extracted using Transformers, and two modalities were fused through a tensor fusion network. We also build a model to detect whether the speaker is depressed or not using LSTM in the final layer. This study suggests the possibility of increasing access to mental illness diagnosis by enabling patients to detect depression on their own in daily conversations. If the model proposed in this study is developed and the voice conversation system is connected, it will be easier for patients who cannot visit the hospital periodically or who are reluctant to visit the hospital to check their condition and seek recovery. Furthermore, it can be expanded to multi-label classification for various mental diseases and used as a simple self-mental disease diagnosis tool.

In this work, we propose a self-supervised multi-agent system that meets the online learning of clustering tasks for video behavior recognition spatio-temporal tasks. Encoding visual behavioral actions as discrete temporal sequence(DTS). Real-time clustering recognition task in a multi-agent system for continuous model building, training, and correction. Finally, we implemented a fully decentralized multi-agent system and completed its feasibility verification in a surveillance video application scenario on vehicle path clustering.

Abstract: Image aesthetic assessment (IAA) with neural attention has made significant progress due to its effectiveness in object recognition. Current studies have shown that the features learned by convolutional neural networks (CNN) at different learning stages indicate meaningful information. The shallow feature contains the low-level information of images and the deep feature perceives the image semantics and themes. Inspired by this, we propose a visual enhancement network with feature fusion (FF-VEN). It consists of two sub-modules, the visual enhancement module (VE module) and the shallow and deep feature fusion module (SDFF module). The former uses an adaptive filter in the spatial domain to simulate human eyes according to the region of interest (ROI) extracted by neural feedback. The latter not only takes out the shallow feature and the deep feature by transverse connection, but also uses a feature fusion unit (FFU) to fuse the pooled features together with the aim of information contribution maximization. Experiments on standard AVA dataset and Photo.net dataset show the effectiveness of FF-VEN.

Urban scene point cloud pose significant challenges for registration due to its large data volume, similar scenarios and dynamic objects. In this paper, we propose PCRMLP, a model for urban scene point cloud registration that achieves comparable registration performance to prior learning-based methods. Compared to previous works which focus on extracting features and estimating correspondence, the model estimates the transformation implicitly from concrete instances. An instance-level urban scene representation method is introduced to extract instance descriptors via semantic segmentation and DBSCAN, which enable the model to obtain robust instance features, filter dynamic objects and estimate transformation in a more logical manner. Then a lightweight network consisting of MLPs is employed to obtain transformation in an encoder-decoder manner. We validate the approach on KITTI dataset. Experimental results demonstrate that PCRMLP can obtain a satisfactory coarse transformation from instance descriptors just in 0.0028s. With a subsequent ICP refinement module, the proposed method achieves higher registration accuracy and computational efficiency than prior learning-based works.

This study aims to evaluate the determinants that influence the adoption of online databases in the learning process of students at economics universities in Vietnam. A quantitative study with a meta-analysis was conducted by utilizing structural equation modeling (SEM). The sample consisted of 492 students from economics universities located in Vietnam who were surveyed using stratified random sampling. The results indicate that the adoption of online databases in student learning is influenced by six determinants, namely: (i) perceived effectiveness, (ii) perceived ease of use, (iii) technical barriers, (iv) personal usefulness, (v) usage attitudes, and (vi) convenience. Our study has revealed that students' intention to use the online database system is positively influenced by their perceived ease of use and perceived usefulness. These findings could be valuable in shaping policies for enhancing the online database system at economics universities, taking into account the students' characteristics and the institution's needs.

Estimating plume cloud height is essential for various applications, such as global climate models. Smokestack plume rise is the constant height at which the plume cloud is carried downwind as its momentum dissipates and the plume cloud and the ambient temperatures equalize. Although different parameterizations are used in most air-quality models to predict the plume rise, they have been unable to estimate it properly. This paper proposes a novel framework to monitor smokestack plume clouds and make long-term, real-time measurements of the plume rise. For this purpose, a three-stage framework is developed based on Deep Convolutional Neural Networks (DCNNs). In the first stage, an improved Mask R-CNN, called Deep Plume Rise Network (DPRNet), is applied to recognize the plume cloud. Then, image processing analysis and least squares theory are respectively used to detect the plume cloud’s boundaries and fit an asymptotic model into their centerlines. The y-component coordinate of this model’s critical point is considered the plume rise. In the last stage, a geometric transformation phase converts image measurements into real-life ones. A wide range of images with different atmospheric conditions, including day, night, and cloudy/foggy, have been selected for the DPRNet training algorithm. Obtained results show that the proposed method outperforms widely-used networks in smoke border detection and recognition.

Existing one-shot neural architecture search (NAS) methods have to conduct a search over a giant super-net, which leads to the huge computational cost. To reduce such cost, in this paper, we propose a method, called FTSO, to divide the whole architecture search into two sub-steps. Specifically, in the first step, we only search for the topology, and in the second step, we search for the operators. FTSO not only reduces NAS’s search time from days to 0.68 seconds, but also significantly improves the found architecture's accuracy. Our extensive experiments on ImageNet show that within 18 seconds, FTSO can achieve a 76.4% testing accuracy, 1.5% higher than the SOTA, PC-DARTS. In addition, FTSO can reach a 97.77% testing accuracy, 0.27% higher than the SOTA, with nearly 100% (99.8%) search time saved, when searching on CIFAR10.

The increasing use of deep learning techniques to manipulate images and videos, commonly referred to as "deepfakes," is making more and more challenging to differentiate between real and fake content. While various deepfake detection systems have been developed, they often struggle to detect deepfakes in real-world situations. In particular, these methods are often unable to effectively distinguish images or videos when these are modified using novel techniques which have not been used in the training set. In this study, we carry out an analysis of different deep learning architectures in an attempt to understand which is more capable of better generalizing the concept of deepfake. According to our results, it appears that Convolutional Neural Networks (CNNs) seem to be more capable of storing specific anomalies and thus excel in cases of datasets with a limited number of elements and manipulation methodologies. The Vision Transformer, conversely, is more effective when trained with more varied datasets, achieving more outstanding generalization capabilities than the other methods analysed. Finally, the Swin Transformer appears to be a good alternative for using an attention-based method in a more limited data regime. All the analyzed architectures seem to have a different way to look at deepfakes but since in a real-world environment, the generalization capability is essential, based on the carried out experiments the Vision Transformer seems to provide superior performances.

Deep learning has already revolutionised the way we process a wide range of data, in many areas of our daily life. The ability to learn abstractions and relationships from heterogeneous data, has provided impressively accurate prediction and classification tools to handle increasingly big datasets. This has a significant impact on the growing wealth of omics datasets, with the unprecedented opportunity for a better understanding of the complexity of living organisms. While this revolution is transforming the way we analyse these data, explainable deep learning is emerging as an additional tool with the potential to change the way we interpret biological data. Explainability addresses critical issues such as transparency, so important when computational tools are introduced especially in clinical environments. Moreover, it empowers artificial intelligence with the capability to provide new insights in the input data, thus adding an element of discovery to these already powerful resources. In this review we provide an overview of the transformative effects explainable deep learning is having on multiple sectors, ranging from genome engineering and genomics, from radiomics to drug design and clinical trials. We offer a perspective to life scientists, to better understand the potential of these tools, and a motivation to implement them in their research, by suggesting learning resources they can use to move their first steps in this field.

Portable Document Format (PDF) is one of the most widely used files types worldwide in data exchange, this has encourage hackers to utilize such files to spread any malicious content through PDF, utilizing different methods and techniques to accomplish that, on the other hand, security researches kept trying to improve detection methods to cope up to the rapidly increasing number of malwares daily, one of the commonly used detection technique nowadays is by utilizing artificial intelligence and Machine learning classificat; thision to help detecting PDF Malwares, in this paper, we utilize machine learning classifier Random Forest on a newly released PDF Malware dataset CIC-Evasive-PDFMal2022 to achieve the main goal of detecting malicious PDF documents, results showing a detection accuracy of around 99.5%

In this paper I describe elements of Game-Based Learning that can be used to support mathematics teaching using games. After creating a game that incorporates the elements described, the game was playtested against a small number of people who answered a questionnaire focusing on user experience, learning motivation and game design. The results are attached separately as well as the analysis. I believe that with further development this game-based approach can be a powerful tool to gamify common learning tools and increase learning motivation and appreciation.

Climbing plants require an external support to grow vertically and enhance light acquisition. Climbers that find a suitable support have greater performance and fitness than those that remain prostrate. Support search is characterized by oscillatory movements (i.e., circumnutation), in which plants rotate around a central axis during their growth. Numerous studies have elucidated the mechanistic details of circumnutation, but how this phenomenon is controlled remains unclear. Here, we use supervised machine learning algorithms to generate models that learn to discriminate between the presence/absence of a support in the environment. Results indicate that there is a difference in the pattern of circumnutation, depending on the presence of a support, that can be learned and classified rather accurately. We also identify distinctive kinematic features that contribute to the classification tasks. Overall, machine learning approaches appear to be powerful tools for understanding the movement of plants.

Initial choice of Learning Rate is a key part of gradient based methods and has a great effect on the performance of the Deep Learning Model.This paper studies the behavior of multiple gradient based optimization algorithm which are commonly used in Deep Learning and compare their performance on various learning rate. As observed popular choice of optimization algorithms are highly sensitive to various choice of learning rates. Our goal is to find which optimizer has an edge over others for a specific setting. We look at two datasets namely MNIST and CIFAR10 for benchmarking. The results are quite surprising, and it will help us to choose a learning rate more efficiently.

The purpose of this paper is to develop a theoretical predictive model for LNG shipping routes selection process. Strategic decisions about shipping costs could be improved if a deeper knowledge about products economic value is provided. Developments made on the extraction and industrial processes related to this fossil fuel are driving the natural gas sector towards a unique globalised market. Moreover, data analytics applications as well as machine learning are topics presented as perfect catalysers for achieving an unprecedented natural gas globalised market. Additionally, this paper aims at showing the state of the art of new techniques used in transportation engineering that might have synergies with other industries (eg. commodities cost reduction, energy supply…). Finally, this paper aims to provide foundation for further research and development using more sophisticated data and algorithms that will help to close the gap between theoretical and practical scope of this techniques.

Coagulation is the most sensitive step in drinking water treatment. Underdosing may not yield the required water quality, whereas overdosing may result in higher costs and excess sludge. Traditionally, the coagulant dosage is set based on bath experiments performed manually. Therefore, this test does not allow real-time dosing control, and its accuracy is subject to operator experience. Alternatively, solutions based on machine-learning (ML) have been evaluated as a computer-aided alternative. Despite these advances, there is open debate on the most suitable ML method applied to the coagulation process, capable of the most highly accurate prediction. This study addresses this gap, where a comparative analysis between ML methods was performed. As a research hypothesis, a novel data-driven fuzzy inference system (FIS) should provide the best performance due to its ability to deal with uncertainties inherent to complex processes. Although ML methods have been widely investigated, only a few studies report hybrid neuro-fuzzy systems applied to coagulation. Thus, to the best of our knowledge, this is the first study thus far to address the accuracy of this novel data-driven FIS for such application. The novel FIS provided the smallest error (0.86), indicating a promising alternative tool for real-time and highly accurate coagulant dosing in drinking water treatment.

This work focused on the evaluation of some machine learning (ML) models and their application in e-health, using intermediate nodes within an Internet of Things (IoT) platform used for heartbeat anomaly detection. For the evaluation of ML models, a set of statistical validation metrics was selected. These metrics were applied in the training, testing and validation phases of the models. The results obtained can determine relevant factors for the selection of ML models, either based on the statistical and intrinsic efficiency of the ML models, or on their suitability to be implemented in intermediate nodes within an IoT platform. the more Lightweight models such as Simple Linear Regression, Logistic Regression, and K Nearest Neighbors, could easily operate in intermediate nodes, and they are models that require low processing and storage to work. In conclusion, the approach for intermediate nodes of Internet of Things platforms using cognitive networks decreases the processing cost in cloud computing and transfers it to the fog layer.

Deep Learning is an extremely important research topic in Earth Observation. Current use-cases range from semantic image segmentation, object detection to more common problems found in computer vision such as object identification. Earth Observation is an excellent source for different types of problems and data for Machine Learning in general and Deep Learning in particular. It can be argued that both Earth Observation and Deep Learning as fields of research will benefit greatly from this recent trend of research. In this paper we take several state of the art Deep Learning network topologies and provide a detailed analysis of their performance for semantic image segmentation for building footprint detection. The dataset used is comprised of high resolution images depicting urban scenes. We focused on single model performance on simple RGB images. In most situations several methods have been applied to increase the accuracy of prediction when using deep learning such as ensembling, alternating between optimisers during training and using pretrained weights to bootstrap new models. These methods although effective, are not indicative of single model performance. Instead, in this paper, we present different topology variations of these state of the art topologies and study how these variations effect both training convergence and out of sample, single model, performance.

The study examined the learner autonomy in EFL learning at the undergraduate level in the context of Bangladesh. It investigated the effectiveness of learner autonomy on EFL learning. Besides, it explored the factors affecting autonomous learning in English language class. This study adopted a mixed- method approach. Data were collected from 60 students who had just completed their second semester at a private university in Dhaka city. The respondent students attended the compulsory English foundation course including their two semesters. Data were also collected from 12 ELT teachers teaching at the tertiary education level. Five EFL classes were observed following a sample of classroom observation schedule. Both open-ended and closed-ended questionnaires were used by the researchers for collecting the data from the students and teachers. Major findings of the study showed that lack of confidence, teachers’ dependency, lack of motivation, short-term goals in learning, huge confusions and confinement in memorization, tendency of using mother tongue and unawareness to self-evaluation of students affected learner autonomy in EFL learning of the undergraduate students. However, the study revealed that motivated students hardly faced any difficulties in achieving maximum outcomes with autonomous learning in the EFL class. Finally, the researchers gave a number of recommendations to bring out effective EFL learning with learner autonomy.

We present a differentially private extension of the block coordinate descent based on objective perturbation. The algorithm iteratively performs linear regression in a federated setting on vertically partitioned data. In addition to a privacy guarantee, the algorithm also offers a utility guarantee; a tolerance parameter indicates how much the differentially private regression may deviate from an analysis without differential privacy. The algorithm’s performance is compared with the standard block coordinate descent algorithm and the trade-off between utility and privacy is studied. The performance is studied using both artificial test data and the forest fires data set. We find that the algorithm is fast and able to generate practical predictions with single-digit privacy budgets, albeit with some accuracy loss.

Evolutionary perspectives have generated many questions and some answers in the study of human health and disease. The field of evolutionary medicine, and related analytics of evolutionary psychiatry and evolutionary psychology have extended and expanded the way health disorders are viewed by searching for why humans, as a species, are vulnerable to certain pathological conditions. The search is organized into four domains that apply proximate and evolutionary explanations to human traits and developmental sequences. This framework opens inquiry to the ontogeny, phylogeny, mechanism, and adaptive significance of human health conditions. In this paper I argue that evolutionary medicine seems to parallel biomedicine in its primarily pathogenic focus. That is, conditions of pain, suffering, and disorder have received the most attention. Some work has used the architecture of evolutionary medicine to take a salutogenic approach, evaluating the proximate and evolutionary explanations of human well-being. I propose that an evolutionary understanding of human well-being requires a survey of emotions and their relationship with neurobiology, language, and culture. My anthropology based, multidisciplinary review of biopsychosocial processes reveals the way evolution has shaped modern human understanding of well-being through sociolinguistic learning processes and thereby our individual experiences of well-being. These insights have the power to contextualize human suffering and flourishing as we progress toward the goal of attenuating the former and expanding the latter.

If the development of machine learning and artificial intelligence plays a role in many fields of research and technology today, it has a special relationship with neurosciences. Indeed, historically inspired by our knowledge of the brain, deep learning shares some vocabularies with neurosciences and can sometimes be considered a brain’s model. Taking the particular example of epileptic seizure, which can develop in any biological neural tissue, we raise the question if and how the models used for deep learning can capture or model these pathological events. This particular example is a starting point to discuss the nature, limits, and functions of these models, and what we expect from a model of the brain. Finally, we argue that a pluralistic approach leading to the integrated coexistence of different models is necessary to study the brain in all its complexity.

In today’s Web 2.0 era, online social media has become an integral part of our lives. In the course of the information revolution, the form of information has undergone a radical change, from simple text information to today’s integrated video, image, text and audio, and there has also been a great change in the way of dissemination and access, as people nowadays do not just rely on traditional media to passively receive information, but more actively and selectively obtain information from social media. Therefore, it has become a great challenge for us to effectively utilize these massive and integrated multi-modal media information to form an effective system of retrieval, browsing, analysis and usage. Unlike movies and traditional long-form video content, micro-videos are usually short in length, between a few seconds and tens of seconds, which allows users to quickly browse different contents and make full use of the fragmented time in their lives, while users can also share their micro-videos to their friends or the public, forming a unique social way. Video contains rich multimodal information, and fusing information from multiple modalities in a video recommendation task can improve the accuracy of the video recommendation task.According to the micro-video recommendation task, a new combinatorial network model is proposed to combine the discrete features of each modality into the overall features of various modalities through the network, and then fuse the various modal features to obtain the overall video features, which will be used for recommendation. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Impaired wound healing is a significant financial and medical burden. The synthesis and deposition of extracellular matrix (ECM) in a new wound is a dynamic process that is constantly changing and adapting to the biochemical and biomechanical signaling from the extracellular microenvironments of the wound. This drives either a regenerative or fibrotic and scar-forming healing outcome. Disruptions in ECM deposition, structure, and composition lead to impaired healing in diseased states, such as in diabetes. Valid measures of the principal determinants of successful ECM deposition include bacterial contamination, tissue perfusion, and mechanical injury and strain. These measures are used by wound-care providers to intervene upon the healing wound to steer healing toward a more functional phenotype with improved structural integrity and healing outcomes and to prevent adverse wound developments.In this review, we discuss bioengineering advances in non-invasive detection of biologic and physiologic factors of the healing wound, visualizing and modeling the ECM, and computational tools to efficiently evaluate the complex data acquired from the wounds to prognosticate healing outcomes and intervene effectively. We focus on bioelectronics and biologic interfaces of the sensors and actuators for real time biosensing and actuation. We also discuss high-resolution, advanced imaging techniques, which go beyond traditional confocal and fluorescence microscopy to visualize microscopic details of the composition of the matrix, linearity of collagen, and live tracking of components within the ECM. Computational modeling of the matrix, including partial differential equation datasets as well as machine learning models that can serve as powerful tools for physicians to guide their decision-making process are discussed.

Blockchain and Machine Learning gives the best solutions together in performing various tasks in the Smart Health care system. With these two new emerging technologies, that have materialized in the last decade. In this paper, we proposed secure, transparent and intelligent methods in the Internate of medical things industry using Machine learning models and blockchain technology to enhance security level and train our models to improve diagnostic, prevention, treatment of the patient, patient rights, patient autonomy and equality in the health care system.

Majority of published articles have talked about the challenges faced by students in learning online however, little has been talked about what the teachers have gone through especially during these times of the pandemic. This paper discusses the factors university teachers face when teaching online. These factors include accessibility to the internet, level of interaction between teachers and students, costs incurred, availability of training and academic policies kept in place to enhance effectiveness of teaching online. These are further divided into personal, social and economic factors where the teachers’ age, gender, remuneration, availability of resources, location and the economic status of the country is discussed in relation to the effectiveness of online learning. Upon carrying out a literature review on articles written on the effectiveness of online learning with the main focus being teachers, it was noted that the main factors affecting the effectiveness of online learning was the availability of internet connection and training provided to teachers. In Kenya, majority of the rural areas lack access to the internet and devices to learn online which makes it difficult for a teacher to teach effectively given the pandemic constraints. This study sheds light on the need for institutions and governments to take input from their teachers and train them on how to make online learning more effective. It also shows the status of universities in Kenya which had to shift to learning online due to the pandemic. Majority of them took time to adapt to this new change due to the discussed factors. Therefore it is recommended that the Government should train teachers and address the issue of lack of internet and electricity in Kenya.

Video editing is a high-required job, for it requires skilled artists or workers equipped with plentiful physical strength and multidisciplinary knowledge, such as cinematography, aesthetics. Thus gradually, more and more researches focus on proposing semi-automatical and even fully automatical solutions to reduce workloads. Since those conventional methods are usually designed to follow some simple guidelines, they lack flexibility and capability to learn complex ones. Fortunately, the advances of computer vision and machine learning make up the shortages of traditional approaches and make AI editing feasible. There is no survey to conclude those emerging researches yet. This paper summaries the development history of automatic video editing, and especially the applications of AI in partial and full workflows. We emphasizes video editing and discuss related works from multiple aspects: modality, type of input videos, methology, optimization, dataset, and evaluation metric. Besides, we also summarize the progresses in image editing domain, i.e., style transferring, retargeting, and colorization, and seek for the possibility to transfer those techniques to video domain. Finally, we give a brief conclusion about this survey and explore some open problems.

Early detection improves prognosis in pancreatic ductal adenocarcinoma (PDAC) but is challenging as lesions are often small and poorly defined on contrast-enhanced computed tomography scans (CE-CT). Deep learning can facilitate PDAC diagnosis, however current models still fail to identify small (<2cm) lesions. In this study, state-of-the-art deep learning models were used to develop an automatic framework for PDAC detection, focusing on small lesions. Additionally, the impact of integrating surrounding anatomy was investigated. CE-CT scans from a cohort of 119 pathology-proven PDAC patients and a cohort of 123 patients without PDAC were used to train a nnUnet for automatic lesion detection and segmentation (nnUnet_T). Two additional nnUnets were trained to investigate the impact of anatomy integration: (1) segmenting the pancreas and tumor (nnUnet_TP), (2) segmenting the pancreas, tumor, and multiple surrounding anatomical structures (nnUnet_MS). An external, publicly available test set was used to compare the performance of the three networks. The nnUnet_MS achieved the best performance, with an area under the receiver operating characteristic curve of 0.91 for the whole test set and 0.88 for tumors <2cm, showing that state-of-the-art deep learning can detect small PDAC and benefits from anatomy information.

The rapid infiltration of fake news is a flaw to the otherwise valuable internet, a virtually global network that allows for the simultaneous exchange of information. While a common, and normally effective, approach to such classification tasks is designing a deep learning-based model, the subjectivity behind the writing and production of misleading news invalidates this technique. Deep learning models are unexplainable in nature, making the contextualization of results impossible because it lacks explicit features used in traditional machine learning. This paper emphasizes the need for feature engineering to effectively address this problem: containing the spread of fake news at the source, not after it has become globally prevalent. Insights from extracted features were used to manipulate the text, which was then tested on deep learning models. The original unknown yet substantial impact that the original features had on deep learning models was successfully depicted in this study.

The influence of the Madden - Julian Oscillation (MJO) on the intensity of the Tropical Cyclones in the North Indian Ocean is investigated through a machine learning algorithm using cyclone data from the Joint Typhoon Warning Centre and MJO from the Bureau of Meteorology, Australia during 1974–2019. The scatter index varies from 0.45 for depressions to 0.03 for the super cyclonic storms indicating that the MJO index is another parameter that should be investigated in cyclone studies.

Concrete is a heterogeneous material with a disordered material morphology that strongly governs the behavior of the material. In this contribution, we present a computational tool called the Concrete Mesostructure Generator (CMG) for the generation of ultra-realistic virtual concrete morphologies for mesoscale and multiscale computational modeling and simulation of concrete. Given an aggregate size distribution, realistic generic concrete aggregates are generated by a sequential reduction of a cuboid to generate a polyhedron with multiple faces. Thereafter, concave depressions are introduced in the polyhedron using gaussian surfaces. The generated aggregates are assembled into the mesostructure using a hierarchic random sequential adsorption algorithm. The virtual mesostructures are first calibrated using laboratory measurements of aggregate distributions. The model is validated by comparing the elastic properties obtained from laboratory testing of concrete specimens with the elastic properties obtained using computational homogenisation of virtual concrete mesostructures. Finally, a 3D-convolutional neural network is trained to directly generate elastic properties from voxel data.

Over the past decade, recognition of human activities (HAR) has become a vibrant field of research, in particular, the spread in our everyday lives of electronics such as mobile phones, smart cell phones, and video cameras. Furthermore, the advancement in the field of deep methodologies and other paradigms have enabled scientists to enable HAR in many areas, consisting of activities in fitness and wellness. For instance, HAR is one of many resorts to support older people through day-to-day activities to support their cognition and physicality. This study is centered on the key aspects deep learning plays in the development of HAR applications. Although numerous HAR examination studies were carried out previously, there have been no overall studies on this subject, in all the earlier studies there were only specific HAR-related subjects. A detailed review covering all the main subjects in this area is therefore essential. This study discusses the latest developments and works in HAR. It separates the methods and the advantages and disadvantages of each method group. This paper finally addresses many problems in the current HAR subject and provides recommendations for potential study.

Foraminifera are single-celled marine organisms that construct shells that remain as fossils in the marine sediments. Classifying and counting these fossils are important in e.g. paleo-oceanographic and -climatological research. However, the identification and counting process has been performed manually since the 1800s and is laborious and time-consuming. In this work, we present a deep learning-based instance segmentation model for classifying, detecting, and segmenting microscopic foraminifera. Our model is based on the Mask R-CNN architecture, using model weight parameters that have learned on the COCO detection dataset. We use a fine-tuning approach to adapt the parameters on a novel object detection dataset of more than 7000 microscopic foraminifera and sediment grains. The model achieves a (COCO-style) average precision of 0.78±0.00 on the classification and detection task, and 0.80±0.00 on the segmentation task. When the model is evaluated without challenging sediment grain images, the average precision for both tasks increases to 0.84±0.00 and 0.86±0.00, respectively. Prediction results are analyzed both quantitatively and qualitatively and discussed. Based on our findings we propose several directions for future work, and conclude that our proposed model is an important step towards automating the identification and counting of microscopic foraminifera.

Neural networks present the characteristics that the results are strongly dependent on the training data, the weight initialisation, and the hyper-parameters chosen. The determination of the distribution of a statistical estimator, as the Mean Squared Error (MSE) or the accuracy, is fundamental to evaluate the performance of a neural network model (NNM). For many machine learning models, as linear regression, it is possible to analytically obtain information as variance or confidence intervals on the results. Neural networks present the difficulty of being not analytically tractable due to their complexity. Therefore, it is impossible to easily estimate distributions of statistical estimators. When estimating the global performance of an NNM by estimating the MSE in a regression problem, for example, it is important to know the variance of the MSE. Bootstrap is one of the most important resampling techniques to estimate averages and variances, between other properties, of statistical estimators. In this tutorial, the application of two resampling (including bootstrap) techniques to the evaluation of neural networks’ performance is explained from both a theoretical and practical point of view. Pseudo-code of the algorithms is provided to facilitate their implementation. Computational aspects, as the training time, are discussed since resampling techniques always require to run simulations many thousands of times and, therefore, are computationally intensive. A specific version of the bootstrap algorithm is presented that allows the estimation of the distribution of a statistical estimator when dealing with an NNM in a computationally effective way. Finally, algorithms are compared on synthetically generated data to demonstrate their performance.

Accurately mapping individual tree species in densely forested environments is crucial to forest inventory. When considering only RGB images, this is a challenging task for many automatic photogrammetry processes. The main reason for that is the spectral similarity between species in RGB scenes, which can be a hindrance for most automatic methods. State-of-the-art deep learning methods could be capable of identifying tree species with an attractive cost, accuracy, and computational load in RGB images. This paper presents a deep learning-based approach to detect an important multi-use species of palm trees (Mauritia flexuosa; i.e., Buriti) on aerial RGB imagery. In South-America, this palm tree is essential for many indigenous and local communities because of its characteristics. The species is also a valuable indicator of water resources, which comes as a benefit for mapping its location. The method is based on a Convolutional Neural Network (CNN) to identify and geolocate singular tree species in a high-complexity forest environment, and considers the likelihood of every pixel in the image to be recognized as a possible tree by implementing a confidence map feature extraction. This study compares the performance of the proposed method against state-of-the-art object detection networks. For this, images from a dataset composed of 1,394 airborne scenes, where 5,334 palm-trees were manually labeled, were used. The results returned a mean absolute error (MAE) of 0.75 trees and an F1-measure of 86.9%. These results are better than both Faster R-CNN and RetinaNet considering equal experiment conditions. The proposed network provided fast solutions to detect the palm trees, with a delivered image detection of 0.073 seconds and a standard deviation of 0.002 using the GPU. In conclusion, the method presented is efficient to deal with a high-density forest scenario and can accurately map the location of single species like the M flexuosa palm tree and may be useful for future frameworks.

Deep neural networks are hegemonic approaches to many machine learning areas, including natural language processing (NLP). Thanks to the availability of large corpora collections and the capability of deep architectures to shape internal language mechanisms in self-supervised learning processes (also known as "pre-training"), versatile and performing models are released continuously for every new network design. But these networks, somehow, learn a probability distribution of words and relations across the training collection used, inheriting the potential flaws, inconsistencies and biases contained in such a collection. As pre-trained models have found to be very useful approaches to transfer learning, dealing with bias has become a relevant issue in this new scenario. We introduce bias in a formal way and explore how it has been treated in several networks, in terms of detection and correction. Also, available resources are identified and a strategy to deal with bias in deep NLP is proposed.

In the field of machine learning, cluster analysis has always been a very important technology for determining useful or implicit characteristics in the data. However, the current mainstream cluster analysis algorithms require comprehensive analysis of the overall data to obtain the best parameters in the algorithm. As a result, handling large-scale datasets would be difficult. This research proposes a distributed related clustering mechanism for Unsupervised Learning, which assumes that if adjacent data are similar, a group can be formed by relating to more data points. Therefore, when processing data, large-scale datasets can be distributed to multiple computers, and the correlation of any two datasets in each computer can be calculated simultaneously. Later, results are processed through aggregation and filtering before assembled into groups. This method would greatly reduce the pre-processing and execution time of the dataset; in practical application, it only needs to focus on how the relevance of the data is designed. In addition, the experimental results show the accuracy, applicability, and ease of use of this method.

Rainfall retrieval using geostationary satellites provides critical means to the monitoring of extreme rainfall events. Using the relatively new Himawari 8 meteorological satellite with three times more channels than its predecessors, the deep learning framework of “convolutional autoencoder” (CAE) was applied to the extraction of cloud and precipitation features. The CAE method was incorporated into the Convolution Neural Network version of the PERSIANN precipitation retrieval that uses GOES satellites. By applying the CAE technique with the addition of Residual Blocks and other modifications of deep learning architecture, the presented derivation of PERSIANN operated at the Central Weather Bureau of Taiwan (referred to as PERSIANN-CWB) expands four extra convolution layers to fully use Himawari 8’s infrared and water vapor channels, while preventing degradation of accuracy caused by the deeper network. The development of PERSIANN-CWB was trained over Taiwan for its diverse weather systems and localized rainfall features, and the evaluation reveals an overall improvement from its CNN counterpart and superior performance over all other rainfall retrievals analyzed. Limitation of this model was found in the derivation of typhoon rainfall, an area requiring further research.

In recent years, research has focused on generating mechanisms to assess the levels of subjects' cognitive workload when performing various activities that demand high concentration levels, such as driving a vehicle. These mechanisms have implemented several tools to analyze cognitive workload where the electroencephalographic (EEG) signals are the most used due to its high precision. However, one of the main challenges in the EEG signals implementing is finding the appropriate information to identify cognitive states. Here we show a new feature selection model for pattern recognition using information from EEG signals based on machine learning techniques called GALoRIS. GALoRIS combines Genetic Algorithms and Logistic Regression to create a new fitness function that identifies and selects the critical EEG features that contribute to recognizing high and low cognitive workload and structures a new dataset capable of optimizing the model's predictive process. We found that GALoRIS identifies data related to high and low cognitive workload of subjects while driving a vehicle using information extracted from multiple EEG signals, reducing the original dataset by more than 50%, maximizing the model's predictive capacity-achieving a precision rate greater than 90%.

Nutrient management of lowbush blueberry (Vaccinium angustifolium Ait.) depends on several yield-limiting features. Machine learning models can process such yield-impacting variables to predict berry yield. We investigated the effects of local variables on yields and nutrient management of lowbush blueberry. We collected 1504 observations from N-P-K fertilizer trials conducted in Quebec, Canada. Meteorological indices at various phenological stages showed the greatest impact on yield. High mean temperature at flower bud opening and after fruit maturation, and total precipitation at flowering showed positive effects. Low mean temperature and low total precipitation before bud opening, at flowering, and by fruit maturity, as well as number of freezing days (< -5ºC) before flower bud opening, showed negative effects. Soil fertility variables, leaf nutrient compositions and N-P-K fertilization showed smaller effects. Gaussian processes predicted berry yields from historical weather data, soil analysis, fertilizer dosage, and leaf nutrients with a root-mean-square-error of 1447 kg ha-1 on the testing data set. An in-house Markov chain algorithm optimized yields modelled with Gaussian processes from leaf nutrient composition, soil test value, and fertilizer dosage conditioned to specified historical weather features. We propose to use conditioned machine learning models to manage nutrients of lowbush blueberry at local scale.

At the start of 2020 the rapid onset of the coronavirus pandemic forced higher education institutions across the world to pivot from face to face to remote teaching. For teaching methods that involve the transmission and dissemination of verbal/visual information between academic staff and students, video technologies provided immediate methods to respond to the restricted access to campus. Practical activities, that usually involve interaction with equipment, presented a greater challenge to adapt for remote delivery. With restrictions on higher education being partially lifted, many institutions worldwide intend to offer blended learning, prioritizing in-person activities that are troublesome to deliver online, such as practicals. Social distancing measures are reducing capacity and placing increased pressure on space, creating a need to optimise limited time students have in the lab and strategies to determine which activities can best utilize this limited resource. Time is constrained, leaving little opportunity to make radical changes to learning and teaching structures. In this publication, The department of Mulicdipalnary Engineering Education (MEE) at the University of Sheffield, utilise their experiences in practical teaching to provide simple, implementable ideas for blended practicals which maximize students’ learning and experiences within the envelope of available resources.

Generic object detection is one of the most important and flourishing branches of computer vision and has real-life applications in our day to day life. With the exponential development of deep learning-based techniques for object detection, the performance has enhanced considerably over the last 2 decades. However, due to the data-hungry nature of deep models, they don't perform well on tasks which have very limited labeled dataset available. To handle this problem, we proposed a transfer learning-based deep learning approach for detecting multiple pigs in the indoor farm setting. The approach is based on YOLO-v2 and the initial parameters are used as the optimal starting values for train-ing the network. Compared to the original YOLO-v2, we transformed the detector to detect only one class of objects i.e. pigs and the back-ground. For training the network, the farm-specific data is annotated with the bounding boxes enclosing pigs in the top view. Experiments are performed on a different configuration of the pen in the farm and convincing results have been achieved while using a few hundred annotated frames for fine-tuning the network.

Many universities and colleges worldwide suspended classroom teaching due to the novel coronavirus pandemic and switched to online teaching. The current cross-sectional study was carried out to analyze the impact of lockdown due to coronavirus disease 2019 (COVID-19) pandemic on the academic performance of veterinary medical students and researchers. Veterinary medical students and researchers were invited to answer an online google form questionnaire. A total of 1398 participants were from 92 different countries answered the questionnaire with response rate of 94.52%. The data showed that COVID-19 pandemic lockdown affected the academic performance of most participants (96.7%) with varying degrees. The mean evaluation scores for the online education in general was 5.06 ± 2.43 while that for the practical parts was 3.62± 2.56. Although online education provides an opportunity for self-study. The main challenge online education faces in veterinary medical science is how to give practical lessons. Since most of the subjects are practical; therefore, it is not easy to learn it online. Students think that it is difficult to fulfill the veterinary competencies only with online education system. Online education can be improved by making it more interactive, showing medical procedures in real situations, giving concise information, and providing 3D virtual tools to mimic the real situation.

The paper concludes the first research on mouth-based Emotion Recognition (ER), adopting a Transfer Learning (TL) approach. Transfer Learning results paramount for mouth-based emotion ER, because a few data sets are available, and most of them include emotional expressions simulated by actors, instead of adopting a real-world categorization. Using TL we can use fewer training data than training a whole network from scratch, thus more efficiently fine-tuning the network with emotional data and improving the convolutional neural network accuracy in the desired domain. The proposed approach aims at improving the Emotion Recognition dynamically, taking into account not only new scenarios but also modified situations with respect to the initial training phase, because the image of the mouth can be available even when the whole face is visible only in an unfavourable perspective. Typical applications include automated supervision of bedridden critical patients in an healthcare management environment, or portable applications supporting disabled users having difficulties in seeing or recognizing facial emotions. This work takes advantage from previous preliminary works on mouth-based emotion recognition using CNN deep-learning, and has the further benefit of testing and comparing a set of networks on large data sets for face-based emotion recognition well known in literature. The final result is not directly comparable with works on full-face ER, but valorizes the significance of mouth in emotion recognition, obtaining consistent performances on the visual emotion recognition domain.

Multidisciplinary Engineering Education (MEE) at the University of Sheffield is dedicated to delivering, at scale, practical teaching to students in the Faculty of Engineering. The COVID-19 pandemic initiated the sudden suspension of face to face teaching required MEE to translate over 600 in-lab practicals to a remote delivery format. With little opportunity to coordinate, academic staff independently adopted a variety of tactics to ensure practical learning outcomes were maintained. Following the reactive response, a proactive reflection was conducted and six categories of tactics for remote practicals have been established. These categories are Provide digital artefacts; Simulated practicals; Synchronous remote participation; Asynchronous participation by proxy; Perform procedure in alternative environment; Remote staff support. The advantages and drawbacks of each of these categories is discussed and it is suggested which tactics are appropriate for particular learning outcomes or operational and environmental outcomes of equivalent in-lab practicals. Further work to comprehensively align outcomes to tactics is proposed and lasting benefit from the analysis can be realized by adopting a principle of Remote Enhanced Practicals.

The vastness of chemical-space constrains traditional drug-discovery methods to the organic laws that are guiding the chemistry involved in filtering through candidates. Leveraging computing with machine-learning to intelligently generate compounds that meet a wide range of objectives can bring significant gains in time and effort needed to filter through a broad range of candidates. This paper details how the use of Generative-Adversarial-Networks, novel machine learning techniques to format the training dataset and the use of quantum computing offer new ways to expedite drug-discovery.

In this paper, we focus on developing a novel method to extract sea ice cover (i.e., discrimination/classification of sea ice and open water) using Sentinel-1 (S1) cross-polarization (vertical-horizontal, VH or horizontal-vertical, HV) data in extra wide (EW) swath mode based on the machine learning algorithm support vector machine (SVM). The classification basis includes the S1 radar backscatter coefficients and texture features that are calculated from S1 data using the gray level co-occurrence matrix (GLCM). Different from previous methods where appropriate samples are manually selected to train the SVM to classify sea ice and open water, we proposed a method of unsupervised generation of the training samples based on two GLCM texture features, i.e. entropy and homogeneity, that have contrasting characteristics on sea ice and open water. We eliminate the most uncertainty of selecting training samples in machine learning and achieve automatic classification of sea ice and open water by using S1 EW data. The comparison shows good agreement between the SAR-derived sea ice cover using the proposed method and a visual inspection, of which the accuracy reaches approximately 90% - 95% based on a few cases. Besides this, compared with the analyzed sea ice cover data Ice Mapping System (IMS) based on 728 S1 EW images, the accuracy of extracted sea ice cover by using S1 data is more than 80%.

Wideband signal detection is an important problem in wireless communication. With the rapid development of deep learning (DL) technology, some DL-based methods are applied to wireless technology, and the effect is obvious. In this paper, we propose a novel neural network for multi-type signal detection that can locate signals and recognize signal types in wideband spectrogram. Our network utilizes the key point estimation to locate the rough centerline of signal region and identify class. Then, several regressions are carried out to achieve properties, such as local offset and border offsets of bounding box, which is further synthesized for a more fine location. Experimental results demonstrate that our method performs more accurate than other DL-based object detection methods previously employed for the same detection task. Specifically, our method runs obviously faster than existing methods, and abandons the anchor generation, which makes it more favorable for real-time applications.

Restricted Boltzmann machines (RBMs) are the building blocks of some deep learning networks. However, despite their importance, it is our perception that some very important derivations about the RBM are missing in the literature, and a beginner may feel RBM very hard to understand. We provide here these missing derivations. We cover the classic Bernoulli-Bernoulli RBM and the Gaussian-Bernoulli RBM, but leave out the ``continuous'' RBM as it is believed not as mature as the former two. This tutorial can be used as a companion or complement to the famous RBM paper ``Training restricted Boltzmann machines: An introduction'' by Fisher and Igel.

While visual assessment is the standard technique for burn evaluation, computer-aided diagnosis is increasingly sought due to high number of incidences globally. Patients are increasingly facing challenges which are not limited to shortage of experienced clinicians, lack of accessibility to healthcare facilities, and high diagnostic cost. Certain number of studies were proposed in discriminating burn and healthy skin using machine learning leaving a huge and important gap unaddressed; whether burns and related skin injuries can be effectively discriminated using machine learning techniques. Therefore, we specifically use pre-trained deep learning models due to deficient dataset to train a new model from scratch. Experiments were extensively conducted using three state-of-the-art pre-trained deep learning models that includes ResNet50, ResNet101 and ResNet152 for image patterns extraction via two transfer learning strategies: fine-tuning approach where dense and classification layers were modified and trained with features extracted by base layers, and in the second approach support vector machine (SVM) was used to replace top-layers of the pre-trained models, trained using off-the-shelf features from the base layers. Our proposed approach records near perfect classification accuracy of approximately 99.9%.

In recent years, a range of problems under the broad umbrella of computer vision based analysis of ancient coins have been attracting an increasing amount of attention. Notwithstanding this research effort, the results achieved by the state of the art in published literature remain poor and far from sufficiently well performing for any practical purpose. In the present paper we present a series of contributions which we believe will benefit the interested community. We explain that the approach of visual matching of coins, universally adopted in existing published papers on the topic, is not of practical interest because the number of ancient coin types exceeds by far the number of those types which have been imaged, be it in digital form (e.g., online) or otherwise (traditional film, in print, etc.). Rather, we argue that the focus should be on understanding the semantic content of coins. Hence, we describe a novel approach—to first extract semantic concepts from real-world multimodal input and associate them with their corresponding coin images, and then to train a convolutional neural network to learn the appearance of these concepts. On a real-world data set, we demonstrate highly promising results, correctly identifying a range of visual elements on unseen coins with up to 84% accuracy.

Federated learning is a decentralized topology of deep learning, that trains a shared model through data distributed among each client (like mobile phones, wearable devices), in order to ensure data privacy by avoiding raw data exposed in data center (server). After each client computes a new model parameter by stochastic gradient decrease (SGD) based on their own local data, all locally-computed parameters will be aggregated in the server to generate an updated global model. Almost all current studies directly average different client computed parameters by default, but no one gives an explanation why averaging parameters is a good approach. In this paper, we treat each client computed parameter as a random vector because of the stochastic properties of SGD, and estimate mutual information between two client computed parameters at different training phases using two methods in two learning tasks. The results confirm the correlation between different clients and show an increasing trend of mutual information with training iteration. However, when we further compute the distance between client computed parameters, we find that parameters are getting more correlated while not getting closer. This phenomenon suggests that averaging parameters may not be the optimum way of aggregating trained parameters.

Physical-law based models are widely utilized in the aerospace industry. One such use is to provide flight dynamics models for use in flight simulators. For human-in-the-loop use, such simulators must run in real-time. Due to the complex physics of rotorcraft flight, to meet this real-time requirement, simplifications to the underlying physics sometimes have to be applied to the model, leading to model response errors in the predictions compared to the real vehicle. This study investigated whether a machine-learning technique could be employed to provide rotorcraft dynamic response predictions, with the ultimate aim of this model taking over when the physics-based model's accuracy degrades. In the current work, a machine-learning technique was employed to train a model to predict the dynamic response of a rotorcraft. Machine learning was facilitated using a Gaussian Process (GP) non-linear autoregressive model, which predicted the on-axis pitch rate, roll rate, yaw rate and heave responses of a Bo105 rotorcraft. A variational sparse GP model was then developed to reduce the computational cost of implementing the approach on large data sets. It was found that both of the GP models were able to provide accurate on-axis response predictions, particularly when the input contained all four control inceptors and one lagged on-axis response term. The predictions made showed improvement compared to a corresponding physics-based model. The reduction of training data to one-third (rotational axes) or one-half (heave axis) resulted in only minor degradation of the GP model predictions.

Spike shape and morphometric characteristics are among the key characteristics of cultivated cereals associated with their productivity. Identification of the genes controlling these traits requires morphometric data at harvesting and analysis of numerous plants, which could be automatically done using technologies of digital image analysis. A method for wheat spike morphometry utilizing 2D image analysis is proposed. Digital images are acquired in two variants: a spike on a table (one projection) or fixed with a clip (four projections). The method identifies spike and awns in the image and estimates their quantitative characteristics (area in image, length, width, circularity, etc.). Section model, quadrilaterals, and radial model are proposed for describing spike shape. Parameters of these models are used to predict spike shape type (spelt, normal, or compact) by machine learning. The mean error in spike density prediction for the images in one projection is 4.61 (~18%) versus 3.33 (~13%) for the parameters obtained using four projections.

Equality and incomparability multi-label ranking have not been introduced to learning before. This paper proposes new native ranker neural network to address the problem of multi-label ranking including incomparable preference orders using a new activation and error functions and new architecture. Preference Neural Network PNN solves the multi-label ranking problem, where labels may have indifference preference orders or subgroups which are equally ranked. PNN is a nondeep, multiple-value neuron, single middle layer and one or more output layers network. PNN uses a novel positive smooth staircase (PSS) or smooth staircase (SS) activation function and represents preference orders and Spearman ranking correlation as objective functions. It is introduced in two types, Type A is traditional NN architecture and Type B uses expanding architecture by introducing new type of hidden neuron has multiple activation function in middle layer and duplicated output layers to reinforce the ranking by increasing the number of weights. PNN accepts single data instance as inputs and output neurons represent the number of labels and output value represents the preference value. PNN is evaluated using a new preference mining data set that contains repeated label values which have not experimented on before. SS and PS speed-up the learning and PNN outperforms five previously proposed methods for strict label ranking in terms of accurate results with high computational efficiency.

This paper presents a study and implementation of a convolutional neural network to identify and recognize humpback whale specimens from the unique patterns of their tails. Starting from a dataset composed of images of whale tails, all the phases of the process of creation and training of a neural network are detailed – from the analysis and pre-processing of images to the elaboration of predictions, using TensorFlow and Keras frameworks. Other possible alternatives are also explained when it comes to tackling this problem and the complications that have arisen during the process of developing this paper.

The prevalence of autism in children in the world is estimated as one per 62 children, higher levels reported in some countries. These children experience significant problems with the development of social, behavioural and verbal and non-verbal communication skills. The skills impairment levels varies from an individual to another and that made teaching autistics a challenge for caregivers such as teachers and relatives. Hence, there are quite a number of frameworks of a software learning systems which focus on gaining the children’s attention using representational visual illustration as a learning method instead of the textual form. However, majority of these tools are lacking the personalisation ability to suite everyone in the spectrum. Assistive technology offers an alternative way to attract children with autism to use. Therefore, this research is proposing Autism Content Management Learning System (ACMLS) Framework to assist caregivers to produce, design and fine-tune or customise the learning materials appropriately so that the system interface and the materials are suitable for every individual in the spectrum according to each child personal profile aiming to make learning attractive and to contribute in improving their social, communication and behavioural skills and nonetheless, their attention level to the delivered educational topics. The ACMLS framework design adopts four main components which are: (1) Design component: which covers the visual design, design principles and the mental model of the children with autism. (2) Technology component: which covers the assistive technology tools and the architecture of the ACMLS system. (3) Education component: Which covers the learning objectives, styles, strategies, methods and the cognitive model. (4) Participants component: which covers the main participants who’re playing a role in the ACMLS framework such as: caregivers and children with autism.

Cognitive neuroscience is the study of how the human brain functions on tasks like decision making, language, perception and reasoning. Deep learning is a class of machine learning algorithms that use neural networks. They are designed to model the responses of neurons in the human brain. Learning can be supervised or unsupervised. Ngram token models are used extensively in language prediction. Ngrams are probabilistic models that are used in predicting the next word or token. They are a statistical model of word sequences or tokens and are called Language Models or Lms. Ngrams are essential in creating language prediction models. We are exploring a broader sandbox ecosystems enabling for AI. Specifically, around Deep learning applications on unstructured content form on the web.

With the digital transformation of the logistics industry, smart logistics algorithms have become a core technology to improve efficiency and reduce costs. This paper reviews the development history of traditional logistics technology and discusses the key role of technologies such as the Internet of Things, big data analysis, artificial intelligence, and automation in logistics technology innovation. It focuses on the application of intelligent logistics algorithms in path optimization, intelligent scheduling, data mining and prediction, and intelligent warehousing. To solve the problem of inconsistency between training and testing objectives, this paper proposes DRL4Route, a deep reinforcement learning-based path optimization framework, and designs the DRL4Route-GAE model. Validated through extensive offline experiments and online deployments, the model significantly outperforms existing optimal benchmark methods on real datasets, improving the location deviation squared metrics and the top-three location prediction accuracy metrics. These research results provide important support to further promote the intelligent development of the logistics industry.

Accurately distinguishing between indolent and aggressive tumors is a crucial unmet need in the clinical management of prostate cancer (PCa). The traditional Gleason grading system has been utilized for this purpose; however, there is often ambiguity in classifying tumors with a Gleason grade of 7. Clinicians commonly resort to using secondary Gleason grades, such as 3+4 or 4+3, to classify these tumors as indolent or aggressive, respectively. Unfortunately, such classifications are prone to misinterpretation, leading to erroneous diagnoses and prognoses. To address this challenge, we investigated the application of Machine Learning (ML) techniques to classify PCa patients based on gene expression data sourced from The Cancer Genome Atlas. By comparing gene expression levels between indolent and aggressive tumors, we sought to identify distinctive features for developing and validating a range of ML algorithms and stacking techniques. The stacking based model achieved an impressive accuracy of 96% for all samples encompassing primary Gleason grades 6 to 10. Notably, when excluding Gleason grade 7 from the analysis, the accuracy further improved to 97%. This study underscores the effectiveness of the stacked ML algorithm for accurately classifying indolent versus aggressive PCa. Leveraging gene expression data and employing a combination of classifiers, this approach offers a powerful solution to address the unmet need in robustly distinguishing between different types of PCa tumors. Future implementation of this methodology may significantly impact clinical decision-making and patient outcomes in the management of prostate cancer.

The use of visual signals in horticulture has attracted significant attention and encompassed a wide range of data types such as 2D images, videos, hyperspectral images, and 3D point clouds. These visual signals have proven to be valuable in developing cutting-edge computer vision systems for various applications in horticulture, enabling plant growth monitoring, pest and disease detection, quality and yield estimation, and automated harvesting. However, unlike other sectors, developing deep learning computer vision systems for horticulture encounters unique challenges due to the limited availability of high-quality training and evaluation datasets necessary for deep learning models. This paper investigates the current status of vision systems and available data in order to identify the high-quality data requirements specific to horticultural applications. We analyse the impact of the quality of visual signals on the information content and features that can be extracted from these signals. To address the identified data quality requirements, we explore the usage of a deep learning-based super-resolution model for generative quality enhancement of visual signals. Furthermore, we discuss how these can be applied to meet the growing requirements around data quality for learning-based vision systems. We also present a detailed analysis of the competitive quality generated by the proposed solution compared to cost-intensive hardware-based alternatives. This work aims to guide the development of efficient computer vision models in horticulture by overcoming existing data challenges and paving a pathway forward for contemporary data acquisition.

The fifth Generation (5G) mobile networks use millimeter Waves (mmWaves) to offer giga bit data rates. However, unlike microwaves, mmWave links are prone to user and topographic dynamics. They easily get blocked and end up forming irregular cell patterns for 5G. This in turn cause too early, too late, or wrong handoffs (HOs). To mitigate HO challenges, sustain connectivity and avert unnecessary HO, we propose a HO scheme based on Jump Markov Linear System (JMLS) and Deep Reinforcement Learning (DRL). JMLS is widely known to account for abrupt changes in system dynamics. DRL likewise emerges as an artificial intelligence technique for learning highly dimensional and time-varying behaviors. We combine the two techniques to account for time-varying, abrupt, and irregular changes in mmWave link behaviour by predicting likely deterioration patterns of target links. The prediction is optimized by meta training techniques that also reduces training sample size. Thus, the JMLS-DRL platform formulates intelligent and versatile HO policies for 5G. Results show our proposed prediction scheme about target link behavior post HO to be highly reliable. The scheme also averts unnecessary HOs thus ably supports longer dew time.

The question of molecular similarity is core in cheminformatics, and is usually assessed via a pairwise comparison based on vectors of properties or molecular fingerprints. We recently exploited variational autoencoders to embed 6M molecules in a chemical space, such that their (Euclidean) distance within the latent space so formed could be assessed within the framework of the entire molecular set. However, the standard objective function used did not seek to manipulate the latent space so as to cluster the molecules based on any perceived similarity. Using a set of some 160,000 molecules of biological relevance, we here bring together three modern elements of deep learning to create a novel and disentangled latent space, viz transformers, contrastive learning, and an embedded autoencoder. The effective dimensionality of the latent space was varied such that clear separation of individual types of molecules could be observed within individual dimensions of the latent space. The capacity of the network was such that many dimensions were not populated at all. As before, we assessed the utility of the representation by comparing clozapine with its near neighbours, and did the same for various antibiotics related to flucloxacillin. Transformers, especially when as here coupled with contrastive learning, effectively provide one-shot learning, and lead to a successful and disentangled representation of molecular latent spaces that at once uses the entire training set in their construction while allowing ‘similar’ molecules to cluster together in an effective and interpretable way.

Infection of liver flukes (Opisthorchis viverrini) is partly due to their suitability for habitats in sub-basin areas, which causes the intermediate host to remain in the watershed system in all seasons. Spatial monitoring of fluke infection at the small basin analysis scale is important because this can enable analysis at the level of the spatial factors involved and influencing infections. The spatial mathematical model was weighted by the nine spatial factors by dividing the analysis into two levels. 1) sub-basin boundary level analyzed with ordinary least square (OLS) model used to analyze spatial factors of liver fluke aimed at analyzing spatial factors related to human liver fluke infection according to sub-basin boundaries, and 2) infection risk positional analysis level with machine learning-based forest classification and regression (FCR) and displaying predictive results of infection risk locations along stream lines. The analysis results show 4 prototype models that import different independent variable factors. The results show that Model-1 and Model-2 give the most AUC = 0.964 and the variables that influence infection risk the most were distance to stream lines, and distance to water bodies, NDMI and NDVI factors rarely affect accuracy. This FCR machine learning application approach can be applied to the analysis of infection risk areas at the sub-basin level, but independent variables must be screened with a preliminary mathematical model weighted to the spatial units in order to obtain the most accurate predictions.

The decreasing width, increasing aspect ratio RDL presents significant challenges to design for reliability (DFR) of advanced package. Therefore, this paper proposes a ML based RDL modeling and simulation method. In the method, RDL is divided into blocks and subdivided into pixels of metal percentage, and the RDL is digitalized as tensors. Then, an ANN-based surrogate model is built and trained by a subset of tensors to predict the equivalent material properties of each block. Lastly, all blocks are transformed into elements for simulations. For validation, line bending simulations were conducted on an RDL, with the reaction force as accuracy indicator. The results show that neglecting layout impact causes critical errors as substrate thins. By the method, the reaction force error is 2.81% and the layout impact can accurately be considered with 200×200 elements. For application, the TCT maximum temperature state simulation was conducted on a CPU chip. The simulation indicates that for advanced package the maximum stress more likely occurs in RDL rather than bumps, both RDL and bumps are critical impacted by layouts, and RDL stress is also impacted by vias/bumps. The proposed method precisely concerns layout impacts with little resources, presents an opportunity of efficiency improvement.

This study aims to evaluate a new approach in modeling gully erosion susceptibility based on deep learning neural network (DLNN) model, ensemble Particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN) and comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shiran watershed, Iran. For this purpose, 13 independent variables affecting gully erosion susceptibility in the study area, including altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from river, land use, soil, lithology, rainfall, , stream power index (SPI), topographic wetness index (TWI), were prepared. Also, 132 gully erosion locations were identified during field visits. Data for modeling were divided into two categories of training (70%) and testing (30%). Receiver operating characteristic (ROC) parameters including sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV) and area under curve (AUC) were used to evaluate the performance of the models. The results showed that, the AUC values from ROC with considering testing datasets of PSO-DLNN is 0.89 and which is associated with superb accuracy. Rest of the models also associated with optimal accuracy and near about PSO-DLNN model; the AUC values from ROC of DLNN, SVM and ANN for testing datasets are 0.87, 0.85 and 0.84 respectively. The PSO algorithm has updated and optimized the weights of DLNN model, and as a result, the efficiency of this model in predicting gully erosion susceptibility has increased. Therefore, it can be concluded that the use of DLNN model and its ensemble with PSO algorithm can be used as a novel and practical method in predicting the susceptibility of gully erosion that helps planners and managers in managing and reducing the risk of this phenomenon.

Machine learning and computer vision have proven to be valuable tools for farmers to streamline their resource utilization to lead to more sustainable and efficient agricultural production. These techniques have been applied to strawberry cultivation in the past with limited success. To build on this past work, in this study two separate sets of strawberry images, along with their associated diseases, were collected and subjected to, resizing, and augmentation. Subsequently, a combined dataset consisting of 9 classes was utilized to fine-tune three distinct pre-trained models: Vision Transformer (ViT), MobileNetV2, and ResNet18. To address the imbalanced class distribution in the dataset, each class was assigned weights to ensure nearly equal impact during the training process. To enhance the outcomes, new images were generated by removing backgrounds, reducing noise, and flipping them. The performances of ViT, MobileNetV2, and ResNet18 were compared after being selected. Customization specific to the task was applied to all three algorithms, and their performances were assessed. Throughout this experiment, none of the layers were frozen, ensuring all layers remained active during training. Attention heads were incorporated into the first 5 and last 5 layers of MobileNetV2 and ResNet18, while the architecture of ViT was modified. The results indicated accuracy factors of 98.4%, 98.1%, and 97.9% for ViT, MobileNetV2, and ResNet18, respectively. Despite the data being imbalanced, the precision, which indicates the proportion of correctly identified positive instances among all predicted positive instances, approached nearly 99% with the ViT. MobileNetV2 and ResNet18 demonstrated similar results. Overall, the analysis revealed that the Vision Transformer model exhibited superior performance in strawberry ripeness and disease classification. The inclusion of attention heads in the early layers of ResNet18 and MobileNet18, along with the inherent attention mechanism in ViT, improved the accuracy of image identification. These findings offer the potential for farmers to enhance strawberry cultivation through passive camera monitoring alone, promoting the health and well-being of the population.

Deep learning is emerging in many industrial sectors in hand with big data analytics to streamline production. In the biomanufacturing sector, big data infrastructure is lagging comparatively to other industries. A promising approach is to combine Deep Neural Networks (DNN) with prior knowledge in Hybrid Neural Network (HNN) workflows that are less dependent on the quality and quantity of data. This paper reviews published articles over the past 30 years on the topic of HNN applications to bioprocesses. It revealed that HNNs were applied to various bioprocesses, including microbial cultures, animal cells cultures, mixed microbial cultures, and enzyme biocatalysis. HNNs were mainly applied for process analysis, process monitoring, development of software sensors, open- and closed-loop control, batch-to-batch control, model predictive control, intensified design of experiments, quality-by-design, and recently for the development of digital twins. Most previous HNN studies combined shallow Feedforward Neural Networks (FFNNs) with physical laws, such as macroscopic material balance equations, following the semiparametric design principle. Only recently, deep HNNs based on deep FFNNs, Convolution Neural Networks (CNN), Long Short-Term Memory (LSTM) networks and Physics Informed Neural Networks (PINNs) have been reported. The biopharma sector is currently a major driver but applications to biologics quality attributes, new modalities, and downstream processing are significant research gaps.

In recent years, intelligent identification and prediction of ore deposits based on deep learning algorithm and image processing technology has gradually become one of the research frontiers in the field of geological and metallogenic prediction. However, this method also has many problems that need to be solved. For example, (1) very few trainable image samples containing mineral point labels; (2) The geological image features are small and irregular, and the image similarity is high; (3) It is difficult to calculate the influence of different geological prospecting factors on ore mineralization. Based on this, this paper constructs a deep learning network model Multiscale Feature Attention Framework (MFAF) based on geo-image data. The results show that MFCA-Net module in MFAF model can solve the problem of scarce mine label images to a certain extent. In addition, the channel attention mechanism SE-Net module can quantify the difference of influence of different source factors on mineralization. The prediction map is obtained by applying the MFAF model in the study of deposit identification and prediction in the research area of the southern section of Qin-hang metallogenic Belt. In the forecast map, many regions have high metallogenic potential. Through observation, it is found that the above predicted area covers 100% of the known ore deposits at present, which has a good prediction effect. Later, we can find out the specific reasons through field verification. The multi-scale feature fusion and attention mechanism MFA Framework in this paper can provide a new way of thinking for geologists in mineral exploration. The research of this paper also provides resource guarantee and technical support for the sustainable exploitation of mineral resources and the sustainable growth of society and economy.

With the exponential growth of machine learning and development of Artificial Neural Network (ANNs) in recent years, there is great opportunity to leverage this approach and accelarate bio-logical discoveries through applications on the analysis of bioinformatics data. Various types of datasets including for example protein or gene interaction networks, molecular structures and cellular signalling pathways, have already been used for machine learning by training ANNs for inference and pattern classification. However, unlike regular data structures that are commonly used in the computer science and engineering fields, bioinformatics datasets present challenges that require unique algorithmic approaches. The recent development of the geometric and deep learning approach within the machine learning field, is very promising towards accelerating analysis complex bioinformatics datasets. The principles of ANNs and their importance for bio-informatics machine learning is demonstrated herein, through presentation of the undelying mathematical and statistical foundations from group theory, symmetry, linear algebra. Further-more, the structure and functions of ANN algorithms that form the core principles of artificial intelligence are explained, in relation to the bioinformatics data domain. Overall, the manuscript provides guidance for researchers to understand the principles required for practicing machine learning and artificial intelligence, with the special considerations towards bioinformatics applications.

A large amount of data is produced every day by stakeholders of the Air Traffic Management (ATM) system, in particular airline operators, airports, and air navigation service provider (ANSP). Most data is kept private for many reasons, including commercial and security concerns. More than data, shared information is precious, as it leverages intelligent decision-making support tools designed to smooth daily operations. We present a framework to detect, identify and characterise anomalies in past aircraft trajectory data. It is based on an open source of ADS-B based aircraft trajectories, and extracted information can benefit a wide range of stakeholders: Air Traffic Control (ATC) training centres could play more realistic simulations; ANSP may improve capacity indicators; academics improve safety models and risk estimations; and commercial stakeholders, like airlines and airports, may use such information to improve short-term predictions and optimise their operations. The technique is based on autoencoding artificial neural networks applied on flows of trajectories, which provide a useful reading grid associating cluster analysis with quantified level of abnormality. In particular, we find that the highest anomaly scores correspond to poor weather conditions, whereas anomalies with a lower score relate to ATC tactical actions.

Falls are extremely damaging to the elderly. The number of elderly who have experienced falls has increased over the years, several of the elderly stay alone or in in badly maintained elderly homes. This makes a low-cost fall detection system a necessity. There has been huge improvements in terms of IoT systems, ML algorithms. Varied data sets have been collected across the world for fall detection. These data sets have a very little in common among them, in terms of user demographics, sensors used, the ADL and Fall activities Hence in this paper we present a data set that has wide user demographics, we used various sensors – such as accelerometer, gyroscope, magnetometer and hear rate. We used wrist worn sensors to collect data. In this paper we present a detailed analysis of the data set we collected using common ML algorithms such as – Naïve Bayes (NB), K Nearest Neighbor (KNN), Logistic Regression (LR), Random Forest (RF) and Support Vector Machines (SVM). We analyzed the performance of these algorithms for variations in accuracy with respect to age, gender, height, weight and health issues and we have identified outliers by analyzing each incorrect prediction. This paper provides the complete details of the data collection methodology, The methods used for analysis and presents the results of analysis in complete detail.

Log collection and storage is a crucial process for enterprises around the globe. Log analysis helps identify potential security breaches and, in some cases, is required by law for compliance. However, enterprises often delegate these responsibilities to third-party Cloud Service Providers (CSPs), where the logs are collected and processed for anomaly detection and stored in a data warehouse for archiving. Prevalent schemes rely on plain (unencrypted) data for anomaly detection. More often, these logs can reveal sensitive information about an organization or the customers of that organization. Hence, it is best to keep it encrypted at all times. This paper presents "SigML++," an extension of work done in "SigML." We utilize Fully Homomorphic Encryption (FHE) with the Cheon-Kim-Kim-Song (CKKS) scheme for supervised log anomaly detection on encrypted data. We use an Artificial Neural Network (ANN) based probabilistic polynomial approximations using a Perceptron with linear activation. We probabilistically approximate the Sigmoid activation function (σ(x)) in the encrypted domain for the intervals [−10,10] and [−50,50]. Experiments show better approximations for Logistic Regression (LR) and Support Vector Machine (SVM) for low-order polynomials.

Abstract: As the policies and regulations currently in place concentrate on environmental protection and greenhouse gas reduction, we are steadily witnessing a shift in the transportation industry towards electromobility. There are, though, several issues that need to be addressed to encourage the adoption of EVs at a larger scale. To this end, we propose a solution capable of addressing multiple EV charging scheduling issues, such as congestion management, scheduling a charging station in advance, and allowing EV drivers to plan optimized long trips using their EVs. The smart charging scheduling system we propose considers a variety of factors such as battery charge level, trip distance, nearby charging stations, other appointments, and average speed. Given the scarcity of data sets required to train the Reinforcement Learning algorithms, the novelty of the recommended solution lies in the scenario simulator, which generates the labelled datasets needed to train the algorithm. Based on the generated scenarios, we created and trained a neural network that uses a history of previous situations to identify the optimal charging station and time interval for recharging. The results are promising and for future work we are planning to train the DQN model using real-world data.

Efficient textual data distributions (TDD) alignment and generation are open research problems in textual analytics and NLP. It is presently difficult to parsimoniously and methodologically confirm that two or more natural language datasets belong to similar distributions, and to identify the extent to which textual data possess alignment. This study focuses on addressing a segment of the broader problem described above by applying multiple supervised and unsupervised machine learning (ML) methods to explore the behavior of TDD by (i) topical alignment, and (ii) by sentiment alignment. Furthermore we use multiple text generation methods including fine-tuned GPT-2, to generate text by topic and by sentiment. Finally we develop a unique process driven variation of Kullback-Leibler divergence (KLD) application to TDD, named KL Textual Distributions Contrasts (KL-TDC) to identify the alignment of machine generated textual corpora with naturally occurring textual corpora. This study thus identifies a unique approach for generating and validating TDD by topic and sentiment, which can be used to help address sparse data problems and other research, practice and classroom situations in need of artificially generated topic or sentiment aligned textual data.

Selective mutism (SM) is an “Anxiety Disorder” characterized by a child’s “persistent inability” to communicate verbally in some (or all) contexts of social life that is associated with other cognitive-affective disorders. Cognitive-behavioural assessment and psychological intervention may be complex to be performed due to both the difficulty to administered standardized neuropsychological batteries (e.g., language-mediated tests) and the difficulty to involve family and teachers in the intervention program, respectively. Here, a single-case study is described in which a female Filipina child with SM underwent a comprehensive neuropsychological assessment and multimodal therapeutical intervention between the ages of 7 to 11 years. More specifically, the psychological intervention included cognitive-behavioral psychotherapy to both improve social-cognitive skills and learning abilities and to reduce anxiety, and speech therapy. Moreover, the parents and teachers were actively involved in the therapeutic process and they were also administered a psycho-education program. After this specific treatment, at the age of 11 years the girl began to verbalize in both therapy and school contexts, although she still was used to adopt non-verbal strategies. A parallel and gradual improvement in communicative-linguistic skills and school learning was also observed. In conclusion, the present report highlights the importance to apply an "integrated and multimodal intervention" to treat SM in children that includes also psycho-education intervention for both parents and teachers.

Aiming at the prediction of environmental vibrations induced by elevated high-speed railway, a machine-learning method is developed by combining random forest algorithm and Bayesian optimization, which using the dataset from on-site experiments . When it comes to achieving a rapid and effective prediction of environmental vibration, there is few research on com-parisons and verifications of different algorithms, and neither on parameter tuning and optimi-zation of machine learning algorithms. In this paper, a field experiment is firstly carried out to measure the ground vibrations caused by high-speed trains running on bridge, and then the en-vironmental vibration characteristics are analyzed in view of ground accelerations and weighted vibration levels. Subsequently, three machine-learning algorithms of linear regression, support vector machine and random forest are developed by using experimental database, and their prediction performance are discussed. Finally, two optimization models for the hyperparameter set of random forest algorithm are further compared. It turns out that the integrated random forest algorithm has higher accuracy in predicting environmental vibration than linear regression and support vector machine; the Bayesian optimization has excellent performance and high efficiency in achieving efficient and in-depth optimization of parameters, and can be combined with the RF machine learning algorithm to effectively predict the environmental vibrations induced by the high-speed railway.

Despite widespread vaccination, early treatments, and improved understanding of the disease, the effects of SARS-CoV-2 infection remain significant worldwide. Many patients still suffer from severe COVID-19, necessitating admission to intensive care units. Remdesivir is a primary treatment option among viral RNA polymerase inhibitors for hospitalized SARS-CoV-2 patients. However, there is a lack of studies examining factors influencing its effectiveness in this context. We conducted a retrospective study throughout 2022, analyzing clinical, laboratory, and sociodemographic data from 252 hospitalized COVID-19 patients treated with remdesivir. Six machine learning algorithms were compared and validated to predict factors associated with the loss of clinical benefit from remdesivir in terms of mortality and hospital stay. Data were extracted from electronic health records. The eXtreme Gradient Boost (XGB) method achieved the highest balanced accuracy for both mortality (95.45%) and hospital stay (94.24%). Factors associated with worse outcomes of remdesivir use in terms of mortality included limitation of life support treatment, need for ventilatory support (especially invasive mechanical ventilation) on day 14 after the first dose of remdesivir, lymphopenia, low levels of albumin and hemoglobin, presence of flu and/or coinfection, and cough. Factors associated with worse outcomes of remdesivir use in terms of hospital stay included the number of doses of the COVID-19 vaccine, patchy lung density, bilateral pulmonary radiological status, number of comorbidities, oxygen therapy, troponin and lactate dehydrogenase levels, and asthenia. These findings highlight the effectiveness of XGB as a strong candidate for accurately categorizing COVID-19 patients undergoing remdesivir treatment.

It is unavoidable that the characteristics of the robot system alter inexactly or cannot be correctly determined during movement and are impacted by external disturbances. There are many adaptive control methods, such as sliding control or neural control, to improve the quality of trajectory tracking for robot motion systems. Still, those methods require a large amount of computation related to solving the problem of constrained nonlinear optimization problem. The article presents some techniques for determining an intelligent controller's online learning function parameters, including two circuits: the inner circuit is a state feedback linearized controller, and the outer course is an Interactive learning controller and does not use the robot's mathematical mode with function parameters online optimal learning and intelligent online learning closely following the joint model to stabilize the robot system. Finally, the 2-DOF planar robot simulation is performed on Matlab software R2022b. The findings indicate that outstanding tracking performance is achievable.

In recent decades, attention has been directed at anemia classification for various medical purposes, such as thalassemia screening and predicting iron deficiency anemia (IDA). In this study, a new method has been successfully tested for discrimination between IDA and β-thalassemia trait (β-TT). The method is based on a Dynamic Harmony Search (DHS). Complete blood count (CBC), a fast and inexpensive laboratory test, is used as the input of the system. Other models, such as a genetic programming method called structured representation on genetic algorithm in non-linear function fitting (STROGANOFF), an artificial neural network (ANN), an adaptive neuro-fuzzy inference system (ANFIS), a support vector machine (SVM), k-nearest neighbor (KNN), and certain traditional methods, are compared with the proposed method.

E-tourism is one of the most important modern services to achieve the development of the tourism sector while relying on sophisticated communication technologies. Certainly, these innovations in the field of tourism have disrupted this sector with new and different dimensions of tourism development. This has led various regions and countries to accelerate the search for the tools that are necessary to achieve excellence and sustainable development in tourism. This research aims to study the development factors of e-tourism to achieve excellence and sustainable development in the tourism of the Ha’il region. Therefore, we applied two analyses: in the first one, we used a statistical analysis based on the survey sent to employees from tourism companies. The objective of this analysis is to determine the main factors of e-tourism to achieve excellence in tourism in the Ha’il region. The results of the statistical analysis have given us the following elements: There are only four main factors that allow authorities to achieve excellence in tourism in the Ha’il region, namely ST, CP, HRS, and SC factors. Then we proceed with a second analysis, to determine the main factors of excellence in tourism that drive the achievement of sustainable development in tourism in the Ha’il region. For this reason, we applied an artificial intelligence method based on the unsupervised machine learning technique. The results obtained from the machine learning technique show that five factors determine the excellence in tourism and reveal the sustainable development of Ha’il’s tourism. These factors are ST, CP, FP, HRS, and GC. Consequently, we consider that all the factors found in both analyses are important to realise excellence in tourism and sustainable development in tourism. However, to achieve sustainable development in tourism in Ha’il, Saudi authorities must develop the three common factors found in the two analyses, namely ST, CP, and HRS.

Predictions of crop production in the Chi basin are of major importance for decision support tools in countries such as Thailand, which aim to increase domestic income and global food security by implementing the appropriate policies. This research aims to establish a predictive model for predicting crop production for an internal crop growth season prior of harvest at the province scale for fourteen provinces in Thailand's Chi basin between 2011 and 2019. We provide approaches for reducing redundant variables and multicollinearity in remotely sensed (RS) and meteorological data to avoid overfitting models using correlation analysis (CA) and variance inflation factor (VIF). Temperature condition index (TCI), normalized difference vegetation index (NDVI), land surface temperature (LSTnight), and mean temperature (Tmean) were the resulting variables in the prediction model with a p-value &lt; 0.05 and a VIF &lt; 5. The baseline data (2011–2017: June to November) were used to train four regression models, which revealed that eXtreme Gradient Boosting (XGBoost), random forest (RF), and XGBoost achieved R2 values of 0.95, 0.94, and 0.93, respectively. In addition, the testing dataset (2018–2019) displayed a minimum root mean square error (RMSE) of 0.18 ton/ha for the optimal solution by integrating variables and applying the XGBoost model. Accordingly, it is estimated that between 2020 and 2022, the total crop production in the Chi basin region would be 7.88, 7.64, and 7.72 million tons, respectively. The results demonstrated that the proposed model is proficient at greatly improving crop yield prediction accuracy when compared to a conventional regression method and that it may be deployed in different regions to assist farmers and policymakers in making more informed decisions about agricultural practices and resource allocation.

The visual perception of leisure spaces between residences in cold regions is important for public health. To compensate for the existing researches` lack of ignoring the cold snow season`s influence, this study selected two types of outdoor leisure space environments in non-snow and snow seasons as research objects. An eye tracker combined with a Semantic Difference (SD) questionnaire was used to verify the feasibility of the application of virtual reality technology, screen out leisure gaze characteristics, and reveal the environmental factors related to leisure visual perception. In snow season, spatial aspect ratio (SAR), building elevation saturation (BS), and grass proportion in the field of view (GP) showed strong correlation to the leisure visual perception scores (W). In non-snow season, apart from the above three factors, roof height difference (RHD), tall tree height (TTH) and color contrast (HC) also influenced W obviously. The effects of factors on W were revealed in immersive virtual en-vironment (IVE) orthogonal experiments and genetic algorithm (GA) and k-nearest neighbor algorithm (KNN) were combined to optimized the environmental factors. The optimized threshold ranges in the non-snow season environment were SAR: 1.82‒2.15, RHD: 10.81 m‒20.09 m, BS: 48.53‒61.01, TTH: 14.18 m‒18.29 m, GP: 0.12‒0.15, and HC: 18.64‒26.83. In the snow season environment, the optimized threshold ranges were SAR: 2.22‒2.54, BS: 68.47‒82.34, and GP: 0.1‒0.14.

The global Covid-19 crisis has seen the push for many education institutions substituting traditional classroom learning to online platforms. This change in the learning experience has been expected to cause major and likely unequal interruption not only in students’ learning, but their well-being overall. Given this, the present study aims to investigate how online or open distance learning, implemented during times of a health crisis, impacted the mental well-being of UiTM students. The study was conducted via an online survey and an online group discussion during the last week of online classes between 29th June to 1st July 2020. Following research on negative emotional states, the short form of the Depression Anxiety Stress Scales (DASS-21) was included in the survey. Results indicate that students experienced varying levels of negative emotions, specifically feeling anxious over situations that might cause panic, feeling emotionally sensitive as well as feeling less motivated to do things. Discussions include how the government of Malaysia needs to ensure for students to be equipped with the right amenities that will offer a smoother ODL experience and that educational institutions provide their stakeholders with clear information so that students can make a more informed choice about their education.

The paper portrays predictive models for dissolved oxygen (DO) levels in an urban lake using common water quality parameters like Temperature, pH, Conductivity and ORP at a time. Data were sampled using three real-time, industry-standard sensors, OPTOD, CTZN, and PHEHT, and then interpolated using the ArcGIS kriging technique. Correlation studies were analyzed through the ML algorithm, the correlation study signified a highly positive correlation between DO and other water parameters and the model was corroborated by R-score in order to create the linear regression model. In addition, an artificial neural network- a machine learning method using the Levenberg-Marquardt algorithm was developed to build a model to predict the do as well. Then, the performance of the models was validated and also the R² accuracy was checked of the predicted data against the actual data. Thus, the appropriateness of the ANN model for the forecasting of investigated attributes is indicated by the fact that the discrepancy between the forecasted and real ANN model is significantly lesser than that of the regression model. However, the model can be used to reveal DO data from unknown urban lake water.

With the rapid expansion of intelligent resource-constrained devices and high-speed communication technologies, Internet of Things (IoT) has earned a wide recognition as the primary standard for low-power lossy networks (LLNs). Nevertheless, IoT infrastructures are vulnerable to cyber-attacks due to the constraints in computation, storage, and communication capacity of the endpoint devices. From one side, the majority of newly developed cyber-attacks are formed by slightly mutating formerly established cyber-attacks to produce a new attack tending to be treated as a normal traffic through the IoT network. From the other side, the influence of coupling the deep learning techniques with cybersecurity field has become a recent inclination of many security applications due to their impressive performance. In this paper, we provide a comprehensive development of a new intelligent and autonomous deep learning-based detection and classification system for cyber-attacks in IoT communication networks leveraging the power of convolutional neural networks, abbreviated as (IoT-IDCS-CNN). The proposed IoT-IDCS-CNN makes use of the high-performance computing employing the robust CUDA based Nvidia GPUs and the parallel processing employing the high-speed I9-Cores based Intel CPUs. In particular, the proposed system is composed of three subsystems: Feature Engineering subsystem, Feature Learning subsystem and Traffic classification subsystem. All subsystems are developed, verified, integrated, and validated in this research. To evaluate the developed system, we employed the NSL-KDD dataset which includes all the key attacks in the IoT computing. The simulation results demonstrated more than 99.3% and 98.2% of cyber-attacks’ classification accuracy for the binary-class classifier (normal vs anomaly) and the multi-class classifier (five categories) respectively. The proposed system was validated using k-fold cross validation method and was evaluated using the confusion matrix parameters (i.e., TN, TP, FN, FP) along with other classification performance metrics including precision, recall, F1-score, and false alarm rate. The test and evaluation results of the IoT-IDCS-CNN system outperformed many recent machine-learning based IDCS systems in the same area of study.

In this study, we propose a scalable deep learning approach to automated phenotyping using UAV multispectral imagery, exemplified by yellow rust detection in winter wheat. We adopt a high granularity scoring method (1 to 9 scale) to align with international standards and plant breeders’ needs. Using a lower spatial resolution (60m flight height at 2.5cm GSD), we reduce the data volume by a factor of 3.4, making large-scale phenotyping faster and more cost-effective while obtaining results comparable to those of the state-of-the-art. Our model incorporates explainability components to optimise spectral bands and flight schedules, achieving top-3 accuracies of 0.87 for validation and 0.67 and 0.70 on two separate test sets. We demonstrate that a minimal set of bands (EVI, Red, and GNDVI) can achieve results comparable to more complex setups, highlighting the potential for cost-effective solutions. Additionally, we show that high performance can be maintained with fewer time steps, reducing operational complexity. Our interpretable model components improve performance through regularisation and provide actionable insights for agronomists and plant breeders. This scalable and explainable approach offers an efficient solution for yellow rust phenotyping and can be adapted for other phenotypes and species, with future work focusing on optimising the balance between spatial, spectral, and temporal resolutions.

Water distribution networks are often susceptible to pipeline leaks caused by mechanical damages, natural hazards, corrosion, and other factors. This paper focuses on the detection of leaks in water distribution networks (WDN) using a data-driven approach based on machine learning. A hybrid Autoencoder neural network (AE) is developed, which utilizes unsupervised learning to address the issue of unbalanced data (as anomalies are rare events). The AE consists of a 3DCNN encoder, a ConvLSTM decoder, and a ConvLSTM future predictor, making the anomaly detection robust. Additionally, spatial, and temporal attention mechanisms are employed to enhance leak localization. The AE first learns the expected behavior and subsequently detects leaks by identifying deviations from this expected behavior. To evaluate the performance of the proposed method, the Water Network Tool for Resilience (WNTR) Simulator is utilized to generate water pressure and flow rate data in a water supply network. Various conditions such as fluctuating water demands, data noise, and the presence of leaks are considered using the pressure-driven demand (PDD) method. Datasets with and without pipe leaks are obtained, where the AE is trained using the dataset without leaks and tested using the dataset with simulated pipe leaks. The results, based on a benchmark WDN and a confusion matrix analysis, demonstrate that the proposed method successfully identifies leaks in 96% of cases and a false positive rate of 4% compared to a random forest model baseline based on supervised learning with a false positive rate of 15% due to unbalanced data. Furthermore, a real case study demonstrates the applicability of the developed model for leak detection in operational conditions of water supply networks using inline sensor data.

Indoor localization (IL) is a significant topic of study with several practical applications. The area of IL has evolved greatly in recent years due to the introduction of numerous technologies such as WiFi, Bluetooth, cameras, and other sensors. Despite the growing interest in this field, there are numerous challenges and drawbacks that must be addressed to develop more accurate and sustainable systems for IL and its real-life applications. This review study gives an in-depth look into IL, covering the most promising artificial intelligence-based and hybrid strategies that have shown excellent potential in overcoming some of the limitations of classic methods. In addition, the paper investigates the significance of high-quality datasets and evaluation metrics in the design and assessment of IL algorithms. Furthermore, this overview study emphasizes the crucial role that machine learning techniques, such as deep learning and transfer learning, play in the advancement of IL. A focus on the importance of IL and the various technologies, methods, and techniques that are being used to improve it. Finally, The survey highlights the need for continued research and development to create more accurate and scalable techniques that can be applied across a range of industries, such as evacuation-egress routes, hazard-crime detection, smart occupancy-driven energy reduction and asset tracking and management.

Prediction of crop yield is essential for food security policymaking, planning, and trade. The objective of the current study is to propose novel crop yield prediction models based on hybrid machine learning methods. In this study, the performance of artificial neural networks-imperialist competitive algorithm (ANN-ICA) and artificial neural networks-gray wolf optimizer (ANN-GWO) models for the crop yield prediction is evaluated. According to the results, ANNGWO, with R of 0.48, RMSE of 3.19, and MEA of 26.65, proved a better performance in the crop yield prediction compared to the ANN-ICA model. The results can be used by either practitioners, researchers or policymakers for food security.

We introduce a total energy and environmental evaluation method in the manufacturing industry. The method gives us a series of descriptive indexes to assess the overall environmental effect level on materials, energy, wastes and products in the life cycle process. Meanwhile, the method uses partial indexes, environmental effect factors, and correction offsets into the quantitative model to analyze the learning process and rebound effect on the energy and environment at each procedure. In this work, we choose S-shaped learning curves to describe how to decrease energy consumption and improve the technical learning by doing for recent 30 years. Also, we draw the different rebound effect curves of the total energy-environmental evaluation with technical learning method, which use the annual industrial production growth rate to show that it's significant to estimate its effect on technology changes. The ideas about the interaction of energy and production environment from material flows to energy consumption, direct us to build an example to estimate quantitatively the results with different condition factors, and realize the process improvement and develop new products.

Optical networks are prone to power jamming attacks intending service disruption. This paper presents a Machine Learning (ML) framework for detection and prevention of jamming attacks in optical networks. We evaluate various ML classifiers for detecting out-of-band jamming attacks with varying intensities. Numerical results show that artificial neural network is the fastest ($10^6$ detection per second) for inference and most accurate ($\approx 100 \%$) in detecting power jamming attacks as well as identifying the optical channels attacked. We also discuss and study a novel prevention mechanism when the system is under active jamming attacks. For this scenario, we propose a novel resource reallocation scheme that utilizes the statistical information of attack detection accuracy to lower the probability of successful jamming of lightpaths while minimizing lightpaths' reallocations. Simulation results show that the likelihood of jamming a lightpath reduces with increasing detection accuracy, and localization reduces the number of reallocations required.

The combination of new-generation information technology and manufacturing technology has resulted in major and profound impact on future development paradigm of manufacturing. It is challenging for existing methods to conduct a multidimensional trend exploration related to machine tool domain, which is the basis of virtually everything in manufacturing. In this paper, we proposed an integrating approach framework combined topic models, bibliometric, trend analysis and patent analysis to mine insightful information about future development from multi-source data related to machine tool, such as papers, grants, patents and news. Specifically, papers and grants provided two different perspectives to explore the current focuses and future trends in machine tool research. Furthermore, the future technology development of machine tool was investigated through patents analysis. Finally, news related to machine tool industry in recent years was analyzed to analyze future machine tool business mode. The integration of the above various analytical methods and the multi-dimensional mining of literatures enabled the analysis of the future development of machine tool domain systematically from multi-perspectives which include research, technology development and industry. The conclusions obtained in this paper is beneficial to different communities of machine tool in terms of determining the research directions for researchers, identifying industry opportunities for corporations and developing reasonable industry policy for policy makers.

World Health Organization (WHO) has announced the monkeypox (MPX) epidemic a global public health emergency due to its re-emergence, remarkable increase in the number of MPX cases worldwide, and its potential spread. This paper introduces the symptoms, complications, and features of MPX; its transmission, diagnosis and testing, vaccines and treatment; MPX and sexually transmitted diseases, especially the human immunodeficiency virus (HIV); possible natural hosts or reservoirs of the monkeypox virus (MPXV). A useful tool for MPX and surgical safety recommendations are presented. The challenges in fighting the MPX epidemic, One Health strategy, and future research are discussed.

This study explores advanced feature engineering and semantic enrichment methods to enhance text classification, focusing on detecting figurative language in tweets. The novel features introduced, Syno\_Lower\_Mean and Syn\_Mean, measure the use of uncommon synonyms and the mean frequency of synonyms, capturing semantic richness crucial for detecting figurative expressions. Using resources like SenticNet and Framester, we enrich our feature set with sentiment and frame semantic information. Our approach includes extensive data preprocessing, sophisticated feature selection, and implementing various classification models, such as SVM, KNN, Logistic Regression, Decision Trees, Random Forest, BERT, and LSTM networks. We rigorously evaluate each model's performance to assess the effectiveness of our features and enrichment methods. Putting emphasis on model explainability, we use decision tree analysis, feature importance analysis, and the TREPAN algorithm to approximate SVM decisions. Although we focus on figurative language detection, our methods have broader implications for various NLP text classification tasks. Our findings demonstrate significant improvements in classification accuracy and interpretability through innovative feature design and dataset enrichment.

Automatic emotion recognition using portable sensors is gaining attention due to its potential use in real-life scenarios. Existing studies have not explored Galvanic Skin Response and Photoplethysmography sensors exclusively for emotion recognition using nonlinear features with machine learning (ML) classifiers such as Random Forest, Support Vector Machine, Gradient Boosting Machine, K-Nearest Neighbor, and Decision Tree. In this study, we proposed a genuine window sensitivity analysis on a continuous annotation dataset to determine the window duration and percentage of overlap that optimize the classification performance using ML algorithms and nonlinear features, namely Lyapunov Exponent, Approximate Entropy, and Poincaré’s indices. We found an optimum window duration of 11 seconds and 16 seconds for valence and arousal, respectively, with 50% overlap, and achieved an accuracy of 0.76 in both dimensions. In addition, we proposed a Strong Labeling Scheme that kept only the extreme values of the labels, which raised the accuracy score to 0.92. Under certain conditions mentioned, traditional ML models offer a good compromise between performance and low computational cost. Our results suggest that well-known ML algorithms can still contribute to the field of emotion recognition, provided that window duration, overlap percentage, and nonlinear features are carefully selected.

Surface water plays a crucial role in climate change, human production, and life, making accurate monitoring and observation of surface water particularly important. However, due to the significant diversity and complexity of water distribution in surface space, accurate mapping of surface water faces considerable challenges. When extracting water bodies from medium-resolution satellite remote sensing images, CNN methods may suffer from limitations in receptive fields and insufficient context modeling capabilities, leading to the loss of water body boundary details and poor fusion of multiscale features. Currently, there is relatively little research on this issue; therefore, it is necessary to explore new combinations of deep learning networks to address these challenges. The purpose of this study is to address the above issues. We propose a new combination of deep learning networks that fully utilize multiscale information to enhance water features. Specifically, we first combine deformable convolutions with the Swin Transformer to increase effective receptive fields while better integrating global semantic information. This combination can capture features of water bodies at different scales, improve the accuracy and integrity of water extraction, and provide reliable technical support for detailed water body extraction. We tested the newly constructed model using Sentinel-2 satellite images. Our model achieved results of over 90%, with an average accuracy of 97.89%, average precision of 94.98%, average recall of 90.05%, and an average F1 score of 92.33%. In addition, our model achieved an accuracy of 98.03% in mountainous areas. Our experiments and results validate the potential of combining the Swin Transformer and deformable convolutions in detailed water body extraction.

Bacterial infections and resistance to antibiotic drugs represent the highest challenges to public health. The search for new and promising compounds with anti-bacterial activity is a very urgent matter. In order to promote the development of platforms enabling to the discovery of compounds with anti-bacterial activity, Fourier Transformed Mid-Infrared (FT-MIR) spectroscopy associated with the machine learning algorithms were used to predict the impact of compounds extracted from Cynara cardunculus against Escherichia coli cells. According to the plant tissue (seeds, dry and fresh leaves, and flowers) and the solvents (ethanol, methanol, acetone, ethyl acetate, and water), compounds with different compositions concerning, phenol content, antioxidant, and antimicrobial activity were obtained. Principal component analysis of spectra, allowed to discriminate compounds that inhibit the E. coli growth, according to the conventional assay. The supervised classification models enabled the prediction of the compound's impact on the E. coli growth, with the accuracy for the test data: Partial least squares-discriminant analysis of 94%; Support vector machines of 89%; k-Nearest neighbor of 72%; and a Backpropagation network of 100%. According to the promising results, the integration of FT-MIR spectroscopy with machine learning presents a high potential to promote the discovery of new compounds with antibacterial activity, thereby streamlining the drug exploratory process.

The health and stability of trees are essential information for the safety of people and property in urban greenery, parks or along roads. The stability of the trees is linked to root stability but essentially also to trunk decay. Currently used internal tree stem decay assessment methods, such as tomography or penetrometry, are reliable but usually time-consuming and unsuitable for large-scale surveys. Therefore, a new method based on close-range remote sensed data, specifically close-range photogrammetry and iPhone LiDAR, was tested to detect decayed standing tree trunks automatically. The proposed study used the PointNet deep learning algorithm for 3D data classification. It was verified in three different datasets consisting of pure coniferous trees, pure deciduous trees or mixed data to eliminate the influence of the detectable symptoms for each group and species itself. The mean achieved validation accuracies of the models were 65.5 % for Coniferous trees, 58.4 % for Deciduous trees and 57.7 % for Mixed data classification. The accuracies indicate promising data, which can be either used by practitioners for preliminary surveys or for other researchers to acquire more input data and create more robust classification models.