The essence of cross-modal generation and retrieval modeling for image-text interactions lies in semantic consistency. Among these, cross-modal representation alignment serves as the foundational requirement for achieving cross-modal semantic consistency. The crux of our proposed method entails the collaborative training of an image captioning model(referred to as the ’captioner’) and a pair of contrastive encoders for image-text matching(referred to as the ’concoder’). This synergistic approach yields concurrent enhancements in concoder’s performance, captioner’s proficiency, and cross-modal semantic coherence. We coin the proposed method as ‘ReCap’. To begin, we initialize the concoder through knowledge distillation from a pre-trained model. During the training process, we use the output of the initialized concoder as input to a residual attention network, jointly training it with the captioner to achieve semantic consistency. Subsequently, we iteratively update the concoder during the image-text momentum encoding phase using the residual attention network, creating a closed-loop for semantic consistency resolution. Upon completion of training, the concoder and captioner modules can be used independently to perform tasks related to cross-modal retrieval and cross-modal generation of text and images. In order to substantiate the efficacy of our proposed method, we initially conducted empirical experiments encompassing image-text retrieval and image captioning tasks, employing a widely recognized benchmark dataset, MSCOCO. Subsequently, we assessed the fine-grained cross-modal alignment performance of the concoder through an image classification task on the iNaturalist 2018 dataset. The achieved performance metrics notably surpassed those achieved by several incumbent state-of-the-art models, thus validating the proficiency of our method. Finally, motivated by the practical requirements of handling the nature conservation image data, we performed caption annotation for the iNaturalist 2018 dataset. Subsequently, we trained the ReCap on this annotated data. Experimental results demonstrate that our proposed method can maintain semantic consistency between cross-modal retrieval and image caption generation for species with similar visual features but distinct semantics. This achievement signifies a meaningful exploration in the field of cross-modal semantic consistency representation, holding significant practical value in the domain of biological research.

The exponential growth of multimodal content across social media platforms, comprising text, images, audio, and video, has catalyzed substantial interest in artificial intelligence, particularly in multi-modal sentiment analysis (MSA). This study presents a comprehensive survey of 30 research papers published between 2020 and 2024 by eminent publishers such as Elsevier, ACM, IEEE, Springer, and others indexed in Google Scholar. Our analysis primarily focuses on exploring multimodal fusion techniques and features, with specific emphasis on the integration of text and image data. Additionally, the article offers an overview of the evolution, definition, and historical context of MSA. It delves into the current challenges and potential advantages of MSA, investigating recent datasets and sophisticated models. Furthermore, the study provides insights into prospective research directions. Notably, this review offers valuable recommendations for advancing research and developing more robust MSA models, thus serving as a valuable resource for both academic and industry researchers engaged in this burgeoning field.

With the proliferation and development of social media platforms, social media data has become an important source for acquiring spatio-temporal information on various urban events. Providing accurate spatio-temporal information for events contributes to enhancing the capabilities of urban management and emergency response. However, existing research on mining spatio-temporal information of events often focuses solely on textual content, neglecting data from other modalities such as images and videos. Therefore, this study proposes an innovative spatio-temporal information extraction method for multi-modal social media data (MIST-SMMD), which extracts the spatio-temporal information of events from multi-modal data on Weibo at coarse and fine-grained hierarchical levels, serving as a beneficial supplement to existing urban event monitoring methods. This paper takes the "July 20th Zhengzhou Heavy Rainfall" incident as an example, to evaluate and analyze the effectiveness of the proposed method. The results indicate that in the coarse-grained spatial information extraction using only textual data, our method achieves a Spatial Precision of 87.54% within a 60m range, and reaches 100% Spatial Precision for ranges beyond 200m. For fine-grained spatial information extraction, the introduction of other modal data such as images and videos results in a significant improvement in Spatial Error. These results demonstrate the ability of the MIST-SMMD method to extract spatio-temporal information from urban events at both coarse and fine levels, and confirms the significant advantages of multi-modal data in enhancing the precision of spatial information extraction.

The multi-modal data fusion method based on IA-net and CHMM technical proposed is designed to solve the problem that the incompleteness of target behavior information in complex family environment leads to the low accuracy of human behavior recognition.The two improved neural networks(STA-ResNet50、STA-GoogleNet)are combined with LSTM to form two IA-Nets respectively to extract RGB and skeleton modal behavior features in video. The two modal feature sequences are input CHMM to construct the probability fusion model of multi-modal behavior recognition.The experimental results show that the human behavior recognition model proposed in this paper has higher accuracy than the previous fusion methods on HMDB51 and UCF101 datasets. New contributions: attention mechanism is introduced to improve the efficiency of video target feature extraction and utilization. A skeleton based feature extraction framework is proposed, which can be used for human behavior recognition in complex environment. In the field of human behavior recognition, probability theory and neural network are cleverly combined and applied, which provides a new method for multi-modal information fusion.

In daily travel and activities, pathfinding is a significant process. They are often used in transportation routes calculation. They have now evolved to be able to solve most situations of the pathfinding and its related problems. This review describes previous and recent studies on the pathfinding algorithms. It reviews the development of pathfinding algorithms in a classification base on their usage. The aim is to summarize the application of the pathfinding algorithms for the readers interested in the subject that can be used as a supplement.

Cyberbullying is defined as the use of social media platforms to hurt or humiliate people online. The anonymity on these platforms makes it easy to spread hurtful content, sometimes leading victims to self-harm. This highlights the urgent need for efficient methods to identify to prevent cyberbullying. Numerous studies have addressed this issue by focusing on cyberbullying classification, primarily through binary classification using multi-modal data or multi-class approaches targeting either text or image data. While deep-learning advancements have improved cyberbullying identification, a gap remains in the multi-class classification of cyberbullying utilizing multi-modal data such as memes and this research aims to bridge this gap by accurately classifying cyberbullying across multiple data modalities through a hybrid deep-learning model that combines RoBERTa for text extraction and Vision Transformer (ViT) for images extraction as hybrid(RoBERTa+ViT) model using late fusion module process. Two datasets were utilized: a Private-dataset was collected from comments on social media videos and a Public-dataset that was downloaded from existing research. The hybrid model was trained on these two datasets and the model demonstrated notable performance, achieving an an accuracy of 99.24% on the Public-dataset and 96.1% on the Private-dataset, with F1-scores of 0.9924 and 0.9599, respectively.

This research centres on advancing the utilisation of a novel Deep Ensemble model called RicEns-Net for predicting crop yields through sophisticated multi-modal data engineering. Initially, data for the study were acquired from Ernst \& Young (EY), a prominent global technology and management consulting firm, as part of their annual data science challenge (EY Open Science Challenge 2023). The predictive models leverage multi-modal data by integrating radar and optical-type remote sensing data alongside meteorological data to create supplementary features essential for predicting crop yield. The primary data features are derived from spectral indices extracted from Sentinel 2 satellites, while more advanced features are generated through combinations and interactions of these fundamental features. Furthermore, data from Sentinel 1 and 3, along with meteorological measurements such as surface temperature and rainfall, account for the intricate natural factors influencing crop yield, creating a comprehensive set of data features based on existing research. To tackle the complexity introduced by numerous data features, extensive data engineering was conducted to identify the most predictive features among 100+ and mitigate the "curse of dimensionality," resulting in 15 features from 5 different modalities. The proposed RicEns-Net comprises multiple machine learning algorithms in a deep ensemble approach to leverage the best features of each of these techniques, achieving optimal performance. The proposed model achieves an MAE value of 341 kg/Ha for prediction, surpassing the performance of the EY Open Science Challenge 2023 winner models and state-of-the-art deep/machine learning approaches.

Along with the popularity of the Internet, people are exposed to more and more ways of micro-videos, and a huge amount of micro-video data has emerged. micro-videos have gradually become the Internet content preferred by the public, and a large number of micro-video apps have also emerged, such as Tiktok and Kwai. Intelligent classification and mining of micro-videos can greatly enhance user experience, improve business operation efficiency and enhance user experience. Through deep intelligent analysis and mining of micro-videos, important information in micro-videos can be extracted to provide an important basis for beautifying videos, content appreciation, video recommendation, content search, etc. In the past, content understanding for short videos often used human work annotation, but in recent years, with the great success of deep convolutional neural networks in image recognition, short video content understanding based on this method has gradually developed. Nowadays, most recognition algorithms extract the feature representation of each frame independently and then fuse them. However, while extracting the feature representation, some low-level semantic features are lost, which makes the algorithm unable to accurately distinguish the category of the video. At present, the algorithm of micro-video recognition based on deep learning has surpassed the iDT algorithm, making these traditional methods fade out of people’s view. In this paper according to the micro-video classification task, a new network model is proposed to concatenate features of each modality into the overall features of various modalities through the network, and then fuse the various modal features with the attention mechanism to obtain the whole micro-video features, which will be used for classification. In order to verify the effectiveness of the algorithm proposed in this paper, experiments are conducted in the public dataset, and it is shown the effectiveness of our model.

Open-vocabulary learning has recently gained prominence as a means to enable image segmentation for arbitrary categories based on textual descriptions. This advancement has extended the applicability of segmentation systems to a broader range of generally purpose scenarios. However, current methods often revolve around specialized architectures and parameters tailored to specific segmentation tasks, resulting in a fragmented landscape of segmentation models. In response to these challenges, we introduce OVAMTSeg, a versatile framework designed for Open-Vocabulary and Multitask Image Segmentation. OVAMTSeg harnesses adaptive prompt learning to empower the model to capture category-sensitive concepts, enhancing its robustness across diverse multi-task and scenario contexts. Text prompts are employed to effectively capture semantic and contextual features of the text, while cross-attention and cross-modal interactions enable the fusion of image and text features. Furthermore, a transformer-based decoder is incorporated for dense prediction. Extensive experimental results underscore the effectiveness of OVAMTSeg, showcasing its state-of-the-art performance and superior generalization capabilities across three segmentation tasks. Notable achievements include a 47.5 mIoU in referring expression segmentation, 51.6 mIoU on Pascal-VOC with four unseen classes, 46.6 mIoU on Pascal-Context in zero-shot segmentation, 65.9 mIoU on Pascal-5i, and 35.7 mIoU on COCO-20i datasets for one-shot segmentation.

Land cover mapping provides spatial information on the physical properties of the Earth’s surface, for various classes of wetlands, artificial surface and constructions, vineyards, water bodies, etc. Having reliable information on land cover is crucial to developing solutions to a variety of environmental problems such as destruction of important wetlands/forests, and loss of fish and wildlife habitats. This has made land cover mapping one of the most widespread application areas in remote sensing computational imaging. However, due to the differences between modalities in terms of resolutions, content, and sensors, integrating complementary information that multi-modal remote sensing imagery exhibits into a robust and accurate system still remains challenging, and classical segmentation approaches generally do not give satisfactory results for land cover mapping. In this paper, we propose a novel dynamic deep network architecture, AMM-FuseNet, that promotes the use of multi-modal remote sensing images for the purpose of land cover mapping. The proposed network exploits the hybrid approach of the Channel Attention mechanism and Densely Connected Atrous Spatial Pyramid Pooling (DenseASPP). In the experimental analysis, in order to to verify the validity of the proposed method, we test AMM-FuseNet applied to four datasets whilst comparing it to the 6 state-of-the-art models of DeepLabV3+, PSPNet, UNet, SegNet, DenseASPP, and DANet. In addition, we also demonstrate the capability of AMM-FuseNet under minimal training supervision (reduced number of training samples) compared to the state-of-the-art, achieving less accuracy loss even for the case with 1/20 of the training samples.

A method for classification is introduced in this article, and it is tested on ADNI database to diagnose alzheimer’s disease (AD). It is obvious that tunning the performance of a classification to get better results is a complicated problem, and when we want model’s accuracy or other peformance measurments higher than 90%, the problem will be more complicated. In this study, we tried and succeeded to discover a method to solve this problem. The final feature set can be used clustering too, because outgrowth feature set of the proposed method is invigorated. In the recent years, a lot of activities is done to develop computer aided systems (CAD) for alzheimer’s disease diagnosis. Most of these recently developed systems concenterated on extracting and combining features from MRI, PET, CSF, and …; in this article, we made attempt to do so and utilized one more technique to increase classification performance. Finding and producing the best features to solve three binary classification problems of AD vs. Normal Control (NC), Mild Cognitive Impairment (MCI) vs. NC, and MCI vs. AD are the purposes of this article. Experiments indicate performance and effectiveness rates of the proposed method, which are accuracies of 98.81%, 81.61%, and 81.40% for AD vs. NC, MCI vs. NC, and AD vs. MCI classification problems, respectively. As can be seen, using this method increased the performance of the three binary problems incredibly.

Pepper leaf segmentation plays a crucial role in monitoring pepper leaf diseases in various backgrounds and ensuring the healthy growth of peppers. However, existing transformer-based segmentation methods suffer from computational inefficiency, excessive parameterization, and limited utilization of edge information. To tackle these challenges, we propose an adaptive multi-scale MLP framework, named AMS-MLP, which combines the multi-path aggregation module (MPAM) and the multi-scale context relation mask module (MCRD) to refine the object boundaries in pepper leaf segmentation. AMS-MLP consists of an encoder-based network, an adaptive multi-scale MLP (AM-MLP) module, and a decoder network. In the encoder network, the MPAM module effectively fuses five-scale features to generate a single-channel mask, improving the accuracy of pepper leaf boundary extraction. The AM-MLP module divides the input features into two branches: the global multi-scale MLP branch captures long-range dependencies between image information, while the local multi-scale MLP branch focuses on extracting local feature maps. Adaptive attention mechanism is designed to dynamically adjust the weights of global and local features. The decoder network incorporates the MCRD module into the convolutional layer, enhancing the extraction of boundary features. To verify the performance of the proposed method, we conducted extensive experiments on three pepper leaf datasets with different backgrounds. The results demonstrate mIoU scores of 97.39%, 96.91%, and 97.91%, as well as F1 scores of 98.29%, 97.86%, and 98.51%, respectively. Comparative analysis with U-Net and state-of-the-art models reveals that the proposed method dramatically improves the accuracy and efficiency of pepper leaf image segmentation.

Purposes: To provide abdominal contrast-enhanced MR image synthesis, we developed an image gradient regularized multi-modal multi-discrimination sparse-attention fusion generative adversarial network (GRMM-GAN) to avoid repeated contrast injections to patients and facilitate adaptive monitoring. Methods: With IRB approval, 165 abdominal MR studies from 61 liver cancer patients were retrospectively solicited from our institutional database. Each study included T2, T1 pre-contrast (T1pre), and T1 contrast-enhanced (T1ce) images. The GRMM-GAN synthesis pipeline consists of a sparse attention fusion network, an image gradient regularizer (GR), and a generative adversarial network with multi-discrimination. The studies were randomly divided into 115 for training, 20 for validation, and 30 for testing. The two pre-contrast MR modalities, T2 and T1pre images, were adopted as inputs in the training phase. The T1ce image at the portal venous phase was used as an output. The synthesized T1ce images were compared with the ground truth T1ce images. The evaluation metrics include peak signal-to-noise ratio (PSNR), structural-similarity-index (SSIM), and mean-squared-error (MSE). A Turing test and experts’ contours evaluated the image synthesis quality. Results: The proposed GRMM-GAN model achieved a PSNR of 28.56, an SSIM of 0.869, and an MSE of 83.27. The proposed model showed statistically significant improvements in all metrics tested with p-values <0.05 over the state-of-the-art model comparisons. The average Turing test score was 52.33%, close to random guessing, supporting the model's effectiveness for clinical application. In the tumor-specific region analysis, the average tumor contrast-to-noise ratio (CNR) of the synthesized MR images was not statistically significant from the real MR images. The average DICE from real vs. synthetic images was 0.90, compared to the inter-operator DICE of 0.91. Conclusion: We demonstrated the function of a novel multi-modal MR image synthesis neural network, GRMM-GAN, for T1ce MR synthesis based on pre-contrast T1 and T2 MR images. GRMM-GAN shows promise for avoiding repeated contrast injections during radiation therapy treatment.

Gene regulation is vital for cellular function and homeostasis, involving diverse mechanisms controlling specific gene products and contributing to tissue-specific gene expression. Dysregulation leads to diseases, emphasizing the need for understanding these mechanisms. Non-coding regions, notably enhancers and super-enhancers (SEs), act as crucial gene regulators, orchestrating transcriptional activity via transcription factors (TFs). SEs, with high activity, are pivotal in cell identity and disease progression. Current computational approaches focus on individual regulators like TFs and miRNAs, neglecting SE interactions. We emphasize incorporating SEs into models to enhance understanding. Experimental studies have recently linked miRNAs and TFs to SEs. Chromatin immunoprecipitation followed by sequencing (ChIP-Seq) provides valuable SE information. In this review, we categorize computational methods leveraging TF and miRNA data into three areas and explore challenges integrating enhancers/SEs. These include unraveling indirect regulatory networks, identifying network motifs, and enriching pathway identification by dissecting gene regulators, including SEs. We hypothesize that addressing these challenges will enhance our understanding of gene regulation, aiding in identifying therapeutic targets and disease biomarkers. We believe that understanding the role of ChIP-Seq data in predicting the effect of miRNA on gene regulation is crucial to construct statistical/computational model that would tackle these challenges.

A full electrification of many local railway lines is often not feasible or sustainable in terms of construction and maintenance costs or alternatively for the presence of additional constraints and limitations deriving from environmental or infrastructural limitations. Battery Operated or other kind of hybrid solutions powertrains are currently proposed as sustainable alternatives to Internal combustion engines for the propulsion of rolling stock on not electrified lines. In this work, authors propose the adoption of a partial electrification of lines to assure higher performances and reliability of battery-operated rolling stock designed to be recharged and feed using standard technologies such as pantographs gathering power from suspended catenaries. This innovative solution is designed for a benchmark test vehicle inspired from an existing one and simulated considering some possible scenario of application corresponding to some existing railway lines in Italy.

The advent of the era of big data has led to the emergence of heterogeneous network data fusion as a prominent area of research. Heterogeneous network data is characterised by multi-modality, multi-source, and high dimensionality, which presents significant challenges for traditional data fusion methods. These methods often encounter difficulties in processing such data, including issues such as information redundancy, data inconsistency, and high computational complexity. This paper proposes a heterogeneous network data fusion model based on a deep neural network. The model employs the Multi-Layer Perceptron (MLP) as its fundamental framework, utilising the deep neural network to facilitate joint feature representation learning on data from disparate modalities. The Adaptive Feature Reconstruction Module enables the model to learn the interrelationships between different modalities and to balance the importance of different modal features in the fusion process in a dynamic manner. Furthermore, we introduce an innovative cross-modal attention mechanism, which is capable of effectively capturing the coupling relationship between deep features in heterogeneous data, thereby enhancing the expressiveness and data fusion efficacy of the model. The experimental results demonstrate that the proposed model markedly enhances the accuracy of classification and regression tasks in comparison to traditional methodologies.

Current methods for assessing individual well-being in team collaboration at the workplace rely often on manually collected surveys. This limits continuous real-world data collection and proactive measures to improve team member workplace satisfaction. We propose a method to automatically derive social signals related to individual well-being in team collaboration from raw audio and video data collected in teamwork contexts. The goal is to develop computational methods and measurements to facilitate the mirroring of individuals’ well-being to themselves. We are focusing on how speech behavior is perceived by team members to improve their well-being. Our main contribution is the assembly of an integrated toolchain to perform multi-modal extraction of robust speech features in noisy field settings and to find which features are predictors of self-reported satisfaction scores. We apply the toolchain to a case study where we collected videos of 22 teams with 56 participants collaborating over a four-day period in a team project. Our audiovisual speaker diarization extracts individual speech features in a noisy environment. As the dependent variable team members filled out a daily PERMA (positive emotion, engagement, relationships, meaning, and accomplishment) survey. These well-being scores have been predicted with speech features extracted from the videos using machine learning. The results suggest that the proposed toolchain is able to automatically predict individual well-being in teams, leading to better teamwork and happier team members.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

Odor Source Localization (OSL) technology allows autonomous agents like mobile robots to find an unknown odor source in a given environment. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. Compared to traditional olfaction-only OSL method, our proposed method integrates vision and olfaction sensor modalities to localize odor sources even if olfaction sensing is disrupted by turbulent airflow or vision sensing is impaired by environmental complexities. The model leverages the zero-shot multi-modal reasoning capabilities of large language models (LLMs), negating the requirement of manual knowledge encoding or custom-trained supervised learning models. A key feature of the proposed algorithm is the `High-level Reasoning’ module, which encodes the olfaction and vision sensor data into a multi-modal prompt and instructs the LLM to employ a hierarchical reasoning process to select an appropriate high-level navigation behavior. Subsequently, the `Low-level Action’ module translates the selected high-level navigation behavior into low-level action commands that can be executed by the mobile robot. To validate our method, we implemented the proposed algorithm on a mobile robot in a complex, real-world search environment that presents challenges to both olfaction and vision-sensing modalities. We compared the performance of our proposed algorithm to single sensory modality-based olfaction-only and vision-only navigation algorithms, and a supervised learning-based vision and olfaction fusion navigation algorithm. Experimental results demonstrate that multi-sensory navigation algorithms are statistically superior to single sensory navigation algorithms. The proposed algorithm outperformed the other algorithms in both laminar and turbulent airflow environments. The code for this work can be found at: https://github.com/SunzidHassan/24_Vision-Olfaction-LLM.

This study focuses on the development and evaluation of an AI-based digital therapeutic prototype for adolescent mental health management and disaster response. The system integrates real-time monitoring, AI-driven conversation analysis, personalized psychological treatment programs, and multimodal data analysis. An algorithm was developed to detect gaslighting and verbal abuse using a BERT-based classification model, achieving 85% accuracy in gaslighting detection and 87% ac-curacy in verbal abuse detection. Additionally, a disaster psychological recovery support module was included, which demonstrated a 30% improvement in users' stress reduction rates in simulated disaster scenarios. The results of this study suggest that such digital therapeutic approaches can significantly contribute to early intervention in adolescent mental health issues and provide effec-tive support during disasters. The developed prototype demonstrates the potential of AI and digital technology to innovate mental health management and disaster response strategies.

This study explores fault-tolerant consensus in leader-following heterogeneous multi-agent systems, focusing on actuator failures in uncrewed aerial vehicles (UAVs) and uncrewed ground vehicles (UGVs). An optimization-based fault-tolerant consensus algorithm is proposed. The algorithm utilizes the Euler-Lagrange formula to ensure system consistency under actuator failures, with the Lyapunov stability theory proving the asymptotic stability of the consistency error. The algorithm is applied to heterogeneous multi-agent systems of UAVs and UGVs to derive optimal fault-tolerant consensus control laws for each vehicle type. Simulation experiments give evidence for the feasibility of the proposed control strategy.

Recent years have seen a proliferation of platform-based “shared mobility services” (SMS) such as car-, bike-, and e-scootersharing in many cities in Germany and around the world. At the same time, these services have become the subject of intense debates: Are they replacing private car travel, thus contributing to sustainable mobility in cities? Or are they drawing users away from public transit and cycling while obstructing public space? From the perspective of sustainable mobility politics it seems far from clear which role these new services could play in transitioning to a less car-centric mobility system. While a number of potential effects and ensuing governance issues of shared mobility services (e.g. regarding questions of equitable access, data governance, the role of public versus private actors) have already been studied this article explores the role of shared mobility services (SMS) in triggering system dynamics and feedback loops in the context of sustainability transitions. The article connects questions regarding the sustainability effects of “shared mobility services” with the role of “push” measures to reduce private car traffic in cities. Using a theoretical framework from socio-technical transitions research and from the sociology of technology it describes the recent growth of shared mobility services in Berlin as an example of the upscaling dynamics of socio-technical niche innovations. Drawing on a series of workshops with mobility service providers and representatives of public authorities it analyses the potential for conflict as well as for coalition building between service providers and public authorities. Based on the theoretical concept of the role of feedback loops and windows of opportunity for transitions it shows how the market growth of shared mobility services added momentum to an already ongoing political debate over the legitimate use of public space in Berlin. Against this backdrop the article shows how growing numbers of car-, bike-, and e-scootersharing vehicles could open up windows of opportunity for re-distributing space away from private cars. The article concludes that supporting and regulating SMS will be key to steering their growth into the direction of sustainability.

With a mild Mediterranean-type climate, Corsica is endemic for canine vector-borne diseases (CVBDs) such as dirofilariosis (a mosquitoes borne-diseases: MBDs), leishmaniosis and ehrlichiosis. The aim of this present study was to evaluate a monthly multi-modal prophylactic strategy (MMP) against CVBDs occurring in Corsica. The study was conducted as a comparative field trial in which eighty dogs allocated into two groups were included: (i) Group 1 consisted of 25 dogs under the MMP [per-os administration of 1.5 tablet of milbemycine oxime-praziquantel and a topical line-on application of a 3.6 mL solution of dinotefuran-permethrin-pyriproxyfen] and (ii) Group 2 under various real-life prophylactic treatment (RLP) based on the use of ectoparasiticide products [different formulations: deltamethrin, fluralaner, fipronil] and/or macrocyclic lactones based-products [milbemycin oxime/praziquantel, milbemycin oxime, moxidectin] during the period ranging from June to October 2017. All animals were followed for one year and had blood drawn at day 0, followed by follow-up at 6 and 12 months. Samples were screened for filariosis using molecular tools as well as for leishmaniosis and ehrlichiosis using indirect immunofluorescence assay (IFA). At the end of the study, no new cases of CVBDs were recorded within Group 1. In Group 2, the cumulative incidence of CVBDs was 20.0% (n= 11; p= 0.015) including dirofilarioses due to Dirofilaria immitis and/or D. repens, with 16.4% (n= 9; p=0.027). Ehrlichiosis was 5.5% (n= 3; p=0.241). No new cases of leishmaniosis were detected in Group 2. The data illustrated that, unlike the RLP treatment which failed to protect at least 20% of dogs, the MMP based on the concurrent administration of milbemycine oxime-praziquantel and dinotefuran-permethrin-pyriproxyfen is efficient to protect dogs against CVBDs in a high-risk area.

In the framework of maritime surveillance, vessel detection techniques based on spaceborne Synthetic Aperture Radar (SAR) images have promoted extensive applications for the effective understanding of unlawful activities at sea. The paper deal with this topic presenting a novel approach exploiting a cascade application of a pre-screening, and discrimination phase. The latter leverage the SAR spectrum by means of sub-looks analysis. For the first time, the method has been validated with experiments on multi-frequency (C-, X-, and L-band) SAR images. For a future syngergic exploitation of more SAR missions, the developed dataset, composed of Sentinel-1, SAOCOM and COSMO-SkyMed images, is comprehensive of multiple images gathered over the same area with short time lag (below 15 minutes). Finally, the diversified processing chains and the results for each mission product and scenarios are discussed. Being the first dataset of SLC (Single Look Complex) SAR multi-frequency data, the present work intends to encourage additional research in this promising field of research.

Robotic odor source localization (OSL) is a technology that enables mobile robots or autonomous vehicles to find an odor source in unknown environments. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. While traditional OSL approaches primarily utilize an Olfaction-only strategy, guiding robots to find the odor source by tracing emitted odor plumes, our work introduces a fusion navigation algorithm that combines both vision and olfaction-based techniques. This hybrid approach addresses challenges such as turbulent airflow, which disrupts olfaction sensing, and physical obstacles inside the search area, which may impede vision detection. In this work, we propose a hierarchical control mechanism that dynamically shifts the robot’s search behavior among four strategies: crosswind maneuver, Obstacle-avoid Navigation, Vision-based Navigation, and Olfaction-based Navigation. Our methodology includes a custom-trained deep-learning model for visual target detection and a moth-inspired algorithm for Olfaction-based navigation. To assess the effectiveness of our approach, we implemented the proposed algorithm on a mobile robot in a search environment with obstacles. Experimental results demonstrate that our Vision and Olfaction Fusion algorithm significantly outperforms Vision-only and Olfaction-only methods, reducing average search time by 54% and 30%, respectively.

One of the most promising advancements in healthcare is the application of digital twin technology. Digital twins are virtual replicas of real-world human patients and can be used for monitoring, and diagnosis, and as a tool to design treatment strategies tailored to individual patients. Furthermore, digital twins could also be helpful in finding novel treatment targets and predicting the effects of drugs and other chemical substances in development. This review article delves into the various data sources and methodologies that contribute to the construction of digital twins. Each data source, including blood glucose levels, heart MRI and CT scans, cardiac electrophysiology, written reports, and multi-omics data, comes with different challenges regarding standardization, integration, and interpretation. We showcase how various datasets and methods are used to overcome these obstacles and generate a digital twin. While digital twin technology has seen significant progress, there are still hurdles in the way to achieving a fully comprehensive patient digital twin. Developments in non-invasive and high-throughput data collection, as well as advancements in modeling and computational power will be crucial to improve digital twin systems. We discuss a few critical developments in light of the current state of digital twin technology. Despite challenges, digital twin research holds great promise for personalized patient care and has the potential to shape the future of healthcare innovation.

Device to Device (D2D) is a pivotal technology in the next generation of communication, allowing for direct task offloading between mobile devices (MDs) to improve the efficient utilization of idle resources. This paper proposes a novel algorithm for dynamic task offloading between active MDs and idle MDs in the D2D-MEC (Mobile Edge Computing) system by deploying multi-agent deep reinforcement learning (DRL) to minimize the long-term average delay of delay-sensitive tasks under deadline constraints. Our core innovation is a dynamic partitioning scheme for idle and active devices in the D2D-MEC system, accounting for stochastic task arrivals and multi-time-slot task execution, which has been insufficiently addressed in existing literature. We adopt a queue-based system to formulate a dynamic task offloading optimization problem. To address the challenges of large action space and coupling of actions across time slots, we model the problem as a Markov Decision Process (MDP) and perform the multi-agent DRL through Multi-Agent Proximal Policy Optimization (MAPPO). We employ a centralized training with decentralized execution (CTDE) framework to enable each MD to make offloading decisions solely based on its local system state. Extensive simulations demonstrate the efficiency and fast convergence of our algorithm. In comparison with the existing sub-optimal results deploying single-agent DRL, our algorithm reduces the average task completion delay by 11.0% and the ratio of dropped tasks by 17.0%.

Metabolomics deals with multiple and complex chemical reactions within living organisms and how these are influenced by external or internal perturbations. It lies at the heart of omics profiling technologies not only as the underlying biochemical layer that reflects information expressed by the genome, the transcriptome and the proteome, but also as the closest layer to the phenome. The combination of metabolomics data with the information available from genomics, transcriptomics, and proteomics offers unprecedented possibilities to enhance current understanding of biological functions, elucidate their underlying mechanisms and uncover hidden associations between omics variables. As a result, a vast array of computational tools have been developed to assist with integrative analysis of metabolomics data with different omics. Here, we review and propose five criteria – hypothesis, data types, strategies, study design and study focus – to classify statistical multi-omics data integration approaches into state-of-the-art classes under which all existing statistical methods fall. The purpose of this review is to look at various aspects that lead the choice of the statistical integrative analysis pipeline in terms of the different classes. We will draw a particular attention to metabolomics and genomics data to assist those new to this field in the choice of the integrative analysis pipeline.

The quality of digital elevation models (DEMs) is inevitably affected by the limitations of the imaging modes and the generation methods. One effective way to solve this problem is to merge the available datasets through data fusion. In this paper, a fusion-based global DEM dataset (82°S-82°N) is introduced, which we refer to as GSDEM-30. This is a 30-m DEM mainly reconstructed from the unfilled SRTM1, AW3D30, and ASTER GDEM v2 datasets combining the multi-source and multi-scale fusion techniques. A comprehensive evaluation of the GSDEM-30 data, as well as the 30-m ASTER GDEM v2 and AW3D30 DEM, was presented. Global ICESat GLAS data and the local National Elevation Dataset (NED) were used as the reference for the vertical accuracy validation, while GlobeLand30 was introduced for the landscape analysis. Furthermore, we employed the maximum slope approach to detect the potential artefacts in the DEMs. The results show that the GDEM data are seriously affected by noise and artefacts. With the advantage of the multiple datasets and the refined post-processing, the GSDEM-30 are contaminated with fewer anomalies than both ASTER GDEM and AW3D30. The fusion techniques used can also be applied to the reconstruction of other fused DEM datasets.

Tracking and early identification of suspected cases are essential to control and prevent potential COVID-19 outbreaks. One of the most popular techniques used to track this disease is the use of Infrared cameras to identify individuals with elevated body temperatures. However, they are limited by their inability to be implemented in open public settings such as public parks or even outdoor recreational centers. This limits their ability to effectively track possible COVID-19 patients as open public recreational places such as parks, concert venues and other public venues are hotspots for the spreading of the virus. Other technological solutions such as thermal scanners require an individual to perform the actual testing as they are not individual standalone technologies. This method of testing can potentially cause the transmission of the virus between the tester and the individual getting tested. As can be seen, an alternative solution is essential to solving this issue. In this study, we aim to present the system, design and potential scope of a non-invasive system that can diagnose and identify potential COVID-19 patients using thermal and optical images of the individual using drone technology. The proposed system (COVIDRONE) combines multi-modal machine intelligence, computer vision and real-time monitoring to enable scalable monitoring. The system will also involve the use of machine learning algorithms for better and more accurate diagnosis. We envisage that development of such technologies may help in developing technological solutions to combat infectious disease threats in the future pandemics.

We addressed whether arbitrary top–down regulation based on self-referential thinking could be valid for sensorimotor synchronization. We hypothesized that the dorsal anterior cingulate cortex (dACC) could regulate sensorimotor synchronization in accordance with internal models generated by self-referential processing. To illustrate the validity of the hypothesis, we conducted a missing oddball task with musical students. Utilizing the event-related deep-brain activity (ER-DBA) method cooperatively with the event-related potential (ERP) method, we found that dACC activation promotes repetitive tapping supported by modal completion, whereas dACC deactivation promotes precise tapping under avoiding erroneous responses for the missing pulses. Endogenous ERP components including P150 as a marker of modal completion and N200 as a marker of response inhibition supported this claim. Furthermore, combining the ER-DBA and ERP results, it was suggested that the brain creates a coherent story to promote repetitive tapping by mediating sensory evidence via modal completion. The free energy measurements theoretically support these findings, thereby confirming the validity of our hypothesis.

The Sei Dareh Bridge is a cable-stayed bridge located in West Sumatra Province, Indonesia. The bridge, has a main span of 123 meters length and 9 meters wide, crosses the Batanghari River. Traffic load is transmitted through 4 prestressed cables to a 42.4 meter high pylon made of concrete. Bridge deck and traffic loads are directly supported by steel box girders as main beams that are reinforced laterally with cross beams IWF 800.300.16.24 and stringers IWF 350.350.12.19. This paper discusses static and dynamic testing on the bridge which aims to assess the feasibility before it is opened for public. Based on the test, it was concluded that the 73% static load could not be achieved because the deflection that occurred was beyond the allowable deflection. This is exacerbated by the sound of a loud clanging sound on the ST2-X1 prestressed cable when loading to 240 tons or 58% of the targeted load. In addition, this bridge is included in the "lazy bridge" category because it takes 24 hours to return to an undeformed condition after loading. As a recommendation for this bridge, it is necessary to carry out a structural health monitoring system (SHMS) regularly on the vehicle floor and cables.

Big Data in medicine includes possibly fast processing of large data sets, both current and historical in purpose supporting the diagnosis and therapy of patients' diseases. Support systems for these activities may include pre-programmed rules based on data obtained from the interview medical and automatic analysis of test results diagnostic results will lead to classification of observations to a specific disease entity. The current revolution using Big Data significantly expands the role of computer science in achieving these goals, which is why we propose a Big Data computer data processing system using artificial intelligence to analyze and process medical images.

MGMT promotor hypermethylation is the most important biomarker for predicting temozolomide sensitivity in aggressive glioblastoma (GBM), a disease with a poor prognosis. An MGMT status prediction without biopsy is mandatory for tailored therapy because methylated MGMT patients have better prognosis. To this end, this paper proposes the radiogenomic model for predicting the status of MGMT Promoter methylation in glioblastoma patients based on the multi-modal MRI data and the EfficientNet deep learning architecture. Perhaps using sophisticated machine learning-based non-invasive methods of genetic prognosis may decrease risky biopsies. The Magnetic Resonance Imaging (MRI) sequences in the BraTS21 competition dataset include T1-weighted and contrast-enhanced images, T2-weighted images, and Fluid Attenuated Inversion Recovery (FLAIR) images. Image preprocessing consisted of normalization, scaling, and data augmentation Fourier transformations for cross-modal alignment. The EfficientNet-b0 model was initially pre-trained on ImageNet and then fine-tuned to the binary classification of methylation and unmethylated MGMT. The models were evaluated based on AUC-ROC, accuracy, and the F1 score. The model’s capability of accurately identifying MGMT methylation status was moderate, with an AUC-ROC score of 0.62393 at its best. These differences influenced validation findings: overfit and resulted in accuracy variations for the small or unbalanced datasets. Applying multimodal MRI data elevated feature extraction, proving that deep learning models have radiogenic predictive power. Therefore, this study demonstrates that ALC and DL models can noninvasively estimate MGMT promoter methylation status. They also suffer from problems of overfitting or generalization, which will require some optimization. It might be safer than biopsies and can enhance approaches to glioblastoma treatment.

In modern security situations, tracking multiple human objects in real-time within challenging urban environments is a critical capability for enhancing situational awareness, minimizing response time, and increasing overall operational effectiveness. Tracking multiple entities enables informed decision-making, risk mitigation, and the safeguarding of civil-military operations to ensure safety and mission success. This paper presents a multi-modal electro-optical/infrared (EO/IR) and radio frequency (RF) fused sensing (MEIRFS) platform for real-time human object detection, recognition, classification, and tracking in challenging environments. By utilizing different sensors in a complementary manner, the robustness of the sensing system is enhanced, enabling reliable detection and recognition results across various situations. Specifically designed Radar tag and thermal tag can be used to discriminate friendly and non-friendly objects. The system incorporates deep learning-based image fusion and human object recognition and tracking (HORT) algorithms to ensure accurate situation assessment. After integrating into an all-terrain robot, multiple ground tests were conducted to verify the consistent HORT in various environments. The MEIRFS sensor system has been designed to meet the Size, Weight, Power, and Cost (SWaP-C) requirements for installation on autonomous ground and aerial vehicles.

The Sei Dareh Bridge is a cable-stayed bridge located in West Sumatra Province, Indonesia. The bridge, which crosses the Batanghari River, has a main span of 123 meters long and 9 meters wide. Traffic load is transmitted through 24 prestressed cables to a 42.4-meter-high pylon made of concrete. The bridge deck and traffic loads are directly supported by steel box girders as main beams that are reinforced laterally with cross beams IWF 800.300.16.24 and stringers IWF 350.350.12.19. This paper discusses static and dynamic testing on the bridge which aims to assess its feasibility before it is opened to the public. Based on the test, it was concluded that a static load of 73% could not be achieved because the deflection that occurred was beyond the allowable deflection. This is exacerbated by a loud clanging sound on the ST2-X1 prestressed cable when loading to 240 tons or 58% of the targeted load. In addition, this bridge is included in the "lazy bridge" category because it takes 24 hours to return to an undeformed condition after loading. As a recommendation for this bridge, it is necessary to carry out a structural health monitoring system (SHMS) regularly on bridge slabs and cables.

A multi-decadal change analysis of the irrigation ponds in Taoyuan, Taiwan was conducted by using multi-source data including digitized ancient maps, declassified single-band CORONA satellite images, and multispectral SPOT images. Supervised LULC classifications were conducted using four textural features derived from the single-band CORONA images and spectral features derived from SPOT images. Post-classification analysis revealed that the number of irrigation ponds in the study area decreased during the post-World War II farmland consolidation period (1945 – 1965) and the subsequent industrialization period (1970 – 2000). However, efforts on restoration of irrigation ponds in recent years have resulted in gradual increases in the number (9%) and total area (12%) of irrigation ponds in the study area.

Traditional soil characterization methods are time consuming, laborious and invasive and do not allow long-term repeatability of measurements. The overall aim of this paper was to assess and model spatial variability of the soil in an olive grove in south Italy by using data from two sensors of different type: a multi-spectral on-board drone radiometer and a hyperspectral visible-near infrared-shortwave infrared (VIS-NIR-SWIR) reflectance radiometer as well as sample data, to arrive at a delineation of homogeneous areas. The hyperspectral data were processed using continuum removal methodology to obtain information about the content and composition of clay. Differently, the multispectral data were firstly upscaled to the support of soil data using geostatistics and taking into account change of support. Secondly, the two-sensor data were integrated with soil granulometric properties by using the multivariate geostatistical techniques of multi-collocated cokriging and factor cokriging, in order to achieve a more exhaustive and finer-scale soil characterisation. The paper shows the impact of change of support on the uncertainty of soil prediction that can have a significant effect on decision making in Precision Agriculture. Moreover, four regionalised factors at two different scales (two per each scale) were retained and mapped. Each factor provided a different delineation of the field with areas characterised by different granulometry and clay composition. The applied method is sufficiently flexible and could be applied to any number and type of sensors.

Attribute reduction is a core technique in the rough set domain and an important step in data preprocessing. Researchers have proposed numerous innovative methods to enhance the capability of attribute reduction, such as the emergence of multi-granularity rough set models, which can effectively process distributed and multi-granularity data. However, these innovative methods still have many shortcomings, such as how to deal with complex constraints and how to perform multi-angle effectiveness evaluations. Based on the multi-granularity model, this study proposes a new method of attribute reduction, namely using multi-granularity neighborhood information gain ratio as the measurement criterion. This method combines both supervised and unsupervised perspectives, and by integrating multi-granularity technology with neighborhood rough set theory, constructs a model that can adapt to multi-level data features. This model can select the optimal granularity level or attribute set according to the requirements. Finally, the proposed method is experimented with on 15 UCI datasets against six other attribute reduction algorithms. The experimental outcomes, upon analysis and comparative review, substantiate the reliability and consistency of the attribute reduction approach introduced in this study.

With a high proportion of distributed photovoltaic and lower fossil energy integrated into the distribution network, it is very difficult to ensure the reliability of power supply. The distributed photovoltaic planning model based on big data is proposed. According to the impact stochastic photovoltaics and loads on reliability planning, the static and dynamic capacity-load ratios are proposed. The big data analysis model of distributed photovoltaic planning is established. The big data multi-scenario generation and reduction algorithm of stochastic distributed photovoltaic and load planning is studied, and a source-load big data scenario matching model is proposed. Ac-cording to the source load big data scenario, the dynamic capacity-load ratio of the distribution network is obtained. The static capacity-load ratio calculation method in distribution network planning is studied to ensure the reliability of power supply. Finally, the IEEE 33-bus system is used as an example. The results show that distributed photovoltaic planning based on big data and multi-scenario methods can improve photovoltaic utilization and power supply reliability.

Mining interspecies interactions remain a challenge due to the complex nature of microbial communities and the need for computational power to handle big data. Our meta-analysis indicates that genetic potential alone does not resolve all issues involving mining of microbial interactions. Nevertheless, it can be used to define the building blocks to infer synergistic interspecies interactions and to limit the search space (i.e., number of species and metabolic reactions) to a manageable size. A reduced search space decreases the number of additional experiments necessary to validate the inferred putative interactions. As validation experiments, we examine how multi-omics and state of the art imaging techniques may further improve our understanding of species interactions’ role in ecosystem processes. Finally, we analyze pros and cons from the current methods to infer microbial interactions from genetic potential and propose a new theoretical framework based on: (i) genomic information of key members of a community; (ii) information of ecosystem processes involved with a specific hypothesis or research question; (iii) the ability to identify putative species’ contributions to ecosystem processes of interest; and, (iv) validation of putative microbial interactions through integration of other data sources.

In response to escalating global demand for poultry, the industry grapples with an array of intricate challenges, from enhancing productivity to improving animal welfare and attenuating environmental impacts. This comprehensive review explores the transformative potential of digital phenotyping, an emergent technological innovation at the cusp of dramatically reshaping broiler production. The central aim of this study is to critically examine digital phenotyping as a pivotal solution to these multidimensional industry conundrums. Our investigation spotlights the profound implications of 'digital twins' in the burgeoning field of broiler genomics, where the production of exact digital counterparts of physical entities accelerates genomics research and its practical applications. Further, this review probes into the ongoing advancements in the research and development of a context-sensitive, multimodal digital phenotyping platform, custom-built to monitor broiler health. I critically evaluate this platform's potential in revolutionizing health monitoring, fortifying the resilience of broiler production, and fostering a harmonious balance between productivity and sustainability. Subsequently, the paper provides a rigorous assessment of the unique challenges that may surface during the integration of digital phenotyping within the industry. These span from technical and economic impediments to ethical deliberations, thus offering a comprehensive perspective. The paper concludes by highlighting the game-changing potential of digital phenotyping in the broiler industry and identifying potential future directions for the field, underlining the significance of continued research and development in unlocking digital phenotyping's full potential. In doing so, it charts a course towards a more robust, sustainable, and productive broiler industry. The insights garnered from this study hold substantial value for a broad spectrum of stakeholders in the broiler industry, setting the stage for an imminent technological evolution in poultry production.

A smart precipitation estimation method based on FY-4B meteorological satellite data (FY-4B_AI) is proposed in this paper. This method spatiotemporally matches 125 features derived from multi-temporal and multi-channels of FY-4B satellite data with the precipitation at stations. Then a precipitation model using the Light Gradient Boosting Machine algorithm is constructed. Comparative results between FY-4B_AI and GPM/IMERG-L products for over 450 million station cases throughout 2023 shows that: 1) FY-4B_AI is superior to GPM IMERG-L in the average absolute error, root mean square error, relative error, correlation coefficient, probability of detection and critical success index. While in the mean error and false alarm rate, FY-4B_AI is slightly inferior to GPM/IMERG-L. 2) Evaluation of strong weather event applications reveals that both FY-4B_AI and GPM/IMERG-L can accurately represent the spatial distribution characteristics of precipitation, no matter in the southeast humid region or the northwest dry region. Notably, FY-4B_AI, due to its higher spatiotemporal resolution, provides a more detailed distribution of precipitation.

The RPL protocol is a routing protocol for low power and lossy networks. In such a network, energy is a very scarce resource; so many studies are focused on minimizing global energy consumption. End-to-end latency is another important performance indicator of the network, but existing research tends to focus more on energy consumption and ignore the end-to-end delay of data transmission. In this paper, we propose a kind of energy equalization routing protocol to maximize the surviving time of the restricted nodes so that the energy consumed by each node is close to each other. At the same time, a multi-path forwarding route is proposed based on the cache utilization. The data is sent to the sink node through different parent nodes at a certain probability, not only by selecting the preferred parent node, thus avoiding buffer overflow and reducing end-to-end delay. Finally, the two algorithms are combined to accommodate different application scenarios. The experimental results show that the proposed three improved schemes improve the reliability of the routing, extend the lifetime of the network, reduce the end-to-end delay, and reduce the number of DAG reconfiguration.

Air quality is one of the most concerning problems in major industrialized cities in the world. Prediction of future air quality is highly relevant to public health. In some big cities, multiple air quality measurement stations are deployed at different locations to monitor air pollutants, such as NO2, CO, PM 2.5 and PM 10, over time. At every monitoring time stamp t, we observe one station×feature matrix xt of the pollutant data, which represents a spatio–temporal process. Traditional methods on prediction of air quality typically use data from one station or can only predict a single pollutant (such as PM 2.5) at a time, which ignores the spatial correlation among different stations. Moreover, the air pollution data are typically highly nonstationary, We propose a de-trending graph convolutional LSTM (long short term memory) to continuously predict the whole station×feature matrix in the next 1 to 48 hours, which not only captures the spatial dependency among multiple stations by replacing an inner product with convolution, but also incorporates the de-trending signals (transform a nonstationary process to a stationary one by differencing the data) into our model. Experiments on the air quality data of the city Chengdu and multiple major cities in China demonstrate the feasibility of our method and show promising results.

Digital twins are the foundation of autonomous off-road vehicles. Dynamic reduction methods are one of several ways to develop digital twins for off-road vehicles. The article commences with a comprehensive overview of the most widely used dynamic reduction methods and then introduces performance metrics for assessing their efficacies in the context of digital twins. The paper additionally includes a detailed mathematical derivation of the state-space representation for reduced-order finite element models. The state-space representation of the reduced finite element models facilitates their export to problem-solving environments for dynamic analysis. The state-space models are eventually solved utilizing the built-in libraries of numerical solvers in textual and graphical programming platforms. In addition, the article identifies the set of solvers that best suit the simulation of virtual models for off-road vehicles. This article also includes an evaluation of the simulation results of digital models with modes ranging from 0 to 30 Hz. In addition, the article demonstrates the lower bound of the frequency range necessary and sufficient to be retained in off-road vehicle virtual models. Finally, the paper presents the simulation outcomes for digital models of commercial off-road vehicles with custom-built control, electrical, and control systems.

With LiDAR (Light Detection and Ranging) time series being used for various applications, optimal realisation of a common geodetic datum over many epochs is a highly important prerequisite with direct impact on accuracy and reliability of derived measures. In our work, we develop and define several approaches to the adjustment of multi-temporal LiDAR data in a given software framework. These approaches ranging from pragmatic to more rigorous solutions are applied to an 8 year time series with 21 individual epochs. The analysis of the respective results suggests that a sequence of bi-temporal adjustments brings the best results while being more flexible and computationally viable than the most extensive approach of using all epochs in one single multi-temporal adjustment. With a combination of sparse control patches measured in the field and one selected reference block, we obtain relative datum discrepancies in the range of 1-2 cm for the complete time series. Based on our findings, we formulate design criteria for setting up and adjusting future time series with the proposed method.

Abstract: Comparing outcrop data to laboratory results is important to verify and validate experiments of analogue and reservoir materials especially regarding conditions for deformation experiments. This is important better understand highly complex carbonate reservoir strata and their response to changes in subsurface conditions, reducing subsurface uncertainty. This study develops methods to allow for a more straightforward comparison of outcrop data (m-scale) with experimentally created fracture arrays developed in cylindrical samples (cm-scale). The main objective is to assess usefulness of experimentally-produced fracture networks as analogues for subsurface structures, typically at the meter and above scale by developing new techniques to use the lab deformation. It analyses key characteristics of laboratory-induced fracture networks by adapting scanline methods to use with x-ray tomography (XRT) images to allow for comparison with outcrop and field data. To test and verify these new methods two low permeability carbonate samples were used for deformation testing and analysis. Applying the different scanline methods we show that they can be used to analyse lab induced fractures (mm to cm-scale) identified in XRT images for comparison with outcrop data (m-scale). In addition, these methods also allow for quantification of fracture network attributes e.g. fracture spacing, fracture apertures, orientation. This new data bridges the gap between micro-scanlines using thin sections and outcrop scanlines.

Multimodal sentiment analysis is rapidly gaining traction due to its ability to comprehensively interpret opinions expressed in video content, which is ubiquitous across various digital platforms. Despite its promising potential, the field is hindered by the limited availability of high-quality, annotated datasets, which poses substantial challenges to the generalizability of predictive models. Models trained on such scarce data often inadvertently assign excessive importance to irrelevant features, such as personal attributes (e.g., eyewear), thereby diminishing their accuracy and robustness. To address this issue, we propose an Enhanced Modal Fusion Learning (EMFL) methodology aimed at significantly improving the generalization capabilities of neural networks. EMFL achieves this by optimizing the integration and interpretation processes of multimodal data, ensuring that sentiment-relevant features are prioritized over confounding attributes. Through extensive experiments conducted on multiple benchmark datasets, we demonstrate that EMFL consistently elevates the accuracy of sentiment predictions across verbal, acoustic, and visual modalities. These findings underscore EMFL's efficacy in mitigating the impact of non-relevant features and enhancing the overall performance of multimodal sentiment analysis models.

This paper presents an approach to damage identification in beams by modal curvatures based on the use of beamforming algorithms. These processors have been successfully used in acoustics for the last thirty years to solve the inverse problems encountered in source recognition and image reconstruction, based on ultrasonic waves. In addition, beamformers apply to a broader range of problems in which the forward solutions are computable and measurable, especially regarding the field of structural vibrations, where the use of such estimators has not received attention to date. In this paper, modal curvatures will play the role of the replica vectors of the imaging field. By means of numerical studies and experimental tests on a steel beam, we motivate the choice of modal curvatures as observed quantities. Furthermore, we compare the performance of the Bartlett and minimum variance distortionless beamformers (MVDR) with an estimator based on the simple minimization of the difference between model and measured data. The results suggest that the application of the MVDR beamformer is highly effective, especially in cases of slight damage between two sensors. MVDR enabled both damage localization, and quantification.

The increased availability of high resolution remote sensor data for precision agriculture 1 applications permits users to aquire deeper and more relevant knowledge about crops states that lead 2 inevitably to better decisions. The algorithm libraries being developed and evolved around these 3 applications rely on multi-spectral or hyper-spectral data acquired by using manned or unmanned 4 platforms. The current state of the art makes thorough use of vegetational indicies to guide the 5 operational management of agricultural land plots. One of the most challenging sub-problems is 6 to correctly identify and separate crop from soil. Thresholding techniques based on Normalized 7 Difference Vegetation Index (NDVI) or other such similar metrics have the advantage of being simple, 8 easy to read transformations of the data packed with useful information. Obvious difficulties arise 9 when crop/tree and soil have similar spectral responses as in case of grass filled areas in vineyards. 10 In this case grass and canopy are close in terms of NDVI values and thresholding techniques will 11 generally fail. Radiometric approaches could be integrated or replaced by a geometric approach that 12 is based on terrain data like Digital Surface Models (DSMs). These models are one of the ouputs 13 of orthorectification engines usually present in data acquired by using unmanned platforms. In 14 this paper we present two approaches based on DSM that are able to segment crop/tree from soil 15 while over gradient terrain. The DSM data are processed through a two dimensional data slicing or 16 reduction technique. Each slice is separately processed as a one dimensional time series to derive the 17 terrain and tree structures separately, here interpreted as object probability densities. In particular 18 the first approach is a Cartesian grid rasterization (CARSCAN) of the terrain and the second is its 19 immediate generalisation or radial grid rasterization of the DSM model (FANSCAN). The FANSCAN 20 recovers information from the original image at greater frequencies on the Fourier plane. These 21 approaches enable the identification of crop/tree from soil in case of slopes or hilly terrain without 22 any constraint on the displacement / direction of plant/tree row. The proposed algorithm uses pure 23 DSM information even if it is possible to fuse its output with other classifiers.

In research applications across several areas, noise removal is indispensable for accuracy of final results. Noise is caused due to physical principals, such as background electronic noise, quantum effect, and wave rebound effect to name a few. Noise removal can help improve results in medical, astronomy, defense, and numerous other fields. Addressing this limitation would result in potentially low cost, automatic, and reliable systems. In this paper, a generalized new approach i.e. Multi-Frame Noise Removal (MFNR) is proposed for noise removal. Given any type of data, the probability density function (PDF) of the noise can be determined. Herein, we extracted the noise PDF parameters using KDE (Kernel Density Estimation). Because the data is corrupted by “deterministic” noise, hence can be cleaned. This could be used as a general purpose noise removal tool. The data point with same position in multiple frames helps us determine the noise PDF characteristics and hence making it possible to remove noise. The conventional wisdom which states that noise removal and detail preservation are contrary to each other is not true for MFNR. Experimental results validate our proposed method which showed practically complete noise reduction based on number of frames used, as compared to existing benchmark methods.

We describe a new approach for integrating multiple views of data into a common latent space using non-negative tensor factorization (NTF). This approach, which we refer to as the "Integrated Sources Model" (ISM), consists of two main steps: embedding and analysis. In the embedding step, each view is transformed into a matrix with common non-negative components. In the analysis step, the transformed views are combined into a tensor and decomposed using NTF. Noteworthy, ISM can be extended to process multi-view data sets with missing views. We illustrate the new approach using two examples: the UCI digit dataset and a public cell type gene signatures dataset, to show that multi-view clustering of digits or marker genes by their respective cell type is better achieved with ISM than with other latent space approaches. We also show how the non-negativity and sparsity of the ISM model components enable straightforward interpretations, in contrast to latent factors of mixed signs. Finally, we present potential applications to single-cell multi-omics and spatial mapping, including spatial imaging and spatial transcriptomics, and computational biology, which are currently under evaluation. ISM relies on state-of-the-art algorithms invoked via a simple workflow implemented in a Jupyter Python notebook.

Precise monitoring of different environmental parameters and contaminations during food processing and storage is a key factor for maintaining its safety and nutritional value. Thus, developing reliable, efficient, cost-effective sensor devices for these purposes is of utmost importance. In this paper, we show that Poly-(diallyl-dimethylammonium chloride)/reduced Graphene oxide (PDAC/rGO) films produced by a simple Layer-by-Layer deposition can be effectively used to monitor temperature, relative humidity and the presence of volatile organic compounds as indicators for spoilage odors. At the same time, they show potential for electrochemical detection of organophosphate pesticide dimethoate. By monitoring the resistance/impedance changes during temperature and relative humidity variations or upon the exposure of PDAC/rGO films to methanol, good linear responses were obtained in the temperature range of 10-100 °C, 15-95 % relative humidity, and 35 ppm - 55 ppm of methanol. Moreover, linearity in the electrochemical detection of dimethoate is shown for the concentrations in the order of 102 µmol dm−3. The analytical response to different external stimuli and analytes depends on the number of layers deposited, affecting sensors’ sensitivity, response and recovery time, and long-term stability. The presented results could serve as a starting point for developing advanced multimodal sensor devices and sensor arrays with high potential for analytical applications in food safety and quality monitoring.

With the recent advances in Machine Learning (ML), several models have been successfully applied to financial and accounting data to predict the likelihood of companies’ bankruptcy. However, time series have received little attention in literature with a lack of studies on the application of Deep Learning sequence models as Recurrent Neural Networks (RNN) and the recent Attention-based models in general. In this research work, we investigated the application of Long Short Term Memory (LSTM) networks to exploit time series of accounting data for bankruptcy prediction. The main contributions of our work are the following: a) we have proposed a Multi-head LSTM that models each financial variable in a time window independently and compared it with a single-input LSTM and other traditional ML models. The Multi-head LSTM outperforms all the other models; b) We identify the optimal time series length for bankruptcy prediction to be equal to 4 years of accounting data; c) We made public the dataset we used for the experiments that include data from 8262 different public companies in the American stock market generated in the period between 1999-2018. Furthermore, we prove the efficacy of the Multi-head LSTM models in terms of lower false positives and better division of the two classes.

A heterogeneous disease like cancer is activated through multiple pathways and different perturbations. Depending upon the activated pathway(s), patients’ survival vary significantly and show different efficacy to various drugs. Therefore, cancer subtype detection using genomics level data is a significant research problem. Subtype detection is often a complex problem, and in most cases, needs multi-omics data fusion to achieve accurate subtyping. Different data fusion and subtyping approaches have been proposed, such as kernel-based fusion, matrix factorization, and deep learning autoencoders. In this paper, we compared the performance of different deep learning autoencoders for cancer subtype detection. We performed cancer subtype detection on four different cancer types from The Cancer Genome Atlas (TCGA) datasets using four autoencoder implementations. We also predicted the optimal number of subtypes in a cancer type using the silhouette score. We observed that the detected subtypes exhibit significant differences in survival profiles. Furthermore, we also compared the effect of feature selection and similarity measures for subtype detection. To evaluate the results obtained, we selected the Glioblastoma multiforme (GBM) dataset and identified the differentially expressed genes in each of the subtypes identified by the autoencoders; the obtained results coincide well with other genomic studies and can be corroborated with the involved pathways and biological functions. Thus, it shows that the results from the autoencoders, obtained through the interaction of different datatypes of cancer, can be used for the prediction and characterization of patient subgroups and survival profiles.

The proportion of area under various crops at a given point in time, known as a cropping pattern, plays an essential role in determining the level of agricultural production. In this study, cropping patterns of three sub-counties in Murang’a County, a typical African smallholder farming area in Kenya, were mapped. Specifically, we compared the performance of eight classification scenarios for mapping cropping patterns; namely using (i) only Sentinel-2 reflectance bands (S2), (ii) S2 and S2 derived vegetation indices (VIs); (iii) S2 and S2 vegetation phenology (VP); (iv) S2 and Sentinel-1 radar backscatter data (S1); (v) S2, VIs, and S1; (vi) S2, VP, and S1; (vii) S2, VIs and VP, and (viii) S2, VIs, VP and S1. Reference data of the dominant cropping patterns and non-croplands were collected. The guided regularized random forest (GRRF) algorithm was used to select the optimum variables and to perform the respective classification for each scenario. The most accurate result of the overall accuracy of 93.16% was attained from the scenario (viii) S2, VIs, VP, and S1. The McNemar’s test of significance did not show significant differences (p≤0.05) among the tested scenarios. Our study demonstrated the strength of GRRF and the synergetic advantage of S2 and S1 derivatives to map cropping patterns in a heterogeneous landscape where high resolution imagery are inaccessible. Our cropping pattern mapping approach can be used in other sites of relatively similar agro-ecological conditions.

Integration of multi-view datasets which are comprised of heterogeneous sources or different representations is challenging to understand the subtle and complex relationship in data. Such data integration methods attempt to combine efficiently the complementary information of multiple data types to construct a comprehensive view of underlying data. Nonnegative matrix factorization (NMF), an approach that can be used for signal compression and noise reduction, has aroused widespread attention in the last two decades. The Kullback–Leibler divergence (or relative entropy) information distance can be used to measure the loss function of NMF. In this article, we propose a fast and robust framework (RSNMF) based on symmetric nonnegative matrix factorization (SNMF) and similarity network fusion (SNF) for clustering human microbiome data including functional, metabolic and phylogenetic profiles. Many existing methods typically utilize all the information provided by each view to create a consensus representation, which often suffers a lot from noise in data and cannot provide a precise representation of the latent data structures. In contrast, RSNMF combines the strength of SNMF and the advantage of SNF to form a robust clustering indicator matrix thus can reduce the noise influence. We conduct experiments on one synthetic and two real dataset (microbiome data, text data) and the results show that the proposed RSNMF has better performance over the baseline and the state-of-art methods, which demonstrates the potential application of RSNMF for microbiome data analysis.

As technologies such as eco-friendly ships, electric propulsion vessels, and multi-fuel propulsion systems advance, the scope of IoT applications in maritime field is expanding, resulting in increased complexity in control factors. The gradual progression towards Maritime Autonomous Surface Ships (MASS) is further driving the evolution of ship-based IoT applications. These advancements underscore the necessity for a platform capable of ensuring reliable connectivity between ships and onshore, while also being adaptable for deployment and operation to meet the demands of service availability. The limitations of the existing single cloud architecture become evident in this context. In response to these emerging challenges, this paper presents a cloud-based horizontal data platform structure anchored in the architecture of a Multi-Region Fog Cloud. This approach is tailored to fulfill the crucial requirement of maintaining robust and seamless connectivity for vessels navigating globally. Leveraging the capabilities of the Fog Cloud, the platform enhances service responsiveness by facilitating localized data collection and distribution, complemented by efficient data caching from the Cloud Center, serving users within the same geographical region. We outline a strategic framework for enhancing and executing key ship services within the proposed architecture. These services encompass data sharing between ships to elevate collision avoidance, disseminating weather data for optimized route planning, and constructing an operator training simulator (OTS) environment through the integration of digital twin technology. After, we implement an architecture using the AWS Cloud and gauges latency and Packet Loss Rate (PLR) through connections to Seoul, California, and Frankfurt regions. The test results reveal that latency in different regions is about 2-5 times higher than that in the same region for the payload. Furthermore, packet loss occurred at roughly 2-3 Hz packet generation rate (PGR) in different regions, whereas in the same region, it commenced at approximately 10-20 Hz PGR.

This study develops a structure for mapping native vegetation in a transition area between Brazilian Cerrado and Atlantic Forest from integrated spatial information from the Sentinel-1 and Sentinel-2 satellites. Most studies use this data separately, however, the integrated use of optical sensors with Synthetic Aperture Radar (SAR) sensors can improve the methodology for classifying land use and land cover (LULC). The fusion of Sentinel-1 and Sentinel-2, for example, can increase the accuracy of mapping algorithms, using complementary information, such as spectral, backscattering, polarimetry, and interferometry. The study area comprises the Lobo Reservoir Hydrographic Basin, which is part of an environmental conservation unit protected by Brazilian law and with significant human development. LULC were classified, using the random forest deep learning algorithm. The classifying attributes were backscatter coefficients, polarimetric decomposition, and interferometric coherence for radar data (Sentinel-1), and optical spectral data, comprising bands in the red edge, near infrared, and shortwave infrared (Sentinel-2). The attributes were evaluated in three settings in which the SAR and optical data were evaluated separately (C1 and C2, respectively) and in an integrated manner (C3). The study found greater accuracy for C3 (96.54%), an improvement of nearly 2% compared to C2 (94.78%) and more than 40% in relation to C1 (55.73%). The classification algorithm encountered significant challenges in identifying wetlandsin C1, but performance improved in C3, enhancing differentiation by stratifying a greater number of classes during training and facilitating visual interpretation during sampling. Accordingly, the use of SAR and optical data becomes an alternative to optimize LULC mapping in tropical regions, due to the limited influence of atmosphere on images in the microwave range.

Use of a multi-sensor approach can provide citizens a holistic insight in the air quality in their immediate surroundings and assessment of personal exposure to urban stressors. Our work, as part of the ICARUS H2020 project, which included over 600 participants from 7 European cities, discusses data fusion and harmonization on a diverse set of multi-sensor data streams to provide a comprehensive and understandable report for participants, and offers possible solutions and improvements. Harmonizing the data streams identified issues with the used devices and protocols, such as non-uniform timestamps, data gaps, difficult data retrieval from commercial devices, and coarse activity data logging. Our process of data fusion and harmonization allowed us to automate the process of generating visualizations and reports and consequently provide each participant with a detailed individualized report. Results showed that a key solution was to streamline the code and speed up the process, which necessitated certain compromises in visualizing the data. A thought-out process of data fusion and harmonization on a diverse set of multi-sensor data streams considerably improved the quality and quantity of data that a research participant receives. Though automatization accelerated the production of the reports considerably, manual structured double checks are strongly recommended.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

With the development of human-computer interaction, the importance of emotion recognition is increasing. Emotion recognition technology provides practical benefits in various industries such as improving user experience, education, and organizational productivity. In education, emotion recognition can enable real-time understanding of students' emotional states and provide tailored feedback, and in the workplace, by monitoring employees' emotional states, it can improve work performance and job satisfaction. Therefore, multimodal-based research that combines text, speech, and video data for emotion recognition is being conducted in various industries. In this study, we propose an emotion recognition method that combines text and speech data, reflecting the characteristics of the Korean language. For text, KoELECTRA is used to perform embedding, and for speech, MFCC and pitch analysis are used to extract features. Finally, a multimodal transformer model is proposed that combines these two data types to perform emotion recognition. The multimodal transformer model processes text and speech data separately, and then learns the interaction between the two modalities through a Cross-Modal Attention mechanism. Through this, the complementary information from text and speech is effectively combined, improving emotion recognition performance. Experimental results show that the proposed model outperforms single-modality models, achieving a high accuracy of 73.13% and an F1-Score of 0.7344 in emotion classification. This study contributes to the advancement of emotion recognition technology by combining various language and modality data, and higher performance can be expected through the integration of additional modalities in the future.

The ANSYS 2024R1 student edition was used to create a finite element model of a basketball rim and backboard. This finite element model included the use of steel for the rim and its mount, a tempered glass backboard, and an aluminum frame behind the backboard. After a mesh was created, fixed support boundary conditions were applied to the four corners of the aluminum frame. The subsequently calculated mode shapes and frequencies were compared to empirical modal analysis previously done at the United States Military Academy at West Point, New York. Four mode shapes and frequencies agreed rather well between the theoretical finite element analysis and previously published empirical modal analysis, specifically where the rim was vibrating in the vertical direction, which was the direction that the accelerometer was aligned for modal analysis. However, three mode shapes missed by the empirical modal analysis were found where the vibration of the rim was confined to the horizontal plane, which was orthogonal to the orientation of our accelerometer.

The need for cross-modal retrieval (CMR) among users is growing because of the swift advancements in computer vision and natural language processing. Promoting home operating systems is greatly aided by the openKylin home operating system. It is focused on enhancing the functionality of the operating system with safe and dependable operating technologies. Practical implications abound for integrating computer vision research into home operating systems. A multimodal retrieval approach based on openKylin is presented to improve the usability of text search graphs, audio, and video. The overview of pertinent domestic and international research is the main topic of this article. This technological advancement. It then offers details on the design, implementation procedure, and final implementation outcomes for demonstration. The works of natural operations show that this strategy has excellent accuracy and performance.

Six mode shapes, including bending and torsion, were documented for five different basketball rims and backboards at the United States Military Academy, West Point, New York, USA. The frequency and damping ratio of each mode shape were also determined. The empirical process began with the time-domain excitation and response of each rim-backboard system. The impulse of excitation came from an impact hammer separately applied to sequentially, to each node. The sinusoidal response was gathered from an accelerometer at a fixed location, node 1. Each time-domain excitation-response was then converted to a frequency domain Bode plot for each node by a B&K 2034 Signal Analyzer, giving transfer functions of output/input versus frequency. Structural Measurements System (SMS) Software was used to fit mode shapes to the Bode plots. Each of the six mode shapes were fitted to the Bode plots of each node at a specific modal frequency. Each of the six mode shapes were a function of the locations of the nodes, and the Bode plot gathered at each node. The first and second modes were critical for showing that the Energy Rebound Testing Device statistically correlated with the energy transferred to the rim and backboard. A known perturbation mass was selectively attached to the rim, to help isolate the dynamic masses and spring rates for the rim and backboard, to ascertain the kinetic energy transferred to the rim had a 95.67% inverse correlation with rim stiffness.

In this work we discuss the numerical challenges involved in the computation of the complex eigenvalues of damped multi-flexible-body problems. Aiming at the highest generality, the candidate method must be able to deal with arbitrary rigid body modes (free-free mechanisms), arbitrary algebraic constraints, and must be able to exploit the sparsity pattern of Jacobians of large systems. We propose a custom implementation of the Krylov-Schur method, proving its robustness and its accuracy in a variety of different complex test cases.

In recent years, the emergence of spatiotemporal big data has made the transition of functional identification from the physical dimension to socioeconomic or human activities becoming more common. In the identification of urban functional areas, most studies considered only a single data source and a single division scale, the research results have problems such as low update frequency or incomplete information in a single data set, and overfitting or underfitting in a single spatial resolution. Using taxi trajectory data and point of interest (POI) data as the main data source, this study proposes a multi-scale recursive identification method for urban functional areas based on cross-validation. First, used the dynamic time warping (DTW) algorithm generates a time series similarity matrix, the CA-RFM model combines the clustering algorithm and random forest model is constructed, the model uses a clustering algorithm (K-MEDOIDS) to extract sig-nificant feature regions as input, which are imported into the random forest model for UFZ identification. Then, to overcome the shortcomings of single scale in expressing urban structural characteristics, a recursive model of different levels of urban road networks is established to classify multi-scale functional areas. Finally, cross-validation using the CA-RFM model and POI quantitative identification method, obtains the final identification results of urban functional areas. This paper selects Shenzhen as the study area for the case study, the results show that the com-bination of clustering algorithm and random forest model greatly reduces the error of manual selection of training samples. In addition, the research shows the superiority of the multi-scale recursive identification method that fuses multi-source data and performs cross-validation from two aspects, that is, the division speed of urban functional area identification results is accelerated and the accuracy is improved.

This paper presents an unsupervised feature selection method for multi-dimensional histogram-valued data. We define a multi-role measure, called the compactness, based on the concept size of given objects and/or clusters described by a fixed number of equal probability bin-rectangles. In each step of clustering, we agglomerate objects and/or clusters so as to minimize the compactness for the generated cluster. This means that the compactness plays the role of a similarity measure between objects and/or clusters to be merged. To minimize the compactness is equivalent to maximize the dis-similarity of the generated cluster, i.e., concept, against the whole concept in each step. In this sense, the compactness plays the role of cluster quality. We also show that the average compactness of each feature with respect to objects and/or clusters in several clustering steps is useful as feature effectiveness criterion. Features having small average compactness are mutually covariate, and are able to detect geometrically thin structure embedded in the given multi-dimensional histogram-valued data. We obtain thorough understandings of the given data by the visualization using dendrograms and scatter diagrams with respect to the selected informative features. We illustrate the effectiveness of the proposed method by using an artificial data set and real histogram-valued data sets.

The value of an NBA basketball player varies at each crucial point in time, depending on the player’s career and performance. This study constructs a player’s value assessment model. The model comprises two parts. First, from an objective perspective, entropy is employed to measure each player’s achievement in five categories—rebounds, assists, steals, blocked shots, and scores. The total entropy assessment value is calculated and then combined with the players’ scores to develop a player's value matrix to assess the relative value model among players of the same type.

Robot Operating System 2 (ROS 2) is a robotic software that uses a set of Quality of Service (QoS) policies to manage the quality of robot data transmissions in a network, such as the RELIABLE and KEEP_LAST options. In ROS 2 node communication, the RELIABLE connection guarantees that all message data can be properly sent from the publisher to the subscriber. However, strict reliability is not guaranteed if the RELIABLE connection uses the KEEP_LAST option to transmit the robot data in the publish-subscribe communication. This study aims to analyze the efficiency of local cache, cache control, and QoS balancing optimization to improve ROS 2 node communication when using the RELIABLE and KEEP_LAST options to transmit multi-robot data in Aggregated Robot Processing (ARP) architecture. Our idea in local cache and cache control is to streamline the sensor data output before processing it when the sensor device produces the data with the same value in a row. Furthermore, QoS balancing optimization aims to balance the DEPTH and DEADLINE QoS configuration to determine the rates and buffer size in ROS 2 node communication. This study shows that combining local cache and QoS balancing optimization improves multi-robot data transmission and cooperation in ARP architecture.

Developing countries like Pakistan is among those where lack of adoption to science and technology advancement is a major constraint for Satellite Remote Sensing use in crops and land use land cover digital information generation. Exponential rise in country population, increased food demand, limiting natural resources coupled with migration of rural community to urban areas had further led to skewed official statistics. This study is an attempt to demonstrate the possible use of freely available satellite data like Landsat8 under complex cropping system of Okara district of Punjab, Pakistan. An Integrated approach has been developed for the satellite data based crops and land use/cover spatial area estimation. The resultant quality was found above 96% with Kappa statistics of 0.95. Land utilization statistics provided detail information about cropping patterns as well as land use land cover status. Rice was recorded as most dominating crop in term of cultivation area of around 0.165 million ha followed by autumn maize 0.074 million ha, Fallow crop fields 0.067 million ha and Sorghum 0.047 million ha. Other minor crops observed were potato, fodder and cotton being cultivated on less than 0.010 million ha. Population settlements were observed over an area of around 0.081 million ha of land.

Selection of the most suitable material is one of the key decisions to be taken at the design stage of a manufacturing process. Traditional approaches as Ashby maps based on material properties are widely used in the industry. However, in the production of multimaterial components, the criteria for the selection can include antagonistic approaches. The aim of this work is the implementation of a methodology based on the results of process simulations for several materials and classify them by applying an advanced data analytics method based on Machine Learning (ML), in this case the Support Vector Regression (SVR) and Multi-Criteria Decision Making (MCDM) methodolo-gies, in this case Multi-criteria Optimization and Compromise Solution (VIKOR) combined with Entropy weighting methods. In order to do this, a Finite Element Model (FEM) has been built to evaluate the extrusion force and the die wear in a multi-material co-extrusion process of bimetallic Ti6Al4V-AZ31B billets. After applying SVR and VIKOR combined with Entropy weighting methodologies, a comparison has been established based on the material selection and complexity of the methodology used, resulting that material chosen in both methodologies is very similar and MCDM method is easier to implement because there is no need of evaluate the error of the pre-diction model and the time for data preprocessing is less than the time needed in SVR.

Autonomous navigation in dynamic environments presents a significant challenge for mobile robotic systems. In this paper, we propose a novel approach utilizing Convolutional Neural Networks (CNNs) for multi-object detection in 3D space and 2D segmentation using Bird’s Eye View (BEV) maps derived from 3D LiDAR data. Our method aims to enable mobile robots to localize movable objects and their occupancy, crucial for safe and efficient navigation. To address the scarcity of labeled real-world datasets, a synthetic dataset based on simulation environment is generated to train and evaluate our model. Additionally, we employ a subset of the NVIDIA r2b dataset for evaluation in real-world. Furthermore, we integrate our CNN-based detection and segmentation model into a ROS2-based framework, facilitating communication between mobile robots and a centralized node for data aggregation and map creation. Our experimental results demonstrate promising performance, showcasing the potential applicability of our approach in future assembly systems. While further validation with real-world data is warranted, our work contributes to the advancement of perception systems by proposing a solution for multi-source multi-object tracking and mapping.

The rapidly evolving domain of multimodal sentiment analysis is crucial for unraveling the intricate layers of emotional expression in social media content, customer service interactions, and personal vlogs. This research introduces a cutting-edge Advanced Cross-Modal Gating (ACMG) framework that significantly enhances the precision of sentiment analysis by refining the interplay among textual, auditory, and visual modalities. Our approach addresses three foundational aspects of sentiment analysis: (1) Advanced learning of cross-modal interactions, which focuses on extracting and synthesizing sentiment from varied modal inputs, thus providing a holistic view of expressed emotions; (2) Mastery over the temporal dynamics of multimodal data, enabling the model to maintain context and sentiment continuity over extended interactions; and (3) Deployment of a novel fusion strategy that not only integrates unimodal and cross-modal cues but also dynamically adjusts the influence of each modality based on its contextual relevance to the sentiment being expressed. The exploration of these dimensions reveals that the nuanced modeling of cross-modal interactions is crucial for enhancing model responsiveness and accuracy. By applying the ACMG model to two highly regarded datasets—CMU Multimodal Opinion Level Sentiment Intensity (CMU-MOSI) and CMU Multimodal Opinion Sentiment and Emotion Intensity (CMU-MOSEI)—we achieve groundbreaking accuracies of 83.9\% and 81.1\%, respectively. These results represent significant improvements of 1.6\% and 1.34\% over the current state-of-the-art, showcasing the superior performance and potential of our approach in navigating the complexities of multimodal sentiment analysis.

In order to reduce the vibration of the transporter and improve the stability of the transporter, the vibration characteristics and key structure optimization research of the mountain orchard transporter are carried out. In this paper, the vibration of electric monorail transporters under different working conditions is tested, and the causes of vibration generated by monorail transporter during operation are explored. The three-dimensional model of the trailer and transmission box is established using Solidworks, and the modal vibration modes of the structure are analyzed theoretically. The modal test system is used for modal test analysis of trailers and transmission boxes. By comparing the results of finite element and experimental modal analysis, the second-order frequency of the trailer is close to the motor's rotating excitation frequency of 50 Hz at rated speed, which is easy to generate resonance. By optimizing the structure of the trailer, the second and third natural frequencies are increased to 54.79 Hz and 58.35 Hz respectively, which avoid the resonance of the trailer during operation and effectively reduce the vibration generated during the transportation of the trailer. Through vibration testing of the optimized electric monorail transporter, the results of vibration testing before and after structural optimization are compared and analyzed, and it is found that the vibration amplitudes of the transporter in X, Y and Z directions are reduced by 0.308m/s², 0.351m/s² and 0.334m/s² respectively, the running stability of the conveyer is improved.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

With the rapid development of Internet and the widely usage of smart devices, massive multimedia data are generated, collected, stored and shared on the Internet. This trend makes cross-modal retrieval problem become a hot issue in this years. Many existing works pay attentions on correlation learning to generate a common subspace for cross-modal correlation measurement, and others uses adversarial learning technique to abate the heterogeneity of multi-modal data. However, very few works combine correlation learning and adversarial learning to bridge the inter-modal semantic gap and diminish cross-modal heterogeneity. This paper propose a novel cross-modal retrieval method, named ALSCOR, which is an end-to-end framework to integrate cross-modal representation learning, correlation learning and adversarial. CCA model, accompanied by two representation model, VisNet and TxtNet is proposed to capture non-linear correlation. Beside, intra-modal classifier and modality classifier are used to learn intra-modal discrimination and minimize the inter-modal heterogeneity. Comprehensive experiments are conducted on three benchmark datasets. The results demonstrate that the proposed ALSCOR has better performance than the state-of-the-arts.

A systematic approach for model updating using the modal identification results is proposed. Modal identification provides mode shapes for physical quantities (acceleration strain, etc.) measured in specific directions at the location of the sensors. Besides, model updating involves the use of the mode shapes related to the nodal degrees-of-freedom of the finite element analytic model. Consequently, the mode shapes obtained by modal identification and the mode shapes of the model updating process do not coincide even for the same mode. Therefore, a method constructing transform matrices that distinguish the cases where measurement is done by acceleration, velocity and displacement sensors and the case where measurement is done by strain sensors is proposed to remedy such disagreement between the mode shapes. The so-constructed transform matrices are then applied when the mode shape residual is used as objective function or for mode pairing in the model updating process. The feasibility of the proposed approach is verified by means of a numerical example in which the strain or acceleration of a simple beam is measured and a numerical example in which the strain of a bridge is measured. Using the proposed approach, it is possible to model the structure regardless of the position of the sensors and to select the location of the sensors independently from the model.

Fabry-Pérto (FP) cavity is the essential component of ultra-stable laser (USL) for gravitational wave detection, which couples multi-physic (Optical/Thermal/Mechanics) fields and requires ultra-high precision. To satisfy the requirements of precise and efficient design, a multi-physic coupling optimization method for fixing cubic FP cavity based on data learning is proposed. A multi-physic model for the cubic FP cavity is established and the performance is obtained by finite element analysis. The key performance indices (V, wF, wF) and key design variables (d, l, F) are determined considering the features of the FP cavity. The 49 sets of data by orthogonal experiment are acquired for the establishment and comparison of different data learning models (NN, RSF, KRG). The result turns out that the neural network has the best performance. Based on NSGA-II, the Pareto optimal front is obtained and the optimal combination of design variables is finally determined as {5,32,250}. The performance after optimization has proven to be a great improvement, of which the displacement under the fixing force and vibration test are decreased by more than 60%. The optimization strategy can not only help the design of the FP cavity but also enlighten other optimization fields.

: Polymer single screw extrusion is a major industrial processing technique used to obtain plastics products. To assure high outputs, tight dimensional tolerances, and excellent product performance, extruder screws may show different design characteristics. Barrier screws, which contain a second flight in the compression zone, have become quite popular as they promote and stabilize polymer melting. Therefore, it is important to design efficiently extruder screws and decide whether a conventional screw will do the job efficiently, or a barrier-screw should be considered instead. This work uses multi-objective evolutionary algorithms to design conventional and barrier screws (Maillefer screws will be studied) with optimized geometry. Processing of two polymers, Low Density Polyethylene and Polypropylene, is analyzed. A methodology based on the use of Artificial Intelligence (AI) techniques, namely data mining, decision making and evolutionary algorithms, is presented and utilized to obtain results with practical significance, based on relevant performance measures (objectives) used in the optimization. For the various case studies selected, Maillefer screws were generally advantageous for processing LDPE, while for PP the use of both types of screws would be feasible.

The aim of this study has been to develop a novel two-level multi-objective genetic algorithm (GA) to optimize time series forecasting data for fans used in road tunnels by the Swedish Transport Administration (Trafikverket). Level 1 is for the process of forecasting time series cost data, while level 2 evaluates the forecasting. Level 1 implements either a multi-objective GA based on the ARIMA model or a multi-objective GA based on the dynamic regression model. Level 2 utilises a multi-objective GA based on different forecasting error rates to identify a proper forecasting. Our method is compared with using the ARIMA model only. The results show the drawbacks of time series forecasting using only the ARIMA model. In addition, the results of the two-level model show the drawbacks of forecasting using a multi-objective GA based on the dynamic regression model. A multi-objective GA based on the ARIMA model produces better forecasting results. In level 2, five forecasting accuracy functions help in selecting the best forecasting. Selecting a proper methodology for forecasting is based on the averages of the forecasted data, the historical data, the actual data and the polynomial trends. The forecasted data can be used for life cycle cost (LCC) analysis.

Ensuring the accuracy of wind power prediction is paramount for the reliable and stable operation of power systems. This study introduces a novel approach aimed at enhancing the precision of wind power prediction through the development of a multiscale hybrid model. This model integrates advanced methodologies including Improved Intrinsic Mode Function with Ensemble Empirical Mode Decomposition with Adaptive Noise (ICEEMDAN), Permutation Entropy(PE), Least Squares Support Vector Regression (LSSVR), Regularized Extreme Learning Machine(RELM), Multi-head Attention (MHA), and Bidirectional Gated Recurrent Unit (BiGRU). Firstly, the ICEEMDAN technique is employed to decompose the non-stationary raw wind power data into multiple relatively stable sub-modes, while concurrently utilizing PE to assess the complexity of each sub-mode. Secondly, the dataset is reconstituted into three distinct components: high-frequency, mid-frequency, and low-frequency, to alleviate data complexity. Following this, the LSSVR, RELM, and MHA-BiGRU models are individually applied to predict the high, mid,and low-frequency components, respectively. Thirdly, the parameters of the low-frequency prediction model are optimized utilizing the Dung Betele Optimizer(DBO) algorithm. Ultimately, the predicted results of each component are aggregated to derive the final prediction. Empirical findings illustrate the exceptional predictive performance of the multiscale hybrid model incorporating LSSVR, RELM,and MHA-BiGRU. In comparison to other benchmark models, the proposed model exhibits a reduction in Root Mean Square Error(RMSE) values of over 10%, conclusively affirming its superior predictive accuracy.

The meticulously engineered powertrain mounting system of hybrid-electric vehicles plays a critical role in minimizing vehicle vibrations and noise, thereby enhancing the longevity of vital powertrain components. However, developing and designing such a system demands substantial time and financial investments due to intricate analysis and modeling requirements. To tackle this challenge, this study integrates data-mining technology into the design and optimization processes of the powertrain mount system. The research focuses on the powertrain mounting system of a transverse four-cylinder hybrid-electric vehicle, employing the CRISP-DM (Cross-Industry Standard Process for Data Mining) methodology to establish a data-mining prediction model for mounting stiffness. This model utilizes three data mining algorithms—Multi-SVR, MRTs, and MLPR—assessing their predictive accuracy concerning mounting system stiffness estimation. A comparative analysis reveals that the MRTs algorithm outperforms others as the most effective prediction model. The proposed predictive model elucidates the quantifiable correlation between vibration isolation performance and installation stiffness, overcoming complexities associated with traditional modeling approaches. Applying this model in powertrain mounting system design showcases the efficacy of the CRISP-DM-based approach, significantly enhancing design efficiency without compromising prediction accuracy.

Masons are often overlooked part of impact basins, but play an important role in revealing the lunar history. Previous study in masons were usually limited to gravity data. Few researches were reported on morphology features and chronology, which hampers the construction of a complete geological interpretation for the evolution of each mascons. We use multi source remote sensing data to identify the details characteristic of mascons. Result of topography, gravity and characteristic are combined to prove that a mason beside Copernicus crater is a buried peak-ring basin which is about 130km and 260km in diameter. The underground structure is of confirmed as 890m thick mare basalts by analyzing the spectral feature of the material in a geological outcrop called Copernicus H. Geology evolution analysis joint crater size-frequency distribution (CSDF) dating demonstrate that the buried basin impact event occurred in 3.6Ga. Then a hawaiian-style eruption in late Imbrian formed Sinus Aestuum Ⅰ Dark Mantling Deposit (DMD). Mare basalts filling in 3.4Ga. After that, ejecta from Copernicus impact event in about 820Ma and weathering processes cause the disappearing from lunar surface of the buried basin.

Urban form is associated with both socio-economic and urban physical properties. This study explores the differences among urban forms in the Seoul Metropolitan Region with a comparison between census-based socioeconomic variables and landscape metrics computed from remotely sensed data. To accomplish this, factor analysis and multi-dimensional scaling were used with the selected variables and metrics. When all of the measures are considered together, four types of cities and towns emerged: 1) exurban-fragmented high growth, 2) exurban-fragmented low growth, 3) compact-extensive urban core and 4) sub-urban compact-high growth. The results indicate that the fusion of knowledge of the physical urban layout and that of socio-economic characteristics is beneficial for a better understanding of urban spatial patterns. However, there remain challenges in delineating each urbanized area and with indicator selection for comparing urban form across cities and towns.

The deployment of Artificial Intelligence (AI) systems in decentralized environments is on the rise, yet representation of shared conceptualization in such scenarios remains a challenging issue. The absence of a shared understanding can lead to suboptimal performance of AI systems and hinders the ability to comprehend the knowledge and beliefs of agents in the domain. This paper proposes a formal model for modeling conceptualization in AI systems that integrates ontology, epistemology, and epistemic logic. The model aims to address the gap in representing shared conceptualization in decentralized environments and enhance the performance of AI systems operating in such environments. The proposed model is a hybrid structure that blends extensional and intensional structures and leverages logic-based languages for modeling purposes. A case study in the healthcare sector is presented to illustrate the application of the proposed model. The study contributes to the existing literature by providing a formal model for representing shared conceptualization in decentralized environments, which can be utilized to optimize the performance of AI systems in these environments.

In this article authors shows chosen problems of technical state diagnosis with the use of identification and technical diagnostics methods such as experimental modal analysis. Relations between methods of dynamic state evaluation and methods of technical state evaluation were indicated. Example modal analysis results illustrate the complexity of projecting dynamic state researches into diagnostic researches of state evaluation.

The generation of vortices around bridge piers can lead to removal of riverbed materials from around piers, especially during flood events and heavy rainfalls, which can compromise the stability of the bridge and consequently its failure, if not properly detected and mitigated. Bridge failures pose serious threats to the local socio-economic and public safety and can cost lives. As such, real-time monitoring and early warning systems for scour-induced bridge failure can serve as a vital tool to protect the community and civil infrastructure against disastrous events. Vibration-base monitoring of bridge scour is an attractive option due to its low cost and relatively easy installation without the need to block the road and close the bridge to traffic. While limited number of previous studies have shown the capabilities of acceleration-based monitoring techniques in this area of research, they generally lack a rigorous framework for data analysis within and relating those to evaluate scour. This paper is an attempt to provide such framework that would enable a fast and low-cost analysis of vibration data within a physical modelling study on a simplified bridge pier. To achieve this, three experiments were conducted on an ideal single-pier scaled model bridge in a hydraulic flume, where water flows at a velocity near the critical velocity for the sand bed which in turn generates a scour hole around the pier. Then, the vibration data recorded using two mounted wireless accelerometers, were used to conduct an operational modal analysis through which the natural frequencies are extracted. The extracted natural frequencies and measured scour depths are then used to provide a chart that relates these two parameters. The results of this study showed the promising capability of the vibration-based data analysis in finding this relationship, indicating an up to around 30-50% reduction in natural frequencies as a result of around 50% scour ratio (ratio of maximum scour depth to buried depth), and beyond 50% scour ratio the natural frequencies remain constant. While the data presented in this paper are preliminary, they clearly show a promising potential for application in real-time monitoring of bridge stability under the effect of local scour and further works are underway to enrich the experimental data and empower the proposed methodologies at the laboratory scale.

Visual question answering (VQA) is receiving increasing attention from researchers in both the computer vision and natural language processing fields. There are two key components in the VQA task: feature extraction and multi-modal fusion. For feature extraction, we introduce a novel co-attention scheme by combining Sentence-guide Word Attention (SWA) and Question-guide Image Attention (QIA) in a unified framework. To be specific, the textual attention SWA relies on the semantics of the whole question sentence to calculate contributions of different question words for text representation. For the multi-modal fusion, we propose a “Cross-modal Multistep Fusion (CMF)” network to generate multistep features and achieve multiple interactions for two modalities, rather than focusing on modeling complex interactions between two modals like most current feature fusion methods. To avoid the linear increase of the computational cost, we share the parameters for each step in the CMF. Extensive experiments demonstrate that the proposed method can achieve competitive or better performance than the state-of-the-art.

A stable driver state is essential in the process of manually transition control, which inevitably occurs in Level 3 automated driving situations. To this end, this paper proposed a CNN algorithm-based driver state monitoring system that uses multi-sensor data such as driver's face image, biometric information, and vehicle behavior information as input. This system calculates the probability of drowsiness for each of the four time periods using a convolutional neural network (CNN) based on ToF camera-based eye blinking, ECG information (pulse rate) embedded in the steering wheel, and vehicle information (steering angle data). In order to build a reliable and high-quality training dataset (Ground Truth) for the CNN algorithm, a baseline was established by matching the driver's face image with the electrocardiogram (ECG) and electroencephalogram (EEG) changes in the drowsy and normal states. In a simulation test of the proposed CNN algorithm using more than 20,000 driver image data acquired using a driving simulator, the TNR was 94.8% and the accuracy was 94.2%. Our proposed method is expected to minimize human errors that may occur when switching control by monitoring inappropriate driver state (drowsiness) in real time.

Modal testing is a common step in aerostructure design, serving to validate the predicted natural frequencies and mode shapes obtained through computational methods. The strategic placement of sensors during testing is crucial to accurately measuring the intended natural frequencies. However, conventional methodologies for sensor placement are often time-consuming and involve iterative processes. This study explores the potential of machine learning techniques to enhance sensor selection methodologies. Three machine learning-based approaches are introduced and assessed, comparing their efficiency with established techniques. The evaluation of these methodologies is conducted using a numerical model of a beam to simulate real-world scenarios. The results offer insights into the efficacy of machine learning in optimizing sensor placement, presenting an innovative perspective on enhancing the efficiency and precision of modal testing procedures in aerostructure design.

In this study, a matched-mode autoregressive source depth estimation method (MMAR) based on autoregressive (AR) wavenumber estimation is proposed for a moving source in shallow water waveguides. The signal original frequency and the environmental parameters, namely, the sound speed profile and bottom properties are known as a prior knowledge. The mode wavenumbers are estimated by the AR modal wavenumber spectrum. On the basis of the mode wavenumber estimation, the mode amplitudes can be estimated by the wavenumber spectrum that is obtained by generalized Hankel transform. The source depth estimation is determined by the peak of source depth function wherein the data mode best matches the replica mode that is calculated using a propagation model. Compared with other methods of moving source depth estimation, the proposed method exhibits a better performance in source depth estimation under low signal-to-noise ratio or the small range span. The selection of horizontal line array depth is illustrated by simulation and normal mode theory in details.

In developing nations, such as Ekiti State, Nigeria, the use of remote sensing data, especially satellite and UAV imagery, remains significantly underutilized in land administration. This limits the potential of multi-resolution imagery in land governance and socio-economic development. This study examines factors influencing UAV adoption for land administration in Nigeria, mapping six distinct rural, peri-urban, and urban sites, and creating orthomosaics with resolutions ranging from 2.2cm to 3.39cm. Boundaries were manually delineated from multi-resolution orthomosaics to acquire coordinates, and parcel areas were calculated. Using 0.05m UAV imagery as the reference, the Root Mean Square Error (RMSE) was computed to evaluate 0.1, 0.5, and 1m orthomosaics' accuracy for boundary delineation across the six geographical contexts. The Normalized Parcel Area Error (NPAE) was also calculated to determine how the multi-resolution imageries affected the property areas. Results showed a consistent increase in error with increasing resolution (0.1m to 1m) in formal areas (Igedora, Maryland, Okebola) with physical demarcations, from 0.117m to 1.747m RMSE. In contrast, informal settlements exhibited inconsistent error values, indicating a differing impact of resolution on error between formal and informal areas. The research demonstrates the role of physical demarcations in facilitating cadastral mapping, with formal settlements demonstrating the highest suitability. This study recommends the use of imagery resolution specific to each context, offering guidance for improved land governance. Implications and recommendations include promoting awareness of settlement typologies in aerial imagery use for cadastral mapping, leveraging UAVs for high-resolution aerial imagery, and addressing regulatory challenges to promote UAV adoption. Finally, the RMSE and NPAE values can serve as metrics for assessing different resolution images’ fitness for cadastral mapping.

Recent advances in satellite technology have brought enormous potential to ecosystem mapping, which is one of the fundamental components of environmental studies. In this paper, a Random Forest classifier is applied for the strict assessment of the efficiency of ecosystem mapping through a detailed comparative analysis between combined Sentinel-1 and Sentinel-2 data and stand-alone Sentinel-2 imagery over three priority ecosystems, including wetlands, riverine areas, and mangroves in Bangladesh. The collocated images, based on the integration of Sentinel-1 data with Sentinel-2 data, would do better than Sentinel-2 imagery alone over various ecosystems. Particularly, in this study, attention focused on the Hakaluki Haor area for the wetlands, the Padma-Jamuna River confluence for the riverine ecosystem, and the Sundarban forest for mangroves. By leveraging Synthetic Aperture Radar (SAR) data in C-band dual-polarization from Sentinel-1 and four spectral bands (blue, green, red, and near-infrared) from Sentinel-2, the study analyzes imagery from December 2022 to February 2023. A 5% cloud masking filter is applied to optical data to enhance accuracy. In this methodology, 70% of the total signature values are used for training the classification model and the remaining 30% for testing. It can be noticed from the results that with the use of fused data, remarkably high accuracy in classification has been improved, such as overall accuracies of 94.17% for mangroves, 87.30% for riverine, and 85.96% for wetland ecosystems. In contrast, the use of singular Sentinel-2 imagery yields lower accuracies of 91.56%, 85.21%, and 82.51% for the respective ecosystems. The integration of radar data is shown to provide critical information, especially in environments with dense vegetation or cloud cover, where optical data alone may be insufficient. The findings of this study underline the limitations of relying on Sentinel-2 imagery to capture complex details of diverse ecosystems and highlight the need to include Sentinel-1 data for a more holistic analysis. This fusion allows improved accuracy to be achieved, which not only brings in more depth of ecological knowledge but also underpins more effective conservation strategies.

Pseudo-nitzschia spp. blooms are a recurrent problem in many coastal areas globally imposing some significant threats to the health of human, ecosystems and economy. Monitoring programmes have been established, where feasible, to mitigate the impacts caused by Pseudo-nitzschia spp. and other harmful algae blooms. The detection of such blooms from satellite data could really provide timely information on emerging risks but the development of taxa-specific algorithms from available multispectral data is still challenged by coupled optical properties with other taxa and water constituents, availability of ground data and generalisation capabilities of algorithms. Here, we developed a new set of algorithms (PNOI) for the detection and monitoring of Pseudo-nitzschia spp. blooms over the Galician coast (NW Iberian Peninsula) from Sentinel-3 OLCI reflectances using support vector machine (SVM). Our algorithm was trained and tested with reflectance data from 260 OLCI images and 4607 Pseudo-nitzschia spp. match up data points, of which 2171 were of high quality. The performance of no bloom/bloom model in the independent test set was robust, showing values of 0.80, 0.72 and 0.79 for area under the curve (AUC), sensitivity and specificity, respectively. Similar results were obtained by our below detection limit/presence model. We also present different model thresholds based on optimisation of true skill statistic (TSS) and F1-score. PNOI outperforms linear models, while its relationship with in-situ chlorophyll-a concentrations is weak demonstrating poor correlation with the phytoplankton abundance. We showcase the importance of PNOI algorithm and OLCI sensor for monitoring the bloom evolution between the weekly ground sampling and during periods of ground data absence, such as due to Covid-19.

Mapping forest extent and forest cover classification are important for the assessment of forest resources in socio-economic as well as ecological terms. Novel developments in the availability of remotely sensed data, computational resources, and advances in areas of statistical learning have enabled fusion of multi-sensor data, often yielding superior classification results. Most former studies of nemoral forests fusing multi-sensor and multi-temporal data have been limited in spatial extent and typically to a simple classification of landscapes into major land cover classes. We hypothesize that multi-temporal, multi-censor data will have a specific strength in further classification of nemoral forest landscapes owing to the distinct seasonal patterns of the phenology of broadleaves. This study aimed to classify the Danish landscape into forest/non-forest and further into forest types (broadleaved/coniferous) and species groups, using a cloud-based approach based on multi-temporal Sentinel 1 and 2 data and machine learning (random forest) trained with National Forest Inventory (NFI) data. Mapping of non-forest and forest resulted in producer accuracies of 99% and 90 %, respectively. The mapping of forest types (broadleaf and conifer) within the forested area resulted in producer accuracies of 95% for conifer and 96% for broadleaf forest. Tree species groups were classified with producer accuracies ranging 34-74%. Species groups with coniferous species were the least confused whereas the broadleaf groups, especially Oak, had higher error rates. The results are applied in Danish National accounting of greenhouse gas emissions from forests, resource assessment and assessment of forest biodiversity potentials.

In recent decades, with the ever-growing scale of video data, near-duplicate videos continue to emerge. Data quality issue caused by near-duplicate videos is becoming more and more prominent, which has affected the application of normal videos. Although current studies on near-duplicate video detection can be helpful to uncover data quality issues for videos, they still lack a process of automatic merging for the video data represented by high-dimensional features, which are difficult to automatically clean the near-duplicate videos to improve data quality for video datasets. At present, there are few studies on near-duplicate video data cleaning. The existing studies have the sensitive problems of video data orderliness and clustering initial center under a condition that prior distribution is unknown, which seriously affect the accuracy of near-duplicate video data cleaning. To address the above issues, an automatic near-duplicate video data cleaning method based on a consistent feature hash ring is proposed in this paper. First, a residual network with convolutional block attention modules, a long short-term memory deep network, and an attention model are integrated to construct an RCLA deep network with the multi-headed attention mechanism to extract spatiotemporal features of video data. Then, a consistent feature hash ring is constructed, which can effectively alleviate the sensitivity of video data orderliness while providing a condition of near-duplicate video merging. To reduce the sensitivity of the initial cluster centers to results of near-duplicate video cleansing, an optimized feature distance-means clustering algorithm is constructed by utilizing a mountain peak function on a consistent feature hash ring, which can implement automatic cleaning of near-duplicate video data. Finally, experiments are conducted based on a commonly used dataset named CC_WEB_VIDEO and a coal mining video dataset. Compared with some existing works, simulation results demonstrate that the performance of the proposed method.

Multi-Faith Spaces (MFS) are a relatively recent invention that quickly gained in significance. On the one hand, they offer a convenient solution for satisfying needs of people with diverse beliefs in the institutional context of hospitals, schools, airports, etc. On the other hand, as Andrew Crompton pointed out, they are politically significant because the multi-faith paradigm “is replacing Christianity as the face of public religion in Europe” (2012, p. 493). Due to their ideological entanglement, MFS are often used as the means to promote either a more privatised version of religion, or a certain denominational preference. Two distinct designs are used to achieve these means: negative in the case of the former, and positive in the latter. Neither is without problems, and neither adequately fulfils its primary purpose of serving diverse groups of believers. Both, however, seem to follow the biases and main problems of secularism. In this paper, I analyse recent developments of MFS to detail their main problems and answer the question, whether the MFS, and the underlying Multi-Faith Paradigm, can be classified as a continuation of secularism.

Impervious surface mapping with high-resolution remote sensing imagery has attracted increasing interest as it can provide detailed information for urban structure and distribution. Previous studies have suggested that the combination of LiDAR data and high-resolution imagery for impervious surface mapping performs better than using only high-resolution imagery. However, due to the high cost of the acquisition of LiDAR data, it is difficult to obtain the multi-sensor remote sensing data acquired at the same acquisition time for impervious surface mapping. Consequently, real landscape changes between multi-sensor remote sensing data at different acquisition times would lead to the error of misclassification in impervious surface mapping. This issue has mostly been neglected in previous works. Furthermore, the observation differences generated from multi-sensor data, including the problems of misregistration, missing data in LiDAR data, and shadow in high-resolution images would also challenge the final mapping result in the fusion of LiDAR data and high-resolution images. In order to conquer these problems, we propose an improved impervious surface mapping method incorporating both LiDAR data and high-resolution imagery at different acquisition times in consideration of real landscape changes and observation differences. In the proposed method, a multi-sensor change detection by supervised multivariate alteration detection is employed to obtain changed areas and misregistration areas. The no-data areas in the LiDAR data and the shadow areas in the high-resolution imagery are extracted by independent classification yielded by its corresponding single sensor data. Finally, an object-based post-classification fusion is proposed to take advantage of independent classification results with single-sensor data and the joint classification result with stacked multi-sensor data. Experiments covering the study site in Buffalo, NY, USA demonstrate that our method can accurately detect landscape changes and obviously improve the performance of impervious surface mapping.