In order to perform multi-degree-of-freedom motion measurements of marine machinery such as ship-borne mechanical platform in an absolute environment without a reference, absolute measurement methods using acceleration sensors and tilt gyroscopes are typically employed. However, due to the influence of wave forces on ship-borne mechanical platform, the coupling between different degrees of freedom can cause mutual interference, resulting in significant sensor measurement disturbances that make efficient computation and real-time analysis challenging. Specifically, when ship-borne mechanical platform swings, the proof mass of the acceleration sensor produces an undesirable signal output in the vertical direction, which leads to imprecise acceleration integration, thereby affecting accurate motion collection and posture estimation. To address these challenges, by analyzing the influence of the inclination angle of the ship-borne mechanical platform on the sensor measurement, and using the working principle of the acceleration sensor and angle sensor, a correction method for the motion measurement of the ship-borne mechanical platform based on multi-sensor fusion is proposed. In this article, we first analyze the influence of inclination angle on the integral effect in the heave direction. Then the configuration using four groups of acceleration sensors to correct the integral effect is proposed. Finally, the optimal inclination angle is determined through Kalman filtering based on the measured value of angle sensors and estimated values from the acceleration sensor sets. Experiments have proved that the average error of the corrected heave displacement signal is 25.34 mm, which is better than the integral displacement signal of a single acceleration sensor. At the same time, the acceleration sensor is used to calculate the roll angle and pitch angle of the ship-borne mechanical platform, and combined with the angle sensor signal to perform Kalman filtering, which filters out the errors caused by the shaking and instability of the mechanical platform, and can more accurately estimate the true inclination of the platform. Therefore, this method can enhance the precision and accuracy of the ship-borne mechanical platform motion signal acquisition, providing more valuable experimental data for research in marine engineering and related fields.

In this work, we show that a late fusion approach to multi-modality in sign language recognition improves the overall ability of the model in comparison to the singular approaches of Computer Vision (88.14%) and Leap Motion data classification (72.73%). With a large synchronous dataset of 18 BSL gestures collected from multiple subjects, two deep neural networks are benchmarked and compared to derive a best topology for each. The Vision model is implemented by a CNN and optimised MLP and the Leap Motion model is implemented by an evolutionary optimised deep MLP topology search. Next, the two best networks are fused for synchronised processing which results in a better overall result (94.44%) since complementary features are learnt in addition to the original task. The hypothesis is further supported by application of the three models to a set of completely unseen data where a multi-modality approach achieves the best results relative to the single sensor method. When transfer learning with the weights trained via BSL, all three models outperform standard random weight distribution when classifying ASL, and the best model overall for ASL classification was the transfer learning multi-modality approach which scored 82.55% accuracy.

We propose a multi-sensor fusion localization framework for autonomous heavy-duty trucks suitable for mining scenarios, which enables high-precision, real-time trajectory generation and map construction. The motion estimated through pre-integration of the Inertial Measurement Unit (IMU) can eliminate distortions in the point cloud and provide an initial guess for LiDAR odometry optimization. The point cloud information obtained from LiDAR can assist in recovering depth information from image features extracted by the monocular camera. To ensure real-time performance, we introduce an iKD-Tree to organize the point cloud data. To address issues arising from bumpy road segments and long-distance driving in practical mining scenarios, we can incorporate a large number of relative and absolute measurements from different sources, such as GPS information and AprilTag-assisted localization data, including loop closure as factors in the system. The proposed method has been extensively evaluated on public datasets and self-collected datasets from mining sites.Our implementation is available at https://github.com/wangyicxy/iLM-slam

In the autonomous navigation of mobile robots, precise positioning is crucial. In forest environments with weak satellite signals or in sites disturbed by complex environments, satellite positioning accuracy has difficulty in meeting the requirements of autonomous navigation positioning accuracy for robots. This article proposes a binocular vision SLAM/UWB tightly coupled localization method. The core of this algorithm is based on an Extended Kalman Filter (EKF), which utilizes the displacement increment output by binocular vision ORB-SLAM and the positioning coordinates calculated via UWB positioning as measurement information to achieve data fusion. The research utilized the constructed experimental platform to collect images and UWB ranging data in outdoor environments and experimentally validated the combined positioning method. The experimental results show that this algorithm outperforms the use of the individual UWB or visual SLAM localization methods in terms of positioning accuracy. Compared with traditional single positioning algorithms, this algorithm exhibits better practicality and stability, and can effectively suppress the impact of UWB non line of sight errors. The average error under normal line of sight conditions is 0.058 m, the root mean square error (RMSE) is 0.080, and the average error under non-line-of-sight conditions is 0.081 m, with an RMSE of 0.084. There is no significant jump or drift. Through the tightly coupled processing of binocular vision SLAM and UWB positioning, more reliable and accurate mobile robot positioning can be achieved, providing a useful reference for the autonomous navigation of mobile robots in complex environments.

Use of a multi-sensor approach can provide citizens a holistic insight in the air quality in their immediate surroundings and assessment of personal exposure to urban stressors. Our work, as part of the ICARUS H2020 project, which included over 600 participants from 7 European cities, discusses data fusion and harmonization on a diverse set of multi-sensor data streams to provide a comprehensive and understandable report for participants, and offers possible solutions and improvements. Harmonizing the data streams identified issues with the used devices and protocols, such as non-uniform timestamps, data gaps, difficult data retrieval from commercial devices, and coarse activity data logging. Our process of data fusion and harmonization allowed us to automate the process of generating visualizations and reports and consequently provide each participant with a detailed individualized report. Results showed that a key solution was to streamline the code and speed up the process, which necessitated certain compromises in visualizing the data. A thought-out process of data fusion and harmonization on a diverse set of multi-sensor data streams considerably improved the quality and quantity of data that a research participant receives. Though automatization accelerated the production of the reports considerably, manual structured double checks are strongly recommended.

Sensitivity to weather conditions, and specially to clouds, is a severe limiting factor to the use of optical remote sensing for Earth monitoring applications. A possible alternative, is to resort to weather-insensitive synthetic aperture radar (SAR) images. However, in many real-world applications, critical decisions are made based on some informative spectral features, such as water, vegetation or soil indices, which cannot be extracted from SAR images. In the absence of optical sources, these data must be estimated. The current practice is to perform linear interpolation between data available at temporally close time instants. In this work, we propose to estimate missing spectral features through data fusion and deep-learning. Several sources of information are taken into account - optical sequences, SAR sequences, DEM - so as to exploit both temporal and cross-sensor dependencies. Based on these data, and a tiny cloud-free fraction of the target image, a compact convolutional neural network (CNN) is trained to perform the desired estimation. To validate the proposed approach, we focus on the estimation of the normalized difference vegetation index (NDVI), using coupled Sentinel-1 and Sentinel-2 time-series acquired over an agricultural region of Burkina Faso from May to November 2016. Several fusion schemes are considered, causal and non-causal, single-sensor or joint-sensor, corresponding to different operating conditions. Experimental results are very promising, showing a significant gain over baselines methods according to all performance indicators.

In the mold machining process, the cutting tool is worn with machining time, thereby affecting the surface accuracy, leading to poor workpiece dimensions, even fracture. At present, many studies have used multiple sensors to detect the machining conditions of cutting tool and workpiece, including indirect measurement method and direct measurement method. The indirect measurement method, which has been studied widely, mainly uses sensors to capture signals for subsequent data analysis; the direct measurement method mainly analyzes the state of cutting shear zone. Due to the cut-in of cutting tool in the machining process, the workpiece is dislocated rapidly, generating considerable amount of heat, which is transferred to the chips, inducing color change on the surface of chips. Many engineers with machining experience often judge the machining state and tool life according to the chips. The engineers' experience is digitized in this study, and indirect measuring sensors are used to predict the tool life, so as to attain the objective for smart manufacturing, the average percentage error of MAPE using single vibration and voltage eigenvalues as input features is 10%, the voltage signal characteristic values and vibration signal characteristic values are combined. Finally, the chip surface chromaticity eigenvalue is combined with signal characteristic value. The average prediction error of BP-LM method is 7.85%, the average prediction error of GRNN method is 6.59%. Therefore, when the eigenvalue of chip surface chromaticity is added to the prediction result, it can enhance the accuracy of cutting tool wear value prediction more effectively than single sensor signal characteristic value.

With the rapid development of Intelligent Transportation Systems (ITS), vehicle type classification, as a key link in Automatic Toll Collection systems (ATC), is of great significance in improving traffic efficiency and reducing economic losses. This study proposes an intelligent vehicle classification system based on deep learning and multi-sensor data fusion to address the accuracy issues existing in vehicle classification methods based on optical sensors (OS) and human observers. The system significantly improves the accuracy and robustness of vehicle classification by combining deep Convolutional Neural Networks (CNN), LiDAR sensors, and machine learning algorithms. We first constructed a large-scale annotated dataset containing multiple vehicle types and complex traffic scenes to improve our model's capability to identify different vehicle characteristics. Next, CNN models based on different architectures were designed to extract global and local features of the vehicle, respectively. In addition, the LiDAR sensor was used to achieve the spatial structure architectures of the vehicle and combined with the output of the CNN model to improve classification performance under occlusion and complex scenes.

Sensor fusion algorithms and models have been widely used in recent times. Although research evidence has informed the use of sensor fusion models in diverse applications, there is room for improvement, especially in home-based health monitoring applications which require less supervision and technical knowledge of users. The present work compares data mining-based fusion software packages such as RapidMiner Studio, Anaconda, Weka, and Orange, and proposes a data fusion framework suitable for in-home applications. 574 privacy-friendly (binary) images and 1,722 datasets gleaned from thermal and Radar sensing solutions respectively, were fused using the software packages on instances of homogeneous and heterogeneous data aggregation. Experimental results indicated that the proposed fusion framework achieved an average Classification Accuracy of 84.7% and 95.7% on homogeneous and heterogeneous datasets respectively, with the help of data mining and machine learning models such as Naïve Bayes, Decision Tree, Neural Network, Random Forest, Stochastic Gradient Descent, Support Vector Machine, K-Nearest Neighbours and CN2 induction. Further evaluation of the sensor data fusion framework based on cross validation of features indicated average values of 94.4% for Classification Accuracy, 95.7% Precision and 96.4% for Recall.

The robust fusion estimation problem of a multi-sensor system with communication constraints, random packet drops, d-step state delays, and deterministic control inputs is investigated. The state augmentation method is used to transform the time delay system into a non-time delay system, and then a robust fusion estimation algorithm based on sensitivity penalty is proposed and the pseudo-cross-covariance matrix is updated. An event-triggered robust fusion estimator with state delay and deterministic control inputs is considered to make the model closer to reality while effectively reducing network congestion and lowering communication costs. Conditions are given to ensure that the estimation errors of the robust fusion estimator are uniform boundedness. Two sets of numerical simulations are provided to illustrate the effectiveness of the derived fusion estimator.

Recent advances in satellite technology have brought enormous potential to ecosystem mapping, which is one of the fundamental components of environmental studies. In this paper, a Random Forest classifier is applied for the strict assessment of the efficiency of ecosystem mapping through a detailed comparative analysis between combined Sentinel-1 and Sentinel-2 data and stand-alone Sentinel-2 imagery over three priority ecosystems, including wetlands, riverine areas, and mangroves in Bangladesh. The collocated images, based on the integration of Sentinel-1 data with Sentinel-2 data, would do better than Sentinel-2 imagery alone over various ecosystems. Particularly, in this study, attention focused on the Hakaluki Haor area for the wetlands, the Padma-Jamuna River confluence for the riverine ecosystem, and the Sundarban forest for mangroves. By leveraging Synthetic Aperture Radar (SAR) data in C-band dual-polarization from Sentinel-1 and four spectral bands (blue, green, red, and near-infrared) from Sentinel-2, the study analyzes imagery from December 2022 to February 2023. A 5% cloud masking filter is applied to optical data to enhance accuracy. In this methodology, 70% of the total signature values are used for training the classification model and the remaining 30% for testing. It can be noticed from the results that with the use of fused data, remarkably high accuracy in classification has been improved, such as overall accuracies of 94.17% for mangroves, 87.30% for riverine, and 85.96% for wetland ecosystems. In contrast, the use of singular Sentinel-2 imagery yields lower accuracies of 91.56%, 85.21%, and 82.51% for the respective ecosystems. The integration of radar data is shown to provide critical information, especially in environments with dense vegetation or cloud cover, where optical data alone may be insufficient. The findings of this study underline the limitations of relying on Sentinel-2 imagery to capture complex details of diverse ecosystems and highlight the need to include Sentinel-1 data for a more holistic analysis. This fusion allows improved accuracy to be achieved, which not only brings in more depth of ecological knowledge but also underpins more effective conservation strategies.

A stable driver state is essential in the process of manually transition control, which inevitably occurs in Level 3 automated driving situations. To this end, this paper proposed a CNN algorithm-based driver state monitoring system that uses multi-sensor data such as driver's face image, biometric information, and vehicle behavior information as input. This system calculates the probability of drowsiness for each of the four time periods using a convolutional neural network (CNN) based on ToF camera-based eye blinking, ECG information (pulse rate) embedded in the steering wheel, and vehicle information (steering angle data). In order to build a reliable and high-quality training dataset (Ground Truth) for the CNN algorithm, a baseline was established by matching the driver's face image with the electrocardiogram (ECG) and electroencephalogram (EEG) changes in the drowsy and normal states. In a simulation test of the proposed CNN algorithm using more than 20,000 driver image data acquired using a driving simulator, the TNR was 94.8% and the accuracy was 94.2%. Our proposed method is expected to minimize human errors that may occur when switching control by monitoring inappropriate driver state (drowsiness) in real time.

Aiming at the problems that are poor generalization performance, low retrieval accuracy and large time consumption of existing content-based image retrieval system, the hierarchical image retrieval method based on multi feature fusion is proposed in this paper. The retrieval accuracy rates on Corel5K, UKbeach and Holidays are 68.23(Top 1), 3.73(N-S) and 88.20(mAp), respectively. The experimental results show that the method proposed in this paper can effectively improve the deficiency of single feature retrieval and save time significantly in the premise of a small amount of loss of accuracy.

Pedestrian multi-target tracking technology plays an important role in artificial intelligence, driverless, virtual reality and other fields. The pedestrian multi-target tracking algorithm DeepSORT based on detection is widely used in industry. It mainly tracks multiple pedestrian targets continuously and keeps their ID unchanged. In order to improve the applicability and tracking accuracy of DeepSORT algorithm, this paper improved the IOU distance measurement in the matching process. At the same time, ResNet50 is used as the feature extraction backbone network, and combined with FPN (Feature Pyramid Network), the appearance features of multi-layer pedestrians are fused to improve the tracking accuracy of DeepSORT algorithm. The proposed algorithm is verified on the public data set MOT-16 and it’s tracking accuracy is enhanced to 4.1%.

A method for infrared and cameras sensor fusion, applied to indoor positioning in intelligent spaces, is proposed in this work. The fused position is obtained with a maximum likelihood estimator from infrared and camera independent observations. Specific models are proposed for variance propagation from infrared and camera observations (phase shifts and image respectively) to their respective position estimates and to the final fused estimation. Model simulations are compared with real measurements in a setup designed to validate the system. The difference between theoretical prediction and real measurements is between 0.4 cm (fusion) and 2.5 cm (camera), within a 95% confidence margin. The positioning precision is in the cm level (sub-cm level can be achieved at most tested positions) in a 4x3 m locating cell with 5 infrared detectors on the ceiling and one single camera, at distances from target up to 5 m and 7 m respectively. Due to the low cost system design and the results observed, the system is expected to be feasible and scalable to large real spaces.

Sensor fusion technology is one of extensive used methods in the field of robot, aerospace and target tracking control. In this paper, the generalized sensor fusion framework, named the closed-loop fusion (CLF) is analyzed and the optimal design principle of filter is proposed in detail. Fusion error optimization problem, which is the core issue of fusion design, is also solved better through the feedback compensation law of CLF framework. Differently from conventional methods, the fusion filter of CLF can be optimally designed and the determination of superposition of fusion information is avoided. To show the validity, simulation and experimental results are to be submitted.

Recent deep learning frameworks draw a strong research interest in the application of ego-motion estimation as they demonstrate a superior result compared to geometric approaches. However, due to the lack of multimodal datasets, most of these studies primarily focused on a single sensor-based estimation. To overcome this challenge, we collect a unique multimodal dataset named LboroAV2, using multiple sensors including camera, Light Detecting And Ranging (LiDAR), ultrasound, e-compass and rotary encoder. We also propose an end-to-end deep learning architecture for fusion of RGB images and LiDAR laser scan data for odometry application. The proposed method contains a convolutional encoder, a compressed representation and a recurrent neural network. Besides feature extraction and outlier rejection, the convolutional encoder produces a compressed representation which is used to visualise the network's learning process and to pass useful sequential information. The recurrent neural network uses this compressed sequential data to learn the relation between consecutive time steps. We use the LboroAV2 and KITTI VO datasets to experiment and evaluate our results. In addition to visualising the network's learning process, our approach gives superior results compared to other similar methods. The code for the proposed architecture is released in GitHub and accessible publicly.

This paper presents a new and enhanced fusion module for the Multi-Sensor Precipitation Estimator (MPE) that would objectively blend real-time satellite quantitative precipitation estimates (SQPE) with radar and gauge estimates. This module consists of a preprocessor that mitigates systematic bias in SQPE, and a two-way blending routine that statistically fuses adjusted SQPE with radar estimates. The preprocessor not only corrects systematic bias in SQPE, but also improves the spatial distribution of precipitation based on SQPE and makes it closely resemble that of radar-based observations. It uses a more sophisticated radar-satellite merging technique to blend preprocessed datasets, and provides a better overall QPE product. The performance of the new satellite-radar-gauge blending module is assessed using independent rain gauge data over a 5-year period between 2003-2007, and the assessment evaluates the accuracy of newly developed satellite-radar-gauge (SRG) blended products versus that of radar-gauge products (which represents MPE algorithm currently used in the NWS operations) over two regions: I) inside radar effective coverage and II) immediately outside radar coverage. The outcomes of the evaluation indicate a) ingest of SQPE over areas within effective radar coverage improve the quality of QPE by mitigating the errors in radar estimates in region I; and b) blending of radar, gauge, and satellite estimates over region II leads to reduction of errors relative to bias-corrected SQPE. In addition, the new module alleviates the discontinuities along the boundaries of radar effective coverage otherwise seen when SQPE is used directly to fill the areas outside of effective radar coverage.

This paper proposes a new approach for multi-focus images fusion based on Region Mosaicing on Contrast Pyramids (REMCP). A density-based region growing method is developed to construct a focused region mask for multi-focus images. The segmented focused region mask is decomposed into a mask pyramid, which is then used for supervised region mosaicking on a contrast pyramid. In this way, the focus measurement and the continuity of focused regions are incorporated and the pixel level pyramid fusion is improved at the region level. Objective and subjective experiments show that the proposed REMCP is more robust to noise than compared algorithms and can fully preserves the focus information of the multi-focus images meanwhile reducing distortions of the fused images.

The quality of digital elevation models (DEMs) is inevitably affected by the limitations of the imaging modes and the generation methods. One effective way to solve this problem is to merge the available datasets through data fusion. In this paper, a fusion-based global DEM dataset (82°S-82°N) is introduced, which we refer to as GSDEM-30. This is a 30-m DEM mainly reconstructed from the unfilled SRTM1, AW3D30, and ASTER GDEM v2 datasets combining the multi-source and multi-scale fusion techniques. A comprehensive evaluation of the GSDEM-30 data, as well as the 30-m ASTER GDEM v2 and AW3D30 DEM, was presented. Global ICESat GLAS data and the local National Elevation Dataset (NED) were used as the reference for the vertical accuracy validation, while GlobeLand30 was introduced for the landscape analysis. Furthermore, we employed the maximum slope approach to detect the potential artefacts in the DEMs. The results show that the GDEM data are seriously affected by noise and artefacts. With the advantage of the multiple datasets and the refined post-processing, the GSDEM-30 are contaminated with fewer anomalies than both ASTER GDEM and AW3D30. The fusion techniques used can also be applied to the reconstruction of other fused DEM datasets.

Precision Agriculture is the ability to handle variations in productivity within a field and maximize financial return, optimize resource utilization and minimize impact of the environment. It is also the process of automated data collection, cloud storage and utilization to build robust decision support system. In case of Ethiopia, due to poor communication infrastructure coverage and absence of the state-of-the-art technology in the agriculture sector, implementing precision farming system is a challenging tasks in the domain area. In this work, we proposed a fusion of multiple sensors using IOT and IIOT infrastructure to collect critical data from farming fields to develop precision farming facility for decision makers. The main purpose was to monitor weather variability, automate irrigation process, extract critical soil properties. In addition, we have used time series data collected from sensor devices to build forecasting model. Fusion of multiple IoT device provide a mechanism in the agriculture area to deal with real-time monitoring of crops. It is cost-effective technology and required low-energy with edge computing sensor device. We employed the Message Queuing Telemetry Transport (MQTT) protocol to connect the Industrial/Internet of Things (I/IoT) to the cloud server. The communication between system user and sensor device has been done via cloud using Node-RED platform, web android APIs. The cloud-based Eco-system allows us to aggregate, visualize, and analyze live streams output from each sensor in real-time manner. Finally, we have built time series forecasting model using records collected by each sensor device. Using the multi-variate time series data-set, we have obtained about 99 forecasting accuracy on some important variables. Finally, we have developed mobile and web-based application for the end-user to monitor the proposed system remotely.

In this work, we propose an approach for the autonomous navigation of mobile robots using fusion of sensor data by a Double Deep Q-Network with collision avoidance by detecting moving people via computer vision techniques. We evaluate two data fusion methods for the proposed autonomous navigation approach: Interactive and Late fusion strategy. Both are used to integrate mobile robot sensors through the following sensors: GPS, IMU and, an RGB-D camera. The proposed collision avoidance module is implemented along with the sensor fusion architecture in order to prevent the autonomous mobile robot from colliding with moving people. The simulation results indicate a significant impact on the success of completing the proposed mission by the mobile robot with the fusion of sensors, indicating a performance increase (success rate) of 27% in relation to navigation without sensor fusion. With the addition of moving people in the environment, deploying the people detection and collision avoidance security module has improved about 14% the success rate when compared to that of the autonomous navigation approach without the security module. Video was developed with robot navigation using the DDQN-Late Fusion https://www.loom.com/share/684afa6a5b0148afadc9a200ab9f3483.

Water area segmentation in remote sensing is of great importance for flood monitoring. To overcome some challenges in this task, we construct the Water Index and Polarization Information (WIPI) multi-modality dataset and propose a multi-Modality Fusion and Gated multi-Filter U-Net (MFGF-UNet) convolutional neural network. The WIPI dataset enhances the water information and reduces the data dimension. In particular, the Cloud-Free label provided in the database effectively mitigates the issue of scarcity of labeled samples Since a single form or uniform kernel size cannot handle the variety in size and shape of water bodies, we proposed the gated multi-filter inception (GMF-Inception) module in our MFGF-UNet. Moreover, we utilize the attention mechanism by introducing the Gated Channel Transform (GCT) skip connection and integrating GCT into GMF- Inception to further improve model performance. Extensive experiments on three benchmarks, including WIPI, Chengdu and GF2020 datasets demonstrate that our method achieves favorable performance with lower complexity and better robustness against six competing approaches. For example, on WIPI, Chengdu and GF2020 datasets, the proposed MFGF-UNet model achieves F1 of 0.9191, 0.7410, and 0.8421, respectively, which average F1 on three datasets is 0.0045 higher than the U-Net model and reduces 62% average GFLOPs. New WIPI dataset, code and trained models have been released on GitHub

Recently, deep learning models have been widely applied to modulation recognition, which have become a hot topic due to their excellent end-to-end learning capabilities. However, current methods are mostly based on uni-modal inputs, which suffer from incomplete information and local optimization. To complement the advantages of different modalities, we focus on the multi-modal fusion method. Therefore, we introduce an iterative dual-scale attentional fusion (iDAF) method to integrate multimodal data. Firstly, two feature maps with different receptive field sizes are constructed using local and global embedding layers. Secondly, the feature inputs are iterated into the Iterative Dual Scale Attention Module (iDCAM), where the two branches capture the details of high-level features and the global weights of each modal channel, respectively. The iDAF not only extracts the recognition characteristics of each specific domains, but also complements the strengths of different modalities to obtain a fruitful view. Our iDAF achieves a recognition accuracy of 93.5\% at 10dB and 0.6232 at full SNR. The comparative experiments and ablation studies effectively demonstrate the effectiveness and superiority of the iDAF.

This paper applies a new artificial intelligence architecture, the Temporal Fusion Transformer (TFT), for the joint GDP forecasting of 25 OECD countries at different time horizons. This new attention-based architecture offers significant advantages over other deep learning methods. First, results are interpretable since the impact of each explanatory variable on each forecast can be calculated. Second, it allows to visualize persistent temporal patterns and to identify significant events and different regimes. Third, it provides quantile regressions and permits to train the model on multiple time series from different distributions. Results suggest that TFTs outperform regression models, especially in periods of turbulence such as the COVID-19 shock. Interesting economic interpretations are obtained depending on whether the country is domestic demand-led or export-led growth. In essence, TFT is revealed as a new tool that artificial intelligence provides to economists and policy makers, with enormous prospects for the future.

Land cover mapping provides spatial information on the physical properties of the Earth’s surface, for various classes of wetlands, artificial surface and constructions, vineyards, water bodies, etc. Having reliable information on land cover is crucial to developing solutions to a variety of environmental problems such as destruction of important wetlands/forests, and loss of fish and wildlife habitats. This has made land cover mapping one of the most widespread application areas in remote sensing computational imaging. However, due to the differences between modalities in terms of resolutions, content, and sensors, integrating complementary information that multi-modal remote sensing imagery exhibits into a robust and accurate system still remains challenging, and classical segmentation approaches generally do not give satisfactory results for land cover mapping. In this paper, we propose a novel dynamic deep network architecture, AMM-FuseNet, that promotes the use of multi-modal remote sensing images for the purpose of land cover mapping. The proposed network exploits the hybrid approach of the Channel Attention mechanism and Densely Connected Atrous Spatial Pyramid Pooling (DenseASPP). In the experimental analysis, in order to to verify the validity of the proposed method, we test AMM-FuseNet applied to four datasets whilst comparing it to the 6 state-of-the-art models of DeepLabV3+, PSPNet, UNet, SegNet, DenseASPP, and DANet. In addition, we also demonstrate the capability of AMM-FuseNet under minimal training supervision (reduced number of training samples) compared to the state-of-the-art, achieving less accuracy loss even for the case with 1/20 of the training samples.

The market for autonomous vehicles (AV) is expected to experience significant growth over the coming decades and to revolutionize the future of transportation and mobility. The AV is a vehicle that is capable of perceiving its environment and perform driving tasks safely and efficiently with little or no human intervention and is anticipated to eventually replace conventional vehicles. Self-driving vehicles employ various sensors to sense and perceive their surroundings and, also rely on advances in 5G communication technology to achieve this objective. Sensors are fundamental to the perception of surroundings and the development of sensor technologies associated with AVs has advanced at a significant pace in recent years. Despite remarkable advancements, sensors can still fail to operate as required, due to for example, hardware defects, noise and environment conditions. Hence, it is not desirable to rely on a single sensor for any autonomous driving task. The practical approaches shown in recent research is to incorporate multiple, complementary sensors to overcome the shortcomings of individual sensors operating independently. This article reviews the technical performance and capabilities of sensors applicable to autonomous vehicles, mainly focusing on vision cameras, LiDAR and Radar sensors. The review also considers the compatibility of sensors with various software systems enabling the multi-sensor fusion approach for obstacle detection. This review article concludes by highlighting some of the challenges and possible future research directions.

This paper presents a methodology to design sensor fusion parameters using real performance indicators of navigation in UAVs based on PixHawk flight controller and peripherals. This methodology and the selected performance indicators allows to find the best parameters for the fusion system of a determined configuration of sensors and a predefined real mission. The selected real platform is described with stress on available sensors and data processing software, and the experimental methodology is proposed to characterize sensor data fusion output and determine the best choice of parameters using quality measurements of tracking output with performance metrics not requiring ground truth.

Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks(CNN) for face verification. In this work, we explore to use identification signal to supervise one CNN and the combination of semi-verification and identification to train the other one. In order to estimate semi-verification loss at a low computation cost, a circle, which is composed of all faces, is used for selecting face pairs from pairwise samples. In the process of face normalization, we propose to use different landmarks of faces to solve the problems caused by poses. And the final face representation is formed by the concatenating feature of each deep CNN after PCA reduction. What's more, each feature is a combination of multi-scale representations through making use of auxiliary classifiers. For the final verification, we only adopt the face representation of one region and one resolution of a face jointing Joint Bayesian classifier. Experiments show that our method can extract effective face representation with a small training dataset and our algorithm achieves 99.71% verification accuracy on LFW dataset.

For advancing manufacturing, arising AM, with an inverse philosophical approach compared to conventional procedures, has benefits that include intricate fabrication, reduced material waste, flexible design, and more. Regardless of its potential, AM must overcome several challenges due to multi-physical processes with miscellaneous physical stimuli in diverse materials systems and situations, such as anisotropic microstructure and mechanical properties, a restricted choice of materials, defects, and high cost. Unlike conventional experimental work that requires extensive trial and error resources and FEM, which generally consumes substantial computational power, the analytical approach based on physics is an exceptional choice. Understanding the relationship between the microstructure and material properties of the fabricated parts is a crucial focus in AM research. Texture is a vital factor in almost every modern industry. This study first proposed a physics-based model to foreshadow the multi-phase crystallographic orientation distribution in Ti-6Al-4V LPBF while considering the part boundary conditions due to the importance of part geometry in real industry. The thermal distribution obtained from this function operates as the information for the single-phase crystallographic texture model. In this model, we forerun and validate the orientations of single-phase materials utilizing three Euler Angles with the principles of CET and thermodynamics, as well as the intensity of the texture by approximating them with published results. Then, we transform the single-phase texture into a dual-phase texture in Bunge calculation, illustrating visualized by pole figures of both BCC and HCP phases. This texture evolution model provides a new paradigm for future researchers to model the texture or microstructure evolution semi-analytically and save many computational resources in a real-world perspective. Others have not yet done this work about simulating the multi-phase texture in an analytical approach, so this work bridges the gap in this field. Furthermore, this paper establishes the foundation for future research on materials properties affected by microstructure or texture in academic and industrial environments. The precision and dependability of the results obtained through this method make it a valuable tool for ongoing research and advancement.

Target detection technology plays a crucial role in fishery ecological monitoring, fishery diversity research, and intelligent aquaculture. Deep learning, with its distinct advantages, provides significant convenience to the fishery industry. However, it still faces various challenges in practical applications, such as significant differences in image species and image blurring. To address these issues, this study proposes a multi-scale, multi-level, and multi-stage cross-domain feature fusion model. In order to train the model more effectively, a new dataset called Fish52 (Multi-scene Fish dataset) was constructed, on which the model achieved an mAP of 82.57%. Furthermore, we compared prevalent one-stage and two-stage detection methods on the Lahatan (single-scene fish dataset) and Fish30 dataset and tested them on the F4k and FishNet dataset. The mAP of our proposed model on the Fish30, Lahatan, F4k, and FishNet datasets reaches 91.72%, 98.7%, 88.6%,and 81.5% respectively, outperforming existing mainstream models. Comprehensive empirical analysis indicates that our model possesses high generalization ability and has reached advanced performance levels. In this study, the depth of the model backbone is deepened, a novel neck structure is proposed, and anew module is embedded therein. To enhance the fusion ability of the model, a new attention mechanism module is introduced. In addition, in the adaptive decoupling detection header module, introducing classes with independent parameter sand regression adapters reduces interaction between different tasks. The proposed model can better monitor fishery resources and enhance aquaculture efficiency. It not only provides an effective approach for fish detection but also has certain reference significance for the identification of similar target sin other environments, and offers assistance for the construction of smart fisheries and digital fisheries.

Many engineered approaches have been proposed over the years for solving the hard problem of performing indoor localisation using smartphone sensors. However, specialising these solutions for difficult edge cases remains challenging. Here we propose an end-to-end hybrid multimodal deep neural network localisation system, MM-Loc, relying on zero hand-engineered features, learning them automatically from data instead. This is achieved by using modality-specific neural networks to extract preliminary features from each sensing modality, which are then combined by cross-modality neural structures. We show that our choice of modality-specific neural architectures is capable of estimating the location with good accuracy independently. But for better accuracy, a multimodal neural network fusing the features of early modality-specific representations is a better proposition. Our proposed MM-Loc solution is tested on cross-modality samples characterised by different sampling rates and data representation (inertial sensors, magnetic and WiFi signals), outperforming traditional approaches for location estimation. MM-Loc elegantly trains directly from data unlike conventional indoor positioning systems, which rely on human intuition.

This study develops a structure for mapping native vegetation in a transition area between Brazilian Cerrado and Atlantic Forest from integrated spatial information from the Sentinel-1 and Sentinel-2 satellites. Most studies use this data separately, however, the integrated use of optical sensors with Synthetic Aperture Radar (SAR) sensors can improve the methodology for classifying land use and land cover (LULC). The fusion of Sentinel-1 and Sentinel-2, for example, can increase the accuracy of mapping algorithms, using complementary information, such as spectral, backscattering, polarimetry, and interferometry. The study area comprises the Lobo Reservoir Hydrographic Basin, which is part of an environmental conservation unit protected by Brazilian law and with significant human development. LULC were classified, using the random forest deep learning algorithm. The classifying attributes were backscatter coefficients, polarimetric decomposition, and interferometric coherence for radar data (Sentinel-1), and optical spectral data, comprising bands in the red edge, near infrared, and shortwave infrared (Sentinel-2). The attributes were evaluated in three settings in which the SAR and optical data were evaluated separately (C1 and C2, respectively) and in an integrated manner (C3). The study found greater accuracy for C3 (96.54%), an improvement of nearly 2% compared to C2 (94.78%) and more than 40% in relation to C1 (55.73%). The classification algorithm encountered significant challenges in identifying wetlandsin C1, but performance improved in C3, enhancing differentiation by stratifying a greater number of classes during training and facilitating visual interpretation during sampling. Accordingly, the use of SAR and optical data becomes an alternative to optimize LULC mapping in tropical regions, due to the limited influence of atmosphere on images in the microwave range.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

The RPL protocol is a routing protocol for low power and lossy networks. In such a network, energy is a very scarce resource; so many studies are focused on minimizing global energy consumption. End-to-end latency is another important performance indicator of the network, but existing research tends to focus more on energy consumption and ignore the end-to-end delay of data transmission. In this paper, we propose a kind of energy equalization routing protocol to maximize the surviving time of the restricted nodes so that the energy consumed by each node is close to each other. At the same time, a multi-path forwarding route is proposed based on the cache utilization. The data is sent to the sink node through different parent nodes at a certain probability, not only by selecting the preferred parent node, thus avoiding buffer overflow and reducing end-to-end delay. Finally, the two algorithms are combined to accommodate different application scenarios. The experimental results show that the proposed three improved schemes improve the reliability of the routing, extend the lifetime of the network, reduce the end-to-end delay, and reduce the number of DAG reconfiguration.

Image fusion is the process of combining multiple input images from single or multiple imaging modalities into a fused image, which is expected to be more informative for human or machine perception as compared to any of the input images. In this paper, we propose a novel method based on deep learning for fusing infrared images and visible images, named the LBP-based proportional input generative adversarial network (LPGAN). In the image fusion task, the preservation of structural similarity and image gradient information is contradictory, and it is difficult for both to achieve good performance at the same time. To solve this problem, we innovatively introduce Local Binary Patterns (LBP) into Generative Adversarial Networks (GANs), which effectively utilize the texture features of the source images, so that the network has stronger feature extraction ability and anti-interference ability. In the feature extraction stage, we introduce a pseudo-siamese network for the generator to extract the detailed features and the contrast features. At the same time, considering the characteristic distribution of different modal images, we propose a 1:4 scale input mode. Extensive experiments on the publicly available TNO dataset and CVC14 dataset show that the proposed method achieves the state-of-the-art performance. We also test the universality of LPGAN through the fusion of RGB and infrared images on the RoadScene dataset. In addition, LPGAN is applied to multi-spectral remote sensing image fusion. Both qualitative and quantitative experiments demonstrate that our LPGAN can not only achieve good structural similarity, but also retain rich detailed information.

In this paper, a multi-mode waveguide-based optical resonator is proposed for an integrated optical refractive index sensor. Conventional optical resonators have been studied for single-mode waveguide-based resonators to enhance the performance, but mass production is limited owing to the high fabrication costs of nano-scale structures. To overcome this problem, we designed an S-bend resonator based on a micro-scale multi-mode waveguide. In general, multi-mode waveguides cannot be utilized as optical resonators, because of a performance degradation resulting from modal dispersion and an output transmission with multi-peaks. Therefore, we exploited the mode discrimination phenomenon using the bending loss, and the resulting S-bend resonator yielded an output transmission without multi-peaks. This phenomenon is utilized to remove higher-order modes efficiently using the difference in the effective refractive index between the higher-order and fundamental modes. As a result, the resonator achieved a Q-factor and sensitivity of 2.3x10³ and 52 nm/RIU, respectively, using the variational finite-difference time-domain method. These results show that the multi-mode waveguide-based S-bend resonator with a wide line width can be utilized as a refractive index sensor.

Lidar and camera sensors are widely utilized in autonomous vehicles (AVs) and robotics due to their complementary sensing capabilities—lidar provides accurate depth information, while cameras capture rich visual data. However, effective fusion of these sensors requires precise calibration, which is often challenging due to the differences in sensing modalities. This paper presents a self-calibration algorithm based on Singular Value Decomposition (SVD) to address this problem. Singular Value Decomposition is a powerful matrix factorization technique that helps identify key calibration parameters by decomposing matrices into singular vectors and values, representing essential calibration data. Our method not only automates the calibration process but also provides a reliable mechanism for detecting calibration errors, ensuring long-term accuracy and robustness in sensor fusion. The algorithm simplifies deployment in real-world applications by eliminating the need for manual calibration or external targets. Experimental results show that our approach improves sensor alignment and fusion accuracy, making it particularly useful for AV and robotic systems where maintaining precise calibration is critical.

Robotic odor source localization (OSL) is a technology that enables mobile robots or autonomous vehicles to find an odor source in unknown environments. An effective navigation algorithm that guides the robot to approach the odor source is the key to successfully locating the odor source. While traditional OSL approaches primarily utilize an Olfaction-only strategy, guiding robots to find the odor source by tracing emitted odor plumes, our work introduces a fusion navigation algorithm that combines both vision and olfaction-based techniques. This hybrid approach addresses challenges such as turbulent airflow, which disrupts olfaction sensing, and physical obstacles inside the search area, which may impede vision detection. In this work, we propose a hierarchical control mechanism that dynamically shifts the robot’s search behavior among four strategies: crosswind maneuver, Obstacle-avoid Navigation, Vision-based Navigation, and Olfaction-based Navigation. Our methodology includes a custom-trained deep-learning model for visual target detection and a moth-inspired algorithm for Olfaction-based navigation. To assess the effectiveness of our approach, we implemented the proposed algorithm on a mobile robot in a search environment with obstacles. Experimental results demonstrate that our Vision and Olfaction Fusion algorithm significantly outperforms Vision-only and Olfaction-only methods, reducing average search time by 54% and 30%, respectively.

Purposes: To provide abdominal contrast-enhanced MR image synthesis, we developed an image gradient regularized multi-modal multi-discrimination sparse-attention fusion generative adversarial network (GRMM-GAN) to avoid repeated contrast injections to patients and facilitate adaptive monitoring. Methods: With IRB approval, 165 abdominal MR studies from 61 liver cancer patients were retrospectively solicited from our institutional database. Each study included T2, T1 pre-contrast (T1pre), and T1 contrast-enhanced (T1ce) images. The GRMM-GAN synthesis pipeline consists of a sparse attention fusion network, an image gradient regularizer (GR), and a generative adversarial network with multi-discrimination. The studies were randomly divided into 115 for training, 20 for validation, and 30 for testing. The two pre-contrast MR modalities, T2 and T1pre images, were adopted as inputs in the training phase. The T1ce image at the portal venous phase was used as an output. The synthesized T1ce images were compared with the ground truth T1ce images. The evaluation metrics include peak signal-to-noise ratio (PSNR), structural-similarity-index (SSIM), and mean-squared-error (MSE). A Turing test and experts’ contours evaluated the image synthesis quality. Results: The proposed GRMM-GAN model achieved a PSNR of 28.56, an SSIM of 0.869, and an MSE of 83.27. The proposed model showed statistically significant improvements in all metrics tested with p-values <0.05 over the state-of-the-art model comparisons. The average Turing test score was 52.33%, close to random guessing, supporting the model's effectiveness for clinical application. In the tumor-specific region analysis, the average tumor contrast-to-noise ratio (CNR) of the synthesized MR images was not statistically significant from the real MR images. The average DICE from real vs. synthetic images was 0.90, compared to the inter-operator DICE of 0.91. Conclusion: We demonstrated the function of a novel multi-modal MR image synthesis neural network, GRMM-GAN, for T1ce MR synthesis based on pre-contrast T1 and T2 MR images. GRMM-GAN shows promise for avoiding repeated contrast injections during radiation therapy treatment.

The multi-modal data fusion method based on IA-net and CHMM technical proposed is designed to solve the problem that the incompleteness of target behavior information in complex family environment leads to the low accuracy of human behavior recognition.The two improved neural networks(STA-ResNet50、STA-GoogleNet)are combined with LSTM to form two IA-Nets respectively to extract RGB and skeleton modal behavior features in video. The two modal feature sequences are input CHMM to construct the probability fusion model of multi-modal behavior recognition.The experimental results show that the human behavior recognition model proposed in this paper has higher accuracy than the previous fusion methods on HMDB51 and UCF101 datasets. New contributions: attention mechanism is introduced to improve the efficiency of video target feature extraction and utilization. A skeleton based feature extraction framework is proposed, which can be used for human behavior recognition in complex environment. In the field of human behavior recognition, probability theory and neural network are cleverly combined and applied, which provides a new method for multi-modal information fusion.

The satellite Earth observation (EO) sector is burgeoning with hundreds of commercial satellites being launched each year, delivering a rich source of data that could be exploited for societal benefit. Data streams from the growing constellation of commercial satellites are of variable quality, limiting the potential for their combined use in science applications that need long time-series data from multiple sources. The quality of calibration performed on optical sensors onboard many satellite systems is highly variable due to calibration methods, sensor design, mission objective, budget, or other operational constraints. A small number of currently operating well-characterised satellite systems with onboard calibration, such as Landsat-8/9, Sentinel-2, and planned future missions like the NASA Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder, the European Space Agency (ESA) Traceable Radiometry Underpinning Terrestrial and Helio Studies (TRUTHS), and LIBRA from China, are considered benchmarks for optical data quality due to their traceability to international measurement standards. This paper describes the concept of a space-based transfer calibration radiometer called the Satellite Cross-Calibration Radiometer (SCR) that would enable the calibration parameters from satellites such as Landsat-8/9, Sentinel-2, or other benchmark systems to be transferred to a range of commercial optical EO satellite systems while in orbit. A description of the key characteristics of the SCR to successfully operate in orbit and transfer calibration from Reference systems to Client systems is presented. A system like the SCR in orbit could complement SI-Traceable satellites (SITSats) to improve data quality and consistency and facilitate the interoperable use of data from multiple optical sensor systems for delivering higher returns on the global investment in EO.

Often, engineers with machining experience often judge machining state and tool life according to chips’ features. Engineers' experience is digitized in this study. During the cutting process, the cutting tool coming in contact with the workpiece produces a shear zone, which causes plastic deformation and shear slip. The chips closest to the shear zone can directly show the state of the tool and workpiece when the material is SKD61. This study used chip color, vibration, and current signal integration for prediction of machining state and cutting tool life. When the cutting tool wears increased, the chip surface color changed in the following way: purpleè purple blueè blue ècyan, or even green and yellow. When the cutting tool was in the accelerating wear phase, the color change was particularly obvious. The Back-Propagation Levenberg–Marquardt (BP-LM) predictive methodology was used to compare the predictive ability of voltage, vibration signal, and chip color. The Mean Absolute Percentage Error (MAPE) for the voltage signal was 12.28%, for the vibration signal it was 11.38%, and for the chip color combined with multi-sensor characteristics it was 7.85%. The MAPE of the chip color was the smallest. Using the General Regression Neural Network (GRNN) methodology, the MAPE for the voltage signal was 10.74%, for the vibration signal 7.96%, and for the chip color combined with multi-sensor characteristics was 6.59%. The MAPE of the chip color was the smallest. Obviously, the chip color combined with multi-sensor signals provided better predictive results than the vibration signal or voltage signal alone. There is currently no research on the usefulness of monitoring chip color for tool life prediction.

AVs suffer reduced maneuverability and performance due to the degradation in sensor performances in fog. Such degradation causes significant object detection errors essential for AVs' safety-critical conditions. For instance, YOLOv5 performs significantly well under favorable weather but suffers miss detections and false positives due to atmospheric scattering caused by fog particles. Existing deep object detection techniques often exhibit a high degree of accuracy. The drawback is being sluggish at object detection in fog. Object detection methods with fast detection speed have been obtained using deep learning at the expense of accuracy. The problem of the lack of balance between detection speed and accuracy in fog persist. This paper presents an improved YOLOv5-based multi-sensor fusion network that combines radar's object detection with a camera image bounding box. We transformed radar detection by mapping the radar detections into a two-dimensional image coordinate and projected the resultant radar image on the camera image. Using the attention mechanism, we emphasized and improved important feature representation used for object detection while reducing high-level feature information loss. We trained and tested our multi-sensor fusion network on clear and multi-fog weather datasets obtained from the CARLA simulator. Our result shows that the proposed method significantly enhances the detection of distant and small objects. Our small CR-YOLOnet model best strikes a balance between accuracy and speed with an accuracy of 0.849 at 69 fps.

Humans’ performance varies due to the mental resources that are available to successfully pursue a task. To monitor users’ current cognitive resources in naturalistic scenarios, it is essential to not only measure demands induced by the task itself but also consider situational and environmental influences. We conducted a multimodal study with 18 participants (nine female, M = 25.9 with SD = 3.8 years). In this study, we recorded, respiratory, ocular, cardiac, and brain activity using functional near-infrared spectroscopy (fNIRS) while participants performed an adapted version of the warship commander task with concurrent emotional speech distraction. We tested the feasibility of decoding the experienced mental effort with a multimodal machine learning architecture. The architecture comprised feature engineering, model optimisation, and model selection to combine multimodal measurements in a cross-subject classification. Our approach reduces possible overfitting and reliably distinguishes two different levels of mental effort. These findings contribute to the prediction of different states of mental effort and pave the way toward generalised state monitoring across individuals in realistic applications.

Proton Exchange Membrane Fuel Cell (PEMFC) is a fast-developing battery technology, and the key to its reliability and lifespan improvement lies in the accurate assessment of durability. However, the degradation mechanism of PEMFC is hard to determine and its internal parameters are highly coupled. Thus, the development of the more accurate life prediction model that meets the actual scenarios is urgent to investigate. To solve this problem, a multi-feature fusion life prediction method based on Temporal Convolutional Network-Gated Recurrent Unit (TCN-GRU) is proposed. A TCN algorithm is used as the prediction base model, and two GRU modules are included to the model to strengthen the model expression ability and improve its predictive accuracy. Two widely recognized datasets and two operating conditions are utilized for model training and prediction, respectively. Comparisons are made with single-feature parameter models in terms of Root Mean Square Error (RMSE) and Determination Coefficient (R2). The results show that the prediction accuracy of the TCN-GRU multi-feature fusion model is higher than that of the single-feature models in terms of stability and anti-interference under both operating conditions. Furthermore, with the increase of input feature parameters, the TCN-GRU model is closer to the real value, which proves once again that the proposed model can meet the accuracy requirements of the life prediction of PEMFC.

This research centres on advancing the utilisation of a novel Deep Ensemble model called RicEns-Net for predicting crop yields through sophisticated multi-modal data engineering. Initially, data for the study were acquired from Ernst \& Young (EY), a prominent global technology and management consulting firm, as part of their annual data science challenge (EY Open Science Challenge 2023). The predictive models leverage multi-modal data by integrating radar and optical-type remote sensing data alongside meteorological data to create supplementary features essential for predicting crop yield. The primary data features are derived from spectral indices extracted from Sentinel 2 satellites, while more advanced features are generated through combinations and interactions of these fundamental features. Furthermore, data from Sentinel 1 and 3, along with meteorological measurements such as surface temperature and rainfall, account for the intricate natural factors influencing crop yield, creating a comprehensive set of data features based on existing research. To tackle the complexity introduced by numerous data features, extensive data engineering was conducted to identify the most predictive features among 100+ and mitigate the "curse of dimensionality," resulting in 15 features from 5 different modalities. The proposed RicEns-Net comprises multiple machine learning algorithms in a deep ensemble approach to leverage the best features of each of these techniques, achieving optimal performance. The proposed model achieves an MAE value of 341 kg/Ha for prediction, surpassing the performance of the EY Open Science Challenge 2023 winner models and state-of-the-art deep/machine learning approaches.

Digital Elevation Models (DEMs) are widely used in geographic and environmental studies. In the current work, the fusion of multi-source DEMs is investigated to improve the overall accuracy of public domain DEMs. Multi-scale decomposition is an important analytical method in data fusion. Three multi-scale decomposition methods – the wavelet transform (WT), bidimensional empirical mode decomposition (BEMD) and nonlinear adaptive multi-scale decomposition (N-AMD) - are applied to the 1-arc-second Shuttle Radar Topography Mission Global digital elevation model (SRTM-1 DEM) and the Advanced Land Observing Satellite World 3D – 30 m digital surface model (AW3D30 DSM) in China. Of these, the WT and BEMD are popular image fusion methods. A new approach for DEM fusion is developed using N-AMD (which is originally invented to remove the cycle from sunspots). Subsequently, a window-based rule is proposed for the fusion of corresponding frequency components obtained by these methods. Quantitative results show that N-AMD is more suitable for multi-scale fusion of multi-source DEMs, taking the ice cloud and land elevation satellite (ICESat) global land surface altimetry data as a reference. The vertical accuracy of the fused DEM shows significant improvements of 29.6% and 19.3% in a mountainous region and 27.4% and 15.5% in a low-relief region, compared to the SRTM-1 and AW3D30 respectively. Furthermore, a slope position-based linear regression method is developed to calibrate the fused DEM for different slope position classes, by investigating the distribution of the fused DEM error with topography. The results indicate that the accuracy of the DEM calibrated by this method is improved by 16% and 13.6%, compared to the fused DEM in the mountainous region and low-relief region respectively, proving that it is a practical and simple means of further increasing the accuracy of the fused DEM.

In response to reducing the energy cost of unmanned surface vehicles (USVs) while overcoming the low accuracy problem in surface target detection, a lightweight detection algorithm with multi-scale feature fusion is proposed. Based on the popular one-stage lightweight Yolov7-tiny target detection model, a lightweight extraction module is designed first by introducing the multiscale residual module to reduce the number of parameters and computational complexity while improving accuracy. The Mish and SiLU activation functions are used to enhance network feature extraction. Second, the path aggregation network employs coordinate convolution to strengthen spatial information perception. Finally, the dynamic head, which is based on the at-tention mechanism, improves the representation ability of object detection heads without any computational overhead. According to the experimental findings, the proposed model has 22.1% fewer parameters than the original model, 15% fewer GFLOPs, a 6.2% improvement in mAP@0.5, a 4.3% rise in mAP@0.5:0.95, and it satisfies the real-time criteria. According to the research, the suggested lightweight water surface detection approach includes a lighter model, a simpler computational architecture, more accuracy, and a wide range of generalizability. It performs bet-ter in a variety of difficult water surface circumstances.

Visual Sensor Networks (VSNs) have been the focus of numerous studies, emphasizing the quality of the information they generate. The primary goal of these networks is to capture data from an area, extract the pertinent information from the visual scene, and facilitate communication. However, the presence of objects in the study area can impacted the network's efficiency, linking the quality of acquired data directly to the positioning of the cameras. Strategically positioning multiple cameras in a potentially complex area, while ensuring effective communication between nodes, presents a challenging issue in VSNs applications. This paper introduces a specific method to enhance the deployment of visual sensors in indoor environments. The research addresses the theme of multi-objective optimization of VSN deployment, integrating various criteria: maximizing overall visual coverage, maximizing the observation of zones of interest, maximizing observation redundancy of zones of interest and ensuring communication connectivity for data transfers. To tackle this problem, we simulate the observed environment incorporating cameras, obstacles, and considering zones of interest. Camera positioning is performed while considering visual constraints and the scene's characteristics. The quality of positioning is evaluated based on the defined objective functions. Initially, a comparative study is conducted with a state-of-the-art approach, integrating the first three objective functions. Subsequently, we incorporate the fourth objective function to ensure data transfers. The proposed method demonstrates efficient camera network deployments in indoor areas, considering global coverage and observation redundancy. In contrast to the state-of-the-art, these results are achieved in areas with visual obstacles while ensuring communication connectivity between the different cameras.

This article proposes the use of a multi-scale and multi-sensor approach to collect and modelling 3D data concerning wide and complex areas in order to obtain a variety of metric information in the same 3D archive, based on a single coordinate system. The employment of these 3D georeferenced products is multifaceted and the fusion or integration among different sensors data, scales and resolutions is promising and could be useful for the generation of a model that could be defined as hybrid. The correct geometry, accuracy, radiometry and weight of the data models are hereby evaluated comparing integrated processes and results from Terrestrial Laser Scanner (TLS), Mobile Mapping System (MMS), Unmanned Aerial Vehicle (UAV), terrestrial photogrammetry, using Total Station (TS) and Global Navigation Satellite System (GNSS) as topographic survey. The entire analysis underlines the potentiality of the integration and fusion of different solutions and is a crucial part of the “Torino 1911” project whose main purpose is mapping and virtually reconstructing the 1911 Great Exhibition settled in the Valentino Park in Turin (Italy).

The central goal of few-shot scene classification is to learn a model that can generalize well to a novel scene category (UNSEEN) from only one or a few labeled examples. Recent works in the remote sensing (RS) community tackle this challenge by developing algorithms in a meta-learning manner. However, most prior approaches have either focused on rapidly optimizing a meta-learner or aimed at finding good similarity metrics while overlooking the embedding power. Here we propose a novel Task-Adaptive Embedding Learning (TAEL) framework that complements the existing methods by giving full play to feature embedding’s dual roles in few-shot scene classification - representing images and constructing classifiers in the embedding space. First, we design a lightweight network that enriches the diversity and expressive capacity of embeddings by dynamically fusing information from multiple kernels. Second, we present a task-adaptive strategy that helps to generate more discriminative representations by transforming the universal embeddings into task-specific embeddings via a self-attention mechanism. We evaluate our model in the standard few-shot learning setting on two challenging datasets: NWPU-RESISC4 and RSD46-WHU. Experimental results demonstrate that, on all tasks, our method achieves state-of-the-art performance by a significant margin.

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled colour correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields better edge and contrast enhancement results without halo effect, colour degradation and is faster and more adaptive than all other algorithms from the literature.

Tunnel fires are generally detected using various sensors, including measuring temperature, CO concentration, and smoke concentration. To address the ambiguity and inconsistency in multi-sensor data, this paper proposes a tunnel fire detection method based on an improved Dempster-Shafer (DS) evidence theory for multi-sensor data fusion. To solve the problem of evidence conflict in DS theory, a two-level multi-sensor data fusion framework is adopted. The first level of fusion involves feature fusion of the same type of sensor data, removing ambiguous data to obtain characteristic data, and calculating the basic probability assignment (BPA) function through the feature interval. The second level fusion derives basic probability numbers from the BPA, calculates the degree of evidence conflict, normalizes to obtain the relative conflict degree, and optimizes the BPA using the trust coefficient. The classical DS evidence theory is then used to integrate and obtain the probability of tunnel fire occurrence. Different heat release rates, tunnel wind speeds, and fire locations are set, forming four fire scenarios. Sensor monitoring data under each simulation condition are extracted and fused using the improved DS evidence theory. The results show that the proposed improved DS evidence theory method detects the probability of fire occurrence in the four scenarios as 67.5%, 71.0%, 82.8%, and 83.5%, respectively, and identifies fire occurrence in approximately 2.4 seconds, an improvement of 64.7% to 70% over traditional methods. This demonstrates the feasibility and superiority of the proposed method, highlighting its significant importance in ensuring personnel safety.

Rollover prevention of partially-filled tank trucks is an industry teaser, with the core challenge being real-time perception and observation of the liquid state inside the tank. In order realize re-liable observation of sloshing liquid, this article firstly proposes a sloshing modeling method based on multi-degree-of-freedom pendulum model, and derives the double mass trammel pendulum model (DMTP, 2DOF) accordingly, which accurately reflects the sloshing dynamics under more pervasive working conditions. Secondly, a free surface fluctuation sensor is designed based on magnetostriction, capable of measuring the inclination and height of the liquid level inside tanks filled with hazardous chemical. Finally, the unscented Kalman filter (UKF) is utilized to synthesize the information of the two, establishing a credible real-time observation of the sloshing liquid. Verified through vehicle-fluid coupled co-simulation, under condition of con-secutive double lane change, observation error of the proposed method is only 25.9% that of the open-loop calculation, providing a secure guarantee for the observation of the state variables of the single pendulum model (SP) used for most kinds of anti-rollover controller.

Unmanned construction machinery vehicles mostly carry work in bridges, tunnels, and outdoor open spaces. Obtaining accurate pose estimation of the entire vehicle and establishing a map of the surrounding environment is of great significance for path planning and control in the later stage. Traditional simultaneous localization and mapping (SLAM) schemes, which mostly use a single sensor, but there are problems with localization drift and mapping failure in scenarios where there are few geometric features and the environment is prone to degradation. Currently, the multi-sensor fusion strategy has been proven to be an effective solution and widely used in the field of unmanned vehicle localization and mapping. This paper proposes a SLAM framework that tightly couples a LiDAR, IMU and camera to achieve accurate and reliable pose estimation. The framework is based on LiDAR-inertial system(LIS) and factor graph optimization theory. Texture information provided by vision is integrated into the LiDAR-inertial odometry to generate a new visual-inertial subsystem(VIS).The two subsystems, VIS and LIS, can assist each other and work jointly. Through real vehicle tests, the system can perform incremental, real-time state estimation, reconstruct dense 3D point cloud maps,and effectively solve the problems of localization drift and mapping failure in the lack of geometric features or challenging construction environments. Meanwhile, the system has a safety redundancy mechanism. When any subsystem fails, the system can also operate normally, to ensure the reliability and robustness of vehicle positioning.

In this work, a systematic study was conducted on the fabrication of multi-material components obtained employing Laser-Powder Bed Fusion (L-PBF) technology. The idea of making multi-material components is a winning capability of additive technologies because it allows the fabrication of Functionally Graded Materials (FGMs) with the customization of parts according to different required properties. The transition from one material to another was achieved gradually and continuously within the same layer using ad-hoc equipment designed for L-PBF systems with a powder spreading technique based on coaters or rollers. The influence of the relative position of the different materials within the powder chamber and the geometry of the developed equipment on the metallurgical and mechanical properties of the manufactured samples was evaluated. The performed tests involved the use of two materials, a nickel-based superalloy, and a stainless steel, having different chemical, physical and mechanical properties to obtain gradual properties variation in the manufactured samples. Based on the results of post-process characterization obtained through metallographic, chemical, and mechanical analysis, the relative positions of the materials and the geometry of the developed equipment have a limited effect on the sample’s manufactured properties. The characteristics of the FGM zone depend on the nature of the employed powders, and its extent coincides with that defined during the design of the divider.

Gender recognition is trivial for physiotherapist, but it is considered a challenge for computers. The electromyography (EMG) and heart rate variability (HRV) were utilized in this work for gender recognition during the stepping exercise using a stepper. The relevant features were extracted and selected. The selected features were then fused to automatically predict gender recognition. However, the feature selection for gender classification became a challenge to ensure better accuracy. Thus, in this paper, a feature selection approach based on both the performance and the diversity between the two features from the rank-score characteristic (RSC) function in a combinatorial fusion approach (CFA) was employed. Then, the features from the selected feature sets were fused using a CFA. The results were then compared with other fusion techniques such as naive bayes (NB), decision tree (J48), k-nearest neighbor (KNN) and support vector machine (SMO). Besides, the results were also compared with previous researches in gender recognition. The experimental results showed that the CFA was efficient for feature selection. The fusion method was also able to improve the accuracy of the gender recognition rate. The CFA provides much better gender classification results which is 94.51% compared to Nazarloo's work (90.34%) and other classifiers.

In this paper, an ultracompact combined sensor for displacement and angle synchronous measurement is proposed based on self-imaging effect of optical microgratings. Using a two-grating structure, linear and angular displacement can be measured by detecting the change of phase and amplitude of the optical transmission respectively within one single structure in meantime. The optical transmitted properties of the two-grating structure are investigated in both theory and simulation. Simulated results indicate that, the optical transmission changes in a sinusoidal relationship to the input linear displacement. Meanwhile, the amplitude of the curve decreases with an input pitch angle, indicating the ability for synchronous measurement within one single compact structure. The synchronous measurement of the linear displacement and the angle is also demonstrated experimentally. The results show a resolution down to 4nm for linear displacement measurement, and a sensitivity of 0.26mV/arcsec within a range of ±1° for angle measurement. Benefitting from a simple common-path structure without using optical components including reflectors and polarizers, the sensor shows an ultrahigh compactness for multiple-degrees-of-freedom measuring, indicating the great potential for this sensor in the fields such as integrated mechanical positioning and semiconductor fabrication.

Drones have been used in a variety of scenarios such as atmospheric monitoring, fire rescue, agricultural irrigation, etc., in which accurate environmental perception is of crucial importance for both decision-making and control. Among the drone sensors, the RGB camera is indispensable for capturing rich visual information for vehicle navigation but encounters a grand challenge in high-dynamic-range scenes that occur frequently in real applications. Specifically, the recorded frames suffer from under-exposure and over-exposure simultaneously and degenerate the successive vision tasks. To solve the problem, we take object tracking as an example and leverage the superior response of event cameras over a large intensity range to propose an event-assisted object tracking algorithm that can achieve reliable tracking under large intensity variations. Specifically, we propose to pursue feature matching from dense event signals, and based on which to (i) design a UNet-based image enhancement algorithm to balance the RGB intensity with the help of neighboring frames in the time domain, and then (ii) construct a dual-input tracking model to track the moving objects from intensity balanced RGB video and event sequence. The proposed approach is comprehensively validated in both simulation and real experiments.

Distributed fiber optic vibration sensors based on Φ-OTDR using Rayleigh backscattering of highly coherent light source pulses are very popular type in the area of sensors due to many attractive features, mainly due to its distributed manner of sensing, i.e. they can operate as thousands of local sensors simultaneously. The paper summarizes and describes several important modifications of the original sensor scheme to enhance its key performance parameters and to extend its application potential. A multi-fiber sensor form was proposed. Single- and two-fiber sensors were designed, constructed and tested both in the laboratory and in a real environment. Variants of two-fiber sensor utilizing optical switches for the sensor flexibility enhancement are proposed and their applications are described.

Wireless Sensor Networks (WSN) is designed to collect information across a large number of limited battery sensor nodes. Therefore, it is important to minimize the energy consumption of each node, which leads to the extension of the network life. Our goal is to design an intelligent WSN that collects as much information as possible to process it intelligently. To achieve this goal, an agent has been migrated to each node in order to process the information and to cooperate with these neighboring nodes while Mobile Agents (MA) can be used to reduce information between nodes and send those to the base station (Sink). This work proposes to use communication architecture for wireless sensor networks based on the Multi Agent System (MAS) to ensure optimal information collection. The collaboration of these agents generates a simple message that summarizes the important information in order to transmit it by a mobile agent. To reduce the size of the MA, the nodes of the network have been grouped into sector. As for each MA, we have established an optimal itinerary, consuming a minimum amount of energy with the data aggregation efficiency in a minimum time. Successive simulations in large scale wireless sensor networks through the SINALGO simulator show the performance of our proposal, in terms of energy consumption and package delivery rate.

In recent years, how to combine intelligent prospecting algorithms such as random forest with a large number of geological and mineral data for quantitative prediction of exploration geochemistry has become an important topic of concern to quantitatively improve the accuracy of target delineation. The ore-forming geological conditions in the central Kunlun area of Xinjiang are great and have good prospecting prospects. However, due to the exhaustion of shallow deposits and the lag of geological prospecting work in the past ten years, there has been no expected breakthrough in the search for large and super-large metal deposits for many years. There has been a serious shortage of reserve resources. The use of new theories, new methods and new technologies for mineral resources investigation and evaluation has become an urgent need in the current prospecting work. In view of this, based on the existing spatial database of geological and mineral resources in the central Kunlun of Xinjiang, combined with the geological characteristics, genesis and metallogenic regularity of the area, this paper carried out a series of studies on gold polymetallic minerals with the help of geographic information system and data science programming software platform. The researchers integrated geological and regional geochemical data, and constructed a random forest metallogenic discriminant model based on two different sampling methods (integrated random undersampling and selection of training samples) to predict the mineralization of gold polymetallic minerals in the central Kunlun area of Xinjiang and delineate the metallogenic target area. The quantitative prediction of gold polymetallic mineral resources in the central Kunlun area of Xinjiang by two random forest models is compared and discussed: the known ore spots, fault structures and geochemical information are extracted, and the known gold polymetallic ore spots and geochemical data are used to form a training set and a prediction set to construct a machine learning random forest model. The results of prediction evaluation and metallogenic prospect division show that for different sampling methods, the performance evaluation parameters of the training process show that the prediction accuracy of the selected training samples is higher, and the selected training samples are more reliable because they can fully learn the complex information of the original data. In the metallogenic prospect prediction and metallogenic potential division, the random forest model of selecting training samples has more reference value and further exploration research significance in the production problem considering the actual exploration cost because of its small area of high potential prediction area and high proportion of ore bearing per unit area. At the same time, this study innovatively improves the prediction accuracy, reduces the exploration risk, and expands the prospecting idea of machine learning algorithm in mathematical geology in the central Kunlun area of Xinjiang. The delineated metallogenic potential area has positive guiding significance for the actual gold polymetallic prospecting work in this area.

Drone and aerial remote sensing images are widely used, but their imaging environment is complex and prone to image blurring. Existing CNN deblurring algorithms usually use multi-scale fusion to extract features in order to make full use of aerial remote sensing blurred image information, but images with different degrees of blurring use the same weights, leading to increasing errors in the feature fusion process layer by layer. Based on the physical properties of image blurring, this paper proposes an adaptive multi-scale fusion blind deblurred generative adversarial network (AMD-GAN), which innovatively applies the degree of image blurring to guide the adjustment of the weights of multi-scale fusion, effectively suppressing the errors in the multi-scale fusion process and enhancing the interpretability of the feature layer. The research work in this paper reveals the necessity and effectiveness of a priori information on image blurring levels in image deblurring tasks. By studying and exploring the image blurring levels, the network model focuses more on the basic physical features of image blurring. Meanwhile, this paper proposes an image blurring degree description model, which can effectively represent the blurring degree of aerial remote sensing images. The comparison experiments show that the algorithm in this paper can effectively recover images with different degrees of blur, obtain high-quality images with clear texture details, outperform the comparison algorithm in both qualitative and quantitative evaluation, and can effectively improve the object detection performance of aerial remote sensing blurred images. Moreover, the average PSNR of this paper's algorithm tested on the publicly available dataset RealBlur-R reached 41.02dB, surpassing the latest SOTA algorithm.

Remote sensing image change detection is a key application technology in remote sensing. In recent years, the development of deep learning has brought new opportunities for remote sensing image change detection. However, to achieve high change detection accuracy, large-scale, good-quality labeled data is required to train the model, which is often difficult to obtain and costly. This paper proposes a semi-supervised remote sensing image change detection network based on consistent regularization for multi-scale feature fusion and reuse (SCMFM-CDNet), which can enhance change detection performance with limited labeled data. Specifically, the SCMFM-CDNet consists of two parts, the supervised stage multi-scale feature fusion and reuse network (MFM-CDNet) and the consistency regularization method of semi-supervised learning. The MFM-CDNet network uses channel attention mechanism and spatial attention mechanism to enhance the expression ability of features, and gradually completes the extraction and detection of change features through multi-scale feature fusion and reuse strategy. The consistency regularization method of semi-supervised learning adopts the teacher model and student model for alternate training, updating model parameters by minimizing the differences in their predictions, thus achieving semi-supervised learning. This paper conducted extensive experiments on three public datasets, LEVIR-CD, WHU-CD, and GoogleGZ-CD. Under the three labeling data ratios of 5%, 10%, and 20%, the F1 scores of the SCMFM-CDNet network on the LEVIR-CD dataset were 88.62, 90.78, and 90.63, respectively. On the WHU-CD dataset, the F1 scores were 88.40, 90.17, and 90.83, respectively. On the GoogleGZ-CD dataset, the F1 scores were 81.44, 82.36, and 85.40, respectively. The results indicate that the proposed network outperforms existing semi-supervised change detection methods in terms of comprehensive performance. In addition, this paper also conducted ablation experiments to evaluate the contribution of the global context module (GCM) and feature fusion reuse module (FFM) in the MFM-CDNet network. The experimental results show that these two modules are crucial for improving network performance.

The availability of multi-rotor UAVs with lifting capacities of several kilograms, allows for a new paradigm in atmospheric measurement techniques, i.e. the integration of research-grade sonic anemometers for airborne turbulence measurements. With their ability to hover and move very slowly, this approach yields an unrevealed flexibility compared to mast-based sonic anemometers, for a wide range of boundary layer investigations that require an accurate characterization of the turbulent flow. For an optimized sensor placement, potential disturbances by the propeller-induced flow (PIF), as well as the potential impact of the sensor weight and angular momentum on the flight performance in the case of a boom-mounted sensor, have to be considered.

This paper is focused on two topics very relevant in water distribution networks (WDNs): vulnerability assessment and the optimal placement of water quality sensors. The main novelty element of this paper is to represent the data of the problem, in this case all objects in a graph underlying a water distribution network, as discrete probability distributions. For vulnerability (and the related issue of re-silience) the metrics from network theory, widely studied and largely adopted in the water research community, reflect connectivity expressed as closeness centrality or, betweenness centrality based on the average values of shortest paths between all pairs of nodes. Also network efficiency and the related vulnerability measures are related to average of inverse distances. In this paper we propose a different approach based on the discrete probability distribution, for each node, of the node-to-node distances. For the optimal sensor placement, the elements to be represented as dis-crete probability distributions are sub-graphs given by the locations of water quality sensors. The objective functions, detection time and its variance as a proxy of risk, are accordingly represented as a discrete e probability distribution over contamination events. This problem is usually dealt with by EA algorithm. We’ll show that a probabilistic distance, specifically the Wasserstein (WST) distance, can naturally allow an effective formulation of genetic operators. Usually, each node is associated to a scalar real number, in the optimal sensor placement considered in the literature, average detection time, but in many applications, node labels are more naturally expressed as histograms or probability distributions: the water demand at each node is naturally seen as a histogram over the 24 hours cycle. The main aim of this paper is twofold: first to show how different problems in WDNs can take advantage of the representational flexibility inherent in WST spaces. Second how this flexibility translates into computational procedures.

Blade Health Monitoring (BHM) is often necessary in power plants and in aviation to prevent excessive blade vibration and cracks. This article proposes a network of blade tip timing sensors operated in a distributed BHM system. A number of cooperating agents is implemented in smart conditioning units which can autonomously operate in an adverse environment and communicate with other nodes via a serial interface. The project uses special versions of reduced instruction set chips that are able to operate near the hot section of the engine. Due to the limited number of types of microprocessors available in the extended temperature range grading, it was necessary to fully utilize the limited hardware resources and implement preemptive multitasking. For this purpose, a custom operating system and communication protocol were designed. The protocol hosts the middle layer which hides the implementation of the distributed system. The presented architecture ensures the sufficient computational capacity in individual nodes of the network operated in adverse conditions. It is scalable and resistant to transmission errors.

Gyroscopes are fascinating instruments with a history of about 200 years. When J.G.F. Bohnenberger presented his machine to his students in 1810 at the University of Tuebingen, Germany, nobody could have foreseen that this fascinating development would be used for complex orientation and positioning. At the University of Stuttgart, Germany, a collection of 160 exhibits is available and in transition for a sustainable future. Here, the systems are digitized in 2D, 2.5D and 3D and are made available for a world-wide community using OpenAccess platforms. The technologies being used are Computed Tomography, Computer Vision, Endoscopy and Photogrammetry. The workflows for combining voxel representations and colored point clouds are described, to create Digital Twins of the tangible assets. Advantages and disadvantages are discussed und work for near future is outlined in this new and challenging field of Tech Heritage digitization.

Cervical fusion has been a standard procedure for treating the abnormalities associated with the cervical spine. However, the reliability of anterior cervical discectomy and fusion (ACDF) has become arguable due to its adverse effects on the biomechanics of adjacent segments. One of the drawbacks associated with ACDF is adjacent segment degeneration (ASD) which has served as the base for the development of dynamic stabilization systems (DSS) and total disc replacement (TDR) devices for cervical spine. However, the hybrid surgical technique has also gained popularity recently but their effect on the biomechanics of cervical spine is not well researched. Thus, the objective of this FE study was to draw the comparison among single, bi-level and hybrid surgery with DCI implant with traditional fusion. Reduction in range of motion (ROM) for all the implanted models was observed for all the motions except extension, compared to intact model. The maximum increase in ROM of 42% was observed at C5-C6 level in Hybrid-DCI model. The maximum increase in adjacent segment’s ROM of 8.7% was observed in multilevel fusion model. The maximum von Mises stress in the implant was highest for the multilevel DCI model. Our study also showed that the shape of DCI implant permits flexion/extension relatively more compared to lateral bending and axial rotation.

This paper proposes a linear eddy-current feature to determine the radius of a metallic ball in a non-contact manner. An electromagnetic eddy-current sensor with two coils is placed co-axially to the metal ball during measurement. It is well known that the distance between the sensor and test piece (i.e. lift-off) affects eddy-current signals. In this paper, it is found that the peak frequency feature of inductance spectrum is linear to the lift-off spacing between the centre of coil and ball. Besides, the slope of peak frequencies versus lift-offs is linked to the radius of ball. The radius of metallic balls is retrieved from the experimental and embedded analytical result of the slope. Measurements have been carried out on 6 metallic balls with different radii. The radius of the metallic ball can be retrieved with an error of less than 2 %.

Wireless Sensor Network is an emerging technology and the collaboration of wireless sensors becomes one of the active research areas to utilize sensor data. Various sensors collaborate to recognize the changes of a target environment, to identify, if occurs, any radical change. For the accuracy improvement, the calibration of sensors has been discussed, and sensor data analytics are becoming popular in research and development. However, they are not satisfactorily efficient for the situations where sensor devices are dynamically moving, abruptly appearing or disappearing. If the abrupt appearance of sensors is a zero-day attack and the disappearance of sensors is an ill-functioning comrade, then sensor data analytics of untrusted sensors will result in an indecisive artifact. The pre-defined sensor requirements or meta-data based sensors verification is not adaptive to identify dynamically moving sensors. This paper describes a deep-learning approach to verify the trustworthiness of sensors by considering the sensor data only, without having to use meta-data about sensors or to request consultation from a cloud server. The contribution of this paper includes 1) quality preservation of sensor data for mining analytics and 2) authenticity verification of dynamically moving sensors with no external consultation.

This paper investigates the applicability of deep learning models for predicting the severity of forest wildfires, utilizing an innovative benchmark dataset called EO4WildFires. EO4WildFires integrates multispectral imagery from Sentinel-2, SAR data from Sentinel-1 and meteorological data from NASA Power annotated with EFFIS data for forest fire detection and size estimation. Resulting in a coverage of 45 countries (Figure \ref{Figure1-events}) with a total of 31730 wildfire events from 2018 to 2022. All these various sources of data are archived into data cubes, with the intention of assessing wildfire severity by considering both current and historical forest conditions, utilizing a broad range of data including temperature, precipitation, and soil moisture. The experimental setup has been arranged to test different deep learning architectures’ effectiveness in predicting the size and shape of wildfire burned areas. The study incorporates both Image Segmentation networks and Visual Transformers, employing a consistent experimental design across various models to ensure comparability of results. Adjustments were made to the training data, such as the exclusion of empty labels and very small events, to refine the focus on more significant wildfire events and potentially improve prediction accuracy. The models’ performance was evaluated using metrics like F1 Score, IoU Score, and Average Percentage Difference (aPD). These metrics offer a multi-faceted view of model performance, assessing aspects such as precision, sensitivity, and the accuracy of the burned area estimation. Through extensive testing with Image Segmentation networks and Visual Transformers, the research not only aims at enhancing the accuracy of estimating the burned area but also underscores the significance of quality training data and the comparative effectiveness of traditional segmentation methods over transformer-based models for this specific application. The dataset is published with an Open Access license and is hosted at: \url{10.5281/zenodo.7762564}.

In order to solve the problem of fault diagnosis for CNC machine feed system under the condition of variable speed conditions, an intelligent fault diagnosis method based on multi-domain feature extraction and ensemble learning model is proposed. First, various monitoring signals including vibration signal, noise signal and current signal are collected. Then, the monitoring signals are preprocessed and the time-domain, frequency-domain and time-frequency domain feature indexes are extracted to construct a multi-dimensional mixed domain feature set. Finally, the feature set is putting into the constructed DoubleEnsemble-LightGBM model to realize the fault diagnosis of the feed system. The experimental results show that the model can achieve good diagnosis results under different working conditions for both the public data set and the feed system test bench data set, and the average overall accuracy is 91.07% and 98.06% respectively. Compared with XGBoost and other advanced ensemble learning models, the method has better accuracy. It provides technical support for the stable operation and intelligent of CNC machine tools..

This work analyzes a new indoor laboratory data set looking at early fire indicators in controlled and realistic experiments representing different incipient fire scenarios. The experiments were performed within the confines of an indoor laboratory setting using multiple distributed sensor nodes on different room positions. Each sensor node collected data of particulate matter (PM), volatile organic compounds (VOC), CO, CO2, H2, UV, air temperature and humidity in terms of a multivariate time series. These data hold immense value for researchers within the machine learning and data science communities who are keen on exploring innovative advanced statistical and machine learning techniques. They serve as a valuable resource for the development of early fire detection systems. The analysis of the collected data was carried out in dependence of the manhattan distance between the fire source and the sensor node. We found that especially larger particles (&gt; 0.5 μm) and VOCs show a significant dependency with respect to the intensity as a function of the manhattan distance to the source. Moreover, we observed differences in the propagation behavior of VOCs, PM, and CO, which are particularly relevant in incipient fire scenarios due to the presence of strand popagation effects.

Water covers a greater part of the earth's surface. Even though we know very little about the underwater world as most parts of it remain unexplored. Oceans including other water bodies hold huge natural resources and also the aquatic lives. These are mostly unexplored and very few of those are known due to unsuited and hazardous environments for the human to explore. This vast underwater world can be monitored remotely from a distant location with much ease and less risk. To monitor water-bodies remotely in real-time, sensor networking has been playing a great role. It is needed to deploy a wireless sensor network over the volume which we want to surveil. For vast water bodies like oceans, rivers and large lakes, data is collected from the different heights of the water level which is sent to the surface sink. Unlike terrestrial communication, radio waves and other conventional mediums can't serve the purpose of underwater communication as they pose high attenuation and very reduced transmission range. Rather an acoustic medium can transmit data more efficiently and reliably in comparison to other mediums. To transmit data reliably from the bottom of the sea to the sinks at the surface, multi-hop communication is needed which must involve a certain scheme. For seabed to surface sink communication, leading researchers have proposed different routing protocols. The goal of these routing protocols is to make underwater communication more reliable, energy-efficient and delay efficient thus to improve the performance of the overall communication. This paper surveys the advancement and applications of the routing protocols which eventually helps in finding the most efficient routing protocol for the Underwater Wireless Sensor Network (UWSN).

In recent years, demand has been increasing for target detection and tracking from aerial imagery via drones using onboard powered sensors and devices. We propose a very effective method for this application based on a deep learning framework. A state-of-art embedded hardware system empowers small flying robots to carry out the real-time onboard computation necessary for object tracking. Two types of embedded modules were developed: one is designed using a Jetson TX or AGX Xavier, and the other is based on an Intel Neural Compute Stick. These are suitable for real-time onboard computing power on small flying drones with limited space. A comparative analysis of current state-of-art deep-learning-based multi-object detection algorithms was carried out utilizing the designated GPU-based embedded computing modules to obtain detailed metric data about frame rates as well as the computation power. We also introduce an effective target tracking approach for moving objects. The algorithm for tracking moving objects is based on the extension of simple online and real-time tracking. It was developed by integrating a deep-learning-based association metric approach (Deep SORT), which uses a hypothesis tracking methodology with Kalman filtering and a deep-learning-based association metric. In addition, a guidance system that tracks the target position using a GPU-based algorithm is introduced. Finally, we demonstrate the effectiveness of the proposed algorithms by real-time experiments with a small multi-rotor drone.

Accurate and timely prediction of Napa cabbage (Brissica rapa subsp. Perkinensis) fresh weight is crucial for optimizing harvest timing, crop management, and supply chain logistics, contributing to food security and price stabilization. Traditional manual sampling methods are labor-intensive and imprecise. This study addresses this challenge by developing a comprehensive (artificial intelligence) AI-powered model for predicting Napa cabbage fresh weight using unmanned aerial vehicle (UAV)-based multi-sensor data. High-resolution RGB, multispectral, and thermal infrared (TIR) imagery were collected over a Napa cabbage field throughout the 2020 growing season. Various vegetation indices, crop features (vegetation fraction, crop height model), and water stress indi-cators (CWSI) were extracted from the imagery. Three AI algorithms—deep neural network (DNN), support vector machine (SVM), and random forest (RF)—were trained and evaluated, with the DNN model consistently outperforming the others. The DNN model achieved the highest accuracy (R² = 0.86 for training, 0.82 for testing; root mean square error (RMSE) = 0.432 kg for training, 0.465 kg for testing) during the mid-to-late rosette growth stage (DAP 35-42), highlighting this period as crucial for fresh weight estimation due to stable leaf area and well-developed canopy structure. The model tended to underestimate the weight of Napa cabbages exceeding 5 kg, potentially due to limited samples and saturation effects of vegetation indices. However, the overall error rate was less than 5%, demonstrating the feasibility and effectiveness of this approach. Spatial analysis revealed that the model accurately captured the variability in Napa cabbage growth across different soil types and irrigation conditions, particularly reflecting the positive impact of drip irrigation on the sandy loam plot. Bias analysis indicated the DNN model's tendency to overestimate smaller Napa cabbages (2 kg), suggesting areas for future refinement. This study demonstrates the potential of UAV-based multi-sensor data and AI algorithms for accurate and non-invasive prediction of Napa cabbage fresh weight. The developed DNN model offers a promising tool for optimizing harvest timing, improving crop management practices, and en-hancing supply chain efficiency. Future research should focus on refining the model for specific weight ranges and diverse environmental conditions, as well as extending its application to other crops, to further advance precision agriculture and contribute to sustainable food production.

In order to make full use of the complementarity of existing navigation systems to improve the navigation and positioning accuracy, this paper investigates the visual/INS integrated navigation system based on the factor graph optimization (FGO) algorithm. In the traditional visual/INS integrated navigation system, there is often the problem of image blurring due to the rapid change of light and shadow captured by the vision sensor and the attitude change of the carrier, which leads to the decrease of the positioning accuracy of the combined navigation system. Therefore, this paper firstly introduces Retinex algorithm and BID algorithm to carry out the design of image de-blurring method; then implements the visual/INS integrated navigation algorithm based on the factor graph optimization method; finally, the experimental scheme is designed, comparative experiments are carried out, and the researched method is verified by using the public dataset. The experimental results show that the combined navigation algorithm realized in this paper has high accuracy, and its positioning accuracy is improved by 40% compared with visual positioning.

The presence of fog in the background can prevent small and distant objects from being detected, let alone tracked. Under safety-critical conditions, multi-object tracking models require faster-tracking speed while maintaining high object-tracking accuracy. The original DeepSORT algorithm used YOLOv4 for the detection phase, and a simple neural network for deep appearance descriptor. Consequently, the feature map generated loses relevant details about the track being matched with a given detection in fog. Targets with a high degree of appearance similarity on the detection frame are more likely to be mismatched, resulting in identity switches or track failures in heavy fog. We propose an improved multi-object tracking model based on the DeepSORT algorithm to im-prove tracking accuracy and speed under foggy weather conditions. First, we employed our camera-radar fusion network (CR-YOLOnet) in the detection phase for faster and more accurate object detection. We proposed an appearance feature network to replace the basic convolutional neural network. We incorporated GhostNet to take the place of the traditional convolutional layers to generate more features and reduce computational complexities and cost. We adopted a segmentation module and fed the semantic labels of the corresponding input frame to add rich semantic information to the low-level appearance feature maps. Our proposed method outperformed YOLOv5 + DeepSORT with a 35.15% increase in multi-object tracking accuracy, a 32.65% increase in multi-object tracking precision, the speed increased by 37.56%, and identity switches decreased by 46.81%.

Human-robot collaboration is a new trend in modern manufacture. The safety or human protection is of great significance due to the share of the same workshop between humans and robots. To achieve effective protection, in this paper, a contact force sensor based on the 8-shaped wound polymer optical fiber is proposed. The 8-shaped wound structure can convert the normal contact force to the shrinkage of the 8-shaped optical fiber ring. The macro-bending loss of the optical fiber is used to detect the contact force. Compared with conventional sensors, the proposed scheme has the advantage of high flexibility, low cost, fast response, high repeatability, which shows the great promise on actively alarming collision and passively reducing the hurt.

This paper comprehensively reviews sensors and sensing devices developed or/and proposed so far utilizing two smart materials: electrorheological fluids (ERFs) and magnetorheological materials (MRMs) whose rheological characteristics such as stiffness and damping can be controlled by external stimuli, an electrical voltage for ERFs and a magnetic field for MRMs, respectively. In this review article, the MRMs are classified into magnetorheological fluid (MRF), magnetorheological elastomer (MRE) and magnetorheological plastomer (MRP). To easily understand the history of sensing research using the two smart materials, the order of this review article is organized in a chronological manner of ERF sensors, MRF sensors, MRE sensors and MRP sensors. Among many sensors fabricated from each smart material, one or two sensors or sensing devices are adopted to discuss on the sensing configuration, working principle and specifications such as accuracy and sensitivity. Some sensors adopted in this article include force sensor, tactile device, strain sensor, wearable bending sensor, magnetometer, display device and flux measurement sensor. After briefly describing what have been reviewed in a conclusion, several challenging future works, which should be done for practical applications as sensors or sensing devices, are remarked in terms of new technologies such as artificial intelligence neural network in which several parameters affecting the sensor signals can be precisely tuned or controlled. It is sure that this review article is very helpful to make creative sensors using not only the proposed smart materials but also several different types of smart materials including shape memory alloys and active polymers.

Recently, there is a growing need for sensors that can operate autonomously, without the need for an external power source. This is especially important in applications where conventional power sources, such as batteries, are impractical or difficult to replace. Self-powered sensors have emerged as a promising solution to this challenge, offering a range of benefits such as low cost, high stability, and environmental friendliness. One of the most promising self-powered sensor technologies is L-S TENG, which stands for the liquid-solid triboelectric nanogenerator. This technology works by harnessing the mechanical energy generated by external stimuli such as pressure, touch, or vibration, and converting it into electrical energy that can be used to power sensors and other electronic devices. Therefore, self-powered based on L-S TENG, which provides numerous benefits such as rapidly responding, portability, cost-effectiveness, and miniaturization, is critical for increasing living standards and optimizing industrial processes. In this review paper, the working principle with three basic modes has been briefly introduced firstly. After that, affecting parameters to L-S TENG are reviewed based on the properties of the liquid and solid phases. With different working principles, L-S TENG has designed a lot of structure that works as a self-powered sensor for pressure/force change, liquid flow motion, concentration, and chemical detection or biochemical sensing. Moreover, the continuous output signal of TENG plays an important role in a real-time sensor that is vital to the growth of the Internet of Things.

Underwater Wireless Sensor Networks (UWSN) enables various oceanic applications which require effective packet transmission. In this case, sparse node distribution, dynamic network topology and inappropriate selection of relay nodes cause void holes. Addressing this problem, we present a Relay based Void Hole Prevention and Repair protocol (ReVOHPR) by multiple Autonomous Underwater Vehicles (AUV) for UWSN. ReVOHPR efficiently identifies and avoids void holes and trap relay nodes to avoid it. ReVOHPR adopts the following operations as Ocean Depth (levels) based Equal Cluster Formation, Dynamic Sleep Scheduling, Virtual Graph based Routing, and Relay Assisted Void Hole Repair. For energy efficient cluster forming, Entropy based Eligibility Ranking (E2R) is presented which elects stable cluster heads (CHs). Then, dynamic sleep scheduling is implemented Dynamic Kernel Kalman Filter (DK2F) algorithm in which Sleep and Active modes based on the nodes current status. Inter Cluster Routing is performed by maximum matching nodes which selects by Dual criteria and also data transmitted to AUV. Finally, void holes are detected and repair by Bi-Criteria Mayfly Optimization (BiCMO) algorithm. The BiCMO focuses on reducing the number of holes, data packet loss and maximizes Quality of Service (QoS) and energy efficiency of the networks. This protocol is timely deal with node failures in packet transmission via multi-hop routing. Simulation is implemented by NS3 (AquaSim module) simulator that evaluates the performance in network simulation for following metrics as average energy consumption, delay, packet delivery rate and throughput.

Mapping forest extent and forest cover classification are important for the assessment of forest resources in socio-economic as well as ecological terms. Novel developments in the availability of remotely sensed data, computational resources, and advances in areas of statistical learning have enabled fusion of multi-sensor data, often yielding superior classification results. Most former studies of nemoral forests fusing multi-sensor and multi-temporal data have been limited in spatial extent and typically to a simple classification of landscapes into major land cover classes. We hypothesize that multi-temporal, multi-censor data will have a specific strength in further classification of nemoral forest landscapes owing to the distinct seasonal patterns of the phenology of broadleaves. This study aimed to classify the Danish landscape into forest/non-forest and further into forest types (broadleaved/coniferous) and species groups, using a cloud-based approach based on multi-temporal Sentinel 1 and 2 data and machine learning (random forest) trained with National Forest Inventory (NFI) data. Mapping of non-forest and forest resulted in producer accuracies of 99% and 90 %, respectively. The mapping of forest types (broadleaf and conifer) within the forested area resulted in producer accuracies of 95% for conifer and 96% for broadleaf forest. Tree species groups were classified with producer accuracies ranging 34-74%. Species groups with coniferous species were the least confused whereas the broadleaf groups, especially Oak, had higher error rates. The results are applied in Danish National accounting of greenhouse gas emissions from forests, resource assessment and assessment of forest biodiversity potentials.

The aim of this paper is to create a sensor model based on optical crystal fibers (PCF). The aim of this model is to find and identify zinc cadmium. This thesis looked at three different categories of concentrations. For sensor architecture, PCF was generated using single-mode fiber-to-end split fusion (SM-PCF-SM). In this experiment, a specific wavelength spectrum was used to alter the concentration of materials covering the fiber in order to demonstrate the fiber's sensing capability. The 550nm wavelength has been used as the optical source for the fiber. The change in the output power of the external light was monitored and changes were observed for each concentration of the concentrations around the fiber. It has been found that the fiber is sensitive to small changes in concentrations. The absorption of the fiber has been calculated for the incoming capacity, as well as the losses in the capacity outside the fiber.

4-(thiazol-2-yldiazenyl)phenol (L₁) and 2-((4-hydroxyphenyl) diazenyl)-5-nitrophenol (L₂) based on azo phenol were synthesised and used as selective colorimetric sensor for CN^- and AcO⁻ ion in DMSO/H₂O-HEPES (v/v; 1:1, pH–7.3 ± 0.2) and showed good sensitivity with large red shifts and nanomolar detection limit for CN^- and AcO^- ion. The stoichiometry of L₁ with CN⁻/AcO⁻ ion was found to be 1:1 and L₂ with CN⁻/AcO⁻ ion was found to be 1:2. Binding constant for L₁+ CN⁻, L₁ + AcO⁻, L₂ + CN⁻ and L₂ + AcO⁻ were calculated by B-H plot as 1.6 × 10³, 8.0 × 10², 8.4 × 10³ and 1.7 × 10² respectively. L₂ showed high selectivity towards CN⁻ ion with low detection limit of 81 nM and large binding constant. In addition, ¹H NMR titration and DFT studies also supported the deprotonation mechanism of receptors in the presence of selective anions.

Phosphors based on magnesium titanate activated with Mn⁴⁺ ions are of great interest because, when excited with blue light, they display a strong red-emitting luminescence. They are characterized by a luminescence decay which is strongly temperature dependent in the range from 0 to 80 °C, making these materials very promising for temperature sensing in the biochemical field. In this work the optical and thermal properties of the luminescence of Mg₂TiO₄ are investigated for different Mn⁴⁺ doping concentrations. The potential of this material for temperature sensing is demonstrated by fabricating a fiber optic temperature microsensor and by comparing its performance against a standard resistance thermometer. The response of the fiber optic sensor is exceptionally fast, enabling monitoring of temperature fluctuation in subsecond time domain.

This study presents of the microsphere-based fiber-optic sensor with the ZnO ALD coating thickness of 100 nm and 200 nm for temperature measurements. Metrological properties of the sensor were investigated over the temperature range of 100°C to 300°C, with a 10°C step. The interferometric signal is used to control whether the microstructure is intact. Spectrum shift of a reflected signal is used to conclude changes in measured parameter for the sensor with a 100 nm coating, while the reflected signal intensity is an indicator during measurements executed by a sensor with a 200 nm coating. With changing temperature, the peak position or intensity of a reflected signal also changes. The R2 coefficient of the presented sensors indicates a linear fit of over 0.99 to the obtained data. The sensitivity of the sensors, investigated in this study, equals 103.5 nW/°C and 0.019 nm/°C for ZnO thickness of 200 nm and 100 nm, respectively.

Miscanthus holds a great potential in the frame of the bioeconomy and yield prediction can help improving Miscanthus logistic supply chain. Breeding programs in several countries are attempting to produce high-yielding Miscanthus hybrids better adapted to different climates and end-uses. Multispectral images acquired from unmanned aerial vehicles (UAVs) in Italy and in the UK in 2021 and 2022 were used to investigate the feasibility of high-throughput phenotyping (HTP) of novel Miscanthus hybrids for yield prediction and crop traits estimation. An intercalibration procedure was performed using simulated data from the PROSAIL model to link vegetation indices (VIs) derived from two different multispectral sensors. Random forest algorithm estimated with good accuracy yield traits (light interception, plant height, green leaf biomass and standing biomass) using VIs time series and predicted yield using peak descriptor derived from VIs time series with 2.3 Mg DM ha-1 of RMSE. The study demonstrates the potential of UAVs multispectral in HTP applications and in yield prediction for providing important information needed to increase sustainable biomass production.

In daily travel and activities, pathfinding is a significant process. They are often used in transportation routes calculation. They have now evolved to be able to solve most situations of the pathfinding and its related problems. This review describes previous and recent studies on the pathfinding algorithms. It reviews the development of pathfinding algorithms in a classification base on their usage. The aim is to summarize the application of the pathfinding algorithms for the readers interested in the subject that can be used as a supplement.

Fabry-Perot air chamber was constructed at the melting point (splicing location) of two single-mode fibers by glycerin assisted self-expansion method. The morphology of the Fabry-Perot air chamber was fabricated and optimized by modulating the splicing parameters (drawing process, discharging location, time and intensity) and the fibers’ end-face (plane or arc). The in-line or reflected Fabry-Perot cavities have been applied to determine the tensile strain in the range of 0-1.2 N. The train sensing performance of the spherical shaped FP cavity has been experimentally demonstrated with the best sensitivity of 3.628 nm/N, corresponding to the resolution of ~0.005 N. The proposed FP fiber sensor has the advantages of low cost, fast fabrication and easy-integration with the common fiber system.

AYUMI EYE is an accelerometer-based gait analysis device that measures the 3D accelerations of the human trunk. This study investigated the measurement accuracy of the AYUMI EYE as hardware as well as the accuracy of the gait cycle extraction program via simultaneous measurements using AYUMI EYE, a ground reaction force (GRF), and an optical motion capture system called VICON. The study was conducted with four healthy individuals as participants. The gait data were obtained by simulating four different patterns for three trials each: normal walking, anterior-tilt walking, hemiplegic walking, and shuffling walking. The AYUMI EYE and VICON showed good agreement for both the acceleration and displacement data. The durations of subsequent stride cycles calculated using the AYUMI EYE and GRF were in good agreement based on the calculated cross-correlation coefficients (CCs) with an r value of 0.896 and p-value less than 0.05, and their accuracies for these results were sufficient.

In this work, an evanescent Bragg grating sensor inscribed in a few-mode planar polymer waveguide was integrated in microchannel structures and characterized with various chemical applications. The planar waveguide and the microchannels consisted of epoxide-based polymers. The Bragg grating structure was post-processed using point-by-point direct inscription technology. By monitoring the central wavelength shift of the reflected Bragg signal, the sensor showed a temperature sensitivity of -47.75 pm/K. Moreover, the functionality of the evanescent field-based measurements is demonstrated with two application examples: refractive index sensing of different aqueous solutions and gas-phase hydrogen concentration detection. For the latter application, the sensor was additionally coated with a functional layer based on palladium nanoparticles. During the refractive index sensing measurement, the sensor achieved a sensitivity of 6.5 nm/RIU from air to 99.9% pure isopropyl alcohol. For the gas-phase hydrogen detection, the coated sensor achieved a reproducible concentration detection up to 4 vol% hydrogen. According to the reported experimental results, the integrated Bragg grating-based waveguide sensor demonstrates high potential for applications based on lab-on-a-chip concept.

Multi-Faith Spaces (MFS) are a relatively recent invention that quickly gained in significance. On the one hand, they offer a convenient solution for satisfying needs of people with diverse beliefs in the institutional context of hospitals, schools, airports, etc. On the other hand, as Andrew Crompton pointed out, they are politically significant because the multi-faith paradigm “is replacing Christianity as the face of public religion in Europe” (2012, p. 493). Due to their ideological entanglement, MFS are often used as the means to promote either a more privatised version of religion, or a certain denominational preference. Two distinct designs are used to achieve these means: negative in the case of the former, and positive in the latter. Neither is without problems, and neither adequately fulfils its primary purpose of serving diverse groups of believers. Both, however, seem to follow the biases and main problems of secularism. In this paper, I analyse recent developments of MFS to detail their main problems and answer the question, whether the MFS, and the underlying Multi-Faith Paradigm, can be classified as a continuation of secularism.

Mechanical ventilation systems, which are used for breathing support when a person is not able to do it by their own, requires a device for measuring the air flow to the patient in order to monitoring and a assure the magnitude establish by a medical staff. Flow sensors are the conventional devices used for the air flow measuring; however, there were not available in Peru, because of the international demand during COVID-19 pandemic. In this sense, a novel air flow sensor based on orifice plate and an intelligent transducer stage were developed as an integrated design. Advanced methodologies in simulations and experiments using specially designed equipment for this application were carried out. The obtained data was used for a mathematical characterization and dimensions validation of the integrated design. The device was tested in its real working conditions, it was implemented in a breathing circuit connected to a low-cost mechanical ventilation system based on cams. Results indicate that the designed air flow sensor/transducer is a low-cost complete medical device for mechanical ventilators able to provide satisfactorily all the ventilation parameters air flow, pressure and volume over time by measuring the air flow and calculating the others. Furthermore, this device provides directly a filtered equivalent electrical signal for a display or a computer.

Detection of human movement requires lightweight, flexible systems to detect mechanical parameters (like strain and pressure) not interfering with user activity, and that he/she can wear comfortably. In this work we address such multifaceted challenge with the development of smart garments for lower limb motion detection, like a textile kneepad and anklet in which soft sensors and readout electronics are embedded for detecting movement of the specific joint. Stretchable capacitive sensors with a three-electrode configuration are built combining conductive textiles and elastomeric layers, and distributed at knee and ankle. They show an excellent behavior in the ~30% strain range, hence the correlation between their responses and the optically tracked Euler angles is allowed for basic lower limb movements. Bending during knee flexion/extension is detected, and it is discriminated from any external contact by implementing in real time a low computational algorithm. The smart anklet is designed to address joint motion detection in and off the sagittal plane. In this work, ankle dorsi/plantar flexion, adduction/abduction, and rotation are retrieved. Both smart garments show a high accuracy in movement detection, with a RMSE less than 4° in the worst case.

We present a data-driven, in situ proximal multi-sensor digital soil mapping approach to develop digital twins for multiple agricultural fields. A novel Digital Soil CoreTM (DSC) Probe was engineered that contains seven sensors, each of a distinct modality, including sleeve friction, tip force, dielectric permittivity, electrical resistivity, soil imagery, acoustics, and visible and near-infrared spectroscopy. The DSC System integrates components the DSC Probe, DSC software, and deployment equipment to sense soil characteristics at a high vertical spatial resolution (mm scale) along in situ soil profiles up to a depth of 120 cm in about 60 sec. The DSC Probe in situ proximal data are harmonized into a data cube providing vertical high-density knowledge associated with physical-chemical-biological soil conditions. In contrast, conventional ex situ soil samples derived from soil cores, soil pits, or surface samples analyzed using laboratory and other methods are bound by substantially coarser spatial resolution and multiple compounding errors. Our objective was to investigate the effects of mismatched scale between high-resolution in situ proximal sensor data and coarser resolution ex situ soil laboratory measurements to develop soil prediction models. Our study was conducted in central California soil in almond orchards. We collected DSC sensor data and spatially co-located soil cores that were sliced into narrow layers for laboratory-based soil measurements. Partial Least Squares Regression (PLSR) cross-validation was used to compare results testing four data integration methods. Method A reduced the high-resolution sensor data to discrete values paired with layer-based soil laboratory measurements. Method B used stochastic distributions of sensor data paired with layer-based soil laboratory measurements. Method C allocated the same soil analytical data to each one of the high-resolution multi-sensor data within a soil layer. Method D linked the high-density multi-sensor soil data directly to crop responses (crop performance and behavior metrics) bypassing costly laboratory soil analysis. Overall, the soil models derived from Method C outperformed Methods A and B. Soil predictions derived using Method D were most cost-effective for directly assessing soil-crop relationships, making this method well-suited for industrial-scale precision agriculture applications.

Glass has emerged as a highly versatile substrate for various sensor and MEMS packaging applications, including electromechanical, thermal, optical, biomedical, and RF devices, due to its exceptional properties such as high geometrical tolerances, outstanding heat and chemical resistance, excellent high-frequency electrical properties, and the ability to be hermetically sealed. In these applications, Through-Glass-Via (TGV) plays a vital role in manufacturing and packaging by creating electrical interconnections through glass substrates. This paper provides a comprehensive summary of the research progress in TGV fabrication along with their integrations, including through-via formation and metallization. The paper also reviews the significant qualification and reliability achievements obtained by the scientific community for TGV. Additionally, the paper summarizes the application of TGV technology in various sensors.

Cancer is a common illness with a high mortality. Compared to traditional technologies, biomarkers detection, with low cost and simple operation, has higher sensitivity and faster speed in early screening and prognosis of cancer. Therefore, extensive research has been focused on the development of biosensors and the construction of sensing interfaces. Molybdenum disulfide (MoS2) is a promising two-dimensional (2D) nanomaterial, whose unique adjustable bandgap shows excellent electronic and optical properties in the construction of biosensor interfaces. It not only has the advantages of high catalytic activity and low manufacturing costs, but also can further expand the application of hybrid structures by different functionalization, and is widely used in various biosensors fields. Herein, the application of electrochemical and optical sensing platforms based on MoS2 in the detection of cancer biomarkers was comprehensively reviewed. Firstly, the structure and preparation method of MoS2 were introduced, and its applicable characteristics in the field of biosensors were explored. Secondly, we comprehensively reviewed the recent construction and application of sensing platform based on MoS2 in the field of cancer biomarkers detection in both electrochemical and optical aspects. The prime characteristics and application performances of MoS2 and its composites were emphasized. Additionally, we also involved some other types of biosensors based on MoS2. Finally, we summarized the challenges and development prospects of MoS2 in the application of cancer biomarkers detection, and provided some insights for the application potential of this kind of emerging nano-materials in a broader field.