Manipulating cloth-like deformable objects (CDOs) is a long-standing problem in the robotics community. CDOs are flexible (non-rigid) objects that do not show a detectable level of com- pression strength while two points on the article are pushed towards each otherand include objects such as ropes (1D), fabrics (2D) and bags (3D). In general, CDOs’ many degrees of freedom (DoF) introduce severe self-occlusion and complex state-action dynamics as significant obstacles for perception and manipulation systems. These challenges exacerbate existing issues of modern robotic control methods such as imitation learning (IL) and reinforcement learning (RL). This review focuses on the application details of data-driven control methods on four major task families in this domain: cloth-shaping, rope manipulation, dressing and bag manip- ulation. Furthermore, we identify specific inductive biases in these four domains that present challenges for more general IL and RL algorithms, and summarise the future direction for the development of the field.

This paper presents a two-dimensional mathematical model of compound eye vision. Such a model is useful for solving navigation issues for autonomous mobile robots on the ground plane. The model is inspired by the insect compound eye that consists of ommatidia, which are tiny independent photoreception units, each of which combines a cornea, lens, and rhabdom. The model describes the planar binocular compound eye vision, focusing on measuring distance and azimuth to a circular feature with an arbitrary size. The model provides a necessary and sufficient condition for the visibility of a circular feature by each ommatidium. On this basis, an algorithm is built for generating a training data set to create two deep neural networks (DNN): the first detects the distance, and the second detects the azimuth to a circular feature. The hyperparameter tuning and the configurations of both networks are described. Experimental results showed that the proposed method could effectively and accurately detect the distance and azimuth to objects.

This work is part of an ongoing research project to develop an unmanned flying social robot to monitor dependants at home in order to detect the person’s state and bring the necessary assistance. In this sense, this paper focuses on the description of a virtual reality (VR) simulation platform for the monitoring process of an avatar in a virtual home by a rotatory-wing autonomous unmanned aerial vehicle (UAV). This platform is based on a distributed architecture composed of three modules communicated through the Message Queue Telemetry Transport (MQTT) protocol: the UAV Simulator implemented in MATLAB/Simulink, the VR Visualiser developed in Unity, and the new emotion recognition (ER) System developed in Python. Using a face detection algorithm and a convolutional neural network (CNN), the ER System is able to detect the person’s face in the image captured by the UAV’s on-board camera and classify the emotion among seven possible ones (surprise, fear, happiness, sadness, disgust, anger or neutral expression). The experimental results demonstrate the correct integration of this new computer vision module within the VR platform, as well as the good performance of the designed CNN, with around 85% in the F1-score, a mean of the precision and recall of the model. The developed emotion detection system can be used in the future implementation of the assistance UAV that monitors dependent people in a real environment, since the methodology used is valid for images of real people.

Abstract: Mass spectrometry research laboratories reported multiple probes for ambient ionization in the last years. Combining them with a mechanical moving stage enables automated sampling and imaging applications. We developed a robotic platform, which is based on RepRap 3D-printer components, and therefore easy to reproduce and to adopt for custom prototypes. The minimal step width of the Open LabBot is 12.5 μm, and the sampling dimensions (x, y, z) are 18 × 15 × 20 cm. Adjustable rails in an aluminium frame construction facilitate the mounting of additional parts such as sensors, probes, or optical components. The Open LabBot uses industry-standard G-code for its control. The simple syntax facilitates the programming of the movement. We developed two programs: 1) LABI-Imaging, for direct control via a USB connection and the synchronization with MS data acquisition. 2) RmsiGUI, which integrates all steps of mass spectrometry imaging: The creation of G-code for robot control, the assembly of imzML files from raw data and the analysis of imzML files. We proved the functionality of the system by the automated sampling and classification of essential oils with a PlasmaChip probe. Further, we performed an ambient ionization mass spectrometry imaging (AIMSI) experiment of a lime slice with laser desorption low-temperature plasma (LD-LTP) ionization, demonstrating the integration of the complete workflow in RmsiGUI. The design of the Open LabBot and the software are released under open licenses to promote their use and adoption in the instrument developers’ community.

This research introduces an Intelligent Robotic Arm with Adaptive Collision Avoidance, employing real-time current fluctuation analysis for human-proximity detection. Precision and versatility in motors and actuators are given top priority in the robotic arm setup. Motor power lines are continually monitored by integrated high-precision current sensors, and a real-time data processing system separates natural fluctuations from those caused by outside influences. When a human comes into contact with the surface of the robotic arm, the system excels at detecting their closeness by identifying unique patternsin the variations of current. This sets off an adaptive collision avoidance system, which quickly flips the main power supply’s kill switch to bring the vehicle to an emergency stop. A crucial component is adaptability, as the system dynamically modifies sensitivity in response to environmental condi- tions. Comparative studies show that this approach performs better than conventional static sensing techniques. Experiments under control confirm the great precision, accuracy, and low false positive rate. The use of a failsafe technique improves system integrity by preventing false alarms and enabling recovery after an emergency

The paper provides a comprehensive review of the recent advancements and methodologies in Human-Robot Collaboration (HRC) applied to the manufacturing assembly process. In modern manufacturing, the assembly process involves intricate and time-consuming operations, often necessitating flexible manual interventions. However, the cost and stability issues associated with manual labor highlight the need for collaborative solutions integrating humans and robots. HRC, as a viable solution, involves the joint effort of humans and robots in manufacturing tasks, presenting advantages in terms of precision, reproducibility, and cycle time. This review categorizes and discusses methodologies such as task allocation, reinforcement learning, and Cyber-Physical Systems (CPS)-based planning approaches that facilitate HRC in the assembly process. It also explores experiments and future trends to address challenges and enhance efficiency in manufacturing assembly through intelligent collaboration between humans and robots. The objective of this research is to provide insights and directions for further research in HRC to optimize manufacturing processes. By analyzing the existing state-of-the-art and presenting future prospects, this paper aims to guide researchers and practitioners toward more effective implementations of HRC in manufacturing assembly, ultimately leading to improved operational efficiency and productivity.

The innovation driven Industry 5.0, in agreement with Industry 4.0, leads to consider human in a prominence position as the center of manufacturing field. This pushes towards the hybridization of manufacturing plants promoting a fully collaboration between human and robot. Furthermore, the new paradigm of "human centred design" and "anthropocentric design" allows enabling a synergistic combination of human and robot skills. However, properly collaborative workplaces are currently very few. Industry is still not confident, and systems integrators hesitate to venture into Human-Robot Collaboration (HRC). Despite the effort in collaborative robotics, a general solution to overcome the current limitations in designing of collaborative workplaces still misses. In the current work, a Knowledge-Based Approach (KBA) is adopted to face collaborative workplace designing problem. The framework resulting from the KBA allows developing a modelling paradigm that enable to define a streamlined approach for the layout designing of a collaborative workplace. Finally, a what-if analysis and a ANOVA analysis are performed to generate and evaluate a set of scenarios related to a collaborative workplace for quality inspection of welded parts. Facing the high complexity and multidisciplinary of HRC can be conveyed to develop a general design approach aimed at overcoming the difficulties that limit the spread of HRC in the manufacturing field.

As businesses increasingly adopt advanced technologies to enhance productivity and safety, the integration of human-robot collaboration (HRC) emerges as a transformative approach. This paper explores the role of GPU-accelerated computer vision and generative AI in optimizing HRC within business environments. By leveraging the computational power of GPUs, real-time data processing, and advanced machine learning algorithms, robots can better interpret complex visual cues and adapt to dynamic workspaces. Generative AI further enables the design of intelligent robotic systems capable of anticipating human actions, optimizing task allocation, and ensuring safety through predictive modeling. This research highlights the potential of these technologies to improve operational efficiency, reduce human error, and create safer, more adaptable workplaces. The implications of such advancements are discussed, providing insights into the future of HRC in various industries.

The oil and gas industry faces increasing pressure to remove people from dangerous offshore environments. Robots present a cost-effective and safe method for inspection, repair and maintenance of topside and marine offshore infrastructure. In this work, we introduce a new immobile multi-sensing robot, the Limpet, which is designed to be low-cost and highly manufacturable, and thus can be deployed in huge collectives for monitoring offshore platforms. The Limpet can be considered an instrument, where in abstract terms, an instrument is a device that transforms a physical variable of interest (measurand) into a form that is suitable for recording (measurement). The Limpet is designed to be part of the ORCA (Offshore Robotics for Certification of Assets) Hub System, which consists of the offshore assets and all the robots (UAVs, drones, mobile legged robots etc.) interacting with them. The Limpet comprises the sensing aspect of the ORCA Hub System. We integrated the Limpet with Robot Operating System (ROS), which allows it to interact with other robots in the ORCA Hub System. In this work, we demonstrate how the Limpet can be used to achieve real-time condition monitoring for offshore structures, by combining remote sensing with signal processing techniques. We show an example of this approach for monitoring offshore wind turbines. We demonstrate the use of four different communication systems (WiFi, serial, LoRa and optical communication) for the condition monitoring process. By processing the sensor data on-board, we reduce the information density of our transmissions, which allows us to substitute short-range high-bandwidth communication systems with low-bandwidth long-range communication systems. We train our classifier offline and transfer its parameters to the Limpet for online classification, where it makes an autonomous decision based on the condition of the monitored structure.

Many tasks in a modern household are done by machines like e.g. a dishwasher or a vacuum cleaner and in the near future most household tasks can be done by smart service robots. This relieves the residents who in turn can enjoy their free time. This newly gained free time turns out to cause the so called spare time rebound effect due to more resource consumption [1,2]. We roughly quantify this rebound effect and propose a CO2 -budget model to reduce or even avoid it. In modern industry, automation and AI take over work from humans, leading to higher productivity of the company as a whole. This is the main reason for economic growth which leads to environmental problems due to higher consumption of natural resources. We show that, even though the effects of automation at home and in the industry are different (free time versus higher productivity) in the end they both lead to more resource consumption and environmental pollution. We discuss possible solutions to this problem such as carbon taxes, emissions trading systems and a carbon budget.

Artificial Intelligence (AI) is revolutionizing decision-making procedures in healthcare information systems (HIS), increasing the efficacy, accuracy, and personalization of healthcare. Notwithstanding remarkable progresses, yet there remain gaps in the holistic comprehension and implication of AI-driven technologies across various HIS scenarios. These gaps, consisting limited integration of AI across a variety of HIS parts and inadequate emphasize on interpretability and privacy, motivate our study to conduct a structured evaluation of recent AI applications in this domain. In this study, we present a novel taxonomy for the AI implication in medical decision-making. We analyzed 30 articles and categorized them into six groups including: Clinical Decision Support Systems (CDSS), Predictive Analytics, Natural Language Processing (NLP), Computer-Aided Diagnostics (CAD), Robotic-Assisted Surgery, and Virtual Health Assistants (VHAs/chatbots). Our study aims to propose a holistic perspective of the fast evolving perspective of AI in HIS. The majority of the investigated studies were published from 2023 and 2022, with Springer as the leading publisher (33%). Python and MATLAB were the most well-known simulation languages, applied in 48% and 20% of the papers, respectively, reflecting the technical trends in the area. By emphasizing on pivotal criteria like interpretability, accuracy, and privacy, this research aims to elucidate the crucial issues and development driving AI-driven decision-making in HIS.

Technological advances in game-mediated robotics provide an opportunity to engage children with cerebral palsy (CP) and other neuromotor disabilities in more frequent and intensive therapy by making personalized, programmed interventions available 24/7 in children’s homes. Though shown to be clinically effective and feasible to produce, little is known of the subjective factors impacting acceptance of what we term assistive/rehabilitative (A/R) gamebots by their target populations. This research describes the conceptualization phase of an effort to develop a valid and reliable instrument to guide the design of A/R gamebots. We conducted in-depth interviews with 8 children with CP and their families who had trialed an exemplar A/R gamebot, PedBotHome, for 28 days in their homes. The goal was to understand how existing theories and instruments were either appropriate or inappropriate for measuring the subjective experience of A/R gamebots. Key findings were the importance of differentiating the use case of therapy from that of assistance in rehabilitative technology assessment, the need to incorporate the differing perspectives of children with CP and those of their parents into A/R gamebot evaluation, and the potential conflict between the goals of preserving the quality of the experience of game play for the child while also optimizing the intensity and duration of therapy provided during play.

After reviewing the history of the struggle between human beings and plant diseases, insects and weeds, especially reviewing the thoughts of plant protection in ancient Chinese agricultural books, the target recognition of plant pests and the six types of plant protection methods and 36 subdi-vision measures were summarized. Then the development overview of pesticide application technology was focused and reviewed systematically by combining the development timeline of pesticide application and the key technologies including the performance measurement and the simulation and modeling of pesticide spraying system. And three suggestions for further research were proposed from the perspectives of human-being and environmental health, the sustainable and eco-friendly application medium, and the efficiently application equipment system in plant protection.