The usage of UAVs in vessel-based missions has been highlighted significantly due to their ability to provide an effective platform for numerous purposes. With enhancements made to aerial vehicles’ technology and sensor miniaturization, UAVs have emerged as significant contributors towards maritime activities. These unmanned planes furnish superior situational awareness alongside seamless collection capabilities of data that make it much more affordable than conventional techniques.
The most common applications of UAV systems are focused chiefly on observation and reconnaissance missions [
1]. It is obvious that advanced vision systems and flights at a hundred meters above the ground significantly increase the range of visual observation. It can be proven by drone usage in modern wars, where identifying enemy positions is crucial in a successful strike [
2]. Drones and their vision systems are excellent tools to monitor the borders of countries [
3] or forests to protect against fires [
4]. Another possibility of UAV observations, which can be a challenge, is to recognize and localize objects on water surface that can be dangerous for vessel’s structure [
5,
6]. It is especially important if future vessels are unmanned, and a great number of lost containers are in the seas. To prevent unexpected collisions, monitoring should constantly operate, with a range of view to perform avoidance maneuvers. This could be possible with a UAV which is continuously power supplied from the deck of the vessel and with the flight altitude at least 50 meters. Therefore, the current paper focuses on such kind of the UAV, i.e. on a tethered multicopter whose payload is sufficient to mount advanced cameras. This paper presents flight tests of the tethered multicopter in maritime conditions in a standard cruise of the ferry "Wolin" over the Baltic Sea. Test results which are a composition of the observations and recorded flight parameters, can be used to identify potential issues of UAV usage in maritime conditions on a deck of a vessel, especially related to gusts and turbulences of the wind over the helipad. The paper presents ultimate results of the UAV operation in sea conditions. The UAV was developed based on the conclusions and invaluable experience from the tests in quasi-real conditions carried out on the lake, which were presented in [
7].
The article consists of six sections and the first one is the introduction with a subsection, where there is a review of current advances in tethered UAV systems. The second one contains a detailed description of the designed tethered hexacopter system, including separate subsections sequentially about the tethered hexacopter, the power cord unwinder, the equipment required for tracking of the helipad position, and the UWB (Ultra Wide-Band) positioning system. In the third section, experimental tests performed flight missions, and weather conditions during the ferry cruise over the Baltic Sea are presented. The last two sections are dedicated respectively to discussion on results and final conclusions.
1.1. Current Advances in Related Research
Unmanned Aerial Vehicles (UAVs) are a transformative technology showing tremendous promise for several sectors, one of which is the maritime industry. A closer analysis reveals a range of perks the utilization of these vehicles offers: efficient retrieval of data streams; advanced surveillance standards preserving public safety while substantially cutting costs for operators. Nevertheless, many impediments need overcoming before fully deploying this budding technology in mission-critical tasks involving vessels: regulations on multiple levels, limited technical capacities, and adverse operating circumstances all pose formidable challenges. In order to achieve the maximum potential from the marine-based application scenarios, it is essential that related issues are addressed comprehensively.
Over the course of several consecutive years, numerous research teams have dedicated their efforts to overcome various challenges associated with operating UAVs in maritime conditions. The constraints imposed by limited resources such as specialists, work hours, and available deck space on ships and boats pose major challenges. Consequently, engineers are compelled to develop autonomous systems that are both maintenance-free and reliable. Nevertheless, the creation of fully autonomous solutions that can be used in commercial applications, proves to be exceedingly expensive and financially unfeasible for many companies and research institutions. As a result, progress is made incrementally within specific domains of expertise.
One of the main applications of the UAV in maritime conditions is photogrammetry, which is a technique to create detailed and accurate 3D maps using the aerial photography. Development and evolution of the UAV in terms of operational costs and reliability strongly increased the accessibility and efficiency of photogrammetry [
8]. This is even more important for the seas due to the increased costs and risks of manned flights. UAVs are easy to deploy and offer a reasonably high spatial resolution and accuracy. Determination of the high-density models of the sea floor utilizing the LIDAR data acquired by UAV is presented in [
9]. Data resolution is a vital parameter in various aerial imaging tasks. When faced with limitations due to small size and weight of the measuring devices, artificial intelligence based enhancement techniques can be employed to overcome these limitations. In a research study discussed in [
10] the set of super-resolution (SR) methods has been explored, including those that leverage the concept of Generative Adversarial Networks (GANs). These techniques aim to enhance the acquired information and improve the resolution of aerial imagery, enabling more detailed and accurate analysis. By leveraging advanced algorithms and deep learning approaches, the SR methods offer potential solutions to enhance the quality and level of detail in aerial images, thereby expanding their applicability in different domains.
SAR (Search And Rescue) missions are another prominent field where UAVs find wide utilization. Specifically, VTOL (Vertical Take-Off and Landing) platforms are commonly employed for conducting extensive marine surveillance with a focus on wide-area coverage and continuous monitoring. Numerous systems have been specifically designed for this purpose, as highlighted in [
11,
12]. Additionally, the development of various UAV systems takes into consideration the requirements and challenges associated with SAR missions, as referenced in [
13]. This underscores the significance of UAV technology in enhancing search and rescue operations, particularly in maritime environments.
The overall performance of the UAV in various tasks is not only dependent on advancements in data acquisition and processing for specific applications but also relies heavily on the UAV’s parameters and its ability to comply with system commands. These parameters include characteristics such as flight stability, maneuverability, payload capacity, and endurance, which directly impact the UAV’s effectiveness in executing tasks. Accurate and precise localization plays a crucial role in mostly autonomously operated robotic systems. While conditions meet on the seas typically involve fewer obstacles that block the GNSS satellite signals, in specific they are met at just over the line dividing the sea from the sky, the weather conditions which often can’t be properly forecasted at sea can disrupt satellite systems. As a result, traditional navigation methods of the drones become less useful due to limited reliability, particularly when systems based on optical flow exhibit reduced accuracy over the water’s surface. To address these challenges, many researches in the topic of UAV applications have leveraged the benefits of systems utilizing the Real Time Kinematic (RTK) method. Lewicka et al. [
14] highlighted the importance of accurate and precise tracking of the trajectory using the GNSS-RTK in order to collect and localize a series of many aerial images. Likewise, in a separate investigation documented in [
15], the application of GNSS-RTK to perform an data fusion in terms of geospatial applications was introduced. When coastal environments is considered, accurate and precise localization has been employed for qualitative spatial analysis, integrating techniques such as terrestrial laser scanning, photogrammetry, and historical bathymetric map data and bathymetric surveying. Despite the potential for significant drift in the global position measurements due to the RTK station being situated on a landing pad moving in relation to global coordinate system, correcting signal disruptions significantly enhances the accuracy of relative positioning. Overall, the utilization of RTK systems in UAV operations addresses the challenges of precise localization, compensating for the limitations posed by maritime conditions and ensuring more accurate and reliable positioning. This enables the successful integration of various geospatial techniques, facilitating high-quality data analysis and enhancing the overall performance of UAVs in maritime environments. Besides relying on GNSS systems for global range navigation and system basing on video data for precise landing pad approach, systems from a level in between the above mentioned that utilize radio frequencies play a vital role in facilitating various UAV operations. Various commonly-spotted and widely used systems for wireless data transfer such as Wi-Fi, Bluetooth, and others are commonly employed for positioning purpose, each with their own constraints and effectiveness. Yang and Yang conducted a comprehensive review of this topic in their study [
16]. Their research delves into the utilization of different wireless data transfer technologies, exploring their capabilities, limitations, and applications within the UAV domain. By examining the effectiveness and practicality of these systems, their work provides valuable insights for optimizing data transmission and communication in UAV operations.
Usually, in UAV missions two crucial moments can be identified: take-off of the UAV and landing. The Surface vehicles have their dynamic characteristics that are influenced by several factors, including their type, scale, weight, inertia and prevailing weather conditions. During a most-common mission scenario, a vessel experiences various types of motion that affect its position and orientation in the marine environment. These motions can be categorized into translational movement, vertical movement, and oscillations in the roll angle. To ensure mission success, the UAV system must be resilient to these disturbances. Extensive analysis of the complexity associated with landing on moving and rocking platforms has been conducted in a comprehensive study discussed in [
17]. The proposed solution not only encompasses control algorithms and software but also introduces a leaning gear with a mechanical self-adaptation as an integral component. Another study by Tang et al. [
18] improved landing stability by implementing an tripod that can be adjusted. The proposed tripod includes omni wheels at the end of each arm. Furthermore, the study presented in [
19] introduces a dedicated system designed specifically for landing on moving vessels, which can also be used to land on moving vehicles. In this particular approach, the burden of time and resources consuming calculations together an analysis of data is shifted to a ground station situated near the take-off and land place. This strategy aims to streamline the operation of the UAV by offloading computational tasks to a centralized system. By doing so, the UAV can focus on its primary objectives without being encumbered by extensive onboard processing requirements. The estimation of the relative position in these landing systems was achieved through sensor fusion using a stereo camera for vision system, fiducial markers to mark the object, and position estimation through the usage of Deep Neural Networks (DNN). Finaly the position was estimated using a Kalman filter that incorporated fusion of the data from the visual system and telemetry from the Internal Measurement Unit (IMU). To ensure adaptability, a finite state machine-based logic was implemented, allowing for trajectory adjustments based on qulatitative indicator of the tracking accuracy and the influence of ground effects.
The publication by Grlj et al. [
20] provides a comprehensive review and analysis of the mobile landing platforms that were developed and presented in the literature. It delves into various aspects such as procedures of landing and take-off, accuracy and precision of position estimation, control algorithms, fundametal rules and algorithms for trajectory generation, as well as systems for autonomous docking. The study offers valuable insights and findings in these areas. In a similar vein, the implementation of visual positioning for the non-stationary landing pad was explored in [
21], utilizing the Robotic Operating System framework. This approach shares similarities with the currently proposed solution, emphasizing the importance of visual cues for determining the relative position of the UAV in the USV (Unmanned Sea Vehicle) local coordinate system (or vice versa).
While vision systems are widely popular for relative positioning, alternative methods have also been investigated. In [
22], a set of ultrasonic sensors was mounted on the USV to detect the presence of the multirotor over the landing pad. This approach demonstrates an alternative means of achieving relative positioning between the two robots. To facilitate coordinated navigation between the UAV and USV, a coupled navigation system was introduced in conjunction with a newly developed guide point generation algorithm. This system ensures the synchronized movement and enhances the overall efficiency and effectiveness of the mission. Through these research contributions, a deeper understanding of mobile landing platforms, their functionalities, and their interaction with UAVs and USVs has been achieved. These studies provide valuable insights for the development of robust and efficient systems for UAV and USV collaborations. The incorporation of a manipulator arm and docking terminal on a heterogeneous mobile landing pad was explored in [
23]. The docking terminal features a socket on the bottom specifically designed to match the UAV configuration. Precise localization is achieved through the utilization of fiducial markers, ensuring accurate positioning during the docking process. The control system implemented in the study combines predictive, reactive, and optimal approaches to manage the landing and docking operations. This fusion of control strategies ensures efficient and reliable coordination between the UAV and the mobile landing pad. Aforementioned system exhibits a high degree of redundancy, facilitated by the extensive freedom of movement provided by robotic arms. The successful integration and cooperation of the UAV and the mobile landing pad results in a symbiotic relationship. The UAV wide field of view and aerial capabilities complement the wheeled vehicle high payload capacity, potentially serving as a charging station for the aerial robot. This effective collaboration maximizes the utilization of both platforms, unlocking their full potential in various applications.
The work of Palafox et al. [
24] provided valuable insights into vision system-based tracking of the landing pad. Another notable study, referenced as [
25], proposed the use of a tethered UAV. However, the main objective of the tethered UAV was not to serve as a power supply but rather to ascertain the position of the aerial untis in relation to ground units. Specific configuration of the loose tether was determined by observing different mechanical components, which in turn provided valuable insights into the positions of the robots in their respective local coordinate systems. In contrast, a rather unconventional approach was presented in [
26], introducing Unmanned Surface Vehicle (USV) utilizing a solar power which was designed specifically for recovering waterproof UAVs which were splashed down into the water with an intention. It is important to note that while this concept demonstrated effectiveness for such scenarios, its applicability to large-scale ocean vessels is limited. These various research endeavors contribute to the exploration and development of different techniques and platforms for visual tracking, relative position determination, and recovery of UAVs, showcasing the diverse strategies employed to address specific challenges in maritime operations.