1. Introduction
Precision agriculture is a technique that utilizes technologies, such as Global Navigation Satellite System (GNSS) and Geographic Information System (GIS) programs, to gather, process and analyze spatial, temporal, and individual data on agricultural ecosystems. This information is then used to determine appropriate management strategies [
1,
2]. Precision agriculture has been extensively utilized in field crops such as corn, soybeans, and grains [
3]. In particular, Unmanned Aircraft Vehicles (UAVs) are particularly useful for time-series observations and can acquire data with high spatial resolution. This makes them highly responsive and advantageous for precision agriculture applications [
4]. The analysis of data acquired from UAVs enables pest and disease management, yield estimation, weed detection, and nutritional status evaluation on a field-by-field basis [
5]. Crop management using a UAV equipped with a hyperspectral camera to generate a field map divided into a grid pattern has been proposed as an example of agricultural remote sensing using UAVs [
6]. This approach allows for precise identification and cartography of crop stress [
7] and diseases [
8] on a grid-by-grid basis, ultimately resulting in improved crop management. Duan et al. propose that by linking geographic information with rice fields and dividing the fields into grids, the variation in NDVI over the growing season can be captured, enabling yield prediction to be achieved in each divided area [
6]. Although precision agriculture has been extensively used in field crops such as corn, soybeans, and grains detection, it has not been widely adopted in horticultural crops such as berries, field vegetables, and orchards [
3]. In horticulture, quality analysis is more significant than in other crops. In addition, individual treatments may be applied to individual plants according to spatial or temporal patterns [
9]. When fertilizers and pesticides are applied to field crops such as wheat and rice in variable amounts, it is appropriate to manage them on a map delimited by a grid. An example of the urgency to identify individual plants is a Panama disease of bananas. The Panama disease can be detected by hyperspectral cameras, and the diseased trees should be immediately sprayed with pesticides directly or cut down [
10]. To achieve this concept, regular crop disease monitoring and identification of individual trees are crucial, and accurate mapping system that incorporates geographic location information for each tree is essential. A proposed method to improve the accuracy of variable fertilizer application in horticultural agriculture involves generating a highly accurate Prescription map of nitrogen fertilizer application by superimposing an NDVI map with aerial images that identify individual trees in an olive grove and account for differences in nitrogen content per square meter [
11]. It has been observed that horticultural agriculture necessitates geographical data linkage to individual crops with an accuracy of approximately 1 m for diverse applications, such as crop yield prediction, quality cartography, and product sampling [
9].
This paper aims to produce maps of plantation crops, such as palm trees, bananas, and rubber, and to provide location information for each crop automatically with a precision of approximately 1 m. The proposed method involves using UAV-LiDAR to create a three-dimensional map of a farm field, extract trees from the automatically generated map, and geo-reference the extracted trees. To validate the effectiveness of the proposed method, experiments are conducted in an apple orchard, also in the field of horticultural agriculture. Furthermore, the paper aims to construct a system that can be easily adjusted for large plantations by tweaking the parameters.
Photogrammetry combined with SfM (Structure-from-Motion) processing is the most economical way to generate maps for UAV remote sensing, and georeferencing, which relates the local coordinate system of the SfM-generated map to the geographic coordinate system, is mostly done manually using ground control points (GCP) [
12,
13,
14]. However, establishing ground reference points can be burdensome and unsuitable for the rapid and efficient mapping of large areas, such as plantations. Thus, research is being conducted on direct georeferencing, which is a georeferencing method that relies solely on acquired data without the need for ground control points, to overcome the burden and inefficiency of ground control point establishment in mapping large areas such as plantations [
15,
16]. It has been proposed that SfM with RTK-GNSS equipped UAVs can produce horizontally accurate maps to a few centimeters without ground control points [
16]. However, due to the standard deviation of camera projection points, a bias in the vertical component can occur and requires at least one GCP for to cancel the bias [
17]. Acquired image data may be limited because we should set appropriate flight paths in order to improve map quality given by SfM [
18,
19]. On the other hand, LiDAR, which can directly acquire accurate 3D information, has attracted attention in the field of agricultural remote sensing, and the quality of data acquired from UAV-LiDAR has been studied [
20]. Štroner et al. aligned point clouds obtained from the inexpensive DJI ZENMUSE L1 scanner mounted on the UAV DJI Matrice 300 with maps created using DJI Terra and ground control points and found that the point clouds in the created maps had errors within 3.5 cm in all directions [
21]. Jóźków et al. evaluated the accuracy of maps created with the Velodyne HDL-32E laser scanner mounted on a UAV and showed that the quality factor of the trajectory reconstruction had the greatest impact on accuracy. The results showed that UAS equipped with the Velodyne HDL-32E laser scanner can provide point clouds with absolute positional accuracy of less than 10 cm [
22]. UAV-LiDAR has been shown to generate maps with errors of a few centimeters, therefore we adopt it for this study. Research has been conducted on methods to georeference point clouds obtained from LiDAR to determine the location of trees and canopy structures in orchards. Yuan proposed the method for aligning a specific apple tree as a reference point using conventional triangulation techniques [
23], while another method automatically performs coordinate transformation during the map generation phase. However, the latter method is limited to when the UAV is moving straight ahead [
24].
This paper proposes a method to obtain a coordinate transformation matrix by time synchronizing the self-position estimation results obtained from LiDAR SLAM and the geographic coordinates obtained from RTK-GNSS of the UAV and registering each trajectory with the Iterative Closest Point (ICP) algorithm. The proposed method is independent of the flight path and does not require a ground control point, since the trajectories are matched to each other.
3. Discussion
In this paper, we created a high-precision 3D map of an actual orchard and performed tree segmentation by processing point clouds of the map. We also proposed an automatic georeferencing system that links the trees on the map to geographic information. The location information of all the trees obtained as references was included in the point clouds of the trees transformed by georeferencing, indicating that the location accuracy of the system in this study is sufficient to determine the rough location of individual trees. In this study, the accuracy of georeferencing was targeted to be accurate enough to identify specific trees, and the tree locations measured as reference data were located within the canopy of the tree. The accuracy of GNSS positioning was reduced in areas where there was a dense growth of foliage, leading to the failure to obtain a FIX solution. Therefore, data were procured from a location situated outside the central region of the leafy canopy. To ensure even greater precision in accuracy validation, it is imperative to establish a ground assessment point constructed from a reflective material, such as metal, and juxtapose its position with the GNSS-derived coordinates. Individual tree detection has been studied mainly in the forestry field, and the most well-known method is to create a CHM and extract a single tree using the LM (Local maxima) algorithm. The LM algorithm assumes that high local intensity maxima in the imagery corresponding to the treetops [
33]. Consequently, the LM method demonstrates good performance in coniferous forests but may detect multiple branches on a single tree in mixed forests and broadleaf forests [
34]. In horticultural agriculture, a method is proposed for clustering and labeling crops with irregular canopy shapes, such as oil palm and coconut, by adapting an optimal filter and using the LM method [
30]. However, these methods use data acquired from Airborne lasers at altitudes of 1000 m or higher, and appropriate filters for relatively inexpensive LiDAR used with small UAVs at altitudes of 10-150 m have not been identified. In this study, we designed a filter of appropriate size for apple trees and constructed a system to extract and save only tree point clouds by clustering and labeling trees. Mohan et al. proposed single-tree detection using CHM of coconut obtained from Airborne Laser Scanning, with a score of
r = 0.87,
p = 0.94, and
F = 0.90 [
30]. Wu et al. also proposed single-tree detection using Deep-Learning’s Faster R-CNN, with a score of
r = 0.94,
p = 0.91, and
= 0.93 [
35]. The results of this study show that individual trees can be detected with accuracy comparable to other studies, and although segmentation of point clouds with closely overlapping crowns is not perfect, segmentation of each apple tree can be performed even for point clouds with overlapping crowns. This method can also be applied to plantation trees such as palm trees and banana trees by adjusting the size of the filtering. The proposed georeferencing methodology in this study involves synchronizing the position obtained through SLAM on the local map with the position obtained through GNSS in the geographic coordinate system. This synchronization is achieved by utilizing the ICP algorithm to register the position in each coordinate system as a point cloud. The accuracy of georeferencing is directly linked to the precision of time synchronization and localization in each coordinate system. With an increase in the size of the map, there is a possibility of drift, leading to a decline in the accuracy of the 3D map. Hence, SLAM-based mapping can include supplementary functionalities such as an enhanced initial estimation of registration utilizing IMUs or Loop Closing. Loop Closing involves observing the same point by circling a circumferential path (loop) and adding that data to a simultaneous equation, significantly reducing cumulative errors, and ensuring accurate localization.