Preprint Article Version 2 This version is not peer-reviewed

Crop Growth Analysis Using Automatic Annotations and Transfer Learning in Multi-Date Aerial Images and Ortho-Mosaics

Version 1 : Received: 11 June 2024 / Approved: 11 June 2024 / Online: 12 June 2024 (09:05:34 CEST)
Version 2 : Received: 12 August 2024 / Approved: 14 August 2024 / Online: 14 August 2024 (12:41:02 CEST)

How to cite: Rana, S.; Gerbino, S.; Akbari Sekehravani, E.; Russo, M. B.; Carillo, P. Crop Growth Analysis Using Automatic Annotations and Transfer Learning in Multi-Date Aerial Images and Ortho-Mosaics. Preprints 2024, 2024060740. https://doi.org/10.20944/preprints202406.0740.v2 Rana, S.; Gerbino, S.; Akbari Sekehravani, E.; Russo, M. B.; Carillo, P. Crop Growth Analysis Using Automatic Annotations and Transfer Learning in Multi-Date Aerial Images and Ortho-Mosaics. Preprints 2024, 2024060740. https://doi.org/10.20944/preprints202406.0740.v2

Abstract

Growth monitoring of crops is a crucial aspect of precision agriculture, essential for optimal yield prediction and resource allocation. Traditional crop growth monitoring methods are labor-intensive and prone to errors. This study introduces an automated segmentation pipeline utilizing multi-date aerial images and ortho-mosaics to monitor the growth of cauliflower crops (Brassica Oleracea var. Botrytis) using an object-based image analysis approach. The methodology employs YOLOv8, Grounding Detection Transformer with Improved Denoising Anchor Boxes (DINO), and the Segment Anything Model (SAM) for automatic annotation and segmentation. The YOLOv8 model was trained using aerial image datasets, which then facilitated the training of the Grounded Segment Anything Model framework. This approach generated automatic annotations and segmentation masks, classifying crop rows for temporal monitoring and growth estimation. The study’s findings utilized a multi-modal monitoring approach to highlight the efficiency of this automated system in providing accurate crop growth analysis, promoting informed decision-making in crop management and sustainable agricultural practices. Results indicate consistent and comparable growth patterns between aerial images and ortho-mosaics, with significant periods of rapid expansion and minor fluctuations over time. The results also indicated a correlation between the both the time and method of observation which paves a future possibility of integration of such techniques aimed at increasing the accuracy in crop growth monitoring based on automatically derived temporal crop row segmentation masks.

Keywords

automatic annotation; grounding detection transformer with improved denoising anchor boxes (grounding DINO); segment anything model (SAM); grounded SAM; growth monitoring

Subject

Biology and Life Sciences, Agricultural Science and Agronomy

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.