Felipe David Georges Gomes, Mayara Maezano Faita Pinheiro, Danielle Ellis Garcia Furuya, Wesley Nunes Gonçalves, José Marcato Júnior, Mirian Fernandes Furtado Michereff, Maria Carolina Blassioli-Moraes, Miguel Borges, Raúl Alberto Alaumann, Veraldo Liesenberg, Lúcio André de Castro Jorge, Ana Paula Marques Ramos, Lucas Prado Osco
Subject:
Environmental And Earth Sciences,
Remote Sensing
Keywords:
machine learning; insect-damage; spectral data; theoretical model
Online: 23 February 2021 (14:12:28 CET)
In cotton cultivars, an insect that causes irreversible damage is the Spodoptera frugiperda, known as the fall armyworm. Since the visual detection of plants is a burdensome task for human inspection, the spectral information related to plant damage, registered on a spectral scale, can be useful. These measurements, associated with machine learning techniques, produce useful information for a rapid and non-invasive inspection method development. To contribute to this gap fulfillment, this paper proposes a machine learning framework to model the spectral response of cotton plants under the attack of the fall armyworm. Additionally, a theoretical model is presented, built from the results of the machine learning analysis, to infer this damage with up-to-date orbital sensors. The data was composed of the reflectance measurements collected at a cotton field with control plants and plants submitted to Spodoptera frugiperda damage. Their spectral response was recorded with a hand-held spectroradiometer ranging from 350 to 2,500 nm, for eight consecutive days. Different machine learning models were evaluated and the overall best model was defined by accuracies comparisons on a testing-set. A ranking approach was adopted based on the model accuracy, returning the most contributive wavelengths for the classification. Sequentially, an unsupervised neural network (Self-Organizing Map - SOM) was implemented to reduce data-dimensionality and assist in the definition of important spectral regions. The regions were associated with the spectral bands of the two sensors (OLI and MSI) and a theoretical model using a band simulation process with the overall best machine learning model was proposed. The results indicated that the Random Forest (RF) algorithm is the most suitable to predict cotton-plants damaged by insects and that the last day of analysis (8th day) was better to separate it, with F-measure equals 0.912. The ranking approach combined with the SOM method indicated the spectral regions at the red to near-infrared (650 to 1,350 nm) and shortwave infrared (1,570 to 1,640 nm) as the most important regions to the analysis. The proposed theoretical model simulated with the OLI and MSI sensor-bands returned an F-Measure of 0.865 and 0.886, respectively. In conclusion, this framework can be used to map cotton-plants under insect-attack. The theoretical model presents high accuracy to infer the insect-damaged on cotton plants based on multispectral bands from other sensors, being a useful tool for future research that intends to evaluate it in other areas and at different field scales.
Danielle Elis Garcia Furuya, Mayara Maezano Faita Pinheiro, Felipe David Georges Gomes, Wesley Nunes Gonçalves, José Marcato Júnior, Diego de Castro Rodrigues, Maria Carolina Blassioli-Moraes, Mirian Fernandes Furtado Michereff, Miguel Borges, Raúl Alberto Alaumann, Ednaldo José Ferreira, Ana Paula Marques Ramos, Lucas Prado Osco, Lúcio André de Castro Jorge
Subject:
Environmental And Earth Sciences,
Atmospheric Science And Meteorology
Keywords:
proximal hyperspectral sensing; precision agriculture; random forest
Online: 22 February 2021 (17:20:41 CET)
A strategy to reduce qualitative and quantitative losses in crop-yields refers to early and accurate detection of insect-damage caused in plants. Remote sensing systems like hyperspectral proximal sensors are a promising strategy for managing crops. In this aspect, machine learning predictions associated with clustering techniques may be an interesting approach mainly because of its robustness to evaluate high dimensional data. In this paper, we model the spectral response of insect-herbivory-damage in maize plants and propose an approach based on machine learning and a clustering method to predict whether the plant is herbivore-attacked or not using leaf reflectance measurements. We differentiate insect-type damage based on the spectral response and indicate the most contributive wavelengths to perform it. For this, we used a maize experiment in semi-field conditions. The maize plants were submitted to three different treatments: control (health plants); plants submitted to Spodoptera frugiperda herbivory-damage, and; plants submitted to Dichelops melacanthus herbivory-damage. The leaf spectral response of all plants (controlled and submitted to herbivory) was measured with a FieldSpec 3.0 Spectroradiometer from 350 to 2500 nm for eight consecutive days. We evaluated the performance of different learners like random forest (RF), support vector machine (SVM), extreme gradient boost (XGB), neural networks (MLP), and measured the impact of a day-by-day analysis into the prediction. We proposed a novel framework with a ranking strategy, based on the accuracy returned by predictions, and a clusterization method based on a self-organizing map (SOM) to identify important regions in the reflectance measurement. Our results indicated that the RF-based framework algorithm is the overall best learner to deal with this type of data. After the 5th day of analysis, the accuracy of the algorithm improved substantially. It separated the three treatments into different groups with an F-measure equal to 0.967, 0.917, and 0.881, respectively. We also verified that the most contributive spectral regions are situated in the near-infrared domain. We conclude that the proposed approach with machine learning methods is adequate to monitor herbivory-damage of S. frugiperda and stink bugs like Dichelops melacanthus in maize, differentiating the types of insect-attack early on. We also demonstrate that the framework proposed for the analysis of the most contributive wavelengths is suitable to highlight spectral regions of interest.