Automated Tenderness Assessment of Okra Using Robotic Non-Destructive Sensing

Okra, a widely grown vegetable in many regions, often suffers from freshness loss during transportation, causing significant waste. Factors like variety, environment, maturity, and handling affect its quality. Current methods for checking okra tenderness are slow and prone to mistakes, so we need a better, non-damaging method. This study aims to use a device on a robot arm to assess okra freshness and tenderness. We tested 120 okra pods, storing some in a cold chamber for 24 hours (considered tender) and others at room temperature for two days before moving them to a cold environment for five more days (considered not tender). We used a force sensor on a robot arm to measure okra hardness without damaging it, then did tenderness tests. We found that certain sensor data, like the first slope (S1) and the difference between the maximum value and the first overshoot (Os), were good predictors of tenderness, with an accuracy rate of nearly 80%. We also validated this non-damaging method with weight loss, compression, and puncture tests, achieving a 95.5% accuracy rate in distinguishing between tender and non-tender okra pods.

Keywords:

Subject: Biology and Life Sciences - Horticulture

1. Introduction

Okra, scientifically known as *Abelmoschus esculentus*, belongs to the mallow family and is renowned for its semi-fibrous nature. Grown primarily in warm regions as an annual crop, and as a perennial in hotter climates, okra is valued not only for its edible fruit but also for its leaves, seeds, flower parts, and stems. This versatile vegetable is cultivated across tropical, subtropical, and temperate regions worldwide, making it a staple in various cuisines [1]. Known by different names such as bhindi, okura, quimgombo, bamia, and gombo [2], okra has found global popularity. Although traditionally not a major crop in most European countries due to its preference for warm climates, some Southern European countries are experimenting with its cultivation due to changing agricultural practices and climate conditions. Despite being less commonly grown in Europe and North America, okra is gaining popularity in these regions due to its high nutritional value, which includes vitamins and other beneficial compounds [3]. Globally, okra production is estimated at approximately 9.96 million tons, with India leading at 6.18 million tons, followed by Nigeria with 1.82 million tons [4]. India is a significant exporter, sending substantial quantities to the Middle East, the United Kingdom, Western Europe, and the United States [5]. Okra pods are rich in calcium, dietary fiber, vitamins, polyphenols, and other bioactive compounds, offering numerous health benefits, including anti-inflammatory, antioxidant, anti-carcinogenic, anti-obesity, anti-diabetic, and anti-cardiovascular properties. [6,7]

However, the freshness loss during transportation poses significant waste and economic challenges. Okra quality is influenced by factors such as variety, growth environment, maturity stage, and harvesting and storage methods, leading to national economic challenges [8]. Fresh okra has a limited shelf life and is prone to water loss, with optimal sensory quality typically observed around six days post-harvest. Assessing okra tenderness is crucial for evaluating its quality, traditionally done through manual observation and destructive means, which are time-consuming, prone to errors, and can lead to harvest losses [9,10,11]. Okra’s desirable qualitative attributes include length, diameter, greenness, mucilage, and fiber content. Medium-sized fruits (8.9–12.7 cm) are preferred by industry and commerce, although smaller fruits are also often accepted. Certain levels of greenness and fruit diameter are necessary, but these are frequently assessed arbitrarily [12].

Traditional methods of assessing tenderness involve manual observation of pod size, color, and tip flexibility, performed by experts. These methods are labor-intensive, tedious, prone to errors, and can cause harvest losses. Early harvesting results in low yield, while late harvesting causes browning and fibrosis, rendering the okra inedible [13,14]. Destructive mechanical hardness is frequently measured using a texture analyzer. As fruits mature, texture changes occur, particularly during ripening, leading to softer produce. Additionally, moisture loss can impact texture. To overcome the limitations of traditional methods, non-destructive techniques have been developed for fruit and vegetable quality assessment. These methods examine internal and external characteristics without causing harm, thus preserving the product’s integrity [15]. Grading lines equipped with sensors for external parameters such as color, size, and appearance have become commonplace [16]. Visible and near-infrared (Vis-NIR) hyperspectral imaging is a non-destructive tool used to evaluate maturity and moisture content in okra, aiding in determining the optimal harvest time [17].

In the agri-food sector, advancements in tactile sensors and manufacturing methods have led to the development of robotic systems capable of non-destructive quality assessment. Tactile sensors enable robots to gently handle delicate foods, assess ripeness, and sort produce based on texture [18]. Texture recognition is critical for robotic systems, allowing them to differentiate between diverse surface properties [19]. Impact analysis has been applied to various fruits and vegetables, including mangos [20], peaches [21], apples [22], kiwis [23],and dragon fruit [24].

This study aims to evaluate the freshness and tenderness of okra using a non-destructive impact device attached to a robotic arm. By leveraging advanced sensor technology, we seek to provide a more efficient, accurate, and non-damaging method of quality assessment, thereby reducing waste and improving supply chain efficiency.

2. Materials and Methods

The description outlines an experiment involving the evaluation of ‘Clemson’ variety fresh okra pods sourced from a local trader in Valencia, Spain.

2.1. Sample Selection

Initially, 120 okra pods were chosen based on criteria such as homogeneity in size and color, absence of physical damage, and the lack of diseases or infections. Each pod was individually numbered from 1 to 120.

Figure 1. Distribution of 120 Okra Pods two groups of 60 similar okra pods each for storage in a cold chamber (Group A) and ambient conditions (Group B), respectively.

2.2. Group Division

The 120 pods were then randomly split into two groups, each consisting of 60 similar okra pods. In order to produce a set of products with acceptable quality conditions and another set with unacceptable quality conditions., one group was stored in a cold chamber condition for 24 hours (“Acquired pods”, tender set), while the other group was stored at ambient conditions for two days and then shifted to a cold environment for five more days (“Stored pods” not tender set).

2.3. Assessment and Timing

The pods from both sets (Acquired and Stored) were evaluated using two distinct methods - a non-destructive method and a destructive method. The assessment for the “Acquired pods” took place on December 13, 2023, while the evaluation for the “Stored pods” occurred on December 19, 2023.

The assessment involves both non-destructive and destructive methods to analyze the pods.

2.4. Non-Destructive Methods for Assessing Tenderness

On December 13, 2023, fruits from the “Acquired pods” set were brought to the robotics laboratory and tested with the robotic impact device [24]. The Universal Robot UR5e’s internal force sensor, located just before the Tool Center Point (TCP) in Odense, Denmark, served as a tactile sensor for assessing product conditions. With six degrees of freedom, this sensor enabled precise force control. Achieving the target force of 20 N involved utilizing internal motion control functionalities at the TCP, incorporating a gain adjustment of 1.5 and damping at 0.01, fine-tuned through experimentation to achieve an underdamped response. To safeguard the product from potential damage, the robot’s TCP featured a compact silicone pad filled with granular fluid. This pad seamlessly transitioned from a soft (quasi-liquid) to a rigid state (quasi-solid) by regulating internal pressure. Control of the pad was orchestrated by a Festo vacuum generator (VADMI-300-LS-P, Esslingen, Germany). The operational sequence initiated by positioning the robot’s sixth axis vertically above the product involved descending at a controlled rate of 0.1 m/s in force control mode to reach a force of 20 N. Just before contact, the vacuum generator induced overpressure in the pad for 0.5 seconds, ensuring a soft pad upon contact.

Upon achieving the target force, the pad’s surface conformed to the specific shape of the product. Activating the vacuum caused the pad to transition to a rigid state, molding to the contact area on the product. The subsequent vertical ascent by 50 millimeters, followed by descent in force control mode to apply a 20 N force on the product, was accompanied by the transmission of the vertical force signal via Ethernet to a LabVIEW program by National Instruments in Austin, TX, USA. Signal stabilization typically occurred after about 2 seconds, reaching a steady state. The robot then returned to its initial position, concluding the information transmission. Figure 2 provides a visual representation of the complete process, detailing the devices used and communication pathways. A similar process was conducted on December 19, 2023, specifically for the “Stored pods” set.

Based on previous studies [24] the parameters extracted from the robotic sensor signal were: maximum force (Fmax), first slope (S1), second slope (S2), the first overshoot (Os), and the steady-state (Ss), Figure 2 and Equation (1).

Os=(Fmax−Ss)/Ss (1)

Figure 3. Robot Components 1) Teach Pendant 2) Bottom Jamming Pad 3) Upper Jamming Pad 4) PLA 3D printed adapter 5) Wrist 1 of the UR5e 6) Wrist 2 of the UR5e 7) PC, connected with the UR with Ethernet 8) Vacuum generator 9) Pressure Regulator.

2.5. Destructive Methods for Assessing Tenderness

Individual pod weight measurements were performed following the completion of the non-destructive robotic measurements. Initial weight (12/12/2023 and 13/12/2023) of pods and final weight at (19/12/2023) (before the destructive firmness test) was measured for the two sets. “The weight measurement is non-destructive. A universal stress strain machine (Ibertest, model IBTH 2730, www.ibertest.es was used to assess the firmness at a constant speed of 1.67 ms−1. The tenderness of each pod was assessed at two different locations throughout the equatorial area using two different tests, puncture compression test of 0.006 m (using a cylindrical needle of 0.001 m diameter) and compression test 6 mm (using a Magness-Taylor rod of 0.008 m diameter). Every fruit’s firmness was assessed twice at equatorial region. similar process used for okra which from the “Stored pods” set on December 19, 2023. Non-destructive variables to the destructive tenderness, the destructive tenderness will serve as the reference tenderness value. An expert assessed other maturity parameters visually (cutting edge of okra).

Figure 4. (A) Universal Stress-Strain Machine: Assessing Tenderness and Texture of Okra Pods (B) Universal Robot UR5e’s Impact Sensor for Assessing Okra Pod Tenderness” tenderness.

3. Results

The loss of tenderness of the okra pods was confirmed destructively measuring texture and weight loss differences in the two sets (“Acquired pods” and “Stored pods”).The texture change was assessed by the texture analysis tests (puncture test and compression test) and the loss of weight was assessed measuring initial weight and weight at the moment of the destructive test As expected, results from the destructive compression test and puncture compression test were significantly different in both sets, the okras from the stored set had lost tenderness compared to the acquired set (Figure 5 and Figure 6). In the same line, the weight loss was significantly higher for the two sets (Figure 5).

Figure 5. Destructive Compression Test Results (N/mm) for Acquired Set and Stored Set Categories; mean values of the destructive compression test for each category, and 95.0% Least Significant Difference (LSD) intervals.

Figure 6. Destructive Puncture Test Results (N/mm) for Acquired Set and Stored Set Categories; mean values of the destructive puncture test for each category, and 95.0% Least Significant Difference (LSD) intervals.

Figure 7. Weight Loss (%) for Acquired Set and Stored Set Categories.; mean values of weight loss for each category, 95.0% Least Significant Difference (LSD) intervals.

In order to validate the capability of the destructive variables in correctly segregating the okra pods into the established categories (acquired and stored, corresponding to tender pods a non-tender pods), a discriminant analysis was carried out two separates into the two categories according to percentage of weight loss, compression test and puncture test, Figure 8. percentage of well classified product of 95.5 % was obtained.

destructive variables and weight loss) of the two established categories of okra pods, neural network analysis was developed to segregate into the two categories based on the non-destructive variables extracted from the robot impact sensor, Figure 9. The variables used were: first slope (S1), second slope (S2), first overshoot (Os) and maximum force over weight while performing the non-destructive impact (Fmax/w). 78.59 % of well classified okra pods was found (Table 1).

From the category of “Acquired pods” 9 pods were wrongly classified as “Stored pods”. On the other hand, from the category of “Stored pods” 16 pods were wrongly classified as “Acquired”.

4. Discussion

The destructive tests proved effective in assessing the tenderness of okra pods, accurately classifying 95.5% of them into categories based on storage conditions. However, the initial conditions of the okra pods obtained from the local market may have influenced their evolution differently, leading to some variability in tenderness. Some pods in the stored set might have remained in an acceptable commercial stage despite inadequate storage conditions, while some pods in the acquired set could have already lost tenderness due to previous storage. Previous studies have shown promising results in evaluating fruit and vegetable texture quality using non-destructive techniques. For instance, in studies on [25] Melon, while [26] Kiwi. Additionally, [27] Persimmon. non-destructive variables extracted from robot sensors successfully classified okra pods into tender and non-tender categories with an accuracy rate of almost 80%. However, it’s important to note that the reference method used in our study may not have been entirely accurate. Nine pods were misclassified as non-tender when they were actually tender, and sixteen pods were misclassified as tender when they were not. This second error is particularly concerning, as it could lead to issues if products of lower quality are offered to consumers.

5. Conclusions

In conclusion, this research paper presents a comprehensive investigation into the assessment of okra pod tenderness and freshness using both destructive and non-destructive methods. The study demonstrated that destructive tests, including compression and puncture tests, along with weight loss measurements, were effective in assessing the tenderness of okra pods with a high degree of accuracy, achieving a 95.5% classification rate for well-segregated pods based on storage conditions. However, it’s crucial to acknowledge the potential limitations of this method, particularly regarding the initial conditions of the okra pods sourced from the local market. Variations in the initial state of the pods could have influenced the speed of deterioration, leading to discrepancies in classification. Despite this, destructive methods remain valuable for assessing okra tenderness and could serve as a reliable reference for quality evaluation. On the other hand, non-destructive techniques, utilizing a robotic impact device and extracting variables such as first slope, second slope, first overshoot, and maximum force over weight, demonstrated promising results in classifying okra pods into tender and non-tender categories. However, the classification rate was slightly lower at approximately 78.59%, with some misclassifications observed. In practical applications, a combination of both destructive and non-destructive methods could offer a comprehensive approach to evaluating okra quality. Destructive tests provide a reliable benchmark for tenderness assessment, while non-destructive methods offer efficiency and potential for automation, albeit with a slightly lower accuracy rate. By integrating these approaches, it’s possible to enhance quality control processes and minimize waste in the okra supply chain. Furthermore, this study contributes to the broader field of food quality assessment, highlighting the importance of innovative techniques such as robotic impact devices in agricultural research. Continued exploration and refinement of both destructive and non-destructive methods will further advance our ability to ensure food quality and safety in agricultural production and distribution systems.

Conflicts of Interest

“The authors declare no conflicts of interest.”

References

Şahin, Y.S.; Bütüner, A.K.; Erdoğan, H. potential for early detection of powdery mildew in okra under field conditions using thermal imaging. Scientific Papers Series Management. Scientific Papers Series Management. Econ. Eng. Agric. Rural. Dev. 2023, 23. [Google Scholar]
Jain, N.; Jain, R.; Jain, V.; Jain, S. A review on; Abelmoschus esculentus. Pharmacia 2012, 1, 84–89. [Google Scholar]
VarmuDy, V. Need to boost okra exports. Facts For You 2011, 31, 21–23. [Google Scholar]
FAOSTAT (2020). Food and agricultural organization statistics. https://www.fao.org/food-agriculture-statistics/resources/en.
Anonymous 2015. Indian Horticultural Database, http://www.nhb.gov.in.
Adelakun, O.E.; Oyelade, O.J.; Ade-Omowaye, B.I.O.; Adeyemi, I.A.; Van de Venter, M. Chemical composition and the antioxidative properties of Nigerian okra seed (Abelmoschus esculentus Moench) flour. Food and Chemical Toxicology 2009, 47, 1123–1126. [Google Scholar] [CrossRef] [PubMed]
Thole, C.; Brandt, S.; Ahmed, N.; Hensel, A. Acetylated Rhamnogalacturonans from immature fruits of Abelmoschus esculentus inhibit the adhesion of helicobacter pylori to human gastric cells by interaction with outer membraneproteins. Molecules 2015, 20, 1677016787. [Google Scholar] [CrossRef]
Kemiklioglu, E.; Ozen, O. Design of a sensor to detect fruit freshness. International Journal of Scientific and Technological Research 2018, 4, 1–6. [Google Scholar]
Culpepper, C.W.; Moon, H.H. (1941). The growth and composition of the fruit of okra in relation to its eating quality. (No. 595). US Department of Agriculture.
Sistrunk, W.A.; Jones, L.C.; Miller, J.C. Okra pod growth habits. Proc. Am. Soc. Hortic. Sci. 1960, 76, 486. [Google Scholar]
Singh, P.; Tripathi, R.D.; Singh, H.N. Effect of age of picking on the chemical composition of the fruit of okra. Indian J. Agric. Sci. 1974, 44, 22. [Google Scholar]
Diaz Franco, A.; Ortegón Morales, A.; Loera Gallardo, J. Fruit characteristics and yield of new okra hybrids. Subtropical Plant Science 1997, 49, 8–11. [Google Scholar]
Liu, J.; Yuan, Y.; Wu, Q.; Zhao, Y.; Jiang, Y.; John, A.; Yang, B. Analyses of quality and metabolites levels of okra during postharvest senescence by 1H-high resolution NMR. Postharvest Biology and Technology 2017, 132, 171–178. [Google Scholar] [CrossRef]
Li, H.; Xie, L.; Ma, Y.; Zhang, M.; Zhao, Y.; Zhao, X. Effects of drying methods on drying characteristics, physicochemical properties and antioxidant capacity of okra. Lwt 2019, 101, 630–638. [Google Scholar] [CrossRef]
El-Mesery, H.S.; Mao, H.; Abomohra AE, F. Applications of non-destructive technologies for agricultural and food products quality inspection. Sensors 2019, 19, 846. [Google Scholar] [CrossRef] [PubMed]
Nicolaï; BM; Defraeye, T.; De Ketelaere, B.; Herremans, E.; Hertog, M.L.; Saeys, W.; Verboven, P. Non-destructive measurement of fruit and vegetable quality. Annual review of food science and technology 2014, 5, 285–312.
Xuan, G.; Gao, C.; Shao, Y.; Wang, X.; Wang, Y.; Wang, K. Maturity determination at harvest and spatial assessment of moisture content in okra using Vis-NIR hyperspectral imaging. Postharvest Biology and Technology 2021, 180, 111597. [Google Scholar] [CrossRef]
Mandil, W.; Rajendran, V.; Nazari, K.; Ghalamzan-Esfahani, A. Tactile-Sensing Technologies: Trends, Challenges and Outlook in Agri-Food Manipulation. Sensors 2023, 23, 7362. [Google Scholar] [CrossRef]
Mayol-Cuevas, W.W.; Juarez-Guerrero, J.; Munoz-Gutierrez, S. A first approach to tactile texture recognition. In Proceedings of the SMC’98 Conference Proceedings, 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 98CH36218), Man, San Diego, CA, USA, 14 October 1998; Volume 5, pp. 4246–4250. [Google Scholar]
De Ketelaere, B.; Howarth, M.S.; Crezee, L.; Lammertyn, J.; De Baerdemaeker, J. Postharvest firmness changes as measured by acoustic and low mass impact devices: a comparison of techniques. Postharvest Biology Technology 2006, 41, 275–84. [Google Scholar] [CrossRef]
Delwiche, M.J.; McDonald, T.; Bowers, S.V. Determination of peach firmness by analysis of impact forces. Trans. ASABE 1987, 30, 249–54. [Google Scholar] [CrossRef]
Shmulevich, I.; Galili, N.; Howarth, M.S. Nondestructive dynamic testing of apples for firmness evaluation. Postharvest Biology and Technology 2003, 29, 287–299. [Google Scholar] [CrossRef]
Ragni, L.; Berardinelli, A.; Guarnieri, A. Impact device for measuring the flesh firmness of kiwifruits. Journal of Food Engineering 2010, 96, 591–97. [Google Scholar] [CrossRef]
Ortiz, C.; Blanes, C.; Gonzalez-Planells, P.; Rovira-Más, F. Non-Destructive Evaluation of White-Flesh Dragon Fruit Decay with a Robot. Horticulturae 2023, 9, 1286. [Google Scholar] [CrossRef]
Sun, J.; Ma, B.; Dong, J.; Zhu, R.; Zhang, R.; Jiang, W. Detection of internal qualities of hami melons using hyperspectral imaging technology based on variable selection algo- rithms. J. Food Process Eng. 2017, 40, e12496. [Google Scholar] [CrossRef]
Zhu, H.; Chu, B.; Fan, Y.; Tao, X.; Yin, W.; He, Y. Hyperspectral imaging for predicting the internal quality of kiwifruits based on variable selection algorithms and chemometric models. Sci. Rep. 2017, 7, 7845. [Google Scholar] [CrossRef] [PubMed]
Munera, S.; Amigo, J.M.; Aleixos, N.; Talens, P.; Cubero, S.; Blasco, J. Potential of VIS-NIR hyperspectral imaging and chemometric methods to identify similar cultivars of nectarine. Food Control 2018, 86, 1–10. [Google Scholar] [CrossRef]

Figure 2. Flow chart of the operational process of the robot arm, related devices, and communication paths (Vacuum Generator (VC).

Figure 8. Discriminant analysis to segregate the two categories based on the destructive variables.

Figure 9. Dispersion diagram from the neural network analysis to segregate the okra pods into the two quality categories according to the non-destructive variables extracted from the robotic sensor.

Table 1. Classification table from the neural network analysis to segregate the okra pods into the two quality categories according to the non-destructive variables extracted from the robotic sensor.

Actual category	Group size	Predicted (Acquired)	Predicted (Stored)
Acquired	59	50 (84.7 %)	9 (15.25 %)
Stored	59	16 (27.12 %)	43 (72.88%)

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).

Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.

MDPI Initiatives

Important Links

Choose an area of interest and we will send you notifications of new preprints at your preferred frequency.

Disclaimer