Skip to main navigation menu Skip to main content Skip to site footer

Research Articles

Vol. 13 No. 3 (2026)

Computer vision-based size estimation module for selective harvesting of lettuce

DOI
https://doi.org/10.14719/pst.14546
Submitted
14 March 2026
Published
22-09-2026 — Updated on 30-09-2026
Versions

Abstract

Selective harvesting of leafy vegetables remains a major challenge in agricultural automation, particularly for lettuce that meet predefined size or maturity criteria. Vision-based perception systems play a critical role in enabling selective harvesting by identifying plants that meet predefined size or maturity criteria. This study presents the development and validation of computer vision-based size estimation software designed to support selective harvesting decisions in leafy vegetable production. A C #-based image processing application was developed to perform red, green and blue (RGB) colour segmentation, contour detection and pixel-to-metric size estimation using images acquired from a standard Universal Serial Bus (USB) webcam. The system converts pixel measurements into real-world dimensions through calibrated scaling factors that account for variations in camera-to-plant distance. Field experiments were conducted using three commercial lettuce cultivars Romaine, Iceberg and Curly. Vision-based canopy width measurements showed strong agreement with manual measurements (N = 60) and exhibited very strong correlations with plant weight (Romaine type: r = 0.9803; Iceberg type: r = 0.9935; Curly type: r = 0.9707; p < 0.001). Linear regression models achieved high predictive performance (R² = 0.942–0.987), while error metrics indicated low prediction errors (Mean absolute error (MAE): 5.62–8.64 g; root mean square error (RMSE): 7.30–11.06 g). Bland-Altman analysis further confirmed strong agreement between vision-based estimates and manual measurements. This study primarily validates a lightweight vision-based measurement algorithm intended for future integration into robotic harvesting systems. The results demonstrate that simple RGB-based image processing can provide reliable size estimation for selective harvesting decisions in leafy vegetable production systems.

References

  1. 1. Hubert B, Rosegrant M, van Boekel MAJS, Ortiz R. The future of food: Scenarios for 2050. Crop Sci. 2020;50:33–50. Available from: https://doi.org/10.2135/cropsci2009.09.0530
  2. 2. Pardey PG, Beddow JM, Hurley TM, Beatty TKM, Eidman VR. A bounds analysis of world food futures: Global agriculture through to 2050. Aust J Agric Resour Econ. 2014;58(4). https://doi.org/10.1111/1467-8489.12072
  3. 3. Guo G, Wen Q, Zhu J. The impact of aging agricultural labor population on farmland output: From the perspective of farmer preferences. Math Probl Eng. 2015;2015:730618. https://doi.org/10.1155/2015/730618
  4. 4. Abak K. Outlook on vegetable production in Turkey. Acta Hortic. 2007;729:25–31. https://doi.org/10.17660/ActaHortic.2007.729.1
  5. 5. Direk M, Arısoy H, Ozen H. The impact of food safety criteria on fruit and vegetable exports from Türkiye to the European Union. Turk J Agric Food Sci Technol. 2024;12(4):644–56. https://doi.org/10.24925/turjaf.v12i4.644-656.6658
  6. 6. Kondo N, Nishitsuji Y, Ling PP, Ting KC. Visual feedback guided robotic cherry tomato harvesting. Trans ASAE. 1996;39(6). Available from: https://doi.org/10.13031/2013.27744
  7. 7. Allotta B, Buttazzo G, Dario P, Quaglia F. A force/torque sensor-based technique for robot harvesting of fruits and vegetables. In: IEEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications; 1990; Ibaraki, Japan. p. 231–5. https://doi.org/10.1109/IROS.1990.262391
  8. 8. Murakami N, Otsuka K, Inoue K, Sugimoto M. Development of robotic cabbage harvester. Part 1: Operational speed of the designed robot. J Jpn Soc Agric Mach. 1999;61(5):85–92. https://doi.org/10.11357/jsam1937.61.5_85
  9. 9. Xu LJ, Kang ZL, Huang P, Luo H. Research on intelligent watermelon identification and positioning method in natural scene. J Intell Fuzzy Syst. 2016;31(4). https://doi.org/10.3233/JIFS-169050
  10. 10. Du J, Lu X, Fan J, Qin Y, Yang X, Guo X. Image-based high-throughput detection and phenotype evaluation method for multiple Lactuca sativa varieties. Front Plant Sci. 2020;11:563386. https://doi.org/10.3389/fpls.2020.563386
  11. 11. Yang R, Wu Z, Fang W, Zhang H, Wang W, Fu L, et al. Detection of abnormal hydroponic lettuce leaves based on image processing and machine learning. Inf Process Agric. 2023;10(1):1–10. https://doi.org/10.1016/j.inpa.2021.11.001
  12. 12. Jung DH, Park SH, Han XZ, Kim HJ. Image processing methods for measurement of lettuce fresh weight. J Biosyst Eng. 2015;40(1):89–93. https://doi.org/10.5307/jbe.2015.40.1.089
  13. 13. Martins G, Neto O, Carmo G, Castoldi R, Santos L, Charlo H. Estimation of biometric, physiological and nutritional variables in lettuce seedlings using multispectral images. Rev Bras Eng Agric Ambient. 2021;25(10):689–95. https://doi.org/10.1590/1807-1929/agriambi.v25n10p689-695
  14. 14. Zhu S. A computer vision system applied to the recognition of different capacitors. J Phys Conf Ser. 2020;1654(1):012033. https://doi.org/10.1088/1742-6596/1654/1/012033
  15. 15. Prasanna N, Bojja P. Industrial IoT enabled fuzzy logic based flame image processing for rotary kiln control. Int J Pervasive Comput Commun. 2021;17(5):533–48. https://doi.org/10.1108/IJPCC-10-2020-0161
  16. 16. Shi C. Applications of CMOS image sensors: Applications and innovations. Appl Comput Eng. 2023;11(1):95–103. https://doi.org/10.54254/2755-2721/11/20230216
  17. 17. Casado-García Á, Heras J, Milella A, Marani R. Semi-supervised deep learning and low-cost cameras for the semantic segmentation of natural images in viticulture. Precis Agric. 2022;23(6):2001–26. https://doi.org/10.1007/s11119-022-09929-9
  18. 18. Pallottino F, Pane C, Figorilli S, Pentangelo A, Antonucci F, Costa C. Greenhouse application of light-drone imaging technology for assessing weeds severity occurring on baby-leaf red lettuce beds approaching fresh-cutting. Span J Agric Res. 2020;18(3):e0207. https://doi.org/10.5424/sjar/2020183-15232
  19. 19. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet. 1986;327(8476):307–310.
  20. 20. Montoya-Cavero LE, Díaz de León Torres R, Gómez-Espinosa A, Escobedo Cabello JA. Vision systems for harvesting robots: Produce detection and localization. Comput Electron Agric. 2022;192:106562. https://doi.org/10.1016/j.compag.2021.106562
  21. 21. Gonzalez RC, Woods RE. Digital image processing. 4th ed. Pearson; 2018.
  22. 22. Rajendran V, Debnath B, Mghames S, Mandil W, Parsa S, Parsons S, et al. Towards autonomous selective harvesting: A review of robot perception, robot design, motion planning and control. J Field Robot. 2024;41(7). https://doi.org/10.1002/rob.22230
  23. 23. Foglia MM, Reina G. Agricultural robot for radicchio harvesting. J Field Robot. 2006;23:6–7. https://doi.org/10.1002/rob.20131
  24. 24. Zhang L, Xu Z, Xu D, Ma J, Chen Y, Fu Z. Growth monitoring of greenhouse lettuce based on a convolutional neural network. Hortic Res. 2020;7:124. Available from: https://doi.org/10.1038/s41438-020-00345-6
  25. 25. Jayalath TC, van Iersel MW. Canopy size and light use efficiency explain growth differences between lettuce and mizuna in vertical farms. Plants. 2021;10(4):704. https://doi.org/10.3390/plants10040704
  26. 26. Birrell S, Hughes J, Cai J, Iida F. A field-tested robotic harvesting system for iceberg lettuce. J Field Robot. 2020;37(2):225–45. https://doi.org/10.1002/rob.21888
  27. 27. Al Bashir A, Majeed Y, Zahid A. Development of an end-effector for robotic harvesting of hydroponic lettuce. J ASABE. 2025;68(4):645–57. https://doi.org/10.13031/ja.16269
  28. 28. Gang MS, Kim HJ, Kim DW. Estimation of greenhouse lettuce growth indices based on a two-stage CNN using RGB-D images. Sensors. 2022;22(15):5499. https://doi.org/10.3390/s22155499
  29. 29. Petropoulou AS, van Marrewijk B, de Zwart F, Elings A, Bijlaard M, van Daalen T, et al. Lettuce production in intelligent greenhouses—3D imaging and computer vision for plant spacing decisions. Sensors. 2023;23(6):2929. https://doi.org/10.3390/s23062929
  30. 30. Iradukunda M, van Iersel MW, Seymour L, Lu G, Ferrarezi RS. Low-cost imaging to quantify germination rate and seedling vigor across lettuce cultivars. Sensors. 2024;24(13):4225. https://doi.org/10.3390/s24134225

Downloads

Download data is not yet available.