Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting

Protected agriculture is a field in which the use of automatic systems is a key factor. In fact, the automatic harvesting of delicate fruit has not yet been perfected. This issue has received a great deal of attention over the last forty years, although no commercial harvesting robots are available...

Full description

Bibliographic Details
Main Authors: Benavides, M., Cantón Garbín, M., Sánchez Molina, J. A., Rodríguez, F.
Format: info:eu-repo/semantics/article
Language:English
Published: MDPI 2020
Subjects:
Online Access:http://hdl.handle.net/10835/8431
_version_ 1789406755994730496
author Benavides, M.
Cantón Garbín, M.
Sánchez Molina, J. A.
Rodríguez, F.
author_facet Benavides, M.
Cantón Garbín, M.
Sánchez Molina, J. A.
Rodríguez, F.
author_sort Benavides, M.
collection DSpace
description Protected agriculture is a field in which the use of automatic systems is a key factor. In fact, the automatic harvesting of delicate fruit has not yet been perfected. This issue has received a great deal of attention over the last forty years, although no commercial harvesting robots are available at present, mainly due to the complexity and variability of the working environments. In this work we developed a computer vision system (CVS) to automate the detection and localization of fruit in a tomato crop in a typical Mediterranean greenhouse. The tasks to be performed by the system are: (1) the detection of the ripe tomatoes, (2) the location of the ripe tomatoes in the XY coordinates of the image, and (3) the location of the ripe tomatoes’ peduncles in the XY coordinates of the image. Tasks 1 and 2 were performed using a large set of digital image processing tools (enhancement, edge detection, segmentation, and the feature’s description of the tomatoes). Task 3 was carried out using basic trigonometry and numerical and geometrical descriptors. The results are very promising for beef and cluster tomatoes, with the system being able to classify 80.8% and 87.5%, respectively, of fruit with visible peduncles as “collectible”. The average processing time per image for visible ripe and harvested tomatoes was less than 30 ms.
format info:eu-repo/semantics/article
id oai:repositorio.ual.es:10835-8431
institution Universidad de Cuenca
language English
publishDate 2020
publisher MDPI
record_format dspace
spelling oai:repositorio.ual.es:10835-84312023-04-12T19:26:34Z Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting Benavides, M. Cantón Garbín, M. Sánchez Molina, J. A. Rodríguez, F. image processing greenhouse automatic tomato harvesting precision agriculture Protected agriculture is a field in which the use of automatic systems is a key factor. In fact, the automatic harvesting of delicate fruit has not yet been perfected. This issue has received a great deal of attention over the last forty years, although no commercial harvesting robots are available at present, mainly due to the complexity and variability of the working environments. In this work we developed a computer vision system (CVS) to automate the detection and localization of fruit in a tomato crop in a typical Mediterranean greenhouse. The tasks to be performed by the system are: (1) the detection of the ripe tomatoes, (2) the location of the ripe tomatoes in the XY coordinates of the image, and (3) the location of the ripe tomatoes’ peduncles in the XY coordinates of the image. Tasks 1 and 2 were performed using a large set of digital image processing tools (enhancement, edge detection, segmentation, and the feature’s description of the tomatoes). Task 3 was carried out using basic trigonometry and numerical and geometrical descriptors. The results are very promising for beef and cluster tomatoes, with the system being able to classify 80.8% and 87.5%, respectively, of fruit with visible peduncles as “collectible”. The average processing time per image for visible ripe and harvested tomatoes was less than 30 ms. 2020-09-02T11:35:51Z 2020-09-02T11:35:51Z 2020-08-25 info:eu-repo/semantics/article 2076-3417 http://hdl.handle.net/10835/8431 en https://www.mdpi.com/2076-3417/10/17/5887 Attribution-NonCommercial-NoDerivatives 4.0 Internacional http://creativecommons.org/licenses/by-nc-nd/4.0/ info:eu-repo/semantics/openAccess MDPI
spellingShingle image processing
greenhouse
automatic tomato harvesting
precision agriculture
Benavides, M.
Cantón Garbín, M.
Sánchez Molina, J. A.
Rodríguez, F.
Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title_full Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title_fullStr Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title_full_unstemmed Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title_short Automatic Tomato and Peduncle Location System Based on Computer Vision for Use in Robotized Harvesting
title_sort automatic tomato and peduncle location system based on computer vision for use in robotized harvesting
topic image processing
greenhouse
automatic tomato harvesting
precision agriculture
url http://hdl.handle.net/10835/8431
work_keys_str_mv AT benavidesm automatictomatoandpedunclelocationsystembasedoncomputervisionforuseinrobotizedharvesting
AT cantongarbinm automatictomatoandpedunclelocationsystembasedoncomputervisionforuseinrobotizedharvesting
AT sanchezmolinaja automatictomatoandpedunclelocationsystembasedoncomputervisionforuseinrobotizedharvesting
AT rodriguezf automatictomatoandpedunclelocationsystembasedoncomputervisionforuseinrobotizedharvesting