Abstract
The use of technology in agriculture has grown imperative. To provide the expanding population's needs for food, agricultural productivity should rise. Computer vision technology has been used to solve the difficulties associated with manual yield estimation. This article present efficient mango fruit yield estimation system with color based pixel classification method with support to that a benchmark mango tree dataset is presented. Dataset is collected temporally under varying illumination conditions, distance and time for 5 months from its blossoming phase to the ripen phase of the fruit. The repository accounts for 21,000 images of mango trees. The proposed work initially preprocess the RGB image by converting into grayscale, HSV and YCbCr color models, each layers of color model are separately extracted and each layer is enhanced by applying techniques like Gaussian blur, histogram equalization to study the features and superiority of the mango images and best color layer which exhibits most dominant features are selected for next level processing. Further, proposed a two stage algorithm using color features to classify the pixels of mango fruit region. Finally, after fruit pixel classification the method is followed by mango fruit detection using Hough transform circle fitting technique. The proposed method could count up to 80% of mango fruits present in the image. This work offers specialized help for the visual recognizable proof and yield estimation of mango fruits and also for other fruits available in the environment.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from [M V Neethi] but restrictions apply to the availability of these data, which were captured personally for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of [M V Neethi].
References
Schertz CE, Brown GK. Basic Considerations in mechanizing citrus harvest. Trans ASAE. 1968;343–3446
Calvin H, James U, Juan N, Salah S. A feature learning- based approach for automated fruit yield estimation. In: Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 105). 2015
Israr H, Qianhua H, Zhuliang C. Automatic fruit recognition based on Dcnn for commercial source trace system. Int J Comput Sci Appl (IJCSA). 2018;8(2/3).
Chuanyuan Z, Won SL, Dongjian H. Immature green citrus detection based on color feature and sum of absolute transformed difference (SATD) using color images in the citrus grove. Comput Electron Agric. 2016;124:243–253
Lu J, Sang N. Detecting citrus fruits and occlusion recovery under natural illumination conditions. Comput Electron Agric Sci Direct. 2015;110
Araya Alman M, Leroux C, Aceved CO, Guillaume S, Valdés-Gómez H, Verdugo-Vásquez N, Pañitrur Dela Fuente C, Tisseyre B. A new localized sampling method to improve grape yield estimation of the current season using yield historical data. Precision Agric. 2019;20: 445
Tien TN, Koenraad V, Niels W, Erdal K, De Baerdemaeker JG, W Saeys. Detection of red and bicolored apples on tree with an RGB-D camera. Biosyst Eng 3 3 e4 4, 1537-5110/© 2016 IAgrE. Published by Elsevier Ltd. All rights reserved. 2016
Kutiba N, Mohamed R, Mohd NAR, Yahaya I, Azim ZAA. Detecting mango fruits by using randomized hough transform and backpropagation neural network. In: 18th International Conference on Information Visualisation. 2014. https://doi.org/10.1109/IV.2014.54.
Inkyu S, Zongyuan G, Feras D, Ben U, Tristan P, Chris MC. Deep fruits: a fruit detection system using deep neural networks. Sensors. 2016;16:1222. https://doi.org/10.3390/s16081222.
Hong C, Lutz D, Yurui S, Michael B. Early yield prediction using image analysis of appl fruit and tree canopy features with neural networks. J Imaging. 2017;3:6. https://doi.org/10.3390/jimaging3010006.
Donggi K, Hongchul C, Jaehoon C, Seong JY, Dongil H. A novel red apple detection algorithm based on AdaBoost Learning. In: IEIE transactions on smart processing and computing. 2015;4(4)
Han L, Won SL, Ku W. Immature green citrus fruit detection and counting based on fast normalized cross correlation (FNCC) using natural outdoor colour images. Precis Agric. 2022. https://doi.org/10.1007/s11119-016-9443-z.
Liu S, Cossell S, Tang J, Dunn G, Whitty M. A computer vision system for early stage grape yield estimation based on shoot detection. Comput Electron Agric. 2017;137:88–101.
Yaqoob M, Jing Z, Xin Z, Longsheng F, Manoj K, Qin Z, Matthew DW. Apple tree trunk and branch segmentation for automatic trellis training using convolutional neural network based semantic segmentation. IFAC Papers Online. 2018;51–17:75–80.
Zhu W, Chen H, Ciechanowska I, Spaner D. Application of infrared thermal imaging for the rapid diagnosis of crop disease. IFAC Pap Online. 2018;51–17:424–30.
Jorge PMG, Carlos EM, Marcelo B. Citrus fruit detection using Faster R-CNN algorithm under real outdoor conditions. In: Proceedings of the 14th International Conference on Precision Agriculture. 2022
Gutiérrez S, Wendel A, Underwood J. Ground based hyperspectral imaging for extensive mango yield estimation. Comput Electron Agric. 2019;157:126–35.
Suchet B, James U. Deep fruit detection in orchards. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). 2017
Ren S, He K, Girshick R, Jian S. Faster R-CNN: towards real-time object detection with region proposal networks. Comput Electron Agric. 2019;157:126–35.
Whelan PF, Ghita O. Color texture analysis. In: Majid M, Xianghua X, Jasjit S (eds) Handbook of Texture analysis. Imperial College Press. 2008
Nishad PM, Manicka Chezian R. Various color spaces and color space conversion algorithms. J Global Res Comput Sci. 2013;4(1).
Payne AB, Walsh KB, Subedi PP, Jarvis D. Estimation of mango crop yield using image analysis segmentation method. Comput Electron Agric. 2013;91:57–64.
Walter M Jr, Jose CB. Automatic green fruit counting in orange trees using digital images. Comput Electron Agric. 2016;127(2016):572–81.
Geetha KA, Murali S. Automatic 3D view generation from a single 2D image for both indoor and outdoor scenes. Int J Comput Sci Appl. 2013. https://doi.org/10.5121/ijcsa.2013.3404.
Diego IP, Rafael R. Computer vision and artificial intelligence in precision agriculture for grain crops: a systematic review. Comput Electron Agric. 2018;153:69–81.
Neethi MV, Geetha Kiran A, Harshvardhan T. Yield estimation in mango orchards using machine vision. AIP Conf Proc. 2021;2336:050004. https://doi.org/10.1063/5.0046526.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
For the writers, there are no apparent conflicts of interest. Each co-author has examined and approved the manuscript's content, and none of the authors have any competing financial interests to mention.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the topical collection “Advances in Computational Intelligence for Artificial Intelligence, Machine Learning, Internet of Things and Data Analytics” guest edited by S. Meenakshi Sundaram, Young Lee and Gururaj K S.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Neethi, M.V., Kiran, A.G. & Tiwari, H. Intelligent Mango Canopies Yield Estimation Using Machine Vision. SN COMPUT. SCI. 4, 171 (2023). https://doi.org/10.1007/s42979-022-01602-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-022-01602-2