Skip to main content
Springer Nature Link
Log in

YOLOAPPLE: Augment Yolov3 deep learning algorithm for apple fruit quality detection

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Apple detection helps the food manufacturing process to distinguish between fresh and damaged apples. In this modern world, many apple-detecting flaws are discovered before harvest. After a harvest, the system is required to identify apple species and quality, which will help in food production machinery. In this research, a novel YOLOAPPLE has been proposed for identifying different apple objects such as three classes: normal apple, damaged, and red delicious apple using Augment Yolov3. Using Grab cut to remove the background of the apple for better results in the next iteration. The augment Yolov3 with extra spatial pyramid information and a swish activation function to maintain feature loss preferences throughout training. Yolov3 is improved by the Darknet53 convolution neural network acting as a backbone and by adding spatial pyramid pooling features using the feature pyramid network before the object detector. Finally, the fully connected layer will classify as normal apple, damaged, and red delicious. The Augment Yolov3 model enables multi-class detection and recognition system that achieves higher mean average precision of 99.13% when compared to the conventional Yolov3, Yolov4 deep learning model. The experimental results originated from a newly generated object recognition model that was created by utilizing the Kaggle dataset using Google Colab inference on an NVIDIA Tesla K-80 GPU for a better localization process and its precise multi-object detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data Availability

Data sharing is not applicable to this article as no new data were created or analyzed in this Research.

References

  1. Pérez-Hernández, F., Tabik, S., Lamas, A., Olmos, R., Fujita, H., Herrera, F.: Object detection binary classifiers methodology based on deep learning to identify small objects handled similarly: Application in video surveillance. Knowl. Based Syst. 194, 105590 (2020)

    Article  Google Scholar 

  2. Farhadi-Tooli, S., Ghanbari, A., Kermani, M.J., Zeinalabedini, M., Bettoni, J.C., Naji, A.M., Kazemi, N.: Droplet-vitrification cryotherapy and thermotherapy as efficient tools for the eradication of apple chlorotic leaf spot virus and apple stem grooving virus from virus-infected quince in vitro cultures. Eur. J. Plant Pathol. 162(1), 31–43 (2022)

    Article  Google Scholar 

  3. Zhao, X., Peng, Y., Li, Y., Wang, Y., Li, Y., Chen, Y.: Intelligent micro flight sensing system for detecting the internal and external quality of apples on the tree. Comput. Electron. Agric. 204, 107571 (2023)

    Article  Google Scholar 

  4. Sumit, S.S., Watada, J., Roy, A., Rambli, D.R.A.: In object detection deep learning methods, YOLO shows supremum to Mask R-CNN. J. Phys. Conf. Ser. 1529(4), 042086 (2020)

    Article  Google Scholar 

  5. Yuan, H., Yan, M.: Food object recognition and intelligent billing system based on Cascade R-CNN. In: 2020 International Conference on Culture-oriented Science & Technology (ICCST) (pp. 80–84). IEEE, 2020

  6. Chandio, A., Gui, G., Kumar, T., Ullah, I., Ranjbarzadeh, R., Roy, A.M., Hussain, A., Shen, Y.: 2022. Precise single-stage detector. arXiv preprint arXiv:2210.04252

  7. Lee, J.: The Detection of Fruit Flower Clusters in Apple Orchards Using Machine Learning (Doctoral dissertation, University of Guelph) (2021)

  8. Junos, M.H., Mohd Khairuddin, A.S., Thannirmalai, S., Dahari, M.: Automatic detection of oil palm fruits from UAV images using an improved YOLO model. Vis. Comput. 38, 2341 (2021)

    Article  Google Scholar 

  9. Gai, W., Liu, Y., Zhang, J., Jing, G.: An improved Tiny YOLOv3 for real-time object detection. Syst. Sci. Control Eng. 9, 314–321 (2021)

    Article  Google Scholar 

  10. Tian, Y., Yang, G., Wang, Z., Wang, H., Li, E., Liang, Z.: Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput. Electron. Agric. 157, 417–426 (2019)

    Article  Google Scholar 

  11. Chu, P., Li, Z., Lammers, K., Lu, R., Liu, X.: Deep learning-based apple detection using a suppression mask R-CNN. Pattern Recognit. Lett. 147, 206–211 (2021)

    Article  Google Scholar 

  12. Zhao, M., Peng, Y., Li, L.: A robot system for the autodetection and classification of apple internal quality attributes. Postharvest Biol. Technol. 180, 111615 (2021)

    Article  Google Scholar 

  13. Zhang, J., Karkee, M., Zhang, Q., Zhang, X., Yaqoob, M., Fu, L., Wang, S.: Multi-class object detection using faster R-CNN and estimation of shaking locations for automated shake-and-catch apple harvesting. Comput. Electron. Agric. 173, 105384 (2020)

    Article  Google Scholar 

  14. Gao, F., Fu, L., Zhang, X., Majeed, Y., Li, R., Karkee, M., Zhang, Q.: Multi-class fruit-on-plant detection for apple in SNAP system using Faster R-CNN. Comput. Electron. Agric. 176, 105634 (2020)

    Article  Google Scholar 

  15. Li, H., Li, C., Li, G., Chen, L.: A real-time table grape detection method based on improved YOLOv4-tiny network in complex background. Biosyst. Eng. 212, 347–359 (2021)

    Article  Google Scholar 

  16. Fu, L., Majeed, Y., Zhang, X., Karkee, M., Zhang, Q.: Faster R-CNN–based apple detection in dense-foliage fruiting-wall trees using RGB and depth features for robotic harvesting. Biosyst. Eng. 197, 245–256 (2020)

    Article  Google Scholar 

  17. Li, X., Pan, J., Xie, F., Zeng, J., Li, Q., Huang, X., Liu, D., Wang, X.: Fast and accurate green pepper detection in complex backgrounds via an improved Yolov4-tiny model. Comput. Electron. Agric. 191, 106503 (2021)

    Article  Google Scholar 

  18. Suo, R., Gao, F., Zhou, Z., Fu, L., Song, Z., Dhupia, J., Li, R., Cui, Y.: Improved multi-classes kiwifruit detection in orchard to avoid collisions during robotic picking. Comput. Electron. Agric. 182, 106052 (2021)

    Article  Google Scholar 

  19. Wu, D., Lv, S., Jiang, M., Song, H.: Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments. Comput. Electron. Agric. 178, 105742 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to express his heartfelt gratitude to the supervisor for his guidance and unwavering support during this research for his guidance and support.

Funding

No Financial support.

Author information

Authors and Affiliations

  1. Department of Computing Technologies, School of Computing, SRM Institute of Science and Technology, Kattankulathur, 603203, Chennai, India

    M. Karthikeyan, R. Srinivasan & C. Santhanakrishnan

  2. Department of Computer Science and Engineering, Annamalai University, Annamalai Nagar, Chidambaram, 608002, India

    T. S. Subashini

  3. Department of Electronics and Communication Engineering, PSN College of Engineering and Technology, Tirunelveli, India

    A. Ahilan

Authors
  1. M. Karthikeyan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. T. S. Subashini
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. R. Srinivasan
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. C. Santhanakrishnan
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. A. Ahilan
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

The authors confirm contribution to the paper as follows: MK contributed to Study conception and design; TSS, RS contributed to Data collection; MK,TSS,RS contributed to Analysis and interpretation of results; CS and AA contributed to Draft manuscript preparation. All authors reviewed the results and approved the final version of the manuscript.

Corresponding author

Correspondence to M. Karthikeyan.

Ethics declarations

Conflict of interest

This paper has no conflict of interest for publishing.

Ethical approval

My research guide reviewed and ethically approved this manuscript for publishing in this Journal.

Human and Animal Rights

His article does not contain any studies with human or animal subjects performed by any of the authors.

Informed consent

I certify that I have explained the nature and purpose of this study to the above-named individual, and I have discussed the potential benefits of this study participation. The questions the individual had about this study have been answered, and we will always be available to address future questions.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karthikeyan, M., Subashini, T.S., Srinivasan, R. et al. YOLOAPPLE: Augment Yolov3 deep learning algorithm for apple fruit quality detection. SIViP 18, 119–128 (2024). https://doi.org/10.1007/s11760-023-02710-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-023-02710-z

Keywords