Abstract
Plant disease control is an indispensable research topic in the field of agriculture. Different apple leaf diseases may have similar manifestations, and it is time-consuming and laborious to rely on manual means. In this paper, we propose an apple leaf disease classification algorithm for a small number of samples, which is based on the C-Grabcut image segmentation algorithm proposed in this paper and the improved EfficientNetB4 transfer learning algorithm. Firstly, data augmentation is used to expand the samples, which effectively solves the problems of insufficient samples and unbalanced sample categories. Then the leaves are extracted from the images using the C-Grabcut algorithm to reduce the interference brought by the background. Finally, the improved Vgg16, ResNet50, EfficientNetB0, EfficientNetB4 and EfficientNetB7 transfer learning algorithms are used to classify leaves into four categories: rust, scab, multiply and healthy. The experimental results show that the improved EfficientB4 algorithm works best with an average accuracy of 98% and the Kappa value of 0.98. In addition, the C-Grabcut algorithm reduces the training time from 153 to 73 s during an epoch, allowing the proposed algorithms to be deployed on devices with lower computing power and memory.
Similar content being viewed by others
Data availability
The datasets analysed during the current study are available in the Kaggle repository, which are available from https://www.kaggle.com/c/plant-pathology-2020-fgvc7/data.
References
PD, S.A(2019)World population prospects 2019: highlights. 2019; Available from: https://www.un.org/development/desa/publications/world-population-prospects-2019-highlights.html
Mohanty SP, Hughes DP, Salathe M (2016) Using Deep Learning for Image-Based Plant Disease Detection. Front Plant Sci 7:1419. https://doi.org/10.3389/fpls.2016.01419
Odegard IYR, van der Voet E (2014) The future of food - Scenarios and the effect on natural resource use in agriculture in 2050. Ecol Econ 97:51–59. https://doi.org/10.1016/j.ecolecon.2013.10.005
Gregory PJ et al (2009) Integrating pests and pathogens into the climate change/food security debate. J Exp Bot 60(10):2827–2838. https://doi.org/10.1093/jxb/erp080
Dong H et al (2006) Dry mycelium of Penicillium chrysogenum protects cotton plants against wilt diseases and increases yield under field conditions. Crop Protect 25(No.4):324–330. https://doi.org/10.1016/j.cropro.2005.05.003
Braunack MV, Garside AL, Magarey RC (2012) Reduced tillage planting and the long-term effect on soil-borne disease and yield of sugarcane (Saccharum inter-specific hybrid) in Queensland, Australia. Soil Tillage Res, (No.1): 85–91. https://doi.org/10.1016/j.still.2011.11.002
Kaur S, Pandey S, Goel S (2019) Plants Disease Identification and Classification Through Leaf Images: A Survey. Arch Comput Methods Eng, (No.2): 507–530. https://doi.org/10.1007/s11831-018-9255-6
Bhange M, Hingoliwala H (2015) Smart farming: Pomegranate disease detection using image processing. Procedia Comput Sci 58:280–288
Sabrol H, Satish K (2016) Tomato plant disease classification in digital images using classification tree. in 2016 international conference on communication and signal processing (ICCSP). IEEE
Aasha Nandhini S et al (2018) Web enabled plant disease detection system for agricultural applications using WMSN. Wireless Pers Commun 102:725–740
Panchal SS, Sonar R (2016) Pomegranate leaf disease detection using support vector machine. Int J Eng Comput Sci 5(6):16815–16818
Qi F, Wang Y, Tang Z (2022) Lightweight plant disease classification combining grabcut algorithm, new coordinate attention, and channel pruning. Neural Process Lett 54(6):5317–5331
Rother C, Kolmogorov V, Blake A (2004) “ GrabCut” interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314
Chen L-C et al (2017) Rethinking atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587
Douillard A et al (2021) Plop: Learning without forgetting for continual semantic segmentation. in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Zhou MM (2019) Apple foliage diseases recognition in Android system with transfer learning-based. MS thesis, Dept Inf Eng, NorthwestA&FNorthwest A&F Univ, Yangling, China
Gao H et al (2022) A mutually supervised graph attention network for few-shot segmentation: the perspective of fully utilizing limited samples. IEEE Transactions on neural networks and learning systems:1–13
Rakelly K et al (2018) Conditional networks for few-shot semantic segmentation
Cao Z et al (2019) Meta-seg: A generalized meta-learning framework for multi-class few-shot semantic segmentation. IEEE Access 7:166109–166121
Shrivastava VK, Pradhan MK (2021) Rice plant disease classification using color features: a machine learning paradigm. J Plant Pathol 103:17–26
Jaisakthi S, Mirunalini P, Thenmozhi D (2019) Grape leaf disease identification using machine learning techniques. in 2019 International Conference on Computational Intelligence in Data Science (ICCIDS). 2019. IEEE
Kaur P, Singla S, Singh S (2017) Detection and classification of leaf diseases using integrated approach of support vector machine and particle swarm optimization. Int J Adv Appl Sci 4(8):79–83
Kranth GPR et al (2018) Plant disease prediction using machine learning algorithms. Int J Comput Appl 18(2):0975–8887
Liu B et al (2017) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10(1):11
Yan Q et al (2020) Apple leaf diseases recognition based on an improved convolutional neural network. Sensors 20(12):3535
Xiong Y et al (2020) Identification of cash crop diseases using automatic image segmentation algorithm and deep learning with expanded dataset. Comput Electron Agric 177:105712
Simonyan K and Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
He K et al (2016) Deep residual learning for image recognition. in Proceedings of the IEEE conference on computer vision and pattern recognition
Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. in International conference on machine learning. PMLR
Hu G et al (2019) A low shot learning method for tea leaf’s disease identification. Comput Electron Agric 163:104852. https://doi.org/10.1016/j.compag.2019.104852
Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
Fang S, Yuan Y et al (2017) Crop disease image recognition based on transfer learning. In Image and Graphics: 9th International Conference, Part I 9:545–554
Deng J et al (2009) ImageNet: A large-scale hierarchical image database. in 2009 IEEE Conference on Computer Vision and Pattern Recognition
Lin M, Chen Q, Yan S (2013) Network in network. arXiv preprint arXiv:1312.4400
Chao X et al (2020) Identification of Apple Tree Leaf Diseases Based on Deep Learning Models. Symmetry. 12(7).https://doi.org/10.3390/sym12071065
Tang M, Gorelick L et al (2013) Grabcut in one cut. In Proceedings of the IEEE international conference on computer vision:1769–1776
Cheng MM et al (2015). Densecut: Densely connected crfs for realtime grabcut. In Comput Graphics Forum 34(7):193–201
Fu R et al (2016) Fully automatic figure-ground segmentation algorithm based on deep convolutional neural network and GrabCut. IET Image Proc 10(12):937–942
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China [grant numbers 42061067, 52063002]; the Science and technology projects of Jiangxi Provincial Department of Education [grant numbers 190745].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lian, S., Guan, L., Pei, J. et al. Identification of apple leaf diseases using C-Grabcut algorithm and improved transfer learning base on low shot learning. Multimed Tools Appl 83, 27411–27433 (2024). https://doi.org/10.1007/s11042-023-16602-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16602-4