Abstract
Precise and automatic plant disease detection represent a fundamental research topic. Indeed, traditional or manual disease detection can be laborious, inaccurate and time-consuming. In this work, a particular attention is given to automatic potato late blight disease detection. In fact, this devastating pathogen leads every year to a significant reduction in potato yields. In addition, since potatoes are a major food source for many nations, decreased production generate a real food insecurity. Therefore, considering these challenges, using advanced techniques in computer vision and machine learning allowed farmers to swiftly and accurately identify disease. The main objective of this research work is to generate a super-resolved labeled dataset (SRD) and evaluate its impact on plant disease detection. Three states of the art object detection methods (Faster-RCNN, Detr and Yolo V8) have been used to conduct an exhaustive evaluation on the effect of using a super-resolved dataset to perform detection. The obtained results show that the detection of potato late blight disease is enhanced using SRD. Training Yolo V8 model on SRD outperform other trained models in detecting very small lesions. In fact, training Yolo V8 on SRD reached higher mAP, lower Loss values and a reasonable inference time, making it suitable for real time applications.







Similar content being viewed by others
Data availability
The data that support the findings of this study are openly available in: https://www.kaggle.com/datasets/emmarex/plantdisease
Additional data related to this work can be obtained on request from the corresponding author.
References
Dey AK, Sharma M, Meshram M (2016) Image processing-based leaf rot disease, detection of betel vine (Piper betle L.). Procedia Comput Sci 85:748–754. https://doi.org/10.1016/j.procs.2016.05.262
Yan-Cheng Zhang, Han-Ping Mao, Bo Hu, Ming-Xi Li (2007) Features selection of cotton disease leaves image based on fuzzy feature selection techniques," 2007 International Conference on Wavelet Analysis and Pattern Recognition, Beijing 124–129. https://doi.org/10.1109/ICWAPR.2007.4420649
Mokhtar U, Ali MA, Hassanien AE, Hefny H (2015) Identifying two of tomatoes leaf viruses using support vector machine. In Information Systems Design and Intelligent Applications; Springer: Berlin, Germany 771–782
Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419. https://doi.org/10.3389/fpls.2016.01419
Prajapati HB, Shah JP, Dabhi VK (2017) Detection and classification of rice plant diseases. Intell Decis Technol 11:357–373. https://doi.org/10.3233/IDT-170301
Fuentes A, Yoon S, Kim SC, Park DS (2017) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022. https://doi.org/10.3390/s17092022
Kaur S, Pandey S, Goel S (2018) Semi-automatic leaf disease detection and classification system for soybean culture. IET Image Proc 12:1038–1048. https://doi.org/10.1049/iet-ipr.2017.0822
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009
Singh UP, Chouhan SS, Jain S, Jain S (2019) Multilayer convolution neural network for the classification of mango leaves infected by anthracnose disease. IEEE Access 7:43721–43729. https://doi.org/10.1109/ACCESS.2019.2907383
Lin Z et al (2019) A unified matrix-based convolutional neural network for fine-grained image classification of wheat leaf diseases,". IEEE Access 7:11570–11590. https://doi.org/10.1109/ACCESS.2019.2891739
Sethy PK, Barpanda NK, Rath AK, Behera SK (2020) Deep feature-based rice leaf disease identification using support vector machine. Comput Electron Agric 175:105527. https://doi.org/10.1016/j.compag.2020.105527
Shrivastava VK, Pradhan MK (2021) Rice plant disease classification using color features: a machine learning paradigm. J Plant Pathol 103:17–26. https://doi.org/10.1007/s42161-020-00683-3
Atila Ü, Uçar M, Akyol K, Uçar E (2021) Plant leaf disease classification using Efficient Net deep learning model. Ecol Informatics 61:101182. https://doi.org/10.1016/j.ecoinf.2020.101182
Yan Zhang, Shiyun Wa, Longxiang Zhang, Chunli Lv (2022) Automatic Plant Disease Detection Based on Tranvolution Detection Network with GAN Modules Using Leaf Images. Front Plant Sci Sec Technical Advances in Plant Science 13. https://doi.org/10.3389/fpls.2022.875693
Ashwinkumar S, Rajagopal S, Manimaran V, Jegajothi B (2022) Automated plant leaf disease detection and classification using optimal MobileNet based convolutional neural networks, Materials Today: Proceedings, Volume 51. Part 1:480–487. https://doi.org/10.1016/j.matpr.2021.05.584
Borhani Y, Khoramdel J, Najafi E (2022) A deep learning-based approach for automated plant disease classification using vision transformer. Sci Rep 12:11554. https://doi.org/10.1038/s41598-022-15163-0
Liu Y, Liu J, Cheng W, Chen Z, Zhou J, Cheng H, Lv C (2023) A high-precision plant disease detection method based on a dynamic pruning gate friendly to low-computing platforms. Plants 12:2073. https://doi.org/10.3390/plants12112073
Saraswat S, Singh P, Kumar M et al (2023) Advanced detection of fungi-bacterial diseases in plants using modified deep neural network and DSURF. Multimed Tools Appl. https://doi.org/10.1007/s11042-023-16281-1
Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6:60. https://doi.org/10.1186/s40537-019-0197-0
Yao T, Luo Y, Chen Y, Yang D, Zhao L (2020) Single-Image Super-Resolution: A Survey. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering vol 516. Springer, Singapore. https://doi.org/10.1007/978-981-13-6504-1_16
Arun PV, Buddhiraju KM, Porwal A, Chanussot J (2020) CNN-based super-resolution of hyperspectral images. IEEE Trans Geosci Remote Sens 58(9):6106–6121. https://doi.org/10.1109/TGRS.2020.2973370
Tai Y, Yang J, Liu X (2017) Image super-resolution via deep recursive residual network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3147–3155. https://doi.org/10.1109/CVPR.2017.298
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inform Process Syst 2:2672–2680. https://doi.org/10.5555/2969033.2969125
Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEETrans Patt Anal Machine Intellig 38(2):295307. https://doi.org/10.1109/TPAMI.205.2439281
Haris M, Shakhnarovich G, Ukita N (2019) Recurrent back-projection network for video super-resolution. In: Proc IEEE Conf Comput Vis Pattern Recognit 3897–3906. https://doi.org/10.1109/CVPR.2019.00402
Kawulok M, Benecki P, Piechaczek S, Hrynczenko K, Kostrzewa D, Nalepa J (2020) Deep Learning for Multiple-Image Super-Resolution. IEEE Geosci Remote Sens Lett 17(6):1062–1066. https://doi.org/10.1109/LGRS.2019.2940483
Elad M, Hel-Or Y (2001) A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur”. IEEE Trans Image Process 10(8):1187–1193. https://doi.org/10.1109/83.935034
Stark H, Oskoui P (1989) High-resolution image recovery from image plane arrays, using convex projections. JOSA A 6(11):1715–1726. https://doi.org/10.1364/JOSAA.6.001715
Tipping ME, Bishop CM (2003) Bayesian image super-resolution. In Adv Neural Inf Process Syst 2033:1303–1310
Hamdi A, Chan YK, Koo VC (2021) A new image enhancement and super resolution technique for license plate recognition. Heliyon (11): e0834. 110.1016/j.heliyon.2021.e08341
A Lugmayr, M Danelljan, R Timofte (2019) "Unsupervised learning for real-world super-resolution, IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea (South), 3408–3416. https://doi.org/10.1109/ICCVW.2019.00423
B Lim, S Son, H Kim, S Nah, KM Lee (2017) Enhanced deep residual networks for single image super-resolution, 2017, IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 1132–1140. https://doi.org/10.1109/CVPRW.2017.151
Wang X et al. (2019) ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. In: Leal-Taixé, L., Roth, S. (eds) Computer Vision – ECCV 2018 Workshops. ECCV 2018. Lecture Notes in Computer Science 11133. Springer, Cham. https://doi.org/10.1007/978-3-030-11021-5_5
Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. IEEE Conf Comput Vision Pattern Recog (CVPR). https://doi.org/10.1109/CVPR.2017.19
Girshick R, Donahue J, Darrell T, Malik J (2016) Region-Based Convolutional Networks for Accurate Object Detection and Segmentation. IEEE Trans Pattern Anal Mach Intell 38(1):142–158. https://doi.org/10.1109/TPAMI.2015.2437384
R. Girshick, Fast R-CNN (2015) IEEE International Conference on Computer Vision (ICCV), Santiago, Chile 1440–1448. https://doi.org/10.1109/ICCV.2015.169
Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans Pattern Anal Mach Intell 39:1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031
K He, G Gkioxari, P Dollár, R Girshick (2017) Mask R-CNN, IEEE International Conference on Computer Vision (ICCV), Venice, Italy 2980–2988. https://doi.org/10.1109/ICCV.2017.322
Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, JM. (eds) Computer Vision –ECCV 2020. Lecture Notes in Computer Science() 12346. Springer, Cham. https://doi.org/10.1007/978-3-030-58452-8_13
J Redmon, S Divvala, R Girshick, A Farhadi (2016) You Only Look Once: Unified, Real-Time Object Detection, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016 779–788. https://doi.org/10.1109/CVPR.2016.91
Hussain M (2023) YOLO-v1 to YOLO-v8 the rise of yolo and its complementary nature toward digital manufacturing and industrial defect detection. Machines 11:677. https://doi.org/10.3390/machines11070677
K He, X Zhang, S Ren, J Sun (2016) "Deep residual learning for image recognition," 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, USA, 770–778. https://doi.org/10.1109/CVPR.2016.90
Bochkovskiy A, Wang C, Liao HM (2020) YOLOv4: Optimal Speed and Accuracy of Object Detection. ArXiv, abs/2004 10934. https://doi.org/10.48550/arXiv.2004.10934
Horé, Alain, Ziou, Djemel (2010) Image quality metrics: PSNR vs. SSIM. 20th International Conference on Pattern Recognition, Istanbul, Turkey. https://doi.org/10.1109/ICPR.2010.579
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612. https://doi.org/10.1109/TIP.2003.819861
Padilla SL, Netto, EAB da Silva (2020) A survey on performance metrics for object-detection algorithms International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil 237–242. https://doi.org/10.1109/IWSSIP48289.2020
Funding
No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
All the authors contributed equally and significantly in writing this article and read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflicts of interest
All authors declare that they have no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sarah, M., Abdlemadjid, M., Sarah, B. et al. Evaluating the effect of super-resolution for automatic plant disease detection: application to potato late blight detection. Multimed Tools Appl 83, 78469–78487 (2024). https://doi.org/10.1007/s11042-024-18574-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-024-18574-5