Skip to main content
Log in

Evaluating the effect of super-resolution for automatic plant disease detection: application to potato late blight detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Precise and automatic plant disease detection represent a fundamental research topic. Indeed, traditional or manual disease detection can be laborious, inaccurate and time-consuming. In this work, a particular attention is given to automatic potato late blight disease detection. In fact, this devastating pathogen leads every year to a significant reduction in potato yields. In addition, since potatoes are a major food source for many nations, decreased production generate a real food insecurity. Therefore, considering these challenges, using advanced techniques in computer vision and machine learning allowed farmers to swiftly and accurately identify disease. The main objective of this research work is to generate a super-resolved labeled dataset (SRD) and evaluate its impact on plant disease detection. Three states of the art object detection methods (Faster-RCNN, Detr and Yolo V8) have been used to conduct an exhaustive evaluation on the effect of using a super-resolved dataset to perform detection. The obtained results show that the detection of potato late blight disease is enhanced using SRD. Training Yolo V8 model on SRD outperform other trained models in detecting very small lesions. In fact, training Yolo V8 on SRD reached higher mAP, lower Loss values and a reasonable inference time, making it suitable for real time applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

The data that support the findings of this study are openly available in: https://www.kaggle.com/datasets/emmarex/plantdisease

Additional data related to this work can be obtained on request from the corresponding author.

References

  1. Dey AK, Sharma M, Meshram M (2016) Image processing-based leaf rot disease, detection of betel vine (Piper betle L.). Procedia Comput Sci 85:748–754. https://doi.org/10.1016/j.procs.2016.05.262

  2. Yan-Cheng Zhang, Han-Ping Mao, Bo Hu, Ming-Xi Li (2007) Features selection of cotton disease leaves image based on fuzzy feature selection techniques," 2007 International Conference on Wavelet Analysis and Pattern Recognition, Beijing 124–129. https://doi.org/10.1109/ICWAPR.2007.4420649

  3. Mokhtar U, Ali MA, Hassanien AE, Hefny H (2015) Identifying two of tomatoes leaf viruses using support vector machine. In Information Systems Design and Intelligent Applications; Springer: Berlin, Germany 771–782

  4. Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419. https://doi.org/10.3389/fpls.2016.01419

    Article  Google Scholar 

  5. Prajapati HB, Shah JP, Dabhi VK (2017) Detection and classification of rice plant diseases. Intell Decis Technol 11:357–373. https://doi.org/10.3233/IDT-170301

    Article  Google Scholar 

  6. Fuentes A, Yoon S, Kim SC, Park DS (2017) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022. https://doi.org/10.3390/s17092022

    Article  Google Scholar 

  7. Kaur S, Pandey S, Goel S (2018) Semi-automatic leaf disease detection and classification system for soybean culture. IET Image Proc 12:1038–1048. https://doi.org/10.1049/iet-ipr.2017.0822

    Article  Google Scholar 

  8. Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009

    Article  Google Scholar 

  9. Singh UP, Chouhan SS, Jain S, Jain S (2019) Multilayer convolution neural network for the classification of mango leaves infected by anthracnose disease. IEEE Access 7:43721–43729. https://doi.org/10.1109/ACCESS.2019.2907383

    Article  Google Scholar 

  10. Lin Z et al (2019) A unified matrix-based convolutional neural network for fine-grained image classification of wheat leaf diseases,". IEEE Access 7:11570–11590. https://doi.org/10.1109/ACCESS.2019.2891739

    Article  Google Scholar 

  11. Sethy PK, Barpanda NK, Rath AK, Behera SK (2020) Deep feature-based rice leaf disease identification using support vector machine. Comput Electron Agric 175:105527. https://doi.org/10.1016/j.compag.2020.105527

    Article  Google Scholar 

  12. Shrivastava VK, Pradhan MK (2021) Rice plant disease classification using color features: a machine learning paradigm. J Plant Pathol 103:17–26. https://doi.org/10.1007/s42161-020-00683-3

    Article  Google Scholar 

  13. Atila Ü, Uçar M, Akyol K, Uçar E (2021) Plant leaf disease classification using Efficient Net deep learning model. Ecol Informatics 61:101182. https://doi.org/10.1016/j.ecoinf.2020.101182

    Article  Google Scholar 

  14. Yan Zhang, Shiyun Wa, Longxiang Zhang, Chunli Lv (2022) Automatic Plant Disease Detection Based on Tranvolution Detection Network with GAN Modules Using Leaf Images. Front Plant Sci Sec Technical Advances in Plant Science 13. https://doi.org/10.3389/fpls.2022.875693

  15. Ashwinkumar S, Rajagopal S, Manimaran V, Jegajothi B (2022) Automated plant leaf disease detection and classification using optimal MobileNet based convolutional neural networks, Materials Today: Proceedings, Volume 51. Part 1:480–487. https://doi.org/10.1016/j.matpr.2021.05.584

    Article  Google Scholar 

  16. Borhani Y, Khoramdel J, Najafi E (2022) A deep learning-based approach for automated plant disease classification using vision transformer. Sci Rep 12:11554. https://doi.org/10.1038/s41598-022-15163-0

    Article  Google Scholar 

  17. Liu Y, Liu J, Cheng W, Chen Z, Zhou J, Cheng H, Lv C (2023) A high-precision plant disease detection method based on a dynamic pruning gate friendly to low-computing platforms. Plants 12:2073. https://doi.org/10.3390/plants12112073

    Article  Google Scholar 

  18. Saraswat S, Singh P, Kumar M et al (2023) Advanced detection of fungi-bacterial diseases in plants using modified deep neural network and DSURF. Multimed Tools Appl. https://doi.org/10.1007/s11042-023-16281-1

    Article  Google Scholar 

  19. Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6:60. https://doi.org/10.1186/s40537-019-0197-0

    Article  Google Scholar 

  20. Yao T, Luo Y, Chen Y, Yang D, Zhao L (2020) Single-Image Super-Resolution: A Survey. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering vol 516. Springer, Singapore. https://doi.org/10.1007/978-981-13-6504-1_16

  21. Arun PV, Buddhiraju KM, Porwal A, Chanussot J (2020) CNN-based super-resolution of hyperspectral images. IEEE Trans Geosci Remote Sens 58(9):6106–6121. https://doi.org/10.1109/TGRS.2020.2973370

    Article  Google Scholar 

  22. Tai Y, Yang J, Liu X (2017) Image super-resolution via deep recursive residual network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3147–3155. https://doi.org/10.1109/CVPR.2017.298

  23. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inform Process Syst 2:2672–2680. https://doi.org/10.5555/2969033.2969125

  24. Dong C, Loy CC, He K, Tang X (2016) Image super-resolution using deep convolutional networks. IEEETrans Patt Anal Machine Intellig 38(2):295307. https://doi.org/10.1109/TPAMI.205.2439281

    Article  Google Scholar 

  25. Haris M, Shakhnarovich G, Ukita N (2019) Recurrent back-projection network for video super-resolution. In: Proc IEEE Conf Comput Vis Pattern Recognit 3897–3906. https://doi.org/10.1109/CVPR.2019.00402

  26. Kawulok M, Benecki P, Piechaczek S, Hrynczenko K, Kostrzewa D, Nalepa J (2020) Deep Learning for Multiple-Image Super-Resolution. IEEE Geosci Remote Sens Lett 17(6):1062–1066. https://doi.org/10.1109/LGRS.2019.2940483

    Article  Google Scholar 

  27. Elad M, Hel-Or Y (2001) A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur”. IEEE Trans Image Process 10(8):1187–1193. https://doi.org/10.1109/83.935034

    Article  Google Scholar 

  28. Stark H, Oskoui P (1989) High-resolution image recovery from image plane arrays, using convex projections. JOSA A 6(11):1715–1726. https://doi.org/10.1364/JOSAA.6.001715

    Article  Google Scholar 

  29. Tipping ME, Bishop CM (2003) Bayesian image super-resolution. In Adv Neural Inf Process Syst 2033:1303–1310

    Google Scholar 

  30. Hamdi A, Chan YK, Koo VC (2021) A new image enhancement and super resolution technique for license plate recognition. Heliyon (11): e0834. 110.1016/j.heliyon.2021.e08341

  31. A Lugmayr, M Danelljan, R Timofte (2019) "Unsupervised learning for real-world super-resolution, IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea (South), 3408–3416. https://doi.org/10.1109/ICCVW.2019.00423

  32. B Lim, S Son, H Kim, S Nah, KM Lee (2017) Enhanced deep residual networks for single image super-resolution, 2017, IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 1132–1140. https://doi.org/10.1109/CVPRW.2017.151

  33. Wang X et al. (2019) ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. In: Leal-Taixé, L., Roth, S. (eds) Computer Vision – ECCV 2018 Workshops. ECCV 2018. Lecture Notes in Computer Science 11133. Springer, Cham. https://doi.org/10.1007/978-3-030-11021-5_5

  34. Ledig C, Theis L, Huszar F, Caballero J, Cunningham A, Acosta A et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. IEEE Conf Comput Vision Pattern Recog (CVPR). https://doi.org/10.1109/CVPR.2017.19

    Article  Google Scholar 

  35. Girshick R, Donahue J, Darrell T, Malik J (2016) Region-Based Convolutional Networks for Accurate Object Detection and Segmentation. IEEE Trans Pattern Anal Mach Intell 38(1):142–158. https://doi.org/10.1109/TPAMI.2015.2437384

    Article  Google Scholar 

  36. R. Girshick, Fast R-CNN (2015) IEEE International Conference on Computer Vision (ICCV), Santiago, Chile 1440–1448. https://doi.org/10.1109/ICCV.2015.169

  37. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans Pattern Anal Mach Intell 39:1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  38. K He, G Gkioxari, P Dollár, R Girshick (2017) Mask R-CNN, IEEE International Conference on Computer Vision (ICCV), Venice, Italy 2980–2988. https://doi.org/10.1109/ICCV.2017.322

  39. Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, JM. (eds) Computer Vision –ECCV 2020. Lecture Notes in Computer Science() 12346. Springer, Cham. https://doi.org/10.1007/978-3-030-58452-8_13

  40. J Redmon, S Divvala, R Girshick, A Farhadi (2016) You Only Look Once: Unified, Real-Time Object Detection, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016 779–788. https://doi.org/10.1109/CVPR.2016.91

  41. Hussain M (2023) YOLO-v1 to YOLO-v8 the rise of yolo and its complementary nature toward digital manufacturing and industrial defect detection. Machines 11:677. https://doi.org/10.3390/machines11070677

    Article  Google Scholar 

  42. K He, X Zhang, S Ren, J Sun (2016) "Deep residual learning for image recognition," 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, USA, 770–778. https://doi.org/10.1109/CVPR.2016.90

  43. Bochkovskiy A, Wang C, Liao HM (2020) YOLOv4: Optimal Speed and Accuracy of Object Detection. ArXiv, abs/2004 10934. https://doi.org/10.48550/arXiv.2004.10934

  44. Horé, Alain, Ziou, Djemel (2010) Image quality metrics: PSNR vs. SSIM. 20th International Conference on Pattern Recognition, Istanbul, Turkey. https://doi.org/10.1109/ICPR.2010.579

  45. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612. https://doi.org/10.1109/TIP.2003.819861

    Article  Google Scholar 

  46. Padilla SL, Netto, EAB da Silva (2020) A survey on performance metrics for object-detection algorithms International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil 237–242. https://doi.org/10.1109/IWSSIP48289.2020

Download references

Funding

No funding was received to assist with the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

All the authors contributed equally and significantly in writing this article and read and approved the final manuscript.

Corresponding author

Correspondence to Mazari Sarah.

Ethics declarations

Conflicts of interest

All authors declare that they have no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sarah, M., Abdlemadjid, M., Sarah, B. et al. Evaluating the effect of super-resolution for automatic plant disease detection: application to potato late blight detection. Multimed Tools Appl 83, 78469–78487 (2024). https://doi.org/10.1007/s11042-024-18574-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18574-5

Keywords