Skip to main content
SpringerLink
Log in

Residual Skip Network-Based Super-Resolution for Leaf Disease Detection of Grape Plant

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

Plant diseases significantly impact agricultural productivity. Early disease identification and diagnosis are critical for plant protection. Recent deep learning approaches have substantially aided detection of plant diseases. However, existing plant leaf disease identification techniques do not provide sufficient disease detection accuracies when the input image resolution is low. Images of grape leaves taken in the field may be low-resolution (LR) in nature due to limited lighting and varying weather conditions. Such LR images may result in incorrect real-time disease diagnosis. Hence super-resolution is a way to solve this problem. This research work proposes a novel Residual Skip Network-based Super-Resolution for Leaf Disease Detection (RSNSR-LDD) in the Grape plant. The input LR image is separated into two subcomponents using the guided filtering technique. Features from the two subcomponents are extracted using single convolutional layer and four layers of the two-channel residual skip network. Concatenation is used to combine the features of two channels. Following this, a decoding block and a convolutional layer are utilized to generate the super-resolution (SR) image. A new collaborative loss function is proposed for training. The obtained SR image is given to the Disease Detection Network (DDN) for grape leaf disease detection. This approach, based on an LR image, assists the farmer in spotting grape plant diseases very early. Proposed model was extensively trained and tested on PlantVillage, Grape 400, Grape Leaf Disease datasets with multiple super-resolution scaling factors for various grape leaves images. For different super-resolution scaling factors such as Χ2, Χ4, Χ6, the proposed model RSNSR-LDD achieved accuracies of 97.19%, 99.37%, and 99.06% for the PlantVillage dataset, 96.88%, 97.12%, and 95.43% for the Grape400 dataset, and 100% for the Grape Leaf Disease dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data Availability

Publicly available PlantVillage, Grape 400, Grape leaf disease datasets were used for obtaining the low resolution images and to train our model.

References

  1. S. Abbas, M. Jain, S. Gour, Vankudothu, Tomato plant disease detection using transfer learning with C-GAN synthetic images. Comput. Electron. Agric. 187, 106279 (2021)

    Article  Google Scholar 

  2. R. Abiantun, F. Juefei-Xu, U. Prabhu, M. Savvides, SSR2: Sparse signal recovery for single-image super-resolution on faces with extreme low resolutions. Pattern Recogn. 90, 308–324 (2019). https://doi.org/10.1016/J.PATCOG.2019.01.032

    Article  Google Scholar 

  3. J. Adhikari, A.R. Sarkar, M.R. Uddin, U.K. Sarker, K. Hossen, U. Rosemila, Effect of nitrogen fertilizer and weed management on the yield of transplant aman rice. J. Bangladesh Agric. Univ. 16(1), 12–16 (2018). https://doi.org/10.3329/jbau.v16i1.36473

    Article  Google Scholar 

  4. N. Agrawal, J. Singhai, D.K. Agarwal, Grape leaf disease detection and classification using multi-class support vector machine, in International conference on recent innovations in signal processing and embedded systems, RISE 2017, 2018-January, 238–244 (2018). https://doi.org/10.1109/RISE.2017.8378160

  5. P.V. Arun, I. Herrmann, K.M. Budhiraju, A. Karnieli, Convolutional network architectures for super-resolution/sub-pixel mapping of drone-derived images. Pattern Recogn. 88, 431–446 (2019). https://doi.org/10.1016/J.PATCOG.2018.11.033

    Article  Google Scholar 

  6. B.A.M. Ashqar, S.S. Abu-Naser, Image-Based tomato leaves diseases detection using deep learning. Int. J. Eng. Res. (Vol. 2) (2019). https://www.researchgate.net/publication/330214376

  7. S. Baker, T. Kanade, Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24(9), 1167–1183 (2002). https://doi.org/10.1109/TPAMI.2002.1033210

    Article  Google Scholar 

  8. H. Chang, D.Y. Yeung, Y. Xiong, Super-resolution through neighbor embedding, in Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 1(2004) https://doi.org/10.1109/cvpr.2004.1315043

  9. J. Chen, J. Chen, D. Zhang, Y. Sun, Y.A. Nanehkaran, Using deep transfer learning for image-based plant disease identification. Comput. Electron. Agric. 173, 105393 (2020). https://doi.org/10.1016/J.COMPAG.2020.105393

    Article  Google Scholar 

  10. Y. Choi, Y. Lee, B.K. Letters, Group-based bi-directional recurrent wavelet neural network for efficient video super-resolution (VSR). Elsevier 2022. https://www.sciencedirect.com/science/article/pii/S0167865522003440

  11. F. Chollet, Xception: deep learning with depthwise separable convolutions, in Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1251–1258) (2017).

  12. S. Dananjayan, Y. Tang, Zhuang, Assessment of state-of-the-art deep learning based citrus disease detection techniques using annotated optical leaf images. Elsevier (2022). https://www.sciencedirect.com/science/article/pii/S016816992100675X

  13. C. Dong., C.C. Loy, K. He, X. Tang, Learning a deep convolutional network for image super-resolution. Lecture notes in computer science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8692 LNCS (PART 4), 184–199. (2014). https://doi.org/10.1007/978-3-319-10593-2_13

  14. C. Dong, C.C. Loy, K. He, X. Tang, Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016). https://doi.org/10.1109/TPAMI.2015.2439281

    Article  Google Scholar 

  15. C. Dong, C.C. Loy, X. Tang, Accelerating the super-resolution convolutional neural network. Lecture notes in computer science (Including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 9906 LNCS, 391–407 (2016). https://doi.org/10.1007/978-3-319-46475-6_25/FIGURES/7

  16. H. Durmus, E.O. Güneş, M. Kırcı, Disease detection on the leaves of the tomato plants by using deep learning, in 2017 6th international conference on agro-geoinformatics (pp. 1–5) (2017). IEEE.

  17. A. Elhassouny, F. Smarandache, Smart mobile application to recognize tomato leaf diseases using convolutional neural networks, in 2019 International conference of computer science and renewable energies (ICCSRE), IEEE, pp. 1–4 (2019).

  18. W.T. Freeman, T.R. Jones, E.C. Pasztor, Example-based super-resolution. IEEE Comput. Graphics Appl. 22(2), 56–65 (2002). https://doi.org/10.1109/38.988747

    Article  Google Scholar 

  19. S. Fu, L. Lu, H. Li, Z. Li, W. Wu, A. Paul, G. Jeon, X. Yang, A real-time super-resolution method based on convolutional neural networks. Circ. Syst. Signal Process. 39(2), 805–817 (2020). https://doi.org/10.1007/S00034-019-01283-Y/FIGURES/9

    Article  Google Scholar 

  20. A.F. Fuentes, S. Yoon, J. Lee, D.S. Park, High-performance deep neural network-based tomato plant diseases and pests diagnosis system with refinement filter bank. Front. Plant Sci. (2018). https://doi.org/10.3389/fpls.2018.01162

    Article  Google Scholar 

  21. R. Gajjar, N. Gajjar, V.J. Thakor, N.P. Patel, S. Ruparelia, Real-time detection and identification of plant leaf diseases using convolutional neural networks on an embedded platform. Vis. Comput. (2021). https://doi.org/10.1007/S00371-021-02164-9

    Article  Google Scholar 

  22. D. Glasner, S. Bagon, M. Irani, Super-resolution from a single image. Proc. IEEE Int. Conf. Comput. Vis. (2009). https://doi.org/10.1109/ICCV.2009.5459271

    Article  Google Scholar 

  23. G. Huang, Z. Liu, Q. Kilian, “Densely connected convolutional networks,” arXiv.org, 2016. arxiv.org/abs/1608.06993.

  24. Y.J. Heo, W.H. Yeo, B.G. Kim, DeepFake detection algorithm based on improved vision transformer. Appl. Intell. (2022). https://doi.org/10.1007/S10489-022-03867-9

    Article  Google Scholar 

  25. K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition, in Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778) (2016).

  26. A.G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, H.Adam, Mobilenets: Efficient convolutional neural networks for mobile vision applications. (2017).

  27. J.B. Huang, A. Singh, N. Ahuja, Single image super-resolution from transformed self-exemplars, in Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 07–12-June-2015, 5197–5206 (2015). https://doi.org/10.1109/CVPR.2015.7299156

  28. X. Huang, A. Chen, G. Zhou, X. Zhang, J. Wang, N. Peng, N. Yan, C. Jiang, Tomato leaf disease detection system based on FC-SNDPN. Multimed. Tools Appl. 82(2), 2121–2144 (2023). https://doi.org/10.1007/S11042-021-11790-3/FIGURES/11

    Article  Google Scholar 

  29. S. Iniyan, R. Jebakumar, P. Mangalraj, M. Mohit, A. Nanda, Plant disease identification and detection using support vector machines and artificial neural networks. Adv. Intell. Syst. Comput. 1056, 15–27 (2020). https://doi.org/10.1007/978-981-15-0199-9_2/COVER

    Article  Google Scholar 

  30. F.N. Iandola, S. Han, M.W. Moskewicz, K. Ashraf, W.J. Dally, K. Keutzer, SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size (2016).

  31. L.W. Kang, C.C. Hsu, B. Zhuang, C.W. Lin, C.H. Yeh, Learning-based joint super-resolution and deblocking for a highly compressed image. IEEE Trans. Multimedia 17(7), 921–934 (2015). https://doi.org/10.1109/TMM.2015.2434216

    Article  Google Scholar 

  32. S. Kaur, P. Kaur, Plant species identification based on plant leaf using computer vision and machine learning techniques. Koreascience (2019). https://doi.org/10.33851/JMIS.2019.6.2.49

    Article  Google Scholar 

  33. M. Khan, Healthy and disease affected leaves of grape plant. figshare. Dataset. (2020) https://doi.org/10.6084/m9.figshare.13083890.v1

  34. J.H. Kim, G.S. Hong, B.G. Kim, D.P. Dogra, deepGesture: deep learning-based gesture recognition scheme using motion sensors. Displays 55, 38–45 (2018). https://doi.org/10.1016/J.DISPLA.2018.08.001

    Article  Google Scholar 

  35. J. Kim, J.K. Lee, K.M. Lee, Accurate image super-resolution using very deep convolutional networks, in Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 1646–1654 (2016). https://doi.org/10.1109/CVPR.2016.182

  36. S. Kumar Sahu, M. Pandey, An optimal hybrid multiclass SVM for plant leaf disease detection using spatial Fuzzy C-Means model. Expert Syst. Appl. 214, 118989 (2023). https://doi.org/10.1016/J.ESWA.2022.118989

    Article  Google Scholar 

  37. C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, W. Shi, Photo-realistic single image super-resolution using a generative adversarial network, in Proceedings - 30th IEEE Conference on computer vision and pattern recognition, CVPR 2017, 2017-January, 105–114 (2017). https://doi.org/10.1109/CVPR.2017.19

  38. K. Li, Y. Zhu, J. Yang, J. Jiang, Video super-resolution using an adaptive superpixel-guided auto-regressive model. Pattern Recogn. 51, 59–71 (2016). https://doi.org/10.1016/J.PATCOG.2015.08.008

    Article  Google Scholar 

  39. X. Luo, Y. Xu, J. Yang, Multi-resolution dictionary learning for face recognition. Pattern Recogn. 93, 283–292 (2019). https://doi.org/10.1016/J.PATCOG.2019.04.027N

    Article  Google Scholar 

  40. N. Nguyen, P. Milanfar, A fast wavelet interpolation-restoration method for superresolution. Circ. Syst. Signal Process 19(4), 321–338 (2000). https://doi.org/10.1007/BF01200891

    Article  MATH  Google Scholar 

  41. P.B. Padol, A.A. Yadav, SVM classifier based grape leaf disease detection, in Conference on advances in signal processing, CASP 2016, 175–179. (2016). https://doi.org/10.1109/CASP.2016.7746160

  42. S.J. Park, B.G. Kim, N. Chilamkurti, A robust facial expression recognition algorithm based on multi-rate feature fusion scheme. Sensors 21(21), 6954 (2021). https://doi.org/10.3390/s21216954

    Article  Google Scholar 

  43. J. Redmon, S. Divvala, R. Girshick, A. Farhadi, You only look once: unified, real-time object detection, in Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 2016-December, 779–788. (2016). https://doi.org/10.1109/CVPR.2016.91

  44. S. Ren, K. He, R. Girshick, Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings. Neurips. Cc. (2015). https://proceedings.neurips.cc/paper/2015/hash/14bfa6bb14875e45bba028a21ed38046-Abstract.html

  45. G. Sachdeva, P. Singh, P. Kaur, Plant leaf disease classification using deep convolutional neural network with Bayesian learning. Mater. Today: Proc. 45, 5584–5590 (2021). https://doi.org/10.1016/J.MATPR.2021.02.312

    Article  Google Scholar 

  46. S.K. Sahu, M. Pandey, An optimal hybrid multiclass SVM for plant leaf disease detection using spatial Fuzzy C-Means model. Expert Syst. Appl. 214, 118989 (2023). https://doi.org/10.1016/j.eswa.2022.118989

    Article  Google Scholar 

  47. K. Shabir, T.H. Al Mahmud, R. Zheng, Z. Ye, Generalized super-resolution DOA estimation array configurations’ design exploiting sparsity in coprime arrays. Circ. Syst. Signal Proc. 38(10), 4723–4738 (2019). https://doi.org/10.1007/S00034-019-01078-1/FIGURES/8

    Article  Google Scholar 

  48. K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition (2014).

  49. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, Z. Wojna, Rethinking the inception architecture for computer vision, in Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818–2826) (2016).

  50. L. Wang, Z. Huang, Y. Gong, C. Pan, Ensemble based deep networks for image super-resolution. Pattern Recogn. 68, 191–198 (2017). https://doi.org/10.1016/J.PATCOG.2017.02.027

    Article  Google Scholar 

  51. X. Wang, K. Chan, K. Yu, Video restoration with enhanced deformable convolutional networks, (2019). http://openaccess.thecvf.com/content_CVPRW_2019/html/NTIRE/Wang_EDVR_Video_Restoration_With_Enhanced_Deformable_Convolutional_Networks_CVPRW_2019_paper.html

  52. J. Yang, J. Wright, T.S. Huang, Y. Ma, Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010). https://doi.org/10.1109/TIP.2010.2050625

    Article  MathSciNet  MATH  Google Scholar 

  53. J. Yang, Y. Yang, G. Liao, B. Lei, A super-resolution direction of arrival estimation algorithm for coprime array via sparse Bayesian learning inference. Circ. Syst. Signal Process. 37(5), 1907–1934 (2018). https://doi.org/10.1007/S00034-017-0637-Z/FIGURES/10

    Article  MathSciNet  MATH  Google Scholar 

  54. X. Yang, C. Wu, D. Zhou, T. Li, Fast image super-resolution based on limit gradient embedding cascaded forest. Circ. Syst. Signal Process. 41(4), 2007–2026 (2022). https://doi.org/10.1007/S00034-021-01869-5/FIGURES/5

    Article  Google Scholar 

  55. X. Yang, Y. Zhang, T. Li, Y. Guo, D. Zhou, Image super-resolution based on the down-sampling iterative module and deep CNN. Circ. Syst. Signal Process. 40(7), 3437–3455 (2021). https://doi.org/10.1007/S00034-020-01630-4/TABLES/3

    Article  Google Scholar 

  56. P.V. Yeswanth, S. Deivalakshmi, Extended wavelet sparse convolutional neural network (EWSCNN) for super resolution. Sādhanā 48(2), 52 (2023)

    Article  MathSciNet  Google Scholar 

  57. P.V. Yeswanth, R. Khandelwal, S. Deivalakshmi, Super resolution-based leaf disease detection in potato plant using broad deep residual network (BDRN). SN Comput. Sci. 4(2), 1–9 (2022). https://doi.org/10.1007/S42979-022-01514-1/METRICS

    Article  Google Scholar 

  58. R. Zeyde, M. Elad, M. Protter, On single image scale-up using sparse-representations. lecture notes in computer science (Including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), 6920 LNCS, 711–730 (2012). https://doi.org/10.1007/978-3-642-27413-8_47

  59. Z. Zhu, F. Guo, H. Yu, C. Chen, Fast single image super-resolution via self-example learning and sparse representation. IEEE Trans. Multimedia 16(8), 2178–2190 (2014). https://doi.org/10.1109/TMM.2014.2364976

    Article  Google Scholar 

  60. M. Zontak, M. Irani, Internal statistics of a single natural image, in Proceedings of the IEEE computer society conference on computer vision and pattern recognition, 977–984 (2011). https://doi.org/10.1109/CVPR.2011.5995401

Download references

Acknowledgements

Authors are thankful to the Director of the National Institute of Technology—Tiruchirappalli for granting us permission to use the GPU resources from the Center of Excellence – Artificial Intelligence (CoE-AI) lab.

Author information

Authors and Affiliations

  1. Department of Electronics and Communication Engineering, National Institute of Technology, Tiruchirappalli, India

    P. V. Yeswanth & S. Deivalakshmi

  2. Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway

    Sony George

  3. Department of Electrical and Computer Engineering, University of Saskatchewan, Saskatoon, Canada

    Seok-Bum Ko

Authors
  1. P. V. Yeswanth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. Deivalakshmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sony George
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seok-Bum Ko
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Deivalakshmi.

Ethics declarations

Conflict of interest

The authors certify that they have NO affiliations with or involvement in any organization or entity with any financial interest (such as honoraria; educational grants; participation in speakers’ bureaus; membership, employment, consultancies, stock ownership, or other equity interest; and expert testimony or patent-licensing arrangements), or non-financial interest (such as personal or professional relationships, affiliations, knowledge or beliefs) in the subject matter or materials discussed in this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yeswanth, P.V., Deivalakshmi, S., George, S. et al. Residual Skip Network-Based Super-Resolution for Leaf Disease Detection of Grape Plant. Circuits Syst Signal Process 42, 6871–6899 (2023). https://doi.org/10.1007/s00034-023-02430-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-023-02430-2

Keywords

Search

Navigation