Abstract
In agriculture, plants plays a major role and taking attention of plants is very critical. Generally, the plant are affected through various diseases like fungi, virus and bacteria. Finding of these diseases are main challenging task for a plant disease identification and classification. In the past few years, machine learning (ML) methods have been developed for the plant disease detection. But, the advancement in a subsection of ML, that is, DL (deep learning) models provide a great solution in the agricultural areas in the recent decades. The main objective of the paper is to provide the survey of numerous DL classification models for the plant disease detection by analysing the digital, hyper spectral and SAR images. This paper provide the review of different deep learning architectures which is utilized for plant disease identification and classification. The role of digital, hyper spectral and SAR images with deep learning models for plant disease detection is reviewed. Further, the different well-known DL architecture for plant disease classification is studied. In addition, the current challenges and their solutions of plant disease identification are discussed. Also, the application of DL and advantages/disadvantages of DL structure in plant domain are presented. Finally, the future scope of DL structure for plant domain is discussed. The preparation of this review is to permit future research to learn higher competences of deep learning while identifying plant diseases by enhancing system performance and accuracy.
Similar content being viewed by others
References
Abdulridha J, Ampatzidis Y, Kakarla SC, Roberts P (2020) Detection of target spot and bacterial spot diseases in tomato using UAV-based and benchtop-based hyperspectral imaging techniques, precis. Agriculture 21(5):955–978
Amy L, Harrison N, French AP (2017) Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods 13(1):80
Ananthi VP (2020) Fused segmentation algorithm for the detection of nutrient deficiency in crops using SAR Images. Artificial intelligence techniques for satellite image analysis springer Cham 137-159
Argüeso D, Picon A, Irusta U, Medela A, San-Emeterio MG, Bereciartua A, Alvarez-Gila A (2020) Few-shot learning approach for plant disease classification using images taken in the field. Comput Electron Agric 175:105542
Arnal BJC (2017) A new automatic method for disease symptom segmentation in digital photographs of plant leaves. Eur J Plant Pathol 147(2):349–364
Ashok S, Kishore G, Rajesh V, Suchitra S, Sophia SGG, Pavithra B (2020) Tomato leaf disease detection using deep learning techniques. In: 2020 5th international conference on communication and electronics systems (ICCES), IEEE, 979-983
Baranowski P, Jedryczka M, Mazurek W, Babula-Skowronska D, Siedliska A, Kaczmarek J (2015) Hyperspectral and thermal imaging of oilseed rape (Brassica napus) response to fungal species of the genus alternaria. PLoS One 10(3):e0122913
Barbedo JGA (2018) Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Comput Electron Agric 153:46–53
Barbedo JGA (2018) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91
Barbedo JGA (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107
Bastings J, Titov I, Aziz W, Marcheggiani D and Sima’an K (2017) Graph convolutional encoders for syntaxaware neural machine translation. In Proceedings of the 2017 conference on empirical methods in natural language processing, Copenhagen, Denmark, 1957-1967
Bock CH (2010) Et al Plant disease severity estimated visually, by digital photography and image analysis, and by hyperspectral imaging. Crit Rev Plant Sci 29(2):59–107
Chanda M, Biswas M (2019) Plant disease identification and classification using back-propagation neural network with particle swarm optimization. In: 2019 3rd international conference on trends in electronics and informatics (ICOEI), IEEE, 1029-1036
Chen YR, Chao K, Kim MS (2002) Machine vision technology for agricultural applications. Comput Electron Agric 36(2–3):173–191
Chen J, Chen J, Zhang D, Sun Y, Nanehkaran YA (2020) Using deep transfer learning for image-based plant disease identification. Comput Electron Agric 173:105393
Chen J, Yin H, Zhang D (2020) A self-adaptive classification method for plant disease detection using GMDH-logistic model. Sustain Comput: Inform Syst 28:100415
Chollet F (n.d.) Xception: Deep Learning with Depthwise Separable Convolutions. arXiv 2017, arXiv:1610.02357v3
Chowdhary KP et al (2020) Detection of cotton leaf diseases using image processing and machine learning approach. 3(5).
Cristin R, Kumar BS, Priya C, Karthick K (2020) Deep neural network based rider-cuckoo search algorithm for plant disease detection. Artif Intell Rev 53(7):4993–5018
Dai J, Li Y, He K, Sun J (2016) R-fcn: object detection via region-based fully convolutional networks. In proceedings of the advances in neural information processing systems (NIPS), international Barcelona convention center, Barcelona, Spain, 5–10: 379–387
Darwish A, Ezzat D, Hassanien AE (2020) An optimized model based on convolutional neural networks and orthogonal learning particle swarm optimization algorithm for plant diseases diagnosis. Swarm Evol Comput 52:100616
Devashish P, Yakkundimath R, Abdulmunaf SB (2016) SVM and ANN based classification of plant diseases using feature reduction technique. IJIMAI 3(7):6–14
Dharmaprakash R, Anand R, Balasanjeevi PR, Balamurugan K, Ganesh RB (2021) AI based plant disease classification using deep learning
Dias PA, Tabb A, Medeiros H (2018) Apple flower detection using deep convolutional networks. Comput Ind 99:17–28
Farabet C, Couprie C, Najman L, LeCun Y (2013) Learning hierarchical features for scene labeling. IEEE Trans Pattern Anal Mach Intell 35(8):1915–1929
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318
Fina F, Birch P, Young R, Obu J, Faithpraise B, Chatwin C (2013) Automatic plant pest detection and recognition using k-means clustering algorithm and correspondence filters. Int J Adv Biotechnol Res 4(2):189–199
Fuentes A, Yoon S, Kim SC, Park DS (2017) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022
Gadekallu TR, Rajput DS, Reddy MPK, Lakshmanna K, Bhattacharya S, Singh S, Jolfaei A, Alazab M (2020) A novel PCA–whale optimization-based deep neural network model for classification of tomato plant diseases using GPU. J Real-Time Image Proc 18:1383–1396
Gewali UB, Monteiro ST, Saber E (2018) Machine learning based hyperspectral image analysis: a survey. arXiv 2018, arXiv:1802.08701
Ghamisi P, Plaza J, Chen Y, Li J, Plaza AJ (2017) Advanced spectral classifiers for hyperspectral images: a review. IEEE Geosci Remote Sens Mag 5(1):8–32
Ghazi MM, Yanikoglu B, Aptoula E (2017) Plant identification using deep neural networks via optimization of transfer learning parameters. Neurocomputing 235:228–235
Graeff S, Link J, Claupein W (2006) Identification of powdery mildew (Erysiphe graminis sp. Tritici) and take-all disease (Gaeumannomyces graminis sp. Tritici) in wheat (Triticum aestivum L.) by means of leaf reflectance measurements. Open Life Sci 1(2):275–288
Graves A, Schmidhuber J (2005) Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw 18(5–6):602–610
Ha JG, Moon H, Kwak JT, Hassan SI, Dang M, Lee ON, Park HY (2017) Deep convolutional neural network for classifying fusarium wilt of radish from unmanned aerial vehicles. J Appl Remote Sens 11(4):042621
Hamel P, Eck D (2010) Learning features from music audio with deep belief networks. In: Proceedings of the11th International Society for Music Information Retrieval Conference (ISMIR), Utrecht, The Netherlands, 339–344
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. 2015. arXiv Prepr. arXiv1512.03385.
Hernández S, Juan LL (2020) Uncertainty quantification for plant disease detection using Bayesian deep learning. Appl Soft Comput-Elsevier 96:106597
Hinton G, Deng L, Yu D, Dahl GE, Mohamed A, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath T, Kingsbury B (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97
Huang PS, He X, Gao J, Deng L, Acero A, Heck L (2013) Learning deep structured semantic models for web search using clickthrough data. In: Proceedings of the 22nd ACM international conference on Information & Knowledge Management, San Francisco, CA, 2333–2338.
Huang PY, Liu F, Shiang SR, Oh J, Dyer C (2016) Attention-based multimodal neural machine translation. In: Proceedings of the 1st conference on machine translation, volume 2: Shared Task Papers, Berlin, Germany, 639–645
Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR), Hawaii convention center, Honolulu, Hawaii, 21–26: pp. 7310–7311
Huang G, Liu Z, van der Maaten L, Weinberger KQ (2018) Densely connected convolutional networks. arXiv 2018, arXiv:1608.06993v5
Jain A, Zamir AR, Savarese S, Saxena A (2016) Structural-RNN: deep learning on spatio-temporal graphs. In: Proceedings of 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, 5308–5317
Jin X, Jie L, Wang S, Qi H-J, Li S-W (2018) Classifying wheat hyperspectral pixels of healthy heads and fusarium head blight disease using a deep neural network in the wild field. Remote Sens 10(3):395
Kamal KC (2019) Et al depth wise separable convolution architectures for plant disease classification. Comput Electron Agric-Elsevier 165:104948
Khamparia A, Saini G, Gupta D, Khanna A, Tiwari S, de Albuquerque VHC (2020) Seasonal crops disease prediction and classification using deep convolutional encoder network. Circuits Syst Signal Process 39(2):818–836
Khan MJ, Khan HS, Yousaf A, Khurshid K, Abbas A (2018) Modern trends in hyperspectral image analysis: a review. IEEE Access 6:14118–14129
Khirade SD, Patil AB (2015) Plant disease detection using image processing. In 2015 international conference on computing communication control and automation, IEEE, 768-771
Kiran GR, Gawande U (2014) An overview of the research on plant leaves disease detection using image processing techniques. IOSR J Comput Eng (IOSR-JCE) 16(1):10–16
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst 25:1097–1105
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems 25. Curran Associates, Inc., pp 1097–1105
Kumain SC, Singh M, Singh N, Kumar K (2018) An efficient Gaussian noise reduction technique for Noisy images using optimized filter approach. In: 2018 first international conference on secure cyber computing and communication (ICSCCC), IEEE, 243-248
Kumar S, Sharma B, Sharma VK, Sharma H, Bansal JC (2020) Plant leaf disease identification using exponential spider monkey optimization. Sustain Comput: Inform Syst 28:100283
Lam AN, Nguyen AT, Nguyen HA, Nguyen TN (2015) Combining deep learning with information retrieval to localize buggy files for bug reports (N). In: Proceedings of 2015 30th IEEE/ACM international conference on automated software engineering (ASE), Lincoln, NE, 476–481
Lei Y et al (2020) Refocusing high-resolution SAR images of complex moving vessels using co-evolutionary particle swarm optimization. Remote Sens 12(20):3302
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) Ssd: single shot multibox detector. In: Proceedings of the European conference on computer vision (ECCV), Amsterdam, the Netherlands, 11–14: 21–37
Liu B, Zhang Y, He D, Li Y (2017) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10(1):1–16
Lowe A, Harrison N, French AP (2017) Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods 13:80
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384
Ma J, Du K, Zheng F, Zhang L, Gong Z, Sun Z (2018) A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network. Comput Electron Agric 154:18–24
Mahdianpari M, Salehi B, Rezaee M, Mohammadimanesh F, Zhang Y (2018) Very deep convolutional neural networks for complex land cover mapping using multispectral remote sensing imagery. Remote Sens 10:1119
Mikolov T, Deoras A, Povey D, Burget L, Cernocky J (2011) Strategies for training large scale neural network language models. In: Proceedings of 2011 IEEE workshop on Automatic Speech Recognition & Understanding, Waikoloa, HI, 196–201
Milioto A, Lottes P and Stachniss C (2017) Real-time blob-wise sugar beets vs weeds classification for monitoring fields using convolutional neural networks. In: Proceedings of ISPRS annals of the photogrammetry, Remote Sensing and Spatial Information Sciences, Bonn, Germany,: 41–48
Mohammed B et al (2018) Deep learning for plant diseases: detection and saliency map visualisation. Human and machine learning springer, Cham 93-117
Mohanty SP, Hughes DP, Salathe M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419
Mustafa MS (2020) Et al development of automated hybrid intelligent system for herbs plant classification and early herbs plant disease detection. Neural Comput Appl 32(15):11419–11441
Nagasubramanian K, Jones S, Singh AK, Sarkar S, Singh A, Ganapathysubramanian B (2019) Plant disease identification using explainable 3D deep learning on hyperspectral images. Plant Methods 15(1):1–10
Nandhini SA, Hemalatha R, Radha S, Indumathi K (2018) Web enabled plant disease detection system for agricultural applications using WMSN. Wirel Pers Commun 102(2):725–740
Negi A, Kumar K, Chauhan P (2021) Deep neural network-based multi-class image classification for plant diseases. Agricultural Informatics: Automation Using the IoT and Machine Learning, 117–129.
Nikos P (2019) Plant disease diagnosis for smart phone applications with extensible set of diseases. Appl Sci 9(9):1952
Ning Z et al (2020) A review of advanced technologies and development for hyperspectral-based plant disease detection in the past three decades. Remote Sens 12(19):3188
Pooja V, Das R, Kanchana V (2017) Identification of plant leaf diseases using image processing techniques. 2017 IEEE technological innovations in ICT for agriculture and rural development (TIAR) IEEE
Prashanthi V, Srinivas K (2020) Plant disease detection using convolutional neural networks. Int J Adv Trends Comput Sci Eng 9(3):2632–2637
Pujari D, Yakkundimath R, Byadgi AS (2016) SVM and ANN based classification of plant diseases using feature reduction technique. IJIMAI 3(7):6–14
Qiang Z, He L, Dai F (2019) Identification of plant leaf diseases based on inception V3 transfer learning and fine-tuning. In International conference on Smart City and Informatization, Springer, Singapore, 118–127
Qin L-F, Zhang X, Zhang X-Q (2020) Early detection of cucumber downy mildew in greenhouse by hyperspectral disease differential feature extraction. Trans Chin Soc Agricult Mach 51(11):212–220
Rahnemoonfar M, Sheppard C (2017) Deep count: fruit counting based on deep simulated learning. Sensors 17(4):905
Ramesh S, Hebbar R, Niveditha M, Pooja R, Shashank N, Vinod PV (2018) Plant disease detection using machine learning. In: 2018 international conference on design innovations for 3Cs compute communicate control (ICDI3C), IEEE, 41-45
Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In Proceedings of the advances in neural information processing systems (NIPS), Montreal convention center, Montreal, QC, Canada, 7–10: 91–99
Sainath TN, Mohamed A, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR, In: Proceedings of 2013 IEEE international conference on acoustics, Speech and Signal Processing, Vancouver, BC, Canada, 8614–8618.
Saleem MH, Potgieter J, Arif KM (2019) Plant disease detection and classification by deep learning. Plants 8(11):468
Saleem MH, Potgieter J, Arif KM (2020) Plant disease classification: a comparative evaluation of convolutional neural networks and deep learning optimizers. Plants 9(10):1319
Sardogan M, Tuncer A, Ozen Y (2018) Plant leaf disease detection and classification based on CNN with LVQ algorithm. In: 2018 3rd International Conference on Computer Science and Engineering (UBMK), IEEE, 382-385
Sarina A et al (2020) Wetland monitoring using SAR data: a meta-analysis and comprehensive review. Remote Sens 12(14):2190
Sharma S, Shivhare SN, Singh N, Kumar K (2019) Computationally efficient ann model for small-scale problems. In: Machine intelligence and signal analysis. Springer, Singapore, pp 423–435
Shen T, Zhou T, Long G, Jiang J, Pan S and Zhang C (2018) DiSAN: directional self-attention network for RNN/CNN-free language understanding. In: Proceedings of the 32nd AAAI conference on artificial intelligence, Palo Alto, CA, 5446–5455
Sifre L, Mallat S (2013) Rotation, scaling and deformation invariant scattering for texture discrimination. In proceedings of the IEEE conference on computer vision and pattern recognition, Portland, OR, USA, 23–28: 1233–1240
Signoroni A, Savardi M, Baronio A, Benini S (2019) Deep learning meets hyperspectral image analysis: a multidisciplinary review. J Imag 5(5):52
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv Prepr.arXiv1409.1556.
Singh V, Misra AK (2015) Detection of unhealthy region of plant leaves using image processing and genetic algorithm. In: 2015 international conference on advances in computer engineering and applications, IEEE, 1028-1032
Singh V, Misra AK (2017) Detection of plant leaf diseases using image segmentation and soft computing techniques. Inf Process Agric 4(1):41–49
Srivastava N, Salakhutdinov RR (2012) Multimodal learning with deep Boltzmann machines. Adv Neural Inf Proces Syst 25:2222–2230
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of 2015 IEEE conference on computer vision and pattern recognition (CVPR), Boston, MA, 1–9
Tete TN and Kamlu S (2017) Detection of plant disease using threshold, k-mean cluster and ann algorithm. In: 2017 2nd international conference for convergence in technology (I2CT), IEEE, 523-526
Thomas S, Kuska MT, Bohnenkamp D, Brugger A, Alisaac E, Wahabzada M, Behmann J, Mahlein A-K (2018) Benefits of hyperspectral imaging for plant disease detection and plant protection: a technical perspective. J Plant Dis Prot 125(1):5–20
Thushara BL and Rasool TM (2020) Analysis of plant diseases using expectation maximization detection with BP-ANN classification. XIII (VIII)
Tian Y, Yang G, Wang Z, Wang H, Li E, Liang Z (2019) Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput Electron Agric 157:417–426
Tompson J, Jain A, LeCun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. Adv Neural Inf Proces Syst 27:1799–1807
Tran TT, Choi JW, Le TTH, Kim JW (2019) A comparative study of deep CNN in forecasting and classifying the macronutrient deficiencies on development of tomato plant. Appl Sci 9(8):1601
Turkoglu M, Hanbay D, Sengur A (2019) Multi-model LSTM-based convolutional neural networks for detection of apple diseases and pests. J Ambient Intell Humaniz Comput, 1-11. https://doi.org/10.1007/s12652-019-01591-w
Vamsidhar E, Rani PJ, Babu KR (2019) Plant disease identification and classification using image processing. Int J Eng Adv Technol 8(3):442–446
Vijai S (2019) Sunflower leaf diseases detection using image segmentation based on particle swarm optimization. Artif Intell Agric 3:62–68
Waghmare H, Kokare R, Dandawate Y (2016) Detection and classification of diseases of grape plant using opposite colour local binary pattern feature and machine learning for automated decision support system. In: 2016 3rd international conference on signal processing and integrated networks (SPIN), IEEE, 513-518
Wang G, Sun Y, Wang J (2017) Automatic image-based plant disease severity estimation using deep learning. Comput Intell Neurosci 2017:2917536–2917538
Wu H, Wiesner-Hanks T, Stewart EL, DeChant C, Kaczmar N, Gore MA, Nelson RJ, Lipson H (2019) Autonomous detection of plant disease symptoms directly from aerial imagery. Plant Phenome J 2(1):1–9
Xie C, Shao Y, Li X, He Y (2015) Detection of early blight and late blight diseases on tomato leaves using hyperspectral imaging. Sci Rep 5(1):1–11
Yinghui Q et al (2020) A novel image fusion method of multi-spectral and SAR images for land cover Classification. Remote Sens 12(22):3801
Younus WM et al (2018) Systemic acquired resistance (SAR): a novel strategy for plant protection with reference to mulberry. Int J Chem Stud 2:1184–1192
Yuan L, Yan P, Han W, Huang Y, Wang B, Zhang J, Zhang H, Bao Z (2019) Detection of anthracnose in tea plants based on hyperspectral imaging. Comput Electron Agric 167:105039
Zhang S, Huang W, Zhang C (2019) Three-channel convolutional neural networks for vegetable leaf disease recognition. Cogn Syst Res 53:31–41
Zhang N, Yang G, Pan Y, Yang X, Chen L, Zhao C (2020) A review of advanced technologies and development for hyperspectral-based plant disease detection in the past three decades. Remote Sens 12(19):3188
Zhong L, Hu L, Zhou H (2019) Deep learning based multi-temporal crop classification. Remote Sens Environ 221:430–443
Zhu X, Zhu M, Ren H (2018) Method of plant leaf recognition based on improved deep convolutional neural network. Cogn Syst Res 52:223–233
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Bhujade, V.G., Sambhe, V. Role of digital, hyper spectral, and SAR images in detection of plant disease with deep learning network. Multimed Tools Appl 81, 33645–33670 (2022). https://doi.org/10.1007/s11042-022-13055-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13055-z