Skip to main content
SpringerLink
Log in

A low-cost UAV for detection of Cercospora leaf spot in okra using deep convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Artificial Intelligence (AI)-enabled agricultural robotics is expected to significantly disrupt the domain of agriculture with promise of profitable farming. However, significant challenges exist while deploying such technologies in economically backward countries in a cost-effective manner that can ensure profitability. This study focusses on identification of Cercospora Leaf Spot (CLS) disease in the okra plant, which is also referred to as lady’s finger or Abelmoschus esculentus L. The disease is identified by using deep learning models on images acquired using a modified cost-effective quadcopter fitted with a camera. Two deep learning models, namely SqueezeNet and ResNet-18, were used for this study with a validation accuracy of 99.1% and 99% respectively. Testing of the models with the images collected using the modified quadcopter produced an accuracy of 92.3% and 94.6% respectively. The misclassifications have been analysed using confusion matrices and possible reasons affecting the classification process are discussed. In addition, the learning process has been visualized using feature parameters from different layers with t-SNE algorithm that reduces the dimension of the input parameters. The internal representation of the last feature extraction layer has been assessed using Class Activated Mapping (CAM). Further, the effect of motion blur on disease identification has been analysed using confusion matrix and CAM. For effective disease detection, it is required that the proposed quadcopter system is restricted to operate within certain limits. Finally, an insight on the future directions for improvement has been provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data availability

NIL.

Code availability

NIL.

References

  1. Abdulridha J, Ampatzidis Y, Kakarla SC, Roberts P (2019) Detection of target spot and bacterial spot diseases in tomato using UAV-based and benchtop-based hyperspectral imaging techniques. Precision Agric. https://doi.org/10.1007/s11119-019-09703-4

    Article  Google Scholar 

  2. Alsharif MH, Kelechi A, Yahya K, Chaudhry S (2020) Machine learning algorithms for smart data analysis in internet of things environment: taxonomies and research trends. Symmetry 12(1), Article ID: 88. https://doi.org/10.3390/sym12010088

  3. Barbedo JGA (2018) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91. https://doi.org/10.1016/j.biosystemseng.2018.05.013

    Article  Google Scholar 

  4. Bharati P, Pramanik A (2020) Deep learning rechniques—R-CNN to Mask R-CNN: A survey computational intelligence in pattern recognition, 657–668. https://doi.org/10.1007/978-981-13-9042-5_56

  5. Bohnenkamp D, Behmann J, Mahlein AK (2019) In-field detection of yellow rust in wheat on the ground canopy and UAV scale. Remote Sens 11: Article ID 2495. https://doi.org/10.3390/rs11212495

  6. Bouabdallah S, Siegwart R (2007) Full control of a quadrotor. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 153–158

  7. Carvajalino JMD, Alzate DE, Ramirez AA, Sepulveda JDS, Rojas AEF, Suarez MS (2018) Evaluating late blight severity in potato crops using unmanned aerial vehicles and machine learning algorithms. Remote Sens 10. https://doi.org/10.3390/rs10101513

  8. Cornia GA (1985) Farm size, land yields and the agricultural production function: An analysis for 15 developing countries. World Develop 13(4):513–534. https://doi.org/10.1016/0305-750X(85)90054-3

    Article  Google Scholar 

  9. Dadrasjavan F, Samadzadegan F, Pourazar SHS, Fazeli H (2019) UAV-based mulispectral imagery for fast citrus greening detection. J Plant Dis Protect 126:307–318. https://doi.org/10.1007/s41348-019-00234-8

    Article  Google Scholar 

  10. Das VK, Ganesh-Kumar A (2018) Farm size, livelihood diversification and farmer’s income in India. Decision 45:185–201. https://doi.org/10.1007/s40622-018-0177-9

    Article  Google Scholar 

  11. DeBoer JL, Huang IY, Grigoriadis V, Blackmore S (2020) Economics of robots and automation in field crop production. Precis Agric 21:278–299. https://doi.org/10.1007/s11119-019-09667-5

    Article  Google Scholar 

  12. Eastwood R, Lipton M, Newell A (2004) Farm size. Handbook of Agricultural Economics 4:3323–3397

  13. Food and Agriculture Organization of the United Nations (1997) FAOSTAT statistical database. FAO, Rome

  14. Gensheng H, Haoyu W, Yan Z, Mingzhu W (2019) A low shot learning method for tea leaf’s disease identification. Comput Electron Agric 163: Article ID 104852. https://doi.org/10.1016/j.compag.2019.104852

  15. Grammatikis PR, Sarigiannidis P, Lagkas T, Moscholios I (2020) A compilation of UAV applications for precision agriculture. Comput Netw 172, Article ID 107148. https://doi.org/10.1016/j.comnet.2020.107148

  16. Ha JG, Moon H, Kwak JT, Hassan SI, Dang M, Lee ON, Park HY (2017) Deep convolutional neural network for classifying Fusarium wilt of radish from unmanned aerial vehicles. J Appl Remote Sens 11(4):042621. https://doi.org/10.1117/1.JRS.11.042621

    Article  Google Scholar 

  17. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. pp 770–778

  18. Heltberg R (1998) Rural market imperfections and the farm size-productivity relationship: Evidence from Pakistan. World Develop 26(10):1807–1826. https://doi.org/10.1016/S0305-750X(98)00084-9

    Article  Google Scholar 

  19. Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2017) SqueezeNet:AlexNet-level accuracy with 50x parameters and < 0.5MB model size. arXiv: 1602.07360

  20. Jha K, Doshi A, Patel P, Shah M (2019) A comprehensive review on automation in agriculture using artifical intelligence. Artif Intell Agric 2:1–12. https://doi.org/10.1016/j.aiia.2019.05.004

    Article  Google Scholar 

  21. Jiang Z, Chen T, Li M (2018) Efficient deep learning inference on edge devices. ACM SysML

  22. Kalita DJ, Singh VP, Kumar V (2020) A survey on SVM hyper-parameters optimization techniques. Lecture Notes in Networks and Systems 100:243–256. https://doi.org/10.1007/978-981-15-2071-6_20

  23. Kerkech M, Hafiane A, Canals R (2018) Deep learning approach with colorimetric spaces and vegetation indices for vine diseases detection in UAV images. Comput Electron Agric 155:237–243. https://doi.org/10.1016/j.compag.2018.10.006

    Article  Google Scholar 

  24. Kerkech M, Hafiane A, Canals R (2020) Vine disease detection in UAV multispectral images using optimized image registration and deep learning segmentation approach. Comput Electron Agric 174: Article ID 105446. https://doi.org/10.1016/j.compag.2020.105446

  25. Liu P, Yu H, Cang S (2019) Adaptive neural network tracking control for underactuated systems with matched and mismatched disturbances. Nonlinear Dyn 98:1447–1464. https://doi.org/10.1007/s11071-019-05170-8

    Article  Google Scholar 

  26. Liu B, Zhang Y, He D, Li Y (2018) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10. https://doi.org/10.3390/sym10010011

  27. Lowder SK, Skoet J, Raney T (2016) The number, size and distribution of farms, smallholder farms and family farms worldwide. World Develop 87:16–29

    Article  Google Scholar 

  28. Lu J, Ehsani R, Shi Y, Abdulridha J, Castro A, Xu Y (2017) Field detection of anthracnose crown rot in strawberry using spectroscopy technology. Comput Electron Agric 135:289–299

    Article  Google Scholar 

  29. Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolution neural network. Neurocomputing 267:378–384. https://doi.org/10.1016/j.neucom.2017.06.023

    Article  Google Scholar 

  30. Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605

    MATH  Google Scholar 

  31. Mogili UR, Deepak BBVL (2018) Review on application of drone systems in precision agriculture. Procedia Comput Sci 133:502–509. https://doi.org/10.1016/j.procs.2018.07.063

    Article  Google Scholar 

  32. Mondino BE, Gajetti M (2017) Preliminary considerations about costs and potential market of remote sensing from UAV in the Italian viticulture context. Eur J Remote Sens 50(1):310–319. https://doi.org/10.1080/22797254.2017.1328269

    Article  Google Scholar 

  33. Pilli SK, Nallathambi B, George SJ, Diwanji V (2014) Eagrobot - A robot for early crop disease detection using image processing. IEEE International Conference on Electronics and Communication Systems, pp 1–6

  34. Polder G, Westeringh N, Kool J, Khan HA, Koostra G, Nieuwenhuizen A (2019) Automatic detection of Tulip Breaking Virus (TBV) using a deep convolutional neural network. Int Federation Automatic Control, 12–17. https://doi.org/10.1016/j.ifacol.2019.12.482

  35. Press Trust of India (2016) 91% land holding would belong to small farmers by 2030, Business Standard, Retrieved from http://www.business-standard.com. Accessed 22 Jul 2020

  36. Strange RN, Scott PR (2005) Plant disease: A threat to global food security. Annu Rev Phytopathol 43:83–116

    Article  Google Scholar 

  37. Sugiura R, Tsuda S, Tsuji H, Murakami N (2018) Virus-infected plant detection in potato seed production field by UAV imagery. ASABE 2018 Annual International Meeting. https://doi.org/10.13031/aim.201800594

  38. Sun L, Zhao C, Yan Z, Liu P, Duckett T, Stolkin R (2019) A novel weakly-supervised approach for RGB-D-based nuclear waste object detection. IEEE Sens J 19(9):3487–3500. https://doi.org/10.1109/JSEN.2018.2888815

    Article  Google Scholar 

  39. Tetila EC, Machado BB, Belete NAS, Guimaraes DA, Pistori H (2017) Identification of soybean foliar diseases using unmanned aerial vehicle images. IEEE Geosci Remote Sens Lett 14(12):2190–2194. https://doi.org/10.1109/LGRS.2017.2743715

    Article  Google Scholar 

  40. Tharwat A (2018) Classification assessment methods. Appl Comput Inform. https://doi.org/10.1016/j.aci.2018.08.003

    Article  Google Scholar 

  41. Tsouros DC, Bibi S, Sarigiannidis G (2019) A review on UAV-based applications for precision agriculture. Information 10. https://doi.org/10.3390/info10110349

  42. Wang A, Wang M, Jiang K, Cao M, Iwahori Y (2019) A dual neural architecture combined SqueezeNet with OctConv for LiDAR data classification. Sensors 19(22):4927. https://doi.org/10.3390/s19224927

    Article  Google Scholar 

  43. Yang Y, Yang R, Pan L, Ma J, Zhu Y, Diao T, Zhang L (2020) A lightweight deep learning algorithm for inspection of laser welding defects on safety vent of power battery. Comput Ind 123: Article ID 103306. https://doi.org/10.1016/j.compind.2020.103306

  44. Ye H, Huang W, Huang S, Cui B, Dong Y, Guo A, Ren Y, Jin Y (2020) Recognition of banana Fusarium wilt based on UAV remoted sensing. Remote Sens 12. https://doi.org/10.3390/rs12060938

  45. Zecha CW, Link J, Claupein W (2013) Mobile sensor platforms: categorisation and research applications in precision farming. J Sens Sens Syst 2:51–72. https://doi.org/10.5194/jsss-2-51-2013

    Article  Google Scholar 

  46. Zhang N, Wang M, Wang N (2002) Precision agriculture - a worldwide overview. Comput Electron Agric 36:113–132

    Article  Google Scholar 

  47. Zhang X, Han L, Dong Y, Shi Y, Huang W, Han L, Moreno PG, Ma H, Ye H, Sobieh (2019) A deep learning-based approach for automated yellow rust disease detection from high-resolution hyperspectral UAV images. Remote Sens 11: Article ID 1554. https://doi.org/10.3390/rs11131554

  48. Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2016) Learning deep features for discriminative localization. IEEE Conference on Computer Vision and Pattern Recognition, pp 2921–2929

  49. Zhou J, Zhou J, Ye H, Ali ML, Nguyen HT, Chen P (2020) Classification of soybean leaf wilting due to drought stress using UAV-based imagery. Comput Electron Agric 175: Article ID 105576. https://doi.org/10.1016/j.compag.2020.105576

Download references

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, SASTRA Deemed University, Thanjavur, 613401, Tamil Nadu, India

    Aravind Krishnaswamy Rangarajan, Edwin Jayaraj Balu, Muni Sekhar Boligala, Arjun Jagannath & Badri Narayanan Ranganathan

Authors
  1. Aravind Krishnaswamy Rangarajan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Edwin Jayaraj Balu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muni Sekhar Boligala
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arjun Jagannath
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Badri Narayanan Ranganathan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Badri Narayanan Ranganathan.

Ethics declarations

Conflicts of interest/Competing interests

The authors have no conflicts of interest to declare.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rangarajan, A.K., Balu, E.J., Boligala, M.S. et al. A low-cost UAV for detection of Cercospora leaf spot in okra using deep convolutional neural network. Multimed Tools Appl 81, 21565–21589 (2022). https://doi.org/10.1007/s11042-022-12464-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12464-4

Keywords

Search

Navigation