Abstract
Artificial Intelligence (AI)-enabled agricultural robotics is expected to significantly disrupt the domain of agriculture with promise of profitable farming. However, significant challenges exist while deploying such technologies in economically backward countries in a cost-effective manner that can ensure profitability. This study focusses on identification of Cercospora Leaf Spot (CLS) disease in the okra plant, which is also referred to as lady’s finger or Abelmoschus esculentus L. The disease is identified by using deep learning models on images acquired using a modified cost-effective quadcopter fitted with a camera. Two deep learning models, namely SqueezeNet and ResNet-18, were used for this study with a validation accuracy of 99.1% and 99% respectively. Testing of the models with the images collected using the modified quadcopter produced an accuracy of 92.3% and 94.6% respectively. The misclassifications have been analysed using confusion matrices and possible reasons affecting the classification process are discussed. In addition, the learning process has been visualized using feature parameters from different layers with t-SNE algorithm that reduces the dimension of the input parameters. The internal representation of the last feature extraction layer has been assessed using Class Activated Mapping (CAM). Further, the effect of motion blur on disease identification has been analysed using confusion matrix and CAM. For effective disease detection, it is required that the proposed quadcopter system is restricted to operate within certain limits. Finally, an insight on the future directions for improvement has been provided.
Similar content being viewed by others
Data availability
NIL.
Code availability
NIL.
References
Abdulridha J, Ampatzidis Y, Kakarla SC, Roberts P (2019) Detection of target spot and bacterial spot diseases in tomato using UAV-based and benchtop-based hyperspectral imaging techniques. Precision Agric. https://doi.org/10.1007/s11119-019-09703-4
Alsharif MH, Kelechi A, Yahya K, Chaudhry S (2020) Machine learning algorithms for smart data analysis in internet of things environment: taxonomies and research trends. Symmetry 12(1), Article ID: 88. https://doi.org/10.3390/sym12010088
Barbedo JGA (2018) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91. https://doi.org/10.1016/j.biosystemseng.2018.05.013
Bharati P, Pramanik A (2020) Deep learning rechniques—R-CNN to Mask R-CNN: A survey computational intelligence in pattern recognition, 657–668. https://doi.org/10.1007/978-981-13-9042-5_56
Bohnenkamp D, Behmann J, Mahlein AK (2019) In-field detection of yellow rust in wheat on the ground canopy and UAV scale. Remote Sens 11: Article ID 2495. https://doi.org/10.3390/rs11212495
Bouabdallah S, Siegwart R (2007) Full control of a quadrotor. IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 153–158
Carvajalino JMD, Alzate DE, Ramirez AA, Sepulveda JDS, Rojas AEF, Suarez MS (2018) Evaluating late blight severity in potato crops using unmanned aerial vehicles and machine learning algorithms. Remote Sens 10. https://doi.org/10.3390/rs10101513
Cornia GA (1985) Farm size, land yields and the agricultural production function: An analysis for 15 developing countries. World Develop 13(4):513–534. https://doi.org/10.1016/0305-750X(85)90054-3
Dadrasjavan F, Samadzadegan F, Pourazar SHS, Fazeli H (2019) UAV-based mulispectral imagery for fast citrus greening detection. J Plant Dis Protect 126:307–318. https://doi.org/10.1007/s41348-019-00234-8
Das VK, Ganesh-Kumar A (2018) Farm size, livelihood diversification and farmer’s income in India. Decision 45:185–201. https://doi.org/10.1007/s40622-018-0177-9
DeBoer JL, Huang IY, Grigoriadis V, Blackmore S (2020) Economics of robots and automation in field crop production. Precis Agric 21:278–299. https://doi.org/10.1007/s11119-019-09667-5
Eastwood R, Lipton M, Newell A (2004) Farm size. Handbook of Agricultural Economics 4:3323–3397
Food and Agriculture Organization of the United Nations (1997) FAOSTAT statistical database. FAO, Rome
Gensheng H, Haoyu W, Yan Z, Mingzhu W (2019) A low shot learning method for tea leaf’s disease identification. Comput Electron Agric 163: Article ID 104852. https://doi.org/10.1016/j.compag.2019.104852
Grammatikis PR, Sarigiannidis P, Lagkas T, Moscholios I (2020) A compilation of UAV applications for precision agriculture. Comput Netw 172, Article ID 107148. https://doi.org/10.1016/j.comnet.2020.107148
Ha JG, Moon H, Kwak JT, Hassan SI, Dang M, Lee ON, Park HY (2017) Deep convolutional neural network for classifying Fusarium wilt of radish from unmanned aerial vehicles. J Appl Remote Sens 11(4):042621. https://doi.org/10.1117/1.JRS.11.042621
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition. pp 770–778
Heltberg R (1998) Rural market imperfections and the farm size-productivity relationship: Evidence from Pakistan. World Develop 26(10):1807–1826. https://doi.org/10.1016/S0305-750X(98)00084-9
Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2017) SqueezeNet:AlexNet-level accuracy with 50x parameters and < 0.5MB model size. arXiv: 1602.07360
Jha K, Doshi A, Patel P, Shah M (2019) A comprehensive review on automation in agriculture using artifical intelligence. Artif Intell Agric 2:1–12. https://doi.org/10.1016/j.aiia.2019.05.004
Jiang Z, Chen T, Li M (2018) Efficient deep learning inference on edge devices. ACM SysML
Kalita DJ, Singh VP, Kumar V (2020) A survey on SVM hyper-parameters optimization techniques. Lecture Notes in Networks and Systems 100:243–256. https://doi.org/10.1007/978-981-15-2071-6_20
Kerkech M, Hafiane A, Canals R (2018) Deep learning approach with colorimetric spaces and vegetation indices for vine diseases detection in UAV images. Comput Electron Agric 155:237–243. https://doi.org/10.1016/j.compag.2018.10.006
Kerkech M, Hafiane A, Canals R (2020) Vine disease detection in UAV multispectral images using optimized image registration and deep learning segmentation approach. Comput Electron Agric 174: Article ID 105446. https://doi.org/10.1016/j.compag.2020.105446
Liu P, Yu H, Cang S (2019) Adaptive neural network tracking control for underactuated systems with matched and mismatched disturbances. Nonlinear Dyn 98:1447–1464. https://doi.org/10.1007/s11071-019-05170-8
Liu B, Zhang Y, He D, Li Y (2018) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10. https://doi.org/10.3390/sym10010011
Lowder SK, Skoet J, Raney T (2016) The number, size and distribution of farms, smallholder farms and family farms worldwide. World Develop 87:16–29
Lu J, Ehsani R, Shi Y, Abdulridha J, Castro A, Xu Y (2017) Field detection of anthracnose crown rot in strawberry using spectroscopy technology. Comput Electron Agric 135:289–299
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolution neural network. Neurocomputing 267:378–384. https://doi.org/10.1016/j.neucom.2017.06.023
Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605
Mogili UR, Deepak BBVL (2018) Review on application of drone systems in precision agriculture. Procedia Comput Sci 133:502–509. https://doi.org/10.1016/j.procs.2018.07.063
Mondino BE, Gajetti M (2017) Preliminary considerations about costs and potential market of remote sensing from UAV in the Italian viticulture context. Eur J Remote Sens 50(1):310–319. https://doi.org/10.1080/22797254.2017.1328269
Pilli SK, Nallathambi B, George SJ, Diwanji V (2014) Eagrobot - A robot for early crop disease detection using image processing. IEEE International Conference on Electronics and Communication Systems, pp 1–6
Polder G, Westeringh N, Kool J, Khan HA, Koostra G, Nieuwenhuizen A (2019) Automatic detection of Tulip Breaking Virus (TBV) using a deep convolutional neural network. Int Federation Automatic Control, 12–17. https://doi.org/10.1016/j.ifacol.2019.12.482
Press Trust of India (2016) 91% land holding would belong to small farmers by 2030, Business Standard, Retrieved from http://www.business-standard.com. Accessed 22 Jul 2020
Strange RN, Scott PR (2005) Plant disease: A threat to global food security. Annu Rev Phytopathol 43:83–116
Sugiura R, Tsuda S, Tsuji H, Murakami N (2018) Virus-infected plant detection in potato seed production field by UAV imagery. ASABE 2018 Annual International Meeting. https://doi.org/10.13031/aim.201800594
Sun L, Zhao C, Yan Z, Liu P, Duckett T, Stolkin R (2019) A novel weakly-supervised approach for RGB-D-based nuclear waste object detection. IEEE Sens J 19(9):3487–3500. https://doi.org/10.1109/JSEN.2018.2888815
Tetila EC, Machado BB, Belete NAS, Guimaraes DA, Pistori H (2017) Identification of soybean foliar diseases using unmanned aerial vehicle images. IEEE Geosci Remote Sens Lett 14(12):2190–2194. https://doi.org/10.1109/LGRS.2017.2743715
Tharwat A (2018) Classification assessment methods. Appl Comput Inform. https://doi.org/10.1016/j.aci.2018.08.003
Tsouros DC, Bibi S, Sarigiannidis G (2019) A review on UAV-based applications for precision agriculture. Information 10. https://doi.org/10.3390/info10110349
Wang A, Wang M, Jiang K, Cao M, Iwahori Y (2019) A dual neural architecture combined SqueezeNet with OctConv for LiDAR data classification. Sensors 19(22):4927. https://doi.org/10.3390/s19224927
Yang Y, Yang R, Pan L, Ma J, Zhu Y, Diao T, Zhang L (2020) A lightweight deep learning algorithm for inspection of laser welding defects on safety vent of power battery. Comput Ind 123: Article ID 103306. https://doi.org/10.1016/j.compind.2020.103306
Ye H, Huang W, Huang S, Cui B, Dong Y, Guo A, Ren Y, Jin Y (2020) Recognition of banana Fusarium wilt based on UAV remoted sensing. Remote Sens 12. https://doi.org/10.3390/rs12060938
Zecha CW, Link J, Claupein W (2013) Mobile sensor platforms: categorisation and research applications in precision farming. J Sens Sens Syst 2:51–72. https://doi.org/10.5194/jsss-2-51-2013
Zhang N, Wang M, Wang N (2002) Precision agriculture - a worldwide overview. Comput Electron Agric 36:113–132
Zhang X, Han L, Dong Y, Shi Y, Huang W, Han L, Moreno PG, Ma H, Ye H, Sobieh (2019) A deep learning-based approach for automated yellow rust disease detection from high-resolution hyperspectral UAV images. Remote Sens 11: Article ID 1554. https://doi.org/10.3390/rs11131554
Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2016) Learning deep features for discriminative localization. IEEE Conference on Computer Vision and Pattern Recognition, pp 2921–2929
Zhou J, Zhou J, Ye H, Ali ML, Nguyen HT, Chen P (2020) Classification of soybean leaf wilting due to drought stress using UAV-based imagery. Comput Electron Agric 175: Article ID 105576. https://doi.org/10.1016/j.compag.2020.105576
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest/Competing interests
The authors have no conflicts of interest to declare.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rangarajan, A.K., Balu, E.J., Boligala, M.S. et al. A low-cost UAV for detection of Cercospora leaf spot in okra using deep convolutional neural network. Multimed Tools Appl 81, 21565–21589 (2022). https://doi.org/10.1007/s11042-022-12464-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12464-4