Skip to main content
SpringerLink
Log in

Tipburn disorder detection in strawberry leaves using convolutional neural networks and particle swarm optimization

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Tipburn is a disorder that is caused by calcium deficiency in plants and may lead to decrements in crop yield. Therefore, it is important to detect tipburn for an appropriate treatment process. In this work, a sequential convolutional neural network (CNN) architecture was developed for tipburn detection in images of strawberry leaves. The parameters of the CNN architecture as well as the dropout and learning rates were determined through a two-stage search operation based on particle swarm optimization (PSO) algorithm. The resulting model, PSO-CNN, contains five convolutional layers and three fully-connected layers with varying number of filters and hidden units. The model development was performed using an original dataset of strawberry leaf images taken from the field under realistic conditions and has been made publicly available with this study. The performance of the PSO-CNN was compared with the performance of eight different benchmark CNN models, namely, VGG16, VGG19, MobileNetV2, EfficientNet, ResNetV2, NasNetMobile, InceptionV3 and InceptionResNetV2. According to the results obtained by ten independent re-runs of the classification task, PSO-CNN achieved the best average performance by 0.9895, 0.9863, and 0.9936 for accuracy, sensitivity, and specificity values, respectively. In addition, the number of parameters of the PSO-CNN model is smaller than those in the benchmark models. This means that PSO-CNN model requires relatively less amount of computation for an efficient model training and performing prediction on the test images. Finally, further experiments were performed on a multi-class problem to demonstrate the effectiveness of the PSO-CNN for tipburn detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Abdullahi HS, Sheriff R, Mahieddine F (2017) Convolution neural network in precision agriculture for plant image recognition and classification. In: 2017 seventh international conference on innovative computing technology (INTECH). IEEE

    Google Scholar 

  2. Amara J, Bouaziz B, Algergawy A (2017) A deep learning-based approach for banana leaf diseases classification. Datenbanksysteme für Business, Technologie und Web (BTW 2017)-Workshopband

  3. Atabay HA (2017) Deep Residual Learning for Tomato Plant Leaf Disease Identification. Journal of Theoretical & Applied Information Technology 95(24)

  4. Atila Ü, Uçar M, Akyol K, Uçar E (2021) Plant leaf disease classification using EfficientNet deep learning model. Ecol Inform 61:101182

    Article  Google Scholar 

  5. Atlantic Working Group for Pest Management Education and Training Standards, Landscape Safety Manual (Chapter 8) (2005) Newfoundland, Canada, The Queen's Printer, ISBN: 1-55146-294-X

  6. Barbedo JGA (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107

    Article  Google Scholar 

  7. Bárcena A, Graciano C, Luca T, Guiamet JJ, Costa L (2019) Shade cloths and polyethylene covers have opposite effects on tipburn development in greenhouse grown lettuce. Sci Hortic 249:93–99

    Article  Google Scholar 

  8. Durmuş H, Güneş EO, Kırcı M (2017) Disease detection on the leaves of the tomato plants by using deep learning. In: 2017 6th international conference on agro-Geoinformatics. IEEE

    Google Scholar 

  9. Dyrmann M, Karstoft H, Midtiby HS (2016) Plant species classification using deep convolutional neural network. Biosyst Eng 151:72–80

    Article  Google Scholar 

  10. Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318

    Article  Google Scholar 

  11. Geetharamani G, Pandian JA (2019) Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput Electr Eng 76:323–338

    Article  Google Scholar 

  12. Hariri M, Avşar E, Sarıdaş MA (2021) Image dataset for Tipburn disorder detection in strawberry leaves. 2021; Available from: https://data.mendeley.com/datasets/trwfmgjjr6/1

  13. He K et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Google Scholar 

  14. Hughes D, Salathé M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint arXiv:1511.08060

  15. Joly A et al (2017) Lifeclef 2017 lab overview: multimedia species identification challenges. In: International conference of the cross-language evaluation forum for European languages. Springer

    Google Scholar 

  16. Kaya A, Keceli AS, Catal C, Yalic HY, Temucin H, Tekinerdogan B (2019) Analysis of transfer learning for deep neural network based plant classification models. Comput Electron Agric 158:20–29

    Article  Google Scholar 

  17. Kc K et al (2019) Depthwise separable convolution architectures for plant disease classification. Comput Electron Agric 165:104948

    Article  Google Scholar 

  18. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedzings of ICNN'95-international conference on neural networks. IEEE

    Google Scholar 

  19. Khan S, Narvekar M (2020) Disorder detection of tomato plant (solanum lycopersicum) using IoT and machine learning. In: Journal of physics: conference series. IOP Publishing

    Google Scholar 

  20. Khan S, Narvekar M (2020) Disorder detection in tomato plant using deep learning. In: Advanced computing technologies and applications. Springer, pp 187–197

    Chapter  Google Scholar 

  21. Kim B et al (2021) Improved vision-based detection of strawberry diseases using a deep neural network. Front Plant Sci 11:2040

    Article  Google Scholar 

  22. Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980

  23. Kuronuma T et al (2018) Tipburn severity and calcium distribution in lisianthus (Eustoma Grandiflorum (Raf.) Shinn.) cultivars under different relative air humidity conditions. Agronomy 8(10):218

    Article  Google Scholar 

  24. Liu B, Zhang Y, He DJ, Li Y (2018) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10(1):11

    Article  Google Scholar 

  25. Lu J, Hu J, Zhao G, Mei F, Zhang C (2017) An in-field automatic wheat disease diagnosis system. Comput Electron Agric 142:369–379

    Article  Google Scholar 

  26. Melis P et al (2012) Preventing tipburn on strawberry cultivar'Clery'. In: VII International Strawberry Symposium 1049

    Google Scholar 

  27. Mikołajczyk A, Grochowski M (2018) Data augmentation for improving deep learning in image classification problem. In: 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE

    Google Scholar 

  28. Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419

    Article  Google Scholar 

  29. Moore KA, Bradley LK (2018) North Carolina extension gardener handbook (chapter 5). The University of North Carolina Press, North Carolina, USA ISBN: 978-1-4696-4125-6

    Google Scholar 

  30. Nie X, Wang L, Ding H, Xu M (2019) Strawberry verticillium wilt detection network based on multi-task learning and attention. IEEE Access 7:170003–170011

    Article  Google Scholar 

  31. Olle M, Williams IH (2017) Physiological disorders in tomato and some methods to avoid them. J Hortic Sci Biotechnol 92(3):223–230

    Article  Google Scholar 

  32. Palencia P, Martinez F, Ribeiro E, Pestana M, Gama F, Saavedra T, de Varennes A, Correia PJ (2010) Relationship between tipburn and leaf mineral composition in strawberry. Sci Hortic 126(2):242–246

    Article  Google Scholar 

  33. Park H, JeeSook E, Kim SH (2018) Crops disease diagnosing using image-based deep learning mechanism. In: 2018 international conference on computing and network communications (CoCoNet). IEEE

    Google Scholar 

  34. Picon A, Alvarez-Gila A, Seitz M, Ortiz-Barredo A, Echazarra J, Johannes A (2019) Deep convolutional neural networks for mobile capture device-based crop disease classification in the wild. Comput Electron Agric 161:280–290

    Article  Google Scholar 

  35. Rahnemoonfar M, Sheppard C (2017) Deep count: fruit counting based on deep simulated learning. Sensors 17(4):905

    Article  Google Scholar 

  36. Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes DP (2017) Deep learning for image-based cassava disease detection. Front Plant Sci 8:1852

    Article  Google Scholar 

  37. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  38. Sandler M et al (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Google Scholar 

  39. Shin J, Chang YK, Heung B, Nguyen-Quang T, Price GW, al-Mallahi A (2021) A deep learning approach for RGB image-based powdery mildew disease detection on strawberry leaves. Comput Electron Agric 183:106042

    Article  Google Scholar 

  40. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  41. Singh R, Athisayamani S (2020) Banana leaf diseased image classification using novel HEAP auto encoder (HAE) deep learning. Multimed Tools Appl:1–13

  42. Singh UP, Chouhan SS, Jain S, Jain S (2019) Multilayer convolution neural network for the classification of mango leaves infected by anthracnose disease. IEEE Access 7:43721–43729

    Article  Google Scholar 

  43. Sladojevic S, Arsenovic M, Anderla A, Culibrk D, Stefanovic D (2016) Deep neural networks based recognition of plant diseases by leaf image classification. Comput Intell Neurosci 2016:3289801–3289811

    Article  Google Scholar 

  44. Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Google Scholar 

  45. Szegedy C et al (2016) Inception-v4, inception-resnet and the impact of residual connections on learning. arXiv preprint arXiv:1602.07261

  46. Tan M, Le QV (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. arXiv preprint arXiv:1905.11946

  47. Too EC, Yujian L, Njuki S, Yingchun L (2019) A comparative study of fine-tuning deep learning models for plant disease identification. Comput Electron Agric 161:272–279

    Article  Google Scholar 

  48. Uğuz S, Uysal N (2021) Classification of olive leaf diseases using deep convolutional neural networks. Neural Comput & Applic 33(9):4133–4149

    Article  Google Scholar 

  49. Vaishnnave MP, Devi KS, Ganeshkumar P (2020) Automatic method for classification of groundnut diseases using deep convolutional neural network. Soft Comput 24(21):16347–16360

    Article  Google Scholar 

  50. Xiao J-R, Chung PC, Wu HY, Phan QH, Yeh JLA, Hou MTK (2021) Detection of strawberry diseases using a convolutional neural network. Plants 10(1):31

    Article  Google Scholar 

  51. Yalcin H, Razavi S (2016) Plant classification using convolutional neural networks. In: 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics).

    Google Scholar 

  52. Zoph B, Le QV (2016) Neural architecture search with reinforcement learning. arXiv preprint arXiv:1611.01578.

Download references

Acknowledgements

Authors would like to thank Dr. Mehmet Ali Sarıdaş from Horticulture Department of Cukurova University for his help during this study.

Author information

Authors and Affiliations

  1. Electrical and Electronics Engineering Department, Çukurova University, 01330, Adana, Turkey

    Muhab Hariri

  2. Computer Engineering Department, Dokuz Eylül University, 35390, İzmir, Turkey

    Ercan Avşar

Authors
  1. Muhab Hariri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ercan Avşar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ercan Avşar.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hariri, M., Avşar, E. Tipburn disorder detection in strawberry leaves using convolutional neural networks and particle swarm optimization. Multimed Tools Appl 81, 11795–11822 (2022). https://doi.org/10.1007/s11042-022-12759-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12759-6

Keywords

Search

Navigation