Abstract
Tailoring a deep convolutional neural network (CNN) for an implementation is a tedious and time-consuming task especially in image identification. In this study, an optimization scheme based on artificial bee colony (ABC) algorithm so-called optimal deep CNN (ODC) classifier for hyperparameter optimization of deep CNN is proposed for plant species identification. It is implemented to a ready-made leaf dataset namely Folio containing #637 images with 32 different plant species. The images are undergone various image preprocessing such as scaling, segmentation and augmentation so as to improve the efficacy of the ODC classifier. Therefore, the dataset is augmented from #637 to #15,288 leaf images whose #12,103 images is allocated for training phase and the remainder for testing the ODC. Moreover, a validation process on 20% of the training dataset is performed along with the training phase in both optimization and classification stages. The accuracy and loss performance of the ODC are examined over the training and validation results. The achieved ODC is verified through the test phase as well as by a comparison with the results in the literature in terms of performance evaluation metrics such as accuracy, sensitivity, specificity and F1-score. In order to further corroborate the proposed scheme, it is even subjected to a benchmark with optimization-based studies such as genetic, particle swarm and firefly algorithms through MNIST digit-image dataset. The ODC identifies the leaf images and digit-images with the best accuracy of 98.99% and 99.21% surpassing the state of the arts. Therefore, the proposed ODC is effective and useful in achieving an optimal CNN thanks to ABC algorithm.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akbarzadeh S, Paap A, Ahderom S et al (2018) Plant discrimination by Support Vector Machine classifier based on spectral reflectance. Comput Electron Agric 148:250–258. https://doi.org/10.1016/j.compag.2018.03.026
Anubha Pearline S, Sathiesh Kumar V, Harini S (2019) A study on plant recognition using conventional image processing and deep learning approaches. Journal of Intelligent and Fuzzy Systems. https://doi.org/10.3233/JIFS-169911
Arribas JI, Sánchez-Ferrero GV, Ruiz-Ruiz G, Gómez-Gil J (2011) Leaf classification in sunflower crops by computer vision and neural networks. Comput Electron Agric 78:9–18. https://doi.org/10.1016/j.compag.2011.05.007
Bacanin N, Bezdan T, Tuba E et al (2020) Optimizing convolutional neural network hyperparameters by enhanced swarm intelligence metaheuristics. Algorithms 13:67. https://doi.org/10.3390/a13030067
Bakhshipour A, Jafari A (2018) Evaluation of support vector machine and artificial neural networks in weed detection using shape features. Comput Electron Agric 145:153–160. https://doi.org/10.1016/j.compag.2017.12.032
Balootaki MA, Rahmani H, Moeinkhah H, Mohammadzadeh A (2020) On the Synchronization and Stabilization of fractional-order chaotic systems: recent advances and future perspectives. Phys A Stat Mech Appl 551:124203
Breiman L (2001) Random forests. Mach Learn 45:5–32. https://doi.org/10.1023/A:1010933404324
Carbas S, Toktas A, Ustun D (eds) (2021) Nature-ınspired metaheuristic algorithms for engineering optimization applications. Springer Singapore
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297. https://doi.org/10.1023/A:1022627411411
Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern SMC-6:325–327. https://doi.org/10.1109/TSMC.1976.5408784
Erkan U (2021) A precise and stable machine learning algorithm: eigenvalue classification (EigenClass). Neural Comput Appl 33(10):5381–5392. https://doi.org/10.1007/s00521-020-05343-2
Esgario JGM, Krohling RA, Ventura JA (2020) Deep learning for classification and severity estimation of coffee leaf biotic stress. Comput Electron Agric 169:105162. https://doi.org/10.1016/j.compag.2019.105162
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009
Grinblat GL, Uzal LC, Larese MG, Granitto PM (2016) Deep learning for plant identification using vein morphological patterns. Comput Electron Agric 127:418–424. https://doi.org/10.1016/j.compag.2016.07.003
Han D, Liu Q, Fan W (2018) A new image classification method using CNN transfer learning and web data augmentation. Expert Syst Appl 95:43–56. https://doi.org/10.1016/j.eswa.2017.11.028
Hassaballah M, Awad AI (2020) Deep learning in computer vision: principles and applications. CRC Press, NW
Hu R, Jia W, Ling H, Huang D (2012) Multiscale distance matrix for fast plant leaf recognition. IEEE Trans Image Process 21:4667–4672. https://doi.org/10.1109/TIP.2012.2207391
Ijjina EP, Chalavadi KM (2016) Human action recognition using genetic algorithms and convolutional neural networks. Pattern Recognit 59:199–212. https://doi.org/10.1016/j.patcog.2016.01.012
Joly A, Göeau H, Glotin H et al (2015) LifeCLEF 2015: multimedia life species identification challenges. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Springer Verlag, Cham, pp 462–483
Kadir A, Nugroho LE, Susanto A, Santosa PI (2011) Signal & image processing. An Int J. https://doi.org/10.5121/sipij.2011.2301
Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39:459–471. https://doi.org/10.1007/s10898-007-9149-x
Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42:21–57. https://doi.org/10.1007/s10462-012-9328-0
Kazmi W, Garcia-Ruiz F, Nielsen J et al (2015) Exploiting affine invariant regions and leaf edge shapes for weed detection. Comput Electron Agric 118:290–299. https://doi.org/10.1016/j.compag.2015.08.023
Kumar N, Belhumeur PN, Biswas A et al (2012) Leafsnap: a computer vision system for automatic plant species identification. European Conference on Computer Vision (ECCV). Springer Berlin Heidelberg, Berlin, Heidelberg, pp 502–516
LeCun Y, Cortes C, Burges CJC (2010) MNIST Handwritten Digit Database. In: AT&T Labs
Lee SH, Chan CS, Mayo SJ, Remagnino P (2017) How deep learning extracts and learns leaf features for plant classification. Pattern Recognit 71:1–13. https://doi.org/10.1016/j.patcog.2017.05.015
Lorena AC, Jacintho LFO, Siqueira MF et al (2011) Comparing machine learning classifiers in potential distribution modelling. Expert Syst Appl 38:5268–5275. https://doi.org/10.1016/j.eswa.2010.10.031
Maron ME (1960) Automatic indexing: an experimental inquiry. J ACM 8:404–414. https://doi.org/10.1145/321075.321084
McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–1333. https://doi.org/10.1007/BF02478259
Mehdipour Ghazi M, Yanikoglu B, Aptoula E (2017) Plant identification using deep neural networks via optimization of transfer learning parameters. Neurocomputing 235:228–235. https://doi.org/10.1016/j.neucom.2017.01.018
Mittal K, Jain A, Vaisla KS et al (2020) A comprehensive review on type 2 fuzzy logic applications: past, present and future. Eng Appl Artif Intell 95:103916. https://doi.org/10.1016/j.engappai.2020.103916
Mohammadzadeh A, Zhang W (2019) Dynamic programming strategy based on a type-2 fuzzy wavelet neural network. Nonlinear Dyn 95:1661–1672. https://doi.org/10.1007/s11071-018-4651-x
Mohammadzadeh A, Sabzalian MH, Zhang W (2020) An interval type-3 fuzzy system and a new online fractional-order learning algorithm: theory and practice. IEEE Trans Fuzzy Syst 28:1940–1950. https://doi.org/10.1109/TFUZZ.2019.2928509
Munisami T, Ramsurn M, Kishnah S, Pudaruth S (2015a) Folio Data Set UCI Machine Learning Repository. https://archive.ics.uci.edu/ml/datasets/Folio
Munisami T, Ramsurn M, Kishnah S, Pudaruth S (2015b) plant leaf recognition using shape features and colour histogram with K-nearest neighbour classifiers. Procedia Comput Sci 58:740–747. https://doi.org/10.1016/j.procs.2015.08.095
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66. https://doi.org/10.1109/TSMC.1979.4310076
Pacheco AGC, Krohling RA (2018) Aggregation of neural classifiers using Choquet integral with respect to a fuzzy measure. Neurocomputing 292:151–164. https://doi.org/10.1016/j.neucom.2018.03.002
Sewak M, Karim R, Pujari P (2018) Practical convolutional neural networks. Packt Publishing
Singh P, Chaudhury S, Panigrahi BK (2021) Hybrid MPSO-CNN: Multi-level Particle Swarm optimized hyperparameters of Convolutional Neural Network. Swarm Evol Comput 63:100863. https://doi.org/10.1016/j.swevo.2021.100863
Sladojevic S, Arsenovic M, Anderla A et al (2016) Deep neural networks based recognition of plant diseases by leaf image classification. Comput Intell Neurosci. https://doi.org/10.1155/2016/3289801
Söderkvist O (2001) Computer vision classification of leaves from swedish trees. Master’s Thesis, Linkoping University
Sui C, Bennamoun M, Togneri R (2017) Deep feature learning for dummies: a simple auto-encoder training method using Particle Swarm Optimisation. Pattern Recognit Lett 94:75–80. https://doi.org/10.1016/j.patrec.2017.03.021
Sun Y, Liu Y, Wang G, Zhang H (2017) Deep learning for plant identification in natural environment. Comput Intell Neurosci. https://doi.org/10.1155/2017/7361042
Toktas A (2021) Multi-objective design of multilayer microwave dielectric filters using artificial bee colony algorithm. In: Carbas S, Toktas A, Ustun D (eds) Nature-ınspired metaheuristic algorithms for engineering optimization applications. Springer Singapore
Toktas A, Ustun D (2020) A triple-objective optimization scheme using butterfly-integrated ABC algorithm for design of multilayer RAM. IEEE Trans Antennas Propag 68:5602–5612. https://doi.org/10.1109/TAP.2020.2981728
Toktas A, Ustun D, Tekbas M (2020) Global optimisation scheme based on triple-objective ABC algorithm for designing fully optimised multi-layer radar absorbing material. IET Microwaves Antennas Propag 14:800–811. https://doi.org/10.1049/iet-map.2019.0868
Wäldchen J, Mäder P (2018) Plant species identification using computer vision techniques: a systematic literature review. Arch Comput Methods Eng 25:507–543. https://doi.org/10.1007/s11831-016-9206-z
Wu SG, Bao FS, Xu EY et al (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. In: ISSPIT 2007-2007 IEEE ınternational symposium on signal processing and ınformation technology, pp 11–16
Yigit E, Sabanci K, Toktas A, Kayabasi A (2019) A study on visual features of leaves in plant identification using artificial intelligence techniques. Comput Electron Agric 156:369–377. https://doi.org/10.1016/j.compag.2018.11.036
Zhang S, Wang H, Huang W (2017) Two-stage plant species recognition by local mean clustering and Weighted sparse representation classification. Cluster Comput 20:1517–1525. https://doi.org/10.1007/s10586-017-0859-7
Zhang S, Zhang C, Wang Z, Kong W (2018a) Combining sparse representation and singular value decomposition for plant recognition. Appl Soft Comput J 67:164–171. https://doi.org/10.1016/j.asoc.2018.02.052
Zhang X, Qiao Y, Meng F et al (2018b) Identification of maize leaf diseases using improved deep convolutional neural networks. IEEE Access 6:30370–30377. https://doi.org/10.1109/ACCESS.2018.2844405
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Erkan, U., Toktas, A. & Ustun, D. Hyperparameter optimization of deep CNN classifier for plant species identification using artificial bee colony algorithm. J Ambient Intell Human Comput 14, 8827–8838 (2023). https://doi.org/10.1007/s12652-021-03631-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-021-03631-w