Abstract
Underwater image classification is a challenging task because of challenging underwater environment and lighting conditions. We propose a novel learning classifier system (LCS), which can classify large-size underwater images with promising accuracy, and acquire knowledge in interpretable format, by using a novel classification convolution autoencoder (CCAE). In proposed system, CCAE is designed as a hybrid network, which combines benefits of classification and autoencoder, to extract compressed non-trivial features. It is also used to decompress LCS generated rules to original input space. In order to evaluate effectiveness of proposed solution, experiments are conducted on selected underwater synsets of benchmark ImageNet dataset. Results are compared with famous CNN methods based on parameters such as accuracy, precision, recall and F-measure. Experiments show that proposed system can accurately classify large-size underwater images with promising accuracy and outperforms well-known deep CNN methods. It has also been observed that LCS generated rules are well generalized, accurate and interpretable.
Similar content being viewed by others
References
Arif MH, Li J, Iqbal M, Liu K (2018) Sentiment analysis and spam detection in short informal text using learning classifier systems. Soft Comput 22(21):7281–7291
Arif MH, Iqbal M, Li J (2019) Extracting and reusing blocks of knowledge in learning classifier systems for text classification: a lifelong machine learning approach. Soft Comput 23:12673–12682. https://doi.org/10.1007/s00500-019-03819-5
Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495
Baldi P (2011) Autoencoders, unsupervised learning and deep architectures. In: Proceedings of the 2011 international conference on unsupervised and transfer learning workshop—volume 27, JMLR.org, UTLW’11, pp 37–50
Bu SJ, Cho SB (2020) A convolutional neural-based learning classifier system for detecting database intrusion via insider attack. Inf Sci 512:123–136
Butz MV, Wilson SW (2002) An algorithmic description of XCS. Soft Comput 6(3):144–153
Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848
Debie ES, Shafi KM (2017) Implications of the curse of dimensionality for supervised learning classifier systems: theoretical and empirical analyses. Pattern Anal Appl 22:519–536
Dong Y, Zhang Z, Hong WC (2018) A hybrid seasonal mechanism with a chaotic cuckoo search algorithm with a support vector regression model for electric load forecasting. Energies 11(4):1009. https://www.mdpi.com/1996-1073/11/4/1009
Dumoulin V, Visin F (2016) A guide to convolution arithmetic for deep learning. CoRR. arXiv:1603.07285
Fredivianus N, Kara K, Schmeck H (2012) Stay real!: XCS with rule combining for real values. In: Genetic and evolutionary computation conference, GECCO’12, Philadelphia, PA, USA, July 7–11, 2012, companion material proceedings, pp 1493–1494
Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding. Neurocomputing 187(C):27–48
Hinton G, Salakhutdinov R (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Hong WC, Li MW, Geng J, Zhang Y (2019) Novel chaotic bat algorithm for forecasting complex motion of floating platforms. Appl Math Model 72:425–443. https://doi.org/10.1016/j.apm.2019.03.031
Iqbal M, Browne WN, Zhang M (2013) Evolving optimum populations with XCS classifier systems—XCS with code fragmented action. Soft Comput 17(3):503–518
Iqbal M, Browne WN, Zhang M (2014) Reusing building blocks of extracted knowledge to solve complex, large-scale Boolean problems. IEEE Trans Evol Comput 18(4):465–480
Iqbal M, Browne WN, Zhang M (2015) Improving genetic search in XCS-based classifier systems through understanding the evolvability of classifier rules. Soft Comput 19(7):1863–1880
Iqbal M, Naqvi SS, Browne WN, Hollitt C, Zhang M (2016) Learning feature fusion strategies for various image types to detect salient objects. Pattern Recognit 60:106–120
Irfan M, Zheng J, Iqbal M, Arif MH (2020) A novel feature extraction model to enhance underwater image classification. Intelligent Computing Systems. Springer International Publishing, Cham, pp 78–91
Jin L, Liang H (2017) Deep learning for underwater image recognition in small sample size situations. In: OCEANS 2017, Aberdeen, pp 1–4
Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. CoRR. arXiv:1412.6980
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems, vol 25, Curran Associates, Inc., pp 1097–1105
Lanzi PL, Loiacono D (2007) Classifier systems that compute action mappings. In: Proceedings of the 9th annual conference on genetic and evolutionary computation, GECCO’07. ACM, New York, pp 1822–1829
Lopez-Vazquez V, Lopez-Guede JM, Marini S, Fanelli E, Johnsen E, Aguzzi J (2020) Video image enhancement and machine learning pipeline for underwater animal detection and classification at cabled observatories. Sensors 20(3)
Luo W, Li J, Yang J, Xu WJ, Zhang J (2018) Convolutional sparse autoencoders for image classification. IEEE Trans Neural Netw Learn Syst 29:3289–3294
Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: ICML workshop on deep learning for audio, speech and language processing
Mahmood A, Bennamoun M, An S, Sohel F, Boussaid F (2020) ResFeats: residual network based features for underwater image classification. Image Vis Comput 93:103811
Matsumoto K, Tajima Y, Saito R, Nakata M, Sato H, Kovacs T, Takadama K (2016) Learning classifier system with deep autoencoder. In: CEC. IEEE, pp 4739–4746
Matsumoto K, Takano R, Tatsumi T, Sato H, Kovacs T, Takadama K (2018) XCSR based on compressed input by deep neural network for high dimensional data. In: GECCO (Companion). ACM, pp 1418–1425
Nakata M, Lanzi PL, Kovacs T, Browne WN, Takadama K (2015) How should learning classifier systems cover a state-action space? In: CEC. IEEE, pp 3012–3019
Nakata M, Browne W, Hamagami T, Takadama K (2017) Theoretical XCS parameter settings of learning accurate classifiers. In: Proceedings of the genetic and evolutionary computation conference, association for computing machinery, GECCO’17, New York, NY, USA, pp 473–480. https://doi.org/10.1145/3071178.3071200
Noh H, Hong S, Han B (2015) Learning deconvolution network for semantic segmentation. In: Proceedings of the 2015 IEEE international conference on computer vision (ICCV), IEEE Computer Society, Washington, DC, USA, ICCV’15, pp 1520–1528
Qin H, Li X, Liang J, Peng Y, Zhang C (2016) Deepfish. Neurocomputing 187(C):49–58
Sabzehzar A, Shan WL, Panahi MS, Saremi O (2015) An improved extended classifier system for the real-time-input real-time-output (XCSRR) stability control of a biped robot. In: Complex adaptive systems, Elsevier, Procedia computer science, vol 61, pp 492–499
Santurkar S, Tsipras D, Ilyas A, Madry A (2018) How does batch normalization help optimization? In: Bengio S, Wallach H, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems, vol 31, Curran Associates, Inc., pp 2483–2493
Schettini R, Corchs S (2010) Underwater image processing: State of the art of restoration and image enhancement methods. EURASIP J Adv Signal Process 1:746052
Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: Visual explanations from deep networks via gradient-based localization. In: The IEEE international conference on computer vision (ICCV)
Siddiqui SA, Salman A, Malik MI, Shafait F, Mian A, Shortis MR, Harvey ES (2017) Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data. ICES J Mar Sci 75(1):374–389
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015, conference track proceedings. arXiv:1409.1556
Stein A, Rauh D, Tomforde S, Hähner J (2017) Interpolation in the eXtended classifier system: an architectural perspective. Elsevier J Syst Archit 75:79–94
Szegedy C, Liu W, Jia Y, Sermanet P, Reed SE, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 1–9
Tadokoro M, Hasegawa S, Tatsumi T, Sato H, Takadama K (2019) Knowledge extraction from XCSR based on dimensionality reduction and deep generative models, pp 1883–189. https://doi.org/10.1109/CEC.2019.8790119
Urbanowicz RJ, Moore JH (2009) Learning classifier systems: a complete introduction, review, and roadmap. J Artif Evol Appl 1(1-1):25
Valev K, Schumann A, Sommer LW, Beyerer J (2018) A systematic evaluation of recent deep learning architectures for fine-grained vehicle classification. CoRR 10649:1–11. https://doi.org/10.1117/12.2305062
Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th international conference on machine learning, ICML’08, ACM, New York, NY, USA, pp 1096–1103
Wang X, Ouyang J, Li D, Zhang G (2019) Underwater object recognition based on deep encoding-decoding network. J Ocean Univ China 18(2):376–382. https://doi.org/10.1007/s11802-019-3858-x
Xiong Q, Zhang X, Xu X, He S (2021) A modified chaotic binary particle swarm optimization scheme and its application in face-iris multimodal biometric identification. Electronics 10(2). https://doi.org/10.3390/electronics10020217
Xu Y, Zhang Y, Wang H, Liu X (2017) Underwater image classification using deep convolutional neural networks and data augmentation. In: 2017 IEEE international conference on signal processing, communications and computing (ICSPCC), pp 1–5
Xue B, Zhang M, Browne WN (2015) A comprehensive comparison on evolutionary feature selection approaches to classification. Int J Comput Intell Appl 14
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Computer vision—ECCV 2014—13th European conference, Zurich, Switzerland, September 6–12, 2014, Proceedings, Part I, pp 818–833
Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: The IEEE conference on computer vision and pattern recognition (CVPR)
Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107–1136. https://doi.org/10.1007/s11071-019-05252-7
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Muhammad Irfan declares that he has no conflict of interest. Zheng Jiangbin declares that he has no conflict of interest. Muhammad Iqbal declares that he has no conflict of interest. Muhammad Hassan Arif declares that he has no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Irfan, M., Jiangbin, Z., Iqbal, M. et al. Enhancing learning classifier systems through convolutional autoencoder to classify underwater images. Soft Comput 25, 10423–10440 (2021). https://doi.org/10.1007/s00500-021-05738-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-021-05738-w