Skip to main content
Log in

Enhancing learning classifier systems through convolutional autoencoder to classify underwater images

  • Application of soft computing
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Underwater image classification is a challenging task because of challenging underwater environment and lighting conditions. We propose a novel learning classifier system (LCS), which can classify large-size underwater images with promising accuracy, and acquire knowledge in interpretable format, by using a novel classification convolution autoencoder (CCAE). In proposed system, CCAE is designed as a hybrid network, which combines benefits of classification and autoencoder, to extract compressed non-trivial features. It is also used to decompress LCS generated rules to original input space. In order to evaluate effectiveness of proposed solution, experiments are conducted on selected underwater synsets of benchmark ImageNet dataset. Results are compared with famous CNN methods based on parameters such as accuracy, precision, recall and F-measure. Experiments show that proposed system can accurately classify large-size underwater images with promising accuracy and outperforms well-known deep CNN methods. It has also been observed that LCS generated rules are well generalized, accurate and interpretable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  • Arif MH, Li J, Iqbal M, Liu K (2018) Sentiment analysis and spam detection in short informal text using learning classifier systems. Soft Comput 22(21):7281–7291

    Article  Google Scholar 

  • Arif MH, Iqbal M, Li J (2019) Extracting and reusing blocks of knowledge in learning classifier systems for text classification: a lifelong machine learning approach. Soft Comput 23:12673–12682. https://doi.org/10.1007/s00500-019-03819-5

    Article  Google Scholar 

  • Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495

    Article  Google Scholar 

  • Baldi P (2011) Autoencoders, unsupervised learning and deep architectures. In: Proceedings of the 2011 international conference on unsupervised and transfer learning workshop—volume 27, JMLR.org, UTLW’11, pp 37–50

  • Bu SJ, Cho SB (2020) A convolutional neural-based learning classifier system for detecting database intrusion via insider attack. Inf Sci 512:123–136

    Article  Google Scholar 

  • Butz MV, Wilson SW (2002) An algorithmic description of XCS. Soft Comput 6(3):144–153

    Article  Google Scholar 

  • Chen L, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    Article  Google Scholar 

  • Debie ES, Shafi KM (2017) Implications of the curse of dimensionality for supervised learning classifier systems: theoretical and empirical analyses. Pattern Anal Appl 22:519–536

    Article  MathSciNet  Google Scholar 

  • Dong Y, Zhang Z, Hong WC (2018) A hybrid seasonal mechanism with a chaotic cuckoo search algorithm with a support vector regression model for electric load forecasting. Energies 11(4):1009. https://www.mdpi.com/1996-1073/11/4/1009

  • Dumoulin V, Visin F (2016) A guide to convolution arithmetic for deep learning. CoRR. arXiv:1603.07285

  • Fredivianus N, Kara K, Schmeck H (2012) Stay real!: XCS with rule combining for real values. In: Genetic and evolutionary computation conference, GECCO’12, Philadelphia, PA, USA, July 7–11, 2012, companion material proceedings, pp 1493–1494

  • Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding. Neurocomputing 187(C):27–48

    Article  Google Scholar 

  • Hinton G, Salakhutdinov R (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507

    Article  MathSciNet  Google Scholar 

  • Hong WC, Li MW, Geng J, Zhang Y (2019) Novel chaotic bat algorithm for forecasting complex motion of floating platforms. Appl Math Model 72:425–443. https://doi.org/10.1016/j.apm.2019.03.031

    Article  MathSciNet  MATH  Google Scholar 

  • Iqbal M, Browne WN, Zhang M (2013) Evolving optimum populations with XCS classifier systems—XCS with code fragmented action. Soft Comput 17(3):503–518

    Article  Google Scholar 

  • Iqbal M, Browne WN, Zhang M (2014) Reusing building blocks of extracted knowledge to solve complex, large-scale Boolean problems. IEEE Trans Evol Comput 18(4):465–480

    Article  Google Scholar 

  • Iqbal M, Browne WN, Zhang M (2015) Improving genetic search in XCS-based classifier systems through understanding the evolvability of classifier rules. Soft Comput 19(7):1863–1880

    Article  Google Scholar 

  • Iqbal M, Naqvi SS, Browne WN, Hollitt C, Zhang M (2016) Learning feature fusion strategies for various image types to detect salient objects. Pattern Recognit 60:106–120

    Article  Google Scholar 

  • Irfan M, Zheng J, Iqbal M, Arif MH (2020) A novel feature extraction model to enhance underwater image classification. Intelligent Computing Systems. Springer International Publishing, Cham, pp 78–91

  • Jin L, Liang H (2017) Deep learning for underwater image recognition in small sample size situations. In: OCEANS 2017, Aberdeen, pp 1–4

  • Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. CoRR. arXiv:1412.6980

  • Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Pereira F, Burges CJC, Bottou L, Weinberger KQ (eds) Advances in neural information processing systems, vol 25, Curran Associates, Inc., pp 1097–1105

  • Lanzi PL, Loiacono D (2007) Classifier systems that compute action mappings. In: Proceedings of the 9th annual conference on genetic and evolutionary computation, GECCO’07. ACM, New York, pp 1822–1829

  • Lopez-Vazquez V, Lopez-Guede JM, Marini S, Fanelli E, Johnsen E, Aguzzi J (2020) Video image enhancement and machine learning pipeline for underwater animal detection and classification at cabled observatories. Sensors 20(3)

  • Luo W, Li J, Yang J, Xu WJ, Zhang J (2018) Convolutional sparse autoencoders for image classification. IEEE Trans Neural Netw Learn Syst 29:3289–3294

    MathSciNet  Google Scholar 

  • Maas AL, Hannun AY, Ng AY (2013) Rectifier nonlinearities improve neural network acoustic models. In: ICML workshop on deep learning for audio, speech and language processing

  • Mahmood A, Bennamoun M, An S, Sohel F, Boussaid F (2020) ResFeats: residual network based features for underwater image classification. Image Vis Comput 93:103811

    Article  Google Scholar 

  • Matsumoto K, Tajima Y, Saito R, Nakata M, Sato H, Kovacs T, Takadama K (2016) Learning classifier system with deep autoencoder. In: CEC. IEEE, pp 4739–4746

  • Matsumoto K, Takano R, Tatsumi T, Sato H, Kovacs T, Takadama K (2018) XCSR based on compressed input by deep neural network for high dimensional data. In: GECCO (Companion). ACM, pp 1418–1425

  • Nakata M, Lanzi PL, Kovacs T, Browne WN, Takadama K (2015) How should learning classifier systems cover a state-action space? In: CEC. IEEE, pp 3012–3019

  • Nakata M, Browne W, Hamagami T, Takadama K (2017) Theoretical XCS parameter settings of learning accurate classifiers. In: Proceedings of the genetic and evolutionary computation conference, association for computing machinery, GECCO’17, New York, NY, USA, pp 473–480. https://doi.org/10.1145/3071178.3071200

  • Noh H, Hong S, Han B (2015) Learning deconvolution network for semantic segmentation. In: Proceedings of the 2015 IEEE international conference on computer vision (ICCV), IEEE Computer Society, Washington, DC, USA, ICCV’15, pp 1520–1528

  • Qin H, Li X, Liang J, Peng Y, Zhang C (2016) Deepfish. Neurocomputing 187(C):49–58

    Article  Google Scholar 

  • Sabzehzar A, Shan WL, Panahi MS, Saremi O (2015) An improved extended classifier system for the real-time-input real-time-output (XCSRR) stability control of a biped robot. In: Complex adaptive systems, Elsevier, Procedia computer science, vol 61, pp 492–499

  • Santurkar S, Tsipras D, Ilyas A, Madry A (2018) How does batch normalization help optimization? In: Bengio S, Wallach H, Larochelle H, Grauman K, Cesa-Bianchi N, Garnett R (eds) Advances in neural information processing systems, vol 31, Curran Associates, Inc., pp 2483–2493

  • Schettini R, Corchs S (2010) Underwater image processing: State of the art of restoration and image enhancement methods. EURASIP J Adv Signal Process 1:746052

    Article  Google Scholar 

  • Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: Visual explanations from deep networks via gradient-based localization. In: The IEEE international conference on computer vision (ICCV)

  • Siddiqui SA, Salman A, Malik MI, Shafait F, Mian A, Shortis MR, Harvey ES (2017) Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data. ICES J Mar Sci 75(1):374–389

    Article  Google Scholar 

  • Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7–9, 2015, conference track proceedings. arXiv:1409.1556

  • Stein A, Rauh D, Tomforde S, Hähner J (2017) Interpolation in the eXtended classifier system: an architectural perspective. Elsevier J Syst Archit 75:79–94

    Article  Google Scholar 

  • Szegedy C, Liu W, Jia Y, Sermanet P, Reed SE, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 1–9

  • Tadokoro M, Hasegawa S, Tatsumi T, Sato H, Takadama K (2019) Knowledge extraction from XCSR based on dimensionality reduction and deep generative models, pp 1883–189. https://doi.org/10.1109/CEC.2019.8790119

  • Urbanowicz RJ, Moore JH (2009) Learning classifier systems: a complete introduction, review, and roadmap. J Artif Evol Appl 1(1-1):25

  • Valev K, Schumann A, Sommer LW, Beyerer J (2018) A systematic evaluation of recent deep learning architectures for fine-grained vehicle classification. CoRR 10649:1–11. https://doi.org/10.1117/12.2305062

    Article  Google Scholar 

  • Vincent P, Larochelle H, Bengio Y, Manzagol PA (2008) Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th international conference on machine learning, ICML’08, ACM, New York, NY, USA, pp 1096–1103

  • Wang X, Ouyang J, Li D, Zhang G (2019) Underwater object recognition based on deep encoding-decoding network. J Ocean Univ China 18(2):376–382. https://doi.org/10.1007/s11802-019-3858-x

    Article  Google Scholar 

  • Xiong Q, Zhang X, Xu X, He S (2021) A modified chaotic binary particle swarm optimization scheme and its application in face-iris multimodal biometric identification. Electronics 10(2). https://doi.org/10.3390/electronics10020217

  • Xu Y, Zhang Y, Wang H, Liu X (2017) Underwater image classification using deep convolutional neural networks and data augmentation. In: 2017 IEEE international conference on signal processing, communications and computing (ICSPCC), pp 1–5

  • Xue B, Zhang M, Browne WN (2015) A comprehensive comparison on evolutionary feature selection approaches to classification. Int J Comput Intell Appl 14

  • Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Computer vision—ECCV 2014—13th European conference, Zurich, Switzerland, September 6–12, 2014, Proceedings, Part I, pp 818–833

  • Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: The IEEE conference on computer vision and pattern recognition (CVPR)

  • Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107–1136. https://doi.org/10.1007/s11071-019-05252-7

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Irfan.

Ethics declarations

Conflict of interest

Muhammad Irfan declares that he has no conflict of interest. Zheng Jiangbin declares that he has no conflict of interest. Muhammad Iqbal declares that he has no conflict of interest. Muhammad Hassan Arif declares that he has no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Irfan, M., Jiangbin, Z., Iqbal, M. et al. Enhancing learning classifier systems through convolutional autoencoder to classify underwater images. Soft Comput 25, 10423–10440 (2021). https://doi.org/10.1007/s00500-021-05738-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-021-05738-w

Keywords

Navigation