Skip to main content
Springer Nature Link
Log in

OMSACC-SGRAN: an implementation of hybrid Optimized Multi-Scale Atrous Convoluted CNN with Self Guided Residual Attention Network for fish species classification

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Visualizing the behavior of fish variants is the primary significance for obtaining biological insights in the marine ecological system. Several computer vision and machine learning-based approaches are introduced to classify the fish variants, but these require large data sets to provide high classification accuracy. Deep structured models handle these issues, but they need more attention during training time because some useful information is missed during the training process. It makes it possible to classify the fish variants inaccurately. Therefore, an automatic fish species classification system is developed to provide high accuracy and avoid misclassification results. Thus, this research work explores a new fish species classification strategy with the adoption of a hybrid deep learning technique. The acquired images are pre-processed using contrast-limited Adaptive Histogram Equalization (CLAHE) and histogram equalization methods for cleaning and increasing the quality of images. These images are fed to the hybrid classifier known as Optimized Multi-Scale Atrous Convoluted CNN with Self-Guided Residual Attention Network (OMSACC-SGRAN). Here, the parameters of both Multi-scale Atrous Convoluted CNN and Multi-scale Self Guided Residual Attention Network are tuned using a newly recommended Marine Predators-Forensics-based Investigation inspired Algorithm (MP-FBI). The experimental results proved that this approach achieve excellent results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Algorithm 1
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

The data underlying this article are available in QUT FISH dataset, at https://www.kaggle.com/datasets/sripaadsrinivasan/fish-species-image-data with access date 2023–04-01.

Secondly, DeepFish database at https://alzayats.github.io/DeepFish/ with access date 2023–01-04.

References

  1. Chuang M-C, Hwang J-N, Williams K (2016) A feature learning and object recognition framework for underwater fish images. IEEE Trans Image Process 25(4):1862–1872

    MathSciNet  Google Scholar 

  2. Qiu C, Zhang S, Wang C, Yu Z, Zheng H, Zheng B (2018) Improving transfer learning and squeeze- and-excitation networks for small-scale fine-grained fish image classification. IEEE Access 6:78503–78512

    Article  Google Scholar 

  3. Roberts PLD, Jaffe JS, Trivedi MM (2011) Multiview, broadband acoustic classification of marine fish: a machine learning framework and comparative analysis. IEEE J Oceanic Eng 36(1):90–104

    Article  Google Scholar 

  4. Han F, Zhu J, Liu B, Zhang B, Xie F (2020) Fish shoals behavior detection based on convolutional neural network and spatiotemporal information. IEEE Access 8:126907–126926

    Article  Google Scholar 

  5. Måløy H (2020) EchoBERT: a transformer-based approach for behavior detection in echograms. IEEE Access 8:218372–218385

    Article  Google Scholar 

  6. Zhao Z, Liu Y, Sun X, Liu J, Yang X, Zhou C (2021) Composited FishNet: fish detection and species recognition from low-quality underwater videos. IEEE Trans Image Process 30:4719–4734

    Article  Google Scholar 

  7. Nagaoka Y, Miyazaki T, Sugaya Y, Omachi S (2019) Automatic Mackerel sorting machine using global and local features. IEEE Access 7:63767–63777

    Article  Google Scholar 

  8. Alagarsamy S, Zhang Y-D, Govindaraj V, Rajasekaran MP, Sankaran S (2021) Smart identification of topographically variant anomalies in brain magnetic resonance imaging using a fish school-based fuzzy clustering approach. IEEE Trans Fuzzy Syst 29(10):3165–3177

    Article  Google Scholar 

  9. Iqbal MA, Wang Z, Ali ZA, Riaz S (2021) Automatic fish species classification using deep convolutional neural networks. Wirel Pers Commun 116:1043–1053

    Article  Google Scholar 

  10. Rodrigues MTA, Freitas MHG, Pádua FLC, Gomes RM, Carrano EG (2015) Evaluating cluster detection algorithms and feature extraction techniques in automatic classification of fish species. Pattern Anal Appl 18:783–797

    Article  MathSciNet  Google Scholar 

  11. Li D, Ling Du (2022) Recent advances of deep learning algorithms for aquacultural machine vision systems with emphasis on fish. Artif Intell Rev 55:4077–4116

    Article  Google Scholar 

  12. Martínez-González ÁT, Ramírez-Rivera VM, Caballero-Vázquez JA, Gómez Jáuregui DA (2021) Deep learning algorithm as a strategy for detection an invasive species in uncontrolled environment. Rev Fish Biol Fish 31:909–922

    Article  Google Scholar 

  13. Ditria EM, Sievers M, Lopez-Marcano S, Jinks EL, Connolly RM (2020) Deep learning for automated analysis of fish abundance: the benefits of training across multiple habitats. Environ Monit Assess 192:698

    Article  Google Scholar 

  14. Jiang L, Quan H, Xie T, Qian J (2022) Fish recognition in complex underwater scenes based on targeted sample transfer learning. Multimed Tools Appl 81:25303–25317

    Article  Google Scholar 

  15. Xiaoling Xu, Li W, Duan Q (2021) Transfer learning and SE-ResNet152 networks-based for small-scale unbalanced fish species identification. Comput Electron Agric 180:105878

    Article  Google Scholar 

  16. Yoshida T, Zhou J, Terayama K, Kitazawa D (2023) Monitoring of cage-cultured sea cucumbers using an underwater time-lapse camera and deep learning-based image analysis. Smart Agric Technol 3:100087

    Article  Google Scholar 

  17. Aziz RM, Desai NP, Baluch MF (2023) Computer vision model with novel cuckoo search based deep learning approach for classification of fish image. Multimed Tools Appl 82:3677–3696

    Article  Google Scholar 

  18. Prasenan P, Suriyakala CD (2022) Fish species classification using a collaborative technique of firefly algorithm and neural network. EURASIP J Adv Signal Process 2022:116

    Article  Google Scholar 

  19. Mathur M, Vasudev D, Sahoo S, Jain D, Goel N (2020) Crosspooled FishNet: transfer learning based fish species classification model. Multimed Tools Appl 79:31625–31643

    Article  Google Scholar 

  20. Rauf HT, Lali MIU, Zahoor S, Shah SZH, Rehman AU, Bukhari SAC (2019) Visual features based automated identification of fish species using deep convolutional neural networks. Comput Electron Agric 167:105075

    Article  Google Scholar 

  21. Jalal A, Salman A, Mian A, Shortis M, Shafait F (2020) Fish detection and species classification in underwater environments using deep learning with temporal information. Ecol Inform 57:101088

    Article  Google Scholar 

  22. Banerjee A, Das A, Behra S, Bhattacharjee D, Srinivasan NT, Nasipuri M, Das N (2022) Carp-DCAE: Deep convolutional autoencoder for carp fish classification. Comput Electron Agric 196:106810

    Article  Google Scholar 

  23. Abinaya NS, Susan D, Kumar R (2021) Naive Bayesian fusion based deep learning networks for multisegmented classification of fishes in aquaculture industries. Ecol Inform 61:101248

    Article  Google Scholar 

  24. Giveki D, Soltanshahi MA, Rastegar H (2024) Shape classification using a new shape descriptor and multi-view learning. Displays 82:102636

    Article  Google Scholar 

  25. Rastegar H, Giveki D (2023) Designing a new deep convolutional neural network for content-based image retrieval with relevance feedback. Comput Electr Eng 106:108593

    Article  Google Scholar 

  26. Giveki D (2021) Improving the performance of convolutional neural networks for image classification. Opt Mem Neural Netw 30:51–66

    Article  Google Scholar 

  27. Giveki D (2021) Scale-space multi-view bag of words for scene categorization. Multimed Tools Appl 80:1223–1245

    Article  Google Scholar 

  28. Giveki D, Karami M (2020) Scene classification using a new radial basis function classifier and integrated SIFT–LBP features. Pattern Anal Appl 23:1071–1084

    Article  MathSciNet  Google Scholar 

  29. Basil N, Marhoon HM, Ibrahim AR (2023) A new thrust vector-controlled rocket based on JOA using MCDA. Measurement: Sensors 26:100672

    Google Scholar 

  30. Raheem FS, Basil N (2023) Automation intelligence photovoltaic system for power and voltage issues based on Black Hole Optimization algorithm with FOPID. Measurement: Sensors 25:100640

    Google Scholar 

  31. Basil N, Marhoon HM, Gokulakrishnan S et al (2022) Jaya optimization algorithm implemented on a new novel design of 6-DOF AUV body: a case study. Multimed Tools Appl . https://doi.org/10.1007/s11042-022-14293-x

  32. Marhoon HM, Ibrahim AR, Basil N (2021) “Enhancement of electro hydraulic position servo control system utilising ant lion optimiser.” Int J Nonlinear Anal Appl (IJNAA) 12(2):2453–2461

    Google Scholar 

  33. Ibrahim AR, Basil N, Mahdi MI (2021) Implementation enhancement of AVR control system within optimization techniques. Int J Nonlinear Anal Appl (IJNAA) 12(2):2008–6822

    Google Scholar 

  34. Ibrahim AR, Basil N, Mahdi MI (2021) “Implementation enhancement of AVR control system within optimization techniques.” Int J Nonlinear Anal Appl (IJNAA) 12(2):2008–6822

    Google Scholar 

  35. Basil N (2020) Rider optimization algorithm implemented on the AVR control system using MATLAB with FOPID. IOP Conf Ser Mater Sci Eng 928(3):032017

    Article  Google Scholar 

  36. Mohammed YR, Basil N, Bayat O, Mohammed AH (2020) A new novel optimization techniques implemented on the AVR control system using MATLAB-SIMULINK. Res Gate 29(5):4515–4521

  37. Giveki D, Zaheri A, Allahyari N (2024) Designing CNNs with optimal architectures using antlion optimization for plant leaf recognition. Multimed Tools Appl. https://doi.org/10.1007/s11042-024-18948-9

  38. Khojasteh P, Aliahmad B, Arjunan SP, Kumar DK (2018) Introducing a Novel Layer in Convolutional Neural Network for Automatic Identification of Diabetic Retinopathy. Annu Int Conf IEEE Eng Med Biol Soc, pp 5938 5941. https://doi.org/10.1109/EMBC.2018.8513606

  39. Rastegar H, Giveki D (2023) Designing a new deep convolutional neural network for skin lesion recognition. Multimed Tools Appl 82:18907–18923

    Article  Google Scholar 

  40. Radhiyah A, Harsono T, Sigit R (2016) "Comparison study of Gaussian and histogram equalization filter on dental radiograph segmentation for labelling dental radiograph," 2016 International Conference on Knowledge Creation and Intelligent Computing (KCIC), Manado, Indonesia, pp 253–258. https://doi.org/10.1109/KCIC.2016.7883655

  41. Md. Sarker MK, Rashwan H, Talavera E, Banu SF, Radeva P, Puig D (2019) MACNet: Multi-scale Atrous Convolution Networks for Food Places Classification in Egocentric Photo-Streams: Munich, Germany, September 8-14, 2018, Proceedings, Part V. https://doi.org/10.1007/978-3-030-11021-5_26

  42. Jiang Y, Yao H, Wu C, Liu W (2021) Multi-scale residual attention network for retinal vessels segmentation. Symmetry 13:24

    Article  Google Scholar 

  43. Faramarzi A, Heidarinejad M, Mirjalili S, Gandomi AH (2020) Marine predators algorithm: a nature-inspired metaheuristic. Exp Syst Appl 152:113377

    Article  Google Scholar 

  44. Rastegar H, Giveki D, Choubin M (2024) EEG signals classification using a new radial basis function neural network and jellyfish meta-heuristic algorithm. Evol Intell 17:1197–1208

    Article  Google Scholar 

  45. Giveki D, Shakarami A, Tarrah H, Soltanshahi MA (2022) A new method for image classification and image retrieval using convolutional neural networks. Concurrency Computat Pract Exper 34(1):e6533. https://doi.org/10.1002/cpe.6533

  46. Brammya G, Praveena S, Preetha NSN, Ramya R, Rajakumar BR, Binu D (2019) Deer hunting optimization algorithm: a new nature-inspired meta-heuristic paradigm. The Computer Journal. https://doi.org/10.1093/comjnl/bxy133

  47. Hashim FA, Houssein EH, Hussain K, Mabrouk MS, Al-Atabany W (2022) Honey Badger algorithm: new metaheuristic algorithm for solving optimization problems. Math Comput Simul 192:84–110

    Article  MathSciNet  Google Scholar 

  48. Chou J-S, Nguyen N-M (2020) FBI inspired meta-optimization. Appl Soft Comput. 93:106339. https://doi.org/10.1016/j.asoc.2020.106339

  49. Siddiqui SA, Salman A, Malik MI, Shafait F, Mian A, Shortis MR, Harvey ES (2018) Automatic fish species classification in underwater videos:exploiting pre-trained deep neural network models to compensate for limited labelled data. ICES J Mar Sci 75:374–389

    Article  Google Scholar 

  50. Agarwal AK, Tiwari RG, Khullar V, Kaushal RK (2021) "Transfer Learning Inspired Fish Species Classification," 2021 8th International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, pp 1154–1159. https://doi.org/10.1109/SPIN52536.2021.9566067

  51. Villon S, Iovan C, Mangeas M, Claverie T, Mouillot D, Villéger S, Vigliola L (2021) Automatic underwater fish species classification with limited data using few-shot learning. Ecol Inform 63:101320

    Article  Google Scholar 

  52. Bhanumathi M, Arthi B (2022) FishRNFuseNET: development of heuristic-derived recurrent neural network with feature fusion strategy for fish species classification. Res Gate 66(1):1–42

Download references

Acknowledgements

I would like to express my very great appreciation to the co-authors of this manuscript for their valuable and constructive suggestions during the planning and development of this research work.

Funding

This research did not receive any specific funding.

Author information

Authors and Affiliations

  1. Department of Computing Technologies, College of Engineering and Technology, SRM Institute of Science and Technology, Chengalpattu, Kattankulathur, Chennai, 603203, Tamil Nadu, India

    Bhanumathi M

  2. Department of Computing Technologies, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, Chengalpattu, Kattankulathur, Chennai, 603203, Tamil Nadu, India

    Arthi B

Authors
  1. Bhanumathi M
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Arthi B
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

All authors have made substantial contributions to conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Bhanumathi M.

Ethics declarations

Ethical approval

Not applicable.

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

M, B., B, A. OMSACC-SGRAN: an implementation of hybrid Optimized Multi-Scale Atrous Convoluted CNN with Self Guided Residual Attention Network for fish species classification. Multimed Tools Appl 83, 87199–87235 (2024). https://doi.org/10.1007/s11042-024-19760-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-19760-1

Keywords