Skip to main content

Self-learning Methodology Based on Degradation Estimation for Underwater Image Enhancement

  • Conference paper
  • First Online:
Intelligent Systems (BRACIS 2022)

Abstract

Underwater images suffer from degradation caused by water turbidity, light attenuation and color casting. An image enhancement procedure improves the perception and the analysis of the objects in the scene. Recent works based on deep learning approaches require synthetically paired datasets to train their models. In this work, it is present a self-learning methodology to enhance images without a paired dataset. The proposed method estimates image degradation from the input image and attenuate it from the image. The output image of an autoencoder is replaced in the loss function by a synthetically degraded version during the training. This procedure drives the network learning to compensate additional degradation. Thereby, the output image is an enhanced version of the input image. It is highlighted that the proposed algorithm requires only one image as input during the training. The results obtained using our method show its effectiveness of color preservation, color cast reduction, and contrast improvement.

Supported by National Council for Scientific and Technological Development (CNPq), the Coordination for the Improvement of Higher Education Personnel (CAPES) and Agency for Petroleum, Natural Gas, and Biofuels (PRH-ANP).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akkaynak, D., Treibitz, T.: A revised underwater image formation model. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6723–6732 (2018). https://doi.org/10.1109/CVPR.2018.00703

  2. Berman, D., Levy, D., Avidan, S., Treibitz, T.: Underwater single image color restoration using haze-lines and a new quantitative dataset. IEEE Trans. Pattern Anal. Mach. Intell. 43(8), 2822–2837 (2021). https://doi.org/10.1109/TPAMI.2020.2977624

    Article  Google Scholar 

  3. Burger, W., Burge, M.J.: Digital Image Processing: An Algorithmic Introduction Using Java, 2nd edn. Springer, London (2016). https://doi.org/10.1007/978-1-4471-6684-9

    Book  Google Scholar 

  4. Cho, Y., Jang, H., Malav, R., Pandey, G., Kim, A.: Underwater Image Dehazing via Unpaired Image-to-image Translation. Int. J. Control Autom. Syst. 18(3), 605–614 (2020). https://doi.org/10.1007/s12555-019-0689-x

    Article  Google Scholar 

  5. Donaldson, J.A., Drews-Jr, P., Bradley, M., Morgan, D.L., Baker, R., Ebner, B.C.: Countering low visibility in video survey of an estuarine fish assemblage. Pac. Conserv. Biol. 26(2), 190–200 (2020)

    Article  Google Scholar 

  6. Dos Santos, M., De Giacomo, G.G., Drews-Jr, P.L.J., Botelho, S.S.C.: Matching color aerial images and underwater sonar images using deep learning for underwater localization. IEEE Robot. Autom. Lett. 5(4), 6365–6370 (2020). https://doi.org/10.1109/LRA.2020.3013852

    Article  Google Scholar 

  7. Drews-Jr., P., Nascimento, E., Botelho, S., Campos, M.: Underwater depth estimation and image restoration based on single images. IEEE Comput. Graph. Appl. 36, 24–35 (2016). https://doi.org/10.1109/MCG.2016.26

  8. Drews-Jr, P., Nascimento, E., Moraes, F., Botelho, S., Campos, M.: Transmission estimation in underwater single images. In: IEEE ICCV, pp. 825–830 (2013)

    Google Scholar 

  9. Fabbri, C., Islam, M.J., Sattar, J.: Enhancing underwater imagery using generative adversarial networks. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 7159–7165 (2018). https://doi.org/10.1109/ICRA.2018.8460552

  10. Fayaz, S., Parah, S., Qureshi, G., Kumar, V.: Underwater image restoration: a state-of-the-art review. IET Image Process. 15, 269–285 (2020). https://doi.org/10.1049/ipr2.12041

  11. Hashisho, Y., Albadawi, M., Krause, T., von Lukas, U.F.: Underwater color restoration using u-net denoising autoencoder. In: 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 117–122 (2019). https://doi.org/10.1109/ISPA.2019.8868679

  12. Islam, M.J., Xia, Y., Sattar, J.: Fast underwater image enhancement for improved visual perception. IEEE Robot. Autom. Lett. 5(2), 3227–3234 (2020). https://doi.org/10.1109/LRA.2020.2974710

    Article  Google Scholar 

  13. Li, C., Anwar, S., Hou, J., Cong, R., Guo, C., Ren, W.: Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Trans. Image Process. 30, 4985–5000 (2021). https://doi.org/10.1109/TIP.2021.3076367

    Article  Google Scholar 

  14. Li, C., Anwar, S., Porikli, F.: Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recogn. 98, 107038 (2020). https://doi.org/10.1016/j.patcog.2019.107038, https://www.sciencedirect.com/science/article/pii/S0031320319303401

  15. Li, C., et al.: An underwater image enhancement benchmark dataset and beyond. IEEE Trans. Image Process. 29, 4376–4389 (2020). https://doi.org/10.1109/TIP.2019.2955241

    Article  MATH  Google Scholar 

  16. Li, J., Skinner, K.A., Eustice, R.M., Johnson-Roberson, M.: WaterGAN: unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robot. Autom. Lett. 3(1), 387–394 (2017)

    Google Scholar 

  17. Lin, Y., Shen, L., Wang, Z., Wang, K., Zhang, X.: Attenuation coefficient guided two-stage network for underwater image restoration. IEEE Sig. Process. Lett. 28, 199–203 (2020). https://doi.org/10.1109/LSP.2020.3048619

  18. Ponce-Hinestroza, A.N., Drews-Jr., P.L., Torres-Méndez, L.A.: A probabilistic approach to restore images acquired in underwater scenes. J. Math. Imaging Vision, 1–16 (2022)

    Google Scholar 

  19. Ponce-Hinestroza, A.N., Torres-Méndez, L.A., Drews-Jr., P.: Using a MRF-BP model with color adaptive training for underwater color restoration. In: ICPR, pp. 787–792 (2016)

    Google Scholar 

  20. Raveendran, S., Patil, M.D., Birajdar, G.K.: Underwater image enhancement: a comprehensive review, recent trends, challenges and applications. Artif. Intell. Rev. 54(7), 5413–5467 (2021). https://doi.org/10.1007/s10462-021-10025-z

    Article  Google Scholar 

  21. Wang, Y., Song, W., Fortino, G., Qi, L.Z., Zhang, W., Liotta, A.: An experimental-based review of image enhancement and image restoration methods for underwater imaging. IEEE Access 7(07), 140233–140251 (2019). https://doi.org/10.1109/ACCESS.2019.2932130

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank to National Council for Scientific and Technological Development (CNPq) and the Coordination for the Improvement of Higher Education Personnel (CAPES). In addition, the author thanks Human Resource Program of The Brazilian National Agency for Petroleum, Natural Gas, and Biofuels - PRH-ANP, supported with resources from oil companies considering the contract clause no 50/2015 of R, D &I of the ANP.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claudio Dornelles Mello Jr. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mello Jr., C.D., Moreira, B.U., de Oliveira Evald, P.J.D., Drews, P.J.L., Botelho, S.S.C. (2022). Self-learning Methodology Based on Degradation Estimation for Underwater Image Enhancement. In: Xavier-Junior, J.C., Rios, R.A. (eds) Intelligent Systems. BRACIS 2022. Lecture Notes in Computer Science(), vol 13654 . Springer, Cham. https://doi.org/10.1007/978-3-031-21689-3_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-21689-3_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-21688-6

  • Online ISBN: 978-3-031-21689-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics