Abstract
Underwater images suffer from degradation caused by water turbidity, light attenuation and color casting. An image enhancement procedure improves the perception and the analysis of the objects in the scene. Recent works based on deep learning approaches require synthetically paired datasets to train their models. In this work, it is present a self-learning methodology to enhance images without a paired dataset. The proposed method estimates image degradation from the input image and attenuate it from the image. The output image of an autoencoder is replaced in the loss function by a synthetically degraded version during the training. This procedure drives the network learning to compensate additional degradation. Thereby, the output image is an enhanced version of the input image. It is highlighted that the proposed algorithm requires only one image as input during the training. The results obtained using our method show its effectiveness of color preservation, color cast reduction, and contrast improvement.
Supported by National Council for Scientific and Technological Development (CNPq), the Coordination for the Improvement of Higher Education Personnel (CAPES) and Agency for Petroleum, Natural Gas, and Biofuels (PRH-ANP).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akkaynak, D., Treibitz, T.: A revised underwater image formation model. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6723–6732 (2018). https://doi.org/10.1109/CVPR.2018.00703
Berman, D., Levy, D., Avidan, S., Treibitz, T.: Underwater single image color restoration using haze-lines and a new quantitative dataset. IEEE Trans. Pattern Anal. Mach. Intell. 43(8), 2822–2837 (2021). https://doi.org/10.1109/TPAMI.2020.2977624
Burger, W., Burge, M.J.: Digital Image Processing: An Algorithmic Introduction Using Java, 2nd edn. Springer, London (2016). https://doi.org/10.1007/978-1-4471-6684-9
Cho, Y., Jang, H., Malav, R., Pandey, G., Kim, A.: Underwater Image Dehazing via Unpaired Image-to-image Translation. Int. J. Control Autom. Syst. 18(3), 605–614 (2020). https://doi.org/10.1007/s12555-019-0689-x
Donaldson, J.A., Drews-Jr, P., Bradley, M., Morgan, D.L., Baker, R., Ebner, B.C.: Countering low visibility in video survey of an estuarine fish assemblage. Pac. Conserv. Biol. 26(2), 190–200 (2020)
Dos Santos, M., De Giacomo, G.G., Drews-Jr, P.L.J., Botelho, S.S.C.: Matching color aerial images and underwater sonar images using deep learning for underwater localization. IEEE Robot. Autom. Lett. 5(4), 6365–6370 (2020). https://doi.org/10.1109/LRA.2020.3013852
Drews-Jr., P., Nascimento, E., Botelho, S., Campos, M.: Underwater depth estimation and image restoration based on single images. IEEE Comput. Graph. Appl. 36, 24–35 (2016). https://doi.org/10.1109/MCG.2016.26
Drews-Jr, P., Nascimento, E., Moraes, F., Botelho, S., Campos, M.: Transmission estimation in underwater single images. In: IEEE ICCV, pp. 825–830 (2013)
Fabbri, C., Islam, M.J., Sattar, J.: Enhancing underwater imagery using generative adversarial networks. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 7159–7165 (2018). https://doi.org/10.1109/ICRA.2018.8460552
Fayaz, S., Parah, S., Qureshi, G., Kumar, V.: Underwater image restoration: a state-of-the-art review. IET Image Process. 15, 269–285 (2020). https://doi.org/10.1049/ipr2.12041
Hashisho, Y., Albadawi, M., Krause, T., von Lukas, U.F.: Underwater color restoration using u-net denoising autoencoder. In: 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 117–122 (2019). https://doi.org/10.1109/ISPA.2019.8868679
Islam, M.J., Xia, Y., Sattar, J.: Fast underwater image enhancement for improved visual perception. IEEE Robot. Autom. Lett. 5(2), 3227–3234 (2020). https://doi.org/10.1109/LRA.2020.2974710
Li, C., Anwar, S., Hou, J., Cong, R., Guo, C., Ren, W.: Underwater image enhancement via medium transmission-guided multi-color space embedding. IEEE Trans. Image Process. 30, 4985–5000 (2021). https://doi.org/10.1109/TIP.2021.3076367
Li, C., Anwar, S., Porikli, F.: Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recogn. 98, 107038 (2020). https://doi.org/10.1016/j.patcog.2019.107038, https://www.sciencedirect.com/science/article/pii/S0031320319303401
Li, C., et al.: An underwater image enhancement benchmark dataset and beyond. IEEE Trans. Image Process. 29, 4376–4389 (2020). https://doi.org/10.1109/TIP.2019.2955241
Li, J., Skinner, K.A., Eustice, R.M., Johnson-Roberson, M.: WaterGAN: unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robot. Autom. Lett. 3(1), 387–394 (2017)
Lin, Y., Shen, L., Wang, Z., Wang, K., Zhang, X.: Attenuation coefficient guided two-stage network for underwater image restoration. IEEE Sig. Process. Lett. 28, 199–203 (2020). https://doi.org/10.1109/LSP.2020.3048619
Ponce-Hinestroza, A.N., Drews-Jr., P.L., Torres-Méndez, L.A.: A probabilistic approach to restore images acquired in underwater scenes. J. Math. Imaging Vision, 1–16 (2022)
Ponce-Hinestroza, A.N., Torres-Méndez, L.A., Drews-Jr., P.: Using a MRF-BP model with color adaptive training for underwater color restoration. In: ICPR, pp. 787–792 (2016)
Raveendran, S., Patil, M.D., Birajdar, G.K.: Underwater image enhancement: a comprehensive review, recent trends, challenges and applications. Artif. Intell. Rev. 54(7), 5413–5467 (2021). https://doi.org/10.1007/s10462-021-10025-z
Wang, Y., Song, W., Fortino, G., Qi, L.Z., Zhang, W., Liotta, A.: An experimental-based review of image enhancement and image restoration methods for underwater imaging. IEEE Access 7(07), 140233–140251 (2019). https://doi.org/10.1109/ACCESS.2019.2932130
Acknowledgments
The authors would like to thank to National Council for Scientific and Technological Development (CNPq) and the Coordination for the Improvement of Higher Education Personnel (CAPES). In addition, the author thanks Human Resource Program of The Brazilian National Agency for Petroleum, Natural Gas, and Biofuels - PRH-ANP, supported with resources from oil companies considering the contract clause no 50/2015 of R, D &I of the ANP.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Mello Jr., C.D., Moreira, B.U., de Oliveira Evald, P.J.D., Drews, P.J.L., Botelho, S.S.C. (2022). Self-learning Methodology Based on Degradation Estimation for Underwater Image Enhancement. In: Xavier-Junior, J.C., Rios, R.A. (eds) Intelligent Systems. BRACIS 2022. Lecture Notes in Computer Science(), vol 13654 . Springer, Cham. https://doi.org/10.1007/978-3-031-21689-3_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-21689-3_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21688-6
Online ISBN: 978-3-031-21689-3
eBook Packages: Computer ScienceComputer Science (R0)