Skip to main content
SpringerLink
Log in

Water–air imaging: distorted image reconstruction based on a twice registration algorithm

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Image will be seriously distorted when camera captures the scene through water surface. This will cause the captured image to lose its readability. Although several previous methods have been proposed to resolve this problem, the methods still need improvement. In this paper, we propose a reconstruction method to restore the distorted images based on a twice registration algorithm. Several calculation methods will be applied to update reference image in different registration phase. Firstly, the method uses the mean image of the image sequence as the reference image for the first registration. Due to the reference image may be blurred, a deblurring step has been applied in this paper. To register the distorted image sequence, a non-rigid registration method has been employed based on B-spline method. In addition, a patch search method also is proposed to update the reference image in the second registration because reference image is the key to improve the accuracy of image registration. It is designed to obtain the most similar patches from the image sequence. Compared with the previous methods using the existing database and generated database, the results show that our method performs better than the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig.10
Fig. 11

Similar content being viewed by others

References

  1. Alterman, M., Schechner, Y.Y., Swirski, Y.: Triangulation in random refractive distortions. IEEE, IEEE ICCP (2013)

    Book  Google Scholar 

  2. Schechner, Y.Y.: A view through the wavess. Marine Technol. Soc. J. 47, 148–150 (2013)

    Article  Google Scholar 

  3. Pardo, G.D., Picón, A., Alvarez-Gila, A.: Automatic redchannel underwater image restoration. J. Vis. Commun. Image Represent 26, 132–145 (2015)

    Article  Google Scholar 

  4. Seemakurthy, K., Rajagopalan, A.N.: Deskewing of underwater images. IEEE Trans. Image Process. 24, 1046–1059 (2015)

    Article  MathSciNet  Google Scholar 

  5. Boffety, M., Galland, F., Allais, A.-G.: Influence of polarization filtering on image registration precision in underwater conditions. Opt. Lett. 37, 3273–3275 (2012)

    Article  Google Scholar 

  6. Wang, G., Zheng, B., Sun, F.F.: Estimation-based approach for underwater image restoration. Opt. Lett. 36, 2384–2386 (2011)

    Article  Google Scholar 

  7. Yan, C., Shao, B., Zhao, H., Ning, R., Zhang, Y., Xu, F.: 3D Room Layout Estimation from a Single RGB Image. IEEE Trans. Multimed. 11, 3014–3035 (2020)

    Article  Google Scholar 

  8. Gilles, J., Osher, S.: Waveslet burst accumulation for turbulence mitigation. J. Electron. Imaging 25, 033003 (2016)

    Article  Google Scholar 

  9. Halder, K.K., Tahtali, M., Anavatti, S.G.: Simple algorithm for correction of geometrically warped underwater images. Electron. Lett. 50, 1687–1689 (2014)

    Article  Google Scholar 

  10. Tian, Y., Narasimhan, S.G.: Globally optimal estimation of nonrigid image distortion. Int. J. Comput. Vis. 98, 279–302 (2012)

    Article  MathSciNet  Google Scholar 

  11. Alterman, M., Swirski, Y.: STELLA MARIS: Stellar marine refractive imaging sensor, In ICCP (2014)

  12. Kanaev, A.V., Hou, W., Woods, S., Smith, L.N.: Restoration of turbulence degraded underwater images. Opt. Eng. 51, 057007 (2012)

    Article  Google Scholar 

  13. Oreifej, O., Guang, S., Pace, T., Shah, M.: A two-stage reconstruction approach for seeing through water. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Institute of Electrical and Electronics Engineers, 1153–1160 (2011)

  14. Yan, C., Shao, B., Zhao, H., Ning, R., Zhang, Y., Xu, F.: 3D room layout estimation from a single RGB image. IEEE Trans. Multimed. 22, 3014–3024 (2020)

    Article  Google Scholar 

  15. Halder, K.K., Paul, M., Tahtali, M.: Correction of geometrically distorted underwater images using shift map analysis. JOSA A-Opt. Image Sci. Vis. 34, 666–673 (2017)

    Article  Google Scholar 

  16. Morris, N.: Image-based water surface reconstruction with refractive stereo, Master’s thesis, University of Toronto (2004)

  17. Tian, Y., Narasimhan, S.G.: Seeing through water: image restoration using model-based tracking. In: IEEE International Conference on Computer Vision, pp. 2303–2310 (2009)

  18. Yan, C., Gong, B., Wei, Y., Gao, Y.: Deep multi-view enhancement hashing for image retrieval. IEEE Trans. Pattern Anal. Mach. Intel. 43, 1445–1451 (2020)

    Article  Google Scholar 

  19. Tian, Y., Narasimhan, S.G.: A globally optimal data-driven approach for image distortion estimation. IEEE CVPR (2010)

  20. Murase, H.: Surface shape reconstruction of a nonrigid transport object using refraction and motion. IEEE TPAMI 14, 1045–1052 (1992)

    Article  Google Scholar 

  21. Milder, D.M., Carter, P.W., Flacco, N.L., Hubbard, B.E., Jones, N.M., Panici, K.R., Platt, B.D., Potter, R.E., Tong, K.W., Twisselmann, D.J.: Reconstruction of through-surface underwater imagery. Wavess Random Complex Media 16, 521–530 (2006)

    Article  Google Scholar 

  22. Halder, K.K., Tahtali, M., Anavatti, S.G.: Geometric correction of atmospheric turbulence-degraded video containing moving objects. Opt Express 23, 5091–5101 (2015)

    Article  Google Scholar 

  23. Tahtali, M., Fraser, D., Lambert, A.J.: Restoration of non-uniformly warped images using a typical frame as prototype. In: Proceedings of IEEE Region 10 Conference, Institute of Electrical and Electronics Engineers, 1–6 (2005)

  24. Fried, D.: Probability of getting a lucky short-exposure image through turbulence. J. Opt. Soc. Am. 68, 1651–1658 (1978)

    Article  Google Scholar 

  25. Weddell, S., Webb, R.: Data preprocessing on sequential data for improved astronomical imaging. In: Proceedings of Image and Vision Computing, pp. 1–8 (2005)

  26. Law, N., Mackay, C., Baldwin, J.: Lucky imaging: high angular resolution imaging in the visible from the ground. Astron. Astrophys. 446, 739–745 (2006)

    Article  Google Scholar 

  27. Efros A., Isler, V., Shi, J., Visontai, M.: Seeing through water. In Neural Information Processing Systems (NIPS 17) (2004)

  28. Wen, Z., Lambert, A., Fraser, D., Li, H.: Bispectral analysis and recovery of images distorted by a moving water surface. Apply Opt. 49, 6376–6384 (2010)

    Article  Google Scholar 

  29. Suiter, H., Flacco, N., Carter, P., Tong, K., Ries, R., Gershenson, M.: Optics near the Snell Angle in a water-to-air change of medium. In IEEE OCEANS, pp. 1–12 (2008)

  30. Donate, A., Dahme, G., Ribeiro, E.:Classification of textures distorted by water wavess. In: 18th International Conference on Pattern Recognition, 2, 421–424 (2006)

  31. Donate, A., Ribeiro, E.: Improved reconstruction of images distorted by water wavess. In: International Conference on Computer Vision Theory and Applications, 228–235 (2006)

  32. Cho, L.: Fast motion deblurring, ACM transactions on graphics (TOG). ACM 28, 145 (2009)

    Google Scholar 

  33. Cai, C.T., Meng, H.Y., Zhu, Q.D.: Blind deconvolution for image deblurring based on edge enhancement and noise suppression. IEEE Access 6, 710–718 (2018)

    Google Scholar 

  34. Huizhong, J., Yusen, L., Enqing, D.: A non-rigid image registration method based on multi-level B-spline and L2-regularization. SIViP 12(6), 1275–1225 (2018)

    Google Scholar 

  35. Wen Z., Fraser, D., Lambert, A., Li, H.: Reconstruction of underwater image by bispectrum. In: IEEE International Conference on Image Processing, 2007. ICIP, 3 (2007)

  36. Zhang, Z., Yang, X.: Reconstruction of distorted underwater images using robust registration. Opt. Express 27(7), 9996 (2019)

    Article  Google Scholar 

  37. Gabarda, S., Cristóbal, G.: Blind image quality assessment through anisotropy. J. Opt. Soc. Am. A 24, B42–B51 (2007)

    Article  Google Scholar 

  38. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by the National Natural Science Foundation of China (No. 61673129, 51674109).

Author information

Authors and Affiliations

  1. College of Intelligent Systems Science and Engineering, Harbin Engineering University, Harbin, 150001, China

    Chengtao Cai, Haiyang Meng, Renjie Qiao & Feng Wang

Authors
  1. Chengtao Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haiyang Meng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Renjie Qiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Feng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haiyang Meng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cai, C., Meng, H., Qiao, R. et al. Water–air imaging: distorted image reconstruction based on a twice registration algorithm. Machine Vision and Applications 32, 64 (2021). https://doi.org/10.1007/s00138-021-01188-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-021-01188-4

Keywords

Search

Navigation