Skip to main content

Advertisement

Springer Nature Link
Log in

A real-time correction and stitching algorithm for underwater fisheye images

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The application of underwater vehicles is an important link in the process of detecting marine resources, in the process, it is necessary to correct underwater images and stitch corrected images to receive a panoramic image. To implement this process, this paper proposes a fisheye image stitching algorithm include an accurate correction algorithm and a FAST-MIS stitching method to correction and stitch the fisheye image, finally obtain the stitch panoramic image. First of all, for correcting the fisheye image, this paper presents a accurate correction algorithm, which produces fewer errors and results in better image quality. In this paper, we use FAST-MIS (Fast multi-image stitching) stitching algorithm to quickly stitch multiple photographs. The FAST-MIS stitching algorithm. The algorithm proposed in this paper transforms the feature points in the process of large-size image Mosaic into small-size image feature points, which reduces the screening range of feature band, thus speeding up the screening speed and accuracy of effective feature points. Through experiment results shows that the error of the accurate correction algorithm proposed in this paper is reduced compared with the traditional method, and the correction effect of the result is also improved. Compared with the traditional ORB (Oriented FAST and Rotated BRIEF) method, the FAST-MIS stitching algorithm proposed in this paper can shorten the time of image stitch by about 23%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)

    Article  Google Scholar 

  2. Lijun, L., Meng, L., Ye, S.: Correction method of image distortion of fisheye lens. Infrared Laser Eng. 48(9), 926002 (2019)

    Article  Google Scholar 

  3. Wei, L., et al.: Double longitude model based correction method for fisheye image distortion. Yi Qi Yi Biao Xue Bao Chin. J. Sci. Instrum. 36(2), 377–385 (2015)

    Google Scholar 

  4. Gim, Y., Ko, H.S., et al.: Study on correction of optical distortion for flow visualization inside axisymmetric droplet. J. Korean Soc. Vis. 12, 21–25 (2014)

    Google Scholar 

  5. Billings, G., Johnson-Roberson, M.: SilhoNet-fisheye: adaptation of a ROI based object pose estimation network to monocular fisheye images. IEEE Robot. Autom. Lett. 5, 4241–4248 (2020)

    Google Scholar 

  6. Zhu, J.C., Wan, L., Liu, N., et al.: A correction method of fisheye lens based on projective reconstruction. Appl. Mech. Mater. 577, 741–744 (2014)

    Article  Google Scholar 

  7. Lu, J.S., Huo, C.L., Yu, Y.H., et al.: A novel calibration method based on heuristic B-spline model for fisheye lenses. In: 2013 International Conference on System Science and Engineering (ICSSE). IEEE (2013)

  8. Ha, J.-E.: Radial distortion correction of fisheye lens using straight lines. In: 2013 International Symposium on Mechatronics and Applied Mechanics (ISMAM 2013)

  9. Hossein-Nejad, Z., Agahi, H., Mahmoodzadeh, A.: Image matching based on the adaptive redundant keypoint elimination method in the SIFT algorithm. Pattern Anal. Appl. 24, 1–15 (2020)

    Google Scholar 

  10. Cheng, X., Hao, Q., Xie, M.: A comprehensive motion estimation technique for the improvement of EIS methods based on the SURF algorithm and Kalman filter. Sensors 16(4), 486 (2016)

    Article  Google Scholar 

  11. Rublee, E., et al.: ORB: an efficient alternative to SIFT or SURF. In: IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain, November 6–13, 2011. IEEE (2011)

  12. Ma, C., Hu, X., Xiao, J., et al.: Improved ORB algorithm using three-patch method and local gray difference. Sensors (Basel, Switzerland) 20(4), 975 (2020)

    Article  Google Scholar 

  13. Bansal, M., Kumar, M., Kumar, M.: 2D object recognition: a comparative analysis of SIFT, SURF and ORB feature descriptors. Multimed. Tools Appl. 80(12), 18839–18857 (2021)

    Article  Google Scholar 

  14. Fu, Q., Yu, H., Wang, X., Yang, Z., He, Y., Zhang, H., Mian, A.: Fast ORB-SLAM without keypoint descriptors. IEEE Trans. Image Process. 31, 1433–1446 (2022)

    Article  Google Scholar 

  15. Fan, Y.G., Chai, J.L., Ming-Ming, X.U., et al.: Improved fast image registration algorithm based on ORB and RANSAC fusion. Guangxue Jingmi Gongcheng Opt. Precis. Eng. 27(3), 702–717 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This work was supported by the National Natural Science Foundation of China (No. 51005142), the Innovation Program of Shanghai Municipal Education Commission (No. 14YZ010), and the Natural Science Foundation of Shanghai (No. 14ZR1414900, No. 19ZR1419300) for providing financial support for this work.

Author information

Authors and Affiliations

  1. School of Mechatronic Engineering and Automation, Shanghai University, No. 99 Shangda Road, Shanghai, China

    Zhanhua Wang, Zhijie Tang, Jingke Huang & Jianda Li

Authors
  1. Zhanhua Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhijie Tang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Jingke Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Jianda Li
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Zhijie Tang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Z., Tang, Z., Huang, J. et al. A real-time correction and stitching algorithm for underwater fisheye images. SIViP 16, 1783–1791 (2022). https://doi.org/10.1007/s11760-022-02135-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02135-0

Keywords