Skip to main content
SpringerLink
Log in

Sea–sky line detection using gray variation differences in the time domain for unmanned surface vehicles

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Sea–sky lines (SKLs) can provide valuable reference information for the obstacle avoidance systems of unmanned surface vehicles (USVs) because obstacles that can threaten the safety of USVs, such as ships and rocks, are generally located below SKLs. Existing methods detect SKLs only using gray, texture or line features in an optical image. However, the background features in images obtained by onboard cameras are complex and change continuously over time, which leads to poor robustness of these methods. Conversely, the method that we proposed in this paper detects SKLs according to the gray variation differences in the time domain between the sky, the SKL and the sea surface when the USVs actually move on the sea. In this way, we can decrease the gray complexity of the image data of different backgrounds, which reduces interference while enhancing the edge features of the SKLs to obtain superior robustness. The proposed method is tested on optical image sequences collected by the ‘Jiu Hang 490’ USV. The experimental results demonstrate that the average accuracy of SKL detection is higher than that of existing methods with approximately 10% improvement while maintaining computational efficiency.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Jin, J., Zhang, J., Shao, F.: A novel ocean bathymetry technology based on an unmanned surface vehicle. Acta Oceanol. Sin. 37(9), 99–106 (2018)

    Article  Google Scholar 

  2. Matos, A., Silva, E., Cruz, N.: Development of an unmanned capsule for large-scale maritime search and rescue. In: IEEE International Conference on Oceans, pp. 1–8. IEEE (2013)

  3. Huntsberger, T., Aghazarian, H.: Stereo vision-based navigation for autonomous surface vessels. J. Field Robot. 28(1), 3–18 (2011)

    Article  Google Scholar 

  4. Ma, H., Smart, E., Ahmed, A., Brown, D.: Radar image-based positioning for USV under GPS denial environment. IEEE Trans. Intell. Transp. 19(1), 1–9 (2018)

    Article  Google Scholar 

  5. Han, J., Park, J., Kim, T., Kim, J.: Precision navigation and mapping under bridges with an unmanned surface vehicle. Auton. Robots 38(4), 349–362 (2015)

    Article  Google Scholar 

  6. Bovcon, B., Mandeljc, R., Janez, P.: Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentation. Robot. Auton. Syst. 104, 1–13 (2018)

    Article  Google Scholar 

  7. Woo, J., Kim, N.: Vision based obstacle detection and collision risk estimation of an unmanned surface vehicle. In: IEEE International Conference on Ubiquitous Robots and Ambient Intelligence, pp. 461–465. IEEE (2016)

  8. Mou, X., Wang, H.: Wide-baseline stereo-based obstacle mapping for unmanned surface vehicles. Sensors 18(4), 1085 (2018)

    Article  Google Scholar 

  9. Shin, B.S., Mou, X., Mou, W.: Vision-based navigation of an unmanned surface vehicle with object detection and tracking abilities. Mach. Vision Appl. 29(1), 1–18 (2017)

    Article  Google Scholar 

  10. Kong, X., Liu, L., Qian, Y.: Automatic detection of sea-sky horizon line and small targets in maritime infrared imagery. Infrared Phys. Technol. 76, 185–199 (2016)

    Article  Google Scholar 

  11. Zeng, W., Wan, L.: Fast detection of sea line based on the visible characteristics of marine images. Acta Opt. Sin. 32(1), 82–89 (2012)

    Google Scholar 

  12. Wang, B., Su, Y., Wan, L.: A sea-sky line detection method for unmanned surface vehicles based on gradient saliency. Sensors 16(4), 543 (2016)

    Article  Google Scholar 

  13. Ma, T., Ma, J.: A sea-sky line detection method based on line segment detector and Hough transform. In: IEEE International Conference on Computer and Communications, pp. 700-703. IEEE (2017)

  14. Sun, X., Xu, Q.: Sea-sky line detection based on edge phase encoding in complicated background. Acta Opt. Sin. 37(11), 86–94 (2017)

    Google Scholar 

  15. Liang, D., Zhang, W.: Robust sea-sky-line detection for complex sea background. In: IEEE International Conference on Progress in Informatics and Computing, pp. 317-321. IEEE (2016)

  16. Sengar, S.S., Mukhopadhyay, S.: Moving object detection based on frame difference and W4. Signal Image Video Process. 11(7), 1357–1364 (2017)

    Article  Google Scholar 

  17. Khare, M., Srivastava, R.K., Khare, A.: Moving object segmentation in Daubechies complex wavelet domain. Signal Image Video Process. 9(3), 635–650 (2015)

    Article  Google Scholar 

  18. Xia, H., Song, S., He, L.: A modified Gaussian mixture background model via spatiotemporal distribution with shadow detection. Signal Image Video Process. 10(2), 343–350 (2016)

    Article  Google Scholar 

  19. Soille, P.: Morphological Image Analysis-Principles and Applications, pp. 183–208. Springer, New York (2003)

    MATH  Google Scholar 

  20. York, Derek: Least-squares fitting of a straight line. Can. J. Phys. 46(16), 1845–1847 (1968)

    Article  MathSciNet  Google Scholar 

  21. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Conmmun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  22. Duda, R.O., Hart, P.E.: Use of the Hough transformation to detect lines and curves in pictures. Conmmun. ACM 15(1), 11–15 (1972)

    Article  Google Scholar 

Download references

Acknowledgements

This paper was supported by the National Key Research and Development Program of China (No. 2017YFC1405203), the National Natural Science Foundation of China (No. 61501520) and the Fundamental Research Funds for the Central Universities (No.19CX05003A-1, No.19CX02046A, No.17CX02079).

Author information

Authors and Affiliations

  1. College of Oceanography and Space Informatics, China University of Petroleum (East China), Qingdao, China

    Fangxu Li, Jie Zhang, Weifeng Sun, Ligang Li & Yongshou Dai

  2. First Institute of Oceanography, Ministry of Natural Resources, Qingdao, China

    Jie Zhang & Jiucai Jin

Authors
  1. Fangxu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jie Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Weifeng Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiucai Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ligang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yongshou Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weifeng Sun.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, F., Zhang, J., Sun, W. et al. Sea–sky line detection using gray variation differences in the time domain for unmanned surface vehicles. SIViP 15, 139–146 (2021). https://doi.org/10.1007/s11760-020-01733-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-020-01733-0

Keywords

Search

Navigation