Skip to main content

Accurate and Robust RGB-D Visual Odometry Based on Point and Line Features

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12816))

  • 1839 Accesses

Abstract

Feature recognition is widely used in visual simultaneous localization and mapping and visual odometry system. The most popular feature is the point feature, which includes SIFT feature, SURF feature, ORB feature. But in low textured scenes, RGB-D simultaneous localization and mapping (SLAM) tend to fail due to lack of reliable point features. Line features are as rich as point features in a structured or a low textured environment. However, line feature always contains more texture information for the calculation of pose, making it more complex for a line feature to be extracted, described and parameterized. To overcome the problems. We proposed a robust VO system fusing both points and lines by linearizing points, which not only preserves the information provided by line features, but also speeds up the calculation process. The method in this paper is evaluated on the TUM public real-world RGB-D dataset. The experimental results demonstrate that the algorithm proposed in this paper is more accurate and robust than the pure feature point algorithm in consideration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Durrant-Whyte, H., Bailey, T.: Simultaneous localization and mapping: part I. IEEE Robot. Autom. Mag 13(2), 99–110 (2006)

    Article  Google Scholar 

  2. Lin, F., Liu, Y., Zhou, J., et al.: Optimization of visual odometry algorithm based on ORB feature. Laser Optoelectron. Prog. 56(21), 180–187 (2019)

    Google Scholar 

  3. Tan, R., Zhu, M., Xu, Y.: Monocular SLAM feature point optimization based on ORB. In: 2019 International Conference on Big Data, Electronics and Communication Engineering, pp. 44–50 (2019)

    Google Scholar 

  4. Cai, L., Ye, Y., Gao, X., et al.: An improved visual SLAM based on affine transformation for ORB feature extraction. Optik 227, 165421 (2021)

    Google Scholar 

  5. Bhowmik, M.K., Shil, S., Saha, P.: Feature points extraction of thermal face using Harris interest point detection. Procedia Technol. 10(1), 24–730 (2013)

    Google Scholar 

  6. Lin, B., Wang, F., Sun, Y., et al.: Boundary points based scale invariant 3D point feature. J. Vis. Commun. Image Represent. 48, 136–148 (2017)

    Article  Google Scholar 

  7. Yongan, S., Kang, J.-G., Lee, L.-K., et al.: Line segment-based indoor mapping with salient line feature extraction. Adv. Robot. 26(5–6), 437–460 (2012)

    Google Scholar 

  8. Zhang, Z., Liu, M., Diao, C., et al.: A survey of the simultaneous localization and mapping (SLAM) based on RGB-D camera. In: Proceedings of 2019 2nd International Conference on Mechanical, Electronic and Engineering Technology, pp. 48–58 (2019)

    Google Scholar 

  9. Li, L.: RGB-D visual odometry based on points and edges. Int. J. Comput. Eng. 5(1), 212–220 (2020)

    Google Scholar 

  10. Liang, B., Wang, G.: Comparative analysis of position and pose estimation methods of RGB-D camera. In: Proceedings of the 2nd International Conference on Artificial Intelligence and Computer Science, pp. 1253–1259 (2020)

    Google Scholar 

  11. Liu, Y., Xie, Z., Liu, H.: LB-LSD: a length-based line segment detector for real-time applications. Pattern Recogn. Lett. 128, 247–254 (2019)

    Article  Google Scholar 

  12. Fanyang, M., Xia, L., Jihong, P.: A feature point matching based on spatial order constraints bilateral-neighbor vote. IEEE Trans. Image Process. 24(11), 4160–4171 (2015)

    Article  MathSciNet  Google Scholar 

  13. Xiaoyun, L., Wang, H., Tang, S., et al.: DM-SLAM: monocular SLAM in dynamic environments. Appl. Sci. 10(12), 1–16 (2020)

    Google Scholar 

  14. Han, B., Wu, W., Wang, Y., et al.: The semi-dense ICP algorithm based on the SIFT feature points neighborhood. In: Proceedings of the 2nd International Conference on Artificial Intelligence and Computer Science, pp. 396–401 (2020)

    Google Scholar 

  15. Grompone von, R.G., Jakubowicz, J., Morel, J.-M., et al.: LSD: a fast line segment detector with a false detection control. IEEE Trans. Pattern Anal. Mach. Intell. 32(4), 722–732 (2010)

    Google Scholar 

  16. Patraucean, V., Gurdjos, P., Grompone von, G.R.: Joint a contrario ellipse and line detection. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 788–802 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhao, G., Zhang, Y., Liu, P., Wu, H., Cui, M. (2021). Accurate and Robust RGB-D Visual Odometry Based on Point and Line Features. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management . KSEM 2021. Lecture Notes in Computer Science(), vol 12816. Springer, Cham. https://doi.org/10.1007/978-3-030-82147-0_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-82147-0_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-82146-3

  • Online ISBN: 978-3-030-82147-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics