Skip to main content

A 3D Reconstruction System for Large Scene Based on RGB-D Image

  • Conference paper
  • First Online:
  • 1719 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11266))

Abstract

As an important research topic in the field of computer vision, 3D modeling of complex scene has an extensive application prospect. RGB-D sensor has been widely used to obtain the depth information in recent years. However, the existing processing system is simply suitable for small-scale scene modeling. In order to develop a better algorithm for large-scale complex scene modeling, this paper builds a 3D scene reconstruction system based on RGB-D images, achieving a better performance in accuracy and real time. SIFT algorithm is first to extract key points to match the descriptors between consecutive frames. By converting into three-dimensional space through the intrinsic matrix, the effective pixel points in the images are then reintegrated to establish the spatial point clouds model which is finally optimized by RANSAC algorithm. The experiments are based on the public database and propose the solution of the problems in the system, which provides a platform for basic research work.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bao, S.Y.Z., Savarese, S.: Semantic structure from motion. In: CVPR, vol. 2011, pp. 2025–2032 (2011)

    Google Scholar 

  2. Beis, J.S., Lowe, D.G.: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1000–1006 (1997)

    Google Scholar 

  3. Bentley, J.L.: Multidimensional binary search trees used for associative searching. Commun. ACM 18(9), 509–517 (1975)

    Article  Google Scholar 

  4. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. In: Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, pp. 726–740 (1987)

    Google Scholar 

  5. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision (2000)

    Google Scholar 

  6. Izadi, S., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 559–568 (2011)

    Google Scholar 

  7. Luan, S., Chen, C., Zhang, B., Han, J., Liu, J.: Gabor convolutional networks. IEEE Trans. Image Process. 1 (2018)

    Google Scholar 

  8. Newcombe, R.A., et al.: KinectFusion: real-time dense surface mapping and tracking. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 127–136 (2011)

    Google Scholar 

  9. Salas-Moreno, R.F., Newcombe, R.A., Strasdat, H., Kelly, P.H.J., Davison, A.J.: Slam++: simultaneous localisation and mapping at the level of objects. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1352–1359 (2013)

    Google Scholar 

  10. Silberman, N., Hoiem, D., Kohli, P., Fergus, R.: Indoor segmentation and support inference from RGBD images. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part V. LNCS, vol. 7576, pp. 746–760. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33715-4_54

    Chapter  Google Scholar 

  11. Smisek, J., Jancosek, M., Pajdla, T.: 3D with kinect. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1154–1160 (2011)

    Google Scholar 

  12. Xiao, J., Ehinger, K.A., Oliva, A., Torralba, A.: Recognizing scene viewpoint using panoramic place representation. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2695–2702 (2012)

    Google Scholar 

  13. Xiao, J., Owens, A., Torralba, A.: SUN3D: a database of big spaces reconstructed using SFM and object labels. In: 2013 IEEE International Conference on Computer Vision, pp. 1625–1632 (2013)

    Google Scholar 

  14. Zhang, B., et al.: One-two-one networks for compression artifacts reduction in remote sensing. ISPRS J. Photogramm. Remote Sens. (2018)

    Google Scholar 

Download references

Acknowledgments

The research is supported partially by the Natural Science Foundation of China under Contract 61672079, 61473086. The work of B. Zhang is supported partially by the Program for New Century Excellent Talents University within the Ministry of Education, China, as well by the Beijing Municipal Science and Technology Commission under Grant Z161100001616005.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Baochang Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, H., Wang, P., Wang, X., Peng, T., Zhang, B. (2018). A 3D Reconstruction System for Large Scene Based on RGB-D Image. In: Peng, Y., Yu, K., Lu, J., Jiang, X. (eds) Intelligence Science and Big Data Engineering. IScIDE 2018. Lecture Notes in Computer Science(), vol 11266. Springer, Cham. https://doi.org/10.1007/978-3-030-02698-1_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-02698-1_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-02697-4

  • Online ISBN: 978-3-030-02698-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics