Skip to main content
SpringerLink
Log in

Efficient Disparity Map Generation Using Stereo and Time-of-Flight Depth Cameras

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing -- PCM 2015 (PCM 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9315))

Included in the following conference series:

Abstract

Three-dimensional content (3D) creation has received a lot of attention due to numerous successes of 3D entertainment. Accurate estimation of depth information is necessary for efficient 3D content creation. In this paper, we propose a disparity map estimation method based on stereo correspondence. The proposed system utilizes depth and stereo camera sets. While the stereo set carries out disparity estimation, depth camera information is projected to left and right camera positions using 3D warping and upsampling is processed in accordance with the image size. The upsampled depth is used for obtaining disparity data of left and right positions. Finally, disparity data from each depth sensor are combined. The experimental results demonstrate that our method produces more accurate disparity maps compared to the conventional approaches which use stereo cameras and a single depth sensor.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhang, L., Tam, W.J.: Stereoscopic image generation based on depth images for 3DTV. IEEE Trans. Broadcast. 51(2), 191–199 (2005)

    Article  Google Scholar 

  2. Tech, G., Muller, K., Wiegand, T.: Evaluation of view synthesis algorithms for mobile 3DTV. In: 3DTV Conference, pp. 132(1–4) (2011)

    Google Scholar 

  3. Lee, E.K., Ho, Y.S.: Generation of multi-view video using a fusion camera system for 3D displays. IEEE Trans. Consum. Electron. 56(4), 2797–2805 (2010)

    Article  Google Scholar 

  4. Jang, W.S., Ho, Y.S.: Efficient disparity map estimation using occlusion handling for various 3D multimedia applications. IEEE Trans. Consum. Electron. 57(4), 1937–1943 (2011)

    Article  Google Scholar 

  5. Scharstein, D., Szeliski, R., Zabih, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7–42 (2002)

    Article  MATH  Google Scholar 

  6. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn, pp. 262–278. Cambridge University Press, Cambridge (2003)

    MATH  Google Scholar 

  7. Jang, W.S., Ho, Y.S.: Discontinuity preserving disparity estimation with occlusion handling. J. Vis. Commun. Image Represent. 25(7), 1595–1603 (2014)

    Article  Google Scholar 

  8. Lee, E.K., Ho, Y.S.: Generation of high-quality depth maps using hybrid camera system for 3-D video. J. Vis. Commun. Image Represent. 22(1), 73–84 (2011)

    Article  MathSciNet  Google Scholar 

  9. Kang, Y.S., Ho, Y.S.: Generation of multi-view images using stereo and time-of-flight depth cameras. In: International Conference on Embedded Systems and Intelligent Technology, pp. 104–107 (2013)

    Google Scholar 

  10. Hirschmuller, H., Innocent, P.R., Garibaldi, J.M.: Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vis. 47(1/2/3), 229–246 (2002)

    Article  MATH  Google Scholar 

  11. Veksler, O.: Fast variable window for stereo correspondence using integral images. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. 1, 556–561 (2003)

    Google Scholar 

  12. Sun, J., Zheng, N.N., Shum, H.Y.: Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25(7), 787–800 (2003)

    Article  MATH  Google Scholar 

  13. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)

    Article  Google Scholar 

  14. Yang, Q., Wang, L., Ahuja, N.: A constant-space belief propagation algorithm for stereo matching. In: Computer Vision and Pattern Recognition, pp. 1458–1465 (2010)

    Google Scholar 

  15. Kang, Y.S., Ho, Y.S.: High-quality multi-view depth generation using multiple color and depth cameras. In: International Workshop on Hot Topics in 3D, pp. 1405–1408 (2010)

    Google Scholar 

  16. Yang, Q., Engels, C., Akbarzadeh, A.: Near real-time stereo for weakly-textured scenes. In: British Machine Vision Conference, pp. 80–87 (2008)

    Google Scholar 

Download references

Acknowledgment

This research was supported by the ‘Cross-Ministry Giga KOREA Project’ of the Ministry of Science, ICT and Future Planning, Republic of Korea(ROK). [GK15C0100, Development of Interactive and Realistic Massive Giga-Content Technology]

Author information

Authors and Affiliations

  1. Gwangju Institute of Science and Technology (GIST), 123 Cheomdan-Gwagiro, Buk-gu, Gwangju, 500-712, Republic of Korea

    Woo-Seok Jang & Yo-Sung Ho

Authors
  1. Woo-Seok Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yo-Sung Ho .

Editor information

Editors and Affiliations

  1. Gwangju Institute of Science and Technology, Gwangju, Korea (Republic of)

    Yo-Sung Ho

  2. Chinese Academy of Sciences, Institute of Automation, Beijing, China

    Jitao Sang

  3. KAIST, Daejeon, Korea (Republic of)

    Yong Man Ro

  4. KAIST, Daejeon, Korea (Republic of)

    Junmo Kim

  5. College of Computer Science, Zhejiang University, Hangzhou, China

    Fei Wu

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Jang, WS., Ho, YS. (2015). Efficient Disparity Map Generation Using Stereo and Time-of-Flight Depth Cameras. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9315. Springer, Cham. https://doi.org/10.1007/978-3-319-24078-7_64

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24078-7_64

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24077-0

  • Online ISBN: 978-3-319-24078-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation