Skip to main content
SpringerLink
Log in
Book cover

Workshop on Dynamic 3D Imaging

Dyn3D 2009: Dynamic 3D Imaging pp 58–69Cite as

Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 5742))

Abstract

We present an improved framework for real-time segmentation and tracking by fusing depth and RGB color data. We are able to solve common problems seen in tracking and segmentation of RGB images, such as occlusions, fast motion, and objects of similar color. Our proposed real-time mean shift based algorithm outperforms the current state of the art and is significantly better in difficult scenarios.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. Computer Vision and Image Understanding 110(3), 346–359 (2008)

    Article  Google Scholar 

  2. Chen, Z., Husz, Z., Wallace, I., Wallace, A.: Video Object Tracking Based on a Chamfer Distance Transform. In: Proceedings of IEEE International Conference on Image Processing, pp. 357–360 (2007)

    Google Scholar 

  3. Collins, T.: Mean-Shift Blob Tracking through Scale Space. In: CVPR, vol. 2, pp. 234–240 (2003)

    Google Scholar 

  4. Comaniciu, D., Ramesh, V., Meer, P.: Real-Time Tracking of Non-Rigid Objects using Mean Shift. In: CVPR, vol. 2, pp. 142–149 (2000)

    Google Scholar 

  5. Comaniciu, D., Meer, P.: Mean Shift: A Robust Approach towards Feature Space Analysis. IEEE Trans. Pattern Analysis Machine Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  6. Comaniciu, D., Ramesh, V.: Mean Shift and Optimal Prediction for Efficient Object Tracking. In: International Conference on Image Processing, pp. 70–73 (2000)

    Google Scholar 

  7. Crabb, R., Tracey, C., Puranik, A., Davis, J.: Real-time Foreground Segmentation via Range and Color Imaging. In: CVPR Workshop on Time of Flight Camera Based Computer Vision (2008)

    Google Scholar 

  8. Gould, S., Baumstarck, P., Quigley, M., Ng, A., Koller, D.: Integrating Visual and Range Data for Robotic Object Detection. In: M2SFA2 2008: Workshop on Multi-camera and Multimodal Sensor Fusion (2008)

    Google Scholar 

  9. Gvili, R., Kaplan, A., Ofek, E., Yahav, G.: Depth Key. SPIE Electronic Imaging (2006)

    Google Scholar 

  10. Hahne, U., Alexa, M.: Combining time-of-flight Depth and Stereo Images without Accurate Extrinsic Calibration. In: Workshop on Dynamic 3D Imaging (2007)

    Google Scholar 

  11. Kuhnert, K., Stommel, M.: Fusion of stereo-camera and pmd-camera data for real-time suited precise 3d environment reconstruction. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4780–4785 (2006)

    Google Scholar 

  12. Leichter, I., LindenBaum, M., Rivlin, E.: A General Framework for Combining Visual Trackers - The Black Boxes Approach. International Journal of Computer Vision 67(3), 343–363 (2006)

    Article  Google Scholar 

  13. Liu, C., Freeman, W., Szeliski, R., Bing Kang, S.: Noise Estimation from a Single Image. In: CVPR, vol. 1, pp. 901–908 (2006)

    Google Scholar 

  14. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, pp. 1150–1157 (1999)

    Google Scholar 

  15. Paris, S., Kornprobst, P., Tumblin, J., Durand, F.: A Gentle Introduction to Bilateral Filtering and its Applications. ACM Siggraph Course Notes (2008)

    Google Scholar 

  16. Reulke, R.: Combination of Distance Data with High Resolution Images. In: IEVM Proceedings (2006)

    Google Scholar 

  17. Sabeti, L., Parvizi, E., Wu, J.: Visual Tracking Using Color Cameras and time-of-flight Range Imaging Sensors. Journal of Multimedia 3(2), 28–36 (2008)

    Article  Google Scholar 

  18. Tang, F., Harville, M., Tao, H., Robinson, I.N.: Fusion of Local Appearance with Stereo Depth for Object Tracking. In: CVPR, pp. 142–149 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, The Hebrew University of Jerusalem, Jerusalem, 91904, Israel

    Amit Bleiweiss & Michael Werman

Authors
  1. Amit Bleiweiss
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael Werman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Computer Graphics Group, University of Siegen, 57068, Siegen, Germany

    Andreas Kolb

  2. Computer Science Department, Kiel University, Germany

    Reinhard Koch

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bleiweiss, A., Werman, M. (2009). Fusing Time-of-Flight Depth and Color for Real-Time Segmentation and Tracking. In: Kolb, A., Koch, R. (eds) Dynamic 3D Imaging. Dyn3D 2009. Lecture Notes in Computer Science, vol 5742. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03778-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03778-8_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03777-1

  • Online ISBN: 978-3-642-03778-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation