research-article

VirtualizeMe: interactive model reconstruction from stereo video streams

Authors:

Daniel Knoblauch,

Falko KuesterAuthors Info & Claims

VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

Pages 193 - 196

https://doi.org/10.1145/1450579.1450620

Published: 27 October 2008 Publication History

Get Access

Abstract

Tele-Immersion depends on face-to-face, viewpoint corrected, stereoscopic, virtual environments, allowing users to naturally interact with each other and the digital environment surrounding them, via realistic avatars. This paper presents an extraction, modeling and communication methodology for the creation of the needed avatars, based on a scalable focused disparity map (FDM) approach. The FDM enables variable distance reconstruction of dynamic target objects despite restrictions in disparity range. Combined with a pixel-based disparity cost interpolation, a sub-pixel disparity refinement is achieved, providing a high depth-resolution and smooth reconstruction of the target objects. This technique approaches real-time characteristics, extracting avatar models and communicating them to remote render nodes at 15 frames per second.

References

[1]

Griesser, A., Roeck, D. S., Neubeck, A., and L., V. G. 2005. Gpu-based foreground-background segmentation using an extended colinearity criterion. In Proc. of Vision, Modeling, and Visualization (VMV), 319--326.

Google Scholar

[2]

Gross, M., Wrmlin, S., Naef, M., Lamboray, E., Spagno, C., Kunz, A., Koller-Meier, E., Svoboda, T., Gool, L. V., Lang, S., Strehlke, K., Moere, A. V., and Staadt, O. 2003. blue-c: A spatially immersive display and 3d video portal for telepresence. 819--827.

Digital Library

Google Scholar

[3]

Mester, R., Aach, T., and Dümbgen, L. 2001. Illumination-invariant change detection using a statistical colinearity criterion. In Proceedings of the 23rd DAGM-Symposium on Pattern Recognition, Springer-Verlag, London, UK, 170--177.

Digital Library

Google Scholar

[4]

Rhee, S.-M., Ziegler, R., Park, J., Naef, M., Gross, M., and Kim, M.-H. 2007. Low-cost telepresence for collaborative virtual environments. Visualization and Computer Graphics, IEEE Transactions on 13, 1, 156--166.

Digital Library

Google Scholar

[5]

Sadagic, A., H., T., Lanier, J., Fuchs, H., Van Dam, A., Daniilidis, K., Mulligan, J., Holden, L., and Zelenik, 2001. National tele-immersion initiative: Towards compelling tele-immersive collaborative environments. Presentation given at Medicine meets Virtual Reality 2001 Conference.

Google Scholar

[6]

Smarr, L. L., Chien, A. A., DeFanti, T., Leigh, J., and Papadopoulos, P. M. 2003. The optiputer. Commun. ACM 46, 11, 58--67.

Digital Library

Google Scholar

[7]

Wu, W., Yang, Z., Nahrstedt, K., Kurillo, G., and Bajcsy, R. 2007. Towards multi-site collaboration in tele-immersive environments. In MULTIMEDIA '07: Proceedings of the 15th international conference on Multimedia, ACM, New York, NY, USA, 767--770.

Digital Library

Google Scholar

[8]

Yang, Q., Wang, L., Yang, R., Wang, S., Liao, M., and Nistér, D. 2006. Real-time global stereo matching using hierarchical belief propagation. In BMVC, British Machine Vision Association, 989--998.

Google Scholar

[9]

Yang, Q., Yang, R., Davis, J., and Nistér, D. 2007. Spatial-depth super resolution for range images. In CVPR, IEEE Computer Society, Minneapolis, MN, USA, 1--8.

Google Scholar

Cited By

View all

Duckworth TRoberts D(2014)Parallel processing for real-time 3D reconstruction from video streamsJournal of Real-Time Image Processing10.1007/s11554-012-0306-19:3(427-445)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1007/s11554-012-0306-1
Sebai DChaieb FGhorbel F(2012)Progressive edge-preserving depth maps coding based on sparse representation2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2012.6365455(1-4)Online publication date: Oct-2012
https://doi.org/10.1109/3DTV.2012.6365455
Kuster CRanieri NAgustina Zimmer HBazin JSun CPopa TGross M(2012)Towards next generation 3D teleconferencing systems2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2012.6365454(1-4)Online publication date: Oct-2012
https://doi.org/10.1109/3DTV.2012.6365454
Show More Cited By

Index Terms

VirtualizeMe: interactive model reconstruction from stereo video streams
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools
        Web conferencing

Recommendations

FPGA based disparity map computation with vergence control

Depth estimation in a scene using image pairs acquired by a stereo camera setup, is one of the important tasks of stereo vision systems. The disparity between the stereo images allows for 3D information acquisition which is indispensable in many machine ...
A novel algorithm for distance measurement using stereo camera
Abstract
Distance estimation can be achieved by using active sensors or with the help of passive sensors such as cameras. The stereo vision system is generally composed of two cameras to mimic the human binocular vision. In this paper, a Python‐based ...
A real-time fuzzy hardware structure for disparity map computation

Stereo images acquired by a stereo camera setup provide depth estimation of a scene. Numerous machine vision applications deal with retrieval of 3D information. Disparity map recovery from a stereo image pair involves computationally complex algorithms. ...

Comments

Information & Contributors

Information

Published In

VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

October 2008

288 pages

ISBN:9781595939517

DOI:10.1145/1450579

Conference Chairs:
Steven Feiner
Columbia University
,
Daniel Thalmann
Ecole Polytechnique Fédérale de Lausanne
,
Pascal Guitton
Université de Bordeaux
,
Program Chairs:
Bernd Fröhlich
Bauhaus-Univ. Weimar
,
Ernst Kruijff
TU Graz
,
Martin Hachet
INRIA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRST08

Sponsor:

VRST08: The ACM Symposium on Virtual Reality Software and Technology

October 27 - 29, 2008

Bordeaux, France

Acceptance Rates

VRST '08 Paper Acceptance Rate 12 of 68 submissions, 18%;

Overall Acceptance Rate 66 of 254 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
274
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Duckworth TRoberts D(2014)Parallel processing for real-time 3D reconstruction from video streamsJournal of Real-Time Image Processing10.1007/s11554-012-0306-19:3(427-445)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1007/s11554-012-0306-1
Sebai DChaieb FGhorbel F(2012)Progressive edge-preserving depth maps coding based on sparse representation2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2012.6365455(1-4)Online publication date: Oct-2012
https://doi.org/10.1109/3DTV.2012.6365455
Kuster CRanieri NAgustina Zimmer HBazin JSun CPopa TGross M(2012)Towards next generation 3D teleconferencing systems2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2012.6365454(1-4)Online publication date: Oct-2012
https://doi.org/10.1109/3DTV.2012.6365454
Donate ALiu XCollins E(2011)Efficient Path-Based Stereo Matching With Subpixel AccuracyIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics10.1109/TSMCB.2010.204983941:1(183-195)Online publication date: 1-Feb-2011
https://dl.acm.org/doi/10.1109/TSMCB.2010.2049839
Vaiapury KIzquierdo E(2010)An O-FDP Framework in 3D Model Based ReconstructionProceedings of the 2010 12th International Asia-Pacific Web Conference10.1109/APWeb.2010.79(424-429)Online publication date: 6-Apr-2010
https://dl.acm.org/doi/10.1109/APWeb.2010.79
Knoblauch DKuester F(2009)Focused Volumetric Visual Hull with Color ExtractionProceedings of the 5th International Symposium on Advances in Visual Computing: Part II10.1007/978-3-642-10520-3_19(208-217)Online publication date: 26-Nov-2009
https://dl.acm.org/doi/10.1007/978-3-642-10520-3_19

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

FPGA based disparity map computation with vergence control

A novel algorithm for distance measurement using stereo camera

A real-time fuzzy hardware structure for disparity map computation

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations