Abstract
We propose a real-time 3D modeling system using multiple stereo cameras which is a method for displaying a target object from an arbitrary view. Each capturing PC segments the objects and estimates disparity fields, then they transmit the data to a 3D modeling server. A modeling server generates 3D models of the objects and renders a video at the designated point of view. A main contribution in this system is a shape-recovery algorithm to derive a 3D scene description from 2D images. We propose an efficient volume carving algorithm using silhouette and disparity at a time that is more robust than conventional algorithms. The algorithm partitions space into an octree and processes it hierarchically so that execution time and space are dramatically reduced. The generated free-view video provides realistic images of dynamically changing scenes in real-time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Izquierdo, E.M., Ohm, J.R.: Image-based Rendering and 3D Modeling: A Complete Framework. Signal Proc.: Image Communication 15, 817–858 (2000)
Redert, P.A.: Multi-viewpoint Systems for 3-D Visual Communication. Ph.D. thesis, Delft University of Technology (2000)
Shapiro, L.G., Stockman, G.C.: Computer Vision, ch. 12. Prentice Hall, New Jersey (2001)
Matusik, W.: Image-Based Visual Hulls. MS Thesis. MIT (1997)
Matsuyama, T., Wu, X., Takai, T., Wada, T.: Real-Time Dynamic 3-D Object Shape Reconstruction and High-Fidelity Texture Mapping for 3-D Video. IEEE Trans. CSVT 14, 357–369 (2004)
Yemeza, Y., Schmitt, F.: 3D Reconstruction of Real Objects with High Resolution Shape and Texture. Image and Vision Computing 22, 1137–1153 (2004)
Esteban, C.H., Schmitt, F.: Multi-Stereo 3D Object Reconstruction. In: Proc. 3DPVT, pp. 159–167 (2002)
Cheung, G.K.M., Baker, S., Kanade, T.: Visual Hull Alignment and Refinement Across Time: A 3D Reconstruction Algorithm Combining Shape-From-Silhouette with Stereo. In: Proc. CVPR, pp. 375–382 (2003)
Kim, H., Kitahara, I., Kogure, K., Hagita, N., Sohn, K.: Sat-Cam: Personal Satellite Virtual Camera. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3333, pp. 87–94. Springer, Heidelberg (2004)
Kim, H., Choe, Y., Sohn, K.: Disparity Estimation Using Region-dividing Technique with Energy-based Regularization. Optical Engineering 43, 1882–1890 (2004)
Everitt, C.: Projective Texture Mapping. NVIDIA SDK White Paper (2001)
Lorensen, W.E., Cline, H.E.: Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In: SIGGRAPH 1987, vol. 21, pp. 163–169 (1987)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, H., Kitahara, I., Kogure, K., Sohn, K. (2006). A Real-Time 3D Modeling System Using Multiple Stereo Cameras for Free-Viewpoint Video Generation. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2006. Lecture Notes in Computer Science, vol 4142. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11867661_22
Download citation
DOI: https://doi.org/10.1007/11867661_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44894-5
Online ISBN: 978-3-540-44896-9
eBook Packages: Computer ScienceComputer Science (R0)