Abstract
This paper presents modeling techniques to generate natural-textured 3D mesh stream from depth image-based representation (DIBR). Although DIBR is a useful representation for expressing 2.5D information of dynamic real objects, its usage is limited to point-based applications. In order to generate smooth and textured 3D mesh models, depth images are captured using active depth sensors, and they are processed with segmentation, noise filtering, and adaptive sampling technique based on the depth variation. 3D meshes are reconstructed by constrained Delaunay triangulation and smoothened with the 3D Gaussian filter. Each mesh model is parameterized for texture mapping of a corresponding color image. Proposed procedures are automated to generate 3D mesh stream from hundreds of image sequence without user interventions. Final output is a natural-textured mesh model per frame, which can be used for arbitrary view synthesis in virtual reality or broadcasting applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smolic, A., Mueller, K., Merkle, P., Rein, T., Eisert, P., Wiegand, T.: Free Viewpoint Video Extraction, Representation, Coding, and Rendering. In: ICIP 2004, IEEE International Conference on Image Processing, Singapore, October 24-27 (2004)
Thomas, G.A., Grau, O.: 3D Image Sequence Acquisition for TV and Film Production. In: Conference Proc. of 1st Symp. on 3D Data Processing Visualization Transmission (2002)
Bazzoni, G., Bianchi, E., Grau, O., et al.: The Origami Project: Advanced Tools and Techniques for High-end Mixing and Interaction between Real and Virtual Content. In: Conference Proc. of 1st Symp. on Data Processing Visualization Transmission (2002)
Remondino, F., Roditakis, A.: 3D Reconstruction of human skeleton from single images or monocular video sequences. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 100–107. Springer, Heidelberg (2003)
Matsuyama, T., Wu, X., Takai, T., Nobuhara, S.: Real-Time 3D Shape Reconstruction, Dynamic 3D Mesh Deformation, and High Fidelity Visualization for 3D Video. International Journal on Computer Vision and Image Understanding 96(3), 393–434 (2004)
Kiriakos, K., Seitz, S.M.: A Theory of Shape by Space Carving. International Journal of Computer Vision 38(3), 199–218 (2000)
Debevec, P., Tayler, C., Malik, J.: Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-based Approach. In: Proceedings of SIGGRAPH 1996, pp. 11–20 (1996)
Niem, W.: Robust and Fast Modelling of 3D Natural Objects from Multiple Views. In: SPIE Proceedings, vol. 2182, pp. 388–397 (1994)
Carranza, J., Theobalt, C., Magnor, M.A., Seidel, H.P.: Free-viewpoint video of human actors. ACM Transactions on Graphics 22(3), 569–577 (2003)
Grau, O., Price, M., Thomas, G.A.: Use of 3d techniques for virtual production. in Proc. of SPIE. In: Conference Proc. of Videometrics and Optical Methods for 3D Shape Measurement, vol. 4309 (2001)
Allen, B., Curless, B., Popovic, Z.: The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics 22(3), 587–594 (2003)
Moccozet, L., Dellas, F., Magnenat-Thalmann, N., Biasotti, S., Mortara, M., Falcidieno, B., Min, P., Veltkamp, R.: Animatable Human Body Model Reconstruction from 3D Scan Data using Templates. In: Proc. CapTech Workshop on Modelling and Motion Capture Techniques for Virtual Environments (2004)
Ignatenko, A., Konushin, A.: A Framework for Depth Image-Based Modeling and Rendering. In: Proc. Graphicon 2003, pp. 169–172 (2003)
Jain, A.K.: Fundamentals of Digital Image Processing. Prentice-Hall, Inc., Englewood Cliffs (1989)
Domiter, V.: Constrained Delaunay triangulation using plane subdivision. In: Proceedings of the 8th Central european seminar on computer graphics, Budmerice, April 19-21, pp. 105–110 (2004)
Eck, M., DeRose, T., Duchamp, T., Hoppe, H., Lounsbery, M., Stuetzle, W.: Multiresolution Analysis of Arbitrary Meshes. In: Proceeding SIGGRAPH 1995, pp. 173–182 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, S.M., Park, J.C., Lee, K.H. (2006). Natural-Textured Mesh Stream Modeling from Depth Image-Based Representation. In: Gavrilova, M., et al. Computational Science and Its Applications - ICCSA 2006. ICCSA 2006. Lecture Notes in Computer Science, vol 3980. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11751540_51
Download citation
DOI: https://doi.org/10.1007/11751540_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34070-6
Online ISBN: 978-3-540-34071-3
eBook Packages: Computer ScienceComputer Science (R0)