Abstract
The multi-view video is a collection of multiple videos, capturing the same scene at different viewpoints. If we acquire multi-view videos from multiple cameras, it is possible to generate scenes at arbitrary view positions. It means that users can change their viewpoints freely and can feel visible depth with view interaction. Therefore, the multi-view video can be used in a variety of applications including three-dimensional TV (3DTV), free viewpoint TV, and immersive broadcasting. However, since the data size of the multi-view video linearly increases as the number of cameras, it is necessary to develop an effective framework to represent, process, and display multi-view video data. In this paper, we propose inter-camera coding methods of multi-view video using layered depth image (LDI) representation. The proposed methods represents various information included in multi-view video hierarchically based on LDI. In addition, we reduce a large amount of multi-view video data to a manageable size by exploiting spatial redundancies among multiple videos and reconstruct the original multiple viewpoints successfully from the constructed LDI.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ISO/IEC JTC1/SC29/WG11 N6720: Call for Evidence on Multi-view Video Coding (October 2004)
ISO/IEC JTC1/SC29/WG11 N6999: Report of the Subjective Quality Evaluation for Multi-view Coding CfE (January 2005)
ISO/IEC JTC1/SC29/WG11 N7327: Call for Proposals on Multi-view Video Coding (July 2005)
ISO/IEC JTC1/SC29/WG11 N7779: Subjective Test Results for the CfP on Multi-view Video Coding. (January 2006)
Shade, J., Gotler, S., Szeliski, R.: Layered Depth Images. In: Proc. of ACM SIGGRAPH, pp. 291–298 (July 1998)
Yoon, S.U., Kim, S.Y., Lee, E.K., Ho, Y.S.: A Framework for Multi-view Video Coding using Layered Depth Images. In: Ho, Y.-S., Kim, H.J. (eds.) PCM 2005. LNCS, vol. 3767, pp. 431–442. Springer, Heidelberg (2005)
Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality Video View Interpolation using a Layered Representation. In: Proc. of ACM SIGGRAPH, pp. 600–608 (August 2004)
Kanade, T., Rander, P.W., Narayanan, P.J.: Virtualized Reality: Constructing Virtual Worlds from Real Scenes. IEEE Multimedia Magazine 1(1), 34–47 (1997)
Matusik, W., Buehler, C., McMillan, L., Gortler, S.J.: Image-based Visual Hulls. In: Proc. of ACM SIGGRAPH, pp. 369–374 (2000)
Carranza, C., Theobalt, C., Magnor, M.A., Seidel, H.-P.: Free-viewpoint Video of Human Actors. ACM Trans. on Graphics 22(3), 569–577 (2003)
Yang, J.C., Everett, M., Buehler, C., McMillan, L.: A Real-time Distributed Light Field Camera. In: Eurographics Workshop on Graphics, pp. 77–85 (2002)
Yoon, S.U., Lee, E.K., Kim, S.Y., Ho, Y.S., Yun, K., Cho, S., Hur, N.: Coding of Layered Depth Images Representing Multiple Viewpoint Video. In: Proc. of Picture Coding Symposium (PCS), SS3-2, pp. 1–6 (April 2006)
Duan, J., Li, J.: Compression of the LDI. IEEE Trans. on Image Processing 12(3), 365–372 (2003)
Interactive Visual Media Group at Microsoft Research, http://research.microsoft.com/vision/InteractiveVisualMediaGroup/3DVideoDownload/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yoon, SU. et al. (2006). Inter-camera Coding of Multi-view Video Using Layered Depth Image Representation. In: Zhuang, Y., Yang, SQ., Rui, Y., He, Q. (eds) Advances in Multimedia Information Processing - PCM 2006. PCM 2006. Lecture Notes in Computer Science, vol 4261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11922162_50
Download citation
DOI: https://doi.org/10.1007/11922162_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48766-1
Online ISBN: 978-3-540-48769-2
eBook Packages: Computer ScienceComputer Science (R0)