Abstract
Multi-view video has recently gained much attraction from academic and commercial fields because it can deliver the immersive viewing of natural scenes. This paper presents a composition method of generating composite views combined with graphic objects. First we generate virtual views between multi-view cameras using depth and texture images of the input videos. Then we mix graphic objects to the generated view images. A distinctive feature of our approach is that we use an identical coordinate system for camera, virtual, and graphics views. The reason for using the same system for all types of cameras is the ability of full interactions between real scene and graphic objects. Another merit is that the occlusion between them is handled automatically by a graphics engine because z values of real scene and graphic objects are stored in the same z buffer. We present experimental results that validate our proposed method and show that graphic objects could become the inalienable part of the multi-view video. For the validation of our method we used multi-view sequences where a graphic object is mixed into camera and virtual images.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Vetro, A., Matusik, W., Pfister, H., Xin, J.: Coding approach s for end-to-end 3D TV sys-tems. In: Picture Coding Symposium, Dececember (2004)
Zhang, Q., Zhu, W., Zhang, Y-Q.: Resource allocation or multimedia streaming over the Internet. IEEE Trans. on Multimedia 3(3) (September 2001)
Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High- Quality Video View Interpolation Using a Layered Representation. In: SIGGRAPH 2004, Los Angeles, CA, USA (August 2004)
Zhang, C., Chen, T.: A survey on image-based rendering - representation, sampling and compression. In: EURASIP Signal processing: image communication, vol. 19(1), pp. 1–28 (2004)
McMillan, L.: An image-based approach in three-dimensional computer graphics, Ph.D thesis, UNC (1997)
Narayanan, P.J.: Visible space models: 2-D representations for large virtual environments. In: ICVC 1999 (1999)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Woo, W., Kim, N., Iwadate, Y.: Photo-realistic interactive 3D virtual environment generation using multiview video. In: SPIE PW-EI Image and Video Communications and Processing (IVCP), Bellingham, WA, January 2001, vol. 4310, pp. 245–254 (2001)
Mircosoft Research, http://research.microsoft.com/vision/InteractiveVisualMediaGroup/3DVideoDownload/
Hill, Jr. F.S.: Computer Graphics using OpenGL, 2nd edn. Prentice Hall, Englewood Cliffs (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ignatov, A., Kim, M. (2006). Multi-view Video Composition with Computer Graphics. In: Pan, Z., Cheok, A., Haller, M., Lau, R.W.H., Saito, H., Liang, R. (eds) Advances in Artificial Reality and Tele-Existence. ICAT 2006. Lecture Notes in Computer Science, vol 4282. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11941354_30
Download citation
DOI: https://doi.org/10.1007/11941354_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-49776-9
Online ISBN: 978-3-540-49779-0
eBook Packages: Computer ScienceComputer Science (R0)