Shujie Liu
ABSTRACT
Recent emerging development of three dimensional video (3DV) has been vigorously driving the Multiview Video Coding (MVC) standard developed by Joint Video Team as an amendment to H.264/AVC and the new 3DV standard developed by MPEG. It is expected that 3DV contents will soon be available to various media consumers. Because of the heterogeneous networks and terminal devices, a variety of end users shall not have (1) the 3DV decoder and view synthesize software installed on their devices, and (2) adequate network bandwidth for 3DV content delivery. 3DV transcoder is therefore necessary for users without 3DV decoder to enjoy 3DV services, as well as for service providers to better control virtual view quality of all 3DV customers. In this paper, we report the first 3DV transcoding scheme for virtual view, which is able to generate bitstream of one single view that can be decoded by H.264/AVC. The key idea of the proposed transcoding is to appropriately generate candidate motion and modes based on motion information from other views in the original bitstream making best use of inter-view correlation. These candidate motion and modes are then properly used to encode a virtual view with significantly reduced complexity for decoding by H.264/AVC. Simulation results show that, compared to the straightforward cascade algorithm, the proposed transcoding experiences minor performance loss with a significantly reduced computation cost. Such low complexity transcoding can be deployed at various media gateways to deliver 3DV content to non-3DV devices.
- A. Vetro, W. Matusik, H. Pfister, J. Xin, "Coding Approaches for End-to-End 3D TV Systems," Picture Coding Symposium, 2004.Google Scholar
- MPEG Video and Requirements Subgroup, "Applications and Requirements on 3D Video Coding," Document w11061, MPEG, Xi'an, China, Oct. 2009.Google Scholar
- "Joint Draft 7.0 on Multiview Video Coding", JVT-AA209, Geneva, CH, Apr. 2008.Google Scholar
- Ahmand, X. Wei, Y. Sun and Y-Q. Zhang, "Video Transcoding: An Overview of Various Techniques and Research Issues", IEEE Trans. on Multimedia, Vol. 7, No. 5, Oct. 2005. Google ScholarDigital Library
- E. Kurutepe, M.R. Civanlar and A. M. Tekalp, "Client-Driven Selective Streaming of Multiview Video for Interactive 3DTV", IEEE Trans. on CSVT, Vol. 17, Nov. 2007 Google ScholarDigital Library
- B. Bai, P. Boulanger and J. Harms, "A Multiview Video Transcoder", ACM Multimedia, Hilton, Singapore, Nov. 2005, pp. 503--506 Google ScholarDigital Library
- S. Liu and C. W. Chen, "Multiview Video Transcoding: From Multiple Views to Single View", Proc. PCS 2009, Picture Coding Symposium, Chicago, USA, May 2009. Google ScholarDigital Library
- A. Smolic, K. Mueller, P. Merkele, P. Kauff and T. Wiegand, "An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution", Proc. PCS 2009, Picture Coding Symposium, Chicago, USA, May 2009. Google ScholarDigital Library
- A. Smolic, K. Müller, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, "Intermediate View Interpolation Based on Multiview Video Plus Depth for Advanced 3D Video Systems", Proc. ICIP 2008, IEEE International Conference on Image Processing, San Diego, CA, USA, October 2008.Google ScholarCross Ref
- K. Müller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand, "Reliability-based Generation and View Synthesis in Layered Depth Video", Proc. MMSP 2008, IEEE International Workshop on Multimedia Signal Processing, Cairns, Australia, October 2008.Google ScholarCross Ref
- L. Zitnick, S. B. Kang, M. Uyttendaele, S.Winder, and R. Szeliski, "High-quality video view interpolation using a layered representation," ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004), vol. 23, no. 3, pp. 600--608, Aug. 2004. Google ScholarDigital Library
- M. Tanimoto, T. Fujii, and K. Suzuki, "View Synthesis Algorithm in View Synthesis Reference Software 3.0 (VSRS3.0)," Tech. Rep. Document M16090, ISO/IEC JTC1/SC29/WG11, Feb. 2009Google Scholar
- Microsoft 3D Video Test Sequences (available online: http://research.microsoft.com/ivm/3DVideoDownload/)Google Scholar
- "Common Test Conditions for Multiview Video Coding," JVT-T207, Klagenfurt, Austria, Jul. 2006.Google Scholar
Index Terms
- 3D video transcoding for virtual views
Recommendations
Multiview video transcoding: from multiple views to single view
PCS'09: Proceedings of the 27th conference on Picture Coding SymposiumAs multiview video is gaining more and more attentions, Multiview Video Coding (MVC) standard has been under development by the Joint Video Team as an extension to H.264/AVC. There will be increasingly more multiview video sources for both high end and ...
Leveraging the quantization offset for improved requantization transcoding of H.264/AVC video
PCS'09: Proceedings of the 27th conference on Picture Coding SymposiumRequantization transcoding is a method for reducing the bit rate of compressed video bitstreams. Most research on requantization is concerned with the architectural design, the selection of a suitable quantizer, or the reduction of requantization ...
Requantization transcoding for H.264/AVC video coding
In this paper, efficient solutions for requantization transcoding in H.264/AVC are presented. By requantizing residual coefficients in the bitstream, different error components can appear in the transcoded video stream. Firstly, a requantization error ...
Comments