Abstract
Video plus depth based 3D video gradually goes mobile. Taking into account the time-varying characteristics of wireless communication, this paper proposes a multi-pass varying bit-rate (VBR) control method for mobile 3D video coding. With the collected rate-distortion (RD) information and the reconstructed compressed video and depth in the first and second pass offline encodings, the encoder can establish the virtual view quality model (VVQM) to assess the right virtual view qualities under different rate combinations of video and depth. In the third pass encoding, the encoder utilizes VVQM to find the optimal video/depth target rate allocation, and then independently controls the video and depth rates with the rate-quantization (RQ) model. In the course of rate control, the video/depth rate allocation will be adjusted in real time to meet the varying channel bandwidth constraint. Experimental results show that the proposed rate control method can not only satisfy the VBR transmission requirements of mobile 3D video, but also provide the higher virtual view quality than the rate control method with fixed video/depth ratio rate allocation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vetro, A., Yea, S., Smolic, A.: Towards a 3D video format for auto-stereoscopic displays. In: Proc. of the SPIE: Application of Digital Image Processing XXXI, San Diego, CA, USA (2008)
Merkle, P., Wang, Y., Müller, K., Smolic, A., Wiegand, T.: Video plus Depth Compression for Mobile 3D Services. In: Proc. IEEE 3DTV Conference, Potsdam, Germany (2009)
MPEG 2 Test Model 5, Rev. 2, ISO/IEC JTC1/SC29WG11 (1993)
Ribas-Corbera, J., Lei, S.: Rate Control for Low-Delay Video Communications. ITU Study Group 16, VCEG, Portland, Doc. Q15-A-20 (1997)
Li, Z.G., Pan, F., Lim, K.P., Feng, G., Lin, X., Rahardja, S.: Adaptive basic unit layer rate control for JVT. In: Doc. JVT-G012r1, Pattaya II, Thailand (2003)
Ma, S., Wu, F., Li, Z.: Proposed Draft of Adaptive Rate Control. In: Doc. JVT-H017r3, Geneva, Switzerland (2003)
Yasakethu, S.L.P., Fernando, W.A.C., Kondoz, A.M.: Rate Controlling in Off Line 3D Video Coding Using Evolution Strategy. IEEE Trans. on Consumer Electronics 55(1), 150–157 (2009)
Kamolrat, B., Fernando, W.A.C., Mrak, M.: Rate controlling for color and depth 3D video coding. In: Proc. of the SPIE: Application of Digital Image Processing XXXI, San Diego, CA, USA (2008)
Ma, S., Gao, W., Lu, Y.: Rate-distortion analysis for H.264/AVC video coding and its application to rate control. IEEE Trans. Circuits Syst. Video Technol. 15(12), 1533–1544 (2005)
Liu, Y., Huang, Q., Ma, S., Zhao, D., Gao, W.: Joint Video/Depth Rate Allocation for 3D Video Coding based on View Synthesis Distortion Model. Signal Processing: Image Communication 24(8), 666–681 (2009)
Takagi, K., Takishima, Y., Nakajima, Y.: A study on rate distortion optimization scheme for JVT coder. In: Proc. SPIE, vol. 5150, pp. 914–923 (2003)
Perkins, M.G.: Data Compression of Stereopairs. IEEE Trans. Commun. 40(4), 684–696 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, Y., Peng, G., Hu, Y., Ci, S., Tang, H. (2010). A Multi-pass VBR Rate Control Method for Video Plus Depth Based Mobile 3D Video Coding. In: Qiu, G., Lam, K.M., Kiya, H., Xue, XY., Kuo, CC.J., Lew, M.S. (eds) Advances in Multimedia Information Processing - PCM 2010. PCM 2010. Lecture Notes in Computer Science, vol 6298. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15696-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-15696-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15695-3
Online ISBN: 978-3-642-15696-0
eBook Packages: Computer ScienceComputer Science (R0)