Abstract
Aiming at fully exploiting the temporal and spatial redundancy and answering the “Call for Proposals” for multi-view video coding (MVC) issued by MPEG, a MVC scheme based on vector field estimation and weighted disparity interpolation is presented. By extending the loop constraint to multi-view images for a parallel camera model and proposing the novel “vector field estimation” scheme, the temporal and spatial redundancy is significantly reduced. Also, weighted disparity interpolation is performed to predict adjacent disparity vectors. Experimental results over multi-view image sets imply that the coding efficiency is improved about 0.2–0.5 dB compared with previous coding approaches such as H.264/AVC simulcast and JMVM.
Similar content being viewed by others
References
ISO/IEC JTC1/SC29/WG11, Updated call for proposal on multi-view video coding, Doc. N7567, Nice, France (2005)
ISO/IEC JTC1/SC29/WG11, Requirements on multi-view video coding v.2, Doc. N7282, Poznan, Poland (2005)
ISO/IEC JTC1/SC29/WG11, Survey of algorithms used for multi-view video coding (MVC), Doc. N6909, Hong Kong, China (2005)
Y. Kim, J. Kim, K. Sohn, Fast disparity and motion estimation for multi-view video coding. IEEE Trans. Consum. Electron. 53(2), 712–719 (2007)
K. Mueller, P. Merkle, H. Schwarz, T. Hinz, A. Smolic, T. Oelbaum, T. Wiegand, Multi-view video coding based on H.264/AVC using hierarchical B-frames, in Proceedings of the Picture Coding Symposium, Beijing, China (2006)
L. Oisel, E. Memin, L. Morin, F. Galpin, One-dimensional dense disparity estimation for three-dimensional reconstruction. IEEE Trans. Image Process. 12(9), 1107–1119 (2003)
M. Siegel, S. Sethuraman, J. McVeigh, A. Jordan, Compression and interpolation of 3-D stereoscopic and multiview video. Stereosc. Disp. Virtual Real. Syst. 3012, 227–238 (1997)
M. Tagliasacchi, L. Frigerio, S. Tubaro, Rate-distortion analysis of motion-compensated interpolation at the decoder in distributed video coding. IEEE Signal Process. Lett. 14(9), 625–628 (2007)
B.L. Tseng, D. Anastassiou, Multiviewpoint video coding with MPEG-2 compatibility. IEEE Trans. Circuits Syst. Video Technol. 6, 414–419 (1996)
D. Tzovaras, I. Kompatsiaris, M.G. Strintzis, 3D object articulation and motion estimation in model-based stereoscopic videoconference image sequence analysis and coding. Signal Process. Image Commun. 14, 817–840 (1999)
W. Yang, K. Ngan, J. Lim, K. Sohn, Joint motion and disparity fields estimation for stereoscopic video sequences. Signal Process. Image Commun. 20(3), 265–276 (2005)
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by Natural Science Foundation of China (grant No. 60832003 and 60672052), Shuguang Projects of Shanghai (06SG43) and the key project of Shanghai Education Committee (09ZZ90).
Rights and permissions
About this article
Cite this article
Liu, S., An, P., Zhang, Z. et al. Multi-View Video Coding Based on Vector Estimation and Weighted Disparity Interpolation. Circuits Syst Signal Process 28, 913–923 (2009). https://doi.org/10.1007/s00034-009-9129-0
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-009-9129-0