Abstract
One of the most efficient approaches to generate the side information (SI) in distributed video codecs is through motion compensated frame interpolation where the current frame is estimated based on past and future reference frames. However, this approach leads to significant spatial and temporal variations in the correlation noise between the source at the encoder and the SI at the decoder. In such scenario, it would be useful to design an architecture where the SI can be more robustly generated at the block level, avoiding the creation of SI frame regions with lower correlation, largely responsible for some coding efficiency losses. In this paper, a flexible framework to generate SI at the block level in two modes is presented: while the first mode corresponds to a motion compensated interpolation (MCI) technique, the second mode corresponds to a motion compensated quality enhancement (MCQE) technique where a low quality Intra block sent by the encoder is used to generate the SI by doing motion estimation with the help of the reference frames. The novel MCQE mode can be overall advantageous from the rate-distortion point of view, even if some rate has to be invested in the low quality Intra coding blocks, for blocks where the MCI produces SI with lower correlation. The overall solution is evaluated in terms of RD performance with improvements up to 2 dB, especially for high motion video sequences and long Group of Pictures (GOP) sizes.
Similar content being viewed by others
References
Aaron A, Rane S, Girod B (2004) Wyner-Ziv video coding with hash-based motion compensation at the receiver, IEEE ICIP, Singapore, October
Aaron A, Rane S, Girod B (2004) Transform-domain Wyner-Ziv codec for video. SPIE Visual Communications and Image Processing, Santa Clara
Artigas X, Ascenso J, Dalai M, Klomp S, Kubasov D, Ouaret M (2007) The DISCOVER codec: architecture, techniques and evaluation, Picture Coding Symposium, Lisbon, Portugal, November
Ascenso J, Pereira F. Advanced side information creation techniques and framework for Wyner-Ziv video coding, Journal of Visual Communication and Image Representation, Special Issue Resource-aware Adaptive Video Streaming. doi:10.1016/j.jvcir.2008.06.001
Ascenso J, Brites C, Pereira F (2005) Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding, 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services, Slovak Republic, July
Ascenso J, Brites C, Pereira F (2005) Motion compensated refinement for low complexity pixel based distributed video coding, IEEE International Conference on Advanced Video and Signal Based Surveillance, Como, Italy, September
Ascenso J, Brites C, Pereira F (2006) Content adaptive Wyner-Ziv video coding driven by motion activity, IEEE ICIP, Atlanta, GA, USA, October
Brites C (2005) Advances on distributed video coding, M.Sc. Thesis, Instituto Superior Técnico, Technical University of Lisbon, Portugal, December
Brites C, Pereira F (2008) Correlation noise modeling for efficient pixel and transform domain Wyner-Ziv video coding. IEEE Trans Circ Syst Video Tech 18(9):1177–1190. doi:10.1109/TCSVT. 2008.924107
Brites C, Ascenso J, Pereira F (2006) Improving transform domain Wyner-Ziv video coding performance, IEEE ICASSP, May, Toulouse, France
Brites C, Ascenso J, Pedro J, Pereira F (2008) Evaluating a feedback channel based transform domain Wyner-Ziv video codec. EURASIP Signal Process Image Commun 23(4):269–297. doi:10.1016/j.image.2008.03.002
Clerckx T, Munteaunu A, Cornelis J, Schelkens P (2007) Distributed video coding with shared encoder/decoder complexity, IEEE ICIP, San Antonio, TX, USA, September
Information Technology: Coding of audio-visual objects, part 10: advanced video coding, ISO/IEC Std. 14496-10 (2003)
Kubasov D, Lajnef K, Guillemot C (2007) A hybrid encoder/decoder rate control for Wyner-Ziv video coding with a feedback channel, IEEE International Workshop on Multimedia Signal Processing, Chania, Crete, Greece, October
Kubasov D, Nayak J, Guillemot C (2007) Optimal reconstruction in Wyner-Ziv video coding with multiple side information, IEEE International Workshop on Multimedia Signal Processing, Chania, Crete, Greece, October
Liu L, He D, Jagmohan A, Lu L, Delp EJ (2008) A low-complexity iterative mode selection algorithm for Wyner-Ziv video compression, IEEE ICIP, San Diego, CA, USA, October
Martinian E, Vetro A, Yedidia JS, Ascenso J, Khisti A, Malioutov D (2006) Hybrid distributed video coding using sca codes. IEEE Multimedia Signal Processing Workshop, Victoria
Mukherjee D, Macchiavello B, Queiroz R (2007) A simple reversed-complexity Wyner-Ziv video coding mode. SPIE Visual Communications and Image Processing, San Jose
Puri R, Majumdar A, Ramchandran K (2007) PRISM: a video coding paradigm with motion estimation at the decoder. IEEE Trans Image Process 16(10):2436–2448. doi:10.1109/TIP.2007.904949
Slepian D, Wolf J (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19(4):471–480. doi:10.1109/TIT.1973.1055037
Song BC, Chun KW (2004) Motion-compensated temporal filtering for denoising in video encoder. Electron Lett 40(13):802–804. doi:10.1049/el:20040550
Tagliasacchi M, Trapanese A, Tubaro S, Ascenso J, Brites C, Pereira F (2006) Intra mode decision based on spatio-temporal cues in pixel domain Wyner-Ziv video coding, IEEE ICASSP, May, Toulouse, France
Trapanese A, Tagliasacchi M, Tubaro S, Ascenso J, Brites C, Pereira F (2005) Embedding a block-based intra mode in frame-based pixel domain wyner-ziv video coding, International Workshop on Very Low Bitrate Video, Sardinia, Italy, September
Tsai D-C, Lee C-M, Lie W-N (2007) Dynamic key block decision with spatio-temporal analysis for Wyner-Ziv video coding, IEEE ICIP, San Antonio, TX, USA, September
Tseng IH, Ortega A (2005) Motion estimation at the decoder using maximum likelihood techniques for distributed video coding, Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, November
Turaga DS, van der Schaar M, Andreopoulos Y, Munteanu A, Schelkens P (2005) Unconstrained motion compensated temporal filtering (UMCTF) for efficient and flexible interframe wavelet video coding. EURASIP Signal Process Image Commun J 20(1):1–19. doi:10.1016/j.image.2004.08.006
Varodayan D, Chen D, Flierl M, Girod B (2008) Wyner-Ziv coding of video with unsupervised motion vector learning. EURASIP Signal Process Image Commun J Spec Issue Distrib Video Coding 23(5):369–378
Vo DT, Nguyen TQ (2008) Quality enhancement for motion JPEG using temporal redundancies. IEEE Trans Circ Syst Video Tech 18(5):609–619. doi:10.1109/TCSVT.2008.918807
Wang H, Cheung N-M, Ortega A. A framework for adaptive scalable video coding using Wyner-Ziv techniques, EURASIP Journal on Applied Signal Processing, vol. 2006
Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circ Syst Video Tech 13(7):560–576. doi:10.1109/TCSVT.2003.815165
Wyner A, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22(1):1–10. doi:10.1109/TIT.1976.1055508
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ascenso, J., Brites, C. & Pereira, F. A flexible side information generation framework for distributed video coding. Multimed Tools Appl 48, 381–409 (2010). https://doi.org/10.1007/s11042-009-0316-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-009-0316-6