Skip to main content
SpringerLink
Log in

Decoder side information generation techniques in Wyner-Ziv video coding: a review

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In Wyner-Ziv (WZ) video coding, decoder side information (SI) takes a key role in a WZ video codec among other building blocks. In this paper, we review the decoder SI generation techniques according to the information utilized in the SI generation process. Specifically, motion compensated extrapolation based approaches, motion compensated interpolation based approaches, and hash-based decoder motion estimation approaches in which auxiliary information is sent by the encoder side. We also review the approaches for decoder SI refinement. The review will help us get insight in the current development of the topic and understand how new and better decoder SI generation approaches can be designed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Aaron A, Girod B (2004) Wyner-ziv video coding with low encoder complexity. In: Picture Coding Symposium 2004, PCS 2004. PCS—Tektronix, Inc., pp 429–433

  2. Aaron A, Rane S, Girod B (2004) Wyner-ziv video coding with hash-based motion compensation at the receiver. In: IEEE International Conference on Image Processing, ICIP 2004. vol 2. IEEE, pp 3097–3100

  3. Aaron A, Zhang R, Girod B (2002) Wyner-ziv coding of motion video. In: The thirty-sixth asilomar conference on signals systems and computers. Conference record of the asilomar conference on signals, systems and computers, vol 1. IEEE Computer Society, pp 240–244

  4. Abou-Elailah A, Dufaux F, Farah J, Cagnazzo M, Pesquest-Popescu B (2013) Fusion of global and local motion estimation for distributed video coding. IEEE Trans Circuits Syst Video Technol 23(1):158–172

    Article  Google Scholar 

  5. Adikari ABB, Fernando WAC, Arachchi HK, Weerakkody WARJ (2006) Sequential motion estimation using luminance and chrominance information for distributed video coding of wyner-ziv frames. Electron Lett 42(7):398–399

    Article  Google Scholar 

  6. Anbu A, Zymnis A (2005) Hash-aided motion estimation. Tech. rep., Stanford University

  7. Argyropoulos S, Thomos N, Boulgouris NV, Strintzis MG (2007) Adaptive frame interpolation for wyner-ziv video coding. In: IEEE 9th workshop on Multimedia Signal Processing, 2007, MMSP 2007, 1–3 Oct 2007. IEEE, pp 159–162

  8. Artigas X, Torres L (2005) Iterative generation of motion-compensated side information for distributed video coding. In: IEEE International Conference on Image Processing, ICIP 2005, vol 1. IEEE, pp 833–836

  9. Artigas X, Torres L (2006) An approach to distributed video coding using 3d face models. In: IEEE international conference on image processing, ICIP 2006. IEEE, p 284

  10. Ascenso J, Brites C, Pereira F (2005) Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding. In: 5th EURASIP conference on speech and image processing, multimedia communications and services. Smolenice, Slovak Republic, pp 1–6

  11. Ascenso J, Brites C, Pereira F (2005) Motion compensated refinement for low complexity pixel based distributed video coding. In: IEEE conference on Advanced Video and Signal Based Surveillance AVSS 2005, 15–16 Sept 2005. IEEE Computer Society, pp 593–598

  12. Ascenso J, Pereira F (2006) Adaptive hash-based side information exploitation for efficient wyner-ziv video coding. In: IEEE International Conference on Image Processing, ICIP 2007, vol 3. IEEE, pp III29–III32

  13. Badem MB, Fernando WAC, Martinez JL, Cuenca P (2009) An iterative side information refinement technique for transform domain distributed video coding. In: IEEE International Conference on Multimedia and Expo, ICME 2009. IEEE Computer Society, pp 177–180

  14. Badem MB, Mrak M, Fernando WAC (2008) Side information refinement using motion estimation in dc domain for transform-based distributed video coding. IEE Electron Lett 44(16):965–966

    Article  Google Scholar 

  15. Cafforio C, Rocca F (1983) The differential method for image motion estimation. Image Sequence Processing and Dynamic Scene Analysis, NATO ASI Series, Vol. 2. 1983. pp. 104–124

  16. Cagnazzo M, Maugey T, Pesquet-Popescu B (2009) A differential motion estimation method for image interpolation in distributed video coding. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2009, 19–24 Apr 2009. IEEE, pp 1861–1864

  17. Choi BT, Lee SH, Ko SJ (2000) New frame rate up-conversion using bi-directional motion estimation. IEEE Trans Consum Electron 46(3):603–609

    Article  Google Scholar 

  18. Dehy R, Pratx G, Wu H (2005) Hash codes for motion estimation of video. Tech. rep., Stanford University

  19. Deligiannis N, Munteanu A, Clerckx T, Cornelis J, Schelkens P (2009) Overlapped block motion estimation and probabilistic compensation with application in distributed video coding. IEEE Signal Process Lett 16(9):743–746

    Article  Google Scholar 

  20. Deligiannis N, Verbist F, Clossifides A et al (2012) Wyner-ziv video coding for wireless lightweight multimedia applications. EURASIP J Wirel Commun Netw 2012:106

    Article  Google Scholar 

  21. Frederik V, Deligiannis N, Jacobs M, Barbarien J et al (2013) Probabilistic motion compensated prediction in distributed video coding. Multimed Tools Appl 66(3):405–430

    Article  Google Scholar 

  22. Girod B, Margot A, Rane S, Rebollo-Monedero D (2005) Distributed video coding. Proc IEEE 93(1):71–83

    Article  Google Scholar 

  23. Guillemot C, Pereira F, Torres L, Ebrahimi T, Leonardi R, Ostermann J (2007) Distributed monoview and multiview video coding. IEEE Signal Proc Mag 24(5):67–76

    Article  Google Scholar 

  24. Guo M, Lu Y, Wu F, Li S, Gao W (2007) Distributed video coding with spatial correlation exploited only at the decoder. In: IEEE International Symposium on Circuits and Systems, ISCAS 2007, 27–30 May 2007. IEEE, pp 41–44

  25. Huang X, Forchhammer S (2008) Improved side information generation for distributed video coding. In: IEEE international workshop on Multimedia Signal Processing, MMSP2008, 8–10 Oct 2008. IEEE, pp 223–228

  26. Huang X et al (2011) Multi-hypothesis transform domain Wyner-Ziv video coding including optical flow. In: IEEE international workshop on Multimedia Signal Processing, MMSP 2011, Oct. 2011. IEEE, pp 1–6

  27. Kaul S, Padilla M, Trejo O (2004) Wyner-ziv video coding with increasingly refined motion estimation. Tech. rep., Stanford University

  28. Kubasov D, Guillemot C (2006) Mesh-based motion-compensated interpolation for side information extraction in distributed video coding. In: IEEE international conference on image processing, ICIP 2006, 8–11 Oct 2006. IEEE, pp 261–264

  29. Lagendijk RL, Sezan MI (1992) Motion compensated frame rate conversion of motion pictures. In: IEEE International Conference on Acoustics, Speech and Signal Processing, 1992 ICASSP-92 (Cat. No.92CH3103-9), 23–26 Mar 1992. IEEE, pp 453–456

  30. Lee J, Moon T, Song K (2005) Hash aided motion estimation: various approaches. Tech. rep., Stanford University

  31. Lee SH, Yang S (2002) Adaptive motion-compensated frame rate up-conversion. Electron Lett 38(10):451–452

    Article  Google Scholar 

  32. Li Z (2005) New methods for motion estimation with applications to low complexity video compression. Doctoral dissertation

  33. Li Z, Delp EJ (2005) Wyner-ziv video side estimator: conventional motion search methods revisited. In: IEEE International Conference on Image Processing 2005, ICIP 2005, 11–14 Sept 2005, vol 1. IEEE, pp 825–828

  34. Li Z, Liu L, Delp EJ (2007) Rate distortion analysis of motion side estimation in wyner-ziv video coding. IEEE Trans Image Process 16(1):98–113

    Article  MathSciNet  Google Scholar 

  35. Lin Y, Song Y, Yeh S (2005) Scalable feature extraction for remote motion estimation. Tech. rep., Stanford University

  36. Liu W, Dong L, Zeng W (2008) Wyner-ziv video coding with multi-resolution motion refinement: theoretical analysis and practical significance. In: Visual Communications and Image Processing 2008, VCIP 2008, vol 6822. SPIE, pp 1–11

  37. Liu W, Dong L, Zeng W (2010) Motion refinement based progressive side-information estimation for wyner-ziv video coding. IEEE Trans Circuits Syst Video Technol 20(12):1863–1875

    Article  Google Scholar 

  38. Macchiavello B, De Queiroz RL, Mukherjee D (2006) Motion-based side-information generation for a scalable wyner-ziv video coder. In: IEEE International Conference on Image Processing, ICIP 2007, vol 6. IEEE, pp VI413–VI416

  39. Martins R, Brites C, Ascenso J, Pereira F (2009) Refining side information for improved transform domain wyner-ziv video coding. IEEE Trans Circuits Syst Video Technol 19(9):1327–1341

    Article  Google Scholar 

  40. Martins R, Brites C, Ascenso J, Pereira F (2010) Statistical motion learning for improved transform domain wyner-ziv video coding. IET Image Process 4(1):28–41

    Article  Google Scholar 

  41. Natario L, Brites C, Ascenso J, Pereira F (2006) Extrapolating side information for low-delay pixel-domain distributed video coding. In: 9th international workshop on visual content processing and representation, VLBV 2005, 15–16 Sept 2005. Lecture Notes in Computer Science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics). LNCS, vol 3893. Springer, pp 16–21

  42. Petrazzuoli G, Cagnazzo M, Pesquet-Popescu B (2010) High order motion interpolation for side information improvement in dvc. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2010, IEEE, pp 2342–2345

  43. Petrazzuoli G, Maugey T, Cagnazzo M, Pesquet-Popescu B (2010) Side information refinement for long duration gops in dvc. In: IEEE international workshop on Multimedia Signal Processing, MMSP 2010. IEEE Computer Society, pp 309–314

  44. Pradhan SS, Ramchandran K (2003) Distributed source coding using syndromes (discus): design and construction. IEEE Trans Inf Theory 49(3):626–643

    Article  MATH  MathSciNet  Google Scholar 

  45. Puri R, Majumdar A, Ishwar P, Ramchandran K (2006) Distributed video coding in wireless sensor networks. IEEE Signal Proc Mag 23(4):94–106

    Article  Google Scholar 

  46. Puri, R., Majumdar, A., Ramchandran, K.: Prism: A video coding paradigm with motion estimation at the decoder. IEEE Trans Image Process 16(10):2436–2448 (2007)

    Article  MathSciNet  Google Scholar 

  47. Puri R, Ramchandran K (2002) Prism: a new robust video coding architecture based on distributed compression principles. In: Proceedings of the annual allerton conference on communication control and computing, vol 40. Citeseer, pp 586–595

  48. Quazi AH (1981) An overview on the time delay estimate in active and passive systems for target localization. IEEE Trans Acoust Speech Signal Process 29(3):527–33

    Article  Google Scholar 

  49. Slepian D, Wolf JK (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19(4):471–480

    Article  MATH  MathSciNet  Google Scholar 

  50. Tagliasacchi M, Trapanese A, Tubaro S, Ascenso J, Brites C, Pereira F (2006) Exploiting spatial redundancy in pixel domain Wyner-Ziv video coding. In: IEEE International Conference on Image Processing, ICIP 2006, 8–11 Oct 2006. IEEE, pp 253–256

  51. Tagliasacchi M, Tubaro S (2007) Hash-based motion modeling in wyner-ziv video coding. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2007 (IEEE Cat. No. 07CH37846). IEEE, pp 509–512

  52. Varodayan D, Aaron A, Girod B (2005) Rate-adaptive distributed source coding using low-density parity-check codes. In: 39th asilomar conference on signals, systems and computer (IEEE Cat. No. 05CH37761), 30 Oct–2 Nov 2005. IEEE, pp 1203–1207

  53. Varodayan D, Chen D, Flierl M, Girod B (2008) Wyner-Ziv coding of video with unsupervised motion vector learning. Signal Process Image Commun 23(5):369–378

    Article  Google Scholar 

  54. Wang D, Vincent A, Blanchfield P, Klepko R (2010) Motion-compensated frame rate up-conversion-part ii: new algorithms for frame interpolation. IEEE Trans Broadcast 56(2):142–149

    Article  Google Scholar 

  55. Wang Y, Jeong J, Wu C, Xiao S (2008) An approach to side information estimation for wyner-ziv video coding. In: 2008 international Congress on Image and Signal Processing (CISP), 27–30 May 2008. IEEE, pp 405–410

  56. Weerakkody WARJ, Fernando WAC, Martinez JL, Cuenca P, Quiles F (2007) An iterative refinement technique for side information generation in dvc. In: IEEE International Conference on Multimedia and Expo, ICME 2007. IEEE pp 164–167

  57. Wei-Jung C, Karam LJ, Abousleman GP (2006) Distributed video coding with 3d recursive search block matching. In: IEEE international symposium on circuits and systems, ISCAS 2006 (IEEE Cat. No. 06CH37717C). IEEE, p 5415–5418

  58. Wyner AD (1974) Recent results in the shannon theory. IEEE Trans Inf Theory IT-20(1):2–10

    Article  MATH  MathSciNet  Google Scholar 

  59. Wyner AD, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory IT-22(1):1–10

    Article  MATH  MathSciNet  Google Scholar 

  60. Xiong Z, Liveris AD, Cheng S (2004) Distributed source coding for sensor networks. IEEE Signal Proc Mag 21(5):80–94

    Article  Google Scholar 

  61. Yangli W, Jechang J, Chengke W, Song X (2007) Wyner-ziv video coding with spatio-temporal side information. In: IEEE International Conference on Multimedia and Expo, ICME 2007. IEEE, pp 132–135

  62. Zhang Y, Zhao D, Ma S, Wang R, Gao W (2009) An auto-regressive model for improved low delay distributed video coding. In: Visual Communications and Image Processing 2009, VCIP 2009. vol 7257. SPIE, p 18–22

  63. Zhang Y, Zhu C (2007) Full search of side information in distributed video coding. In: Image and graphics, 2007. IEEE, pp 246–249

Download references

Acknowledgements

This work was supported in part by the National Science and Technology Major Project of China (2011ZX03001-007-01), the National Basic Research Program of China (2009CB320404), the Fundamental Research Funds for the Central Universities (72115046), and the 111 Project (B08038).

Author information

Authors and Affiliations

  1. State Key Lab. of ISN, Xidian University, Xi’an, Shaanxi, 710071, China

    Yuan Jia, Yangli Wang, Rui Song & Jiandong Li

Authors
  1. Yuan Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yangli Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rui Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jiandong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuan Jia.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jia, Y., Wang, Y., Song, R. et al. Decoder side information generation techniques in Wyner-Ziv video coding: a review. Multimed Tools Appl 74, 1777–1803 (2015). https://doi.org/10.1007/s11042-013-1718-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1718-z

Keywords

Search

Navigation