Skip to main content
SpringerLink
Log in

Error-resilient multi-view video coding using Wyner-Ziv techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, a Wyner-Ziv (WZ) coding based error-resilient scheme is proposed for multi-view video transmission over error-prone channels. At the encoder, the key frames of the odd views are protected by WZ encoding to generate the auxiliary bit-stream alongside the multi-view video coded bit-stream. At the decoder, error-concealed multi-view decoded frames are used as the side information (SI) for WZ decoding. Based on the study on the characteristics of multi-view video coding (MVC) and the propagating behavior of channel errors, a recursive model to estimate the transmission distortion is developed in the transform domain, in which the channel-induced distortion takes into consideration both motion and disparity compensation. With the proposed model, we propose a rate control strategy for WZ encoding to infer the minimum bit rate so as to correct the SI errors. The WZ bit rate estimation method exploits the correlation between the original bit-planes and the SI bit-planes as well as the bit-plane interdependency. Extensive experimental results show that the proposed error-resilient scheme outperforms Reed Solomon based forward error correction method by about 1.1 dB and outperforms the adaptive intra refresh algorithm by approximately 1.6 dB at the packet loss rate 10 %.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Advanced video coding for generic audiovisual services (2012) Standard ISO/IEC JTC 1

  2. Aarion A, Rane S, Setton E, Griod B (2004) Transform-domain Wyner-Ziv codec for video. In: Proceedings of the visual communications and image processing. San Jose

  3. Brites C, Pereira F (2008) Correlation noise modeling for efficient pixel and transform domain Wyner-Ziv video coding. IEEE Trans Circ Syst Video Technol 18(9):1177–1189

    Article  Google Scholar 

  4. Brites C, Pereira F (2011) An efficient encoder rate control solution for transform domain Wyner-Ziv video coding. IEEE Trans Circ Syst Video Technol 21(9):1278–1292

    Article  Google Scholar 

  5. Crave O, Pesquet-Popescu B, Guillemot C (2010) Robust video coding based on multiple description scalar quantization with side information. IEEE Trans Circ Syst Video Technol 20(6):769–779

    Article  Google Scholar 

  6. (2006) Description of core experiments in MVC. ISO/IEC JTC1/SC29/WG11, MPEG2006/W7798

  7. Dissanaayake MB, Sevail DVSXD, Worrall ST, Fernando WAC (2010) Error resilient technique for MVC using redundant disparity vectors. In: Proceedings of the IEEE international conference multimedia and expo (ICME), pp 1712–1717

  8. Girod B, Aaron AM, Rane S, Rebollo-Monedero D (2005) Distributed video coding. Proceedings IEEE 93(1):71–83

    Article  Google Scholar 

  9. Guillemot C, Pereira F, Torres L, Ebrahimi T, Leonardi R, Ostermann J (2007) Distributed monoview and multiview video coding. IEEE Signal Proc Mag 24(5):67–76

    Article  Google Scholar 

  10. Guo X, Wu F, Zhao D, Gao W (2008) Wyner-Ziv-based multiview video coding. IEEE Trans Circ Syst Video Technol 18(6):713–724

    Article  Google Scholar 

  11. He Z, Cai J, Wen Chen C (2002) Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding. IEEE Trans Circ Syst Video Technol 12(6):511–523

    Article  Google Scholar 

  12. He Z, Liang Y, Chen L, Ahmad I, Wu D (2005) Power-rate-distortion analysis for wireless video communication under energy constraint. IEEE Trans Circ Syst Video Technol 15(5):645–657

    Article  Google Scholar 

  13. He Z, Xiong H (2006) Transmission distortion analysis for real time video encoding and streaming over wireless networks. IEEE Trans Circ Syst Video Technol 16(9):1051–1062

    Article  MATH  Google Scholar 

  14. ISO/IEC JTC1/SC29/WG11 (2008) WD 3 Reference Software for MVC, Doc. JVT-AC207. Busan

  15. Kubasov D, Nayak J, Guillemot C (2007) Optimal reconstruction in Wyner-Ziv video coding with multiple side information. In: Proceedings of the IEEE 9th workshop multimedia signal process, pp 183–186

  16. Kubota A, Smolic A, Magnor M, Tanimoto M, Chen T, Zhang C (2007) Multiview imaging and 3DTV. IEEE Signal Proc Mag 24(6):10–21

    Article  Google Scholar 

  17. Li Y, Ma S, Zhao D, Gao W (2009) Modeling correlation noise statistics at decoder for multi-view distributed video coding: In: Proceedings of the IEEE symposium circuits and systems, pp 2597–2600

  18. Liu S, Chen Y, Wang Y-K, Gabbouj M, Hannuksela MM, Li H (2008) Frame loss error concealment for multi-view video coding. In: Proceedings of the IEEE international symposium circuits and system (ISCAS), pp 3470–3473

  19. Merkle P, Smolic A, Mller K, Wiegand T (2007) Efficient prediction structures for multiview video coding. IEEE Trans Circ Syst Video Technol 17(11):1461–1473

    Article  Google Scholar 

  20. Puri R, Majumdar A, Ishwar P, Ramchandran K (2006) Distributed video coding in wireless sensor networks. IEEE Signal Proc Mag 23(4):94–106

    Article  MATH  Google Scholar 

  21. Qing L, Masala E, He X (2013) Practical distributed video coding in pakcet lossy channel. Opt Engineering 52(7):1–18

    Article  MATH  Google Scholar 

  22. Rane S, Baccichet P, Girod B (2008) Systematic lossy error protection of video signals. IEEE Trans Circ Syst Video Technol 18(10):1347–1360

    Article  Google Scholar 

  23. Sehgal A, Jagmohan A, Ahuja N (2004) Wyner-Ziv coding of video: an error resilient compression framework. IEEE Trans Multimed 6(2):249–258

    Article  Google Scholar 

  24. Schier M, Welzl M (2012) Optimizing selective ARQ for H.264 live streaming: a novel method for predicting loss impact in real time. IEEE Trans Multimed 14(2):415–430

    Article  Google Scholar 

  25. Slepian D, Wolf JK (1973) Noiseless coding of correlated information sources. IEEE Trans Inform Theory IT-19(4):471–480

    Article  MathSciNet  Google Scholar 

  26. Song K, Chung T, Oh Y, Kim CS (2009) Error concealment of multi-view video sequences using inter-view and intra-view correlations. J Vis Commun Image Represent 20(4):281–292

    Article  Google Scholar 

  27. Tan AS, Aksay A, Akar GB, Arikan E (2009) Rate-distortion optimization for stereoscopic video streaming with unequal error protection. In: Eurasip Journal on Advances in Signal Processing, pp 14

  28. Varodayan D, Aaron A, Girod B (2006) Rate-adaptive codes for distributed source coding. Signal Process (EURASIP) 86:3123–3130

    Article  Google Scholar 

  29. Vetro A, Wiegand T, Sullivan GJ (2011) Overview of the stereo and multi-view video coding extensions of the H.264/MPEG-4 AVC standard. Proceedings of the IEEE 99(4):626–642

    Article  MATH  Google Scholar 

  30. Wang J, Majumdar A, Ranmchandran K (2009) Robust video transmission with distributed source coded auxiliary channel. IEEE Trans Image Process 18(12):2695–2705

    Article  MathSciNet  Google Scholar 

  31. Wenger S (2001) Common condition for wire-line, low delay IP/UDP/RTP packet loss resilient testing. ITU-T VCEG document VCEG-N79r1

  32. Wenger S (1999) Proposed error patterns for internet experiments. ITU-T VCEG document Q15-I-16r1

  33. Wyner A, Ziv J (1976) The rate-distortion function for souce coding with side information at the decoder. IEEE Trans Inform Theory IT-22(1):1–10

    Article  MathSciNet  Google Scholar 

  34. Xiang X, Zhao D, Wang Q, Ma S, Gao W (2009) Rate-distortion optimization with inter-view refreshment for stereoscopic video coding over error-prone networks. In: Proceedings SPIE visual communications and image processing. San Jose

  35. Xiang W, Zhu C, Siew CK, Xu Y, Liu M (2009) Forward error correction-based 2-D layered multiple description coding for error resilient H.264 SVC video transmission. IEEE Trans Circ Syst Video Technol 19(12):1730–1738

    Article  Google Scholar 

  36. Xue Z, Loo KK, Cosmas J, Tun M, Feng L, Yip P-Y (2010) Error resilient scheme for wavelet video codec using automatic ROI dectection and Wyner-Ziv coding over packet erasure channel. IEEE Trans Broadcast 56(4):481–493

    Article  Google Scholar 

  37. Yajnik M, Moon SB, Kurose J, Towsley D (1999) Measurement and modeling of the temporal dependence in packet loss. In: Proceedings of the IEEE INFOCOM, vol 1. pp 345–352

  38. Yang H, Rose K (2010) Optimizing motion compensated prediction for error resilient video coding. IEEE Trans Image Process 19(1):108–118

    Article  MathSciNet  Google Scholar 

  39. Yeo C, Ramchandran K (2010) Robust distributed multiview video compression for wireless camera networks. IEEE Trans Image Process 19(4):995–1008

    Article  MathSciNet  Google Scholar 

  40. Zhang R, Regunathan SL, Rose K (2000) Video coding with optimal inter/intra-mode switching for packet loss resilience. IEEE J Sel Areas Commun 18(6):966–976

    Article  Google Scholar 

  41. Zhang Y, Gao W, Lu Y, Huang Q, Zhao D (2007) Joint source-channel rate-distortion optimization for H.264 video coding over error-prone networks. IEEE Trans Multimed 9(3):445–454

    Article  Google Scholar 

  42. Zhang Y, Zhu C, Yap K (2008) A joint source-channel video coding scheme based on distributed video coding. IEEE Trans Multimed 10(8):1648–1656

    Article  Google Scholar 

  43. Zhang Y, Xiong H, He Z, Yu S, Chen C (2011) An error resilient video coding scheme using embedded Wyner-Ziv description with decoder side Non-stationary distortion modeling. IEEE Trans Circ Syst Video Technol 21(4):498–512

    Article  Google Scholar 

  44. Zhou Y, Hou C, Xiang W, Wu F (2011) Channel distortion modeling for multi-view video transmission over packet-swtiched networks. IEEE Trans Circ Syst Video Technol 21(11):1679–1692

    Article  Google Scholar 

  45. Zhu C, Wang Y, Hannuksela M, Li H (2009) Error resilient video coding using redundant pictures. IEEE Trans Circ Syst Video Technol 19(1):3–14

    Article  Google Scholar 

Download references

Acknowledgments

This work was partially supported by the Natural Science Foundation of China (No. 61036008), and Queensland Government’s Smart Futures Fellowship.

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Southwest Jiaotong University, Chengdu, 610031, Sichuan, China

    Pan Gao & Qiang Peng

  2. School of Mechanical and Electrical Engineering, University of Southern Queensland, Toowoomba, QLD, 4350, Australia

    Pan Gao & Wei Xiang

Authors
  1. Pan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qiang Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Xiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pan Gao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, P., Peng, Q. & Xiang, W. Error-resilient multi-view video coding using Wyner-Ziv techniques. Multimed Tools Appl 74, 7957–7982 (2015). https://doi.org/10.1007/s11042-014-2033-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2033-z

Keywords

Search

Navigation