Abstract
The most recent literature indicates multiple description coding (MDC) as a promising coding approach to handle the problem of video transmission over unreliable networks with different quality and bandwidth constraints. In this work, we describe an approach that moves from the concept of spatial MDC and improves coding efficiency by exploiting some form of scalability. In the algorithm, we first generate four subsequences by sub-sampling, these subsequences are then taken in pairs that will form each of the two descriptions. For each description, one of the original subsequences is predicted from the other one via some scalable algorithms, focusing on the inter layer prediction scheme. The proposed algorithm has been implemented as pre- and post- processing of the standard H.264/SVC coder. The experimental results presented show that the algorithm provides excellent results in several conditions including 3D video sequences.
Similar content being viewed by others
References
van der Schaar M, Chou PA (eds) (2007) Multimedia over IP and wireless networks. Elsevier Inc.
ISO/IEC International Standard (1995) Generic Coding of Moving Pictures and Associated Audio Information: Video. ISO/IEC International Standard ISO/IEC/JTC/SC29/WG11 - ISO/IEC 138182
Li W (2001) Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans Circuits Syst Video Technol 11(3):301–317
Radha H, van der Schaar M, Chen Y (2001) The MPEG-4 fine-grained scalable video coding method for multimedia streamingover IP. IEEE Trans Multimedia 3:53–68
Schwarz H, Marpe D, Wiegand T (2005) Basic concepts for supporting spatial and SNR scalability in the scalable H.264/MPEG4-AVC extension. In: Proceeding of IWSSIP 2005, Chalkida Greece
Goyal VK (2001) Multiple description coding: compression meets the network. Signal Process Mag 18(5):74–93
Wang Y, Reibman R, Lin SN (2005) Multiple description coding for video delivery. Proc IEEE 93(1)57–70
Setton E, Baccichet P, Girod B (2008) Peer-to-Peer live multicast: a video perspective. Proc IEEE 96(1):25–38
Wolf JK, Wyner AD, Ziv J (1980) Source coding for multiple descriptions. Bell Syst Tech J 59(8):1417–1426
Jayant NS (1981) Subsampling of a DPCM speech channel to provide two ‘self-contained’ half-rate channels. Bell Syst Tech J 60(4):501–509
Caramma M, Fumagalli M, Lancini R (2001) Polyphase down-sampling multiple description coding for IP transmission. In: SPIE 2001 visual communications and image processing, San Jose, CA, pp 545–552
Schwarz H, Marpe D, Wiegand T (2004) MCTF and scalability extension of H.264/AVC. In: Proceeding of PCS 2004, San Francisco, CA, USA
Wang Y, Lin S (2002) Error resilient video coding using multiple description motion compensation. IEEE Trans Circuits Syst Video Technol 12(6):438–452
Chen CW, Zeng W, Steinmetz R (eds) (2008) Scanning the issue: recent advances in distributed multimedia communications. In: Proceedings of the IEEE. Special Issue on Recent Advances in Distributed Multimedia Communications, vol 96, no 1. IEEE, Piscataway, NJ, pp 131–142
Apostolopoulos JG, Trott MD (2004) Path diversity for enhanced media streaming. IEEE Commun Mag 42(8):80–87
Liu M, Zhu Ce (2007) Multiple description video coding using hierarchical B pictures. In: IEEE international conference on multimedia and expo, Beijing, China, pp 1367–1370
Franchi N, Fumagalli M, Lancini R, Tubaro S (2005) Multiple description video coding for scalable and robust transmission over IP. IEEE Trans Circuits Syst Video Technol 15(3):321–334
Van Der Schaar M, Turaga DS (2003) Multiple description scalable coding using wavelet-based motion compensated temporal filtering. Int Conf Image Proc 3:489–492
Bai H., Zhao Y (2006) Multiple description video coding based on lattice vector quantization. In: First international conference on innovative computing, information and control, vol 2, pp 241–244
Yu M, Wenqin Z, Jiang G, Yin Z (2005) An Approach to 3D scalable multiple description video coding with content delivery networks. In: IEEE international workshop on VLSI design and video technology, pp 191–194
Schwarz H, Hinz T, Kirchhoffer H, Marpe D, Wiegand T (2004) Technical description of the HHI proposal for SVC CE1. ISO(IEC JTC1/SC29/WG11, Doc. m11244, Palma de Mallorca, Spain
Mansour H, Nasiopoulos P, Leung V (2006) An efficient multiple description coding scheme for the scalable extension of H.264/AVC (SVC). In: IEEE international symposium on signal processing and information technology, Vancouver, BC, pp 519–529
Schafer R, Schwarz H, Marpe D, Wiegand T (2005) MCTF and scalability extension of H.264/AVC and its applications to video transmission, storage and surveillance. Visual communications and image processing
van Moorsel A (2001) Metrics for the Internet age: quality of experience and quality of business. Fifth Performability Workshop
Folli M, Favalli L, Lanati M (2008) Parameter optimization for a scalable multiple description coding scheme based on spatial subsampling. In: Proceedings of Mobimedia ’08, Oulu, Finland
Wei Z, Cai C, Ma K-K (2006) A novel H.264-based multiple description video coding via polyphase transform and partial prediction. In: International symposium on intelligent signal processing and communications, Yonago, Japan, pp 151–154
Folli M, Favalli L (2007) Multiple description coding algorithms for H.264 coder. In: Proceedings of Mobimedia ’07, Nafpaktos, Greece
Tillo T, Olmo G (2004) A novel multiple description coding scheme compatible with the JPEG 2000 decoder. IEEE Signal Process Lett 11(11):908–911
Akyol E, Tekalp AM, Civanlar MR (2005) Scalable multiple description video coding with flexible number of descriptions. IEEE Int Conf Image Proc 3:712–715
Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circuits Syst Video Technol 13:560–570
Baccaglini E, Tillo T, Olmo G (2004) Network adaptive multiple description coding for JPEG2000. In: IEEE international conference on image processing, Genova, pp 936–939
Fehn C (2003) A 3D-TV system based on video plus depth information. Signals, Systems and Computers, 2003. Conference Record of the Thirty-Seventh Asilomar Conference. vol 2, pp 9–12. doi:11.1109/ACSSC.2003.1292181
Kamolrat B, Fernando WAC, Mrak M, Kondoz A (2008) Joint source and channel coding for 3D video with depth image - based rendering. IEEE Trans Consum Electron 54(2):887–894
Karim HA, Hewage C, Worrall S, Kondoz A (2008)Scalable multiple description video coding for stereoscopic 3D. IEEE Trans on Consum Electron 54(2):745–752
Flierl M, Girod B (2007) Multi-view video compression—exploiting inter-image similarities. IEEE Signal Process Mag 24(7):66–76. doi:10.1109/MSP.2007.905699
Fehn C, Rarre R, Pastoor S (2006) Interactive 3D-TV-concepts and key technologies. Proc IEEE 94(3):524–538
Setton E, Liang Y, Girod B. Adaptive multiple description video streaming over multiple channels with active probing. In: Proceedings of the 2003 international conference on multimedia and expo, vol 2. IEEE Computer Society, Washington, USA, pp 509–512
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Favalli, L., Folli, M. ILPS: a scalable multiple description coding scheme for H.264. Multimed Tools Appl 54, 609–634 (2011). https://doi.org/10.1007/s11042-010-0577-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0577-0