Abstract
Generation of side information for multi-view Distributed Video Coding in multi-camera environments (e.g., video surveillance) poses challenges in scenarios with temporary non-overlapping among views and consequently, no resources for generating the side information at some time instants. In this paper we extend our previous work (Ciobanu and Corte-Real, Multimed Tools Appl 48(3):411–436, 2010) (for scenarios with permanent complete-overlapping among views) and propose a solution to this problem by exploiting the past visual data associated with each view, gathered over time as a panoramic image (sprite). The entire collection of temporal data from all the cameras is subsequently used for generating the side information. We tackle several topics related to these scenarios and propose solutions for the encountered issues. Optimization techniques are also discussed, e.g., temporal tags and block alternatives associated with the sprite contents for an improved generation of side information. This paper also presents a post-processing technique for additional refinement of generated side information. Practical results show an overall significant enhancement of side information by over 2 dB.
Similar content being viewed by others
References
Aaron A, Girod B (2004) Wyner-ziv video coding with low encoder complexity. In: Proc. international Picture Coding Symposium, PCS’04, San Francisco, CA
Aaron A, Rane S, Girod B (2004) Wyner-ziv video coding with hash-based motion-compensation at the receiver. In: Proc. IEEE intl. conference on image processing, Singapore
Artigas X, Angeli E, Torres L (2006) Side information generation for multiview distributed video coding using a fusion approach. In: 7th Nordic Signal Processing Symposium, NORSIG’06, Reykjavik, Iceland, 7–9 June 2006
Ascenso J, Pereira F (2007) Adaptive hash-based side information exploitation for efficient Wyner-Ziv video coding. In: International Conference on Image Processing (ICIP)—2007, San Antonio, Texas, USA
Benedek C, Havasi L, Sziranyi T, Szlavik Z (2005) Motion-based flexible camera registration. In: IEEE conference on Advanced Video and Signal Based Surveillance, 2005, AVSS 2005, pp 439–444
Bergevin R, Soucy M, Gagnon H, Laurendeau D (1996) Towards a general multi-view registration technique. IEEE Trans Pattern Anal Mach Intell 18(5):540–547
Ciobanu L, Corte-Real L (2010) Successive refinement of side information for multi-view distributed video coding. Multimed Tools Appl 48(3):411–436
Dufaux F, Moscheni F (1996) Background mosaicking for low bit rate video coding. In: Proceedings of international conference on image processing, vol 1, pp 673–676
Dufaux F, Ouaret M, Ebrahimi T (2007) Recent advances in multiview distributed video coding. In: SPIE Defense and Security Symposium (DSS 2007), Orlando, Florida, USA, 9–13 Apr 2007
Guo X, Lu Y, Wu F, Gao W, Li S (2006) Distributed multi-view video coding. In: Proceedings of SPIE-IS&T Electronic Imaging, SPIE, vol 6077. San Jose, California, USA, 15–19 Jan 2006
Izquierdo E (2003) Efficient and accurate image based camera registration. IEEE Trans Multimedia 5(3):293–302
Lee M-C, Chen W-G, Lin C, Gu C, Markoc T, Zabinsky S, Szeliski R (1997) A layered video object coding system using sprite and affine motion model. IEEE Trans Circuits Syst Video Technol 7(1):130–145
Ouaret M, Dufaux F, Ebrahimi T (2006) Fusion-based multiview distributed video coding. In: ACM International Workshop on Video Surveillance and Sensor Networks, Santa Barbara, CA, USA, 27 Oct 2006
Ouaret M, Dufaux F, Ebrahimi T (2007) Multiview distributed video coding with encoder driven fusion. In: European Conference on Signal Processing (EUSIPCO), Poznan, Poland, 3–7 Sept 2007
Pereira FC, Ebrahimi T (2002) The MPEG-4 Book. Prentice Hall PTR, Upper Saddle River, NJ, USA
Puri R, Ramchandran K (2003) PRISM: a “reversed” multimedia coding paradigm. In: Proc. Intl. Conference on Image Processing (ICIP), Barcelona, Spain
Sikora T (2005) Trends and perspectives in image and video coding. In: Proceedings of the IEEE vol 93(1), pp 6–17
Slepian D, Wolf JK (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19:471–480
Smolic A, Sikora T, Ohm J-R (1999) Long-term global motion estimation and its application for sprite coding, content description, and segmentation. IEEE Trans Circuits Syst Video Technol 9(8):1227–1242
Szlávik Z, Szirányi T, Havasi L (2007) Video camera registration using accumulated co-motion maps. ISPRS J Photogramm Remote Sens 61(5):298–306
Wyner D, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22:1–10
Yeo C, Ramchandran K (2007) Robust distributed multi-view video compression for wireless camera networks. In: VCIP 2007, San Jose, California, USA, 28 Jan–1 Feb 2007
Acknowledgement
The first author acknowledges the Fundação para a Ciência e a Tecnologia, Portugal, for the financial support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ciobanu, L., Côrte-Real, L. Sprite-based generation of side information for multi-view Distributed Video Coding. Multimed Tools Appl 60, 609–639 (2012). https://doi.org/10.1007/s11042-011-0831-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0831-0