Skip to main content
SpringerLink
Log in

Sprite-based generation of side information for multi-view Distributed Video Coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Generation of side information for multi-view Distributed Video Coding in multi-camera environments (e.g., video surveillance) poses challenges in scenarios with temporary non-overlapping among views and consequently, no resources for generating the side information at some time instants. In this paper we extend our previous work (Ciobanu and Corte-Real, Multimed Tools Appl 48(3):411–436, 2010) (for scenarios with permanent complete-overlapping among views) and propose a solution to this problem by exploiting the past visual data associated with each view, gathered over time as a panoramic image (sprite). The entire collection of temporal data from all the cameras is subsequently used for generating the side information. We tackle several topics related to these scenarios and propose solutions for the encountered issues. Optimization techniques are also discussed, e.g., temporal tags and block alternatives associated with the sprite contents for an improved generation of side information. This paper also presents a post-processing technique for additional refinement of generated side information. Practical results show an overall significant enhancement of side information by over 2 dB.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  1. Aaron A, Girod B (2004) Wyner-ziv video coding with low encoder complexity. In: Proc. international Picture Coding Symposium, PCS’04, San Francisco, CA

  2. Aaron A, Rane S, Girod B (2004) Wyner-ziv video coding with hash-based motion-compensation at the receiver. In: Proc. IEEE intl. conference on image processing, Singapore

  3. Artigas X, Angeli E, Torres L (2006) Side information generation for multiview distributed video coding using a fusion approach. In: 7th Nordic Signal Processing Symposium, NORSIG’06, Reykjavik, Iceland, 7–9 June 2006

  4. Ascenso J, Pereira F (2007) Adaptive hash-based side information exploitation for efficient Wyner-Ziv video coding. In: International Conference on Image Processing (ICIP)—2007, San Antonio, Texas, USA

  5. Benedek C, Havasi L, Sziranyi T, Szlavik Z (2005) Motion-based flexible camera registration. In: IEEE conference on Advanced Video and Signal Based Surveillance, 2005, AVSS 2005, pp 439–444

  6. Bergevin R, Soucy M, Gagnon H, Laurendeau D (1996) Towards a general multi-view registration technique. IEEE Trans Pattern Anal Mach Intell 18(5):540–547

    Article  Google Scholar 

  7. Ciobanu L, Corte-Real L (2010) Successive refinement of side information for multi-view distributed video coding. Multimed Tools Appl 48(3):411–436

    Article  Google Scholar 

  8. Dufaux F, Moscheni F (1996) Background mosaicking for low bit rate video coding. In: Proceedings of international conference on image processing, vol 1, pp 673–676

  9. Dufaux F, Ouaret M, Ebrahimi T (2007) Recent advances in multiview distributed video coding. In: SPIE Defense and Security Symposium (DSS 2007), Orlando, Florida, USA, 9–13 Apr 2007

  10. Guo X, Lu Y, Wu F, Gao W, Li S (2006) Distributed multi-view video coding. In: Proceedings of SPIE-IS&T Electronic Imaging, SPIE, vol 6077. San Jose, California, USA, 15–19 Jan 2006

  11. Izquierdo E (2003) Efficient and accurate image based camera registration. IEEE Trans Multimedia 5(3):293–302

    Article  Google Scholar 

  12. Lee M-C, Chen W-G, Lin C, Gu C, Markoc T, Zabinsky S, Szeliski R (1997) A layered video object coding system using sprite and affine motion model. IEEE Trans Circuits Syst Video Technol 7(1):130–145

    Article  Google Scholar 

  13. Ouaret M, Dufaux F, Ebrahimi T (2006) Fusion-based multiview distributed video coding. In: ACM International Workshop on Video Surveillance and Sensor Networks, Santa Barbara, CA, USA, 27 Oct 2006

  14. Ouaret M, Dufaux F, Ebrahimi T (2007) Multiview distributed video coding with encoder driven fusion. In: European Conference on Signal Processing (EUSIPCO), Poznan, Poland, 3–7 Sept 2007

  15. Pereira FC, Ebrahimi T (2002) The MPEG-4 Book. Prentice Hall PTR, Upper Saddle River, NJ, USA

    Google Scholar 

  16. Puri R, Ramchandran K (2003) PRISM: a “reversed” multimedia coding paradigm. In: Proc. Intl. Conference on Image Processing (ICIP), Barcelona, Spain

  17. Sikora T (2005) Trends and perspectives in image and video coding. In: Proceedings of the IEEE vol 93(1), pp 6–17

  18. Slepian D, Wolf JK (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19:471–480

    Article  MathSciNet  MATH  Google Scholar 

  19. Smolic A, Sikora T, Ohm J-R (1999) Long-term global motion estimation and its application for sprite coding, content description, and segmentation. IEEE Trans Circuits Syst Video Technol 9(8):1227–1242

    Article  Google Scholar 

  20. Szlávik Z, Szirányi T, Havasi L (2007) Video camera registration using accumulated co-motion maps. ISPRS J Photogramm Remote Sens 61(5):298–306

    Article  Google Scholar 

  21. Wyner D, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22:1–10

    Article  MathSciNet  MATH  Google Scholar 

  22. Yeo C, Ramchandran K (2007) Robust distributed multi-view video compression for wireless camera networks. In: VCIP 2007, San Jose, California, USA, 28 Jan–1 Feb 2007

Download references

Acknowledgement

The first author acknowledges the Fundação para a Ciência e a Tecnologia, Portugal, for the financial support.

Author information

Authors and Affiliations

  1. Faculdade de Engenharia da Universidade do Porto/INESC Porto, Porto, Portugal

    Lucian Ciobanu & Luís Côrte-Real

Authors
  1. Lucian Ciobanu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luís Côrte-Real
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lucian Ciobanu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ciobanu, L., Côrte-Real, L. Sprite-based generation of side information for multi-view Distributed Video Coding. Multimed Tools Appl 60, 609–639 (2012). https://doi.org/10.1007/s11042-011-0831-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0831-0

Keywords

Search

Navigation