skip to main content
10.1145/1291233.1291402acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Wavelet-based multi-view video coding with full scalability and illumination compensation

Published: 29 September 2007 Publication History

Abstract

A wavelet-based approach to scalable multi-view video coding (MVC) is examined in this paper. A 4-D wavelet transform is used to decorrelate the multi-view video data temporally, view-directionally, and spatially for efficient compression. Motion compensated temporal filtering (MCTF) is applied to each video sequence of each camera to exploit temporal correlation and inter-view dependencies are exploited with disparity compensated view filtering (DCVF). Together with a 2-D spatial wavelet transform the 4-D wavelet transform is constituted. The open-loop structure of the decomposition, together with embedded quantization and coding, allows for the construction of a bitstream which is fully scalable in temporal, view-directional, spatial and quality dimension. Results for scalable decoding in all dimensions are given, as well as comparisons to simulcast coding and state-of-the-art non-scalable multi-view video coding. Further, a significant coding gain is shown when the sequences are pre-processed with an algorithm for cross-view illumination compensation based on histogram matching.

References

[1]
M. Droese, C. Clemens, and T. Sikora. Extending Single-View Scalable Video Coding to Multi-view based on H.264/AVC. In ICIP 2006, Atlanta, USA, pages 2977--2980, October 2006.
[2]
U. Fecker, M. Barkowsky, and A. Kaup. Improving the Prediction Efficiency for Multi-View Video Coding Using Histogram Matching. In PCS 2006, Beijing, China, April 2006.
[3]
J. Garbas, U. Fecker, T. Tröger, and A. Kaup. 4-D Scalable Multi-View Video Coding Using Disparity Compensated View Filtering and Motion Compensated Temporal Filtering. In MMSP 2006, Victoria, Canada, October 2006.
[4]
ISO/IEC JTC1/ SC29/ WG11. Joint Draft 1.0 on Multiview Video Coding. JVT-U209, Hangzhou, China, Oct. 2006.
[5]
ISO/IEC JTC1/ SC29/ WG11. Joint Scalable Video Model JSVM-8. MPEG2006/N8456, Hangzhou, China, Okt. 2006.
[6]
A. Secker and D. Taubman. Motion-Compensated Highly Scalable Video Compression Using an Adaptive 3D Wavelet Transform Based on Lifting. In ICIP 2001, Greece, pages 1029--1032, 2001.
[7]
R. Xiong, F. Wu, J. Xu, S. Li, and Y.-Q. Zhang. Barbell Lifting Wavelet Transform for Highly Scalable Video Coding. In PCS, San Francisco, USA, 2004.
[8]
R. Xiong, J. Xu, F. Wu, and S. Li. Studies on Spatial Scalable Frameworks for Motion Aligned 3D Wavelet Video Coding. In VCIP 2005, Beijing, China, volume 5960, July 2005.
[9]
W. Yang, Y. Lu, F. Wu, J. Cai, K. N. Ngan, and S. Li. 4-D Wavelet-Based Multiview Video Coding. IEEE Trans. on Circuits and Systems for Video Technology, 16(11):1385--1396, November 2006.

Cited By

View all
  • (2013)User-Action-Driven View and Rate Scalable Multiview Video CodingIEEE Transactions on Image Processing10.1109/TIP.2013.226980122:9(3473-3484)Online publication date: 1-Sep-2013
  • (2011)Methods and Tools for Wavelet-Based Scalable Multiview Video CodingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2011.210555221:2(113-126)Online publication date: 1-Feb-2011
  • (2011)View and rate scalable multiview image coding with depth-image-based rendering2011 17th International Conference on Digital Signal Processing (DSP)10.1109/ICDSP.2011.6005019(1-8)Online publication date: Jul-2011
  • Show More Cited By

Index Terms

  1. Wavelet-based multi-view video coding with full scalability and illumination compensation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '07: Proceedings of the 15th ACM international conference on Multimedia
    September 2007
    1115 pages
    ISBN:9781595937025
    DOI:10.1145/1291233
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 September 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Article

    Conference

    MM07

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2013)User-Action-Driven View and Rate Scalable Multiview Video CodingIEEE Transactions on Image Processing10.1109/TIP.2013.226980122:9(3473-3484)Online publication date: 1-Sep-2013
    • (2011)Methods and Tools for Wavelet-Based Scalable Multiview Video CodingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2011.210555221:2(113-126)Online publication date: 1-Feb-2011
    • (2011)View and rate scalable multiview image coding with depth-image-based rendering2011 17th International Conference on Digital Signal Processing (DSP)10.1109/ICDSP.2011.6005019(1-8)Online publication date: Jul-2011
    • (2009)Enhancing coding efficiency in spatial scalable multiview video coding with wavelets2009 IEEE International Workshop on Multimedia Signal Processing10.1109/MMSP.2009.5293340(1-6)Online publication date: Oct-2009
    • (2008)Wavelet-based multi-view video coding with joint best basis wavelet packets2008 15th IEEE International Conference on Image Processing10.1109/ICIP.2008.4711984(1232-1235)Online publication date: Oct-2008

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media