skip to main content
10.1145/2512142.2512143acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Dynamic adaptive 3D multi-view video streaming over the internet

Authors Info & Claims
Published:22 October 2013Publication History

ABSTRACT

Increasing throughput rates and technical developments in video streaming over the Internet offer an attractive solution for the distribution of immersive 3D multi-view. Nevertheless, robustness of video streaming is subject to its utilisation of efficient error resiliency and content aware adaptation techniques. Dynamic network characteristics resulting in frequent congestions may prevent video packets from being delivered in a timely manner. Packet delivery failures may become prominent, degrading 3D immersive video experience significantly. In order to overcome this problem, a novel view recovery technique for 3D free-viewpoint video is introduced to maintain 3D video quality in a cost-effective manner. In this concept, the undelivered (discarded) views as a result of adaptation in the network are recovered with high quality at the receiver side, using Side Information (SI) and the delivered frames of neighbouring views. The proposed adaptive 3D multi-view video streaming scheme is tested using Dynamic Adaptive Streaming over HTTP (MPEG-DASH) standard. Tests using the proposed adaptive technique have revealed that the perceptual 3D video quality under adverse network conditions is significantly improved thanks to the utilisation of the extra side information in view recovery.

References

  1. C.-M. Cheng, .-S.-J. Lin, and S.-H. Lai. Spatio-temporally consistent novel view synthesis algorithm from video-plus-depth sequences for autostereoscopic displays. Broadcasting, IEEE Trans. on, 57:523--532, 2011.Google ScholarGoogle Scholar
  2. E. Christensen et al. Web services description language (wsdl) 1.1, 2001.Google ScholarGoogle Scholar
  3. C. Gurler, S. Savas, and A. Tekalp. Quality of experience aware adaptation strategies for multi-view video over p2p networks. In Image Processing (ICIP), 2012 19th IEEE International Conference on, pages 2289--2292, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  4. T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, and A. Y. Wu. An efficient k-means clustering algorithm: Analysis and implementation. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(7):881--892, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P. Merkle, A. Smolic, K. Muller, and T. Wiegand. Efficient prediction structures for multiview video coding. Circuits and Systems for Video Technology, IEEE Transactions on, 17(11):1461--1473, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. K. Muller, A. Smolic, K. Dix, P. Merkle, P. Kauff, and T. Wiegand. View synthesis for advanced 3d video systems. EURASIP J. Image and Video Processing, 2008, 2008.Google ScholarGoogle Scholar
  7. I. Recommendation. Methodology for the subjective assessment of the quality of television pictures,recommendation itu-r bt. 500--11. ITU Telecom. Standardization Sector of ITU, 2002.Google ScholarGoogle Scholar
  8. I. Sodagar. The mpeg-dash standard for multimedia streaming over the internet. MultiMedia, IEEE, 18(4):62--67, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. T. Stockhammer. Dynamic adaptive streaming over http --: standards and design principles. In Proceedings of the second annual ACM conference on Multimedia systems, MMSys '11, pages 133--144, New York, NY, USA, 2011. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Y. Sugiyama. An algorithm for solving discrete-time wiener-hopf equations based upon euclid's algorithm. Information Theory, IEEE Transactions on, 32(3):394--409, 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. G. J. Sullivan and R. L. Baker. Efficient quadtree coding of images and video. Image Processing, IEEE Transactions on, 3(3):327--331, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. G. Tech, H. Schwarz, K. Muller, and T. Wiegand. 3d video coding using the synthesized view distortion change. In Picture Coding Symposium (PCS), 2012, pages 25--28. IEEE, 2012.Google ScholarGoogle ScholarCross RefCross Ref
  13. A. Vetro, T. Wiegand, and G. Sullivan. Overview of the stereo and multiview video coding extensions of the h.264/mpeg-4 avc standard. Proceedings of the IEEE, 99(4):626--642, 2011.Google ScholarGoogle ScholarCross RefCross Ref
  14. T. Wiegand and G. Sullivan. The h.264/avc video coding standard {standards in a nutshell}. Signal Processing Magazine, IEEE, 24(2):148--153, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  15. Y. Zhao and L. Yu. A perceptual metric for evaluating quality of synthesized sequences in 3dv system. In Proc. of SPIE Vol, volume 7744, pages 77440X-1, 2010.Google ScholarGoogle Scholar

Index Terms

  1. Dynamic adaptive 3D multi-view video streaming over the internet

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ImmersiveMe '13: Proceedings of the 2013 ACM international workshop on Immersive media experiences
      October 2013
      68 pages
      ISBN:9781450324021
      DOI:10.1145/2512142

      Copyright © 2013 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 22 October 2013

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Author Tags

      Qualifiers

      • research-article

      Acceptance Rates

      ImmersiveMe '13 Paper Acceptance Rate6of19submissions,32%Overall Acceptance Rate11of31submissions,35%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader