skip to main content
10.1145/2814347.2814353acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Compressed Domain Video Processing for Tile Based Panoramic Streaming using SHVC

Published: 30 October 2015 Publication History

Abstract

Panoramic streaming is a particular way of video streaming where an arbitrary Region-of-Interest (RoI) of high-spatial resolution videos is transmitted, allowing users to navigate around the video and leading to an immersive experience. Tile based streaming has been proposed in the past and is drawing a lot of attention to provide a solution that scales well. In tile base streaming the video is divided into multiple tiles and a subset of tiles of interest is transmitted to the viewer. We propose a low-complexity compressed domain video processing technique, which uses H.265/SHVC and generates a single video bitstream from the selected tiles so that single hardware decoders can be used to decode the RoI video stream. Additionally, the proposed technique makes it possible to use Open GOP structures in the output layer without incurring in any interruption at switching events, which provides a better compression efficiency compared to closed GOP structures.

References

[1]
ClassX, Stanford University. http://classx.stanford.edu/, Aug. 2015.
[2]
R. van Brandenburg, O. Niamult, M. Prins, H. Stokking, "Spatial Segmentation For Immersive Media Delivery", 2011.
[3]
Christian Weissig, Oliver Schreer, Peter Eisert, Peter Kauff, "The Ultimate Immersive Experience: Panoramic 3D Video Acquisition", Advances in Multimedia Modeling, Lecture Notes in Computer Science Volume 7131, 2012, pp 671--681.
[4]
http://www.oculus.com/rift/, Aug. 2015.
[5]
A. Mavlankar, P. Agrawal, D. Pang, S. Halwa, N. Cheung, B. Girod "An interactive Region-of-Interest Video Streaming System for Online Lecture Viewing", Special Session on Advanced Interactive Multimedia Streaming, Proc. of 18th International Packet Video Workshop (PV), Hong Kong, Dec. 2010.
[6]
ISO/IEC 23009--1:2014/Amd 2:2015, "Spatial relationship description, generalized URL parameters and other extensions"
[7]
A. Mavlankar, P. Baccichet, D. Varodayan, and B. Girod, "Optimal Slice Size for Streaming Regions of High Resolution Video with Virtual Pan/Tilt/Zoom Functionality," Proc. of 15th European Signal Processing Conference (EUSIPCO), Poznan, Poland, Sept. 2007
[8]
N. Quang, G. Ravindra, W.T. Ooi, "Adaptive Encoding of Zoomable Video Streams based on User Access Pattern", MMSys 2011, San Jose, Feb. 2011.
[9]
Y. Sanchez, R. Skupin, and T. Schierl: "Compressed Domain Video Processing for Tile based Panoramic Streaming using HEVC", Proceedings of IEEE International Conference on Image Processing (ICIP), Quebec, Canada, September 2015.
[10]
ITU-T, Recommendation H.265 (04/15), Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services -- Coding of Moving Video, High Efficiency Video Coding.
[11]
A. Fujibayashi, TK Tan (NTT DOCOMO), "Random access support for HEVC", JCTVC-D234, 4th JCT-VC Meeting, Daegu, January 2011.
[12]
R. Skupin, Y. Sanchez, and T. Schierl: "Compressed Domain Video Compositing with HEVC", Picture Coding Symposium (PCS 2015), Cairns, Australia, May 31 - June 3, 2015.
[13]
Y. Sanchéz, R.Globisch, T. Schierl, and T. Wiegand: Low Complexity Cloud-video-Mixing Using HEVC, Proceedings of IEEE Consumer Communications and Networking Conference, Las Vegas, NV, USA, January 2014.

Cited By

View all
  • (2019)A Survey on 360° Video StreamingACM Computing Surveys10.1145/332911952:4(1-36)Online publication date: 30-Aug-2019
  • (2019)A Flexible Viewport-Adaptive Processing Mechanism for Real-Time VR Video Transmission2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2019.00064(336-341)Online publication date: Jul-2019
  • (2018)Scalable Video Coding Based on User’s View for Real-Time Virtual Reality ApplicationsIEEE Communications Letters10.1109/LCOMM.2017.276402122:1(25-28)Online publication date: Jan-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ImmersiveME '15: Proceedings of the 3rd International Workshop on Immersive Media Experiences
October 2015
48 pages
ISBN:9781450337458
DOI:10.1145/2814347
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 October 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. SHVC
  2. interactivity
  3. panorama streaming
  4. tiles

Qualifiers

  • Research-article

Conference

MM '15
Sponsor:
MM '15: ACM Multimedia Conference
October 30, 2015
Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 11 of 31 submissions, 35%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)A Survey on 360° Video StreamingACM Computing Surveys10.1145/332911952:4(1-36)Online publication date: 30-Aug-2019
  • (2019)A Flexible Viewport-Adaptive Processing Mechanism for Real-Time VR Video Transmission2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2019.00064(336-341)Online publication date: Jul-2019
  • (2018)Scalable Video Coding Based on User’s View for Real-Time Virtual Reality ApplicationsIEEE Communications Letters10.1109/LCOMM.2017.276402122:1(25-28)Online publication date: Jan-2018
  • (2018)Distributed Video Transcoding System for 8K 360° VR Tiled Streaming Service2018 International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC.2018.8539372(592-595)Online publication date: Oct-2018
  • (2017)Comparison of HEVC coding schemes for tile-based viewport-adaptive streaming of omnidirectional video2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2017.8122227(1-6)Online publication date: Oct-2017
  • (2017)Viewport-dependent delivery schemes for stereoscopic panoramic video2017 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON)10.1109/3DTV.2017.8280404(1-4)Online publication date: Jun-2017
  • (2017)Video processing for panoramic streaming using HEVC and its scalable extensionsMultimedia Tools and Applications10.1007/s11042-016-4097-476:4(5631-5659)Online publication date: 1-Feb-2017
  • (2016)Tiling in Interactive Panoramic VideoIEEE Transactions on Multimedia10.1109/TMM.2016.258630418:9(1819-1831)Online publication date: 1-Sep-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media