research-article

Efficient Tile-Based Adaptive Streaming for 360-Degree Video-on-Demand Systems

Authors:

Jingyu WangAuthors Info & Claims

MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference

Pages 435 - 440

https://doi.org/10.1145/3625468.3653436

Published: 17 April 2024 Publication History

Abstract

In the field of 360-degree video streaming, the optimization of visual quality within the viewer's field of view, alongside the minimization of system resource consumption, is a critical concern. The considerable file sizes associated with high-quality 360-degree videos pose significant challenges for efficient transmission. Current strategies primarily employ a tile-based approach to address these issues. However, these approaches face two core challenges: the methodology for tile segmentation, and the strategy for downloading tiles. To address these challenges, this paper presents a tile-based solution designed specifically for adaptive 360-degree video-on-demand streaming. Our method surpasses baseline methods in extensive simulations, positioning it as one of the leading solutions in the MMSys'24 Grand Challenge1.

References

[1]

Cagri Ozcinar, Julián Cabrera, and Aljosa Smolic. Visual attention-aware omnidirectional video streaming using optimal tiles for virtual reality. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 9(1):217--230, 2019.

[2]

Shahryar Afzal, Jiasi Chen, and KK Ramakrishnan. Characterization of 360-degree videos. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network, pages 1--6, 2017.

Digital Library

[3]

Yu Guan, Chengyuan Zheng, Xinggong Zhang, Zongming Guo, and Junchen Jiang. Pano: optimizing 360° video streaming with a better understanding of quality perception. In Proceedings of the ACM Special Interest Group on Data Communication, SIGCOMM '19, page 394-407, New York, NY, USA, 2019. Association for Computing Machinery.

Digital Library

[4]

Iraj Sodagar. The mpeg-dash standard for multimedia streaming over the internet. IEEE multimedia, 18(4):62--67, 2011.

Digital Library

[5]

Yimin Zhou, Ling Tian, Ce Zhu, Xin Jin, and Yu Sun. Video coding optimization for virtual reality 360-degree source. IEEE Journal of Selected Topics in Signal Processing, 14(1):118--129, 2019.

[6]

Kashyap Kammachi Sreedhar, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications. In 2016 IEEE International Symposium on Multimedia (ISM), pages 583--586. IEEE, 2016.

[7]

Yuwen He, Xiaoyu Xiu, Philippe Hanhart, Yan Ye, Fanyi Duanmu, and Yao Wang. Content-adaptive 360-degree video coding using hybrid cubemap projection. In 2018 Picture Coding Symposium (PCS), pages 313--317. IEEE, 2018.

[8]

King-To Ng, Shing-Chow Chan, and Heung-Yeung Shum. Data compression and transmission aspects of panoramic videos. IEEE Transactions on Circuits and Systems for Video Technology, 15(1):82--95, 2005.

[9]

Eric Lindskog and Niklas Carlsson. Reeft-360: Real-time emulation and evaluation framework for tile-based 360 streaming under time-varying conditions. In Proceedings of the 12th ACM Multimedia Systems Conference, pages 307--313, 2021.

Digital Library

[10]

Lei Zhang, Yanyan Suo, Ximing Wu, Feng Wang, Yuchi Chen, Laizhong Cui, Jiangchuan Liu, and Zhong Ming. Tbra: Tiling and bitrate adaptation for mobile 360-degree video streaming. In Proceedings of the 29th ACM International Conference on Multimedia, pages 4007--4015, 2021.

Digital Library

[11]

Chamara Madarasingha and Kanchana Thilakarathna. Vastile: Viewport adaptive scalable 360-degree video frame tiling. In Proceedings of the 29th ACM International Conference on Multimedia, pages 4555--4563, 2021.

Digital Library

[12]

Yixuan Ban, Lan Xie, Zhimin Xu, Xinggong Zhang, Zongming Guo, and Yue Wang. Cub360: Exploiting cross-users behaviors for viewport prediction in 360 video adaptive streaming. In 2018 IEEE International Conference on Multimedia and Expo (ICME), pages 1--6. IEEE, 2018.

[13]

Yanan Bao, Huasen Wu, Tianxiao Zhang, Albara Ah Ramli, and Xin Liu. Shooting a moving target: Motion-prediction-based transmission for 360-degree videos. In 2016 IEEE International Conference on Big Data (Big Data), pages 1161--1170. IEEE, 2016.

[14]

Chenglei Wu, Zhihao Tan, Zhi Wang, and Shiqiang Yang. A dataset for exploring user behaviors in vr spherical video streaming. In Proceedings of the 8th ACM on Multimedia Systems Conference, pages 193--198, 2017.

Digital Library

[15]

Miguel Fabián Romero Rondón, Lucile Sassatelli, Ramón Aparicio-Pardo, and Frédéric Precioso. Track: A new method from a re-examination of deep architectures for head motion prediction in 360° videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(9):5681--5699, 2022.

Cited By

Sidhu JBentaleb AGanesan DLane NShi W(2024)LCR360: Efficient Head Movement Prediction and Viewport Sharing in 360° Video StreamingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3696210(2084-2090)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3696210
Guo PSu WZhang XChen HMa Z(2024)Modeling the non-uniform retinal perception for viewport-dependent streaming of immersive videoMultimedia Systems10.1007/s00530-024-01434-530:4Online publication date: 5-Aug-2024
https://doi.org/10.1007/s00530-024-01434-5

Index Terms

Efficient Tile-Based Adaptive Streaming for 360-Degree Video-on-Demand Systems
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia streaming

Recommendations

Efficient viewport prediction and tiling schemes for 360 degree video streaming
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference

360-degree video streaming for VR visualisation is characterised by large transmission data volume and stringent interactive latency demands; hence guaranteeing suitable transmission quality, while meeting the existing constraints, is highly challenging. ...
Adaptive 360-Degree Video Streaming using Scalable Video Coding
MM '17: Proceedings of the 25th ACM international conference on Multimedia

Virtual reality and 360-degree video streaming are growing rapidly, yet, streaming high-quality 360-degree video is still challenging due to high bandwidth requirements. Existing solutions reduce bandwidth consumption by streaming high-quality video ...
An Evaluation of Tile Selection Methods for Viewport-Adaptive Streaming of 360-Degree Video

360-degree video has become increasingly popular nowadays. For effective transmission of bandwidth-intensive 360-degree video over networks, viewport-adaptive streaming has been introduced. In this article, we evaluate, for the first time, ten existing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference

April 2024

557 pages

ISBN:9798400704123

DOI:10.1145/3625468

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Results Reproduced / v1.1

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Natural Science Foundation of China
the Ministry of Education and China Mobile Joint Fund

Conference

MMSys '24

Sponsor:

SIGMM

MMSys '24: ACM Multimedia Systems Conference 2024

April 15 - 18, 2024

Bari, Italy

Acceptance Rates

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
112
Total Downloads

Downloads (Last 12 months)112
Downloads (Last 6 weeks)5

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sidhu JBentaleb AGanesan DLane NShi W(2024)LCR360: Efficient Head Movement Prediction and Viewport Sharing in 360° Video StreamingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3696210(2084-2090)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3696210
Guo PSu WZhang XChen HMa Z(2024)Modeling the non-uniform retinal perception for viewport-dependent streaming of immersive videoMultimedia Systems10.1007/s00530-024-01434-530:4Online publication date: 5-Aug-2024
https://doi.org/10.1007/s00530-024-01434-5

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten