Chao Zhou
Zhenhua Li
ABSTRACT
360 degree video is anew generation of video streaming technology that promises greater immersiveness than standard video streams. This level of immersiveness is similar to that produced by virtual reality devices -- users can control the field of view using head movements rather than needing to manipulate external devices. Although 360 degree video could revolutionize streaming technology, large scale adoption is hindered by a number of factors. 360 degree video streams have larger bandwidth requirements, require faster responsiveness to user inputs, and users may be more sensitive to lower quality streams.; AB@In this paper, we review standard approaches toward 360 degree video encoding and compare these to a new, as yet unpublished, approach by Oculus which we refer to as the offset cubic projection. Compared to the standard cubic encoding, the offset cube encodes a distorted version of the spherical surface, devoting more information (i.e., pixels) to the view in a chosen direction. We estimate that the offset cube representation can produce better or similar visual quality while using less than 50% pixels under reasonable assumptions about user behavior, resulting in 5.6% to 16.4% average savings in video bitrate. During 360 degree video streaming, Oculus uses a combination of quality level adaptation and view orientation adaptation. We estimate that this combination of streaming adaptation in two dimensions can cause over 57% extra segments to be downloaded compared to an ideal downloading strategy, wasting 20% of the total downloading bandwidth.
- Akamai's {state of the internet} q1 2016 report. https://www.akamai.com/uk/en/multimedia/documents/state-of-the-internet/akamai-state-of-the-internet-report-q1-2016.pdf.Google Scholar
- Charles Proxy. https://www.charlesproxy.com/.Google Scholar
- Cubic Projection. http://wiki.panotools.org/Cubic_Projection.Google Scholar
- Equirectangular Projection. http://mathworld.wolfram.com/EquirectangularProjection.html.Google Scholar
- Facebook's 2 Billion Acquisition Of Oculus Closes, Now Official. https://techcrunch.com/2014/07/21/facebooks-acquisition-of-oculus-closes-now-official/.Google Scholar
- FFmpeg. http://www.ffmpeg.org/.Google Scholar
- Great Cicle. http://mathworld.wolfram.com/GreatCircle.html.Google Scholar
- Internet Connection Speed Recommendations. https://help.netflix.com/en/node/306.Google Scholar
- Lynxmotion Pan and Tilt Kit / Aluminium. http://www.robotshop.com/en/lynxmotion-pan-and-tilt-kit-aluminium2.html.Google Scholar
- Next-generation video encoding techniques for 360 video and VR. https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/.Google Scholar
- Nokia OZO. http://ozo.nokia.com.Google Scholar
- OneRepublic - Kids (360 version). https://www.facebook.com/OneRepublic/videos/10154946797263912/.Google Scholar
- SPEEDTEST. http://www.speedtest.net/.Google Scholar
- Under the hood: Building 360 video. https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/.Google Scholar
- Xavier Corbillon, Alisa Devlic, Gwendal Simon, and Jacob Chakareski. Viewport-adaptive navigable 360-degree video delivery. arXiv preprint arXiv:1609.08042, 2016.Google Scholar
- ISO/IEC 23009-1:2014 Information technology -- Dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats. Standard, International Organization for Standardization, May 2014.Google Scholar
- Daisuke Ochi, Yutaka Kunita, Akio Kameda, Akira Kojima, and Shinnosuke Iwaki. Live streaming system for omnidirectional video. In 2015 IEEE Virtual Reality (VR), pages 349--350. IEEE, 2015.Google ScholarCross Ref
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. Optimizing 360 video delivery over cellular networks. In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges, pages 1--6. ACM, 2016. Google ScholarDigital Library
- David Salomon. Transformations and projections in computer graphics. Springer Science & Business Media, 2007. Google ScholarDigital Library
- Kay M Stanney, Ronald R Mourant, and Robert S Kennedy. Human factors issues in virtual environments: A review of the literature. Presence, 7(4):327--351, 1998. Google ScholarDigital Library
- Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity. Image Processing, IEEE Transactions on, 13(4):600--612, 2004. Google ScholarDigital Library
Index Terms
- A Measurement Study of Oculus 360 Degree Video Streaming
Recommendations
Adaptive 360-Degree Video Streaming using Scalable Video Coding
MM '17: Proceedings of the 25th ACM international conference on MultimediaVirtual reality and 360-degree video streaming are growing rapidly, yet, streaming high-quality 360-degree video is still challenging due to high bandwidth requirements. Existing solutions reduce bandwidth consumption by streaming high-quality video ...
On the Effectiveness of Offset Projections for 360-Degree Video Streaming
Special Section on Delay-Sensitive Video Computing in the Cloud and Special Section on Extended MMSys-NOSSDAV Best PapersA new generation of video streaming technology, 360-degree video, promises greater immersiveness than standard video streams. This level of immersiveness is similar to that produced by virtual reality devices—users can control the field of view using ...
A client-based adaptation framework for 360-degree video streaming
Highlights- The use of estimated bitrate/quality improves the viewport quality significantly.
Abstract360-degree video is one of the key components of Virtual Reality (VR) applications. 360-degree videos viewed on Head Mounted Displays can offer impressive viewing experiences to users. Yet, streaming of 360-degree videos over the ...
Comments