ABSTRACT
This poster focuses on addressing the power consumption issues in 360-degree immersive video streaming on smart phones, an emerging virtual reality (VR) application in the consumer video market. We first conducted a power measurement study that indicates VR view generation as the major power consumption source. Then, we developed an edge-based immersive streaming system called EdgeVR that offloads the power-consuming view generation operation from the smart phone to the edge. Through our preliminary evaluations using EdgeVR, we identified the challenge of Motion-to-Photon latency associated with offloading. To reduce such latency, we propose a viewport prediction-based pre-rendering mechanism at the edge to ensure the quality of experience in the VR application.
- [n.d.]. Archos VR Glasses. https://www.archos.com/us/products/objects/cself/avr/index.html.Google Scholar
- [n.d.]. DODOcase. https://www.dodocase.com/.Google Scholar
- [n.d.]. Google Cardboard. https://vr.google.com/cardboard/.Google Scholar
- [n.d.]. Monsoon Power Monitor. http://msoon.github.io/powermonitor/PowerTool/doc/LVPM%20Manual.pdf.Google Scholar
- [n.d.]. Samsung GearVR. https://www.oculus.com/gear-vr/.Google Scholar
- [n.d.]. Three Sixty Video Player powered by Brightcove. https://github.com/ftlabs/o-three-sixty.Google Scholar
- [n.d.]. three.js - Javascript 3D library. https://threejs.org/.Google Scholar
- [n.d.]. WebVR - Bringing Virtual Reality to the Web. https://webvr.info/.Google Scholar
- 2012. Real-Time Messaging Protocol (RTMP) Specification V1.0. https://www.adobe.com/devnet/rtmp.html.Google Scholar
- 2015. What is Motion-To-Photon Latency? http://www.chioka.in/what-is-motion-to-photon-latency/.Google Scholar
- Aaron Carroll and Gernot Heiser. 2010. An Analysis of Power Consumption in a Smartphone. In USENIX Annual Technical Conference (ATC). 21--21.Google Scholar
- Xavier Corbillon, Francesca De Simone, and Gwendal Simon. 2017. 360-Degree Video Head Movement Dataset. In ACM Multimedia Systems Conference (MMSys). 199--204.Google ScholarDigital Library
- Xianglong Feng, Viswanathan Swaminathan, and Sheng Wei. 2019. Viewport Prediction for Live 360-Degree Mobile Video Streaming Using User-Content Hybrid Motion Tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 3, 2, Article 43 (June 2019), 22 pages.Google ScholarDigital Library
- Wenjie Hu and Guohong Cao. 2015. Energy-aware video streaming on smartphones. In IEEE Conference on Computer Communications (INFOCOM). 1185--1193.Google ScholarCross Ref
- Nan Jiang, Viswanathan Swaminathan, and Sheng Wei. 2017. Power Evaluation of 360 VR Video Streaming on Head Mounted Display Devices. In ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). 55--60.Google ScholarDigital Library
- Robert LiKamWa, Zhen Wang, Aaron Carroll, Felix Xiaozhu Lin, and Lin Zhong. 2014. Draining Our Glass: An Energy and Heat Characterization of Google Glass. In Asia-Pacific Workshop on Systems (APSys). 10:1--10:7.Google Scholar
- Yao Liu, Mengbai Xiao, Ming Zhang, Xin Li, Mian Dong, Zhan Ma, Zhenhua Li, and Songqing Chen. 2015. Content-adaptive Display Power Saving in Internet Mobile Streaming. In ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV). 1--6.Google Scholar
- Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 Video Delivery Over Cellular Networks. In ACM Workshop on All Things Cellular: Operations, Applications and Challenges. 1--6.Google ScholarDigital Library
- Jingyu Zhang, Gan Fang, Chunyi Peng, Minyi Guo, Sheng Wei, and Viswanathan Swaminathan. 2016. Profiling Energy Consumption of DASH Video Streaming Over 4G LTE Networks. In International Workshop on Mobile Video. 3.Google ScholarDigital Library
- Lide Zhang, Birjodh Tiwana, Robert P Dick, Zhiyun Qian, Z Morley Mao, Zhaoguang Wang, and Lei Yang. 2010. Accurate online power estimation and automatic battery behavior based power model generation for smartphones. In IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS). 105--114.Google ScholarDigital Library
Index Terms
- Virtual reality streaming at the edge: a power perspective: poster
Recommendations
Power-efficient live virtual reality streaming using edge offloading
NOSSDAV '22: Proceedings of the 32nd Workshop on Network and Operating Systems Support for Digital Audio and VideoThis paper aims to address the significant power challenges in live virtual reality (VR) streaming (a.k.a., 360-degree video streaming), where the VR view rendering and the advanced deep learning operations (e.g., super-resolution) consume a ...
Interactive Augmented Live Virtual Reality Streaming: A Health Care Application
ICMHI '18: Proceedings of the 2nd International Conference on Medical and Health InformaticsVirtual Reality (VR) technology has been around for decades; however, we have probably only begun to realize the practical applications until recent years. With increase of computing power, decrease of cost and physical dimension, a new class of ...
Comments