Abstract
In this article, we explore the possibility of enabling cloud-based virtual space applications for better computational scalability and easy access from any end device, including future lightweight wireless head-mounted displays. In particular, we investigate virtual space applications such as virtual classroom and virtual gallery, in which the scenes and activities are rendered in the cloud, with multiple views captured and streamed to each end device. A key challenge is the high bandwidth requirement to stream all the user views, leading to high operational cost and potential large delay in a bandwidth-restricted wireless network. We propose a novel hybrid-cast approach to save bandwidth in a multi-user streaming scenario. We identify and broadcast the common pixels shared by multiple users, while unicasting the residual pixels for each user. We formulate the problem of minimizing the total bitrate needed to transmit the user views using hybrid-casting and describe our approach. A common view extraction approach and a smart grouping algorithm are proposed and developed to achieve our hybrid-cast approach. Simulation results show that the hybrid-cast approach can significantly reduce total bitrate by up to 55% and avoid congestion-related latency, compared to traditional cloud-based approach of transmitting all the views as individual unicast streams, hence addressing the bandwidth challenges of the cloud, with additional benefits in cost and delay.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Novel Hybrid-Cast Approach to Reduce Bandwidth and Latency for Cloud-Based Virtual Space
- ISO/IEC JTC 1. 1993. Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s-Part 2: Video. ISO/IEC 11172-2 (MPEG-1) (1993).Google Scholar
- ISO/IEC JTC 1. 1999. Coding of audio-visual objects—Part 2: visual. ISO/IEC 14496-2 (MPEG-4 Vis. Version 1) (Apr. 1999).Google Scholar
- ITU-T ISO/IEC JTC 1. 1994. Generic coding of moving pictures and associated audio information part 2: Video. ITU-T Rec. H.262 ISO/IEC 13818-2 (MPEG-2 Video) (Nov. 1994).Google Scholar
- ITU-T ISO/IEC JTC 1. 2003. Advanced video coding for generic audio-visual services. ITU-T Rec. H.264 ISO/IEC 14496-10 (AVC) (May 2003).Google Scholar
- Song Ho Ahn. 2018. OpenGL projection matrix. Retrieved 2018 from http://www.songho.ca/opengl/gl_projectionmatrix.html.Google Scholar
- Song Ho Ahn. 2018. OpenGL transformation. Retrieved 2018 from http://www.songho.ca/opengl/gl_transform.html.Google Scholar
- Amazon. 2018. Amazon EC2 pricing. Retrieved 2018 from https://aws.amazon.com/ec2/pricing/on-demand.Google Scholar
- Amazon. 2018. AWS. Retrieved 2018 from https://aws.amazon.com.Google Scholar
- Wei Cai and Victor C. M. Leung. 2012. Multiplayer cloud gaming system with cooperative video sharing. In Cloud Computing Technology and Science (CloudCom), 2012 IEEE 4th International Conference on. IEEE, Taipei, 640--645. Google ScholarDigital Library
- Marta Carbone and Luigi Rizzo. 2010. Dummynet revisited. ACM SIGCOMM Computer Communication Review 40, 2 (2010), 12--20. Google ScholarDigital Library
- Recommendation H.261 CCITT. 1990. Video codec for audiovisual services at px 64 kbit/s. Draft Revision (Mar. 1990).Google Scholar
- Recommendation H.263 CCITT. 1995. Video coding for low bit rate communication. Draft (Nov. 1995).Google Scholar
- Aleksandra Checko, Henrik L. Christiansen, Ying Yan, Lara Scolari, Georgios Kardaras, Michael S. Berger, and Lars Dittmann. 2015. Cloud RAN for mobile networks—A technology overview. IEEE Communications Surveys 8 Tutorials 17, 1 (2015), 405--426.Google Scholar
- Hoang T. Dinh, Chonho Lee, Dusit Niyato, and Ping Wang. 2013. A survey of mobile cloud computing: Architecture, applications, and approaches. Wireless Communications and Mobile Computing 13, 18 (2013), 1587--1611.Google ScholarCross Ref
- edX. 2018. MOOC. Retrieved 2018 from https://www.edx.org.Google Scholar
- Cass Everitt. 2001. Projective texture mapping. White Paper, Nvidia Corporation (April 2001).Google Scholar
- Xueshi Hou, Yao Lu, and Sujit Dey. 2016. A novel hyper-cast approach to enable cloud-based virtual classroom applications. In 2016 IEEE International Symposium on Multimedia (ISM’16). IEEE, San Jose, CA, USA, 533--536.Google ScholarCross Ref
- HTC. 2018. HTC Vive. Retrieved 2018 from https://www.htcvive.com.Google Scholar
- ITU-T and ISO/IEC JTC. 2013. High efficiency video coding. ITU-T Rec. H.265 and ISO/IEC 23008-2 (HEVC) (Jan. 2013).Google Scholar
- Xin Jin, Li Erran Li, Laurent Vanbever, and Jennifer Rexford. 2013. Softcell: Scalable and flexible cellular core network architecture. In Proceedings of the 9th ACM Conference on Emerging Networking Experiments and Technologies. ACM, 163--174. Google ScholarDigital Library
- StarBurst K. Miller, StarBurst K. Robertson, Cisco A. Tweedly, and StarBurst M. White. 1998. StarBurst multicast file transfer protocol (MFTP) specification. Retrieved 1998 from https://tools.ietf.org/html/draft-miller-mftp-spec-03.Google Scholar
- David Lecompte and Frédéric Gabin. 2012. Evolved multimedia broadcast/multicast service (eMBMS) in LTE-advanced: Overview and Rel-11 enhancements. IEEE Communications Magazine 50, 11 (2012).Google ScholarCross Ref
- Yao Liu, Shaoxuan Wang, and Sujit Dey. 2014. Content-aware modeling and enhancing user experience in cloud mobile rendering and streaming. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 4, 1 (Mar. 2014), 43--56.Google ScholarCross Ref
- Yao Lu and Sujit Dey. 2016. JAVRE: A joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 6, 4 (2016), 544--559.Google ScholarCross Ref
- Yao Lu, Yao Liu, and Sujit Dey. 2015. Cloud mobile 3D display gaming user experience modeling and optimization by asymmetric graphics rendering. IEEE Journal of Selected Topics in Signal Processing 9, 3 (April 2015), 517--532.Google ScholarCross Ref
- Oculus. 2018. Oculus rift. Retrieved 2018 from https://www.oculus.com.Google Scholar
- Oculus. 2018. Performance head-up display. Retrieved 2018 from https://developer.oculus.com/documentation/pcsdk/latest/concepts/dg-hud.Google Scholar
- OpenGL. 2018. OpenGL. Retrieved 2018 from https://www.opengl.org.Google Scholar
- Abhijit Patait and Eric Young. 2018. High performance video encoding with Nvidia GPS. https://goo.gl/Bdjdgm.Google Scholar
- 5G-Xcast Project. 2018. PTM. Retrieved 2018 from http://5g-xcast.eu/about.Google Scholar
- WebM project. 2018. VP9 video codec. Retrieved 2018 from http://www.webmproject.org/vp9.Google Scholar
- Samsung. 2018. Samsung gear VR. Retrieved 2018 from http://www.samsung.com/global/galaxy/gear-vr.Google Scholar
- Unity. 2018. Unity. Retrieved 2018 from https://unity3d.com.Google Scholar
- Shaoxuan Wang and Sujit Dey. 2013. Adaptive mobile cloud computing to enable rich mobile multimedia applications. IEEE Transactions on Multimedia 15, 4 (June 2013), 870--883. Google ScholarDigital Library
- Wikipedia. 2018. AV1. Retrieved 2018 from https://en.wikipedia.org/wiki/AOMedia_Video_1.Google Scholar
- Wikipedia. 2018. IP multicast. Retrieved 2018 from https://en.wikipedia.org/wiki/IP_multicast.Google Scholar
- Wikipedia. 2018. Pragmatic general multicast. Retrieved 2018 from https://en.wikipedia.org/wiki/Pragmatic_General_Multicast.Google Scholar
- Wikipedia. 2018. Real-time transport protocol. Retrieved 2018 from https://en.wikipedia.org/wiki/Real-time_Transport_Protocol.Google Scholar
- Wikipedia. 2018. Rendering pipeline. Retrieved 2018 from https://en.wikipedia.org/wiki/Graphics_pipeline.Google Scholar
- Wikipedia. 2018. Resource reservation protocol. Retrieved 2018 from https://en.wikipedia.org/wiki/Resource_Reservation_Protocol.Google Scholar
- Finn Wong. 2016. Performance analysis and optimization for PC-based VR applications: From the CPU’s perspective. Intel Virtual Reality Documentation. Retrieved 2016 from https://software.intel.com/en-us/articles/performance-analysis-and-optimization-for-pc-based-vr-applications-from-the-cpu-s.Google Scholar
- Yi Xu and Shiwen Mao. 2013. A survey of mobile cloud computing for rich media applications. IEEE Wireless Communications 20, 3 (2013), 46--53.Google ScholarCross Ref
Index Terms
- Novel Hybrid-Cast Approach to Reduce Bandwidth and Latency for Cloud-Based Virtual Space
Recommendations
Software Techniques to Reduce Cybersickness Among Users of Immersive Virtual Reality Environments
Intelligent Information and Database SystemsAbstractThe virtual worlds are photorealistic, the users have difficulty distinguishing the reality and virtuality. The high degree of realism of artificial virtual worlds results in deep immersion in virtual environments. The users immerse themselves in ...
Hybrid avatars: enabling co-presence in multiple realities
Web3D '16: Proceedings of the 21st International Conference on Web3D TechnologyVirtual reality (VR) and augmented reality (AR) technologies are quickly making their way into people's everyday lives. Typically, these technologies are used separately to create either plain VR or AR applications rather than harnessing the ...
Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment
Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Comments