skip to main content
research-article

Novel Hybrid-Cast Approach to Reduce Bandwidth and Latency for Cloud-Based Virtual Space

Authors Info & Claims
Published:15 June 2018Publication History
Skip Abstract Section

Abstract

In this article, we explore the possibility of enabling cloud-based virtual space applications for better computational scalability and easy access from any end device, including future lightweight wireless head-mounted displays. In particular, we investigate virtual space applications such as virtual classroom and virtual gallery, in which the scenes and activities are rendered in the cloud, with multiple views captured and streamed to each end device. A key challenge is the high bandwidth requirement to stream all the user views, leading to high operational cost and potential large delay in a bandwidth-restricted wireless network. We propose a novel hybrid-cast approach to save bandwidth in a multi-user streaming scenario. We identify and broadcast the common pixels shared by multiple users, while unicasting the residual pixels for each user. We formulate the problem of minimizing the total bitrate needed to transmit the user views using hybrid-casting and describe our approach. A common view extraction approach and a smart grouping algorithm are proposed and developed to achieve our hybrid-cast approach. Simulation results show that the hybrid-cast approach can significantly reduce total bitrate by up to 55% and avoid congestion-related latency, compared to traditional cloud-based approach of transmitting all the views as individual unicast streams, hence addressing the bandwidth challenges of the cloud, with additional benefits in cost and delay.

Skip Supplemental Material Section

Supplemental Material

References

  1. ISO/IEC JTC 1. 1993. Coding of moving pictures and associated audio for digital storage media at up to about 1.5 Mbit/s-Part 2: Video. ISO/IEC 11172-2 (MPEG-1) (1993).Google ScholarGoogle Scholar
  2. ISO/IEC JTC 1. 1999. Coding of audio-visual objects—Part 2: visual. ISO/IEC 14496-2 (MPEG-4 Vis. Version 1) (Apr. 1999).Google ScholarGoogle Scholar
  3. ITU-T ISO/IEC JTC 1. 1994. Generic coding of moving pictures and associated audio information part 2: Video. ITU-T Rec. H.262 ISO/IEC 13818-2 (MPEG-2 Video) (Nov. 1994).Google ScholarGoogle Scholar
  4. ITU-T ISO/IEC JTC 1. 2003. Advanced video coding for generic audio-visual services. ITU-T Rec. H.264 ISO/IEC 14496-10 (AVC) (May 2003).Google ScholarGoogle Scholar
  5. Song Ho Ahn. 2018. OpenGL projection matrix. Retrieved 2018 from http://www.songho.ca/opengl/gl_projectionmatrix.html.Google ScholarGoogle Scholar
  6. Song Ho Ahn. 2018. OpenGL transformation. Retrieved 2018 from http://www.songho.ca/opengl/gl_transform.html.Google ScholarGoogle Scholar
  7. Amazon. 2018. Amazon EC2 pricing. Retrieved 2018 from https://aws.amazon.com/ec2/pricing/on-demand.Google ScholarGoogle Scholar
  8. Amazon. 2018. AWS. Retrieved 2018 from https://aws.amazon.com.Google ScholarGoogle Scholar
  9. Wei Cai and Victor C. M. Leung. 2012. Multiplayer cloud gaming system with cooperative video sharing. In Cloud Computing Technology and Science (CloudCom), 2012 IEEE 4th International Conference on. IEEE, Taipei, 640--645. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Marta Carbone and Luigi Rizzo. 2010. Dummynet revisited. ACM SIGCOMM Computer Communication Review 40, 2 (2010), 12--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Recommendation H.261 CCITT. 1990. Video codec for audiovisual services at px 64 kbit/s. Draft Revision (Mar. 1990).Google ScholarGoogle Scholar
  12. Recommendation H.263 CCITT. 1995. Video coding for low bit rate communication. Draft (Nov. 1995).Google ScholarGoogle Scholar
  13. Aleksandra Checko, Henrik L. Christiansen, Ying Yan, Lara Scolari, Georgios Kardaras, Michael S. Berger, and Lars Dittmann. 2015. Cloud RAN for mobile networks—A technology overview. IEEE Communications Surveys 8 Tutorials 17, 1 (2015), 405--426.Google ScholarGoogle Scholar
  14. Hoang T. Dinh, Chonho Lee, Dusit Niyato, and Ping Wang. 2013. A survey of mobile cloud computing: Architecture, applications, and approaches. Wireless Communications and Mobile Computing 13, 18 (2013), 1587--1611.Google ScholarGoogle ScholarCross RefCross Ref
  15. edX. 2018. MOOC. Retrieved 2018 from https://www.edx.org.Google ScholarGoogle Scholar
  16. Cass Everitt. 2001. Projective texture mapping. White Paper, Nvidia Corporation (April 2001).Google ScholarGoogle Scholar
  17. Xueshi Hou, Yao Lu, and Sujit Dey. 2016. A novel hyper-cast approach to enable cloud-based virtual classroom applications. In 2016 IEEE International Symposium on Multimedia (ISM’16). IEEE, San Jose, CA, USA, 533--536.Google ScholarGoogle ScholarCross RefCross Ref
  18. HTC. 2018. HTC Vive. Retrieved 2018 from https://www.htcvive.com.Google ScholarGoogle Scholar
  19. ITU-T and ISO/IEC JTC. 2013. High efficiency video coding. ITU-T Rec. H.265 and ISO/IEC 23008-2 (HEVC) (Jan. 2013).Google ScholarGoogle Scholar
  20. Xin Jin, Li Erran Li, Laurent Vanbever, and Jennifer Rexford. 2013. Softcell: Scalable and flexible cellular core network architecture. In Proceedings of the 9th ACM Conference on Emerging Networking Experiments and Technologies. ACM, 163--174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. StarBurst K. Miller, StarBurst K. Robertson, Cisco A. Tweedly, and StarBurst M. White. 1998. StarBurst multicast file transfer protocol (MFTP) specification. Retrieved 1998 from https://tools.ietf.org/html/draft-miller-mftp-spec-03.Google ScholarGoogle Scholar
  22. David Lecompte and Frédéric Gabin. 2012. Evolved multimedia broadcast/multicast service (eMBMS) in LTE-advanced: Overview and Rel-11 enhancements. IEEE Communications Magazine 50, 11 (2012).Google ScholarGoogle ScholarCross RefCross Ref
  23. Yao Liu, Shaoxuan Wang, and Sujit Dey. 2014. Content-aware modeling and enhancing user experience in cloud mobile rendering and streaming. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 4, 1 (Mar. 2014), 43--56.Google ScholarGoogle ScholarCross RefCross Ref
  24. Yao Lu and Sujit Dey. 2016. JAVRE: A joint asymmetric video rendering and encoding approach to enable optimized cloud mobile 3D virtual immersive user experience. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 6, 4 (2016), 544--559.Google ScholarGoogle ScholarCross RefCross Ref
  25. Yao Lu, Yao Liu, and Sujit Dey. 2015. Cloud mobile 3D display gaming user experience modeling and optimization by asymmetric graphics rendering. IEEE Journal of Selected Topics in Signal Processing 9, 3 (April 2015), 517--532.Google ScholarGoogle ScholarCross RefCross Ref
  26. Oculus. 2018. Oculus rift. Retrieved 2018 from https://www.oculus.com.Google ScholarGoogle Scholar
  27. Oculus. 2018. Performance head-up display. Retrieved 2018 from https://developer.oculus.com/documentation/pcsdk/latest/concepts/dg-hud.Google ScholarGoogle Scholar
  28. OpenGL. 2018. OpenGL. Retrieved 2018 from https://www.opengl.org.Google ScholarGoogle Scholar
  29. Abhijit Patait and Eric Young. 2018. High performance video encoding with Nvidia GPS. https://goo.gl/Bdjdgm.Google ScholarGoogle Scholar
  30. 5G-Xcast Project. 2018. PTM. Retrieved 2018 from http://5g-xcast.eu/about.Google ScholarGoogle Scholar
  31. WebM project. 2018. VP9 video codec. Retrieved 2018 from http://www.webmproject.org/vp9.Google ScholarGoogle Scholar
  32. Samsung. 2018. Samsung gear VR. Retrieved 2018 from http://www.samsung.com/global/galaxy/gear-vr.Google ScholarGoogle Scholar
  33. Unity. 2018. Unity. Retrieved 2018 from https://unity3d.com.Google ScholarGoogle Scholar
  34. Shaoxuan Wang and Sujit Dey. 2013. Adaptive mobile cloud computing to enable rich mobile multimedia applications. IEEE Transactions on Multimedia 15, 4 (June 2013), 870--883. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Wikipedia. 2018. AV1. Retrieved 2018 from https://en.wikipedia.org/wiki/AOMedia_Video_1.Google ScholarGoogle Scholar
  36. Wikipedia. 2018. IP multicast. Retrieved 2018 from https://en.wikipedia.org/wiki/IP_multicast.Google ScholarGoogle Scholar
  37. Wikipedia. 2018. Pragmatic general multicast. Retrieved 2018 from https://en.wikipedia.org/wiki/Pragmatic_General_Multicast.Google ScholarGoogle Scholar
  38. Wikipedia. 2018. Real-time transport protocol. Retrieved 2018 from https://en.wikipedia.org/wiki/Real-time_Transport_Protocol.Google ScholarGoogle Scholar
  39. Wikipedia. 2018. Rendering pipeline. Retrieved 2018 from https://en.wikipedia.org/wiki/Graphics_pipeline.Google ScholarGoogle Scholar
  40. Wikipedia. 2018. Resource reservation protocol. Retrieved 2018 from https://en.wikipedia.org/wiki/Resource_Reservation_Protocol.Google ScholarGoogle Scholar
  41. Finn Wong. 2016. Performance analysis and optimization for PC-based VR applications: From the CPU’s perspective. Intel Virtual Reality Documentation. Retrieved 2016 from https://software.intel.com/en-us/articles/performance-analysis-and-optimization-for-pc-based-vr-applications-from-the-cpu-s.Google ScholarGoogle Scholar
  42. Yi Xu and Shiwen Mao. 2013. A survey of mobile cloud computing for rich media applications. IEEE Wireless Communications 20, 3 (2013), 46--53.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Novel Hybrid-Cast Approach to Reduce Bandwidth and Latency for Cloud-Based Virtual Space

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 14, Issue 3s
      Special Section on Delay-Sensitive Video Computing in the Cloud and Special Section on Extended MMSys-NOSSDAV Best Papers
      June 2018
      317 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/3233173
      Issue’s Table of Contents

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 15 June 2018
      • Accepted: 1 April 2018
      • Revised: 1 March 2018
      • Received: 1 August 2017
      Published in tomm Volume 14, Issue 3s

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader