Ivan Slivar
Lea Skorin-Kapov
Editorial Notes
A corrigendum was issued for this article on December 4, 2019. You can download the corrigendum from the supplemental material section of this citation page.
ABSTRACT
Cloud gaming has been recognized as a promising shift in the online game industry, with the aim being to deliver high-quality graphics games to any type of end user device. The concepts of cloud computing are leveraged to render the game scene as a video stream which is then delivered to players in real-time. Given high bandwidth and strict latency requirements, a key challenge faced by cloud game providers lies in configuring the video encoding parameters so as to maximize player Quality of Experience (QoE) while meeting bandwidth availability constraints. In this paper we address this challenge by conducting a subjective laboratory study involving 52 players and two different games aimed at identifying QoE-driven video encoding adaptation strategies. Empirical results are used to derive analytical QoE estimation models as functions of bitrate and framerate, while also taking into account game type and player skill. Results have shown that under certain identified bandwidth conditions, reductions of framerate lead to QoE improvements due to improved graphics quality. Given that results indicate that different QoE-driven video adaptation policies should likely be applied for different types of games, we further report on objective video metrics that may be used to classify games for the purpose of choosing an appropriate and QoE-driven video codec configuration strategy.
Supplemental Material
Available for Download
Corrigendum to "Cloud gaming QoE models for deriving video encoding adaptation strategies," by Slivar et al., Proceedings of the 7th International Conference on Multimedia Systems (MMSys '16).
- H. Ahmadi, S. Z. Tootaghaj, M. R. Hashemi, and S. Shirmohammadi. A game attention model for efficient bit rate allocation in cloud gaming. Multimedia Systems, 20(5):485--501, 2014. Google Scholar
Digital Library
- J. Beyer, R. Varbelow, J.-N. Antons, and S. Möller. Using electroencephalography and subjective self-assessment to measure the influence of quality variations in cloud gaming. In Proceedings of the 7th International Workshop on Quality of Multimedia Experience (QoMEX), pages 1--6, May 2015.Google ScholarCross Ref
- M. Claypool. Motion and scene complexity for streaming video games. In Proceedings of the 4th International Conference on Foundations of Digital Games, pages 34--41. ACM, 2009. Google ScholarDigital Library
- M. Claypool and K. Claypool. Latency and player actions in online games. Commun. ACM, 49(11):40--45, Nov. 2006. Google ScholarDigital Library
- M. Claypool and K. Claypool. Perspectives, frame rates and resolutions: it's all in the game. In Proceedings of the 4th International Conference on Foundations of Digital Games, pages 42--49. ACM, 2009. Google ScholarDigital Library
- M. Claypool, J. Decelle, G. Hall, and L. O'Donnell. Surrender at 20? Matchmaking in League of Legends. In Proceedings of Games Entertainment Media Conference (GEM), pages 1--4. IEEE, 2015.Google Scholar
- M. Claypool and D. Finkel. The effects of latency on player performance in cloud-based games. In Proceedings of 13th Annual Workshop on Network and Systems Support for Games (NetGames), pages 1--6, 2014. Google ScholarDigital Library
- V. Clincy and B. Wilgor. Subjective evaluation of latency and packet loss in a cloud-based game. In Proceedings of the 10th International Conference on Information Technology: New Generations (ITNG), pages 473--476. IEEE, 2013. Google ScholarDigital Library
- M. Dick, O. Wellnitz, and L. Wolf. Analysis of factors affecting players' performance and perception in multiplayer games. In Proceedings of 4th ACM SIGCOMM workshop on Network and system support for games, NetGames '05, pages 1--7, 2005. Google ScholarDigital Library
- M. Fiedler, T. Hossfeld, and P. Tran-Gia. A generic quantitative relationship between quality of experience and quality of service. Network, IEEE, 24(2):36--41, 2010. Google ScholarDigital Library
- H. Hong, C. Hsu, T. Tsai, C. Huang, K. Chen, and C. Hsu. Enabling adaptive cloud gaming in an open-source cloud gaming platform. IEEE Transactions on Circuits and Systems for Video Technology, PP(99):1--14, 2015.Google ScholarCross Ref
- P. ITU-T Recommendation. Subjective video quality assessment methods for multimedia applications. 1999.Google Scholar
- M. Jarschel, D. Schlosser, S. Scheuring, and T. Hoßfeld. Gaming in the clouds: QoE and the users' perspective. Mathematical and Computer Modelling, 57(11):2883--2894, 2013.Google ScholarCross Ref
- Y.-T. Lee, K.-T. Chen, H.-I. Su, and C.-L. Lei. Are all games equally cloud-gaming-friendly? An electromyographic approach. In Proceedings of the 11th Annual Workshop on Network and Systems Support for Games (NetGames), pages 1--6. IEEE, 2012. Google ScholarDigital Library
- Y. Liu, S. Wang, and S. Dey. Content-aware modeling and enhancing user experience in cloud mobile rendering and streaming. IEEE J. Emerg. Sel. Topics Circuits Syst., 4(1):43--56, 2014.Google ScholarCross Ref
- S. Moller, J.-N. Antons, J. Beyer, S. Egger, E. Nunez Castellar, L. Skorin-Kapov, and M. Suznjevic. Towards a new ITU-T recommendation for subjective methods evaluating gaming QoE. In Proceedings of the 7th International Workshop on Quality of Multimedia Experience (QoMEX), pages 1--6. IEEE, 2015.Google ScholarCross Ref
- S. Möller, D. Pommer, J. Beyer, and J. Rake-Revelant. Factors Influencing Gaming QoE: Lessons Learned from the Evaluation of Cloud Gaming Services. In Proceedings of the 4th International Workshop on Perceptual Quality of Systems (PQS 2013), pages 1--5, Sept. 2013.Google ScholarCross Ref
- P. Quax, A. Beznosyk, W. Vanmontfort, R. Marx, and W. Lamotte. An evaluation of the impact of game genre on user experience in cloud gaming. In Proceedings of Games Innovation Conference (IGIC), pages 216--221. IEEE, 2013.Google ScholarCross Ref
- I. Slivar, M. Suznjevic, and L. Skorin-Kapov. Empirical QoE Study of In-Home Streaming of Online Games. In Proceedings of the 14th Annual Workshop on Network and Systems Support for Games (NetGames), Nagoya, Japan, Dec. 2014. Google ScholarDigital Library
- I. Slivar, M. Suznjevic, and L. Skorin-Kapov. The impact of video encoding parameters and game type on QoE for cloud gaming: A case study using the Steam platform. In Proceedings of the 7th International Workshop on Quality of Multimedia Experience (QoMEX), pages 1--6, May 2015.Google ScholarCross Ref
- M. Suznjevic, O. Dobrijevic, and M. Matijasevic. MMORPG player actions: Network performance, session patterns and latency requirements analysis. Multimedia Tools and Applications, 45(1-3):191--241, 2009. Google ScholarDigital Library
- M. Suznjevic, L. Skorin-Kapov, and M. Matijasevic. Impact of User, System, and Context factors on Gaming QoE: a Case Study Involving MMORPGs. In Proceedings of the 12th ACM SIGCOMM Workshop on Network and System Support for Games, 2013. Google ScholarDigital Library
- S. Wang and S. Dey. Modeling and characterizing user experience in a cloud server based mobile gaming approach. In Proceedings of Global Telecommunications Conference (GLOBECOM), pages 1--7. IEEE, 2009. Google ScholarDigital Library
- Z.-Y. Wen and H.-F. Hsiao. QoE-driven performance analysis of cloud gaming services. In Proceedings of the 16th International Workshop on Multimedia Signal Processing (MMSP), pages 1--6. IEEE, 2014.Google ScholarCross Ref
Index Terms
- Cloud gaming QoE models for deriving video encoding adaptation strategies
Recommendations
Game Categorization for Deriving QoE-Driven Video Encoding Configuration Strategies for Cloud Gaming
Special Section on Delay-Sensitive Video Computing in the Cloud and Special Section on Extended MMSys-NOSSDAV Best PapersCloud gaming has been recognized as a promising shift in the online game industry, with the aim of implementing the “on demand” service concept that has achieved market success in other areas of digital entertainment such as movies and TV shows. The ...
Content-aware video encoding for cloud gaming
MMSys '19: Proceedings of the 10th ACM Multimedia Systems ConferenceCloud gaming allows users with thin-clients to play complex games on their end devices as the bulk of processing is offloaded to remote servers. A thin-client is only required to have basic decoding capabilities which exist on most modern devices. The ...
A latency compensation technique based on game characteristics to mitigate the influence of delay on cloud gaming quality of experience
MMSys '20: Proceedings of the 11th ACM Multimedia Systems ConferenceCloud Gaming (CG) is an immersive multimedia service that promises many benefits. In CG, the games are rendered in a cloud server, and the resulted scenes are streamed as a video sequence to the client. Using CG users are not forced to update their ...
Comments