Work in Progress

Towards an Open Standard for Gameplay Metrics

Authors:

Francisco Gutiérrez,

Kathrin Gerling,

Katrien VerbertAuthors Info & Claims

CHI PLAY '18 Extended Abstracts: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts

Pages 399 - 406

https://doi.org/10.1145/3270316.3271529

Published: 23 October 2018 Publication History

Abstract

Gameplay Metrics can help provide insights into player behaviour and performance, supporting game designers and players wishing to better understand their own game, yet such data is often not easily available to the wider public. We take our inspiration from the field of Learning Analytics, which attempts to create awareness and insights for learners by leveraging the gathered activity data and feeding this back to the students in an open way. This paper suggests an open standard for gathering and storing Gameplay Metrics data based on proven standards in Learning Analytics, facilitating easier development of analytical tools across different video games and genres to the benefit of researchers, developers, and players.

References

[1]

C. Alonso-Fernandez, A. Calvo, M. Freire, I. Martinez-Ortiz, and B. Fernandez-Manjon. 2017. Systematizing game learning analytics for serious games. In 2017 IEEE Global Engineering Education Conference (EDUCON). 1111--1118.

[2]

Aneesha Bakharia, Kirsty Kitto, Abelardo Pardo, Dragan Gavs ević, and Shane Dawson. 2016. Recipe for success: lessons learnt from using xAPI within the connected learning analytics toolkit. In Proceedings of the sixth international conference on learning analytics & knowledge. ACM, 378--382.

Digital Library

[3]

Sven Charleer, Kathrin Gerling, Francisco Guiterrez, Hans Cauwenbergh, Bram Luycx, and Katrien Verbert. Real-Time Dashboards to Support eSports Spectating. In CHIPLAY 2018. in press, 1--13.

Digital Library

[4]

Sven Charleer, Joris Klerkx, Erik Duval, Tinne De Laet, and Katrien Verbert. 2016. Creating Effective Learning Analytics Dashboards: Lessons Learnt. In Adaptive and Adaptable Learning: 11th European Conference on Technology Enhanced Learning, EC-TEL 2016, Lyon, France, September 13--16, 2016, Proceedings, Katrien Verbert, Mike Sharples, and Tomavz Klobuvc ar (Eds.). Springer International Publishing, Cham, 42--56.

[5]

David Churchill and Michael Buro. 2011. Build Order Optimization in StarCraft. In AIIDE. 14--19.

Digital Library

[6]

Anders Drachen, Magy Seif El-Nasr, and Alessandro Canossa. 2013. Game Analytics -- The Basics. Springer London, London, 13--40.

[7]

Blizzard Entertainment. 2010. StarCraft II: Wings of Liberty. Game {PC}. (27 July 2010). Blizzard Entertainment, Irvine, California, USA. Last played April 2018.

[8]

Blizzard Entertainment. 2018. S2 Protocol. https://github.com/Blizzard/s2protocol. (June 2018). Accessed: 2018-07-13.

[9]

Riot Games. 2009. League of Legends. Game {PC}. (27 October 2009). Riot Games, Los Angeles, California, USA. Last played April 2018.

[10]

Riot Games. 2018. Riot Games API. https://developer.riotgames.com/. (June 2018). Accessed: 2018-07-13.

[11]

Hidden Path Entertainment and Valve Corporation. 2012. Counter-Strike: Global Offensive. Game {PC}. (21 August 2012). Valve Corporation, Bellevue, Washington, USA. Last played April 2018.

[12]

Jesse Hostetler, Ethan W Dereszynski, Thomas G Dietterich, and Alan Fern. 2012. Inferring strategies from limited reconnaissance in real-time strategy games. arXiv preprint arXiv:1210.4880 (2012).

Digital Library

[13]

J. L. Hsieh and C. T. Sun. 2008. Building a player strategy model by analyzing replays of real-time strategy games. In 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence). 3106--3111.

[14]

Pascal Lessel, Alexander Vielhauer, and Antonio Krü ger. 2017. Expanding Video Game Live-Streams with Enhanced Communication Channels: A case study. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17) (2017), 1571--1576.

Digital Library

[15]

Ben Medler and Brian Magerko. 2011. Analytics of play: Using information visualization and gameplay practices for visualizing video game data. Parsons Journal for Information Mapping 3, 1 (2011), 1--12.

[16]

Nelson Minar. 2015. Riot Games API. https://nelsonslog.wordpress.com/2015/08/15/lol-live-match-stats/. (August 2015). Accessed: 2018-07-13.

[17]

Zachary Pousman, John Stasko, and Michael Mateas. 2007. Casual information visualization: Depictions of data in everyday life. IEEE transactions on visualization and computer graphics 13, 6 (2007), 1145--1152.

Digital Library

[18]

Glen Robertson and Ian Watson. 2014. An Improved Dataset and Extraction Process for Starcraft AI. Proceedings of the Twenty-Seventh International Florida Artificial Intelligence Research Society Conference (2014), 255--260. http://www.aaai.org/ocs/index.php/FLAIRS/FLAIRS14/paper/view/7867

[19]

Jose Luis Santos, Katrien Verbert, Joris Klerkx, Stefaan Ternier, Sven Charleer, and Erik Duval. 2015. Tracking Data in Open Learning Environments. Journal of Universal Computer Science 21, 7 (2015), 976--996.

[20]

sf editor1. 2018. Brood War Application Programming Interface. https://sourceforge.net/projects/bwapi.mirror/. (June 2018). Accessed: 2018-07-13.

[21]

George Siemens and Phil Long. 2011. Penetrating the fog: Analytics in learning and education. Educause Review 46, 5 (2011), 30--32.

[22]

Rafet Sifa, Anders Drachen, and Christian Bauckhage. 2018. Profiling in Games: Understanding Behavior from Telemetry. Social Interactions in Virtual Worlds: An Interdisciplinary Perspective (2018).

[23]

Katrien Verbert, Erik Duval, Joris Klerkx, Sten Govaerts, and José Luis Santos. 2013. Learning Analytics Dashboard Applications. American Behavioral Scientist 57, 10 (2013), 1500--1509.

[24]

Ben G. Weber, Michael Mateas, and Arnav Jhala. 2012. Learning from Demonstration for Goal-driven Autonomy. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence (AAAI'12). AAAI Press, 1176--1182. http://dl.acm.org/citation.cfm?id=2900728.2900895

Digital Library

[25]

AlliedModders Wiki. 2015. Counter-Strike: Global Offensive Events. https://wiki.iedmods.net/Counter-Strike:_Global_Offensive_Events. (November 2015). Accessed: 2018-07--13.

[26]

Annika Wolff, Zdenek Zdrahal, Andriy Nikolov, and Michal Pantucek. 2013. Improving Retention: Predicting At-risk Students by Analysing Clicking Behaviour in a Virtual Learning Environment. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (LAK '13). ACM, New York, NY, USA, 145--149.

Digital Library

Cited By

Sargolzaei PRastogi MZaman L(2024)Advancing Mixed Reality Game Development: An Evaluation of a Visual Game Analytics Tool in Action-Adventure and FPS GenresProceedings of the ACM on Human-Computer Interaction10.1145/36770558:CHI PLAY(1-32)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677055
Coppola RFulcini TManzi SStrada F(2024)How to Measure Game Testing: a Survey of Coverage MetricsProceedings of the ACM/IEEE 8th International Workshop on Games and Software Engineering10.1145/3643658.3643920(15-19)Online publication date: 14-Apr-2024
https://dl.acm.org/doi/10.1145/3643658.3643920
Pedrassoli Chitayat ACoates ABlock FDrachen AWalker JDean JMcconachie MYork P(2024)From Passive Viewer to Active Fan: Towards the Design and Large-Scale Evaluation of Interactive Audience Experiences in Esports and BeyondProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656318(94-107)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656318
Show More Cited By

Index Terms

Towards an Open Standard for Gameplay Metrics

Recommendations

Towards gameplay analysis via gameplay metrics
MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era

User-oriented research in the game industry is undergoing a change from relying on informal user-testing methods adapted directly from productivity software development to integrating modern approaches to usability- and user experience testing. Gameplay ...
Feedback-based gameplay metrics: measuring player experience via automatic visual analysis
IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

Using gameplay metrics to articulate player interaction within game systems has received increased interest in game studies. The value of gameplay metrics comes from a desire to empirically validate over a decade of theorization of player experience and ...
Game Metrics for Evaluating Social In-game Behavior and Interaction in Multiplayer Games
ACE '16: Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology

This paper explores the potential and applicability of gameplay metrics to assess social behavior and interactions of players. As digital games are often played in social contexts, social phenomena and processes are an important part of game user ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI PLAY '18 Extended Abstracts: Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts

October 2018

725 pages

ISBN:9781450359689

DOI:10.1145/3270316

General Chairs:
Florian 'Floyd' Mueller
Exertion Games Lab, RMIT University, Melbourne, Australia
,
Daniel Johnson
Queensland University of Technology, Brisbane, Australia
,
Ben Schouten
Eindhoven University of Technology and Amsterdam University of Applied Sciences, the Netherlands
,
Program Chairs:
Phoebe O. Toups Dugas
Play & Interactive Experiences for Learning Lab, New Mexico State University, Las Cruces, New Mexico, USA
,
Peta Wyeth
Queensland University of Technology, Brisbane, Australia

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2018

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

CHI PLAY '18

Sponsor:

SIGCHI

CHI PLAY '18: The annual symposium on Computer-Human Interaction in Play

October 28 - 31, 2018

VIC, Melbourne, Australia

Acceptance Rates

CHI PLAY '18 Extended Abstracts Paper Acceptance Rate 43 of 123 submissions, 35%;

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
242
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sargolzaei PRastogi MZaman L(2024)Advancing Mixed Reality Game Development: An Evaluation of a Visual Game Analytics Tool in Action-Adventure and FPS GenresProceedings of the ACM on Human-Computer Interaction10.1145/36770558:CHI PLAY(1-32)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677055
Coppola RFulcini TManzi SStrada F(2024)How to Measure Game Testing: a Survey of Coverage MetricsProceedings of the ACM/IEEE 8th International Workshop on Games and Software Engineering10.1145/3643658.3643920(15-19)Online publication date: 14-Apr-2024
https://dl.acm.org/doi/10.1145/3643658.3643920
Pedrassoli Chitayat ACoates ABlock FDrachen AWalker JDean JMcconachie MYork P(2024)From Passive Viewer to Active Fan: Towards the Design and Large-Scale Evaluation of Interactive Audience Experiences in Esports and BeyondProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656318(94-107)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656318
Gagnon DSwanson LHarpstead E(2024)Open Game Data: Defining a Pipeline and Standards for Educational Data Mining and Learning Analytics with Video Game Data2024 IEEE Conference on Games (CoG)10.1109/CoG60054.2024.10645573(1-8)Online publication date: 5-Aug-2024
https://doi.org/10.1109/CoG60054.2024.10645573
Xenopoulos PRulff JSilva C(2022)ggViz: Accelerating Large-Scale Esports Game AnalysisProceedings of the ACM on Human-Computer Interaction10.1145/35495016:CHI PLAY(1-22)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549501
Khalili-Mahani NDe Schutter B(2019)Affective Game Planning for Health Applications: Quantitative Extension of Gerontoludic Design Based on the Appraisal Theory of Stress and CopingJMIR Serious Games10.2196/133037:2(e13303)Online publication date: 6-Jun-2019
https://doi.org/10.2196/13303

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten