skip to main content
10.1145/3402942.3403016acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfdgConference Proceedingsconference-collections
research-article

Reading Between the Lines – Towards an Algorithm Exploiting In-game Behaviors to Learn Preferences in Gameful Systems

Published: 17 September 2020 Publication History

Abstract

Players’ retainment can be fostered by investigating whether the game elements players are interacting with are to their liking and tailoring game dynamics to meet their preferences. Thus, adaptive gameplay is a widely interesting topic in both the Game User Research field and the game industry. Considering that explicit information on players’ preferences often lacks, alternative approaches are needed. This task becomes even more challenging when the gameplay data available is limited due to the simplicity of the system employed, as it occurs in gameful systems in contrast to complex entertainment games or serious games. In this work, we propose an algorithm that exploits user behaviors as an implicit component to compute players’ preferences by measuring their level of activity. The application domain is a persuasive gameful system, and the customizable game elements are single-player challenges. The proposed algorithm uses offline gameplay data to compute a preference score for every viable option. The outcomes are then compared against a ground truth calculated from players’ in-game choices. Our findings suggest that players’ behaviors can be used to inform the generation of tailored game elements.

References

[1]
Yigal Attali and Meirav Arieli-Attali. 2015. Gamification in assessment: Do points affect test performance?Computers & Education 83 (2015), 57–63. https://doi.org/10.1016/j.compedu.2014.12.012
[2]
Myat Aung, Simon Demediuk, Yuan Sun, Ye Tu, Yu Ang, Siva Nekkanti, Shantanu Raghav, Diego Klabjan, Rafet Sifa, and Anders Drachen. 2019. The trails of Just Cause 2: spatio-temporal player profiling in open-world games. In Proceedings of the 14th International Conference on the Foundations of Digital Games. ACM, 41.
[3]
Roger Bakeman and John M. Gottman. 1997. Observing Interaction: An Introduction to Sequential Analysis.
[4]
Richard Bartle. 1996. Hearts, Clubs, Diamonds, Spades: Players Who Suit MUDs. 1 (1996), 19.
[5]
Shlomo Berkovsky, Mac Coombe, Jill Freyne, Dipak Bhandari, and Nilufar Baghaei. 2010. Physical Activity Motivating Games: Virtual Rewards for Real Activity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’10). ACM, New York, NY, USA, 243–252. https://doi.org/10.1145/1753326.1753362 event-place: Atlanta, Georgia, USA.
[6]
P. Bertens, A. Guitart, and Á Periáñez. 2017. Games and big data: A scalable multi-dimensional churn prediction model. In 2017 IEEE Conference on Computational Intelligence and Games (CIG). 33–36. https://doi.org/10.1109/CIG.2017.8080412
[7]
Alessandro Canossa, Sasha Makarovych, Julian Togelius, and Anders Drachenn. 2018. Like a DNA String: Sequence-Based Player Profiling in Tom Clancy’s The Division. In Fourteenth Artificial Intelligence and Interactive Digital Entertainment Conference.
[8]
Alessandro Canossa and Gillian Smith. 2015. Towards a Procedural Evaluation Technique: Metrics for Level Design. In Proceedings of the 10th International Conference on the Foundations of Digital Games. Pacific Grove, CA, USA.
[9]
Mihaly Csikszentmihalyi. 1997. Finding flow: The psychology of engagement with everyday life. Basic Books, New York, NY, US.
[10]
Luis de Marcos, Eva Garcia-Lopez, and Antonio Garcia-Cabot. 2016. On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking. Computers & Education 95 (2016), 99–113. https://doi.org/10.1016/j.compedu.2015.12.008
[11]
Thomas Debeauvais, Bonnie Nardi, Diane J. Schiano, Nicolas Ducheneaut, and Nicholas Yee. 2011. If You Build It They Might Stay: Retention Mechanisms in World of Warcraft. In Proceedings of the 6th International Conference on Foundations of Digital Games(FDG ’11). ACM, New York, NY, USA, 180–187. https://doi.org/10.1145/2159365.2159390 event-place: Bordeaux, France.
[12]
Simon Demediuk, Alexandra Murrin, David Bulger, Michael Hitchens, Anders Drachen, William L. Raffe, and Marco Tamassia. 2018. Player retention in league of legends: a study using survival analysis. In Proceedings of the Australasian Computer Science Week Multiconference. ACM, 43.
[13]
Simon Demediuk, Marco Tamassia, Xiaodong Li, and William L. Raffe. 2019. Challenging AI: Evaluating the Effect of MCTS-Driven Dynamic Difficulty Adjustment on Player Enjoyment. In ACSW. 43–1.
[14]
Simon Demediuk, Marco Tamassia, William L. Raffe, Fabio Zambetta, Xiaodong Li, and Florian Mueller. 2017. Monte carlo tree search based algorithms for dynamic difficulty adjustment. In 2017 IEEE Conference on Computational Intelligence and Games (CIG). IEEE, 53–59.
[15]
Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From Game Design Elements to Gamefulness: Defining ”Gamification”. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments(MindTrek ’11). ACM, New York, NY, USA, 9–15. https://doi.org/10.1145/2181037.2181040 event-place: Tampere, Finland.
[16]
A. Drachen, A. Canossa, and G. N. Yannakakis. 2009. Player modeling using self-organization in Tomb Raider: Underworld. In 2009 IEEE Symposium on Computational Intelligence and Games. 1–8. https://doi.org/10.1109/CIG.2009.5286500
[17]
Anders Drachen, James Green, Chester Gray, Elie Harik, Patty Lu, Rafet Sifa, and Diego Klabjan. 2016. Guns and guardians: Comparative cluster analysis and behavioral profiling in destiny. In 2016 IEEE Conference on Computational Intelligence and Games (CIG). IEEE, 1–8.
[18]
A. Drachen, R. Sifa, C. Bauckhage, and C. Thurau. 2012. Guns, swords and data: Clustering of player behavior in computer games in the wild. In 2012 IEEE Conference on Computational Intelligence and Games (CIG). 163–170. https://doi.org/10.1109/CIG.2012.6374152
[19]
Magy Seif El-Nasr, Anders Drachen, and Alessandro Canossa. 2016. Game analytics. Springer.
[20]
Lauren S. Ferro, Steffen P. Walz, and Stefan Greuter. 2013. Towards Personalised, Gamified Systems: An Investigation into Game Design, Personality and Player Typologies. In Proceedings of The 9th Australasian Conference on Interactive Entertainment: Matters of Life and Death(IE ’13). ACM, New York, NY, USA, 7:1–7:6. https://doi.org/10.1145/2513002.2513024 event-place: Melbourne, Australia.
[21]
Michela Ferron, Enrica Loria, Marconi Annapaola, and Massa Paolo. 2019. Play&Go, an Urban Game Promoting Behaviour Change for Sustainable Mobility. Interaction Design and Architecture(s) Journal – IxD&A (2019), 24 – 45.
[22]
F. Hadiji, R. Sifa, A. Drachen, C. Thurau, K. Kersting, and C. Bauckhage. 2014. Predicting player churn in the wild. In 2014 IEEE Conference on Computational Intelligence and Games. 1–8. https://doi.org/10.1109/CIG.2014.6932876
[23]
Danial Hooshyar, Moslem Yousefi, and Heuiseok Lim. 2018. Data-Driven Approaches to Game Player Modeling: A Systematic Literature Review. ACM Comput. Surv. 50, 6 (2018), 90:1–90:19. https://doi.org/10.1145/3145814
[24]
Danial Hooshyar, Moslem Yousefi, and Heuiseok Lim. 2018. A Procedural Content Generation-Based Framework for Educational Games: Toward a Tailored Data-Driven Game for Developing Early English Reading Skills. Journal of Educational Computing Research 56, 2 (2018), 293–310. https://doi.org/10.1177/0735633117706909
[25]
Ruud S. Jacobs. 2016. Play to Win Over: Audiences and Effects of Persuasive Games.
[26]
Tomislav Jagušt, Ivica Botički, and Hyo-Jeong So. 2018. Examining competitive, collaborative and adaptive gamification in young learners’ math learning. Computers & Education 125 (2018), 444–457. https://doi.org/10.1016/j.compedu.2018.06.022
[27]
Rishabh Joshi, Varun Gupta, Xinyue Li, Yue Cui, Ziwen Wang, Yaser Ravari, Rafet Sifa, Azita Parsaianen, Anders Drachen, and Simon Peter Demediuk. 2019. A Team Based Player Versus Player Recommender Systems Framework For Player Improvement. In Proceedings of ACSW. York.
[28]
Maurits Kaptein, Boris De Ruyter, Panos Markopoulos, and Emile Aarts. 2012. Adaptive Persuasive Systems: A Study of Tailored Persuasive Text Messages to Reduce Snacking. ACM Trans. Interact. Intell. Syst. 2, 2 (2012), 10:1–10:25. https://doi.org/10.1145/2209310.2209313
[29]
Michael D. Kickmeier-Rust, Eva-C. Hillemann, and Dietrich Albert. 2014. Gamification and Smart Feedback: Experiences with a Primary School Level Math App. International Journal of Game-Based Learning (IJGBL) 4, 3 (2014), 35–46. https://doi.org/10.4018/ijgbl.2014070104
[30]
Kristian Kiili, Korbinian Moeller, and Manuel Ninaus. 2018. Evaluating the effectiveness of a game-based rational number training - In-game metrics as learning indicators. Computers & Education 120 (2018), 13–28. https://doi.org/10.1016/j.compedu.2018.01.012
[31]
Jun H. Kim, Daniel V. Gunn, Eric Schuh, Bruce Phillips, Randy J. Pagulayan, and Dennis Wixon. 2008. Tracking Real-time User Experience (TRUE): A Comprehensive Instrumentation Solution for Complex Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’08). ACM, New York, NY, USA, 443–452. https://doi.org/10.1145/1357054.1357126 event-place: Florence, Italy.
[32]
Antti Knutas, Rob van Roy, Timo Hynninen, Marco Granato, Jussi Kasurinen, and Jouni Ikonen. 2019. A process for designing algorithm-based personalized gamification. Multimedia Tools and Applications 78, 10 (2019), 13593–13612. https://doi.org/10.1007/s11042-018-6913-5
[33]
Jonna Koivisto and Juho Hamari. 2019. The rise of motivational information systems: A review of gamification research. International Journal of Information Management 45 (2019), 191–210. https://doi.org/10.1016/j.ijinfomgt.2018.10.013
[34]
Johannes Kunkel, Benedikt Loepp, and Jürgen Ziegler. 2017. A 3D item space visualization for presenting and manipulating user preferences in collaborative filtering. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, 3–15.
[35]
Nikoletta Zampeta Legaki, Nannan Xi, Juho Hamari, and Vassilios Assimakopoulos. 2019. Gamification of The Future: An Experiment on Gamifying Education of Forecasting. https://doi.org/10.24251/HICSS.2019.219
[36]
C. Lopez and C. Tucker. 2018. Towards Personalized Adaptive Gamification: A Machine Learning Model for Predicting Performance. IEEE Transactions on Games(2018), 1–1. https://doi.org/10.1109/TG.2018.2883661
[37]
Enrica Loria and Annapaola Marconi. 2018. Player Types and Player Behaviors: Analyzing Correlations in an On-the-field Gamified System. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts - CHI PLAY ’18 Extended Abstracts. ACM Press, Melbourne, VIC, Australia, 531–538. https://doi.org/10.1145/3270316.3271526
[38]
Enrica Loria and Annapaola Marconi. 2019. A Data-Driven Approach to Deduce Players’ Preferences from In-Game Interactions in Gameful Systems. In Proceedings of The First Game Analytics Workshop, Vol. In Press. CEUR Workshop Proceedings, Atlanta, GA, USA.
[39]
Annapaola Marconi and Enrica Loria. 2020. Sustainable Mobility in Smart Cities: The Key Role of Gamified Motivational Systems for Citizens’ Engagement and Behavior Change. In Implications of Mobility as a Service (MaaS) in Urban and Rural Environments: Emerging Research and Opportunities, IGI Global (Ed.). Hershey, PA, 211–246.
[40]
Andrzej Marczewski. 2018. Even Ninja Monkeys Like to Play: Unicorn Edition.
[41]
Baptiste Monterrat, Élise Lavoué, and Sébastien George. 2017. Adaptation of Gaming Features for Motivating Learners. Simulation & Gaming 48, 5 (2017), 625–656. https://doi.org/10.1177/1046878117712632
[42]
Benedikt Morschheuser and Juho Hamari. 2019. The Gamification of Work: Lessons From Crowdsourcing. Journal of Management Inquiry 28, 2 (2019), 145–148. https://doi.org/10.1177/1056492618790921
[43]
Lennart E. Nacke, Chris Bateman, and Regan L. Mandryk. 2014. BrainHex: A neurobiological gamer typology survey. Entertainment Computing 5, 1 (2014), 55–62. https://doi.org/10.1016/j.entcom.2013.06.002
[44]
Aline Normoyle and Shane T. Jensen. 2015. Bayesian Clustering of Player Styles for Multiplayer Games. In Eleventh Artificial Intelligence and Interactive Digital Entertainment Conference.
[45]
Dmitry Nozhnin. 2012. Predicting Churn: When Do Veterans Quit?
[46]
Rita Orji, Regan L. Mandryk, and Julita Vassileva. 2017. Improving the Efficacy of Games for Change Using Personalization Models. ACM Trans. Comput.-Hum. Interact. 24, 5 (2017), 32:1–32:22. https://doi.org/10.1145/3119929
[47]
Rita Orji, Lennart E. Nacke, and Chrysanne Di Marco. 2017. Towards Personality-driven Persuasive Health Games and Gamified Systems. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). ACM, New York, NY, USA, 1015–1027. https://doi.org/10.1145/3025453.3025577 event-place: Denver, Colorado, USA.
[48]
Ranilson Paiva, Ig Ibert Bittencourt, Thyago Tenório, Patricia Jaques, and Seiji Isotani. 2016. What do students do on-line? Modeling students’ interactions to improve their learning experience. Computers in Human Behavior 64 (2016), 769–781. https://doi.org/10.1016/j.chb.2016.07.048
[49]
Carlos Pereira Santos, Kevin Hutchinson, Vassilis-Javed Khan, and Panos Markopoulos. 2017. Measuring self-esteem with games. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, 95–105.
[50]
Maria Perez-Ortiz and Rafal K. Mantiuk. 2017. A practical guide and software for analysing pairwise comparison experiments. arXiv:1712.03686 [cs, stat](2017). arXiv: 1712.03686.
[51]
Felix Putze, Mazen Salous, and Tanja Schultz. 2018. Detecting memory-based interaction obstacles with a recurrent neural model of user behavior. In 23rd International Conference on Intelligent User Interfaces. ACM, 205–209.
[52]
Amon Rapp, Frank Hopfgartner, Juho Hamari, Conor Linehan, and Federica Cena. 2019. Strengthening gamification studies: Current trends and future opportunities of gamification research. International Journal of Human-Computer Studies 127 (2019), 1–6. https://doi.org/10.1016/j.ijhcs.2018.11.007
[53]
Rafet Sifa, Anders Drachen, and Christian Bauckhage. 2018. Profiling in Games: Understanding Behavior from Telemetry. Social Interactions in Virtual Worlds: An Interdisciplinary Perspective (2018).
[54]
R. Sifa, A. Drachen, C. Bauckhage, C. Thurau, and A. Canossa. 2013. Behavior evolution in Tomb Raider Underworld. In 2013 IEEE Conference on Computational Inteligence in Games (CIG). 1–8. https://doi.org/10.1109/CIG.2013.6633637
[55]
Tom Stafford and Erwin Haasnoot. 2017. Testing sleep consolidation in skill learning: A field study using an online game. Topics in cognitive science 9, 2 (2017), 485–496.
[56]
HALLIFAX Stuart, Audrey Serna, Jean-Charles Marty, and Elise Lavoué. 2019. Adaptive gamification in education: A literature review of current trends and developments. In European Conference on Technology Enhanced Learning (EC). Delft, Netherlands.
[57]
Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement learning: an introduction(second edition ed.). The MIT Press, Cambridge, Massachusetts.
[58]
M. Tamassia, W. Raffe, R. Sifa, A. Drachen, F. Zambetta, and M. Hitchens. 2016. Predicting player churn in destiny: A Hidden Markov models approach to predicting player departure in a major online game. In 2016 IEEE Conference on Computational Intelligence and Games (CIG). 1–8. https://doi.org/10.1109/CIG.2016.7860431
[59]
Gustavo Fortes Tondello, Deltcho Valtchanov, Adrian Reetz, Rina R. Wehbe, Rita Orji, and Lennart E. Nacke. 2018. Towards a Trait Model of Video Game Preferences. International Journal of Human–Computer Interaction 34, 8(2018), 732–748. https://doi.org/10.1080/10447318.2018.1461765
[60]
Gustavo F. Tondello, Rina R. Wehbe, Lisa Diamond, Marc Busch, Andrzej Marczewski, and Lennart E. Nacke. 2016. The Gamification User Types Hexad Scale. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’16). ACM, New York, NY, USA, 229–243. https://doi.org/10.1145/2967934.2968082
[61]
Julita Vassileva. 2012. Motivating participation in social computing applications: a user modeling perspective. User Modeling and User-Adapted Interaction 22, 1 (2012), 177–201. https://doi.org/10.1007/s11257-011-9109-5
[62]
Guenter Wallner. 2015. Sequential Analysis of Player Behavior. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’15). ACM, New York, NY, USA, 349–358. https://doi.org/10.1145/2793107.2793112 event-place: London, United Kingdom.
[63]
Günter Wallner, Christopher Schinnerl, Michael Helfried Schiller, Alexander Monte Calvo, Johanna Pirker, Rafet Sifa, and Anders Drachen. 2019. Beyond the individual: Understanding social structures of an online player matchmaking website. Entertainment Computing 30 (2019), 100284.
[64]
Harald Warmelink, Jonna Koivisto, Igor Mayer, Mikko Vesa, and Juho Hamari. 2018. Gamification of the work floor: A literature review of gamifying production and logistics operations. Hawaii International Conference on System Sciences 2018 (HICSS-51) (2018).
[65]
Helen Wauck and Wai-Tat Fu. 2017. A Data-Driven, Multidimensional Approach to Hint Design in Video Games. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, 137–147.
[66]
Geogios N. Yannakakis. 2012. Game AI Revisited. In Proceedings of the 9th Conference on Computing Frontiers(CF ’12). ACM, New York, NY, USA, 285–292. https://doi.org/10.1145/2212908.2212954 event-place: Cagliari, Italy.
[67]
G. N. Yannakakis and J. Togelius. 2011. Experience-Driven Procedural Content Generation. IEEE Transactions on Affective Computing 2, 3 (2011), 147–161. https://doi.org/10.1109/T-AFFC.2011.6
[68]
G. N. Yannakakis and J. Togelius. 2015. Experience-driven procedural content generation (Extended abstract). In 2015 International Conference on Affective Computing and Intelligent Interaction (ACII). 519–525. https://doi.org/10.1109/ACII.2015.7344619
[69]
Ping Zhang. 2008. Motivational Affordances: Reasons for ICT Design. Technical Opinion (2008).

Cited By

View all
  • (2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
  • (2023)Challenging Models: Formalizing Quests in Gamified Systems for Behavioral Change2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00121(747-756)Online publication date: 1-Oct-2023
  • (2023)Enhancing Gameful Systems with a Domain Specific Language for Rules Lifecycle Management2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00065(342-352)Online publication date: 1-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
FDG '20: Proceedings of the 15th International Conference on the Foundations of Digital Games
September 2020
804 pages
ISBN:9781450388078
DOI:10.1145/3402942
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive gameplay
  2. game analytics
  3. persuasive games
  4. player behaviors
  5. player experience

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

FDG '20

Acceptance Rates

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)23
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Technologies to Support Adaptable Game Design: A Systematic Mapping StudyJournal of the Brazilian Computer Society10.5753/jbcs.2024.309030:1(69-101)Online publication date: 26-Apr-2024
  • (2023)Challenging Models: Formalizing Quests in Gamified Systems for Behavioral Change2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00121(747-756)Online publication date: 1-Oct-2023
  • (2023)Enhancing Gameful Systems with a Domain Specific Language for Rules Lifecycle Management2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C59198.2023.00065(342-352)Online publication date: 1-Oct-2023
  • (2022)A systematic mapping study on digital game adaptation dimensionsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559122(1-14)Online publication date: 17-Oct-2022
  • (2021)Gamified and Self-Adaptive Applications for the Common Good: Research Challenges Ahead2021 International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS)10.1109/SEAMS51251.2021.00028(149-155)Online publication date: May-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media