skip to main content
10.1145/3631085.3631286acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbgamesConference Proceedingsconference-collections
research-article

A Dynamic Difficulty Adjustment Algorithm With Generic Player Behavior Classification Unity Plugin In Single Player Games

Authors Info & Claims
Published:19 January 2024Publication History

ABSTRACT

With the game market growing year by year, game developers find themselves in an extremely competitive scenario. To draw players attention towards their game and to engage them even more during gameplay, one alternative is to apply a Dynamic Difficulty Adjustment algorithm. But the problem of the DDA approach is usually not the algorithm itself, but the player classification step. Therefore, we created a generic Unity Plugin that, allied with a Python API, will be able to classify players, using unsupervised and supervised Machine Learning techniques, based on game telemetry. We also implemented our own simple DDA algorithm, to test how it would work allied with the online classification process. The results show that the DDA version outperforms the standard one in the Video-Game category (CEGE Framework). The resultant classification was 63% completely accurate and 100% partially accurate. Moreover, no other work was able to create a generic plugin that simplified the use of ML in the game development context, allowing to test 28 different algorithm combinations.

References

  1. Ernest Adam. 2008. Difficulty Modes and Dynamic Difficulty Adjustment. Gamasutra, http://www.designersnotebook.com/Columns/095_Difficulty_Modes/095_difficulty_modes.htm. Acessed: 01/07/2023.Google ScholarGoogle Scholar
  2. Ernest Adams. 2014. Fundamentals of Game Design (3rd ed.). New Riders Publishing, Thousand Oaks, CA, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jonathan David Aguilar, Diego Enrique Guzmán, Carlos Felipe Rengifo, Luz Marina Chalapud, and Juan David Guzmán. 2022. Proposal of a Game with Dynamic Difficulty Adjustment from Physiological Signals in the Context of an Exergame. In 2022 IEEE 40th Central America and Panama Convention (CONCAPAN). 1–6. https://doi.org/10.1109/CONCAPAN48024.2022.9997775Google ScholarGoogle ScholarCross RefCross Ref
  4. Ahmad Ashari, Iman Paryudi, and A Min. 2013. Performance Comparison between Naïve Bayes, Decision Tree and k-Nearest Neighbor in Searching Alternative Design in an Energy Simulation Tool. International Journal of Advanced Computer Science and Applications 4 (12 2013). https://doi.org/10.14569/IJACSA.2013.041105Google ScholarGoogle ScholarCross RefCross Ref
  5. Franz Aurenhammer. 1991. Voronoi Diagrams - A Survey of a Fundamental Geometric Data Structure. ACM Comput. Surv. 23, 3 (Sept. 1991), 345–405. https://doi.org/10.1145/116873.116880Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bukhori Abdul Aziz Hutama, Sari Widya Sihwi, and Umi Salamah. 2021. Kinect Based Therapy Games To Overcome Misperception in People With Dysgraphia Using Dynamic Difficulty Adjustment. In 2021 IEEE International Conference on Computing (ICOCO). 230–235. https://doi.org/10.1109/ICOCO53166.2021.9673556Google ScholarGoogle ScholarCross RefCross Ref
  7. Richard Bartle. 1996. Hearts, clubs, diamonds, spades: Players who suit MUDs. (06 1996).Google ScholarGoogle Scholar
  8. Christian Bauckhage, Anders Drachen, and Rafet Sifa. 2015. Clustering Game Behavior Data. IEEE Transactions on Computational Intelligence and AI in Games 7 (09 2015), 266–278. https://doi.org/10.1109/TCIAIG.2014.2376982Google ScholarGoogle ScholarCross RefCross Ref
  9. M. Biasutti. 2011. Flow and Optimal Experience. In Encyclopedia of Creativity (Second Edition) (second edition ed.), Mark A. Runco and Steven R. Pritzker (Eds.). Academic Press, San Diego, 522–528. https://doi.org/10.1016/B978-0-12-375038-9.00099-6Google ScholarGoogle ScholarCross RefCross Ref
  10. Luís Fernando Bicalho, Augusto Baffa, and Bruno Feijó. 2019. A Game Analytics Model to Identify Player Profiles in Singleplayer Games. 11–20. https://doi.org/10.1109/SBGames.2019.00013Google ScholarGoogle ScholarCross RefCross Ref
  11. Jeanne H. Brockmyer, Christine M. Fox, Kathleen A. Curtiss, Evan McBroom, Kimberly M. Burkhart, and Jacquelyn N. Pidruzny. 2009. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624–634. https://doi.org/10.1016/j.jesp.2009.02.016Google ScholarGoogle ScholarCross RefCross Ref
  12. Reis Burak Arslan and Elifsu Filiz. 2022. Enhancement of Player Experience in Video Games Using EEG Based Dynamic Difficulty Adjustment. In 2022 International Conference on INnovations in Intelligent SysTems and Applications (INISTA). 1–4. https://doi.org/10.1109/INISTA55318.2022.9894125Google ScholarGoogle ScholarCross RefCross Ref
  13. Eduardo Calvillo Gamez. 2009. On the core elements of the experience of playing video games. Calvillo Gamez, E.H. (2009) On the core elements of the experience of playing video games. Doctoral thesis, UCL (University College London) (09 2009).Google ScholarGoogle Scholar
  14. Jenova Chen. 2007. Flow in Games (and Everything Else). Commun. ACM 50, 4 (apr 2007), 31–34. https://doi.org/10.1145/1232743.1232769Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Akash Cherukuri and Frank G. Glavin. 2022. Balancing the Performance of a FightingICE Agent using Reinforcement Learning and Skilled Experience Catalogue. In 2022 IEEE Games, Entertainment, Media Conference (GEM). 1–6. https://doi.org/10.1109/GEM56474.2022.10017566Google ScholarGoogle ScholarCross RefCross Ref
  16. Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience.Google ScholarGoogle Scholar
  17. Bruno de Araujo and Bruno Feijó. 2013. Evaluating dynamic difficulty adaptivity in shoot’em up games.Google ScholarGoogle Scholar
  18. TNW Deals. 2016. This engine is dominating the gaming industry right now. https://thenextweb.com/gaming/2016/03/24/engine-dominating-gaming-industry-right-now/. Acessed: 15/05/2019.Google ScholarGoogle Scholar
  19. Anders Drachen, Alessandro Canossa, and Georgios Yannakakis. 2009. Player modeling using self-organization in Tomb Raider: Underworld. CIG2009 - 2009 IEEE Symposium on Computational Intelligence and Games, 1 – 8. https://doi.org/10.1109/CIG.2009.5286500Google ScholarGoogle ScholarCross RefCross Ref
  20. Dagmara Dziedzic and Wojciech Włodarczyk. 2018. Approaches to Measuring the Difficulty of Games in Dynamic Difficulty Adjustment Systems. International Journal of Human-Computer Interaction 34 (04 2018). https://doi.org/10.1080/10447318.2018.1461764Google ScholarGoogle ScholarCross RefCross Ref
  21. Felipe Machado Figueira, Lucas Nascimento, Jose da Silva Junior, Troy Kohwalter, Leonardo Murta, and Esteban Clua. 2018. BinG: A Framework for Dynamic Game Balancing using Provenance. In 2018 17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). 57–5709. https://doi.org/10.1109/SBGAMES.2018.00016Google ScholarGoogle ScholarCross RefCross Ref
  22. Julian Frommel, Fabian Fischbach, Katja Rogers, and Michael Weber. 2018. Emotion-based Dynamic Difficulty Adjustment Using Parameterized Difficulty and Self-Reports of Emotion. 163–171. https://doi.org/10.1145/3242671.3242682Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Fong-Ling Fu, Rong-Chang Su, and Sheng-Chin Yu. 2009. EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education 52 (01 2009), 101–112. https://doi.org/10.1016/j.compedu.2008.07.004Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jiayue Gao and Zihan Lu. 2021. Influence of Flow Conditions in Entertainment Activities. In Proceedings of the 2021 4th International Conference on Humanities Education and Social Sciences (ICHESS 2021). Atlantis Press, 1574–1578. https://doi.org/10.2991/assehr.k.211220.266Google ScholarGoogle ScholarCross RefCross Ref
  25. Bruno E. R. Garcia, Marcio K. Crocomo, and Kléber O. Andrade. 2018. Dynamic Difficulty Adjustment in a Whac-a-Mole like Game. In 2018 17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). 88–888. https://doi.org/10.1109/SBGAMES.2018.00020Google ScholarGoogle ScholarCross RefCross Ref
  26. Robin Hunicke. 2005. The case for dynamic difficulty adjustment in games. ACM International Conference Proceeding Series 265, 429–433. https://doi.org/10.1145/1178477.1178573Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Robin Hunicke and Vernell Chapman. 2004. AI for dynamic difficulty adjustment in games. Challenges in game artificial intelligence AAAI workshop 2 (01 2004).Google ScholarGoogle Scholar
  28. Ryota Ishii, Suguru Ito, Makoto Ishihara, Tomohiro Harada, and Ruck Thawonmas. 2018. Monte-Carlo Tree Search Implementation of Fighting Game AIs Having Personas. 1–8. https://doi.org/10.1109/CIG.2018.8490367Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Tremblay Jonathan, Bruno Bouchard, and Bouklila Abdenour. 2012. Understanding and Implementing Adaptive Difficulty Adjustment in Video Games. Algorithmic and Architectural Gaming Design: Implementation and Development (01 2012), 82–106. https://doi.org/10.4018/978-1-4666-1634-9.ch005Google ScholarGoogle ScholarCross RefCross Ref
  30. Sotiris Kotsiantis. 2007. Supervised Machine Learning: A Review of Classification Techniques. Informatica (Ljubljana) 31 (10 2007).Google ScholarGoogle Scholar
  31. Ewa Lach. 2015. A Quick Method for Dynamic Difficulty Adjustment of a Computer Player in Computer Games. Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science) 9120 (06 2015), 669–678. https://doi.org/10.1007/978-3-319-19369-4-59Google ScholarGoogle ScholarCross RefCross Ref
  32. C.J. Larche and M.J. Dixon. 2014. The relationship between the skill-challenge balance, game expertise, flow and the urge to keep playing complex mobile games. (2014). https://doi.org/10.1556/2006.2020.00070Google ScholarGoogle ScholarCross RefCross Ref
  33. Diana Lora, Antonio Sánchez-Ruiz, Pedro Gonzalez-Calero, and Marco Gómez-Martín. 2016. Dynamic Difficulty Adjustment in Tetris.Google ScholarGoogle Scholar
  34. Diana Lora, Antonio A Sánchez-Ruiz, and Pedro A González-Calero. 2016. Difficulty Adjustment in Tetris with Time Series. In Proceedings 3rd Congreso de la Sociedad Española para las Ciencias del Videojuego (CoSECiVi 2016).Google ScholarGoogle Scholar
  35. Diana Sofía Lora-Ariza, Antonio A. Sánchez-Ruiz, Pedro Antonio González-Calero, and Irene Camps-Ortueta. 2022. Measuring Control to Dynamically Induce Flow in Tetris. IEEE Transactions on Games 14, 4 (2022), 579–588. https://doi.org/10.1109/TG.2022.3182901Google ScholarGoogle ScholarCross RefCross Ref
  36. Nathan Lovato. 2015. 16 Reasons Why Players Are Leaving Your Game. https://www.gamasutra.com/blogs/NathanLovato/20150408/240663/16_Reasons_Why_Players_Are_Leaving_Your_Game.php. Acessed: 15/12/2020.Google ScholarGoogle Scholar
  37. David J. C. MacKay. 2002. Information Theory, Inference & Learning Algorithms. Cambridge University Press, New York, NY, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Tobias Mahlmann, Anders Drachen, Julian Togelius, Alessandro Canossa, and Georgios Yannakakis. 2010. Predicting player behavior in Tomb Raider: Underworld. Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games, CIG2010, 178 – 185. https://doi.org/10.1109/ITW.2010.5593355Google ScholarGoogle ScholarCross RefCross Ref
  39. Endoh Masanobu, Henry B., and Koji Mikami. 2017. Dynamic Pressure Cycle Control: Dynamic Diffculty Adjustment beyond the Flow Zone. 9–14. https://doi.org/10.1109/NICOInt.2017.12Google ScholarGoogle ScholarCross RefCross Ref
  40. Lazaros Michailidis, Emili Balaguer-Ballester, and Xun He. 2018. Flow and Immersion in Video Games: The Aftermath of a Conceptual Challenge. Frontiers in Psychology 9 (2018), 1682. https://doi.org/10.3389/fpsyg.2018.01682Google ScholarGoogle ScholarCross RefCross Ref
  41. Paraschos Moschovitis and Alena Denisova. 2022. Keep Calm and Aim for the Head: Biofeedback-Controlled Dynamic Difficulty Adjustment in a Horror Game. IEEE Transactions on Games (2022), 1–1. https://doi.org/10.1109/TG.2022.3179842Google ScholarGoogle ScholarCross RefCross Ref
  42. Jeanne Nakamura and Mihaly Csikszentmihalyi. 2014. The Concept of Flow. Springer Netherlands, Dordrecht, 239–263. https://doi.org/10.1007/978-94-017-9088-8_16Google ScholarGoogle ScholarCross RefCross Ref
  43. Nielsen. 2020. 3, 2, 1 GO! VIDEO GAMING IS AT AN ALL-TIME HIGH DURING COVID-19. https://www.nielsen.com/us/en/insights/article/2020/3-2-1-go-video-gaming-is-at-an-all-time-high-during-covid-19/. Acessed: 15/12/2020.Google ScholarGoogle Scholar
  44. Bruno Odierna and Ismar Frango Silveira. 2019. Player Game Data Mining for Player Classification. 52–61. https://doi.org/10.22533/at.ed3921924055Google ScholarGoogle ScholarCross RefCross Ref
  45. Dvir Ben Or, Michael Kolomenkin, and Gil Shabat. 2021. DL-DDA - Deep Learning based Dynamic Difficulty Adjustment with UX and Gameplay constraints. In 2021 IEEE Conference on Games (CoG). 1–7. https://doi.org/10.1109/CoG52621.2021.9619162Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Kyle Orland. 2014. Introducing Steam Gauge: Ars reveals Steam’s most popular games. https://arstechnica.com/gaming/2014/04/introducing-steam-gauge-ars-reveals-steams-most-popular-games/. Acessed: 03/07/2019.Google ScholarGoogle Scholar
  47. Manuel Pezzera and Alberto Borghese. 2020. Dynamic difficulty adjustment in exer-games for rehabilitation: a mixed approach. https://doi.org/10.1109/segah49190.2020.9201871Google ScholarGoogle ScholarCross RefCross Ref
  48. Johannes Pfau, Jan David Smeddinck, and Rainer Malaka. 2020. Enemy Within: Long-Term Motivation Effects of Deep Player Behavior Models for Dynamic Difficulty Adjustment(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3313831.3376423Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Shaun Prescott. 2019. The most popular desktop gaming clients, ranked. https://www.pcgamer.com/the-most-popular-desktop-gaming-clients-ranked/. Acessed: 17/12/2020.Google ScholarGoogle Scholar
  50. Ghulam Ruqeyya, Tehmina Hafeez, Sanay Muhammad Umar Saeed, and Aleeza Ishwal. 2022. EEG-based Engagement Index for Video Game Players. In 2022 International Conference on Emerging Trends in Electrical, Control, and Telecommunication Engineering (ETECTE). 1–6. https://doi.org/10.1109/ETECTE55893.2022.10007386Google ScholarGoogle ScholarCross RefCross Ref
  51. Adam Saltsman. 2009. Game Changers: Dynamic Difficulty. Game Developer, https://www.gamedeveloper.com/design/game-changers-dynamic-difficulty. Acessed: 30/06/2023.Google ScholarGoogle Scholar
  52. Gabriel Sepulveda, Felipe Besoain, and Nicolas A. Barriga. 2019. Exploring Dynamic Difficulty Adjustment in Videogames. 1–6. https://doi.org/10.1109/CHILECON47746.2019.8988068Google ScholarGoogle ScholarCross RefCross Ref
  53. Mirna Silva, Victor Silva, and Luiz Chaimowicz. 2016. Dynamic Difficulty Adjustment on MOBA Games. Entertainment Computing 18 (10 2016). https://doi.org/10.1016/j.entcom.2016.10.002Google ScholarGoogle ScholarCross RefCross Ref
  54. Mirna Paula Silva, Victor do Nascimento Silva, and Luiz Chaimowicz. 2015. Dynamic Difficulty Adjustment through an Adaptive AI. In 2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). 173–182. https://doi.org/10.1109/SBGames.2015.16Google ScholarGoogle ScholarCross RefCross Ref
  55. Juan Suaza, Edwin Gamboa, and Maria Trujillo. 2019. A Health Point-Based Dynamic Difficulty Adjustment Strategy for Video Games. 436–440. https://doi.org/10.1007/978-3-030-34644-7_42Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Rhio Sutoyo, Davies Winata, Katherine Oliviani, and Dedy Martadinata. 2015. Dynamic Difficulty Adjustment in Tower Defence. Procedia Computer Science 59 (12 2015), 435–444. https://doi.org/10.1016/j.procs.2015.07.563Google ScholarGoogle ScholarCross RefCross Ref
  57. Penelope Sweetser and Peta Wyeth. 2005. GameFlow: A Model for Evaluating Player Enjoyment in Games. Comput. Entertain. 3, 3 (jul 2005), 3. https://doi.org/10.1145/1077246.1077253Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Mahimna Vyas. 2021. Experience of flow in games and using it to improve well-being: A Critical review. Indian Journal of Health and Wellbeing 11 (03 2021), 116–120. https://doi.org/10.6084/m9.figshare.14556297.v1Google ScholarGoogle ScholarCross RefCross Ref
  59. Matheus Weber and Pollyana Notargiacomo. 2020. Dynamic Difficulty Adjustment in Digital Games Using Genetic Algorithms. In 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames). 62–70. https://doi.org/10.1109/SBGames51465.2020.00019Google ScholarGoogle ScholarCross RefCross Ref
  60. Tom Wijman. 2019. Newzoo Global Games Market Report 2019. Technical Report. Newzoo. https://newzoo.com/solutions/standard/market-forecasts/global-games-market-report/Google ScholarGoogle Scholar
  61. Steven Wright. 2018. There are too many video games. What now?https://www.polygon.com/2018/9/28/17911372/there-are-too-many-video-games-what-now-indiepocalypse. Acessed: 10/07/2019.Google ScholarGoogle Scholar
  62. Su Xue, Meng Wu, John Kolen, Navid Aghdaie, and Kazi Zaman. 2017. Dynamic Difficulty Adjustment for Maximized Engagement in Digital Games. 465–471. https://doi.org/10.1145/3041021.3054170Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Georgios N. Yannakakis and John Hallam. 2009. Real-Time Game Adaptation for Optimizing Player Satisfaction. IEEE Transactions on Computational Intelligence and AI in Games 1, 2 (2009), 121–133. https://doi.org/10.1109/TCIAIG.2009.2024533Google ScholarGoogle ScholarCross RefCross Ref
  64. Chang Yun, Dvijesh Shastri, and Ioannis Pavlidis. 2009. O’ game, can you feel my frustration?: Improving user’s gaming experience via stresscam. Conference on Human Factors in Computing Systems - Proceedings, 2195–2204. https://doi.org/10.1145/1518701.1519036Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Mohammad Zohaib. 2018. Dynamic Difficulty Adjustment (DDA) in Computer Games: A Review. Advances in Human-Computer Interaction 2018 (11 2018), 1–12. https://doi.org/10.1155/2018/5681652Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Dynamic Difficulty Adjustment Algorithm With Generic Player Behavior Classification Unity Plugin In Single Player Games
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Other conferences
              SBGames '23: Proceedings of the 22nd Brazilian Symposium on Games and Digital Entertainment
              November 2023
              176 pages

              Copyright © 2023 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 19 January 2024

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article
              • Research
              • Refereed limited
            • Article Metrics

              • Downloads (Last 12 months)36
              • Downloads (Last 6 weeks)16

              Other Metrics

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader

            HTML Format

            View this article in HTML Format .

            View HTML Format