skip to main content
10.1145/3411764.3445689acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Serious Snacking: A Survival Analysis of how Snacking Mechanics Affect Attrition in a Mobile Serious Game

Published:07 May 2021Publication History

ABSTRACT

Many serious games are most effective when played regularly; however, little is known about how individual game elements support player adherence over time. This work draws on evidence from existing frameworks and game design theories as well as from the design of casual games to investigate how individual game mechanics affect player attrition in a serious game. We implemented a math-learning game in which we could individually layer various game mechanics, and over the course of 3 weeks, 99 participants played one of six versions: Baseline, Rewards, Novelty, Completion, Waiting, or Blocking. We compared the game versions by analyzing the players’ performance as well as behaviour. Using survival analysis, we identified that the addition of Completion and Blocking mechanics facilitated the strongest sustained engagement. These findings are congruent with existing theories of player experience and promote the development of guidelines on designing for sustained engagement in serious games.

Skip Supplemental Material Section

Supplemental Material

3411764.3445689_videofigure.mp4

mp4

57.4 MB

3411764.3445689_videopreview.mp4

mp4

18.8 MB

References

  1. Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and Validation of the Player Experience Inventory: A Scale to Measure Player Experiences at the Level of Functional and Psychosocial Consequences. International Journal of Human-Computer Studies 135 (March 2020), 102370. https://doi.org/10.1016/j.ijhcs.2019.102370Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Clark C. Abt. 1970. Serious Games. University Press of America, Lanham, MD.Google ScholarGoogle Scholar
  3. Dmitry Alexandrovsky, Maximilian Achim Friehs, Max V. Birk, Rowan K. Yates, and Regan L. Mandryk. 2019. Game Dynamics That Support Snacking, Not Feasting. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, Barcelona Spain, 573–588. https://doi.org/10.1145/3311350.3347151Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Maximilian Altmeyer, Kathrin Dernbecher, Vladislav Hnatovskiy, Marc Schubhan, Pascal Lessel, and Antonio Krüger. 2019. Gamified Ads: Bridging the Gap Between User Enjoyment and the Effectiveness of Online Ads. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, Glasgow, Scotland Uk, 1–12. https://doi.org/10.1145/3290605.3300412Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Chris Mark Bateman and Richard Boon. 2006. 21st Century Game Design. Charles River Media, Hingham, Mass.Google ScholarGoogle Scholar
  6. Max V. Birk, Cheralyn Atkins, Jason T. Bowey, and Regan L. Mandryk. 2016. Fostering Intrinsic Motivation Through Avatar Identification in Digital Games. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 2982–2995. https://doi.org/10.1145/2858036.2858062Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Max V. Birk, Maximilian A. Friehs, and Regan L. Mandryk. 2017. Age-Based Preferences and Player Experience: A Crowdsourced Cross-Sectional Study. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’17). ACM, New York, NY, USA, 157–170. https://doi.org/10.1145/3116595.3116608Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Max Valentin Birk and Regan Lee Mandryk. 2019. Improving the Efficacy of Cognitive Training for Digital Mental Health Interventions Through Avatar Customization: Crowdsourced Quasi-Experimental Study. Journal of Medical Internet Research 21, 1 (Jan. 2019), e10133. https://doi.org/10.2196/10133Google ScholarGoogle ScholarCross RefCross Ref
  9. Max V. Birk, Regan L. Mandryk, and Cheralyn Atkins. 2016. The Motivational Push of Games: The Interplay of Intrinsic Motivation and External Rewards in Games for Training. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’16). ACM, New York, NY, USA, 291–303. https://doi.org/10.1145/2967934.2968091Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J M. Bland and D. G Altman. 1998. Statistics Notes: Survival Probabilities (the Kaplan-Meier Method). BMJ 317, 7172 (Dec. 1998), 1572–1580. https://doi.org/10.1136/bmj.317.7172.1572Google ScholarGoogle ScholarCross RefCross Ref
  11. Jason T Bowey, Maximilian A Friehs, and Regan L Mandryk. 2019. Red or Blue Pill: Fostering Identification and Transportation through Dialogue Choices in RPGs. In Proceedings of the 14th International Conference on the Foundations of Digital Games. ACM, San Luis Obispo California, 1–11. https://doi.org/10.1145/3337722.3337734Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Elizabeth A. Boyle, Thomas M. Connolly, Thomas Hainey, and James M. Boyle. 2012. Engagement in Digital Entertainment Games: A Systematic Review. Computers in Human Behavior 28, 3 (May 2012), 771–780. https://doi.org/10.1016/j.chb.2011.11.020Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Andrew D. Carlo, Reza Hosseini Ghomi, Brenna N. Renn, Michael A. Strong, and Patricia A. Areán. 2020. Assessment of Real-World Use of Behavioral Health Mobile Applications by a Novel Stickiness Metric. JAMA Network Open 3, 8 (Aug. 2020), e2011978. https://doi.org/10.1001/jamanetworkopen.2020.11978Google ScholarGoogle ScholarCross RefCross Ref
  14. David Collett. 2015. Modelling Survival Data in Medical Research. CRC press, 6000 Broken Sound Parkway NW, Sute 300.Google ScholarGoogle Scholar
  15. D. R. Cox. 1972. Regression Models and Life-Tables. Journal of the Royal Statistical Society. Series B (Methodological) 34, 2(1972), 187–220. https://doi.org/10.1111/j.2517-6161.1972.tb00899.xGoogle ScholarGoogle ScholarCross RefCross Ref
  16. Mihaly Csikszentmihalyi. 1990. Flow: The Psychology of Optimal Experience. Harper & Row, New York.Google ScholarGoogle Scholar
  17. K. R. Daffner, M. M. Mesulam, L. F. Scinto, L. G. Cohen, B. P. Kennedy, W. C. West, and P. J. Holcomb. 1998. Regulation of Attention to Novel Stimuli by Frontal Lobes: An Event-Related Potential Study. Neuroreport 9, 5 (March 1998), 787–791.Google ScholarGoogle ScholarCross RefCross Ref
  18. Frederik De Grove, Johannes Breuer, Vivian Hsueh Hua Chen, Thorsten Quandt, Rabindra Ratan, and Jan Van Looy. 2017. Validating the Digital Games Motivation Scale for Comparative Research Between Countries. Communication Research Reports 34, 1 (Jan. 2017), 37–47. https://doi.org/10.1080/08824096.2016.1250070Google ScholarGoogle ScholarCross RefCross Ref
  19. Peter F. Delaney, Peter P. J. L. Verkoeijen, and Arie Spirgel. 2010. Spacing and Testing Effects. In Psychology of Learning and Motivation, Brian H. Ross (Ed.). The Psychology of Learning and Motivation: Advances in Research and Theory, Vol. 53. Academic Press, San Diego, CA; London, 63–147. https://doi.org/10.1016/S0079-7421(10)53003-2Google ScholarGoogle ScholarCross RefCross Ref
  20. Simon Demediuk, Alexandra Murrin, David Bulger, Michael Hitchens, Anders Drachen, William L. Raffe, and Marco Tamassia. 2018. Player Retention in League of Legends: A Study Using Survival Analysis. In Proceedings of the Australasian Computer Science Week Multiconference on - ACSW ’18. ACM Press, Brisband, Queensland, Australia, 1–9. https://doi.org/10.1145/3167918.3167937Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Paul Denny. 2013. The Effect of Virtual Achievements on Student Engagement. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’13. ACM Press, Paris, France, 763. https://doi.org/10.1145/2470654.2470763Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Paul Denny, Fiona McDonald, Ruth Empson, Philip Kelly, and Andrew Petersen. 2018. Empirical Support for a Causal Relationship Between Gamification and Learning Outcomes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–13. https://doi.org/10.1145/3173574.3173885Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Sebastian Deterding, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. From Game Design Elements to Gamefulness: Defining ”Gamification”. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments(MindTrek ’11). ACM, New York, NY, USA, 9–15. https://doi.org/10.1145/2181037.2181040Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Anders Drachen and Alessandro Canossa. 2009. Towards Gameplay Analysis via Gameplay Metrics. In Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era on - MindTrek ’09. ACM Press, Tampere, Finland, 202. https://doi.org/10.1145/1621841.1621878Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Anders Drachen, Rafet Sifa, Christian Bauckhage, and Christian Thurau. 2012. Guns, Swords and Data: Clustering of Player Behavior in Computer Games in the Wild. In 2012 IEEE Conference on Computational Intelligence and Games (CIG). IEEE, Granada, Spain, 163–170. https://doi.org/10.1109/cig.2012.6374152Google ScholarGoogle ScholarCross RefCross Ref
  26. Gunther Eysenbach. 2005. The Law of Attrition. Journal of Medical Internet Research 7, 1 (March 2005), e11. https://doi.org/10.2196/jmir.7.1.e11Google ScholarGoogle ScholarCross RefCross Ref
  27. R. L. Fantz. 1964. VISUAL EXPERIENCE IN INFANTS: DECREASED ATTENTION TO FAMILIAR PATTERNS RELATIVE TO NOVEL ONES. Science (New York, N.Y.) 146, 3644 (Oct. 1964), 668–670.Google ScholarGoogle Scholar
  28. Tim Fields. 2014. Mobile & Social Game Design: Monetization Methods and Mechanics (second editioned.). CRC Press, Taylor & Francis Group, Boca Raton.Google ScholarGoogle Scholar
  29. Tim Fields, Brandon Cotton, and Brandon Cotton. 2011. Social Game Design: Monetization Methods and Mechanics (first ed.). CRC Press, Boca Raton, Florida. https://doi.org/10.1201/9780240817675Google ScholarGoogle ScholarCross RefCross Ref
  30. Jonathan Frome. 2007. Eight Ways Videogames Generate Emotion.. In Digra Conference. Digital Games Research Association, Tokyo Japan, 4.Google ScholarGoogle Scholar
  31. Julian Frommel, Fabian Fischbach, Katja Rogers, and Michael Weber. 2018. Emotion-Based Dynamic Difficulty Adjustment Using Parameterized Difficulty and Self-Reports of Emotion. In The Annual Symposium on Computer-Human Interaction in Play Extended Abstracts - CHI PLAY ’18. ACM Press, Melbourne, VIC, Australia, 163–171. https://doi.org/10.1145/3242671.3242682Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Julian Frommel, Valentin Sagl, Ansgar E. Depping, Colby Johanson, Matthew K. Miller, and Regan L. Mandryk. 2020. Recognizing Affiliation: Using Behavioural Traces to Predict the Quality of Social Interactions in Online Games. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–16. https://doi.org/10.1145/3313831.3376446Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Julian Frommel, Claudia Schrader, and Michael Weber. 2018. Towards Emotion-Based Adaptive Games: Emotion Recognition Via Input and Performance Features. In The Annual Symposium on Computer-Human Interaction in Play Extended Abstracts - CHI PLAY ’18. ACM Press, Melbourne, VIC, Australia, 173–185. https://doi.org/10.1145/3242671.3242672Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Tracy Fullerton. 2014. Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition. CRC Press, Boca Raton, Florida.Google ScholarGoogle ScholarCross RefCross Ref
  35. Paul A. Games and John F. Howell. 1976. Pairwise Multiple Comparison Procedures with Unequal N’s and/or Variances: A Monte Carlo Study. Journal of Educational Statistics 1, 2 (June 1976), 113–125. https://doi.org/10.3102/10769986001002113Google ScholarGoogle ScholarCross RefCross Ref
  36. Riot Games. 2009. League of Legends.Google ScholarGoogle Scholar
  37. Rosemary Garris, Robert Ahlers, and James E. Driskell. 2002. Games, Motivation, and Learning: A Research and Practice Model. Simulation & Gaming 33, 4 (Dec. 2002), 441–467. https://doi.org/10.1177/1046878102238607Google ScholarGoogle ScholarCross RefCross Ref
  38. Kathrin Maria Gerling, Frank Paul Schulte, Jan Smeddinck, and Maic Masuch. 2012. Game Design for Older Adults: Effects of Age-Related Changes on Structural Elements of Digital Games. In Entertainment Computing - ICEC 2012(Lecture Notes in Computer Science), Marc Herrlich, Rainer Malaka, and Maic Masuch (Eds.). Springer Berlin Heidelberg, Bremen, Germany, 235–242.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Kiel M Gilleade and Alan Dix. 2004. Using Frustration in the Design of Adaptive Videogames. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology - ACE ’04. ACM Press, Singapore, 228–232. https://doi.org/10.1145/1067343.1067372Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Minas Gjoka, Michael Sirivianos, Athina Markopoulou, and Xiaowei Yang. 2008. Poking Facebook: Characterization of Osn Applications. In Proceedings of the First Workshop on Online Social Networks - WOSP ’08. ACM Press, Seattle, WA, USA, 31. https://doi.org/10.1145/1397735.1397743Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Lewis R. Goldberg. 1992. The Development of Markers for the Big-Five Factor Structure.Psychological Assessment 4, 1 (1992), 26–42. https://doi.org/10.1037/1040-3590.4.1.26Google ScholarGoogle ScholarCross RefCross Ref
  42. Frederic Guay, Robert J Vallerand, and Celine Blanchard. 2001. On the Assessment of Situational Intrinsic and Extrinsic Motivation: The Situational Motivation Scale (SIMS). Motivation and Emotion 24 (2001), 40.Google ScholarGoogle Scholar
  43. Timothy D Hackenberg. 2009. TOKEN REINFORCEMENT: A REVIEW AND ANALYSIS. Journal of the Experimental Analysis of Behavior 91, 2 (March 2009), 257–286. https://doi.org/10.1901/jeab.2009.91-257Google ScholarGoogle ScholarCross RefCross Ref
  44. Fabian Hadiji, Rafet Sifa, Anders Drachen, Christian Thurau, Kristian Kersting, and Christian Bauckhage. 2014. Predicting Player Churn in the Wild. In 2014 IEEE Conference on Computational Intelligence and Games. IEEE, Dortmund, Germany, 1–8. https://doi.org/10.1109/cig.2014.6932876Google ScholarGoogle ScholarCross RefCross Ref
  45. Stuart Hallifax, Audrey Serna, Jean-Charles Marty, Guillaume Lavoué, and Elise Lavoué. 2019. Factors to Consider for Tailored Gamification. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, Barcelona Spain, 559–572. https://doi.org/10.1145/3311350.3347167Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Frank E. Harrell, Kerry L. Lee, and Daniel B. Mark. 2005. Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors. In Tutorials in Biostatistics, R. B. D’Agostino (Ed.). John Wiley & Sons, Ltd, Chichester, UK, 223–249. https://doi.org/10.1002/0470023678.ch2b(i)Google ScholarGoogle ScholarCross RefCross Ref
  47. Robin Hunicke. 2005. The Case for Dynamic Difficulty Adjustment in Games. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology - ACE ’05. ACM Press, Valencia, Spain, 429–433. https://doi.org/10.1145/1178477.1178573Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Roslina Ibrahim and Azizah Jaafar. 2009. Educational Games (EG) Design Framework: Combination of Game Design, Pedagogy and Content Modeling. In 2009 International Conference on Electrical Engineering and Informatics. IEEE, Bangi, Malaysia, 293–298. https://doi.org/10.1109/ICEEI.2009.5254771Google ScholarGoogle ScholarCross RefCross Ref
  49. Jaakko Iisalo and Rovio Entertainment Ltd.2009. Angry Birds. Game [iOS, Windows Phone 7, Windows Phone 8, bada, Maemo, webOS, Android, Symbian³, Nintendo 3DS, Windows, Mac, Xbox 360, PS3, PS4, PSP, BlackBerry Tablet OS, Blackberry 10].Google ScholarGoogle Scholar
  50. K Jackson and T D Hackenberg. 1996. Token Reinforcement, Choice, and Self-Control in Pigeons.Journal of the Experimental Analysis of Behavior 66, 1 (July 1996), 29–49. https://doi.org/10.1901/jeab.1996.66-29Google ScholarGoogle ScholarCross RefCross Ref
  51. Stephen P Jenkins. 2005. Survival Analysis. Unpublished manuscript, Institute for Social and Economic Research, University of Essex, Colchester, UK 42 (2005), 54–56.Google ScholarGoogle Scholar
  52. W. A. Johnston, K. J. Hawley, S. H. Plewe, J. M. Elliott, and M. J. DeWitt. 1990. Attention Capture by Novel Stimuli. Journal of Experimental Psychology. General 119, 4 (Dec. 1990), 397–411.Google ScholarGoogle Scholar
  53. Bill Jolley, Richard Mizerski, and Doina Olaru. 2006. How Habit and Satisfaction Affects Player Retention for Online Gambling. Journal of Business Research 59, 6 (June 2006), 770–777. https://doi.org/10.1016/j.jbusres.2006.01.017Google ScholarGoogle ScholarCross RefCross Ref
  54. Edward L Kaplan and Paul Meier. 1958. Nonparametric Estimation from Incomplete Observations. Journal of the American statistical association 53, 282(1958), 457–481. https://doi.org/10.1080/01621459.1958.10501452Google ScholarGoogle ScholarCross RefCross Ref
  55. N. Karsh and B. Eitam. 2015. I Control Therefore I Do: Judgments of Agency Influence Action Selection. Cognition 138 (May 2015), 122–131. https://doi.org/10.1016/j.cognition.2015.02.002Google ScholarGoogle ScholarCross RefCross Ref
  56. Saskia M Kelders, Robin N Kok, Hans C Ossebaard, and Julia EWC Van Gemert-Pijnen. 2012. Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions. Journal of Medical Internet Research 14, 6 (Nov. 2012), e152. https://doi.org/10.2196/jmir.2104Google ScholarGoogle ScholarCross RefCross Ref
  57. Jun H. Kim, Daniel V. Gunn, Eric Schuh, Bruce Phillips, Randy J. Pagulayan, and Dennis Wixon. 2008. Tracking Real-Time User Experience (TRUE): A Comprehensive Instrumentation Solution for Complex Systems. In Proceeding of the Twenty-Sixth Annual CHI Conference on Human Factors in Computing Systems - CHI ’08. ACM Press, Florence, Italy, 443. https://doi.org/10.1145/1357054.1357126Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Madison Klarkowski, Daniel Johnson, Peta Wyeth, Cody Phillips, and Simon Smith. 2018. Don’t Sweat the Small Stuff: The Effect of Challenge-Skill Manipulation on Electrodermal Activity. In The Annual Symposium on Computer-Human Interaction in Play Extended Abstracts - CHI PLAY ’18. ACM Press, Melbourne, VIC, Australia, 231–242. https://doi.org/10.1145/3242671.3242714Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Richard N. Landers and Rachel C. Callan. 2011. Casual Social Games as Serious Games: The Psychology of Gamification in Undergraduate Education and Employee Training. In Serious Games and Edutainment Applications, Minhua Ma, Andreas Oikonomou, and Lakhmi C. Jain(Eds.). Springer London, London, 399–423. https://doi.org/10.1007/978-1-4471-2161-9_20Google ScholarGoogle ScholarCross RefCross Ref
  60. Emily G. Lattie, Stephen M. Schueller, Elizabeth Sargent, Colleen Stiles-Shields, Kathryn Noth Tomasino, Marya E. Corden, Mark Begale, Chris J. Karr, and David C. Mohr. 2016. Uptake and Usage of IntelliCare: A Publicly Available Suite of Mental Health and Well-Being Apps. Internet Interventions 4 (May 2016), 152–158. https://doi.org/10.1016/j.invent.2016.06.003Google ScholarGoogle ScholarCross RefCross Ref
  61. Lauren A. Leotti and Mauricio R. Delgado. 2011. The Inherent Reward of Choice. Psychological Science 22, 10 (Oct. 2011), 1310–1318. https://doi.org/10.1177/0956797611417005Google ScholarGoogle ScholarCross RefCross Ref
  62. Conor Linehan, Ben Kirman, Shaun Lawson, and Gail Chan. 2011. Practical, Appropriate, Empirically-Validated Guidelines for Designing Educational Games. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI ’11. ACM Press, Vancouver, BC, Canada, 1979. https://doi.org/10.1145/1978942.1979229Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Hangcheng Liu. 2015. Comparing Welch’s ANOVA, a Kruskal-Wallis Test and Traditional ANOVA in Case of Heterogeneity of Variance. Ph.D. Dissertation. VCU Libraries. https://doi.org/10.25772/BWFP-YE95Google ScholarGoogle ScholarCross RefCross Ref
  64. Jim Lumsden, Elizabeth A Edwards, Natalia S Lawrence, David Coyle, and Marcus R Munafò. 2016. Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and Efficacy. JMIR Serious Games 4, 2 (July 2016), e11. https://doi.org/10.2196/games.5888Google ScholarGoogle ScholarCross RefCross Ref
  65. Thomas W. Malone. 1980. What Makes Things Fun to Learn? Heuristics for Designing Instructional Computer Games. In Proceedings of the 3rd ACM SIGSMALL Symposium and the First SIGPC Symposium on Small Systems(SIGSMALL ’80). ACM, New York, NY, USA, 162–169. https://doi.org/10.1145/800088.802839Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Regan Lee Mandryk and Max Valentin Birk. 2017. Toward Game-Based Digital Mental Health Interventions: Player Habits and Preferences. Journal of Medical Internet Research 19, 4 (2017), e128. https://doi.org/10.2196/jmir.6906Google ScholarGoogle ScholarCross RefCross Ref
  67. N. Mantel. 1966. Evaluation of Survival Data and Two New Rank Order Statistics Arising in Its Consideration. Cancer Chemotherapy Reports 50, 3 (March 1966), 163–170.Google ScholarGoogle Scholar
  68. T. Mäntylä and T. Sgaramella. 1997. Interrupting Intentions: Zeigarnik-like Effects in Prospective Memory. Psychological Research 60, 3 (1997), 192–199.Google ScholarGoogle ScholarCross RefCross Ref
  69. Andrzej Marczewski. 2013. The Intrinsic Motivation RAMP. https://www.gamified.uk/gamification-framework/the-intrinsic-motivation-ramp/.Google ScholarGoogle Scholar
  70. Andrzej Marczewski. 2015. User Types HEXAD. In Even Ninja Monkeys Like to Play. Gamified UK, United Kingdom.Google ScholarGoogle Scholar
  71. Edward McAuley, Terry Duncan, and Vance V. Tammen. 1989. Psychometric Properties of the Intrinsic Motivation Inventory in a Competitive Sport Setting: A Confirmatory Factor Analysis. Research Quarterly for Exercise and Sport 60, 1 (March 1989), 48–58. https://doi.org/10.1080/02701367.1989.10607413Google ScholarGoogle ScholarCross RefCross Ref
  72. David C McClelland. 1987. Human Motivation(first ed.). Cambridge University Press, Cambridge, UK. https://doi.org/10.1017/CBO9781139878289Google ScholarGoogle ScholarCross RefCross Ref
  73. Elisa D Mekler, Florian Brühlmann, Klaus Opwis, and Alexandre N Tuch. 2013. Do Points, Levels and Leaderboards Harm Intrinsic Motivation?: An Empirical Analysis of Common Gamification Elements. In Proceedings of the First International Conference on Gameful Design, Research, and Applications. ACM, ACM, Toronto, Ontario, Canada, 66–73. https://doi.org/10.1145/2583008.2583017Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Elisa D. Mekler, Florian Brühlmann, Alexandre N. Tuch, and Klaus Opwis. 2017. Towards Understanding the Effects of Individual Gamification Elements on Intrinsic Motivation and Performance. Computers in Human Behavior 71 (June 2017), 525–534. https://doi.org/10.1016/j.chb.2015.08.048Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Haim Mendelson and Ken Moon. 2018. Modeling Success and Engagement for the App Economy. In Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW ’18. ACM Press, Lyon, France, 569–578. https://doi.org/10.1145/3178876.3186123Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Rupert G Miller Jr. 2011. Survival Analysis. Vol. 66. John Wiley & Sons, Hoboken, New Jersey, US.Google ScholarGoogle Scholar
  77. Walter Mischel, Ebbe B. Ebbesen, and Antonette Raskoff Zeiss. 1972. Cognitive and Attentional Mechanisms in Delay of Gratification. Journal of Personality and Social Psychology 21, 2(1972), 204–218. https://doi.org/10.1037/h0032198Google ScholarGoogle ScholarCross RefCross Ref
  78. Alberto Mora, Daniel Riera, Carina Gonzalez, and Joan Arnedo-Moreno. 2015. A Literature Review of Gamification Design Frameworks. In Games and Virtual Worlds for Serious Applications (VS-Games), 2015 7th International Conference On. IEEE, Skövde, Sweden, 1–8. https://doi.org/10.1109/VS-GAMES.2015.7295760Google ScholarGoogle ScholarCross RefCross Ref
  79. Robert R. Morris, Stephen M. Schueller, and Rosalind W. Picard. 2015. Efficacy of a Web-Based, Crowdsourced Peer-To-Peer Cognitive Reappraisal Platform for Depression: Randomized Controlled Trial. Journal of Medical Internet Research 17, 3 (2015), e72. https://doi.org/10.2196/jmir.4167Google ScholarGoogle ScholarCross RefCross Ref
  80. Isabel Briggs Myers. 1962. The Myers-Briggs Type Indicator: Manual (1962).Consulting Psychologists Press, Palo Alto. https://doi.org/10.1037/14404-000Google ScholarGoogle ScholarCross RefCross Ref
  81. Lennart Nacke and Anders Drachen. 2011. Towards a Framework of Player Experience Research. In Proceedings of the Second International Workshop on Evaluating Player Experience in Games at FDG, Vol. 11. ACM, Bordeaux, France, 6.Google ScholarGoogle Scholar
  82. Rita Orji, Julita Vassileva, and Regan L. Mandryk. 2014. Modeling the Efficacy of Persuasive Strategies for Different Gamer Types in Serious Games for Health. User Modeling and User-Adapted Interaction 24, 5 (Dec. 2014), 453–498. https://doi.org/10.1007/s11257-014-9149-8Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Antti Oulasvirta, Sakari Tamminen, Virpi Roto, and Jaana Kuorelahti. 2005. Interaction in 4-Second Bursts: The Fragmented Nature of Attentional Resources in Mobile HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’05). ACM, Portland, Oregon, USA, 919–928. https://doi.org/10.1145/1054972.1055101Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. Johannes Pfau, Jan David Smeddinck, and Rainer Malaka. 2018. Towards Deep Player Behavior Models in MMORPGs. In The Annual Symposium on Computer-Human Interaction in Play Extended Abstracts - CHI PLAY ’18. ACM Press, Melbourne, VIC, Australia, 381–392. https://doi.org/10.1145/3242671.3242706Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Johannes Pfau, Jan David Smeddinck, and Rainer Malaka. 2020. Enemy Within: Long-Term Motivation Effects of Deep Player Behavior Models for Dynamic Difficulty Adjustment. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–10. https://doi.org/10.1145/3313831.3376423Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Susanne Poeller, Nicola Baumann, and Regan L. Mandryk. 2020. Power Play: How the Need to Empower or Overpower Other Players Predicts Preferences in League of Legends. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–13. https://doi.org/10.1145/3313831.3376193Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Susanne Poeller, Max V. Birk, Nicola Baumann, and Regan L. Mandryk. 2018. Let Me Be Implicit: Using Motive Disposition Theory to Predict and Explain Behaviour in Digital Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–15. https://doi.org/10.1145/3173574.3173764Google ScholarGoogle ScholarDigital LibraryDigital Library
  88. Till Riemer. 2015. Agent-Based Procedural Quest Generation for a Role-Playing Game. Master Thesis. IT University of Copenhagen, Copenhagen.Google ScholarGoogle Scholar
  89. David Robinson and Victoria Bellotti. 2013. A Preliminary Taxonomy of Gamification Elements for Varying Anticipated Commitment. In Proc. ACM CHI 2013 Workshop on Designing Gamification: Creating Gameful and Playful Experiences. ACM, Paris, France, 6.Google ScholarGoogle Scholar
  90. Harry T Roman. 2004. Why Math Is so Important. Tech Directions 63, 10 (2004), 16.Google ScholarGoogle Scholar
  91. Richard M. Ryan. 1982. Control and Information in the Intrapersonal Sphere: An Extension of Cognitive Evaluation Theory. Journal of Personality and Social Psychology 43, 3(1982), 450–461. https://doi.org/10.1037/0022-3514.43.3.450Google ScholarGoogle ScholarCross RefCross Ref
  92. Richard M. Ryan and Edward L. Deci. 2000. Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being. American psychologist 55, 1 (2000), 68–78. https://doi.org/10.1037/0003-066x.55.1.68Google ScholarGoogle ScholarCross RefCross Ref
  93. Richard M. Ryan, C. Scott Rigby, and Andrew Przybylski. 2006. The Motivational Pull of Video Games: A Self-Determination Theory Approach. Motivation and Emotion 30, 4 (Nov. 2006), 344–360. https://doi.org/10.1007/s11031-006-9051-8Google ScholarGoogle ScholarCross RefCross Ref
  94. Michael Sailer and Lisa Homner. 2020. The Gamification of Learning: A Meta-Analysis. Educational Psychology Review 32, 1 (March 2020), 77–112. https://doi.org/10.1007/s10648-019-09498-wGoogle ScholarGoogle ScholarCross RefCross Ref
  95. Morgan Klaus Scheuerman, Katta Spiel, Oliver L. Haimson, Foad Hamidi, and Stacy M. Branham. 2020. HCI Guidelines for Gender Equity and Inclusivity.Google ScholarGoogle Scholar
  96. Florian Schimanke, Robert Mertens, and Ute Schmid. 2017. Spaced Repetition in Mobile Learning Games - A Cure to Bulimic Learning?. In E-Learn World Conference on E-Learning. ERIC, Vancouver, BC, Canada, 11.Google ScholarGoogle Scholar
  97. David Schoenfeld. 1981. The Asymptotic Properties of Nonparametric Tests for Comparing Survival Distributions. Biometrika 68, 1 (1981), 316–319. https://doi.org/10.1093/biomet/68.1.316Google ScholarGoogle ScholarCross RefCross Ref
  98. Rafet Sifa, Christian Bauckhage, and Anders Drachen. 2014. The Playtime Principle: Large-Scale Cross-Games Interest Modeling. In 2014 IEEE Conference on Computational Intelligence and Games. IEEE, Dortmund, Germany, 1–8. https://doi.org/10.1109/cig.2014.6932906Google ScholarGoogle ScholarCross RefCross Ref
  99. Rafet Sifa, Anders Drachen, Christian Bauckhage, Christian Thurau, and Alessandro Canossa. 2013. Behavior Evolution in Tomb Raider Underworld. In 2013 IEEE Conference on Computational Inteligence in Games (CIG). IEEE, Niagara Falls, ON, Canada, 1–8. https://doi.org/10.1109/cig.2013.6633637Google ScholarGoogle ScholarCross RefCross Ref
  100. B. F. Skinner. 1938. The Behavior of Organisms: An Experimental Analysis. Appleton-Century, Oxford, England.Google ScholarGoogle Scholar
  101. B. F. Skinner. 1948. ’Superstition’ in the Pigeon. Journal of Experimental Psychology 38, 2 (1948), 168–172. https://doi.org/10.1037/h0055873Google ScholarGoogle ScholarCross RefCross Ref
  102. Richard P. Smith. 1981. Boredom: A Review. Human Factors 23, 3 (1981), 329–340. https://doi.org/10.1177/001872088102300308Google ScholarGoogle ScholarCross RefCross Ref
  103. Minzhu Song and Sujing Zhang. 2008. EFM: A Model for Educational Game Design. In Technologies for E-Learning and Digital Entertainment(Lecture Notes in Computer Science). Springer, Berlin, Heidelberg, Nanjing, China, 509–517. https://doi.org/10.1007/978-3-540-69736-7_54Google ScholarGoogle ScholarDigital LibraryDigital Library
  104. Susana Ruiz and interFUEL, LLC. 2006. Darfur Is Dying. Game [Web/Online].Google ScholarGoogle Scholar
  105. Christine J. Syrek, Oliver Weigelt, Corinna Peifer, and Conny H. Antoni. 2017. Zeigarnik’s Sleepless Nights: How Unfinished Tasks at the End of the Week Impair Employee Sleep on the Weekend through Rumination. Journal of Occupational Health Psychology 22, 2 (April 2017), 225–238. https://doi.org/10.1037/ocp0000031Google ScholarGoogle ScholarCross RefCross Ref
  106. Gustavo F. Tondello and Lennart E. Nacke. 2019. Player Characteristics and Video Game Preferences. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM, Barcelona Spain, 365–378. https://doi.org/10.1145/3311350.3347185Google ScholarGoogle ScholarDigital LibraryDigital Library
  107. Gustavo F. Tondello, Rina R. Wehbe, Lisa Diamond, Marc Busch, Andrzej Marczewski, and Lennart E. Nacke. 2016. The Gamification User Types Hexad Scale. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. ACM, Austin Texas USA, 229–243. https://doi.org/10.1145/2967934.2968082Google ScholarGoogle ScholarDigital LibraryDigital Library
  108. April Tyack and Elisa D. Mekler. 2020. Self-Determination Theory in HCI Games Research: Current Uses and Open Questions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–22. https://doi.org/10.1145/3313831.3376723Google ScholarGoogle ScholarDigital LibraryDigital Library
  109. Anant Vaibhav and Pooja Gupta. 2014. Gamification of MOOCs for Increasing User Engagement. In 2014 IEEE International Conference on MOOC, Innovation and Technology in Education (MITE). IEEE, Patiala, India, 290–295. https://doi.org/10.1109/mite.2014.7020290Google ScholarGoogle ScholarCross RefCross Ref
  110. Rajan Vaish, Keith Wyngarden, Jingshu Chen, Brandon Cheung, and Michael S. Bernstein. 2014. Twitch Crowdsourcing: Crowd Contributions in Short Bursts of Time. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems(CHI ’14). ACM, Toronto, Ontario, Canada, 3645–3654. https://doi.org/10.1145/2556288.2556996Google ScholarGoogle ScholarDigital LibraryDigital Library
  111. Markus Viljanen, Antti Airola, Tapio Pahikkala, and Jukka Heikkonen. 2016. Modelling User Retention in Mobile Games. In 2016 IEEE Conference on Computational Intelligence and Games (CIG). IEEE, Santorini, Greece, 1–8. https://doi.org/10.1109/cig.2016.7860393Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Luis von Ahn. 2008. Human Computation. In 2008 IEEE 24th International Conference on Data Engineering. IEEE, Cancun, Mexico, 1–2. https://doi.org/10.1109/icde.2008.4497403Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. Ben Weber, Michael John, Michael Mateas, and Arnav Jhala. 2011. Modeling Player Retention in Madden NFL 11. In IAAI, Vol. Twenty-Third IAAI Conference. AAAI Press, San Francisco, CA, USA, 6.Google ScholarGoogle Scholar
  114. B. L. Welch. 1951. On the Comparison of Several Mean Values: An Alternative Approach. Biometrika 38, 3/4 (Dec. 1951), 330. https://doi.org/10.2307/2332579Google ScholarGoogle ScholarCross RefCross Ref
  115. WHO. 2018. ICD-11 Gaming Disorder.Google ScholarGoogle Scholar
  116. Georgios N. Yannakakis, Pieter Spronck, Daniele Loiacono, and Elisabeth André. 2013. Player Modeling. Artificial and computational intelligence in games 6 (2013), 15 pages. https://doi.org/10.4230/DFU.VOL6.12191.45Google ScholarGoogle ScholarCross RefCross Ref
  117. José P Zagal, Staffan Björk, and Chris Lewis. 2013. Dark Patterns in the Design of Games. In FDG 2013(Foundations of Digital Games Conference, FDG 2013). ACM, Crete, Greece, 8.Google ScholarGoogle Scholar
  118. Daowen Zhang and Hui Quan. 2009. Power and Sample Size Calculation for Log-Rank Test with a Time Lag in Treatment Effect. Statistics in Medicine 28, 5 (Feb. 2009), 864–879. https://doi.org/10.1002/sim.3501Google ScholarGoogle ScholarCross RefCross Ref
  119. Georg Zoeller. 2013. Game Development Telemetry in Production. In Game Analytics, Magy Seif El-Nasr, Anders Drachen, and Alessandro Canossa(Eds.). Springer London, London, 111–135. https://doi.org/10.1007/978-1-4471-4769-5_7Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Serious Snacking: A Survival Analysis of how Snacking Mechanics Affect Attrition in a Mobile Serious Game
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
            May 2021
            10862 pages
            ISBN:9781450380966
            DOI:10.1145/3411764

            Copyright © 2021 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 7 May 2021

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            Overall Acceptance Rate6,199of26,314submissions,24%

            Upcoming Conference

            CHI '24
            CHI Conference on Human Factors in Computing Systems
            May 11 - 16, 2024
            Honolulu , HI , USA

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format