skip to main content
10.1145/3025453.3025638acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Is Difficulty Overrated?: The Effects of Choice, Novelty and Suspense on Intrinsic Motivation in Educational Games

Published: 02 May 2017 Publication History

Abstract

Many game designers aim to optimize difficulty to make games that are "not too hard, not too easy." However, recent experiments have shown that even moderate difficulty can reduce player engagement. The present work investigates other design factors that may account for the purported benefits of difficulty, such as choice, novelty and suspense. These factors were manipulated in three design experiments involving over 20,000 play sessions of an online educational game.
The first experiment (n=10,472) randomly assigned some players to a particular level of difficulty but allowed other players to freely choose their difficulty. Moderately difficult levels were most motivating when self-selected; yet, when difficulty was blindly assigned, the easiest games were most motivating. The second experiment (n=5,065) randomly assigned players to differing degrees of novelty. Moderate novelty was optimal, while too much or too little novelty reduced intrinsic motivation. A final experiment (n=6,511) investigated the role of suspense in "close games", where it was found to be beneficial. If difficulty decreases motivation while novelty and suspense increase it, then an implication for educational game designers is to make easy, interesting games that are "not too hard, not too boring."

Supplementary Material

MP4 File (p1028-lomas.mp4)

References

[1]
Abuhamdeh, S. and Csikszentmihalyi, M. (2012) The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities. Personality and Social Psychology Bulletin 38, 3, 317--330.
[2]
Andersen, E., Liu, Y., Snider, R., Szeto, R., and Popovic, Z. (2011) Placing a value on aesthetics in online casual games. ACM CHI.
[3]
Aponte, M., Levieux, G., & Natkin, S. (2011). Measuring the level of difficulty in single player video games. Entertainment Computing, 2(4), 205--21
[4]
Atkinson, J. (1958) Towards Experimental Analysis of Human Motivation in Terms of Motives, Expectances, and incentives. In J. Atkinson, ed., Motives in fantasy, action and society. Van Nostrand, Princeton, NJ, 288--305.
[5]
Barto, A., Mirolli, M., & Baldassarre, G. (2013). Novelty or surprise? Frontiers of Psychology, 4.
[6]
Berlyne, D. E. (1970). Novelty, complexity, and hedonic value. Perception & Psychophysics, 8(5), 279--286.
[7]
Bjork, S., & Holopainen, J. (2004). Patterns in game design.
[8]
Chase, C. C. (2012). The interplay of chance and skill: Exploiting a common game mechanic to enhance learning and persistence. Proceedings of the 2012 International Conference of the Learning Sciences.
[9]
Cordova, D. I., & Lepper, M. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88(4), 715.
[10]
Csikszentmihalyi, M., & Csikszentmihalyi, I. S. (Eds.). (1992). Optimal experience: Psychological studies of flow in consciousness. Cambridge University Press.
[11]
Deci, E. L., & Ryan, R. M. (2000). The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 4, 227--268.
[12]
Deci, E. L., & Ryan, R. M. (2003). Intrinsic motivation inventory. Self-Determination Theory, 267.
[13]
Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological bulletin, 125(6), 627.
[14]
Dickey, M.D. (2005) Engaging by design: How engagement strategies in popular computer and video games can inform instructional design. Educational Technology Research and Development 53, 2, 67--83.
[15]
Eccles, J. S. and Wigfield, A. Motivational beliefs, values, and goals. Annual review of psychology 53, (2002), 109--32.
[16]
Ely, J., Frankel, A., & Kamenica, E. (2015). Suspense and surprise. Journal of Political Economy, 123(1), 215--260.
[17]
Fishbach, A. and Finkelstein, S. How feedback influences persistence, disengagement and change in goal pursuit. In A. Elliot and H. Aarts, eds., Goal-directed behavior. Psychology Press, 2012, 1--53.
[18]
Harter, S. (1978a) Pleasure derived from challenge and the effects of receiving grades on children's difficulty level choices. Child Development 49, 3 788--799.
[19]
Hebb, D. O. (1955) Drives and the C.N.S. (Conceptual Nervous System) Psychological Review, 62, 243--254
[20]
Van der Heijden, H. (2004). User acceptance of hedonic information systems. MIS Quarterly, 28(4), 695--704.
[21]
Hockley, R. (2013) The Psychology of Fatigue: Work, Effort and Control. Cambridge University Press.
[22]
2Hong, Y., Chiu, C., Dweck, C.S., Lin, D.M.-S., and Wan, W. Implicit theories, attributions, and coping: A meaning system approach. Journal of Personality and Social Psychology 77, 3 (1999), 588--599.
[23]
Hunicke, R., & Chapman, V. (2004). AI for dynamic difficulty adjustment in games. Challenges in Game Artificial Intelligence AAAI, 91--96.
[24]
Kashdan, T. B., & Silvia, P. J. (2009). Curiosity and interest: The benefits of thriving on novelty and challenge. Oxford handbook of positive psychology, 2, 367--374.
[25]
Khajah, M. M., Roads, B. D., Lindsey, R. V, & Mozer, M. C. (2016). Designing Engaging Games Using Bayesian Optimization. ACM CHI.
[26]
Klarkowski, M., Johnson, D., Wyeth, P., McEwan, M., Phillips, C., & Smith, S. (2016). Operationalising and Evaluating Sub-Optimal and Optimal Play Experiences through Challenge-Skill Manipulation. ACM CHI.
[27]
Kline, P. (2014). The new psychometrics: Science, psychology and measurement. Routledge. p. 79.
[28]
Koedinger, K. R., Baker, R. S., Cunningham, K., Skogsholm, A., Leber, B., & Stamper, J. (2010). A data repository for the EDM community: The PSLC DataShop. Handbook of educational data mining, 43.
[29]
Koedinger, K. R., Booth, J. L., Klahr, D. (2013) Instructional Complexity and the Science to Constrain It Science. 22 November 2013: Vol. 342 no. 6161 pp. 935--937
[30]
Kohavi, R., Longbotham, R., Sommerfield, D., and Henne, R. M. (2008) Controlled experiments on the web: survey and practical guide. Data Mining and Knowledge Discovery 18, 1 140--181.
[31]
Kurzban, R., Duckworth, A., Kable, J. W., and Myers, J. An opportunity cost model of subjective effort and task performance. The Behavioral and brain sciences 36, 6 (2013), 661--79.
[32]
Inoue, N. (2007). Why face a challenge? The reason behind intrinsically motivated students' spontaneous choice of challenging tasks. Learning and Individual Differences, 17(3), 251--259.
[33]
Lomas, D., Patel, K., Forlizzi, J. L., & Koedinger, K. R. (2013) Optimizing challenge in an educational game using large-scale design experiments. ACM CHI
[34]
Lomas, D., Forlizzi, J., Poonwala, N., Patel, N., Shodhan, S., Patel, K., Koedinger, K., and Brunskill, E. (2016). Interface Design Optimization as a Multi-Armed Bandit Problem. ACM CHI.
[35]
Lomas, D. (2015) Accelerating Theory Development with Large Online Experiments: Towards an Interaction Design Science. HCIC
[36]
Lomas, J. D. (2014). Optimizing motivation and learning with large-scale game design experiments (Doctoral dissertation, Carnegie Mellon University).
[37]
Malone, T. (1981) Toward a theory of intrinsically motivating instruction. Cognitive Science 5, 4, 333--369.
[38]
Malone, T. W., & Lepper, M. R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. Aptitude, learning, and instruction, 3(1987), 223--253.
[39]
Murphy, J., Hofacker, C. and Mizerski, R. (2006) Primacy and recency effects on clicking behavior. Journal of Computer Mediated Communication, 11 (2).
[40]
Norman, D. A. (2013). The design of everyday things: Revised and expanded edition. Basic books.
[41]
O'Rourke, E. and Haimovitz, K. (2014) Brain points: a growth mindset incentive structure boosts persistence in an educational game. ACM CHI.
[42]
Papoušek, J., & Pelánek, R. (2015) Impact of Adaptive Educational System Behaviour on Student Motivation. AIED.
[43]
Pelánek, R., Rihák, J., & Papoušek, J. (2016). Impact of data collection on interpretation and evaluation of student models. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 40--47). ACM.
[44]
Shalley, C. E., & Oldham, G. R. (1985). Effects of goal difficulty and expected external evaluation on intrinsic motivation: A laboratory study. Academy of Management Journal, 28(3), 628--640.
[45]
Shapira, Z. (1989) Task choice and assigned goals as determinants of task motivation and performance. Org. Behavior & Human Dec. Proc. 44, 2, 141--165.
[46]
Schell, J. (2008) The Art of Game Design. Morgan Kaufmann
[47]
Schmierbach, M., Chung, M., Wu, M., & Kim, K. (2014). No One Likes to Lose: The Effect of Game Difficulty on Competency, Flow, and Enjoyment. Journal of Media Psychology, 26(3), 105--110.
[48]
Sweetser, P. and Wyeth, P. (2005) GameFlow: a model for evaluating player enjoyment in games. Computers in Entertainment (CIE) 3, 3, 1--24.
[49]
Teigen, K. (1994) Yerkes-Dodson: A Law for all Seasons. Theory & Psychology 4:525--547,
[50]
Weiner, B. An attributional theory of achievement motivation and emotion. Psychological review 92, 4 (1985), 548--73.
[51]
Yannakakis, G. N., Denmark, S., and Hallam, J. (2007) Towards optimizing entertainment in computer games, 933--971.
[52]
Yerkes, R. M., & Dodson, J. D. (1908). The relation of strength of stimulus to rapidity of habit-formation. Journal of comparative neurology and psychology, 18(5), 459--482.

Cited By

View all
  • (2024)Using Games in the Classroom to Boost Motivation Among ESL StudentsIntegrating Technology in Problem-Solving Educational Practices10.4018/979-8-3693-6745-2.ch005(93-116)Online publication date: 25-Oct-2024
  • (2024)Understanding the Impact of Perceived Challenge on Narrative Immersion in Video Games: The Role-Playing Game Genre as a Case StudyInformation10.3390/info1506029415:6(294)Online publication date: 22-May-2024
  • (2024)Circular Synergy City: Designing a Board Game for Fostering Collaboration Among Circular Economy StakeholdersProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685361(1-14)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. Is Difficulty Overrated?: The Effects of Choice, Novelty and Suspense on Intrinsic Motivation in Educational Games

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    • Honorable Mention

    Author Tags

    1. a/b testing
    2. challenge
    3. difficulty
    4. education
    5. experiments
    6. flow
    7. games
    8. intrinsic motivation
    9. learning
    10. near win
    11. novelty
    12. suspense
    13. theory

    Qualifiers

    • Research-article

    Funding Sources

    • IES

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)233
    • Downloads (Last 6 weeks)26
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Using Games in the Classroom to Boost Motivation Among ESL StudentsIntegrating Technology in Problem-Solving Educational Practices10.4018/979-8-3693-6745-2.ch005(93-116)Online publication date: 25-Oct-2024
    • (2024)Understanding the Impact of Perceived Challenge on Narrative Immersion in Video Games: The Role-Playing Game Genre as a Case StudyInformation10.3390/info1506029415:6(294)Online publication date: 22-May-2024
    • (2024)Circular Synergy City: Designing a Board Game for Fostering Collaboration Among Circular Economy StakeholdersProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685361(1-14)Online publication date: 13-Oct-2024
    • (2024)On Video Game Balancing: Joining Player- and Data-Driven AnalyticsGames: Research and Practice10.1145/36758072:3(1-30)Online publication date: 30-Aug-2024
    • (2024)Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned ParadigmsACM Transactions on Computer-Human Interaction10.1145/367323031:3(1-74)Online publication date: 15-Jun-2024
    • (2024)Edutainment in the Context of Science Communication in Virtual RealityCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678827(359-364)Online publication date: 14-Oct-2024
    • (2024)Rowing Beyond: Investigating Steering Methods for Rowing-based Locomotion in Virtual EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642192(1-17)Online publication date: 11-May-2024
    • (2024)Exploration of Novelty as Part of the Player Experience of Need Satisfaction in GamesInteracting with Computers10.1093/iwc/iwae006Online publication date: 15-Mar-2024
    • (2024)Does Where You Exercise Matter? The Influence of VR Environmental Cues and Social Cues on Exercise Motivation and BehaviorInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2426916(1-17)Online publication date: 19-Nov-2024
    • (2024)The powerful impact of teacher expectations: a narrative reviewJournal of the Royal Society of New Zealand10.1080/03036758.2024.239329655:2(343-371)Online publication date: 26-Aug-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media