ABSTRACT
Building on the sources of enjoyment identified by Schaffer and Fang's card sorting study, we describe the development of two new measures for player experience research, the Enjoyment Questionnaire (EQ) and the Sources of Enjoyment Questionnaire (SoEQ). Among other sources, the EQ and SoEQ draw on flow theory, self-determination theory, and desire fulfillment theory. The EQ assesses digital game enjoyment and the SoEQ assesses 38 sources of enjoyment in digital games, including Humor, Relaxation, Savoring, Optimal Pacing, Optimal Variety, Social Responsibility, Task Significance, and Clear Task Purpose. The scale was validated with a survey of 564 participants. Results demonstrated the EQ and each subscale of the SoEQ have both construct validity and internal consistency. Results also provided evidence for convergent and discriminant validity. The EQ and SoEQ are useful and reliable tools for the study of digital game enjoyment and its sources.
Supplemental Material
- Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135, (March 2020), 102370. DOI:https://doi.org/10.1016/j.ijhcs.2019.102370Google ScholarDigital Library
- John Brooke. 1996. SUS: A “quick and dirty” usability scale. In Usability evaluation in industry. Taylor & Francis, London, UK, 189– 194.Google Scholar
- Stuart Brown and Christopher Vaughan. 2010. Play: How it Shapes the Brain, Opens the Imagination, and Invigorates the Soul (Reprint edition ed.). Avery, New York.Google Scholar
- Fred Bryant. 2003. Savoring Beliefs Inventory (SBI): A scale for measuring beliefs about savouring. Journal of mental health 12, 2 (2003), 175–196.Google ScholarCross Ref
- Michael Buhrmester, Tracy Kwang, and Samuel D. Gosling. 2016. Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality data? American Psychological Association, Washington, DC, US. DOI:https://doi.org/10.1037/14805-009Google Scholar
- Laura C. Crysel and Gregory D. Webster. 2018. Schadenfreude and the spread of political misfortune. PLOS ONE 13, 9 (September 2018), e0201754. DOI:https://doi.org/10.1371/journal.pone.0201754Google ScholarCross Ref
- Edward Deci and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. Plenum Press, New York.Google Scholar
- Alena Denisova, Paul Cairns, Christian Guckelsberger, and David Zendle. 2020. Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS). International Journal of Human-Computer Studies 137, (2020), 102383.Google ScholarDigital Library
- Robert F. DeVellis and Carolyn T. Thorpe. 2021. Scale development: Theory and applications. Sage publications.Google Scholar
- Stefan Engeser and Falko Rheinberg. 2008. Flow, performance and moderators of challenge-skill balance. Motivation and Emotion 32, 3 (2008), 158–172.Google ScholarCross Ref
- Xiaowen Fang, Susy Chan, Jacek Brzezinski, and Chitra Nair. 2010. Development of an instrument to measure enjoyment of computer game play. INTL. Journal of human–computer interaction 26, 9 (2010), 868–886.Google Scholar
- Xiaowen Fang, Jingli Zhang, and Susy S. Chan. 2013. Development of an Instrument for Studying Flow in Computer Game Play. International Journal of Human–Computer Interaction 29, 7 (July 2013), 456–470. DOI:https://doi.org/10.1080/10447318.2012.715991Google Scholar
- Xiaowen Fang, Jingli Zhang, and Susy S. Chan. 2013. Development of an Instrument for Studying Flow in Computer Game Play. International Journal of Human-Computer Interaction 29, 7 (July 2013), 456–470. DOI:https://doi.org/10.1080/10447318.2012.715991Google ScholarCross Ref
- Tracy Fullerton. 2014. Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition (3 edition ed.). A K Peters/CRC Press, Boca Raton.Google Scholar
- Joseph F. Hair, William C. Black, Barry J. Babin, and Rolph E. Anderson. 2019. Multivariate data analysis (8th ed.). Cengage Learning, Hampshire, UK.Google Scholar
- Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, and Jeffrey P. Bigham. 2018. A data-driven analysis of workers’ earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI conference on human factors in computing systems, 1–14.Google Scholar
- David Hauser, Aaron J. Moss, Cheskie Rosenzweig, Shalom Noach Jaffe, Jonathan Robinson, and Leib LItman. 2021. Evaluating CloudResearch's Approved Group as a Solution for Problematic Data Quality on MTurk. (2021).Google Scholar
- Susan M. Havercamp. 1998. The Reiss Profile of motivation sensitivity: Reliability, validity, and social desirability. PhD Thesis. Ohio State University.Google Scholar
- Timothy J. Huelsman, Richard C. Nemanick Jr, and David C. Munz. 1998. Scales to measure four dimensions of dispositional mood: Positive energy, tiredness, negative activation, and relaxation. Educational and Psychological Measurement 58, 5 (1998), 804–819.Google ScholarCross Ref
- Susan A. Jackson and Herbert W. Marsh. 1996. Development and validation of a scale to measure optimal experience: The Flow State Scale. Journal of sport and exercise psychology 18, 1 (1996), 17–35.Google ScholarCross Ref
- Rex B. Kline. 2015. Principles and practice of structural equation modeling. Guilford publications.Google Scholar
- Hannu Korhonen, Markus Montola, and Juha Arrasvuori. 2009. Understanding playful user experience through digital games. In International Conference on Designing Pleasurable Products and Interfaces, Citeseer. Retrieved January 26, 2017 from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.586.7146&rep=rep1&type=pdfGoogle Scholar
- Nicole Lazzaro. 2004. Why We Play Games: Four Keys to More Emotion Without Story. (2004). Retrieved from http://gamemodworkshop.com/readings/xeodesign_whyweplaygames.pdfGoogle Scholar
- Nicole Lazzaro. 2009. Why we play: affect and the fun of games. In Human-computer interaction: Designing for diverse users and domains. 155–176.Google Scholar
- James (Jim) R. Lewis and Jeff Sauro. 2017. Revisiting the factor structure of the system usability scale. J. Usability Studies 12, 4 (August 2017), 183–192.Google Scholar
- Andrés Lucero and Juha Arrasvuori. 2010. PLEX Cards: A Source of Inspiration when Designing for Playfulness. In Proceedings of the 3rd International Conference on Fun and Games (Fun and Games ’10), ACM, New York, NY, USA, 28–37. DOI:https://doi.org/10.1145/1823818.1823821Google ScholarDigital Library
- Zdravko Marjanovic, C. Ward Struthers, Robert Cribbie, and Esther R. Greenglass. 2014. The Conscientious Responders Scale: A New Tool for Discriminating Between Conscientious and Random Responders. SAGE Open (August 2014). DOI:https://doi.org/10.1177/2158244014545964Google Scholar
- Edward McAuley, Terry Duncan, and Vance V. Tammen. 1989. Psychometric Properties of the Intrinsic Motivation Inventory in a Competitive Sport Setting: A Confirmatory Factor Analysis. Research Quarterly for Exercise and Sport 60, 1 (March 1989), 48–58. DOI:https://doi.org/10.1080/02701367.1989.10607413Google ScholarCross Ref
- Elisa D. Mekler and Kasper Hornbæk. 2019. A Framework for the Experience of Meaning in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), Association for Computing Machinery, New York, NY, USA, 1–15. DOI:https://doi.org/10.1145/3290605.3300455Google ScholarDigital Library
- Gary C. Moore and Izak Benbasat. 1991. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information systems research 2, 3 (1991), 192–222.Google Scholar
- Jeanne Nakamura and Mihaly Csikszentmihalyi. 2014. The concept of flow. In Flow and the foundations of positive psychology. Springer, 239–263.Google Scholar
- Brennan R. Payne, Joshua J. Jackson, Soo Rim Noh, and Elizabeth A. L. Stine-Morrow. 2011. In The Zone: Flow State and Cognition in Older Adults. Psychol Aging 26, 3 (2011), 738–743. DOI:https://doi.org/10.1037/a0022359Google ScholarCross Ref
- Marjorie A. Pett, Nancy R. Lackey, and John Sullivan. 2003. Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research (1st Edition ed.). SAGE Publications, Inc, Thousand Oaks, Calif.Google Scholar
- Mikki H. Phan, Joseph R. Keebler, and Barbara S. Chaparro. 2016. The Development and Validation of the Game User Experience Satisfaction Scale (GUESS). Human Factors 58, 8 (December 2016), 1217–1247. DOI:https://doi.org/10.1177/0018720816669646Google ScholarCross Ref
- Andrew K. Przybylski, Netta Weinstein, Richard M. Ryan, and C. Scott Rigby. 2009. Having to versus wanting to play: Background and consequences of harmonious versus obsessive engagement in video games. CyberPsychology & Behavior 12, 5 (2009), 485–492.Google ScholarCross Ref
- John M. Quick, Robert K. Atkinson, and Lijia Lin. 2012. Empirical taxonomies of gameplay enjoyment: Personality and video game preference. International Journal of Game-Based Learning (IJGBL) 2, 3 (2012), 11–31.Google ScholarCross Ref
- Justus J. Randolph. 2005. Free-marginal multirater kappa: An alternative to Fleiss´ fixed-marginal multirater kappa. Joensuu, Finland. Retrieved from https://eric.ed.gov/?id=ED490661Google Scholar
- Steven Reiss. 2002. Who Am I? The 16 Basic Desires That Motivate Our Actions and Define Our Personalities (35050th edition ed.). Berkley, New York, NY.Google Scholar
- Steven Reiss. 2004. Multifaceted Nature of Intrinsic Motivation: The Theory of 16 Basic Desires. Review of General Psychology 8, 3 (2004), 179–193. DOI:https://doi.org/10.1037/1089-2680.8.3.179Google ScholarCross Ref
- R. M. Ryan and E. L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55, 1 (January 2000), 68–78. DOI:https://doi.org/10.1037//0003-066X.55.1.68Google ScholarCross Ref
- Richard M. Ryan and Christina Frederick. 1997. On energy, personality, and health: Subjective vitality as a dynamic reflection of well-being. Journal of personality 65, 3 (1997), 529–565.Google ScholarCross Ref
- Aaron M. Sackett, Tom Meyvis, Leif D. Nelson, Benjamin A. Converse, and Anna L. Sackett. 2010. You're Having Fun When Time Flies: The Hedonic Consequences of Subjective Time Progression. Psychol Sci 21, 1 (January 2010), 111–117. DOI:https://doi.org/10.1177/0956797609354832Google ScholarCross Ref
- Jeff Sauro and James R. Lewis. 2012. Quantifying the User Experience: Practical Statistics for User Research (1 edition ed.). Morgan Kaufmann, Amsterdam ; Waltham, MA.Google ScholarDigital Library
- Owen Schaffer. 2019. A desire fulfillment theory of digital game enjoyment. Ph.D. Dissertation. DePaul University, Chicago, IL, USA. Retrieved from https://via.library.depaul.edu/cdm_etd/18Google Scholar
- Owen Schaffer and Xiaowen Fang. 2016. Impact of Task and Interface Design on Flow. Dublin, Ireland. Retrieved from http://aisel.aisnet.org/sighci2016/7/Google Scholar
- Owen Schaffer and Xiaowen Fang. 2018. What Makes Games Fun? Card Sort Reveals 34 Sources of Computer Game Enjoyment. New Orleans. Retrieved from http://aisel.aisnet.org/amcis2018/HCI/Presentations/2/Google Scholar
- Jan Van Looy, Cédric Courtois, Melanie De Vocht, and Lieven De Marez. 2012. Player identification in online games: Validation of a scale for measuring identification in MMOGs. Media Psychology 15, 2 (2012), 197–221.Google ScholarCross Ref
- Viswanath Venkatesh and Fred D. Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science 46, 2 (2000), 186–204.Google Scholar
- Nicholas Winter, Tyler Burleigh, Ryan Kennedy, and Scott Clifford. 2019. A Simplified Protocol to Screen Out VPS and International Respondents Using Qualtrics. Social Science Research Network, Rochester, NY. DOI:https://doi.org/10.2139/ssrn.3327274Google Scholar
- Nick Yee. 2006. Motivations for play in online games. CyberPsychology & behavior 9, 6 (2006), 772–775.Google Scholar
Recommendations
A systematic review of quantitative studies on the enjoyment of digital entertainment games
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsEnjoyment has been identified as a central component of the player experience (PX), but various, overlapping concepts within PX make it difficult to develop valid measures and a common understanding of game enjoyment. We conducted a systematic review of ...
The Impact of Fulfilling a Desire for Idealism on Task Engagement and Enjoyment in Digital Games
HCI in GamesAbstractFor practitioners and researchers who want to design for enjoyment, empirical research on what makes digital games enjoyable is critical. This is true for Game Design, Gamification of non-game applications, and Serious Games with a purpose beyond ...
Digital Game Enjoyment: A Literature Review
HCI in GamesAbstractA review of the literature on digital game enjoyment or what makes digital games enjoyable is presented, organized by topic. A literature search resulted in 61 relevant peer-reviewed research articles or papers. No limits were put on the research ...
Comments