skip to main content
10.1145/3491101.3519819acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Development and Preliminary Validation of the Enjoyment Questionnaire and the Sources of Enjoyment Questionnaire

Authors Info & Claims
Published:28 April 2022Publication History

ABSTRACT

Building on the sources of enjoyment identified by Schaffer and Fang's card sorting study, we describe the development of two new measures for player experience research, the Enjoyment Questionnaire (EQ) and the Sources of Enjoyment Questionnaire (SoEQ). Among other sources, the EQ and SoEQ draw on flow theory, self-determination theory, and desire fulfillment theory. The EQ assesses digital game enjoyment and the SoEQ assesses 38 sources of enjoyment in digital games, including Humor, Relaxation, Savoring, Optimal Pacing, Optimal Variety, Social Responsibility, Task Significance, and Clear Task Purpose. The scale was validated with a survey of 564 participants. Results demonstrated the EQ and each subscale of the SoEQ have both construct validity and internal consistency. Results also provided evidence for convergent and discriminant validity. The EQ and SoEQ are useful and reliable tools for the study of digital game enjoyment and its sources.

Skip Supplemental Material Section

Supplemental Material

3491101.3519819-video-preview.mp4

mp4

13.6 MB

3491101.3519819-talk-video.mp4

mp4

57.2 MB

References

  1. Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135, (March 2020), 102370. DOI:https://doi.org/10.1016/j.ijhcs.2019.102370Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. John Brooke. 1996. SUS: A “quick and dirty” usability scale. In Usability evaluation in industry. Taylor & Francis, London, UK, 189– 194.Google ScholarGoogle Scholar
  3. Stuart Brown and Christopher Vaughan. 2010. Play: How it Shapes the Brain, Opens the Imagination, and Invigorates the Soul (Reprint edition ed.). Avery, New York.Google ScholarGoogle Scholar
  4. Fred Bryant. 2003. Savoring Beliefs Inventory (SBI): A scale for measuring beliefs about savouring. Journal of mental health 12, 2 (2003), 175–196.Google ScholarGoogle ScholarCross RefCross Ref
  5. Michael Buhrmester, Tracy Kwang, and Samuel D. Gosling. 2016. Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality data? American Psychological Association, Washington, DC, US. DOI:https://doi.org/10.1037/14805-009Google ScholarGoogle Scholar
  6. Laura C. Crysel and Gregory D. Webster. 2018. Schadenfreude and the spread of political misfortune. PLOS ONE 13, 9 (September 2018), e0201754. DOI:https://doi.org/10.1371/journal.pone.0201754Google ScholarGoogle ScholarCross RefCross Ref
  7. Edward Deci and Richard M. Ryan. 1985. Intrinsic Motivation and Self-Determination in Human Behavior. Plenum Press, New York.Google ScholarGoogle Scholar
  8. Alena Denisova, Paul Cairns, Christian Guckelsberger, and David Zendle. 2020. Measuring perceived challenge in digital games: Development & validation of the challenge originating from recent gameplay interaction scale (CORGIS). International Journal of Human-Computer Studies 137, (2020), 102383.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Robert F. DeVellis and Carolyn T. Thorpe. 2021. Scale development: Theory and applications. Sage publications.Google ScholarGoogle Scholar
  10. Stefan Engeser and Falko Rheinberg. 2008. Flow, performance and moderators of challenge-skill balance. Motivation and Emotion 32, 3 (2008), 158–172.Google ScholarGoogle ScholarCross RefCross Ref
  11. Xiaowen Fang, Susy Chan, Jacek Brzezinski, and Chitra Nair. 2010. Development of an instrument to measure enjoyment of computer game play. INTL. Journal of human–computer interaction 26, 9 (2010), 868–886.Google ScholarGoogle Scholar
  12. Xiaowen Fang, Jingli Zhang, and Susy S. Chan. 2013. Development of an Instrument for Studying Flow in Computer Game Play. International Journal of Human–Computer Interaction 29, 7 (July 2013), 456–470. DOI:https://doi.org/10.1080/10447318.2012.715991Google ScholarGoogle Scholar
  13. Xiaowen Fang, Jingli Zhang, and Susy S. Chan. 2013. Development of an Instrument for Studying Flow in Computer Game Play. International Journal of Human-Computer Interaction 29, 7 (July 2013), 456–470. DOI:https://doi.org/10.1080/10447318.2012.715991Google ScholarGoogle ScholarCross RefCross Ref
  14. Tracy Fullerton. 2014. Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition (3 edition ed.). A K Peters/CRC Press, Boca Raton.Google ScholarGoogle Scholar
  15. Joseph F. Hair, William C. Black, Barry J. Babin, and Rolph E. Anderson. 2019. Multivariate data analysis (8th ed.). Cengage Learning, Hampshire, UK.Google ScholarGoogle Scholar
  16. Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, and Jeffrey P. Bigham. 2018. A data-driven analysis of workers’ earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI conference on human factors in computing systems, 1–14.Google ScholarGoogle Scholar
  17. David Hauser, Aaron J. Moss, Cheskie Rosenzweig, Shalom Noach Jaffe, Jonathan Robinson, and Leib LItman. 2021. Evaluating CloudResearch's Approved Group as a Solution for Problematic Data Quality on MTurk. (2021).Google ScholarGoogle Scholar
  18. Susan M. Havercamp. 1998. The Reiss Profile of motivation sensitivity: Reliability, validity, and social desirability. PhD Thesis. Ohio State University.Google ScholarGoogle Scholar
  19. Timothy J. Huelsman, Richard C. Nemanick Jr, and David C. Munz. 1998. Scales to measure four dimensions of dispositional mood: Positive energy, tiredness, negative activation, and relaxation. Educational and Psychological Measurement 58, 5 (1998), 804–819.Google ScholarGoogle ScholarCross RefCross Ref
  20. Susan A. Jackson and Herbert W. Marsh. 1996. Development and validation of a scale to measure optimal experience: The Flow State Scale. Journal of sport and exercise psychology 18, 1 (1996), 17–35.Google ScholarGoogle ScholarCross RefCross Ref
  21. Rex B. Kline. 2015. Principles and practice of structural equation modeling. Guilford publications.Google ScholarGoogle Scholar
  22. Hannu Korhonen, Markus Montola, and Juha Arrasvuori. 2009. Understanding playful user experience through digital games. In International Conference on Designing Pleasurable Products and Interfaces, Citeseer. Retrieved January 26, 2017 from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.586.7146&rep=rep1&type=pdfGoogle ScholarGoogle Scholar
  23. Nicole Lazzaro. 2004. Why We Play Games: Four Keys to More Emotion Without Story. (2004). Retrieved from http://gamemodworkshop.com/readings/xeodesign_whyweplaygames.pdfGoogle ScholarGoogle Scholar
  24. Nicole Lazzaro. 2009. Why we play: affect and the fun of games. In Human-computer interaction: Designing for diverse users and domains. 155–176.Google ScholarGoogle Scholar
  25. James (Jim) R. Lewis and Jeff Sauro. 2017. Revisiting the factor structure of the system usability scale. J. Usability Studies 12, 4 (August 2017), 183–192.Google ScholarGoogle Scholar
  26. Andrés Lucero and Juha Arrasvuori. 2010. PLEX Cards: A Source of Inspiration when Designing for Playfulness. In Proceedings of the 3rd International Conference on Fun and Games (Fun and Games ’10), ACM, New York, NY, USA, 28–37. DOI:https://doi.org/10.1145/1823818.1823821Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Zdravko Marjanovic, C. Ward Struthers, Robert Cribbie, and Esther R. Greenglass. 2014. The Conscientious Responders Scale: A New Tool for Discriminating Between Conscientious and Random Responders. SAGE Open (August 2014). DOI:https://doi.org/10.1177/2158244014545964Google ScholarGoogle Scholar
  28. Edward McAuley, Terry Duncan, and Vance V. Tammen. 1989. Psychometric Properties of the Intrinsic Motivation Inventory in a Competitive Sport Setting: A Confirmatory Factor Analysis. Research Quarterly for Exercise and Sport 60, 1 (March 1989), 48–58. DOI:https://doi.org/10.1080/02701367.1989.10607413Google ScholarGoogle ScholarCross RefCross Ref
  29. Elisa D. Mekler and Kasper Hornbæk. 2019. A Framework for the Experience of Meaning in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), Association for Computing Machinery, New York, NY, USA, 1–15. DOI:https://doi.org/10.1145/3290605.3300455Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Gary C. Moore and Izak Benbasat. 1991. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information systems research 2, 3 (1991), 192–222.Google ScholarGoogle Scholar
  31. Jeanne Nakamura and Mihaly Csikszentmihalyi. 2014. The concept of flow. In Flow and the foundations of positive psychology. Springer, 239–263.Google ScholarGoogle Scholar
  32. Brennan R. Payne, Joshua J. Jackson, Soo Rim Noh, and Elizabeth A. L. Stine-Morrow. 2011. In The Zone: Flow State and Cognition in Older Adults. Psychol Aging 26, 3 (2011), 738–743. DOI:https://doi.org/10.1037/a0022359Google ScholarGoogle ScholarCross RefCross Ref
  33. Marjorie A. Pett, Nancy R. Lackey, and John Sullivan. 2003. Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research (1st Edition ed.). SAGE Publications, Inc, Thousand Oaks, Calif.Google ScholarGoogle Scholar
  34. Mikki H. Phan, Joseph R. Keebler, and Barbara S. Chaparro. 2016. The Development and Validation of the Game User Experience Satisfaction Scale (GUESS). Human Factors 58, 8 (December 2016), 1217–1247. DOI:https://doi.org/10.1177/0018720816669646Google ScholarGoogle ScholarCross RefCross Ref
  35. Andrew K. Przybylski, Netta Weinstein, Richard M. Ryan, and C. Scott Rigby. 2009. Having to versus wanting to play: Background and consequences of harmonious versus obsessive engagement in video games. CyberPsychology & Behavior 12, 5 (2009), 485–492.Google ScholarGoogle ScholarCross RefCross Ref
  36. John M. Quick, Robert K. Atkinson, and Lijia Lin. 2012. Empirical taxonomies of gameplay enjoyment: Personality and video game preference. International Journal of Game-Based Learning (IJGBL) 2, 3 (2012), 11–31.Google ScholarGoogle ScholarCross RefCross Ref
  37. Justus J. Randolph. 2005. Free-marginal multirater kappa: An alternative to Fleiss´ fixed-marginal multirater kappa. Joensuu, Finland. Retrieved from https://eric.ed.gov/?id=ED490661Google ScholarGoogle Scholar
  38. Steven Reiss. 2002. Who Am I? The 16 Basic Desires That Motivate Our Actions and Define Our Personalities (35050th edition ed.). Berkley, New York, NY.Google ScholarGoogle Scholar
  39. Steven Reiss. 2004. Multifaceted Nature of Intrinsic Motivation: The Theory of 16 Basic Desires. Review of General Psychology 8, 3 (2004), 179–193. DOI:https://doi.org/10.1037/1089-2680.8.3.179Google ScholarGoogle ScholarCross RefCross Ref
  40. R. M. Ryan and E. L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55, 1 (January 2000), 68–78. DOI:https://doi.org/10.1037//0003-066X.55.1.68Google ScholarGoogle ScholarCross RefCross Ref
  41. Richard M. Ryan and Christina Frederick. 1997. On energy, personality, and health: Subjective vitality as a dynamic reflection of well-being. Journal of personality 65, 3 (1997), 529–565.Google ScholarGoogle ScholarCross RefCross Ref
  42. Aaron M. Sackett, Tom Meyvis, Leif D. Nelson, Benjamin A. Converse, and Anna L. Sackett. 2010. You're Having Fun When Time Flies: The Hedonic Consequences of Subjective Time Progression. Psychol Sci 21, 1 (January 2010), 111–117. DOI:https://doi.org/10.1177/0956797609354832Google ScholarGoogle ScholarCross RefCross Ref
  43. Jeff Sauro and James R. Lewis. 2012. Quantifying the User Experience: Practical Statistics for User Research (1 edition ed.). Morgan Kaufmann, Amsterdam ; Waltham, MA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Owen Schaffer. 2019. A desire fulfillment theory of digital game enjoyment. Ph.D. Dissertation. DePaul University, Chicago, IL, USA. Retrieved from https://via.library.depaul.edu/cdm_etd/18Google ScholarGoogle Scholar
  45. Owen Schaffer and Xiaowen Fang. 2016. Impact of Task and Interface Design on Flow. Dublin, Ireland. Retrieved from http://aisel.aisnet.org/sighci2016/7/Google ScholarGoogle Scholar
  46. Owen Schaffer and Xiaowen Fang. 2018. What Makes Games Fun? Card Sort Reveals 34 Sources of Computer Game Enjoyment. New Orleans. Retrieved from http://aisel.aisnet.org/amcis2018/HCI/Presentations/2/Google ScholarGoogle Scholar
  47. Jan Van Looy, Cédric Courtois, Melanie De Vocht, and Lieven De Marez. 2012. Player identification in online games: Validation of a scale for measuring identification in MMOGs. Media Psychology 15, 2 (2012), 197–221.Google ScholarGoogle ScholarCross RefCross Ref
  48. Viswanath Venkatesh and Fred D. Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science 46, 2 (2000), 186–204.Google ScholarGoogle Scholar
  49. Nicholas Winter, Tyler Burleigh, Ryan Kennedy, and Scott Clifford. 2019. A Simplified Protocol to Screen Out VPS and International Respondents Using Qualtrics. Social Science Research Network, Rochester, NY. DOI:https://doi.org/10.2139/ssrn.3327274Google ScholarGoogle Scholar
  50. Nick Yee. 2006. Motivations for play in online games. CyberPsychology & behavior 9, 6 (2006), 772–775.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
    April 2022
    3066 pages
    ISBN:9781450391566
    DOI:10.1145/3491101

    Copyright © 2022 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 28 April 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • poster
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate6,164of23,696submissions,26%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format