research-article

Development and Validation of a German Version of the Player Experience Inventory (PXI)

Authors:

Maximilian Altmeyer,

Katharina Emmerich,

Andrey Krekhov,

Katta SpielAuthors Info & Claims

MuC '22: Proceedings of Mensch und Computer 2022

Pages 265 - 275

https://doi.org/10.1145/3543758.3543763

Published: 15 September 2022 Publication History

Abstract

The Player Experience Inventory (PXI), initially developed by Abeele et al. (2020), measures player experiences among English-speaking players. However, empirically validated translations of the PXI are sparse, limiting the use of the scale among non-English speaking players. In this paper, we address this issue by providing a translated version of the scale in German, the most widely spoken first language in the European Union. After translating the original items, we conducted a confirmatory factor analysis (N = 506) to validate the German version of the PXI. Our results confirmed a 10-factor model—which the original authors of the instrument suggested—and show that the German PXI has valid psychometric properties. While model fit, internal consistency and convergent validity were acceptable, there was room for improvement regarding discriminant validity. Based on our results, we advocate for the German PXI as a valid and reliable instrument for assessing player experiences in German-speaking samples.

References

[1]

Vero Vanden Abeele, Katta Spiel, Lennart Nacke, Daniel Johnson, and Kathrin Gerling. 2020. Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences. International Journal of Human-Computer Studies 135 (2020), 102370. https://doi.org/10.1016/j.ijhcs.2019.102370

Digital Library

[2]

Lena Fanya Aeschbach, Sebastian AC Perrig, Lorena Weder, Klaus Opwis, and Florian Brühlmann. 2021. Transparency in measurement reporting: A systematic literature review of chi play. Proceedings of the ACM on Human-Computer Interaction 5, CHI PLAY(2021), 1–21. https://doi.org/10.1145/3474660

Digital Library

[3]

Dominique Banville, Pauline Desrosiers, and Yvette Genet-Volet. 2000. Translating questionnaires and inventories using a cross-cultural translation technique. Journal of teaching in Physical Education 19, 3 (2000), 374–387.

[4]

Orlando Behling and Kenneth S Law. 2000. Translating questionnaires and other research instruments: Problems and solutions. Vol. 133. sage.

[5]

João Bosco Borges, Carmen Li Juy, Izac Sidarta de Andrade Matos, Paulo Vitor Angelo Silveira, and Ticianne de Gois Ribeiro Darin. 2020. Player Experience Evaluation: a Brief Panorama of Instruments and Research Opportunities. Journal on Interactive Systems 11, 1 (2020), 74–91. https://doi.org/10.5753/jis.2020.765

[6]

Jeanne H. Brockmyer, Christine M. Fox, Kathleen A. Curtiss, Evan McBroom, Kimberly M. Burkhart, and Jacquelyn N. Pidruzny. 2009. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45, 4 (2009), 624–634. https://doi.org/10.1016/j.jesp.2009.02.016 Publisher: Elsevier.

[7]

Florian Brühlmann and Gian-Marco Schmid. 2015. How to measure the game experience? Analysis of the factor structure of two questionnaires. In Proceedings of the 33rd annual acm conference extended abstracts on human factors in computing systems. 1181–1186. https://doi.org/10.1145/2702613.2732831

Digital Library

[8]

Edward L Deci and Richard M. Ryan. 2013. Intrinsic motivation and self-determination in human behavior. Springer Science & Business Media.

[9]

Alena Denisova, A Imran Nordin, and Paul Cairns. 2016. The convergence of player experience questionnaires. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play. 33–37. https://doi.org/10.1145/2967934.2968095

Digital Library

[10]

Anders Drachen, Pejman Mirza-Babaei, and Lennart E. Nacke. 2018. Games user research. Oxford University Press.

[11]

Katharina Emmerich, Natalya Bogacheva, Mareike Bockholt, and Viktor Wendel. 2016. Operationalization and measurement of evaluation constructs. In Entertainment Computing and Serious Games. Springer, 306–331.

[12]

Leandre R. Fabrigar, Duane T. Wegener, Robert C. MacCallum, and Erin J. Strahan. 1999. Evaluating the use of exploratory factor analysis in psychological research.Psychological Methods 4, 3 (sep 1999), 272–299. https://doi.org/10.1037/1082-989X.4.3.272

[13]

Claes Fornell and David Larcker. 1981. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research 18, 1 (1981), 39–50. https://doi.org/10.1177/002224378101800104

[14]

Casper Harteveld, Nithesh Javvaji, Tiago Machado, Yevgeniya V. Zastavker, Victoria Bennett, and Tarek Abdoun. 2020. Preliminary Development and Evaluation of the Mini Player Experience Inventory (MPXI). In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, New York, NY, USA, 257–261. https://doi.org/10.1145/3383668.3419877

Digital Library

[15]

Li Tze Hu and Peter M. Bentler. 1999. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 6, 1 (1999), 1–55. https://doi.org/10.1080/10705519909540118

[16]

Johan Huizinga. 2020. Homo ludens. Editora Perspectiva SA.

[17]

Johan Högberg, Juho Hamari, and Erik Wästlund. 2019. Gameful Experience Questionnaire (GAMEFULQUEST): an instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction 29, 3 (2019), 619–660. https://doi.org/10.1007/s11257-019-09223-w Publisher: Springer.

Digital Library

[18]

Wijnand A. IJsselsteijn, Yvonne AW de Kort, and Karolien Poels. 2013. The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven (2013), 3–9.

[19]

Charlene Jennett, Anna L Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and defining the experience of immersion in games. International journal of human-computer studies 66, 9 (2008), 641–661. https://doi.org/10.1016/j.ijhcs.2008.04.004

Digital Library

[20]

Daniel Johnson, M John Gardner, and Ryan Perry. 2018. Validation of two game experience scales: the player experience of need satisfaction (PENS) and game experience questionnaire (GEQ). International Journal of Human-Computer Studies 118 (2018), 38–46. https://doi.org/10.1016/j.ijhcs.2018.05.003

[21]

Dominik Kayser, Sebastian Andrea Caesar Perrig, and Florian Brühlmann. 2021. Measuring Players’ Experience of Need Satisfaction in Digital Games: An Analysis of the Factor Structure of the UPEQ. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play. 158–162. https://doi.org/10.1145/3450337.3483499

Digital Library

[22]

Pascal Klein, Nicole Burkard, Larissa Hahn, Merten Nikolay Dahlkemper, Kevin Eberle, Tina Jäger, and Marc Herrlich. 2021. Coordinating vector field equations and diagrams with a serious game in introductory physics. European Journal of Physics(2021). https://doi.org/10.1088/1361-6404/abef5c

[23]

Patri Lankoski, Staffan Björk, 2015. Game research methods: An overview. Lulu. com.

[24]

Effie L.-C. Law, Florian Brühlmann, and Elisa D. Mekler. 2018. Systematic review and validation of the game experience questionnaire (geq)-implications for citation and reporting practice. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 257–270. https://doi.org/10.1145/3242671.3242683

Digital Library

[25]

Tara T Lineweaver and Jessica W Brolsma. 2014. How you ask matters: An experimental investigation of the influence of mood on memory self-perceptions and their relationship with objective memory. Memory 22, 8 (2014), 1103–1115. https://doi.org/10.1080/09658211.2013.870209

[26]

Robert R McCrae, John E Kurtz, Shinji Yamagata, and Antonio Terracciano. 2011. Internal Consistency, Retest Reliability, and Their Implications for Personality Scale Validity. Personality and Social Psychology Review 15, 1 (2011), 28–50. https://doi.org/10.1177/1088868310366253

[27]

Elisa D. Mekler, Julia Ayumi Bopp, Alexandre N. Tuch, and Klaus Opwis. 2014. A systematic review of quantitative studies on the enjoyment of digital entertainment games. In Proceedings of the SIGCHI conference on human factors in computing systems. 927–936. https://doi.org/10.1145/2556288.2557078

Digital Library

[28]

Julia Müller, Max Sprenger, Tobias Franke, Paul Lukowicz, Claudia Reidick, and Marc Herrlich. 2020. Game of TUK: deploying a large-scale activity-boosting gamification project in a university context. In Proceedings of the Conference on Mensch und Computer(MuC ’20). Association for Computing Machinery, New York, NY, USA, 169–172. https://doi.org/10.1145/3404983.3410008

Digital Library

[29]

Anke Verena Reinschluessel, Joern Teuber, Marc Herrlich, Jeffrey Bissel, Melanie van Eikeren, Johannes Ganser, Felicia Koeller, Fenja Kollasch, Thomas Mildner, Luca Raimondo, Lars Reisig, Marc Ruedel, Danny Thieme, Tobias Vahl, Gabriel Zachmann, and Rainer Malaka. 2017. Virtual Reality for User-Centered Design and Evaluation of Touch-free Interaction Techniques for Navigating Medical Images in the Operating Room. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’17). ACM, New York, NY, USA, 2001–2009. https://doi.org/10.1145/3027063.3053173 event-place: Denver, Colorado, USA.

Digital Library

[30]

Katja Rogers, Maximilian Milo, Michael Weber, and Lennart E Nacke. 2020. The Potential Disconnect between Time Perception and Immersion: Effects of Music on VR Player Experience. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 414–426. https://doi.org/10.1145/3410404.3414246

Digital Library

[31]

R.M. Ryan, V. Mims, and R. Koestner. 1983. Relation of reward contingency and interpersonal context to intrinsic motivation: A review and test using cognitive evaluation theory. Journal of Personality and Social Psychology 45, 4(1983), 736–750. https://doi.org/10.1037/0022-3514.45.4.736

[32]

Richard M. Ryan and Edward L. Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American psychologist 55, 1 (2000), 68. https://doi.org/10.1037/0003-066X.55.1.68

[33]

Richard M. Ryan, C. Scott Rigby, and Andrew Przybylski. 2006. The motivational pull of video games: A self-determination theory approach. Motivation and emotion 30, 4 (2006), 344–360. https://doi.org/10.1007/s11031-006-9051-8

[34]

Karin Schermelleh-Engel, Helfried Moosbrugger, Hans Müller, 2003. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of psychological research online 8, 2 (2003), 23–74.

[35]

Jan David Smeddinck, Marc Herrlich, and Rainer Malaka. 2015. Exergames for Physiotherapy and Rehabilitation: A Medium-term Situated Study of Motivational Aspects and Impact on Functional Reach. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 4143–4146. https://doi.org/10.1145/2702123.2702598 event-place: Seoul, Republic of Korea.

Digital Library

[36]

April Tyack and Peta Wyeth. 2021. ” The Small Decisions Are What Makes it Interesting” Autonomy, Control, and Restoration in Player Experience. Proceedings of the ACM on Human-Computer Interaction 5, CHI PLAY(2021), 1–26. https://doi.org/10.1145/3474709

Digital Library

[37]

Josef Wiemeyer, Lennart Nacke, Christiane Moser, and Florian ‘Floyd’ Mueller. 2016. Player Experience. Springer International Publishing, Cham, 243–271. https://doi.org/10.1007/978-3-319-40612-1_9

[38]

Matthias Wilde, Katrin Bätz, Anastassiya Kovaleva, and Detlef Urhahne. 2009. Überprüfung einer Kurzskala intrinsischer Motivation (KIM). Zeitschrift für Didaktik der Naturwissenschaften 15 (2009). https://pub.uni-bielefeld.de/record/2404161

[39]

Adriana Zaiţ and PSPE Bertea. 2011. Methods for Testing Discriminant Validity. Management & Marketing Journal 9, 2 (2011), 217–224.

Cited By

Herren SSeebacher BMildner SRiederer YPachmann UBöckler NNiedecken SSgandurra SBonati LHotz ISchättin AJurt RBrenneis CLenfert KBehrendt FSchmidlin SNacke LSchuster-Amft CMartin-Niedecken A(2025)Exergame (ExerG)-Based Physical-Cognitive Training for Rehabilitation in Adults With Motor and Balance Impairments: Usability StudyJMIR Serious Games10.2196/6651513(e66515-e66515)Online publication date: 14-Feb-2025
https://doi.org/10.2196/66515
Liszio SBäuerlein FHildebrand Jvan Nahl CMasuch MBasu O(2024)Cooperative Virtual Reality Gaming for Anxiety and Pain Reduction in Pediatric Patients and their Caregivers during Painful Medical Procedures: Research Protocol for a Randomized Control Trial (Preprint)JMIR Research Protocols10.2196/63098Online publication date: 8-Jul-2024
https://doi.org/10.2196/63098
Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Show More Cited By

Index Terms

Development and Validation of a German Version of the Player Experience Inventory (PXI)
1. General and reference
  1. Cross-computing tools and techniques
    1. Validation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI design and evaluation methods

Recommendations

miniPXI: Development and Validation of an Eleven-Item Measure of the Player Experience Inventory
CHI PLAY

Questionnaires are vital in games user research (GUR) to assess player experience (PX). However, having too many questions in surveys prevents wider uptake among GUR professionals because of games' rapid production cycles. To address this issue, we ...
The Player Experience Inventory Bench: Providing Games User Researchers Actionable Insight into Player Experiences
CHI PLAY '20: Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play

In this paper, we present PXI Bench, an online tool to provide actionable insight into the player experience, designed by and for games user researchers. Based on the Player Experience Inventory (PXI), it provides detailed information about the baseline ...
Development and validation of the player experience inventory: A scale to measure player experiences at the level of functional and psychosocial consequences
Highlights
- Scale to measure player experience at functional and psychosocial level concurrently.
Abstract
Games User Research (GUR) focuses on measuring, analysing and understanding player experiences to optimise game designs. Hence, GUR experts aim to understand how specific game design choices are experienced by players, and how these ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '22: Proceedings of Mensch und Computer 2022

September 2022

624 pages

ISBN:9781450396905

DOI:10.1145/3543758

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MuC '22

MuC '22: Mensch und Computer 2022

September 4 - 7, 2022

Darmstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
259
Total Downloads

Downloads (Last 12 months)76
Downloads (Last 6 weeks)14

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Herren SSeebacher BMildner SRiederer YPachmann UBöckler NNiedecken SSgandurra SBonati LHotz ISchättin AJurt RBrenneis CLenfert KBehrendt FSchmidlin SNacke LSchuster-Amft CMartin-Niedecken A(2025)Exergame (ExerG)-Based Physical-Cognitive Training for Rehabilitation in Adults With Motor and Balance Impairments: Usability StudyJMIR Serious Games10.2196/6651513(e66515-e66515)Online publication date: 14-Feb-2025
https://doi.org/10.2196/66515
Liszio SBäuerlein FHildebrand Jvan Nahl CMasuch MBasu O(2024)Cooperative Virtual Reality Gaming for Anxiety and Pain Reduction in Pediatric Patients and their Caregivers during Painful Medical Procedures: Research Protocol for a Randomized Control Trial (Preprint)JMIR Research Protocols10.2196/63098Online publication date: 8-Jul-2024
https://doi.org/10.2196/63098
Krekhov AEmmerich KDemay LKrüger J(2024)Clothing Sounds in Games: Generation Procedure and Impact on Player ExperienceProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685378(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685378
Emmerich KKrekhov AKrüger J(2024)Playing for a Better Future: How Animal Avatars Influence the Attitude of PlayersProceedings of the ACM on Human-Computer Interaction10.1145/36770968:CHI PLAY(1-25)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677096
Graf LEmmerich KLiszio SMasuch M(2024)The Impact of Emotional Virtual Characters on Emotional State and Player Experience in VR Horror GamesProceedings of the 19th International Conference on the Foundations of Digital Games10.1145/3649921.3649942(1-13)Online publication date: 21-May-2024
https://dl.acm.org/doi/10.1145/3649921.3649942
Perrig SScharowski NBrühlmann Fvon Felten NOpwis KAeschbach L(2024)Independent Validation of the Player Experience Inventory: Findings from a Large Set of Video Game PlayersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642270(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642270
Küntzer LSchwab SSpaderna HRock G(2024)Measuring User Experience of Older Adults during Virtual Reality Exergaming2024 16th International Conference on Quality of Multimedia Experience (QoMEX)10.1109/QoMEX61742.2024.10598263(153-159)Online publication date: 18-Jun-2024
https://doi.org/10.1109/QoMEX61742.2024.10598263
Wiemeyer J(2024)Serious GamesSports Technology10.1007/978-3-662-68703-1_22(207-215)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-662-68703-1_22
Hirsch LMüller FChiossi FBenga TButz A(2023)My Heart Will Go On: Implicitly Increasing Social Connectedness by Visualizing Asynchronous Players’ Heartbeats in VR GamesProceedings of the ACM on Human-Computer Interaction10.1145/36110577:CHI PLAY(976-1001)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611057
Schabert GSchubhan MSchmitz MAltmeyer M(2023)Faster, Harder? Investigating the Impact of Changing Background Music Speed on Gameplay Performance and Player Experience in an Endless Runner GameCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616085(114-119)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616085
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten