Skip to main content
SpringerLink
Log in

Evaluating Exertion Games

  • Chapter
  • First Online:
Evaluating User Experience in Games

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

Games that demand exertion of the players through bodily movements are experiencing increasing commercial success and have been attributed with many physical, mental and social benefits, thus changing the way we play computer games. However, there is a lack of understanding of how to evaluate such exertion games, mainly because the games’ facilitated bodily movements are believed to be responsible for these novel experiences, but are not considered in traditional evaluation methods that primarily assume keyboard- and gamepad-style input devices. We do not believe there is a generic approach to evaluating exertion games, and therefore offer an overview of our mixed experiences in using various methods to guide the reader for future evaluations in this domain. We support the presented methods with data from case studies we undertook in order to illustrate their use and what kinds of results to expect. Methods that we have not had experience with, but which also have the potential to address the contribution of bodily involvement to the user experience, are also outlined. By identifying remaining issues in regards to evaluation methods for exertion games, we aim to provide an informed way forward for research in this area. With our work, we hope to contribute towards the advancement of such games, fostering their many benefits towards a more positive user experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ambady N, Rosenthal R (1992) Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin 111: 256–274.

    Article  Google Scholar 

  • Argyle M (1988) Bodily Communication. Methuen, London.

    Google Scholar 

  • Bernhardt D, Robinson P (2008) Interactive control of music using emotional body expressions. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, ACM, New York.

    Google Scholar 

  • Bianchi-Berthouze N, Cairns P, Cox A, Jennett C, Kim WW (2006) On posture as a modality for expressing and recognizing emotions. Workshop on the Role of Emotion in HCI, HCI 2006.

    Google Scholar 

  • Bianchi-Berthouze N, Kim W, Patel D (2007) Does body movement engage you more in digital game play? and why? Affective Computing and Intelligent Interaction.

    Google Scholar 

  • Bianchi-Berthouze N, Kleinsmith A (2003) A categorical approach to affective gesture recognition. Connection Science 15: 259–269.

    Article  Google Scholar 

  • Bogost I (2005) The rhetoric of exergaming. Digital Arts and Cultures (DAC) Conference, Denmark.

    Google Scholar 

  • Borg G (1998) Borg’s Perceived Exertion and Pain Scales. Human Kinetics, Champaign, IL.

    Google Scholar 

  • Chen M, Kolko B, Cuddihy E, Medina E (2005) Modelling and measuring engagement in computer games. Presentation at the Annual Conference for the Digital Games Research Association (DiGRA), Vancouver, Canada.

    Google Scholar 

  • Clark R (2008) Seniors trump barriers in Wii bowling tourney. http://www.nj.com/sunbeam/index.ssf?/base/news-4/1222587621327110.xml&coll=9. Accessed 20 April 2009.

  • Clark M, Gronbegh E (1987) The effect of age, sex and participation in age group athletics on the development of trust in children. International Journal of Sport Psychology 18: 181–187.

    Google Scholar 

  • Csikszentmihalyi M (1990) Flow: The Psychology of Optimal Performance. Harper and Row, New York.

    Google Scholar 

  • De Silva PR, Bianchi-Berthouze N (2004) Modeling human affective postures: An information theoretic characterization of posture features. Computer Animation and Virtual Worlds 15: 269–276.

    Article  Google Scholar 

  • DeLorenzo M (2007) Wii sports experiment. http://wiinintendo.net/2007/01/15/wii-sports-experiment-results/. Accessed 20 April 2009.

  • Ekman P, Rosenberg EL (2005) What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System (FACS). Oxford University Press, New York.

    Book  Google Scholar 

  • Eriksson E, Hansen T, Lykke-Olesen A (2007) Movement-based interaction in camera spaces: A conceptual framework. Personal and Ubiquitous Computing 11: 621–632.

    Article  Google Scholar 

  • Graves L, Stratton G, Ridgers ND, Cable NT (2007) Comparison of energy expenditure in adolescents when playing new generation and sedentary computer games: Cross sectional study. British Medical Journal 335: 1282–1284.

    Article  Google Scholar 

  • Hart M (2003) Borg scale gets ‘thumbs up’. http://www.torq.ltd.uk/pfm_disp.asp?newsid=18. Accessed 20 April 2009.

  • Hero G (2009) Guitar Hero. http://guitarhero.com. Accessed 20 April 2009.

  • Hoysniemi J (2006) Design and evaluation of physically interactive games. Tampere University.

    Google Scholar 

  • Iso-Ahola SE, Hatfield BD (1986) Psychology of Sports: A Social Psychological Approach. Wm. C. Brown Publishers, Dubuque, IA.

    Google Scholar 

  • Lantz F (2006) Big games and the porous border between the real and the mediated. http://www.vodafone.com/flash/receiver/16/articles/indexinner07.html. Accessed 20 April 2009.

  • LeBlanc C (2008) Nintendo Wii fits in neurorehabilitation. http://72.14.235.132/search?q=cache:-AMXr3ZD4DAJ:healthcarereview.com/index.php%3Fsrc%3Dnews%26refno%3D2366%26category%3DCover%2520Story%26PHPSESSID%3D…+%22Nintendo+Wii+Fits+in+Neurorehabilitation%22&hl=en&ct=clnk&cd=2&gl=au. Accessed 20 April 2009.

    Google Scholar 

  • Lehrer J (2006) How the Nintendo Wii will get you emotionally invested in video games. Seedmagazine.com. Brain & Behavior. http://www.seedmagazine.com/news/2006/11/a_console_to_make_you_wiip.php. Accessed 20 April 2009.

  • Lieberman DA (2006) Dance games and other exergames: What the research says. http://www.comm.ucsb.edu/faculty/lieberman/exergames.htm. Accessed 20 April 2009.

  • Lindley SE, Le Couteur J, Berthouze NL (2008) Stirring up experience through movement in game play: Effects on engagement and social behaviour. In: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM, Florence, Italy.

    Google Scholar 

  • Lindley SE, Monk AF (2008) Social enjoyment with electronic photograph displays: Awareness and control. International Journal of Human-Computer Studies 66: 587–604.

    Article  Google Scholar 

  • Loke L, Larssen A, Robertson T, Edwards J (2007) Understanding movement for interaction design: Frameworks and approaches. Personal and Ubiquitous Computing 11: 691–701.

    Article  Google Scholar 

  • Lord C, Risi S, Lambrecht L, Cook EH, Leventhal BL, DiLavore PC, Pickles A, Rutter M (2000) The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders 30: 205–223.

    Article  Google Scholar 

  • Mandryk R, Atkins S, Inkpen K (2006) A continuous and objective evaluation of emotional experience with interactive play environments. In: CHI ’06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, New York.

    Google Scholar 

  • Mandryk RL, Inkpen KM (2004) Physiological indicators for the evaluation of co-located collaborative play, In: Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work, ACM, New York.

    Google Scholar 

  • McCarthy J, Wright P (2004) Technology as Experience. MIT Press, Boston, MA.

    Google Scholar 

  • Meeren HKM, van Heijnsbergen C, de Gelder B (2005) Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences 102: 16518–16523.

    Article  Google Scholar 

  • Moen J (2006) KinAesthetic movement interaction: Designing for the pleasure of motion. KTH, Numerical Analysis and Computer Science, Stockholm.

    Google Scholar 

  • Mueller F (2002) Exertion interfaces: Sports over a distance for social bonding and fun. Massachusetts Institute of Technology.

    Google Scholar 

  • Mueller F, Agamanolis S, Picard R (2003) Exertion interfaces: Sports over a distance for social bonding and fun. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, Ft. Lauderdale, FL.

    Google Scholar 

  • Mueller F, Gibbs M (2007a) A physical three-way interactive game based on table tennis. In: Proceedings of the 4th Australasian Conference on Interactive Entertainment, RMIT University, Melbourne, Australia.

    Google Scholar 

  • Mueller F, Gibbs M (2007b) Evaluating a distributed physical leisure game for three players. Conference of the Computer-Human Interaction Special Interest Group (CHISIG) of Australia on Computer-Human Interaction: OzCHI’07, ACM, Adelaide, Australia.

    Google Scholar 

  • Mueller F, Stevens G, Thorogood A, O’Brien S, Wulf V (2007) Sports over a distance. Personal and Ubiquitous Computing 11: 633–645.

    Article  Google Scholar 

  • Nenonen V, Lindblad A, Häkkinen V, Laitinen T, Jouhtio M, Hämäläinen P (2007) Using heart rate to control an interactive game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Press, New York.

    Google Scholar 

  • Palameta B, Brown WM (1999) Human cooperation is more than by-product mutualism. Animal Behaviour 57: 1–3.

    Article  Google Scholar 

  • Pasch M, Berthouze N, van Dijk EMAG, Nijholt A (2008) Motivations, strategies, and movement patterns of video gamers playing Nintendo Wii boxing. Facial and Bodily Expressions for Control and Adaptation of Games (ECAG 2008), Amsterdam, the Netherlands.

    Google Scholar 

  • Powell W (2008) Virtually walking? Developing exertion interfaces for locomotor rehabilitation. CHI 2008. Workshop submission to “Exertion Interfaces”.

    Google Scholar 

  • Ratey J (2008) Spark: The Revolutionary New Science of Exercise and the Brain. Little, Brown and Company, Boston, MA.

    Google Scholar 

  • Rocco E (1998) Trust breaks down in electronic contexts but can be repaired by some initial face-to-face contact. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co., New York.

    Google Scholar 

  • Salen K, Zimmerman E (2003) Rules of Play: Game Design Fundamentals. MIT Press, Cambridge, MA.

    Google Scholar 

  • Strauss A, Corbin J (1998) Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. SAGE Publications, Thousand Oaks, CA.

    Google Scholar 

  • Tan B, Aziz AR, Chua K, Teh KC (2002) Aerobic demands of the dance simulation game. International Journal of Sports Medicine 23: 125–129.

    Article  Google Scholar 

  • Wakkary R, Hatala M, Jiang Y, Droumeva M, Hosseini M (2008) Making sense of group interaction in an ambient intelligent environment for physical play. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, ACM, Bonn, Germany.

    Google Scholar 

  • Wankel LM (1985) Personal and situational factors affecting exercise involvement: The importance of enjoyment. Research Quarterly for Exercise and Sport 56: 275–282.

    Google Scholar 

  • Well-being Field Report (2009) http://nsg.jyu.fi/index.php/Well-being_Field_Report. Accessed 20 April 2009.

  • XRtainment (2009) XRtainment – Where working out is all play! http://www.xrtainmentzone.com/. Accessed 20 April 2009.

  • Zheng J, Bos N, Olson JS, Olson GM (2001) Trust without touch: Jump-start trust with social chat. Short Paper at the Conference on Human Factors in Computing Systems CHI-01, ACM, New York.

    Google Scholar 

  • Zheng J, Veinott E, Bos N, Olson JS, Olson GM (2002) Trust without touch: Jumpstarting long-distance trust with initial social activities. In: Proceedings of the Conference on Human Factors in Computing Systems, CHI-2002, ACM, New York, pp. 141–146.

    Google Scholar 

Download references

Acknowledgements

Some of the case studies presented in this chapter have been supported by the Marie Curie International Re-Integration Grant “AffectME” (MIRG-CT-2006-046434). The authors also wish to acknowledge the role of Media Lab Europe and the MIT Media Lab in supporting initial work on Breakout for Two, together with Stefan Agamanolis, Rosalind Picard and Ted Selker. Thanks also to the University of Melbourne and CSIRO Collaborative Research Support Scheme in supporting initial development work on Table Tennis for Three. Special thanks to Martin R. Gibbs and Frank Vetere in the Interaction Design Group at the University of Melbourne.

Author information

Authors and Affiliations

  1. Interaction Design Group, Department of Information Systems, The University of Melbourne, Melbourne, Australia

    Florian ‘Floyd’ Mueller

  2. UCLIC, University College London, London, UK

    Nadia Bianchi-Berthouze

Authors
  1. Florian ‘Floyd’ Mueller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nadia Bianchi-Berthouze
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Florian ‘Floyd’ Mueller .

Editor information

Editors and Affiliations

  1. Institut de Recherches en, Informatique de Toulouse (IRIT), Université Toulouse III, route de Narbonne 118, Toulouse CX 4, 31062, France

    Regina Bernhaupt

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Mueller, F.‘., Bianchi-Berthouze, N. (2010). Evaluating Exertion Games. In: Bernhaupt, R. (eds) Evaluating User Experience in Games. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-963-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-963-3_11

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-962-6

  • Online ISBN: 978-1-84882-963-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation