Abstract
In-process assessment of trainee learners in game-based simulators is a challenging activity. This typically involves human instructor time and cost, and does not scale to the one tutor per learner vision of computer-based learning. Moreover, evaluation from a human instructor is often subjective and comparisons between learners are not accurate. Therefore, in this paper, we propose an automated, formula-driven quantitative evaluation method for assessing performance competence in serious training games. Our proposed method has been empirically validated in a game-based driving simulator using 7 subjects and 13 sessions, and accuracy up to 90.25% has been achieved when compared to an existing qualitative method. We believe that by incorporating quantitative evaluation methods like these future training games could be enriched with more meaningful feedback and adaptive game-play so as to better monitor and support player motivation, engagement and learning performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ritterfeld, U., Cody, M., Vorderer, P.: Serious Games: Explication of an Oxymoron: Introduction. In: Ritterfeld, U., Cody, M., Vorderer, P. (eds.) Serious Games: Mechanics and Effects, pp. 3–9. Routledge, New York (2009)
Ertmer, P., Newby, T.: Behaviorism, cognitivism, constructivism: comparing critical features from an instructional design perspective. Performanc. Improvement Quarterly 6(4), 50–72 (1993)
Goel, L., Johnson, N., Junglas, I., Ives, B.: Situated Learning: Conceptualization and Measurement. Decision Sciences Journal of Innovative Education 8(1), 215–240 (2010)
Clark, D.: Bloom’s Taxonomy of Learning Domains: The Three Types of Learning, http://www.skagitwatershed.org/~donclark/hrd/bloom.html
Perkins, D.N., Salomon, G.: Transfer of learning. In: International Encyclopedia of Education, 2nd edn. Pergamon Press, Oxford (1992)
Brennecke, A.: A General Framework for Digital Game-Based Training Systems. Doctoral thesis, University of Rostock (2009)
Backlund, P., Engström, H., Johannesson, M., Lebram, M.: Games for traffic education: An experimental study in a game-based driving simulator. Simulation & Gaming 41(2) (2010), doi:10.1177/1046878107311455
Mitchell, A., Savill-Smith, C.: The use of computer and video games for learning: A review of the literature. In: Learning and Skills Development Agency, London, pp. 1–93 (2004)
Ratan, R., Ritterfeld, U.: Serious Games: Explication of an Oxymoron: Classifying Serious Games. In: Ritterfeld, U., Cody, M., Vorderer, P. (eds.) Serious Games: Mechanics and Effects, pp. 10–24. Routledge, New York (2009)
Hsu, J.: Video Games and Control Dreams, Study Suggests, http://www.livescience.com/culture/video-games-control-dreams-100525.html
Piselli, P., Claypool, M., Doyle, J.: Relating Cognitive Models of Computer Games to User Evaluations of Entertainment. In: 4th International Conference on Foundations of Digital Games, Orlando, Florida (2009)
Hudlicka, E.: Affective Game Engines: Motivation and Requirements. In: 4th International Conference on Foundations of Digital Games, Orlando, Florida (2009)
Carini, R.M., Kuh, G.D., Klein, S.P.: Student Engagement and Student Learning: Testing the Linkages. Research in Higher Education 47(1), 1–32 (2006)
Backlund, P., Engstrom, H., Hammar, C., Johannesson, M., Lebram, M.: Sidh - a Game Based Firefighter Training Simulation. In: 11th International Conference Information Visualization (IV 2007), pp. 899–907 (2007)
Backlund, P., Engström, H., Johannesson, M., Lebram, M., Sjödén, B.: Designing for self-efficacy in a game based simulator: An experimental study and its implications for serious games design. In: Bannatyne, M., et al. (eds.) Vis 2008, London, UK, pp. 106–113 (2008), ISBN: 978-0-7695-3271-4
Gee, J.P.: Theories and Mechanisms: Deep Learning Properties of Good Digital Games: How Far Can They Go? In: Ritterfeld, U., Cody, M., Vorderer, P. (eds.) Serious Games: Mechanics and Effects, pp. 67–82. Routledge, New York (2009)
Gibbs, G., Habeshaw, T.: Preparing to Teach: An Introduction to Effective Teaching in Higher Education. Technical and Educational Services Ltd., Bristol (1992)
Bayliss, J.D., Schwartz, D.I.: Instructional Design as Game Design. In: 4th International Conference on Foundations of Digital Games, Orlando, Florida (2009)
Graesser, A., Chipman, P., Leeming, F., Biedenbach, S.: Theories and Mechanisms: Deep Learning and Emotion in Serious Games. In: Ritterfeld, U., Cody, M., Vorderer, P. (eds.) Serious Games: Mechanics and Effects, pp. 83–102. Routledge, New York (2009)
Eck, R.V.: Digital Game-Based Learning: It’s Not Just the Digital Natives Who Are Restless. EDUCAUSE Review 41(2), 16–30 (2006)
Debul, P.: Game on!: Game-based learning. T.H.E. Journal 33(6), 41, 30–33, http://www.thejournal.com/articles/17788
Picard, R., Papert, S., Bender, W., Blumberg, B., Breazeal, C., Cavallo, D., et al.: Affective learning: A manifesto. BT Technology Journal 22(4), 253–264 (2004)
Hidi, S., Harackiewicz, J.M.: Motivating the academically unmotivated: A critical issue for the 21st century. Review of Educational Research 70(2), 151–179 (2000)
Gilleade, K.M., Dix, A., Allanson, J.: Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me. In: DiGRA 2005, Vancouver, BC, Canada (2005)
Bersak, D., McDarby, G., Augenblick, N., McDarby, P., McDonnell, D., MdDonald, B., Karkun, R.: Intelligent Biofeedback using an Immersive Competitive Environment. In: Designing Ubiquitous Computing Games Workshop at UbiComp 2001, Atlanta, GA, USA (2001)
Kim, J., Bee, N., Wagner, J., André, E.: Emote to win: affective interactions with a computer game agent. In: GI Jahrestagung, vol. (1), pp. 159–164 (2004)
Fairclough, S.H.: Psychophysiological Inference and Physiological Computer Games. In: Brainplay 2007: Brain-Computer Interfaces and Games. Advances in Computer Entertainment, Salzburg, Austria (2007)
Elliot, A.J., Church, M.A.: A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology 72(1), 218–232 (1997)
VDrift.net, http://vdrift.net/
Transana version 2.42, http://www.transana.org/
MATLAB version 7.6.0. Natick. The MathWorks Inc., Massachusetts (2003)
Ekanayake, H., Backlund, P., Ziemke, T., Ramberg, R., Hewagamage, K.: Game Interaction State Graphs for Evaluation of User Engagement in Explorative and Experience-based Training Games. In: International Conference on Advances in ICT for Emerging Regions (ICTer), Colombo, Sri Lanka (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ekanayake, H., Backlund, P., Ziemke, T., Ramberg, R., Hewagamage, K. (2011). Assessing Performance Competence in Training Games. In: D’Mello, S., Graesser, A., Schuller, B., Martin, JC. (eds) Affective Computing and Intelligent Interaction. ACII 2011. Lecture Notes in Computer Science, vol 6975. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24571-8_65
Download citation
DOI: https://doi.org/10.1007/978-3-642-24571-8_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24570-1
Online ISBN: 978-3-642-24571-8
eBook Packages: Computer ScienceComputer Science (R0)