Abstract
Validation of applied games is generally a lengthy and costly process, usually done after the game has (almost) been completed. This article argues that validation throughout the design process is vital for creating games that achieve their desired objective. It proposes a framework to integrate validation throughout the applied game design process. Iterative design and design fidelity levels form the foundation of the framework. In the framework four types of design fidelity (specifications, concepts, prototypes, and integrations) are linked to five types of validity (content, face, construct, concurrent and predictive validity), which lead to eight applicable validation tools and techniques. The framework is a starting point for further research into applied game validation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., Berta, R.: Assessment in and of serious games: an overview. Adv. Hum. Comput. Int. (2013). Article no. 136864
Graafland, M., Dankbaar, M., Mert, A., Lagro, J., De Wit-Zuurendonk, L., Schuit, S., Schaafstal, A., Schijven, M.: How to systematically assess serious games applied to health care. JMIR Serious Games 2, e11 (2014)
Mayer, I., Bekebrede, G., Harteveld, C., Warmelink, H., Zhou, Q., van Ruijven, T., Lo, J., Kortmann, R., Wenzler, I.: The research and evaluation of serious games: toward a comprehensive methodology. Br. J. Educ. Technol. 45, 502–527 (2014)
Sanchez, A., Cannon-Bowers, J., Bowers, C.: Establishing a science of game based learning. In: Cannon-Bowers, J., Bowers, C. (eds.) Serious Game Design and Development: Technologies for Training and Learning, pp. 290–304. IGI Global (2010)
Connolly, T., Stansfield, M., Hainey, T.: Towards the development of a games-based learning evaluation framework. In: Connolly, T., Stansfield, M., Boyle, L. (eds.) Games-Based Learning Advancements for Multi-sensory Human Computer Interfaces: Techniques and Effective Practices, pp. 251–273. IGI Global, Hershey (2009)
Kriz, W.C., Hense, J.U.: Theory-oriented evaluation for the design of and research in gaming and simulation. Simul. Gaming 37, 268–283 (2006)
Feinstein, A.H., Cannon, H.M.: Constructs of simulation evaluation. Simul. Gaming 33, 425–440 (2002)
Mueller, R., Thoring, K.: Design thinking vs. lean startup: a comparison of two user-driven innovation strategies. Presented at the 2012 International Design Management Research Conference, Boston, MA, 8 August (2012)
Kelley, T., Littman, J.: The Art of Innovation: Lessons in Creativity from IDEO. America’s Leading Design Firm. Random House, New York (2001)
Kelley, T., Littman, J.: The Ten Faces of Innovation: IDEO’s Strategies for Defeating the Devil’s Advocate and Driving Creativity Throughout Your Organization. Random House, New York (2005)
American Educational Research Association, American Psychological Association, National Council on Measurement in Education: Standards for Educational and Psychological Testing. American Educational Research Association, Washington, D.C. (1999)
Saffer, D.: Designing for Interaction: Creating Innovative Applications and Devices. New Riders, Berkeley (2010)
De Freitas, S., Oliver, M.: How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Comput. Educ. 46, 249–264 (2006)
Marne, B., Wisdom, J., Huynh-Kim-Bang, B., Labat, J.-M.: The six facets of serious game design: a methodology enhanced by our design pattern library. In: Ravenscroft, A., Lindstaedt, S., Kloos, C.D., Hernández-Leo, D. (eds.) EC-TEL 2012. LNCS, vol. 7563, pp. 208–221. Springer, Heidelberg (2012)
Harteveld, C., Guimaraes, R., Mayer, I.S., Bidarra, R.: Balancing play, meaning and reality: the design philosophy of LEVEE PATROLLER. Simul. Gaming 41, 316–340 (2010)
Harteveld, C.: Triadic Game Design: Balancing Reality, Meaning and Play. Springer-Verlag, London (2011)
Rooney, P.: A theoretical framework for serious game design: exploring pedagogy, play and fidelity and their implications for the design process. Int. J. Game-Based Learn. 2, 41–60 (2012)
Dondlinger, M.J.: Educational video game design: a review of the literature. J. Appl. Educ. Technol. 4, 21–31 (2007)
Charsky, D.: From edutainment to serious games: a change in the use of game characteristics. Games Cult. 5, 177–198 (2010)
Annetta, L.A.: The “I’s” have it: a framework for serious educational game design. Rev. Gen. Psychol. 14, 105–112 (2010)
Kato, P.M., Cole, S.W., Bradlyn, A.S., Pollock, B.H.: A video game improves behavioral outcomes in adolescents and young adults with cancer: a randomized trial. Pediatrics 122, e305–e317 (2008)
Shute, V.J., Ventura, M., Bauer, M., Zapata-Rivera, D.: Melding the power of serious games and embedded assessment to monitor and foster learning. In: Ritterfeld, U., Cody, M., Vorderer, P. (eds.) Serious Games: Mechanisms and Effects, pp. 295–321. Routledge, New York (2009)
Shute, V.J., Ventura, M.: Stealth Assessment: Measuring and Supporting Learning in Video Games. The MIT Press, Cambridge (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Warmelink, H., Valente, M., van Tol, R., Schravenhoff, R. (2016). Get It Right! Introducing a Framework for Integrating Validation in Applied Game Design. In: De Gloria, A., Veltkamp, R. (eds) Games and Learning Alliance. GALA 2015. Lecture Notes in Computer Science(), vol 9599. Springer, Cham. https://doi.org/10.1007/978-3-319-40216-1_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-40216-1_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40215-4
Online ISBN: 978-3-319-40216-1
eBook Packages: Computer ScienceComputer Science (R0)