Skip to main content
Log in

Developing a cognitive evaluation method for serious game engineers

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Serious game is an application that has been recently designed for a specific purpose in areas such as education, healthcare, management, and engineering with the core components in games. There have been recent attempts to evaluate the effects of serious games through cognitive aspects used in empirical research, yet there are struggles for application designers to apply these cognitive neuroscientific principles to validate their proposed programs. In this paper, simple tools in cognitive psychology are introduced for analyzing serious game designs through empirical testing. The experiment is designed to investigate the effects of a tangible walking game on attention, memory, and emotion. Results revealed that the group that directly played the tangible walking game showed a slightly better performance on word recall than the control group that just watched the game. We are proposing, in this paper, an experimental method for validating a tangible walking game that can be potentially applied to other serious games. A cognitive evaluation procedure has been developed showing how to exploit simple empirical testing to validate the effectiveness of the proposed tangible game through the cognitive aspects of information processing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Lee, D., Lee, H., Park, D., Jeong, Y.-S.: Proxy based seamless connection management method in mobile cloud computing. Clust. Comput. (2013). doi:10.1007/s10586-013-0249-8

    Google Scholar 

  2. Kim, J.-M., Jeong, H.-Y., Cho, I., Kang, S.M., Park, J.H.: A secure smart-work service model based OpenStack for cloud computing. Clust. Comput. (2013). doi:10.1007/s10586-013-0251-1

    Google Scholar 

  3. Badrinath, B.R., Phatak, S.H.: On clustering in database servers for supporting mobile clients. Clust. Comput. 1, 149–159 (1998)

    Article  Google Scholar 

  4. Abt, C.C.: Serious games. University Press of America, Lanham (1987)

    Google Scholar 

  5. Abdelkhalek, A., Bilas, A., Moshovos, A.: Behavior and performance of interactive multi-player game servers. Clust. Comput. 6, 355–366 (2003)

    Article  Google Scholar 

  6. Ramakrishna, V., Robinson, M., Eustice, K., Reiher, P.: An active self-optimizing multiplayer gaming architecture. Clust. Comput. 9, 201–215 (2006)

    Article  Google Scholar 

  7. Gamberini, L., Barresi, G., Majer, A., Scarpetta, F., Piaget, I.: A game a day keeps the doctor away: a short review of computer games in mental. Computer 1, 127–145 (2005)

    Google Scholar 

  8. Huang, W.-H.D., Tettegah, S.: Cognitive load and empathy in serious games: a conceptual framework. In: Gaming and Cognition, p. 15. IGI Global (2010). doi:10.4018/978-1-61520-717-6.ch006

    Google Scholar 

  9. Wong, W.L., Shen, C., Nocera, L., Carriazo, E., Tang, F., Bugga, S., Narayanan, H., Wang, H., Ritterfeld, U.: Serious video game effectiveness. In: Proceedings of the International Conference on Advances in Computer Entertainment Technology—ACE ’07, p. 49. ACM, New York (2007)

    Chapter  Google Scholar 

  10. Hausdorff, J.M., Yogev, G., Springer, S., Simon, E.S., Giladi, N.: Walking is more like catching than tapping: gait in the elderly as a complex cognitive task. Exp. Brain Res. Exp. Hirnforsch. Exp. Cérébr. 164, 541–548 (2005)

    Article  Google Scholar 

  11. Kim, K., Oh, S., Ahn, J., Lee, S.: Development of a walking game for the elderly using controllers of hand buttons and foot boards. Comput. Games (2012). doi:10.1109/CGames.2012.6314569

    Google Scholar 

  12. Gunter, G.A., Kenny, R.F., Vick, E.H.: Taking educational games seriously: using the RETAIN model to design endogenous fantasy into standalone educational games. Educ. Technol. Res. Dev. 56, 511–537 (2007)

    Article  Google Scholar 

  13. Fan, J., Byrne, J., Worden, M.S., Guise, K.G., McCandliss, B.D., Fossella, J., Posner, M.I.: The relation of brain oscillations to attentional networks. J. Neurosci. 27, 6197–6206 (2007)

    Article  Google Scholar 

  14. Luck, S.J.: An introduction to event-related potentials and their neural origins. In: Luck, S.J. (ed.) An Introduction to the EventRelated Potential Technique, pp. 1–50. MIT Press, Cambridge (2005)

    Google Scholar 

  15. Kim, M.: Cognitive process to evaluate serious games for the elderly. Int. J. Contents 6. (2010)

  16. Bozoki, A., Radovanovic, M., Winn, B., Heeter, C., Anthony, J.C.: Effects of a computer-based cognitive exercise program on age-related cognitive decline. Arch. Gerontol. Geriatr. 57, 1–7 (2013)

    Article  Google Scholar 

  17. Owen, A.M., Hampshire, A., Grahn, J.A., Stenton, R., Dajani, S., Burns, A.S., Howard, R.J., Ballard, C.G.: Putting brain training to the test. Nature 465, 775–778 (2010)

    Article  Google Scholar 

  18. Baddeley, A.D., Hitch, G.J., Bower, G.H.: The psychology of learning and motivation. Psychol. Learn. Motiv. 52, 47–89 (1974)

    Article  Google Scholar 

  19. Conway, A.R., Cowan, N., Bunting, M.F.: The cocktail party phenomenon revisited: the importance of working memory capacity. Psychonomic Society, Inc. (2001)

  20. Vogel, E.K., McCollough, A.W., Machizawa, M.G.: Neural measures reveal individual differences in controlling access to working memory. Nature 438, 500–503 (2005)

    Article  Google Scholar 

  21. Weuve, J., Kang, J.H., Manson, J.E., Breteler, M.M.B., Ware, J.H., Grodstein, F.: Physical activity, including walking, and cognitive function in older women. JAMA J. Am. Med. Assoc. 292, 1454–1461 (2004)

    Article  Google Scholar 

  22. Plutchik, R.: A psychoevolutionary theory of emotions. Soc. Sci. Inf. 21, 529–553 (1982)

    Article  Google Scholar 

  23. Berkowitz, L., Harmon-Jones, E.: Toward an understanding of the determinants of anger. Emotion 4, 107–130 (2004)

    Article  Google Scholar 

  24. Picard, R.W.: Affective computing (2000)

  25. Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17, 124–129 (1971)

    Article  Google Scholar 

  26. Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatr. 25, 49–59 (1994)

    Article  Google Scholar 

  27. Laird, J.D.: Self-attribution of emotion: the effects of expressive behavior on the quality of emotional experience. J. Pers. Soc. Psychol. 29, 475–486 (1974)

    Article  Google Scholar 

  28. Cohen, J., Perlstein, W., Braver, T.: Temporal dynamics of brain activation during a working memory task. Nature 386, 604–608 (1997)

    Article  Google Scholar 

  29. Im-Bolter, N., Johnson, J., Pascual-Leone, J.: Processing limitations in children with specific language impairment: the role of executive function. Child Dev. 77, 1822–1841 (2006)

    Article  Google Scholar 

  30. Stroop, J.R.: Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643–662 (1935)

    Article  Google Scholar 

  31. Nystrom, L.E., Braver, T.S., Sabb, F.W., Delgado, M.R., Noll, D.C., Cohen, J.D.: Working memory for letters, shapes, and locations: fMRI evidence against stimulus-based regional organization in human prefrontal cortex. NeuroImage 11, 424–446 (2000)

    Article  Google Scholar 

  32. Trick, L.M., Enns, J.T.: Lifespan changes in attention: the visual search task. Cogn. Dev. 13, 369–386 (1998)

    Article  Google Scholar 

  33. Kwak, Y., Cho, D.: Usefulness of Seoul verbal learning test in differential diagnosis of Alzheimer’s disease and subcortical vascular dementia. J. Korean Neurological Assoc., 22–28 (2004)

  34. Lee, T., Lee, K., Lee, K., Choi, J., Kim, H.: Korea University Facial Expression Collection: KUEFC. Korea University, Seoul, Korea (2006)

  35. Lievesley, R., Wozencroft, M., Ewins, D.: The emotiv EPOC neuroheadset: an inexpensive method of controlling assistive technologies using facial expressions and thoughts? J. Assist. Technol. 5, 67–82 (2011)

    Google Scholar 

  36. Hwang, Y., Shin, W.-Y., Kim, J.: What i read on your face is my emotion: the effects of emiton on interpreting others’ facial expression. Korean J. Commun. Stud., 247–271 (2010)

  37. Mahncke, H.W., Connor, B.B., Appelman, J., Ahsanuddin, O.N., Hardy, J.L., Wood, R.A., Joyce, N.M., Boniske, T., Atkins, S.M., Merzenich, M.M.: Memory enhancement in healthy older adults using a brain plasticity-based training program: a randomized, controlled study. Proc. Natl. Acad. Sci. USA 103, 12523–12528 (2006)

    Article  Google Scholar 

  38. Hillman, C.H., Erickson, K.I., Kramer, A.F.: Be smart, exercise your heart: exercise effects on brain and cognition. Nat. Rev. Neurosci. 9, 58–65 (2008)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by Hoseo University’s world class 2030 project in 2011.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to KyungSik Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, S., Baik, Y., Nam, K. et al. Developing a cognitive evaluation method for serious game engineers. Cluster Comput 17, 757–766 (2014). https://doi.org/10.1007/s10586-013-0289-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-013-0289-0

Keywords

Navigation