skip to main content
10.1145/1536513.1536575acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfdgConference Proceedingsconference-collections
extended-abstract

Level up: a frame work for the design and evaluation of educational games

Published: 26 April 2009 Publication History

Abstract

Games have the potential to transform the educational system in the United States. However, the study of games has lacked a coherent research paradigm. In order for games to research their full positional, there is a need to have a scientific way to evaluate the effectiveness of games and interactive environments for learning. In this paper, we discuss current research into the empirical evaluation of games; we use methods from the Intelligent Tutoring System literature to evaluate an educational computer science game. We do this by mapping empirical learning curves on student game-log data. We believe the results of this type of analysis can help evaluate and improve educational video game research.

References

[1]
Anderson, J. R., Conrad, F. G., Corbett, A. T. Skill Acquisition and the LISP Tutor. Cognitive Science, 13 (1989), 467--505.
[2]
Baker, R. S. J. D. Habgood, M. P. J. Ainsworth, S. E. Corbett, A. T. Modeling the Acquisition of Fluent Skill in Educational Action Games. Lecture Notes in Computer Science, NUMB 4511, 17--26
[3]
Barnes, T., E. Powell, A. Chaffin, H. Lipford. Game2Learn: Improving the engagement and motivation of CS1 students. In ACM GDCSE'08.
[4]
Beauboeuf, T & J. Mason. Why the high attrition rate for computer science students: some thoughts and observations. SIGCSE Bull. 37, 2 (Jun. 2005), 103--106.
[5]
Pittsburgh Science of Learning Center (PSLC) Data Shop http://www.learnlab.org/technologies/datashop/ (Dec 2008)
[6]
Eagle, M. & T. Barnes. Experimental Evaluation of an Educational Game for Improved Learning in Introductory Computing. To appear in SIGCSE 2009. Knoxville, TN.
[7]
Gee, J. P. What video games have to teach us about learning and literacy. Comput. Entertain. 1, 1 (Oct. 2003), 20.
[8]
Hunicke, R., Robison, A., Squire, K., and Steinkuehler, C. Games, learning and literacy. Sandbox 2006. ACM Press, New York, NY, 19--19.
[9]
Martin, B., Koedinger, K., Mitrovic, A., Mathan, S. On Using Learning Curves to Evaluate ITS. Proceedings of the 12th International Conference on Artificial Intelligence in Education (AIED-2005), 419--426.
[10]
Prensky, M. 2003. Digital game-based learning. Comput. Entertain. 1, 1 (Oct. 2003), 21--21.
[11]
Rodrigo, M. M. T., Baker, R. S. J. d., Lagud, M. C. V., Lim, S. A. L., Macapanpan, A. F., Pascua, S. A. M. S., Santillano, J. Q., Sevilla, L. R. S., Sugay, J. O., Tep, S., Viehland, N. J. B.: Affect and usage choices in simulation problem solving environments. Artificial Intelligence in Education, pp. 145--152. Marina del Rey, CA (2007)
[12]
Steinkuehler, C. Learning in massively multiplayer online games. In Proc. Intl. Conf. Learning Sciences, Santa Monica, CA, June 22--26, 2004, p. 521--528.
[13]
Squire, K. (2003). Video games in education. International Journal of Intelligent Simulations and Gaming, vol. 2, 49--62.
[14]
Zweben, S. 2003--2004 Taulbee Survey. Computing Research Association Taulbee Survey, May 2005.

Cited By

View all
  • (2020)sD&D: Design and Implementation of Cybersecurity Educational Game with Highly Extensible FunctionalityAdvances in Information and Communication10.1007/978-3-030-39445-5_62(857-873)Online publication date: 25-Feb-2020
  • (2018)Insights into Design of Educational Games: Comparative Analysis of Design ModelsProceedings of the Future Technologies Conference (FTC) 201810.1007/978-3-030-02686-8_78(1041-1061)Online publication date: 18-Oct-2018
  • (2014)BraillePlayProceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility10.1145/2661334.2661377(137-144)Online publication date: 20-Oct-2014
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
FDG '09: Proceedings of the 4th International Conference on Foundations of Digital Games
April 2009
386 pages
ISBN:9781605584379
DOI:10.1145/1536513
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • SASDG: The Society for the Advancement of the Science of Digital Games

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. educational data mining
  2. empirical evaluation
  3. games
  4. intelligent tutoring systems

Qualifiers

  • Extended-abstract

Conference

FDG '09
Sponsor:
  • SASDG

Acceptance Rates

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2020)sD&D: Design and Implementation of Cybersecurity Educational Game with Highly Extensible FunctionalityAdvances in Information and Communication10.1007/978-3-030-39445-5_62(857-873)Online publication date: 25-Feb-2020
  • (2018)Insights into Design of Educational Games: Comparative Analysis of Design ModelsProceedings of the Future Technologies Conference (FTC) 201810.1007/978-3-030-02686-8_78(1041-1061)Online publication date: 18-Oct-2018
  • (2014)BraillePlayProceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility10.1145/2661334.2661377(137-144)Online publication date: 20-Oct-2014
  • (2013)Evaluation of games for teaching computer scienceProceedings of the 8th Workshop in Primary and Secondary Computing Education10.1145/2532748.2532751(51-60)Online publication date: 11-Nov-2013
  • (2013)Art history concepts at play with ThIATROJournal on Computing and Cultural Heritage 10.1145/2460376.24603786:2(1-15)Online publication date: 24-May-2013
  • (2010)Design and evaluation of a Serious Game for immersive cultural training2010 16th International Conference on Virtual Systems and Multimedia10.1109/VSMM.2010.5665978(253-260)Online publication date: Oct-2010
  • (2010)Intelligent tutoring systems, educational data mining, and the design and evaluation of video gamesProceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part II10.1007/978-3-642-13437-1_23(215-217)Online publication date: 14-Jun-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media