Abstract
SimStudent is a machine-learning agent that learns cognitive skills by demonstration. It was originally developed as a building block of the Cognitive Tutor Authoring Tools (CTAT), so that the authors do not have to build a cognitive model by hand, but instead simply demonstrate solutions for SimStudent to automatically generate a cognitive model. The SimStudent technology could then be used to model human students’ performance as well. To evaluate the applicability of SimStudent as a tool for modeling real students, we applied SimStudent to a genuine learning log gathered from classroom experiments with the Algebra I Cognitive Tutor. Such data can be seen as the human students’ “demonstrations” of how to solve problems. The results from an empirical study show that SimStudent can indeed model human students’ performance. After training on 20 problems solved by a group of human students, a cognitive model generated by SimStudent explained 82% of the problem-solving steps performed correctly by another group of human students.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Greer, J.E., McCalla, G.: Student modelling: the key to individualized knowledge-based instruction, vol. x, p. 383. Springer-Verlag, Berlin, New York (1994)
Anderson, J.R., et al.: Cognitive tutors: Lessons learned. Journal of the Learning Sciences 4(2), 167–207 (1995)
Aleven, V., et al.: The Cognitive Tutor Authoring Tools (CTAT): Preliminary evaluation of efficiency gains. In: Ikeda, M., Ashley, K.D., Chan, T.W. (eds.) Proceedings of the 8th International Conference on Intelligent Tutoring Systems, pp. 61–70. Springer Verlag, Berlin (2006)
Matsuda, N., et al.: Applying Machine Learning to Cognitive Modeling for Cognitive Tutors, in Machine Learning Department Technical Report (CMU-ML-06-105), School of Computer Science, Carnegie Mellon University: Pittsburgh, PA (2006)
Muggleton, S., de Raedt, L.: Inductive Logic Programming: Theory and methods. Journal of Logic Programming 19-20(Supplement 1), 629–679 (1994)
Lau, T.A., Weld, D.S.: Programming by demonstration: an inductive learning formulation. In: Proceedings of the 4th international conference on Intelligent user interfaces, pp. 145–152. ACM Press, New York (1998)
Johnson, W.L., et al.: Integrating pedagogical agents into virtual environments. Presence 7(6), 523–546 (1998)
Baffes, P., Mooney, R.: Refinement-Based Student Modeling and Automated Bug Library Construction. Journal of Artificial Intelligence in Education 7(1), 75–116 (1996)
Merceron, A., Yacef, K.: A web-based tutoring tool with mining facilities to improve learning and teaching. In: Proceedings of the 11th International Conference on Artificial Intelligence in Education, Hoppe, U., Verdejo, F., Kay, J.(eds.), pp. 201–208 (2003)
Mertz, J.S.: Using A Simulated Student for Instructional Design. International Journal of Artificial Intelligence in Education 8, 116–141 (1997)
Koedinger, K.R., Corbett, A.: Cognitive Tutors: Technology Bringing Learning Sciences to the Classroom. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, pp. 61–78. Cambridge University Press, New York, NY (2006)
Matsuda, N., Cohen, W.W., Koedinger, K.R.: Applying Programming by Demonstration in an Intelligent Authoring Tool for Cognitive Tutors. In: AAAI Workshop on Human Comprehensible Machine Learning (Technical Report WS-05-04), AAAI association: Menlo Park, CA, pp. 1–8 (2005)
Friedman-Hill, E.: Jess in Action: Java Rule-based Systems, Greenwich, CT: Manning (2003)
Quinlan, J.R.: Learning Logical Definitions from Relations. Machine Learning 5(3), 239–266 (1990)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Matsuda, N., Cohen, W.W., Sewall, J., Lacerda, G., Koedinger, K.R. (2007). Evaluating a Simulated Student Using Real Students Data for Training and Testing\(^{\thanks{The research presented in this paper is supported by National Science Foundation Award No. REC-0537198.}}\) . In: Conati, C., McCoy, K., Paliouras, G. (eds) User Modeling 2007. UM 2007. Lecture Notes in Computer Science(), vol 4511. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73078-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-73078-1_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73077-4
Online ISBN: 978-3-540-73078-1
eBook Packages: Computer ScienceComputer Science (R0)