Abstract
Authoring Intelligent Tutoring Systems is expensive and time consuming. To reduce costs, the Cognitive Tutor Authoring Tools and the Example-Tracing Tutor paradigm were developed to make the tutor authoring process more efficient. Under this paradigm, tutors are constructed by demonstrating behavior directly in a tutor interface, reducing the need for programming expertise. This paper evaluates the efficiency of authoring a tutor with SimStudent, an extension to the Example-Tracing paradigm that is designed to produce greater generality in less time by induction from past demonstrations and feedback. We found that authoring an algebra tutor in SimStudent is faster than Example-Tracing while maintaining equivalent final model quality. Furthermore, we found that the SimStudent model generalizes beyond the problems that were used to author it.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Koedinger, K.R., Corbett, A.T.: Cognitive tutors: Technology bringing learning science to the classroom. The Cambridge Handbook of the Learning Sciences, 61–78 (2006)
Beal, C.R., Walles, R., Arroyo, I., Woolf, B.P.: On-line Tutoring for Math Achievement Testing: A Controlled Evaluation. Journal of Interactive Online Learning 6, 1–13 (2007)
Graesser, A.C., Vanlehn, K., Rose, C., Jordan, P.W., Harter, D.: Intelligent Tutoring Systems with Conversational Dialogue. AI Magazine 22(4), 39 (2001)
Koedinger, K.R., Anderson, J.R.: Intelligent Tutoring Goes To School in the Big City. International Journal of Artificial Intelligence in Education 8, 1–14 (1997)
Mitrovic, A., Martin, B., Mayo, M.: Using evaluation to shape ITS design: Results and experiences with SQL-Tutor. User Modeling and User-Adapted Interaction 12(2-3), 243–279 (2002)
Ritter, S., Anderson, J.R., Koedinger, K.R., Corbett, A.T.: Cognitive Tutor: Applied research in mathematics education. Psychonomic Bulletin & Review 14(2), 249–255 (2007)
Vanlehn, K.: The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems. Educational Psychologist 46(4), 197–221 (2011)
Murray, T.: An Overview of Intelligent Tutoring System Authoring Tools: Updated analysis of the state of the art. In: Murray, Ainsworth, Blessing (eds.) Authoring Tools for Advanced Technology Learning Environments, pp. 493–546. Kluwer Academic Publishers, Netherlands (2003)
Aleven, V., McLaren, B.M., Sewall, J., Koedinger, K.R.: The cognitive tutor authoring tools (CTAT): Preliminary evaluation of efficiency gains. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 61–70. Springer, Heidelberg (2006)
Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive Tutors: Lessons Learned. The Journal of Learning Sciences 4(2), 167–207 (1995)
Aleven, V., McLaren, B.M., Sewall, J., Koedinger, K.R.: Example-Tracing Tutors: A New Paradigm for Intelligent Tutoring Systems. International Journal of Artificial Intelligence in Education 19(2), 105–154 (2009)
Matsuda, N., Cohen, W.W., Koedinger, K.R.: Creating Cognitive Tutors by Tutoring. International Journal of Artificial Intelligence in Education
Card, S.K., Moran, T.P., Newell, A.: The keystroke-level model for user performance time with interactive systems. Communications of the ACM 23(7), 396–410 (1980)
Li, N., Cohen, W.W., Koedinger, K.R.: Problem Order Implications for Learning Transfer. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 185–194. Springer, Heidelberg (2012)
MacLellan, C.J., Matsuda, N., Koedinger, K.R.: Toward a reflective SimStudent: Using experience to avoid generalization errors. In: AIED Workshop on Simulated Learners (July 2013)
Li, N., Schreiber, A.J., Cohen, W.W., Koedinger, K.R.: Efficient Complex Skill Acquisition Through Representation Learning. Advances in Cognitive Systems 2, 149–166 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
MacLellan, C.J., Koedinger, K.R., Matsuda, N. (2014). Authoring Tutors with SimStudent: An Evaluation of Efficiency and Model Quality. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds) Intelligent Tutoring Systems. ITS 2014. Lecture Notes in Computer Science, vol 8474. Springer, Cham. https://doi.org/10.1007/978-3-319-07221-0_70
Download citation
DOI: https://doi.org/10.1007/978-3-319-07221-0_70
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07220-3
Online ISBN: 978-3-319-07221-0
eBook Packages: Computer ScienceComputer Science (R0)