Abstract
Intelligent tutoring systems have achieved demonstrable success in supporting formal problem solving. More recently such systems have begun incorporating student explanations of problem solutions. Typically, these natural language explanations are entered with menus, but some ITSs accept open-ended typed inputs. Typed inputs require more work by both developers and students and evaluations of the added value for learning outcomes has been mixed. This paper examines whether typed input can yield more accurate student modeling than menu-based input. This paper examines the application of Knowledge Tracing student modeling to natural language inputs and examines the standard Knowledge Tracing definition of errors. The analyses indicate that typed explanations can yield more predictive models of student test performance than menu-based explanations and that focusing on semantic errors can further improve predictive accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4, 167–207 (1995)
Koedinger, K., Anderson, J., Hadley, W., Mark, M.: Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education 8, 30–43 (1997)
VanLehn, K., Lynch, C., Schulze, K., Shapiro, J.A., Shelby, R., Taylor, L., Treacy, D., Weinstein, A., Wintersfill, M.: The Andes Physics Tutoring System: Five years of evaluations. In: Proceedings of AIED 2005: The 12th International Conference on Artificial Intelligence and Education, pp. 678–685 (2005)
Atkinson, R., Derry, S., Renkl, A., Worthman, D.: Learning from examples: Instructional principles from the worked examples research. Review of Educational Research 70, 181–214 (2000)
Chi, M.T.H., Bassok, M., Lewis, M., Reimann, P., Glaser, R.: Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science 13, 145–182 (1989)
Conati, C., VanLehn, K.: Toward computer-based support for meta-cognitive skills: A computational framework to coach self-explanation. International Journal of Artificial Intelligence in Education 11, 398–415 (2000)
Aleven, V.A., Koedinger, K.R.: An effective metacognitive strategy: Learning by doing and explaining with a computer-based Cognitive Tutor. Cognitive Science 26, 147–179 (2002)
Graesser, A.C., Person, N., Harter, D.: Teaching tactics and dialog in AutoTutor. International Journal of Artificial Intelligence in Education 12, 257–279 (2001)
Rose, C.P., Jordan, P.W., Ringenberg, M., Siler, S., Vanlehn, K., Weinstein, A.: Interactive conceptual tutoring in Atlas-Andes. In: Proceedings of AIED 2001: The 10th International Conference on Aritifical Intelligence and Education, pp. 256–266 (2001)
Khuwaja, R.A., Evens, M.W., Michael, J.A., Rovick, A.A.: Architecture of CIRCSIM-tutor. In: Proceedings of the 7th Annual IEEE Computer-Based Medical Systems Symposium, vol. 3, pp. 158–163 (1994)
Zinn, C., Moore, J., Core, M.: A three-tier planning architecture for managing tutorial dialogue. In: Proceedings of the 6th International Intelligent Tutoring Systems Conference, pp. 574–584 (2002)
Aleven, V., Koedinger, K.R., Popescu, O.: A tutorial dialogue system to support self-explanation: Evaluation and open questions. In: Proceedings of AIED 2003: The 11th International Conference on Artificial Intelligence and Education, pp. 39–46 (2003)
Arroyo, I., Woolf, B.P.: Inferring learning and attitudes from a Bayesian Network of log file data. In: Proceedings of AIED 2005: The 12th International Conference on Artificial Intelligence and Education, pp. 33–40 (2005)
Conati, C., Gertner, A., VanLehn, K.: Using Bayesian networks to manage uncertainly in student modeling. User Modeling and User-Adapted Interaction 12(4), 371–417 (2002)
Corbett, A.T., Anderson, J.R.: Knowledge Tracing: Modeling the Acquisition of Procedural Knowledge. User Modeling and User-Adapted Interaction 4, 253–278 (1995)
Shute, V.: SMART Evaluation: Cognitive diagnosis, mastery learning & remediation. In: Proceedings of AIED 1995: The 7th World Conference on Artificial Intelligence and Education, pp. 125–130 (1995)
Corbett, A., Wagner, A., Raspat, J.: The Impact of analysing example solutions on problem solving in a pre-algebra tutor. In: Proceedings of AIED 2003: The 11th International Conference on Artificial Intelligence and Education, pp.133–140 (2003)
Corbett, A.T., Wagner, A., Lesgold, S., Ulrich, H., Stevens, S.: The impact on learning of generating vs. selecting descriptions in analyzing algebra example solutions. In: Proceedings of the 7th International Conference of the Learning Sciences, pp. 99–105 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Corbett, A., Wagner, A., Lesgold, S., Ulrich, H., Stevens, S. (2007). Modeling Students’ Natural Language Explanations. In: Conati, C., McCoy, K., Paliouras, G. (eds) User Modeling 2007. UM 2007. Lecture Notes in Computer Science(), vol 4511. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73078-1_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-73078-1_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73077-4
Online ISBN: 978-3-540-73078-1
eBook Packages: Computer ScienceComputer Science (R0)