Abstract
In this paper we evaluate the instructional effectiveness of tutorial dialogue agents in an exploratory learning setting. We hypothesize that the creative nature of an exploratory learning environment creates an opportunity for the benefits of tutorial dialogue to be more clearly evidenced than in previously published studies. In a previous study we showed an advantage for tutorial dialogue support in an exploratory learning environment where that support was administered by human tutors [9]. Here, using a similar experimental setup and materials, we evaluate the effectiveness of tutorial dialogue agents modeled after the human tutors from that study. The results from this study provide evidence of a significant learning benefit of the dialogue agents.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Aleven, V., Rosé, C.P.: Authoring plug-in tutor agents by demonstration: Rapid rapid tutor development. In: Proceedings of AI in Education (2005)
Bloom, B.S.: The 2 Sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher 13, 4–16 (1984)
Cohen, P.A., Kulik, J.A., Kulik, C.C.: Educational outcomes of tutoring: A meta-analysis of findings. American Educational Research Journal 19, 237–248 (1982)
Forbus, K.D., Whalley, P.B., Evrett, J.O., Ureel, L., Brokowski, M., Baher, J., Kuehne, S.E.: CyclePad: An Articulate Virtual Laboratory for Engineering Thermodynamics. Artificial Intelligence 114(1-2), 297–347 (1999)
Graesser, A., VanLehn, K.: the TRG, & the NLT, Why2 Report: Evaluation of Why/Atlas, Why/AutoTutor, and Accomplished Human Tutors on Learning Gains for Qualitative Physics Problems and Explanations, LRDC Tech. Report, University of Pittsburgh (2002)
Graesser, A.C., Jackson, G.T., Mathews, E.C., Mitchell, H.H., Olney, A., Ventura, M., Chipman, P., Franceschetti, D., Hu, X., Louwerse, M.M., Person, N.K.: The Tutoring ResearchGroup: Why/AutoTutor: A Test of Learning Gains from a Physics Tutor with Natural Language Dialog. In: Proceedings of the Cognitive Science Society (2003)
Koedinger, K.R., Aleven, V., Heffernan, N.T., McLaren, B.M., Hockenberry, M.: Opening the Door to Non-programmers: Authoring Intelligent Tutor Behavior by Demonstration. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 162–174. Springer, Heidelberg (2004)
Person, N., Bautista, L., Graesser, A., Mathews, E.: The Tutoring Research Group. In: Moore, J.D., Redfield, C.L., Johnson, W.L. (eds.) Artificial Intelligence in Education: AI-ED in the Wired and Wireless Future, Proceedings of AI-ED 2001, pp. 286–293. IOS Press, Amsterdam (2001)
Rosé, C.P., Aleven, V., Carey, R., Robinson, A., Wu, C.: A First Evaluation of the Instructional Value of Negotiatble Problem Solving Goals on the Exploratory Learning Continuum. In: Proceedings of AI in Education (2005)
Penstein Rosé, C., Torrey, C., Aleven, V., Wu, A.R.C., Forbus, K.D.: CycleTalk: Toward a dialogue agent that guides design with an articulate simulator. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 401–411. Springer, Heidelberg (2004)
Rosé, C.P., Jordan, P., Ringenberg, M., Siler, S., VanLehn, K., Weinstein, A.: Interactive Conceptual Tutoring in Atlas-Andes. In: Proceedings of AI in Education (2001)
VanLehn, K., Graesser, A., Tanner, J., Jordan, P., Olney, A., Rosé, C.P.: When is reading just as effective as one-on-one interactive tutoring? In: Proceedings of the Annual Meeting of the Cognitive Science Society (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kumar, R., Rosé, C., Aleven, V., Iglesias, A., Robinson, A. (2006). Evaluating the Effectiveness of Tutorial Dialogue Instruction in an Exploratory Learning Context. In: Ikeda, M., Ashley, K.D., Chan, TW. (eds) Intelligent Tutoring Systems. ITS 2006. Lecture Notes in Computer Science, vol 4053. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11774303_66
Download citation
DOI: https://doi.org/10.1007/11774303_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35159-7
Online ISBN: 978-3-540-35160-3
eBook Packages: Computer ScienceComputer Science (R0)