Abstract
There is growing recognition that AI technologies can, and should, support collaborative learning. To provide this support, we need models of collaborative talk that reflect the ways in which learners interact. Great progress has been made in modeling dialogue for high school and college-age learners, but the dialogue processes that characterize collaborative talk between elementary learner dyads are not currently well understood. This paper reports on a study with elementary school learners (4th and 5th grade, ages 9–11 years old) coded collaboratively in dyads. We recorded dialogue from 22 elementary school learner dyads, covering 7594 total utterances. We labeled this corpus manually with dialogue acts and then induced a hidden Markov model to identify the underlying dialogue states and the transitions between these states. The model identified six distinct hidden states which we interpret as Social Dialogue, Confusion, Frustrated Coordination, Exploratory Talk, Directive & Disagreement, and Disagreement & Self-Explanation. The HMM revealed that when students entered into a productive exploratory talk state, the primary way they transitioned out of this state is when they became confused or reached an impasse. When this occurred, the learners then moved into states of disputation and conflict before re-entering the Exploratory Talk state. These findings can inform the design of AI agents who support young learners’ collaborative talk and help agents determine when students are conflicting rather than collaborating.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
While the agents were not designed to elicit verbal responses from the learners and could not listen or respond, some learners spoke to them nonetheless.
References
Barnes, D.: Exploring Talk in School: Inspired by the Work of Douglas Barnes. SAGE Publications Ltd, New York (2008). https://doi.org/10.4135/9781446279526
Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. J. Educ. Media 29, 241–250 (2004). https://doi.org/10.1080/1358165042000283101
D’Mello, S.K., Lehman, B., Person, N.: Monitoring affect states during effortful problem solving activities. Int. J. Artif. Intell. Educ. 20(4), 361–389 (2010). https://doi.org/10.3233/JAI-2010-012
D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012). https://doi.org/10.1016/j.learninstruc.2011.10.001
Graesser, A.C., Olde, B.A.: How does one know whether a person understands a device? the quality of the questions the person asks when the device breaks down. J. Educ. Psychol. 95, 524–536 (2003). https://doi.org/10.1037/0022-0663.95.3.524
Griffith, A.E., et al.: Discovering co-creative dialogue states during collaborative learning. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) AIED 2021. LNCS (LNAI), vol. 12748, pp. 165–177. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78292-4_14
Light, P., Littleton, K. (eds.): Learning with Computers: Analysing Productive Interactions. Routledge, Milton Park (1998)
Ma, Y., Wiggins, J.B., Celepkolu, M., Boyer, K.E., Lynch, C., Wiebe, E.: The challenge of noisy classrooms: Speaker detection during elementary students’ collaborative dialogue. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) AIED 2021. Lecture Notes in Computer Science, vol. 12748, pp. 268–281. Lecture Notes in Computer Science, Springer, Cham (2021)
Madaio, M., Peng, K., Ogan, A., Cassell, J.: A climate of support: a process-oriented analysis of the impact of rapport on peer tutoring. In: Rethinking Learning in the Digital Age: Making the Learning Sciences Count, 13th International Conference of the Learning Sciences (ICLS) 2018. International Society of the Learning Sciences (2018)
McQuiggan, S.W., Robison, J.L., Lester, J.C.: Affective transitions in narrative-centered learning environments. J. Educ. Technol. Soc. 13(1), 40–53 (2010)
Mercer, N.: The Guided Construction of Knowledge: Talk amongst Teachers and Learners, p. viii, 135. Multilingual Matters (1995)
Mercer, N.: Words and Minds: How We Use Language to Think Together. Routledge, Milton Park (2000). https://doi.org/10.4324/9780203464984
Mercer, N., Howe, C.: Explaining the dialogic processes of teaching and learning: the value and potential of sociocultural theory. Learn. Cult. Soc. Interact. 1(1), 12–21 (2012). https://doi.org/10.1016/j.lcsi.2012.03.001
Mercer, N., Wegerif, R.: Is ‘exploratory talk’ productive talk? In: Learning with Computers: Analysing Productive Interaction, p. 23. Routledge, Milton Park (1998)
Misra, A., Loukina, A., Beigman Klebanov, B., Gyawali, B., Zechner, K.: A good start is half the battle won: unsupervised pre-training for low resource children’s speech recognition for an interactive reading companion. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds.) Artificial Intelligence in Education. Lecture Notes in Computer Science, pp. 306–317. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78292-4_25
Morales-Urrutia, E.K., Ocaña Ch., J.M., Pérez-Marín, D., Pizarro-Romero, C.: Promoting learning and satisfaction of children when interacting with an emotional companion to program. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) Artificial Intelligence in Education, vol. 12164, pp. 220–223. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-52240-7_40
Nystrand, M., Wu, L.L., Gamoran, A., Zeiser, S., Long, D.A.: Questions in time: Investigating the structure and dynamics of unfolding classroom discourse. Discourse Process. 35(2), 135–198 (2003). https://doi.org/10.1207/S15326950DP3502_3
Piaget, J.: Part i: cognitive development in children: Piaget development and learning. J. Res. Sci. Teach. 2(3), 176–186 (1964). https://doi.org/10.1002/tea.3660020306
Rabiner, L., Juang, B.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)
Rodríguez, F.J., Boyer, K.E.: Discovering individual and collaborative problem-solving modes with hidden Markov models. In: Conati, C., Heffernan, N., Mitrovic, A., Verdejo, M.F. (eds.) AIED 2015. Lecture Notes in Computer Science, pp. 408–418. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19773-9_41
Sun, S.: Meta-analysis of Cohen’s Kappa. Health Serv. Outcomes Res. Methodol. 11, 145–163 (2011). https://doi.org/10.1007/s10742-011-0077-3
Tiam-Lee, T.J., Sumi, K.: Adaptive feedback based on student emotion in a system for programming practice. In: Nkambou, R., Azevedo, R., Vassileva, J. (eds.) Intelligent Tutoring Systems, vol. 10858, pp. 243–255. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91464-0_24
VanLehn, K., Siler, S., Murray, C., Yamauchi, T., Baggett, W.B.: Why do only some events cause learning during human tutoring? Cogn. Instr. 21(3), 209–249 (2003). https://doi.org/10.1207/S1532690XCI2103_01
Williams, L., Wiebe, E., Yang, K., Ferzli, M., Miller, C.: In support of pair programming in the introductory computer science course. Comput. Sci. Educ. 12(3), 197–212 (2002). https://doi.org/10.1076/csed.12.3.197.8618
Zakaria, Z., et al.: Two-computer pair programming: exploring a feedback intervention to improve collaborative talk in elementary students. Comput. Sci. Educ. 32(1), 3–29 (2022). https://doi.org/10.1080/08993408.2021.1877987
Acknowledgements
This work is supported by the National Science Foundation through grant DRL-1721160. Any opinions, findings, conclusions, or recommendations expressed in this report are those of the authors and do not necessarily represent the views of the National Science Foundation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Earle-Randell, T.V. et al. (2023). Confusion, Conflict, Consensus: Modeling Dialogue Processes During Collaborative Learning with Hidden Markov Models. In: Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O.C., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2023. Lecture Notes in Computer Science(), vol 13916. Springer, Cham. https://doi.org/10.1007/978-3-031-36272-9_50
Download citation
DOI: https://doi.org/10.1007/978-3-031-36272-9_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36271-2
Online ISBN: 978-3-031-36272-9
eBook Packages: Computer ScienceComputer Science (R0)