Skip to main content

Impact of Pedagogical Agents’ Conversational Formality on Learning and Engagement

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10331))

Included in the following conference series:

Abstract

This study investigated the impact of pedagogical agents’ conversational formality on learning and engagement in a trialog-based intelligent tutoring system (ITS). Participants (N = 167) were randomly assigned into one of three conditions to learn summarization strategies with the conversational agents: (1) a formal condition in which both the teacher agent and the student agent spoke with a formal language style, (2) an informal condition in which both agents spoke informally, and (3) a mixed condition in which the teacher agent spoke formally, whereas the student agent spoke informally. Result showed that the agents’ informal discourse yielded higher performance, but elicited higher report of text difficulty and mind wandering. This discourse also caused longer response time and lower arousal. The implications are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Graesser, A.C., McNamara, D.S., Cai, Z., Conley, M., Li, H., Pennebaker, J.: Coh-Metrix measures text characteristics at multiple levels of language and discourse. Elem. School J. 115, 210–229 (2014). doi:10.1086/678293

    Article  Google Scholar 

  2. Li, H., Graesser, A.C., Conley, M., Cai, Z., Pavlik, P., Pennebaker, J.W.: A new measure of text formality: an analysis of discourse of Mao Zedong. Discourse Process. 53, 205–232 (2016). doi:10.1080/0163853X.2015.1010191

    Article  Google Scholar 

  3. Li, H., Graesser, A.C., Cai, Z.: Comparing two measures of formality. In: Boonthum-Denecke, C., Youngblood, G.M. (eds.) 2013 FlAIRS, pp. 220–225. AAAI Press, Palo Alto (2013)

    Google Scholar 

  4. Denton, P.: The power of our words: teacher language that helps children learn. Center for Responsive Schools Inc., Turners Falls (2013)

    Google Scholar 

  5. Gámez, P.B., Lesaux, N.K.: The relation between exposure to sophisticated and complex language and early—adolescent English—only and language minority learners’ vocabulary. Child Dev. 83, 1316–1331 (2012). doi:10.1111/j.1467-8624.2012.01776.x

    Article  Google Scholar 

  6. Gámez, P.B., Lesaux, N.K.: Early-adolescents’ reading comprehension and the stability of the middle school classroom-language environment. Dev. Psychol. 51, 447–458 (2015). doi:10.1037/a0038868

    Article  Google Scholar 

  7. Moreno, R., Mayer, R.E.: Personalized messages that promote science learning in virtual environments. J. Educ. Psychol. 96, 165–173 (2004). doi:10.1037/0022-0663.96.1.165

    Article  Google Scholar 

  8. Mayer, R.E.: Principles based on social cues: personalization, voice, and presence principles. In: Mayer, R.E. (ed.) Cambridge Handbook of Multimedia Learning, pp. 201–212. Cambridge University Press, New York (2005)

    Chapter  Google Scholar 

  9. Snow, C.E., Uccelli, P.: The challenge of academic language. In: Olson, D.R., Torrance, N. (eds.) The Cambridge Handbook of Literacy, Cambridge, New York, pp. 112–133 (2009)

    Google Scholar 

  10. Graesser, A.C., Chipman, P., Haynes, B.C., Olney, A.: AutoTutor: an intelligent tutoring system with mixed-initiative dialogue. IEEE Trans. Edu. 48, 612–618 (2005). doi:10.1109/TE.2005.856149

    Article  Google Scholar 

  11. Graesser, A.C., Li, H., Forsyth, C.: Learning by communicating in natural language with conversational agents. Curr. Dir. Psychol. Sci. 23, 374–380 (2014). doi:10.1177/0963721414540680

    Article  Google Scholar 

  12. Chi, M.T.H., Roy, M., Hausmann, R.G.M.: Observing tutoring collaboratively: Insights about tutoring effectiveness from vicarious learning. Cog. Sci. 32, 301–341 (2008). doi:10.1080/03640210701863396

    Article  Google Scholar 

  13. Fredricks, J.A., Blumenfeld, P.C., Paris, A.H.: School engagement: potential of the concept, state of the evidence. Rev. Educ. Res. 74, 59–109 (2004). doi:10.3102/00346543074001059

    Article  Google Scholar 

  14. Fulmer, S.M., D’Mello, S.K., Strain, A., Graesser, A.C.: Interest-based text preference moderates the effect of text difficulty on engagement and learning. Contemp. Educ. Psychol. 41, 98–110 (2015). doi:10.1016/j.cedpsych.2014.12.005

    Article  Google Scholar 

  15. Feng, S., D’Mello, S., Graesser, A.C.: Mind wandering while reading easy and difficult texts. Psychon. B. Rev. 20, 586–592 (2013). doi:10.3758/s13423-012-0367-y

    Article  Google Scholar 

  16. Smallwood, J.M., Schooler, J.W.: The restless mind. Psychol. Bull. 132, 946–958 (2006). doi:10.1037/0033-2909.132.6.946

    Article  Google Scholar 

  17. McVay, J.C., Kane, M.J.: Does mind wandering reflect executive function or executive failure? Comment on Smallwood and Schooler (2006) and Watkins (2008). Psychol. Bull. 136, 188–197 (2010). doi:10.1037/a0018298

    Article  Google Scholar 

  18. Buhrmester, M., Kwang, T., Gosling, S.D.: Amazon’s Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspect. Psychol. Sci. 6, 3–5 (2011). doi:10.1177/1745691610393980

    Article  Google Scholar 

  19. Li, H., Cai, Z., Graesser, A.C.: How good is popularity? Summary grading in crowdsourcing. In: Barnes, T., Chi, M., Feng, M. (eds.) 2016 EDM, pp. 430–435. EDM Society, Raleigh (2016)

    Google Scholar 

  20. Meyer, B.J.F.: Text coherence and readability. Top. Lang. Disord. 23, 204–224 (2003). doi:10.1097/00011363-200307000-00007

    Article  Google Scholar 

  21. Graesser, A.C., Keshtkar, F., Li, H.: The role of natural language and discourse processing in advanced tutoring systems. In: Holtgraves, T. (ed.) The Oxford handbooks of language and social psychology, Oxford, New York, pp. 491–509 (2014)

    Google Scholar 

  22. Li, H., Cheng, Q., Yu, Q., Graesser, A.C.: The role of peer agent’s learning competency in trialogue-based reading intelligent systems. In: Conati, C., Heffernan, N., Mitrovic, A., Verdejo, M. (eds.) AIED 2015. LNCS (LNAI), vol. 9112, pp. 694–697. Springer, Cham (2015). doi:10.1007/978-3-319-19773-9_94

    Chapter  Google Scholar 

  23. Friend, R.: Effects of strategy instruction on summary writing of college students. Contemp. Edu. Psychol. 26, 3–24 (2001). doi:10.1006/ceps.1999.1022

    Article  Google Scholar 

  24. Russell, J.A., Weiss, A., Mendelsohn, G.A.: Affect Grid: a single-item scale of pleasure and arousal. J. Pers. Soc. Psychol. 57, 493–502 (1989). doi:10.1037/0022-3514.57.3.493

    Article  Google Scholar 

  25. Smallwood, J., Davies, J.B., Heim, D., Finnigan, F., Sudberry, M., O’Connor, R., Obonsawin, M.: Subjective experience and the attentional lapse: task engagement and disengagement during sustained attention. Conscious. Cogn. 13, 657–690 (2004). doi:10.1016/j.concog.2004.06.003

    Article  Google Scholar 

  26. Smallwood, J.M., Baracaia, S.F., Lowe, M., Obonsawin, M.: Task unrelated thought whilst encoding information. Conscious. Cogn. 12, 452–484 (2003). doi:10.1016/S1053-8100(03)00018-7

    Article  Google Scholar 

  27. Clifford, M.: Students need challenge, not easy success. Edu. Leadership 48, 22–26 (1990)

    Google Scholar 

Download references

Acknowledgement

This work was funded by the Institute of Education Sciences (Grant No. R305C120001). Any opinions are those of the authors and do not necessarily reflect the views of these funding agencies, cooperating institutions, or other individuals.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Haiying Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Li, H., Graesser, A. (2017). Impact of Pedagogical Agents’ Conversational Formality on Learning and Engagement. In: André, E., Baker, R., Hu, X., Rodrigo, M., du Boulay, B. (eds) Artificial Intelligence in Education. AIED 2017. Lecture Notes in Computer Science(), vol 10331. Springer, Cham. https://doi.org/10.1007/978-3-319-61425-0_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61425-0_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61424-3

  • Online ISBN: 978-3-319-61425-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics