Abstract
Conversational interfaces that incorporate animated characters potentially are well suited for educational software, since they can engage children as active learners and support question asking skills. In the present research, a simulation study was conducted in which twenty-four 7-to-10-year-old children used speech and pen input to converse directly with animated fish as they learned about marine biology. The animated fish responded with TTS voices crafted to sound either extroverted or introverted in accordance with the speech signal literature. During these interactions, children became highly engaged, asking an average of 152 questions during a 45-minute session. Self-report measures further confirmed that children liked “talking to the animals and that the TTS and interface were easy to understand and use. The auditory embodiment of animated characters as TTS output also had a significant selective impact on children’s engagement in asking science questions. Specifically, children asked +16% more science questions when conversing with animated characters embodying an extrovert TTS voice that resembled the speech of a master teacher (e.g., higher volume and pitch, wider pitch range), rather than an introvert TTS voice, although no differential impact was found on social questions. These findings reveal that conversational interfaces can be designed that effectively stimulate children during learning activities, thereby supporting the goals of next-generation educational software.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bettencourt, E., Gillett, M., Gall, M., and Hull, R. (1983). Effects of teacher enthusiasm training on student on-task behaviour and achievement. American Educational Research Journal, 20(4): 435–450.
Cassell, J. and Ryokai, K. (2000). Story Spaces: Interfaces for Children’s voices. In Proc. of ACM SIGCHI Conference of Human Factors in Computing Systems: CHI 2000, pp. 243–244.
Cassell, J., Sullivan, J., Prevost, S., and Churchill, E., editors (2000). Embodied conversational agents. MIT Press, Cambridge, MA.
Dehn, D.M. and Van Mulken, S. (2000). The impact of animated interface agents: A review of empirical research. International Journal of Human-Computer Studies, 52: 1–22.
Druin, A.e., editor (1996). Designing Multimedia Environments for Children. John Wiley & Sons, USA.
Druin, A.e., editor (1999). The Design of Children’s Technology. Morgan Kaufmann, San Francisco, CA.
Gustavson, K. and House, D. (2001). Fun or Boring? A web-based evaluation of expressive synthesis for children. In Proc. of Eurospeech 2001, pp. 565–568, Aalborg, Denmark.
Haughland, S.W. (2000). Computers and young children. Report available from the Educational Resources Information Center, ERIC Document Reproduction Service No. ED 438 926.
Kulik, J.A., Bangert, R.L., and Williams, G.W. (1983). Effects of computer-based education on secondary school students. Journal of Educational Psychology, 75(1): 19–26.
Lester, J.C., Converse, S.A., Stone, B.A., Kahler, S., and Barlow, T. (1997). Animated pedagogical agents and problem-solving effectiveness: A large-scale empirical evaluation. In Proc. of Eighth World Conference on Artificial Intelligence in Education, pp. 23–30, Kobe, Japan.
Moreno, R., Mayer, R., Spires, H., and Lester, J. (2001). The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents?. Cognition and Instruction, 19(2): 177–213.
Nass, C., Isbister, K., and Lee, E. (2000). Truth is beauty: Researching embodied conversational agents. In Cassell, J., Sullivan, J., Prevost, S., and Churchill, E., editors, Embodied Conversational Agents, pp. 374–402, MIT Press, Cambridge, MA.
Nass, C. and Lee, K.L. (2001). Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. Journal of Experimental Psychology: Applied, 7(3): 171–181.
Nass, C. and Lee, K.L. (2000). Does computer-generated speech manifest personality? An experimental test of similarity-attraction. In Proc. of Conference on Human Factors in Computing Systems: CHI 2000, pp. 329–336, ACM Press, New York, NY.
Nass, C., Steuer, J., and Tauber, E. (1994). Computers are social actors. In Proc. of Conference on Human Factors in Computing Systems: CHI 1994, pp. 72–78, ACM Press, Boston, MA.
Oviatt, S.L. and Adams, B. (2000). Designing and evaluating conversational interfaces with animated characters. In Cassell, J., Sullivan, J., Prevost, S., and Churchill, E., editors, Embodied Conversational Agents, pp. 319–343, MIT Press, Cambridge, MA.
Richmond, V., Gorham, J., and McCroskey, J. (1987). The relationship between selected immediacy behaviours and cognitive learning. Communication Yearbook, 10: 574–590.
Rickenberg, R. and Reeves, B. (2000). The effects of animated characters on anxiety, task performance, and evaluations of user interfaces. In Proc. of Conference on Human Factors in Computer Systems: CHI 2000, pp. 49–56, ACM Press, The Hague, Amsterdam.
Sallinen-Kuparinen, A. (1992). Teacher communicator style. Communication Education, 41(2): 153–166.
Scherer, K.R. (1979). Personality markers in speech. In Scherer K.R. and Giles H., editors, Social Markers in Speech, pp. 147–209, Cambridge Univ. Press, Cambridge, UK.
Smith, B.L., Brown, B.L., Strong, W.J., and Rencher, A.C. (1995). Effects of speech rate on personality perception. Language and Speech, 18: 145–152.
Tusing, K.J. and Dillard, J.P. (2000). The sounds of dominance: Vocal precursors of perceived dominance during interpersonal influence. Human Communication Research, 26: 148–171.
Editor information
Rights and permissions
Copyright information
© 2004 Kluwer Academic Publishers
About this chapter
Cite this chapter
Darves, C., Oviatt, S. (2004). Talking to Digital Fish. In: Ruttkay, Z., Pelachaud, C. (eds) From Brows to Trust. Human-Computer Interaction Series, vol 7. Springer, Dordrecht. https://doi.org/10.1007/1-4020-2730-3_10
Download citation
DOI: https://doi.org/10.1007/1-4020-2730-3_10
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-2729-1
Online ISBN: 978-1-4020-2730-7
eBook Packages: Computer ScienceComputer Science (R0)