skip to main content
10.1145/2556288.2557280acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Conversing with children: cartoon and video people elicit similar conversational behaviors

Published: 26 April 2014 Publication History

Abstract

Interactive animated characters have the potential to engage and educate children, but there is little research on children's interactions with animated characters and real people. We conducted an experiment with 69 children between the ages of 4 and 10 years to investigate how they might engage in conversation differently if their interactive partner appeared as a cartoon character or as a person. A subset of the participants interacted with characters that displayed exaggerated and damped facial motion. The children completed two conversations with an adult confederate who appeared once as herself through video and once as a cartoon character. We measured how much the children spoke and compared their gaze and gesture patterns. We asked them to rate their conversations and indicate their preferred partner. There was no difference in children's conversation behavior with the cartoon character and the person on video, even among those who preferred the person and when the cartoon exhibited altered motion. These results suggest that children will interact with animated characters as they would another person.

Supplementary Material

suppl.mov (pn1745-file3.mp4)
Supplemental video

References

[1]
Andrist, S., Pejsa, T., Mutlu, B., and Gleicher, M. Designing effective gaze mechanisms for virtual agents. In Proc. CHI 2012, ACM Press (2012), 705--714.
[2]
Baldwin, D., and Tomasello, M. Word learning: A window on early pragmatic understanding. In Proc. Child Language Research Forum. Chicago, IL, 2001, 3--23.
[3]
Bartneck, C., and Reichenbach, J. Subtle emotional expressions of synthetic characters. International Journal of Human-Computer Studies 62, 2 (2005), 179--192.
[4]
Black, M., Chang, J., Chang, J., and Narayanan, S. Comparison of child-human and child-computer interactions based on manual annotations. In Proc. Workshop on Child, Computer and Interaction 2009 (2009).
[5]
Boker, S. M., Cohn, J. F., Theobald, B.-J., Matthews, I., Brick, T. R., and Spies, J. R. Effects of damping head movement and facial expression in dyadic conversation using real-time facial expression tracking and synthesized avatars. Phil. Trans. R. Soc. B 364, 1535 (2009), 3485--3495.
[6]
Borgers, N., de Leeuw, E., and Hox, J. Children as respondents in survey research: Cognitive development and response quality 1. Bulletin de Méthodologie Sociologique 66, 1 (2000), 60--75.
[7]
Borgers, N., Hox, J., and Sikkel, D. Response effects in surveys on children and adolescents: The effect of number of response options, negative wording, and neutral mid-point. Quality & Quantity 38, 1 (2004), 17--33.
[8]
Burleson, W., and Picard, R. W. Gender-Specific approaches to developing emotionally intelligent learning companions. IEEE Intelligent Systems 22, 4 (2007), 62--69.
[9]
Calder, A. J., Rowland, D., Young, A. W., Nimmo-Smith, I., Keane, J., and Perrett, D. I. Caricaturing facial expressions. Cognition 76, 2 (2000), 105--146.
[10]
Calder, A. J., Young, A. W., Rowland, D., and Perrett, D. I. Computer-enhanced emotion in facial expressions. Phil. Trans. R. Soc. B 264 (1997), 919--925.
[11]
Cassell, J. Embodied conversational agents: representation and intelligence in user interfaces. AI Magazine 22, 4 (2001), 67.
[12]
Cassell, J., and Tartaro, A. Intersubjectivity in human-agent interaction. Interaction Studies 8, 3 (2007), 391--410.
[13]
Cootes, T. F., Edwards, G. J., and Taylor, C. J. Active appearance models. IEEE Trans. on Pattern Analysis and Machine Intelligence 23, 6 (2001), 681--685.
[14]
Cootes, T. F., Wheeler, G., Walker, K., and Taylor, C. J. View-based active appearance models. Image and Vision Computing 20, 9-10 (2002), 657--664.
[15]
Costa, P. T., and MacCrae, R. R. Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO FFI): Professional Manual. Psychological Assessment Resources, 1992.
[16]
Coulston, R., Oviatt, S., and Darves, C. Amplitude convergence in children's conversational speech with animated personas. In Proc. International Conference on Spoken Language Processing, vol. 4 (2002), 2689--2692.
[17]
Darves, C., Oviatt, S., and Coulston, R. Adaptation of users' spoken dialogue patterns in a conversational interface. In Proc. International Conference on Spoken Language Processing, vol. 1 (2002), 561--564.
[18]
de Melo, C. M., Carnevale, P., and Gratch, J. The impact of emotion displays in embodied agents on emergence of cooperation with people. Presence 20, 5 (2011), 449--465.
[19]
Grist, C. L., Socha, A., and McCord, D. M. The M5-PS-35: A five-factor personality questionnaire for preschool children. Journal of Personality Assessment 94, 3 (2012), 287--295.
[20]
Guadagno, R. E., Swinth, K. R., and Blascovich, J. Social evaluations of embodied agents and avatars. Computers in Human Behavior 27, 6 (2011), 2380--2385.
[21]
Hayes, D. Anytime Playdate: Inside the Preschool Entertainment Boom, or How Television Became My Baby's Best Friend. Free Press, New York, NY, 2008.
[22]
Hess, U., Blairy, S., and Kleck, R. E. The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior 21, 4 (1997), 241--257.
[23]
Hyde, J., Carter, E. J., Kiesler, S., and Hodgins, J. K. Perceptual effects of damped and exaggerated facial motion in animated characters. In Proc. IEEE International Conference on Automatic Face and Gesture Recognition 2013 (2013).
[24]
Kirkorian, H. L., Wartella, E. A., and Anderson, D. R. Media and young children's learning. Children and Electronic Media 18, 1 (2008), 39--61.
[25]
Knowles, A. D., and Nixon, M. C. Children's comprehension of expressive states depicted in a television cartoon. Australian Journal of Psychology 41, 1 (1989), 17--24.
[26]
Linebarger, D. L., and Walker, D. Infants' and toddlers' television viewing and language outcomes. American Behavioral Scientist 46, X (2004), 1--21.
[27]
Matthews, I., and Baker, S. Active appearance models revisited. International Journal of Computer Vision 60 (2004), 135--164.
[28]
Max Planck Institute for Psycholinguistics, The Language Archive, Nijmegen, The Netherlands. ELAN. http://tla.mpi.nl/tools/tla-tools/elan.
[29]
Oviatt, S. Talking to thimble jellies: Children's conversational speech with animated characters. In Proc. INTERSPEECH 2000 (2000), 877--880.
[30]
Read, J. C., and MacFarlane, S. Using the fun toolkit and other survey methods to gather opinions in child computer interaction. In Proc. IDC 2006, ACM Press (2006), 81--88.
[31]
Rideout, V. J., Vandewater, E. A., and Wartella, E. A. Zero to six: Electronic media in the lives of infants, toddlers and preschoolers. Tech. rep., The Henry J. Kaiser Family Foundation, 2003.
[32]
Scheck, A. M., L. Alvin Malesky, J., Grist, C. L., and McCord, D. M. Personality in preschool children: Preliminary psychometrics of the M5-PS questionnaire. American Journal of Psychological Research 6, 1 (2010), 134--156.
[33]
Sloetjes, H., and Wittenburg, P. Annotation by category: ELAN and ISO DCR. In Proc. LREC (2008).
[34]
Tam, J., Carter, E., Kiesler, S., and Hodgins, J. Video increases the perception of naturalness during remote interactions with latency. In Proc. CHI EA 2012, ACM Press (2012), 2045--2050.
[35]
Theobald, B.-J., Matthews, I., Mangini, M., Spies, J. R., Brick, T. R., Cohn, J. F., and Boker, S. M. Mapping and manipulating facial expression. Language and Speech 52 (2009), 369--386.
[36]
Troseth, G. L., Saylor, M. M., and Archer, A. H. Young children's use of video as a source of socially relevant information. Child Development 77, 3 (2006), 786--799.
[37]
Widen, S. C., and Russell, J. A. Children acquire emotion categories gradually. Cognitive Development 23, 2 (2008), 291--312.
[38]
Zaman, B., Abeele, V. V., and Grooff, D. D. Measuring product liking in preschool children: An evaluation of the Smileyometer and this or that methods. International Journal of Child-Computer Interaction 1, 1 (2013), 61--70.

Cited By

View all
  • (2024)Sevilen Çizgi Karakterlerin Değerler Açısından İncelenmesi (MEB Okul Öncesi Eğitim Programı-2024)Uluslararası Erken Çocukluk Eğitimi Çalışmaları Dergisi10.37754/ijeces.14952839:2(85-102)Online publication date: 25-Sep-2024
  • (2023)Combining wearable fNIRS and immersive virtual reality to study preschoolers’ social development: a proof-of-principle study on preschoolers’ social preferenceOxford Open Neuroscience10.1093/oons/kvad0122Online publication date: 15-Dec-2023
  • (2023)How do people respond to computer-generated versus human faces? A systematic review and meta-analysesComputers in Human Behavior Reports10.1016/j.chbr.2023.10028310(100283)Online publication date: May-2023
  • Show More Cited By

Index Terms

  1. Conversing with children: cartoon and video people elicit similar conversational behaviors

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
      April 2014
      4206 pages
      ISBN:9781450324731
      DOI:10.1145/2556288
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 26 April 2014

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. agent
      2. animated character
      3. avatar
      4. behavior
      5. children
      6. conversation
      7. facial motion

      Qualifiers

      • Research-article

      Conference

      CHI '14
      Sponsor:
      CHI '14: CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2014
      Ontario, Toronto, Canada

      Acceptance Rates

      CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)23
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 27 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Sevilen Çizgi Karakterlerin Değerler Açısından İncelenmesi (MEB Okul Öncesi Eğitim Programı-2024)Uluslararası Erken Çocukluk Eğitimi Çalışmaları Dergisi10.37754/ijeces.14952839:2(85-102)Online publication date: 25-Sep-2024
      • (2023)Combining wearable fNIRS and immersive virtual reality to study preschoolers’ social development: a proof-of-principle study on preschoolers’ social preferenceOxford Open Neuroscience10.1093/oons/kvad0122Online publication date: 15-Dec-2023
      • (2023)How do people respond to computer-generated versus human faces? A systematic review and meta-analysesComputers in Human Behavior Reports10.1016/j.chbr.2023.10028310(100283)Online publication date: May-2023
      • (2022)CodeWalk: Facilitating Shared Awareness in Mixed-Ability Collaborative Software DevelopmentProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544812(1-16)Online publication date: 23-Oct-2022
      • (2021)Interdisciplinary Development of a Transdiagnostic Mobile App to Enhance Children’s Emotion Regulation: Sharing Insights and Lessons Learned. (Preprint)JMIR Formative Research10.2196/28300Online publication date: 28-Feb-2021
      • (2021)Supporting Shy Preschool Children in Joining Social PlayProceedings of the 20th Annual ACM Interaction Design and Children Conference10.1145/3459990.3460729(396-407)Online publication date: 24-Jun-2021
      • (2021)Same benefits, different communication patterns: Comparing Children's reading with a conversational agent vs. a human partnerComputers & Education10.1016/j.compedu.2020.104059161(104059)Online publication date: Mar-2021
      • (2019)Voice Agents Supporting High-Quality Social PlayProceedings of the 18th ACM International Conference on Interaction Design and Children10.1145/3311927.3323151(314-325)Online publication date: 12-Jun-2019
      • (2018)Kid SpaceProceedings of the Group Interaction Frontiers in Technology10.1145/3279981.3279986(1-9)Online publication date: 16-Oct-2018
      • (2018)'You Can Always Do Better!"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174126(1-13)Online publication date: 21-Apr-2018
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media