research-article

Robots Tutoring Children: Longitudinal Evaluation of Social Engagement in Child-Robot Interaction

Authors:

Wolmet BarendregtAuthors Info & Claims

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

Article No.: 64, Pages 1 - 10

https://doi.org/10.1145/2971485.2971536

Published: 23 October 2016 Publication History

Abstract

This paper explores children's social engagement to a robotic tutor by analyzing their behavioral reactions to socially significant events initiated by the robot. Specific questions addressed in this paper are whether children express signs of social engagement as a reaction to such events, and if so, in what way. The second question is whether these reactions differ between different types of social events, and finally, whether such reactions disappear or change over time. Our analysis indicates that children indeed show behaviors that indicate social engagement using a range of communicative channels. While gaze towards the robot's face is the most common indication for all types of social events, verbal expressions and nods are especially common for questions, and smiles are most common after positive feedback. Although social responses in general decrease slightly over time, they are still observable after three sessions with the robot.

References

[1]

Anzalone, S.M., Boucenna, S., Ivaldi, S., and Chetouani, M. Evaluating the Engagement with Social Robots. International Journal of Social Robotics 7 (2015), 465--478.

[2]

Argyle, M. and Dean, J. Eye-Contact, Distance and Affiliation. Sociometry 28, 3 (1965), 289--304.

[3]

Bainbridge, W.A., Hart, J.W., Kim, E.S., and Scassellati, B. The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents. International Journal of Social Robotics 3, 1 (2011), 41--52.

[4]

Belpaeme, T., Baxter, P., De Greeff, J., Kennedy, J., Read, R., Looije, R., Neerincx, M., Baroni, I., and Zelati, M. Child-Robot Interaction: Perspectives and Challenges. In Social Robotics, Herrmann, G., Pearson, M., Lenz, A., Bremner, P., Spiers, A. and Leonards, U. eds. Springer International Publishing (2013), 452--459.

Digital Library

[5]

Belpaeme, T., Baxter, P., Read, R., Wood, R., Cuayahuitl, H., Kiefer, B., Racioppa, S., Kruijff-Korbayova, I., Athanasopoulos, G., Enescu, V., Looije, R., Neerincx, M., Demiris, Y., Ros Espinoza, R., Beck, A., Canamero, L., Hiolle, A., Lewis, M., Baroni, I., Nalin, M., Cosi, P., Paci, G., Tesser, F., Sommavilla, G., and Humbert, R. Multimodal Child-Robot Interaction: Building Social Bonds. Journal of Human-Robot Interaction 1, 2 (2012), 33--53.

[6]

Beran, T. and Ramirez-Serrano, A. Can Children Have a Relationship with a Robot? In Human-Robot Personal Relationships, Lamers, M. and Verbeek, F. eds. Springer Berlin Heidelberg (2011), 49--56.

[7]

Bergin, C. and Bergin, D. Attachment in the Classroom. Educational Psychology Review 21, 2 (2009), 141--170.

[8]

Castellano, G., Leite, I., Pereira, A., Martinho, C., Paiva, A., and Mcowan, P.W. Affect Recognition for Interactive Companions: Challenges and design in real world scenarios. Journal on Multimodal User Interfaces 3, 1--2 (2010), 89--98.

[9]

Castellano, G., Paiva, A., Kappas, A., Aylett, R., Hastie, H., Barendregt, W., Nabais, F., and Bull, S. Towards Empathic Virtual and Robotic Tutors. In Artificial Intelligence in Education, Lane, H.C., Yacef, K., Mostow, J. and Pavlik, P. eds. Springer Berlin Heidelberg (2013), 733--736.

[10]

Castellano, G., Pereira, A., Leite, I., Paiva, A., and Mcowan, P.W. Detecting User Engagement with a Robot Companion Using Task and Social Interaction-based Features. In Proc. ICMI-MLMI'09, (2009).

Digital Library

[11]

Corrigan, L.J., Basedow, C., Küster, D., Kappas, A., Peters, C., and Castellano, G. Mixing implicit and explicit probes: finding a ground truth for engagement in social human-robot interactions. In Proc. 2014 ACM/IEEE International Conference on Human-robot Interaction, ACM (2014), 140--141.

Digital Library

[12]

Datyner, A.C., Richmond, J.L., and Henry, J.D. The development of empathy in infancy: insights from the rapid facial mimicry response. Frontiers in Human Neuroscience (2013).

[13]

Deshmukh, A., Castellano, G., Kappas, A., Barendregt, W., Nabais, F., Paiva, A., Ribeiro, T., Leite, I., and Aylett, R. Towards Empathic Artificial Tutors. In Proc. 8th ACM/IEEE international conference on Human-robot interaction, IEEE Press (2013), 113--114.

Digital Library

[14]

Duffy, B.R. Anthropomorphism and the social robot. Robotics and Autonomous Systems 42, 3--4 (2003), 177--190.

[15]

Fogg, B.J. and Nass, C. Silicon sycophants: the effects of computers that flatter. International Journal of Human-Computer Studies 46, 5 (1997), 551--561.

Digital Library

[16]

Hall, L., Hume, C., Tazzyman, S., Deshmukh, A., Janarthanam, S., Hastie, H., Aylett, R., Castellano, G., Papadopoulos, F., Jones, A., Corrigan, L., Paiva, A., Alves-Oliveira, P., Ribeiro, T., Barendregt, W., Serholt, S., and Kappas, A. Map Reading with an Empathic Robot Tutor. In Proc. HRI 2016: International Conference on Human-Robot Interaction (Extended abstracts), (2016).

Digital Library

[17]

Han, J. Emerging Technologies: Robot Assisted Language Learning. Language Learning & Technology 16, 3 (2012), 1--9.

[18]

Johnson, L., Rickel, J., and Lester, J. Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education 11 (2000), 47--78.

[19]

Jones, A., Küster, D., Basedow, C., Alves-Oliveira, P., Serholt, S., Hastie, H., Corrigan, L.J., Barendregt, W., Kappas, A., Paiva, A., and Castellano, G. Empathic Robotic Tutors for Personalised Learning: A Multidisciplinary Approach. In Proc. International Conference on Social Robotics, Springer International Publishing (2015), 285--295.

[20]

Kanda, T., Hirano, T., Eaton, D., and Ishiguro, H. Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. Human-Computer Interaction 19 (2004), 61--84.

Digital Library

[21]

Kanda, T., Sato, R., Saiwaki, N., and Ishiguro, H. A Two-Month Field Trial in an Elementary School for Long-Term Human-Robot Interaction. IEEE Transactions on Robotics 23, 5 (2007), 962--971.

Digital Library

[22]

Kennedy, J., Baxter, P., and Belpaeme, T. The Robot Who Tried Too Hard: Social Behaviour of a Robot Tutor Can Negatively Affect Child Learning. In Proc. 10th Annual ACM/IEEE International Conference on Human-Robot Interaction, ACM (2015), 67--74.

Digital Library

[23]

Kennedy, J., Baxter, P., Senft, E., and Belpaeme, T. Social Robot Tutoring for Child Second Language Learning. In Proc. 11th Annual ACM/IEEE International Conference on Human Robot Interaction, (2016).

Digital Library

[24]

Kidd, C.D. 2003. Sociable Robots: The Role of Presence and Task in Human-Robot Interaction. In Georgia Institute of Technology Massachusetts Institute of Technology.

[25]

Leite, I., Castellano, G., Pereira, A., Martinho, C., and Paiva, A. Long-Term Interactions with Empathic Robots: Evaluating Perceived Support in Children. In Social Robotics, Ge, S., Khatib, O., Cabibihan, J.-J., Simmons, R. and Williams, M.-A. eds. Springer Berlin Heidelberg (2012), 298--307.

Digital Library

[26]

Leite, I., Martinho, C., and Paiva, A. Social Robots for Long-Term Interaction: A Survey. International Journal of Social Robotics 5, 2 (2013), 291--308.

[27]

Leyzberg, D., Spaulding, S., and Scassellati, B. Personalizing robot tutors to individuals' learning differences. In Proc. 2014 ACM/IEEE international conference on Human-robot interaction, ACM (2014), 423--430.

Digital Library

[28]

Leyzberg, D., Spaulding, S., Toneva, M., and Scassellati, B. The Physical Presence of a Robot Tutor Increases Cognitive Learning Gains. In Proc. 34th Annual Conference of the Cognitive Science Society, (2012).

[29]

Lusk, M.M. and Atkinson, R.K. Animated pedagogical agents: does their degree of embodiment impact learning from static or animated worked examples? Applied Cognitive Psychology 21, 6 (2007), 747--764. 1347.

[30]

Mubin, O., Stevens, C.J., Shahid, S., Mahmud, A.A., and Dong, J.-J. A review of the applicability of robots in education. Technology for Education and Learning (2013), 1--7.

[31]

Nass, C. and Moon, Y. Machines and Mindlessness: Social Responses to Computers. Journal of Social Issues 56, 1 (2000), 81--103.

[32]

Oh, K. and Kim, M. Social Attributes of Robotic Products: Observations of Child-Robot Interactions in a School Environment. International Journal of Design 4, 1 (2010).

[33]

Okita, S.Y., Ng-Thow-Hing, V., and Sarvadevabhatla, R.K. Multimodal approach to affective human-robot interaction design with children. ACM Trans. Interact. Intell. Syst. 1, 1 (2011), 1--29.

Digital Library

[34]

Pereira, A., Martinho, C., Leite, I., and Paiva, A. iCat, the chess player: the influence of embodiment in the enjoyment of a game. In Proc. 7th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2008), (2008).

Digital Library

[35]

Porges, S.W. Social Engagement and Attachment. Annals of the New York Academy of Sciences 1008, 1 (2003), 31--47.

[36]

Reeves, B. and Nass, C. 1996. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, New York.

Digital Library

[37]

Salter Ainsworth, M. Attachments Beyond Infancy. American Psychologist 44, 4 (1989), 709--716.

[38]

Sidner, C.L., Lee, C., Kidd, C.D., Lesh, N., and Rich, C. Explorations in engagement for humans and robots. Artificial Intelligence 166, 1--2 (2005), 140--164.

Digital Library

[39]

Sulčič, V. and Sulčič, A. Can Online Tutors Improve the Quality of E-Learning? Issues in Informing Science and Information Technology 4 (2007), 201--210.

[40]

Takayama, L. Perspectives on Agency Interacting with and through Personal Robots. In Human-Computer Interaction: The Agency Perspective, Zacarias, M. and De Oliveira, J. eds. Springer Berlin Heidelberg (2012), 195--214.

[41]

Turkle, S. 2006. A Nascent Robotics Culture: New Complicities for Companionship. AAAI Technical Report Series.

[42]

Vacharkulksemsuk, T. and Fredrickson, B.L. Strangers in sync: Achieving embodied rapport through shared movements. Journal of experimental social psychology 48, 1 (2012), 399--402. 2011.07.015.

[43]

Vygotsky, L. 1978. Mind in Society: The development of higher psychological processes. Harvard University Press, Cambridge, MA.

[44]

Yιlmaz, R. and Kιlιç-Çakmak, E. Educational interface agents as social models to influence learner achievement, attitude and retention of learning. Computers & Education 59, 2 (2012), 828--838.

Digital Library

Cited By

Malnatsky ELigthart MJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Fitting Humor: Age-Based Personalization for Shaping Relatable Child-Robot InteractionsProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721532(331-341)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721532
Lilley KDossey ECohn MClopper CWagner LZellou G(2025)Social evaluation of text-to-speech voices by adults and childrenSpeech Communication10.1016/j.specom.2024.103163166:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.specom.2024.103163
Metaxoudis E(2024)Integrating AI Into Early Childhood EducationEmpowering Early Education With Computational Thinking, AI, and STEM10.4018/979-8-3693-6210-5.ch002(35-64)Online publication date: 25-Oct-2024
https://doi.org/10.4018/979-8-3693-6210-5.ch002
Show More Cited By

Index Terms

Robots Tutoring Children: Longitudinal Evaluation of Social Engagement in Child-Robot Interaction
1. Human-centered computing

Recommendations

Measuring young children's long-term relationships with social robots
IDC '18: Proceedings of the 17th ACM Conference on Interaction Design and Children

Social robots are increasingly being developed for long-term interactions with children in domains such as healthcare, education, therapy, and entertainment. As such, we need to deeply understand how children's relationships with robots develop through ...
Assessing Children's Perceptions and Acceptance of a Social Robot
IDC '19: Proceedings of the 18th ACM International Conference on Interaction Design and Children

Children's interactions with social robots and other technologies are increasingly longitudinal, especially in areas such as healthcare, therapy, and education. As such, we need to understand how children perceive social robots over time and the kinds ...
Escaping from Children's Abuse of Social Robots
HRI '15: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

Social robots working in public space often stimulate children's curiosity. However, sometimes children also show abusive behavior toward robots. In our case studies, we observed in many cases that children persistently obstruct the robot's activity. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

October 2016

1045 pages

ISBN:9781450347631

DOI:10.1145/2971485

General Chairs:
Staffan Björk
University of Gothenburg
,
Eva Eriksson
Chalmers University of Technology
,
Program Chairs:
Morten Fjeld
Chalmers University of Technology
,
Susanne Bødker
University of Aarhus
,
Publications Chairs:
Wolmet Barendregt
University of Gothenburg
,
Mohammad Obaid
Chalmers University of Technology

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Chalmers University of Technology
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

NordiCHI '16

NordiCHI '16: 9th Nordic Conference on Human-Computer Interaction

October 23 - 27, 2016

Gothenburg, Sweden

Acceptance Rates

NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

65
Total Citations
View Citations
859
Total Downloads

Downloads (Last 12 months)126
Downloads (Last 6 weeks)12

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Malnatsky ELigthart MJohal WLemaignan SBrščić DVázquez MCharisi V(2025)Fitting Humor: Age-Based Personalization for Shaping Relatable Child-Robot InteractionsProceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction10.5555/3721488.3721532(331-341)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.5555/3721488.3721532
Lilley KDossey ECohn MClopper CWagner LZellou G(2025)Social evaluation of text-to-speech voices by adults and childrenSpeech Communication10.1016/j.specom.2024.103163166:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.specom.2024.103163
Metaxoudis E(2024)Integrating AI Into Early Childhood EducationEmpowering Early Education With Computational Thinking, AI, and STEM10.4018/979-8-3693-6210-5.ch002(35-64)Online publication date: 25-Oct-2024
https://doi.org/10.4018/979-8-3693-6210-5.ch002
De Jong CPeter JKühne RBarco A(2024)Children's Acceptance of a Domestic Social Robot: How It Evolves over TimeACM Transactions on Human-Robot Interaction10.1145/363806613:2(1-20)Online publication date: 14-Jun-2024
https://dl.acm.org/doi/10.1145/3638066
Jing MHu TLi HXu Y(2024)The Transfer Deficit in the Context of Social Robots: A Case of Early Spatial Learning from Screen-Based TechnologyProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3659384(725-731)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3659384
Jin QKawas SArora SYuan YYarosh S(2024)Is Your Family Ready for VR? Ethical Concerns and Considerations in Children's VR UsageProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655804(436-454)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655804
Levinson LAbbasi NSabanovic SGunes H(2024)Expert Insights on Robots for Safeguarding Children: How (not) and Why (not)?Proceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655798(600-611)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3628516.3655798
Karousou AMakris NSarafis IChatzichristofis SAmanatiadis A(2024)Evaluating Student Acceptance and Engagement with a Humanoid Robot Tutor in a Formal Learning Environment2024 32nd Mediterranean Conference on Control and Automation (MED)10.1109/MED61351.2024.10566196(394-399)Online publication date: 11-Jun-2024
https://doi.org/10.1109/MED61351.2024.10566196
Manikutty GPotapragada SPasupuleti DUnnithan MVenugopal APrabha PArunav HKumar VRthuraj PBhavani R(2024)Exploring Child-Robot Interaction in Individual and Group Settings in India2024 8th International Conference on Robotics and Automation Sciences (ICRAS)10.1109/ICRAS62427.2024.10654467(37-42)Online publication date: 21-Jun-2024
https://doi.org/10.1109/ICRAS62427.2024.10654467
Oralbayeva NTelisheva ZAmir AZhanatkyzy AAimysheva ASandygulova A(2024)Moveable Älıpbi: Design of Montessori-Based Child-Robot Interaction for Long-Term Alphabet LearningInternational Journal of Social Robotics10.1007/s12369-024-01189-zOnline publication date: 25-Nov-2024
https://doi.org/10.1007/s12369-024-01189-z
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten