Abstract
This work aims to endow a social robot with the ability to mimic affective empathy, which represents the skill of inferring the other’s emotional state and mirroring the detected emotion. In this direction, we first designed a set of 52 facial expressions that may be representative of the primary emotions. Leveraging on the idea that the robot should learn the matching between emotion and its expressions directly from the final users, we modeled a deep reinforcement learning algorithm, and we recruited 105 users to train it, by rating the coherence of the robot’s facial expressions on a web interface. A total of 22251 facial configurations were generated by the algorithm and rewarded by the pool of participants. The results proved that the algorithm exploited every facial configuration, converging towards a subset of 6 facial expressions at the end of the teaching process. Thus, we tested the trained empathetic model on a real robot (i.e. CloudIA robot) in a conversation scenario. The results collected through the interview and the questionnaires’ analysis highlighted a general tendency of preferring the empathetic behavior of the robot, more than the not empathetic one. Namely, the robot endowed with empathetic behavior was perceived as more human-like and aware of the context of the interaction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bagheri, E., Roesler, O., Cao, H.L., Vanderborght, B.: A reinforcement learning based cognitive empathy framework for social robots. Int. J. Soc. Robot. 13(5), 1079–1093 (2021)
Baron-Cohen, S.: The Essential Difference. Penguin UK (2004)
Bradley, M., Lang, P.: The international affective digitized sounds: affective ratings of sounds and instruction manual (technical report no. b-3). University of Florida. NIMH Center for the Study of Emotion and Attention, Gainesville, FL (2007)
Churamani, N., Barros, P., Strahl, E., Wermter, S.: Learning empathy-driven emotion expressions using affective modulations. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2018)
Cifuentes, C.A., Pinto, M.J., Céspedes, N., Múnera, M.: Social robots in therapy and care. Current Rob. Rep. 1(3), 59–74 (2020)
Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992)
Hegel, F., Spexard, T., Wrede, B., Horstmann, G., Vogt, T.: Playing a different imitation game: Interaction with an empathic android robot. In: 2006 6th IEEE-RAS International Conference on Humanoid Robots, pp. 56–61. IEEE (2006)
Hoffman, M.L.: Empathy and moral development. Ann. Rep. Educ. Psychol. Japan 35, 157–162 (1996)
Lamm, C., Tomova, L.: The neural bases of empathy in humans. In: Neuronal Correlates of Empathy, pp. 25–36. Elsevier (2018)
Lang, P.J., Bradley, M.M., Cuthbert, B.N., et al.: International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Center for the Study of Emotion & Attention Gainesville, FL, NIMH (2005)
Leite, I., Castellano, G., Pereira, A., Martinho, C., Paiva, A.: Empathic robots for long-term interaction. Int. J. Soc. Robot. 6(3), 329–341 (2014)
Leite, I., Pereira, A., Mascarenhas, S., Martinho, C., Prada, R., Paiva, A.: The influence of empathy in human-robot relations. Int. J. Hum. Comput. Stud. 71(3), 250–260 (2013)
Mikels, J.A., Fredrickson, B.L., Larkin, G.R., Lindberg, C.M., Maglio, S.J., Reuter-Lorenz, P.A.: Emotional category data on images from the international affective picture system. Behav. Res. Methods 37(4), 626–630 (2005)
Mileounis, A., Cuijpers, R.H., Barakova, E.I.: Creating robots with personality: the effect of personality on social intelligence. In: Ferrández Vicente, J.M., Álvarez-Sánchez, J.R., de la Paz López, F., Toledo-Moreo, F.J., Adeli, H. (eds.) IWINAC 2015. LNCS, vol. 9107, pp. 119–132. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18914-7_13
Niculescu, A., van Dijk, B., Nijholt, A., Li, H., See, S.L.: Making social robots more attractive: the effects of voice pitch, humor and empathy. Int. J. Soc. Robot. 5(2), 171–191 (2013)
Paiva, A., Leite, I., Boukricha, H., Wachsmuth, I.: Empathy in virtual agents and robots: a survey. ACM Trans. Interactive Intell. Syst. (TiiS) 7(3), 1–40 (2017)
Riek, L.D., Paul, P.C., Robinson, P.: When my robot smiles at me: enabling human-robot rapport via real-time head gesture mimicry. J. Multimodal User Interfaces 3(1), 99–108 (2010)
Rossi, S., Ferland, F., Tapus, A.: User profiling and behavioral adaptation for HRI: a survey. Pattern Recogn. Lett. 99, 3–12 (2017)
Siedlecka, E., Denson, T.F.: Experimental methods for inducing basic emotions: a qualitative review. Emot. Rev. 11(1), 87–97 (2019)
Sorrentino, A., Khalid, O., Coviello, L., Cavallo, F., Fiorini, L.: Modeling human-like robot personalities as a key to foster socially aware navigation. In: 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), pp. 95–101. IEEE (2021)
Stotland, E.: Exploratory investigations of empathy. In: Advances in Experimental Social Psychology, vol. 4, pp. 271–314. Elsevier (1969)
Tapus, A., Mataric, M.J., Scassellati, B.: Socially assistive robotics [grand challenges of robotics]. IEEE Rob. Autom. Mag. 14(1), 35–42 (2007)
Yalçın, Ö.N.: Evaluating empathy in artificial agents. arXiv preprint arXiv:1908.05341 (2019)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sorrentino, A., Assunção, G., Cavallo, F., Fiorini, L., Menezes, P. (2022). A Reinforcement Learning Framework to Foster Affective Empathy in Social Robots. In: Cavallo, F., et al. Social Robotics. ICSR 2022. Lecture Notes in Computer Science(), vol 13817. Springer, Cham. https://doi.org/10.1007/978-3-031-24667-8_46
Download citation
DOI: https://doi.org/10.1007/978-3-031-24667-8_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-24666-1
Online ISBN: 978-3-031-24667-8
eBook Packages: Computer ScienceComputer Science (R0)