Skip to main content
SpringerLink
Log in

Effect of Emotion Synchronization in Robot Facial Expressions

  • Conference paper
  • First Online:
HCI International 2021 - Posters (HCII 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1420))

Included in the following conference series:

  • 1825 Accesses

Abstract

With the recent developments in fields like Artificial Intelligence and Robotics, the rise of social robots is not far away. For social robots to establish better human interaction, they must be able to interact with people casually. In this research, we introduce the idea of empathy in robots by syncing our emotions with the robot’s facial expression. The emotions are estimated and synchronized in real-time using biological signals (i.e., brainwave and heartrate). In this paper, we (1) investigate the effect that emotion synchronization has in human-robot interactions by comparing the impressions of a robot that generates synchronized facial expressions with non-synchronized ones, and (2) clarify the effectiveness of selecting stimulus according to the individual’s interest. The results suggest that emotion synchronization of facial expressions is an effective way to improve human-robot interactions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Robins, B., Dautenhahn, K., Te Boekhorst, R.: Robots as assistive technology - does appearance matter? In: Proceedings of the 2004 IEEE Int Workshop on Robot & Human Interactive Communication, pp. 277–282. IEEE, Kurashiki, Okayama, Japan (2004)

    Google Scholar 

  2. Fung, P., et al.: Towards empathetic human-robot interactions. In: Gelbukh, A. (ed.) CICLing 2016. LNCS, vol. 9624, pp. 173–193. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-75487-1_14

    Chapter  Google Scholar 

  3. Cuff, B.M.P., Brown, S.J., Taylor, L., Howat, D.J.: Empathy: a review of the concept. Emot. Rev. 8(2), 144–153 (2016)

    Article  Google Scholar 

  4. Höök, K.: Affective loop experiences: designing for interactional embodiment. Philos. Trans. R. Soc. Lond. Biol. Sci. 364(1535), 3585–3595 (2009)

    Article  Google Scholar 

  5. Leite, I., Castellano, G., Pereira, A., Martinho, C., Paiva, A.: Long-term interactions with empathic robots: evaluating perceived support in children. In: Ge, S.S., Khatib, O., Cabibihan, J.J., Simmons, R., Williams, M.A. (eds.) ICSR 2012. LNCS, vol. 7621, pp. 298–307. Springer, Berlin, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34103-8_30

    Chapter  Google Scholar 

  6. Hegel, F., Spexard, T., Vogt, T., Horstmann, G., Wrede, B.: Playing a different imitation game: interaction with an empathic Android robot. In: Proceedings of the 2006 IEEE-RAS International conference on humanoid robots, Genova, Italy, pp. 56–61 (2006)

    Google Scholar 

  7. Riek, L.D., Paul, P.C., Robinson, P.: When my robot smiles at me: enabling human-robot rapport via real-time head gesture mimicry. J. Multimodal User Interfaces 3(1–2), 99–108 (2010)

    Article  Google Scholar 

  8. Ikeda, Y., Horie, R., Sugaya, M.: Estimate emotion with biological information for robot interaction. Proc. Comput. Sci. 112, 1589–1600 (2017)

    Article  Google Scholar 

  9. Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)

    Article  Google Scholar 

  10. Kajihara, Y., Sripian, P., Feng, C., Sugaya, M.: Emotion synchronization method for robot facial expression. In: Kurosu, M. (ed.) HCII 2020. LNCS, vol. 12182, pp. 644–653. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49062-1_44

    Chapter  Google Scholar 

  11. Baveye, Y., Dellandrea, E., Chamaret, C., Chen, L.: LIRIS-ACCEDE: a video database for affective content analysis. IEEE Trans. Affect. Comput. 6(1), 43–55 (2015)

    Article  Google Scholar 

  12. Osgood, C.E.: The nature and measurement of meaning. Psychol. Bull. 49(3), 197 (1952)

    Article  Google Scholar 

  13. Hayashi, F.: The fundamental dimensions of interpersonal cognitive structure. Bull. Fac. Educ. Nagoya Univ. 25, 233–247 (1978)

    Google Scholar 

  14. Hayashi, R., Kato, S.: Psychological effects of physical embodiment in artificial pet therapy. Artificial Life and Robotics 22(1), 58–63 (2017)

    Article  Google Scholar 

  15. Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25(1), 49–59 (1994)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Engineering, Shibaura Institute of Technology, 3-7-5, Toyosu, Koto, Tokyo, 135-8548, Japan

    Kiruthika Raja, Tipporn Laohakangvalvit, Peeraya Sripian & Midori Sugaya

Authors
  1. Kiruthika Raja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tipporn Laohakangvalvit
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peeraya Sripian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Midori Sugaya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kiruthika Raja .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  3. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Raja, K., Laohakangvalvit, T., Sripian, P., Sugaya, M. (2021). Effect of Emotion Synchronization in Robot Facial Expressions. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1420. Springer, Cham. https://doi.org/10.1007/978-3-030-78642-7_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78642-7_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78641-0

  • Online ISBN: 978-3-030-78642-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation