Skip to main content
SpringerLink
Log in

Investigating Entrainment of People’s Pointing Gestures by Robot’s Gestures Using a WOZ Method

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

A person’s behavior tends to be similar to that of the robot with which he or she is interacting, and this tendency is called entrainment. In this paper, we reveal the robot gestures that are important to the entrainment of people’s pointing gestures. We conducted a laboratory experiment using a Wizard-of-Oz paradigm in which a participant and a robot have an object-reference conversation. The frequencies of a participant’s pointing gestures in conversation were compared among three conditions: (1) gazing, (2) pointing and (3) gazing&pointing conditions. The results show that the participants in the gazing&pointing condition used the most pointing gestures, while those in the pointing condition used the fewest pointing gestures. This suggests that a robot’s gazing gestures play an important role in the entrainment of people’s pointing gestures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Kita S (2003) Pointing: a fundamental building block of human communication. In: Kita S (ed) Pointing: where language, culture, and cognition meet. Erlbaum, Mahwah, pp 1–8

    Google Scholar 

  2. McNeill D (2003) Pointing and morality in Chicago. In: Kita S (ed) Pointing: where language, culture, and cognition meet. Erlbaum, Mahwah, pp 293–306

    Google Scholar 

  3. Cabibihan JJ, So CW, Nazar M, Ge SS (2009) Pointing gestures for a robot mediated communication interface. In: Intelligent robotics and applications. Lecture notes in computer science, pp 67–77

    Chapter  Google Scholar 

  4. Graham JA, Heywood S (1975) The effects of elimination of hand gestures and of verbal codability on speech performance. Eur J Soc Psychol 5(2):189–195

    Article  Google Scholar 

  5. Rauscher FH, Krauss RM, Chen Y (1996) Gesture, speech, and lexical access: the role of lexical movements in speech production. Psychol Sci 7:226–230

    Article  Google Scholar 

  6. Ono T, Imai M, Ishiguro H (2001) A model of embodied communications with gestures between humans and robots. In: Proc 23rd annual meeting of the cognitive science society, pp 732–737

    Google Scholar 

  7. Sakamoto D, Kanda T, Ono T, Kamashima M, Imai M, Ishiguro H (2005) Cooperative embodied communication emerged by interactive humanoid robots. Int J Hum-Comput Stud 62:247–265

    Article  Google Scholar 

  8. Gump BB, Kulik JA (1997) Stress, affiliation, and emotional contagion. J Pers Soc Psychol 72(2):305–319

    Article  Google Scholar 

  9. Charny JE (1966) Psychosomatic manifestations of rapport in psychotherapy. Psychosom Med 28:305–315

    Google Scholar 

  10. Chartrand TL, Bargh JA (1999) The chameleon effect: the perception-behavior link and social interaction. J Pers Soc Psychol 76(6):893–910

    Article  Google Scholar 

  11. Moore C, Dunham JP (1995) Joint attention: its origins and role in development. Lawrence Erlbaum, Hillsdale

    Google Scholar 

  12. Garrod S, Anderson A (1987) Saying what you mean in dialog: a study in conceptual and semantic co-ordination. Cognition 27:181–218

    Article  Google Scholar 

  13. Brennan ES, Clark HH (1996) Lexical choice and conceptual pacts in conversation. J Exp Psychol Learn Mem Cogn 22:1482–1493

    Article  Google Scholar 

  14. Brennan ES (1996) Lexical entrainment in spontaneous dialog. In: Proc international symposium on spoken dialogue, pp 41–44

    Google Scholar 

  15. Gustafson J, Larsson A, Carlson R, Hellman K (1997) How do system questions influence lexical choices in user answers. In: Proc Eurospeech, Rhodes, Greece, pp 2275–2278

    Google Scholar 

  16. Iio T, Shiomi M, Shinozawa K, Miyashita T, Akimoto T, Hagita N (2009) Lexical entrainment in human-robot interaction: can robots entrain human vocabulary? In: Proc of the IEEE/RSJ international conference on intelligent robots and systems, pp 3727–3734

    Google Scholar 

  17. Kendon A (1970) Movement coordination in social interaction: some examples described. Acta Psychol 32:101–125

    Article  Google Scholar 

  18. Condon SW, Sander WL (1974) Neonate movement is synchronized with adult speech: interactional participation and language acquisition. Science 183:99–101

    Article  Google Scholar 

  19. Ogawa H, Watanave T (2001) InterRobot: speech-driven embodiment interaction robot. Adv Robot 15(3):371–377

    Article  Google Scholar 

  20. Goodwin C (1981) Conversational organization: interaction between speakers and hearers. Academic Press, San Diego

    Google Scholar 

  21. Goodwin C (1980) Restarts, pauses, and the achievement of mutual gaze at turn-beginning. Sociol Inq 50:272–302

    Article  Google Scholar 

  22. Yamazaki A, Yamazaki K, Kuno Y, Burdelski M, Kawashima M, Kuzuoka H (2008) Precision timing in human-robot interaction: coordination of head movement and utterance. In: Proc CHI’08

    Google Scholar 

  23. Mutlu B, Shiwa T, Kanda T, Ishiguro H, Hagita N (2009) Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In: Proc HRI’09

    Google Scholar 

  24. Shimada M, Yoshikawa Y, Asada M, Saiwaki N, Ishiguro H (2011) Effects of observing eye contact between a robot and another person. Int J Soc Robot 3(2):143–154

    Article  Google Scholar 

  25. Breazeal C, Scasselati B (1999) A context-dependent attention system for a social robot. In: Proc of international joint conference on artificial intelligence, pp 1146–1151

    Google Scholar 

  26. Brooks AR, Breazeal C, Marjanovic M, Scassellati B, Williamson MM (1998) The cog project: building a humanoid robot. In: Nehaniv C (ed) Computation for metaphors, analogy and agent. Springer lecture notes in artificial intelligence, vol 1562. Springer, Germany

    Google Scholar 

  27. Imai M, Ono T, Ishiguro H (2003) Physical relation and expression: joint attention for human-robot interaction. IEEE Trans Ind Electron 50(4):636–643

    Article  Google Scholar 

  28. Itakura S, Ishida H, Kanda T, Shimada Y, Ishiguro H, Lee K (2008) How to build an intentional android: infants’ imitation of a robot’s goal-directed actions. Infancy 13(5):519–532

    Article  Google Scholar 

  29. Meltzoff AN (1995) Understanding the intentions of others: re-enactment of intended acts by 18-month-old children. Dev Psychol 31(5):838–850

    Article  Google Scholar 

  30. Mutlu B, Forlizzi J (2008) Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In: ACM/IEEE int conf on human robot interaction, pp 287–942

    Google Scholar 

  31. Shiomi M, Kanda T, Ishiguro H, Hagita N (2007) Interactive humanoid robots for a science museum. IEEE Intell Syst 22(2):25–32

    Article  Google Scholar 

  32. Gross H-M, Boehme H, Schroeter Ch, Mueller S, Koenig A, Einhorn E, Martin Ch, Merten M, Bley A (2009) TOOMAS: interactive shopping guide robots in everyday use—final implementation and experiences from long-term field trials. In: IEEE/RSJ int conf on intelligent robots and systems, pp 2005–2012

    Google Scholar 

  33. Li J, Chignell M (2011) Communication of emotion in social robots through simple head and arm movements. Int J Soc Robot 3(2):125–142

    Article  Google Scholar 

  34. Bainbridge AW, Hart WJ, Kim SE, Scassellati B (2010) The benefits of interactions with physically present robots over video-displayed agents. Int J Soc Robot 3(1):41–52

    Article  Google Scholar 

  35. Papero, NEC. http://www.nec.co.jp/products/robot/en/index.html

Download references

Author information

Authors and Affiliations

  1. ATR Intelligent Robotics and Communication Laboratories, 2-2-2 Hikaridai, Keihanna Science City, Kyoto, 619-0288, Japan

    Takamasa Iio, Masahiro Shiomi, Kazuhiko Shinozawa, Takaaki Akimoto & Norihiro Hagita

  2. Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe City, 610-0394, Japan

    Katsunori Shimohara

Authors
  1. Takamasa Iio
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masahiro Shiomi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kazuhiko Shinozawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Takaaki Akimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Katsunori Shimohara
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Norihiro Hagita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Takamasa Iio.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Iio, T., Shiomi, M., Shinozawa, K. et al. Investigating Entrainment of People’s Pointing Gestures by Robot’s Gestures Using a WOZ Method. Int J of Soc Robotics 3, 405–414 (2011). https://doi.org/10.1007/s12369-011-0112-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-011-0112-0

Keywords

Search

Navigation