Skip to main content

Engagement in Dialogue with Social Robots

  • Chapter
  • First Online:
Dialogues with Social Robots

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 427))

Abstract

It is becoming increasingly clear that social and interactive skills are necessary requirements in many application areas where robots interact, communicate and collaborate with humans or other connected devices. The social aspects of human-computer interaction and the connection between humans and robots has recently received considerable attention in the fields of artificial intelligence, cognitive science, healthcare, companion technologies, and industrial/commercial robotics. This article addresses some dimensions of near-term future HRI, with focus on engagement detection for conversational efficiency. We present some findings from HRI research conducted at the Speech Communication Lab at Trinity College Dublin, report our experiences with a publicly exhibited conversational robot, and discuss some future research trends.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dautenhahn, K.: Socially intelligent robots: dimensions of human-robot interaction. Philos. Trans. R. Soc. Lond. B Biol. Sci. 362(1480), 679–704 (2007)

    Article  Google Scholar 

  2. Lungarella, M., Metta, G., Pfeifer, R., Sandini, G.: Developmental robotics: a survey. Connect. Sci. 15, 151190 (2004). doi:10.1080/09540090310001655110

    Google Scholar 

  3. Becker-Asano, C., Kanda, C.T., Ishiguro H.: How about laughter? Perceived naturalness of two laughing humanoid robots. In: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, Nederlands (2009)

    Google Scholar 

  4. Skantze, G., Johansson, M., Beskow, J.: Exploring turn-taking cues in multi-party human-robot discussions about objects. In: Proceedings of ICMI, Seattle, Washington, USA (2015)

    Google Scholar 

  5. Tinwell, A.: The Uncanny Valley in Games and Animation. CRC Press (2014). ISBN: 9781466586956

    Google Scholar 

  6. Peters, C., Castellano, G., de Freitas, S.: An exploration of user engagement in HCI. In: Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots Article (AFFINE 09), No. 9 ACM, New York, NY, USA (2009)

    Google Scholar 

  7. Campbell, N.: Machine Processing of Dialogue States; Speculations on Conversational Entropy. Invited keynote in Proceeding of the Specom 2016. Budapest, Hungary (2016)

    Google Scholar 

  8. Shibata, T.: An overview of human interactive robots for psychological enrichment. In: Proceedings of IEEE (2004)

    Google Scholar 

  9. Pepper: https://www.aldebaran.com/en/a-robots/pepper/more-about-pepper

  10. Kendon, A.: Gesture and speech: how they interact. In: Wiemann, Harrison, R. (eds.) Nonverbal Interaction (Sage Annual Reviews of Communication, vol. 11), Sage Publications, Beverly Hills, California. pp.13–46 (1983)

    Google Scholar 

  11. Huang, Y., Gilmartin, E., Campbell, N.: Conversational engagement recognition using auditory and visual cues. In: Proceedings of Interspeech 2016, San Francisco, USA (2016)

    Google Scholar 

  12. Sidner, L.C., Dzikovska, M.: Robot Interaction: Engagement between Humans and Robots for Hosting Activities Pittsburgh, PA, USA, pp. 123–130 (2002). ISBN: 0-7695-1834-6

    Google Scholar 

  13. Gilmartin, E., Bonin, F., Vogel C., Campbell, N.: Exploring the role of laughter in multiparty conversation, DialDam. In: Proceedings of 17th Workshop on the Semantics and Pragmatics of Dialogue, (SEMDIAL) Amsterdam (2013)

    Google Scholar 

  14. Oertel, C., Cummins, F., Edlund, J., Wagner, P., Campbell, N.: D64: a corpus of richly recorded conversational interaction. J. Multimodal User Interfaces (2010)

    Google Scholar 

  15. Hayakawa, A., Haider, F., Cerrato, L., Campbell, N., Luz, S.: Detection of cognitive states and their correlation to speech recognition performance in speech-to-speech machine translation systems. In: Proceedings of Interspeech 2015. Dresden, Germany (2015)

    Google Scholar 

  16. Han, J.G. et al.: Speech & multimodal resources: the herme database of spontaneous multimodal human-robot dialogues. In: Proceedings of the 8th LREC, Istanbul, Turkey, 23–25 May 2012

    Google Scholar 

Download references

Acknowledgements

This research is supported by Science Foundation Ireland under Grant No. 13/RC/2016, through the ADAPT Centre for Digital Content Technology at Trinity College, Dublin (www.adaptcentre.ie). We are grateful to the School of Computer Science and Statistics at Trinity College Dublin for their continuing support of the Speech Communication Lab.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Loredana Cerrato .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Cerrato, L., Campbell, N. (2017). Engagement in Dialogue with Social Robots. In: Jokinen, K., Wilcock, G. (eds) Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427. Springer, Singapore. https://doi.org/10.1007/978-981-10-2585-3_25

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2585-3_25

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2584-6

  • Online ISBN: 978-981-10-2585-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics