Skip to main content
SpringerLink
Log in

Information State Based Multimodal Dialogue Management: Estimating Conversational Engagement from Gaze Information

  • Conference paper
Intelligent Virtual Agents (IVA 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5773))

Included in the following conference series:

Motivation

Thanks to the progress of computer vision technologies and human sensing technologies, human behaviors, such as gaze and head poses, can be accurately measured in real time. Previous studies in multimodal user interfaces and intelligent virtual agents presented many interesting applications by exploiting such sensing technologies [1, 2]. However, little has been studied how to extract communication signals from a huge amount of data, and how to use such data in dialogue management in conversational agents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Qvarfordt, P., Zhai, S.: Conversing with the user based on eye-gaze patterns. In: CHI 2005 (2005)

    Google Scholar 

  2. Nakano, Y.I., et al.: Towards a Model of Face-to-Face Grounding. In: The 41st Annual Meeting of the Association for Computational Linguistics (ACL 2003), Sapporo, Japan (2003)

    Google Scholar 

  3. Ishii, R., Nakano, Y.: Estimating User’s Conversational Engagement based on Gaze Behaviors. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 200–207. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Matheson, C., Poesio, M., Traum, D.: Modelling Grounding and Discourse Obligations Using Update Rules. In: 1st Annual Meeting of the North American Chapter of the Association for Computational Linguistics, NAACL 2000 (2000)

    Google Scholar 

  5. MIDIKI, http://midiki.sourceforge.net/

Download references

Author information

Authors and Affiliations

  1. Dept. of Computer and Information Science, Seikei University, Japan

    Yukiko Nakano

  2. Dept. of Computer and Information Sciences, Tokyo University of Agriculture and Technology, Japan

    Yuji Yamaoka

Authors
  1. Yukiko Nakano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuji Yamaoka
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Human Media Interaction (HMI), University of Twente, EWI (Zilverling), P.O.Box 217, 7500, Enschede, AE, The Netherlands

    Zsófia Ruttkay

  2. Deutsches Forschungszentrum für künstliche Intelligenz (DFKI), Campus D3.2, 66123, Saarbrücken, Germany

    Michael Kipp

  3. Human Media Interaction Group,Dept. of Computer Science, University of Twente, P.O. Box 217, 7500, Enschede, AE, The Netherlands

    Anton Nijholt

  4. Center for Analysis and Design of Intelligent Agents, CADIA, School of Computer Science, Reykjavik University, Kringlan 1, 103, Reykjavik, Iceland

    Hannes Högni Vilhjálmsson

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nakano, Y., Yamaoka, Y. (2009). Information State Based Multimodal Dialogue Management: Estimating Conversational Engagement from Gaze Information. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds) Intelligent Virtual Agents. IVA 2009. Lecture Notes in Computer Science(), vol 5773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04380-2_77

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04380-2_77

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04379-6

  • Online ISBN: 978-3-642-04380-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation