Abstract
With the goal of building an intelligent conversational agent that can recognize the user’s engagement, this paper proposes a method of judging a user’s conversational engagement based on head pose data. First, we analyzed how head pose information is correlated with the user’s conversational engagement and found that the amplitude of head movement and rotation have a moderate positive correlation with the level of conversational engagement. We then established an engagement estimation model by applying a decision tree learning algorithm to 19 parameters. The results showed that the proposed model based on head pose information performs quite well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sidner, C.L., et al.: Explorations in engagement for humans and robots. Artificial Intelligence 166(1-2), 140–164 (2005)
Peters, C.: Direction of Attention Perception for Conversation Initiation in Virtual Environments. In: Intelligent Virtual Agents (2005)
Sidner, C.L., et al.: Where to Look: A Study of Human-Robot Engagement. In: ACM International Conference on Intelligent User Interfaces, IUI (2004)
Nakano, Y.I., Ishii, R.: Estimating User’s Engagement from Eye-gaze Behaviors in Human-Agent Conversations. In: 2010 International Conference on Intelligent User Interfaces (IUI 2010), Hong Kong,
Nakano, Y.I., et al.: Towards a Model of Face-to-Face Grounding. In: The 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan (ACL 2003) (2003)
Bohus, D., Horvitz, E.: Learning to Predict Engagement with a Spoken Dialog System in Open-World Settings. In: SIGdial 2009, London, UK (2009)
Kendon, A.: Spatial organization in social encounters: the F-formation system. In: Gumperz, J.J. (ed.) Conducting Interaction: Patterns of behavior in focused encounters. Studies in International Sociolinguistics, Cambridge University Press, Cambridge (1990)
Morency, L.-P., et al.: Head gestures for perceptual interfaces: The role of context in improving recognition. Artificial Intelligence 171(8-9), 568–585 (2007)
Rich, C., et al.: Recognizing Engagement in Human-Robot Interaction. In: Human-Robot Interaction (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ooko, R., Ishii, R., Nakano, Y.I. (2011). Estimating a User’s Conversational Engagement Based on Head Pose Information. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds) Intelligent Virtual Agents. IVA 2011. Lecture Notes in Computer Science(), vol 6895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23974-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-23974-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23973-1
Online ISBN: 978-3-642-23974-8
eBook Packages: Computer ScienceComputer Science (R0)