Abstract
In face-to-face conversations, speakers are continuously checking whether the listener is engaged in the conversation. When the listener is not fully engaged in the conversation, the speaker changes the conversational contents or strategies. With the goal of building a conversational agent that can control conversations with the user in such an adaptive way, this study analyzes the user’s gaze behaviors and proposes a method for predicting whether the user is engaged in the conversation based on gaze transition 3-Gram patterns. First, we conducted a Wizard-of-Oz experiment to collect the user’s gaze behaviors as well as the user’s subjective reports and an observer’s judgment concerning the user’s interest in the conversation. Next, we proposed an engagement estimation algorithm that estimates the user’s degree of engagement from gaze transition patterns. This method takes account of individual differences in gaze patterns. The algorithm is implemented as a real-time engagement-judgment mechanism, and the results of our evaluation experiment showed that our method can predict the user’s conversational engagement quite well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kendon, A.: Some Functions of Gaze Direction in Social Interaction. Acta Psychologica 26, 22–63 (1967)
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
Clark, H.H.: Using Language. Cambridge University Press, Cambridge (1996)
Duncan, S.: Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology 23(2), 283–292 (1972)
Argyle, M., Graham, J.: The Central Europe Experiment - looking at persons and looking at things. Journal of Environmental Psychology and Nonverbal Behaviour 1, 6–16 (1977)
Anderson, A.H., Bard, E., Sotillo, C., Doherty-Sneddon, G., Newlands, A.: The effects of face-to-face communication on the intelligibility of speech. Perception and Psychophysics 59, 580–592 (1997)
Nakano, Y.I., Reinstein, G., Stocky, T., Cassell, J.: Towards a Model of Face-to-Face Grounding. In: ACL 2003, Sapporo, Japan (2003)
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., Werf, R.J.v.d., Morency, L.-P.: Virtual Rapport. In: 6th International Conference on Intelligent Virtual Agents. Springer, Marina del Rey (2006)
Sidner, C.L., Lee, C., Kidd, C., Lesh, N., Rich, C.: Explorations in engagement for humans and robots. Artificial Intelligence 166(1-2), 140–164 (2005)
Qvarfordt, P., Zhai, S.: Conversing with the user based on eye-gaze patterns. In: CHI 2005 (2005)
Eichner, T., Prendinger, H., André, E., Ishizuka, M.: Attentive Presentation Agents. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722. Springer, Heidelberg (2007)
Kipp, M.: Anvil - A Generic Annotation Tool for Multimodal Dialogue. In: The 7th European Conference on Speech Communication and Technology (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ishii, R., Nakano, Y.I. (2008). Estimating User’s Conversational Engagement Based on Gaze Behaviors. In: Prendinger, H., Lester, J., Ishizuka, M. (eds) Intelligent Virtual Agents. IVA 2008. Lecture Notes in Computer Science(), vol 5208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85483-8_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-85483-8_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85482-1
Online ISBN: 978-3-540-85483-8
eBook Packages: Computer ScienceComputer Science (R0)