Abstract
Participation in natural, real-time dialogue calls for behaviors supported by perception-action cycles from around 100 msec and up. Generating certain kinds of such behaviors, namely envelope feedback, has been possible since the early 90s. Real-time backchannel feedback related to the content of a dialogue has been more difficult to achieve. In this paper we describe our progress in allowing virtual humans to give rapid within-utterance content-specific feedback in real-time dialogue. We present results from human-subject studies of content feedback, where results show that content feedback to a particular phrase or word in human-human dialogue comes 560-2500 msec from the phrase’s onset, 1 second on average. We also describe a system that produces such feedback with an autonomous agent in limited topic domains, present performance data of this agent in human-agent interactions experiments and discuss technical challenges in light of the observed human-subject data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R., et al.: Virtual Rapport. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)
Thórisson, K.R.: Dialogue Control in Social Interface Agents. In: Paper presented at the InterCHI Adjunct Proceedings, Conference on Human Factors in Computing Systems, Amsterdam (1993)
Thórisson, K.R.: Communicative Humanoids: A Computational Model of Psycho-Social Dialogue Skills. Unpublished Ph.D. thesis, Massachusetts Institute of Technology (1996)
Tosa, N.: Neurobaby. In: ACM SIGGRAPH, pp. 212–213 (1993)
Thórisson, K.R.: Natural Turntaking Needs No Manual: Computational Theory and Model, From Perception to Action. In: Granström, B., House, D., Karlsson, I. (eds.) Multimodality in Language and Speech Systems, pp. 173–207. Kluwer Academic Publishers, Dordrecht, The Netherlands (2002)
Bavelas, J.B., Coates, L., Johnson, T.: Listeners as Co-narrators. Journal of Personality and Social Psychology 79(6), 941–952 (2000)
Tickle-Degnen, L., Rosenthal, R.: The Nature of Rapport and its Nonverbal Correlates. Psychological Inquiry 1(4), 285–293 (1990)
Gratch, J., Wang, N., Okhmatovskaia, A., Lamothe, F., Morales, M., van der Werf, R., et al.: Can virtual humans be more engaging than real ones? In: Jacko, J. (ed.) HCII 2007. LNCS, vol. 4552, pp. 286–297. Springer, Heidelberg (2007)
Scherer, K.R., Ellgring, H.: Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion (2007)
Ward, N., Tsukahara, W.: Prosodic features which cue back-channel responses in English and Japanese. Journal of Pragmatics 23, 1177–1207 (2000)
Morency, L.-P., Sidner, C., Lee, C., Darrell, T.: Contextual Recognition of Head Gestures. In: Paper presented at the 7th International Conference on Multimodal Interactions, Torento, Italy (2005)
Kopp, S., Krenn, B., Marsella, S., Marshall, A., Pelachaud, C., Pirker, H., et al.: Towards a common framework for multimodal generation in ECAs: The behavior markup language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, Springer, Heidelberg (2006)
Gratch, J., Marsella, S.: A domain independent framework for modeling emotion. Journal of Cognitive Systems Research 5(4), 269–306 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jonsdottir, G.R., Gratch, J., Fast, E., Thórisson, K.R. (2007). Fluid Semantic Back-Channel Feedback in Dialogue: Challenges and Progress. In: Pelachaud, C., Martin, JC., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds) Intelligent Virtual Agents. IVA 2007. Lecture Notes in Computer Science(), vol 4722. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74997-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-74997-4_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74996-7
Online ISBN: 978-3-540-74997-4
eBook Packages: Computer ScienceComputer Science (R0)