Abstract
The focus of this paper is on pointing gestures that do not function as deictic pointing to a concrete referent but rather as structuring the flow of information. Examples are given on their use in giving feedback and creating a common ground in natural conversations, and their meaning is described with the help of semantic themes of the Index Finger Extended gesture family. A communication model is also sketched together with an exploration of the simultaneous occurrence of gestures and speech signals, using a two-way approach that combines top-down linguistic-pragmatic and bottom-up signal analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Clark, H.H., Schaefer, E.F.: Contributing to Discourse. Cog. Sci. 13, 259–294 (1989)
Traum, D.: Computational models of grounding in collaborative systems. In: Working Papers of the AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems, pp. 124–131. AAAI, Menlo Park (1999)
Jokinen, K.: Constructive Dialogue Management: Speech Interaction and Rational Agency. John Wiley, Chichester (2009a)
Pickering, M., Garrod, S.: Towards a mechanistic psychology of dialogue. Behavioral and Brain Sciences 27, 169–226 (2004)
Goodwin, C.: Gestures as a resource for the organization of mutual orientation. Semiotica 62(1/2), 29–49 (1986)
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
Jokinen, K., Vanhasalo, M.: Stand-up Gestures – Annotation for Communication Management. In: Proceedings of the Nodalida Workshop on Multimodal Annotation, Tartu. NEALT Series of Language Technology (2009)
Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge (2003)
McNeill, D.: Gesture and Thought. University of Chicago Press, Chicago (2005)
Kendon, A.: Gesture: Visible action as utterance, Cambridge (2004)
Bavelas, J., Chovil, N.: Visible acts of meaning. An Integrated Message Model of Language in Face-to-Face Dialogue. J. Lang and Soc. Psy. 19(2), 163–194 (2000)
Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., Paggio, P.: The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. In: Martin, J.C., Paggio, P., Kuenlein, P., Stiefelhagen, R., Pianesi, F. (eds.) Multimodal corpora for modelling human multimodal behaviour; Special issue of the International Journal of Language Resources and Evaluation 41(3–4), 273–287 (2007)
Douglas, C.E., Campbell, N., Cowie, R., Roach, P.: Emotional speech: Towards a new generation of databases. Speech Comm. 40, 33–60 (2003)
Jokinen, K., Campbell, N.: Non-verbal Information Sources for Constructive Dialogue Management. Tutorial at LREC-2008. Marrakech, Marocco (2008)
Jokinen, K.: Gesturing in Alignment and Conversational Activity. In: Proceedings of the Pacific Linguistic Conference, Sapporo, Japan (2009b)
Carletta, J.: Announcing the AMI Meeting Corpus. The ELRA Newsletter 11(1), 3–5 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jokinen, K. (2010). Pointing Gestures and Synchronous Communication Management. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds) Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science, vol 5967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12397-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-12397-9_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12396-2
Online ISBN: 978-3-642-12397-9
eBook Packages: Computer ScienceComputer Science (R0)