Abstract
Graphical communications, such as dialogues using maps, drawings, or pictures, provide people with two independent modalities through which they can interact with each other. In such conversation, graphical interaction can be both sequential and parallel, affected by the activity-dependent constraints imposed by the task performed in the interaction (Umata, Shimojima, Katagiri, and Swoboda (2003)). In this paper, we compare the patterns of speech and graphical interaction in collaborative problem-solving tasks. The amount of speech overlap did not show a significant difference among four task conditions, although graphical overlaps did. This shows that both resource-dependent and activity-dependent constraints play a significant role in determining the interaction organization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brennan, S.E.: Seeking and providing evidence for mutual understanding. Ph.D. dissertation, Stanford University (1990)
Clark, H.H.: Using language. Cambridge University Press, Cambridge (1996)
Clark, H.H., Schaefer, E.F.: Contributing to discourse. Cognitive Science 13, 259–294 (1989)
Condon, W.S.: Speech and body motion synchrony of the speaker-hearer. In: Horton, D.L., Jenkins, J.J. (eds.) Perception of Language, pp. 150–173. Merrill, Columbus (1971)
Sacks, H., Schegloff, E.A., Jefferson, G.: A simplest systematics for the organization of turn-taking in conversation. Language 50, 696–735 (1974)
Stefik, M., Foster, G., Bobrow, D., Kahn, K., Lanning, S., Suchman, L.: Beyond the chalkboard: computer support for collaboration and problem solving in meetings. Communications of the ACM 30(1), 32–47 (1987)
Tatar, D., Foster, G., Bobrow, D.: Design for conversation: lessons from cognoter. International Journal of Man-Machine Studies 34(2), 185–210 (1991)
Traum, D.: A computational theory of grounding in natural language conversation. Ph.D. dissertation, University of Rochester (1994)
Whittaker, S., Brennan, S., Clark, H.: Coordinating activity: an analysis of computer supported co-operative work. In: Proceedings of CHI 1991 Human Factors in Computing Systems, pp. 361–367. ACM Press, New York (1991)
Umata, I., Shimojima, A., Katagiri, Y., Swoboda, N.: Graphical turns in multimodal communication. In: Proceedings of the 25th Annual Conference of the Cognitive Science Society, CD-ROM (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Umata, I., Shimojima, A., Katagiri, Y. (2004). Speech and Graphical Interaction in Multimodal Communication. In: Blackwell, A.F., Marriott, K., Shimojima, A. (eds) Diagrammatic Representation and Inference. Diagrams 2004. Lecture Notes in Computer Science(), vol 2980. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-25931-2_30
Download citation
DOI: https://doi.org/10.1007/978-3-540-25931-2_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21268-3
Online ISBN: 978-3-540-25931-2
eBook Packages: Springer Book Archive