Abstract
Multimodal systems support people with different needs and different features during the interaction process making it more easy and natural. However naturalness can usually produce ambiguous interpretation. This paper discusses ambiguities in multimodal interaction proposing in particular two different examples of ambiguities: a) multimodal ambiguities produced combining un-ambiguous modal information containing contrasting concepts in multimodal dialogue, b) ambiguities arising by the propagation at multimodal level of a modal input ambiguity. Moreover, the paper proposes a formal representation of multimodal inputs using the hybrid approach that combines the attribute multi-set grammar with the linear logic. This paper starts from discussing the main features of a multimodal system and the classes of cooperation between modalities. The attribute multi-set grammar combined with the linear logic enables to highlight the multidimensionality of multimodality and allows to formally describe ambiguities that can occur.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Nigay, L., Coutaz, J.: A design space for multimodal systems - concurrent processing and data fusion. In: INTERCHI 1993 - Conference on Human Factors in Computing Systems, pp. 172–178. Addison Wesley, Reading (1993)
Marriott, K., Meyer, B.: Non-standard Logics for Diagram Interpretation. In: Theory and Application of Diagrams: First International Conference, Diagrams 2000, Proceedings. Edinburgh, Scotland, UK, pp. 95–174 (September 2000)
Martin, J.C.: Toward Intelligent Cooperation Between Modalities: The Example of a System Enabling Multimodal Interaction with a Map. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI 1997) Workshop on Intelligent Multimodal Systems, Nagoya, Japan (1997)
Oviatt, S.L.: Multimodal Interfaces. In: Jacko, J., Sears, A. (eds.) Handbook of Human-Computer Interaction, Law rence Erlbaum, New Jersey (2002)
Mankoff, J., Abowd, G.: Error Correction Techniques for Handwriting, Speech, and other ambiguous or error prone systems. Georgia Tech GVU Center Technical Report, GIT-GVU-99-18 (1999)
Caschera, M.C., Grifoni, P.: Management of ambiguities. Visual Languages for Interactive Computing: Definitions and Formalizations. IGI Publishing (in press), ISBN: 1-59904-534-6
Allen, J.F., Ferguson, G.: Actions and events in interval temporal logic. Journal of Logic and Computation 4(5), 531–579 (1994)
Chomsky, N.: Three models for the description of language. IRE Transactions on Information Theory 2, 113–124 (1956)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Caschera, M.C., Ferri, F., Grifoni, P. (2007). An Approach for Managing Ambiguities in Multimodal Interaction. In: Meersman, R., Tari, Z., Herrero, P. (eds) On the Move to Meaningful Internet Systems 2007: OTM 2007 Workshops. OTM 2007. Lecture Notes in Computer Science, vol 4805. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76888-3_61
Download citation
DOI: https://doi.org/10.1007/978-3-540-76888-3_61
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76887-6
Online ISBN: 978-3-540-76888-3
eBook Packages: Computer ScienceComputer Science (R0)