Definition
Multimodal interfaces are characterized by the (possibly simultaneous) use of multiple human sensory modalities and can support combined input/output modes.
The term multimodal recurs across several domains. Since its first use in the field of interface design, its affinity and derivation from the terms “mode” and “modality” were discussed. According to Merriam-Webster, one of the meanings for mode is “a possible, customary, or preferred way of doing something,” whereas modality can be “one of the main avenues of sensation (as vision).” In multimodal interfaces, the former influences the way information is conveyed, the latter refers to the exploited communication channel. Both express peculiar aspects of a multimodal system, which is expected to provide users with flexibility and natural interaction.
Early multimodal interfaces simply combined display, keyboard, and mouse with voice (speech recognition/synthesis). Later, pen-based input, hand gestures, eye gaze, haptic...
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsRecommended Reading
Blattner MM, Dannenberg RB. CHI’90 Workshop on multimedia and multimodal interface design. SIGCHI Bull. 1990;22(2):54–8.
Bolt RA. Put that there: voice and gesture at the graphics interface. ACM Comput Graph. 1980;14(3):262–70.
Cohen PR, Johnston M, McGee DR, Oviatt SL, Pittman J, Smith I, Chen L, Clow J. QuickSet: multimodal interaction for distributed applications. In: Proceedings of the 5th ACM International Conference on Multimedia; 1997. p. 31–40.
European Telecommunications Standards Institute. Human Factors (HF); Multimodal interaction, communication and navigation guidelines ETSI EG 202 191 V1.1.1 (2003–08).
Jaimes A, Sebe N. Multimodal human-computer interaction: a survey. Comput Vis Image Underst. 2007;108(1–2):116–34.
Norman D. The design of everyday things. New York: Doubleday; 1988.
Oviatt S. Ten myths of multimodal interaction. Commun ACM. 1999;42(11):74–81.
Oviatt S. Multimodal interfaces. In: Jacko J, Sears A, editors. The human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications. Mahwah: Lawrence Erlbaum; 2003.
Reeves LM, Lai J, Larson JA, Oviatt S, Balaji TS, Buisine S, Collings P, Cohen P, Kraal B, Martin JC, McTear M, Raman TV, Stanney KM, Su H, Wang QY. Guidelines formultimodal user interface design. Commun ACM. 2004;47(1):57–9.
Yuen PC, Tang YY, Wang PSP, editors. Multimodal interface for human-machine communication. River Edge: World Scientific; 2002.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media, LLC, part of Springer Nature
About this entry
Cite this entry
Sebillo, M., Vitiello, G., De Marsico, M. (2018). Multimodal Interfaces. In: Liu, L., Özsu, M.T. (eds) Encyclopedia of Database Systems. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8265-9_880
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8265-9_880
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8266-6
Online ISBN: 978-1-4614-8265-9
eBook Packages: Computer ScienceReference Module Computer Science and Engineering