Abstract
Large individual differences have been documented among users in their multimodal integration patterns, which suggest that new user-adaptive approaches to multimodal fusion may be opportune. Before pursuing such an approach, this study explores whether people can be successfully encouraged to switch their multimodal integration pattern to one that is easier to process through the use of explicit instructions. Longitudinal data were collected from young and elderly adults as they used speech and pen input with a simulated map system. Results revealed that only 37% of users switched their integration pattern and maintained it, whereas another 19% never switched their natural pattern and 31% switched but then reverted during a follow-up session. In addition, significant destabilization of elderly users’ integration pattern was one “cost” of attempting to instruct a change in pattern. This research underscores the need for user-centered design in future multimodal system development, especially for vulnerable users such as the elderly.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cohen, P.R., Johnston, M., McGee, D.R., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J.: QuickSet: Multimodal interaction for distributed applications. In: Proc. Multimedia 1997, pp. 31–40 (1997)
Craik, F.I.M., Salthouse, T.A. (eds.): Handbook of Aging and Cognition, 2nd edn. LEA, Mahwah (2000)
Czaja, S.J., Lee, C.C.: Designing computer systems for older adults. In: Jacko, J., Sears, A. (eds.) Handbook of Human-Computer Interaction, pp. 413–427. LEA, New York (2003)
Mollon, J.D., Perkins, A.J.: Errors of judgement at Greenwich in 1796. Nature 380, 101–102 (1996)
Oviatt, S., Lunsford, R., Coulston, R.: Individual differences in multimodal integration patterns: What are they and why do they exist? In: Proc. Human-Factors in Computing Systems, CHI (2005) (in press)
Oviatt, S.L., Coulston, R., Tomko, S., Xiao, B., Lunsford, R., Wesson, M., Carmichael, L.: Toward a theory of organized multimodal integration patterns during human-computer interaction. In: Proc. ICMI, pp. 44–51 (2003)
Stone, J.V., Hunkin, N.M., Porrill, J., Wood, R., Keeler, V., Beanland, M., Port, M., Porter, N.R.: When is now? Perception of simultaneity. Proc. Royal Society: Biological Sciences 268, 31–38 (2001)
Xiao, B., Girand, C., Oviatt, S.L.: Multimodal integration patterns in children. In: Proc. ICSLP, pp. 629–632 (2002)
Xiao, B., Lunsford, R., Coulston, R., Wesson, M., Oviatt, S.L.: Modeling multimodal integration patterns and performance in seniors: Toward adaptive processing of individual differences. In: Proc. ICMI, pp. 265–272 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oviatt, S., Coulston, R., Lunsford, R. (2005). Just Do What I Tell You: The Limited Impact of Instructions on Multimodal Integration Patterns. In: Ardissono, L., Brna, P., Mitrovic, A. (eds) User Modeling 2005. UM 2005. Lecture Notes in Computer Science(), vol 3538. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527886_34
Download citation
DOI: https://doi.org/10.1007/11527886_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27885-6
Online ISBN: 978-3-540-31878-1
eBook Packages: Computer ScienceComputer Science (R0)