Abstract
Over the last few years, a growing number of IT devices have started to incorporate touch-screen technology in order to create more effective multimodal user interfaces. The use of such technology has opened up the possibility of presenting different kinds of tactile feedback (i.e., active vs. passive) to users. Here, we report 2 experiments designed to investigate the spatiotemporal constraints on the multisensory interaction between vision and touch as they relate to a user’s active vs. passive interaction with a touch screen device. Our results demonstrate that when touch is active, tactile perception is less influenced by irrelevant visual stimulation than when passively touching the screen. Our results also show that vision has to lead touch by approximately 40ms in order for optimal simultaneity to be perceived, no matter whether touch is active or passive. These findings provide constraints for the future design of enhanced multimodal interfaces.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Brewster, S., Chohan, F., Brown, L.: Tactile feedback for mobile interaction. In: Proc. CHI 2007, pp. 159–162. ACM Press, New York (2007)
Brown, L., Brewster, S., Purchase, H.: A first investigation into the effectiveness of tactons. In: Proc. World Haptics 2005, pp. 167–176. IEEE Press, Los Alamitos (2005)
Hoggan, E., Brewster, S.: Crossmodal icons for information display. In: Proc. CHI 2006, pp. 857–862. ACM Press, New York (2006)
Tan, H., Pentland, A.: Tactual displays for wearable computing. In: Proc. ISWC 1997, pp. 225–230. IEEE Press, Los Alamitos (1997)
Gallace, A., Tan, H., Spence, C.: The failure to detect tactile change: A tactile analogue of visual change blindness. Psychon. Bull. Rev. 13, 300–303 (2006)
Spence, C., Pavani, F., Maravita, A., Holmes, N.: Multisensory contributions to the representation of peripersonal space in humans. In: Lin, M. (ed.): Haptic rendering: Foundations, algorithms, and applications. Wellesley, MA: AK Peters (in press)
Spence, C., Shore, D.I., Klein, R.M.: Multisensory prior entry. J. Exp. Psychol. Gen. 130, 799–832 (2001)
Zampini, M., Shore, D.I., Spence, C.: Audiovisual temporal order judgments. Exp. Brain Res. 152, 198–210 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, JH., Spence, C. (2008). Spatiotemporal Visuotactile Interaction. In: Ferre, M. (eds) Haptics: Perception, Devices and Scenarios. EuroHaptics 2008. Lecture Notes in Computer Science, vol 5024. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69057-3_104
Download citation
DOI: https://doi.org/10.1007/978-3-540-69057-3_104
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69056-6
Online ISBN: 978-3-540-69057-3
eBook Packages: Computer ScienceComputer Science (R0)