Matthew S. Prewett
ABSTRACT
Information display systems have become increasingly complex and more difficult for human cognition to process effectively. Based upon Wicken's Multiple Resource Theory (MRT), information delivered using multiple modalities (i.e., visual and tactile) could be more effective than communicating the same information through a single modality. The purpose of this meta-analysis is to compare user effectiveness when using visual-tactile task feedback (a multimodality) to using only visual task feedback (a single modality). Results indicate that using visual-tactile feedback enhances task effectiveness more so than visual feedback (g = .38). When assessing different criteria, visual-tactile feedback is particularly effective at reducing reaction time (g = .631) and increasing performance (g = .618). Follow up moderator analyses indicate that visual-tactile feedback is more effective when workload is high (g = .844) and multiple tasks are being performed (g = .767). Implications of results are discussed in the paper.
- Wickens, C., (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 2, 159--177.Google Scholar
Cross Ref
- Chiasson, J., McGrath, B., & Rupert, A. (2002). Enhanced situation awareness in sea, air, and land environment. In Proceedings of NATO RTO Human Factors & Medicine Panel Symposium on "Spatial disorientation in military vehicles: Causes, consequences and cures," La Coruñña, Spain, No. TRO-MP-086, 1--10.Google Scholar
- Van Erp, J. & Van Veen, H. (2004). Vibrotactile in-vehicle navigation system. Transportation Research Part F, 247--256.Google Scholar
- Wilson, D. B. (2001). Effect size determination program. Software.Google Scholar
- Hedges, L. V., & Olkin, I. O. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press, Inc.Google Scholar
- Borenstein, M., & Rothstein, H. (1999). Comprehensive meta-analysis: A computer program for research synthesis. Englewood, NJ: Biostat.Google Scholar
- Akamatsu, M., & Sato, S. (1994). A multimodal mouse with tactile and force feedback. International Journal of Human-Computer Studies, 40(3), 443--453. Google ScholarDigital Library
- Cockburn, A., Firth, A. (2003). Improving the acquisition of small targets. In proceedings of the HCI, 181--196.Google Scholar
- Diamond, D. D., Kass, S. J., Andrasik, F., Raj, A. K., & Rupert, A. H. (2002). Vibrotactile cueing as a master caution system for visual monitoring. Human Factors & Aerospace Safety, 2(4), 339--354.Google Scholar
- Forster, B., Cavina-Pratesi, C., Aglioti, S. M., & Berlucchi, G. (2002). Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time. Experimental Brain Research, 143(4), 480--487.Google ScholarCross Ref
- He, F., & Agah, A. (2001). Multi-modal human interactions with an intelligent interface utilizing images, sounds, and force feedback. Journal of Intelligent & Robotic Systems, 32(2), 171--190. Google ScholarDigital Library
- Hopp, P. J., Smith, C. A. R., Clegg, B. A., & Heggestad, E. D. (2005). Interruption management: The use of attention-directing tactile cues. Human Factors, 47(1), 1--11.Google ScholarCross Ref
- Hwang, F., Keates, S., Langdon, P., & Clarkson, P. J. (2003). Multiple haptic target for motion-impaired computer users. CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Ft. Lauderdale, Florida, USA, 41--48. Google ScholarDigital Library
- Lindeman, R. W., Sibert, J. L., Mendez-Mendez, E., Patil, S., & Phifer, D. (2005). Effectiveness of directional vibrotactile cuing on a building-clearing task. CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Portland, Oregon, USA, 271--280. Google ScholarDigital Library
- Lindeman, R. W., Yanagida, Y., Sibert, J. L., & Lavine, R. (2003). Effective vibrotactile cueing in a visual search task. Proceedings of the Ninth IFIP TC13 International Conference on Human-Computer Interaction (INTERACT 2003), Sept. 1-5, 2003, Zurich, Switzerland, pp. 89--96.Google Scholar
- McGee, M. R. (1999). A haptically enhanced scrollbar: Force-Feedback as a means of reducing the problems associated with scrolling, First PHANTOM Users Research Symposium, May, Deutsches Krebsforschungszentrum, Heidelberg, Germany.Google Scholar
- Moorhead, I. R., Holmes, S., & Furnell, A. (2004). Understanding multisensory integration for pilot spatial orientation. QINETIQ/KI/CHS/TR042277.Google Scholar
- Oakley, I., McGee, M. R., Brewster, S., & Gray, P. (2000). Putting the feel in 'look and feel'. CHI '00: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, The Hague, The Netherlands, 415--422. Google ScholarDigital Library
- Oakley, I., & O'Modhrain, S. (2005). Tilt to scroll: Evaluating a motion based vibrotactile mobile interface. WHC '05: Proceedings of the 1st joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Pisa, Italy, 40--49. Google ScholarDigital Library
- Swindells, C., Unden, A., & Sang, T. (2003). Torque BAR: An ungrounded haptic feedback device. ICMI '03: Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver, British Columbia, Canada, 52--59. Google ScholarDigital Library
- Tang, H., Beebe, D. J., & Kramer, A. F. (1997). Comparison of tactile and visual feedback for a multi-state input mechanism. IEMBS '97: Proceedings of the 19th annual international conference of the IEEE engineering in medicine and biology society, Chicago, Illinois, USA, 4 1697--1700.Google Scholar
- Unger, B. J., Nicolaidis, A., Berkelman, P. J., Thompson, A., Lederman, S., & Klatzky, R. L. et al. (2002). Virtual peg-in-hole performance using a 6-DOF magnetic levitation haptic device: Comparison with real forces and with visual guidance alone. HAPTIC '02: Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Orlando, Florida, USA, 263--270. Google ScholarDigital Library
- Van Erp, J. B. F., & Verschoor, M. H. (2004). Cross-modal visual and vibrotactile tracking. Applied Ergonomics, 35(2), 105--112.Google ScholarCross Ref
Index Terms
- The benefits of multimodal information: a meta-analysis comparing visual and visual-tactile feedback
Recommendations
Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis
ICMI '06: Proceedings of the 8th international conference on Multimodal interfacesIn a meta-analysis of 43 studies, we examined the effects of multimodal feedback on user performance, comparing visual-auditory and visual-tactile feedback to visual feedback alone. Results indicate that adding an additional modality to visual feedback ...
Multimodal imaging of incidental retrieval: The low route to memory
Memories of past episodes frequently come to mind incidentally, without directed search. It has remained unclear how incidental retrieval processes are initiated in the brain. Here we used fMRI and ERP recordings to find brain activity that specifically ...
Estimation of brain response to multimodal stimuli by index of spatiotemporal locality by magnetoencephalography
AbstractBrain‐computer interface (BCI) enables people who cannot move their own body freely to manipulate machines and helps their communication and life. Recent brain‐computer interface (BCI) uses multimodal stimuli to increase bit rate of the system, so ...
Comments