Eve Hoggan
Stephen A. Brewster
ABSTRACT
We report the results of an exploratory 8-day field study of CrossTrainer: a mobile game with crossmodal audio and tactile feedback. Our research focuses on the longitudinal effects on performance with audio and tactile feedback, the impact of context such as location and situation on performance and personal modality preference. The results of this study indicate that crossmodal feedback can aid users in entering answers quickly and accurately using a variety of different widgets. Our study shows that there are times when audio is more appropriate than tactile and vice versa and for this reason devices should support both tactile and audio feedback to cover the widest range of environments, user preference, locations and tasks.
- Bernsen, N. O. Modality Theory in Support of Multi-modal Interface Design. ERCIM Workshop on Multi-modal HCI (1993), 27--44.Google Scholar
- Brewster, S. A. Overcoming the Lack of Screen Space on Mobile Computers. Personal and Ubiquitous Computing 6 (2002), 188--205. Google ScholarDigital Library
- Brewster, S. A. Sound in the Interface to a Mobile Computer. In Proc. HCI International '99, Lawrence Erlbaum Associates (1999), 43--47. Google ScholarDigital Library
- Brewster, S. A., Wright, P. C., and Edwards, A. D. N. Experimentally Derived Guidelines for the Creation of Earcons. In Proc. HCI '95, Springer (1995), 155--159.Google Scholar
- Brown, L. M. and Brewster, S. A. Multidimensional Tactons for Non-Visual Information Display in Mobile Devices. In Proc. MobileHCI '06, ACM Press (2006), 231--238. Google ScholarDigital Library
- Enriquez, M. and MacLean, K. The Role of Choice in Longitudinal Recall of Meaningful Tactile Signals. In Proc. IEEE Symposium on Haptic Interfaces for Virtual Environments and Teleoperator Systems, IEEE (2008), 49--56. Google ScholarDigital Library
- Garzonis, S. et al. Auditory Icon and Earcon Mobile Service Notifications: Intuitiveness, Learnability, Memorability and Preference. In Proc. CHI '09, ACM Press (2009), 1513 -- 1522. Google ScholarDigital Library
- Hoggan, E. and Brewster, S. A. Designing audio and tactile crossmodal icons for mobile devices. In Proc. ICMI '07, ACM Press (2007), 162--169. Google ScholarDigital Library
- Hoggan, E., Brewster, S. A., and Johnston, J. Investi--gating the Effectiveness of Tactile Feedback for Mo--bile Touchscreens. In Proc. CHI '08, ACM Press (2008), 1573--1582. Google ScholarDigital Library
- Hoggan, E., Crossan, A., Brewster, S. A., and Kaaresoja, T. Audio or Tactile Feedback: Which Modality When? In Proc. CHI '09, ACM Press (2009), 2253--2256. Google ScholarDigital Library
- Kaaresoja, T., Brown, L. M., and Linjama, J. Snap-Crackle-Pop: Tactile Feedback for Mobile Touch Screens. In Proc. Eurohaptics, (2006), 565--566.Google Scholar
- Koskinen, E., Kaaresoja, T., and Laitinen, P. Feel-Good Touch: Finding the Most Pleasant Tactile Feed-back for a Mobile Touch Screen Button. In Proc. ICMI '08, ACM Press (2008), 297--304. Google ScholarDigital Library
- Laitinen, P. and Mäenpää, J. Enabling Mobile Haptic Design: Piezoelectric Actuator Technology Properties in Handheld Devices. In Proc. HAVE '06, (2006).Google ScholarCross Ref
- Lederman, S. J. and Klatzky, R. L. New Directions in Touch. Canadian Journal of Experimental Psychology 61 (2007), 169--170.Google ScholarCross Ref
- Lee, S. and Zhai, S. The Performance of Touch Screen Soft Buttons. In Proc. CHI '09, ACM Press (2009), 309--318. Google ScholarDigital Library
- Lewkowicz, D. J. The Development of Intersensory Temporal Perception: An Epigenetic Systems/Limitations View. Psychological Bulletin 126 (2000), 281--308.Google Scholar
- Luk, J. et al. A role for haptics in mobile interaction: initial design using a handheld tactile display prototype In Proc. CHI '06, ACM Press (2006), 171--180. Google ScholarDigital Library
- Mackenzie, I. S., Zhang, S., and Soukoreff, R. W. Text Entry Using Soft Keyboards. Behaviour and Information Technology 18 (1999), 235--244.Google ScholarCross Ref
- Mortimer, B., Zets, G., and Cholewiak, R. W. Vibrotactile Transduction and Transducers. The Journal of the Acoustic Society of America 121 (2007), 2970--2977.Google Scholar
- Poupyrev, I. and Maruyama, S. Tactile Interfaces for Small Touch Screens. In Proc. 16th Annual ACM Sym--posium on User Interface Software and Technology, ACM Press (2003), 217--220. Google ScholarDigital Library
- Soukoreff, R. W. and MacKenzie, I. S. Metrics for Text Entry Research: an Evaluation of MSD and KSPC, and a new Unified Error Metric. In Proc. CHI '03, ACM Press (2003), 113--120. Google ScholarDigital Library
- Williamson, J., Murray-Smith, R., and Hughes, S. Shoogle: excitatory multimodal interaction on mobile devices. In Proc. CHI'07, ACM Press (2007), 121--124. Google ScholarDigital Library
Index Terms
- Crosstrainer: testing the use of multimodal interfaces in situ
Recommendations
Investigating the effectiveness of tactile feedback for mobile touchscreens
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThis paper presents a study of finger-based text entry for mobile devices with touchscreens. Many devices are now coming to market that have no physical keyboards (the Apple iPhone being a very popular example). Touchscreen keyboards lack any tactile ...
Audio or tactile feedback: which modality when?
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWhen designing interfaces for mobile devices it is import-ant to take into account the variety of contexts of use. We present a study that examines how changing noise and dis-turbance in the environment affects user performance in a touchscreen typing ...
Crossmodal congruence: the look, feel and sound of touchscreen widgets
ICMI '08: Proceedings of the 10th international conference on Multimodal interfacesOur research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, ...
Comments