Teemu Tuomas Ahmaniemi
ABSTRACT
In this paper we present results of a study where perception of dynamic audiotactile feedback to gesture input was examined. Our main motivation was to investigate how users' active input and different modality conditions effect the perception of the feedback. The experimental prototype in the study was a handheld sensor-actuator device that responds dynamically to user's hand movements creating an impression of a virtual texture. The feedback was designed so that the amplitude and frequency of texture were proportional to the overall angular velocity of the device. We used four different textures with different velocity responses. The feedback was presented to the user by the tactile actuator in the device, by audio through headphones, or by both. During the experiments, textures were switched in random intervals and the task of the user was to detect the changes while moving the device freely. The performances of the users with audio or audiotactile feedback were quite equal while tactile feedback alone yielded poorer performance. The texture design didn't influence the movement velocity or periodicity but tactile feedback induced most and audio feedback the least energetic motion. In addition, significantly better performance was achieved with slower motion. We also found that significant learning happened over time; detection accuracy increased significantly during and between the experiments. The masking noise used in tactile modality condition did not significantly influence the detection accuracy when compared to acoustic blocking but it increased the average detection time.
- Ahmaniemi, T., Lantz V., Marila J.,2008. Dynamic Audiotactile Feedback in Gesture Interaction. Proceedings of the 10th International Conference on Human-Computer Interaction with Mobile Devices and Services, Amsterdam, the Netherlands. Google Scholar
Digital Library
- Brown, L., Brewster, S., A., Purchase, H., C. 2005. A First Investigation into the Effectiveness of Tactons. Proceedings of WorldHaptics, Pisa, Italy. Google ScholarDigital Library
- Dalton, B., Behm, D., 2007. Effects of noise and music on human and task performance: A systematic review Occupational Ergonomics, 7(3), 143--152.Google Scholar
- Goldin-Meadow, S. 2006. The Hand's Role in Talking and Thinking, Handbook pp. 336--369.Google Scholar
- Hoggan, E., and Brewster, S. Designing Audio and Tactile Crossmodal Icons for Mobile Devices, 2006. Proceedings of ACM International Conference on Multimodal Interfaces, Nagoya, Japan. ACM Press, 162--169. Google ScholarDigital Library
- http://www.gras.dk/00012/00058/00166/00344/, 13.5.2008.Google Scholar
- Jousmäki, V., and Hari, R. 1998, Parchment-skin illusion: sound--biased touch. Current Biology, 1998, 8(6) 190--191.Google Scholar
- Lederman, S.J., Klatzky, R.L., Martin, A. & Tong, C. 2003. Relative performance using haptic and/or touch-produced auditory cues in a remote absolute texture identification task. IEEE VR'03, 11th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 151--158. Google ScholarDigital Library
- Mononen, K. 2007. The Effects of Augmented Feedback on Motor Skill Learning in Shooting, A Feedback Training Intervention among Inexperienced Rifle Shooters, Doctoral Thesis, University of Jyväskylä.Google Scholar
- Norman, D., A. 1990. The Design of Everyday Things. Currency/Doubleday, New York. 9--12, 87--104.Google Scholar
- Oakley, I., Park J., 2008. Did you feel something? Distracter tasks and recognition of vibrotactile cues. Interacting with Computers, 20(2008), 354--363. Google ScholarDigital Library
- Rath, M., and Rohs, M. 2006. Explorations in Sound for Tilting--based Interfaces. Proceedings of the 8th international conference on Multimodal interfaces, Banff, Alberta, Canada. Google ScholarDigital Library
- Salminen, K., Surakka, V., Lylykangas, J., Raisamo, J., Saarinen, R., Raisamo, R., Rantala, J., and Evreinov, G. 2008. Emotional and Behavioral Responses to Haptic Stimulation. Proceeding of the twenty--sixth annual SIGCHI conference on Human factors in computing systems. Florence, Italy. ACM Press, NY, USA, 1555--1562. Google ScholarDigital Library
- Toivonen M, Rauno P., Savolainen S., Lehtomäki K. 2002. Noise Attenuation and Proper Insertion of Earplugs into Ear Canals. Ann. Occup. Hyg. 46 (6), 527--530, Oxford University Press.Google Scholar
- Williamson, J. and Murray-Smith, 2002. R. Audio feedback for gesture recognition. Technical Report, Department of Computing Science, University of Glasgow, Glasgow.Google Scholar
Index Terms
- Perception of dynamic audiotactile feedback to gesture input
Recommendations
Dynamic audiotactile feedback in gesture interaction
MobileHCI '08: Proceedings of the 10th international conference on Human computer interaction with mobile devices and servicesProper feedback is one of the challenges in gesture interaction. Providing continuous feedback during the execution of the gesture increases the feeling of control and it can help user to perform the task more efficiently. In this paper we introduce an ...
Audio-haptic feedback in mobile phones
CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing SystemsA new breed of mobile phones has been designed to enable concurrent vibration and audio stimulation, or audio-haptics. This paper aims to share techniques for creating and optimizing audio-haptic effects to enhance the user interface.The authors present ...
Haptic Feedback to the Palm and Fingers for Improved Tactile Perception of Large Objects
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyWhen one manipulates a large or bulky object, s/he utilizes tactile information at both fingers and the palm. Our goal is to efficiently convey contact information to a user's hand during interaction with a virtual object. We propose a haptic system ...
Comments