Teemu Ahmaniemi
ABSTRACT
Proper feedback is one of the challenges in gesture interaction. Providing continuous feedback during the execution of the gesture increases the feeling of control and it can help user to perform the task more efficiently. In this paper we introduce an experimental handheld sensor-actuator device that responds dynamically to user's motion. With the device we explored the potential of continuous audiotactile feedback in closed-loop gesture interaction, designed simple synthesis methods for feedback, and tested the user perception. We designed four simple textures that respond to overall angular velocity of the device, all with different velocity responses. The system enabled us to examine how well subjects can distinguish the textures on the fly. Our preliminary findings show that audio modality dominates the perception. Tactile feedback worked quite well alone but the modalities together didn't lead to any better performance than audio alone.
- Norman, D., A. 1990. The Design of Everyday Things. Currency/Doubleday, New York. 9--12, 87--104.Google Scholar
- Mononen, K. 2007. The Effects of Augmented Feedback on Motor Skill Learning in Shooting, A Feedback Training Intervention among Inexperienced Rifle Shooters, Doctoral Thesis, University of Jyväskylä.Google Scholar
- Rath, M., and Rohs, M. 2006. Explorations in Sound for Tilting-based Interfaces. Proceedings of the 8th international conference on Multimodal interfaces, Banff, Alberta, Canada. Google ScholarDigital Library
- Williamson, J. and Murray-Smith, 2002. R. Audio feedback for gesture recognition. Technical Report, Department of Computing Science, University of Glasgow, Glasgow.Google Scholar
- Tandler, P. and Prante, T. 2001. Using Incremental Gesture Recognition to Provide Immediate Feedback while Drawing Pen Gestures. Unpublished Tech. Note. http://www.ipsi.fraunhofer.de/Google Scholar
- Williamson, J., Murray-Smith. R. and Hughes, S. 2007. Shoogle: Excitatory Multimodal Interaction on Mobile Devices. Proceedings of ACM SIG CHI Conference, San Jose. Google ScholarDigital Library
- Brown, L., Brewster, S., A., Purchase, H., C. 2005. A First Investigation into the Effectiveness of Tactons. Proceedings of WorldHaptics, Pisa, Italy. Google ScholarDigital Library
- Brown, L. M. and Kaaresoja, T. 2006. Feel Who's Talking: Using Tactons for Mobile Phone Alerts. Extended Abstracts of CHI, Montreal, Canada. Google ScholarDigital Library
- Symmons, M., A., Richardson, B., L., Wuillemin, D., B., VanDoorn, G., H. 2005. Active versus passive touch in three dimensions. Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Pisa, Italy. Google ScholarDigital Library
- Sherrick, C., E., and Craig, J., C. 1982. The Psychophysics of Touch, Tactual Perception: A Sourcebook, W. Schiff and E. Foulke, eds., Cambridge University Press, 55--81.Google Scholar
Index Terms
- Dynamic audiotactile feedback in gesture interaction
Recommendations
Fluid gesture interaction design: Applications of continuous recognition for the design of modern gestural interfaces
This article presents Gesture Interaction DEsigner (GIDE), an innovative application for gesture recognition. Instead of recognizing gestures only after they have been entirely completed, as happens in classic gesture recognition systems, GIDE exploits ...
3D gesture interaction for handheld augmented reality
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive ApplicationsIn this paper, we present a prototype for exploring natural gesture interaction with Handheld Augmented Reality (HAR) applications, using visual tracking based AR and freehand gesture based interaction detected by a depth camera. We evaluated this ...
Gesture interaction for wall-sized touchscreen display
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationIn order to improve the user experience in a large touchscreen, this research introduces gesture interaction into wall-sized touchscreen. According to the distance between user and display, we create two interaction modes for touch and body gesture ...
Comments