Wenjie Wu
Stefan Rank
ABSTRACT
We use game prototypes to investigate different audio feedback designs for hand gestures for encouraging immersion. Replacing explicit audio instructions for hand positions and movements with responsive audio feedback, suggestive of interaction methods by using environmental story-related audio cues, leads to measurably higher immersion. We present the design of responsive audio feedback for hand gestures in the context of such a game. The spatial organization of diegetic environmental feedback before, during, and after gesture input is supported by a structured approach towards the design of audio cues.
Supplemental Material
Available for Download
Poster Board
- D. Norman. Natural user interfaces are not natural. Interactions, 17:6--10, 2010. Google Scholar
Digital Library
- K. O'Hara, R. Harper, H. Mentis, A. Sellen, and A. Taylor. On the naturalness of touchless: Putting the "interaction" back into NUI. ACM Trans. Comput.-Hum. Interact, 20. Google ScholarDigital Library
Index Terms
- Spatial Audio Feedback for Hand Gestures in Games
Recommendations
Responsive Environmental Diegetic Audio Feedback for Hand Gestures in Audio-Only Games
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in PlayTouch-less hand gestures require a structured approach towards the design of audio feedback, especially in audio-only environments. We present an implementation approach for responsive audio feedback geared towards hand gestures in audio-only games, ...
Audio Feedback Design Principles for Hand Gestures in Audio-Only Games
AM '15: Proceedings of the Audio Mostly 2015 on Interaction With SoundThe design of audio feedback for touch-less gesture interaction with audio-only environments requires a structured approach. We present design principles for responsive audio feedback geared towards hand gestures in audio-only games, focusing on ...
Abacus Gestures: A Large Set of Math-Based Usable Finger-Counting Gestures for Mid-Air Interactions
Designing an extensive set of mid-air gestures that are both easy to learn and perform quickly presents a significant challenge. Further complicating this challenge is achieving high-accuracy detection of such gestures using commonly available hardware, ...
Comments