Wenjie Wu
Stefan Rank
ABSTRACT
Touch-less hand gestures require a structured approach towards the design of audio feedback, especially in audio-only environments. We present an implementation approach for responsive audio feedback geared towards hand gestures in audio-only games, focusing on diegetic environmental feedback before, during, and after gestures. The developed framework is used in a project investigating the usefulness of different feedback designs. Preliminary results suggest that the implemented game variants are both rated highly in terms of usability and enjoyment, and that replacing explicit audio instructions for hand positions and movements with responsive audio feedback for suggesting interaction methods using environmental story-related audio cues leads to higher immersion.
- Brockmyer, J., Fox, C., Curtiss, K., McBroom, E., Burkhart, K. M., and N.Pidruzny, J. The development of the game engagement questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45 (2009), 624--634.Google Scholar
Cross Ref
- Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., and Walton, A. Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies 66 (2008), 641--661. Google ScholarDigital Library
- Liljedahl, M., Papworth, N., and Lindberg, S. Beowulf an audio mostly game. In Proceedings of the international conference on advances in computer entertainment technology., New York, NY, USA (2007), 200--203. Google ScholarDigital Library
- Norman, D. Natural user interfaces are not natural. Interactions 17 (2010), 6--10. Google ScholarDigital Library
- O'Hara, K., Harper, R., Mentis, H., Sellen, A., and Taylor, A. On the naturalness of touchless: Putting the interaction back into NUI. ACM Trans. Comput.-Hum. Interact 20. Google ScholarDigital Library
- Papworth, N. ispooks: an audio focused game design. In Proceedings of the 5th Audio Mostly Conference., Pite, Sweden (2010), 1--8. Google ScholarDigital Library
- Roden, T. E., Parberry, I., and Ducrest, D. Toward mobile entertainment: A paradigm for narrative-based audio only games. Science of Computer Programming 67 (2007s), 76--90. Google ScholarDigital Library
Index Terms
- Responsive Environmental Diegetic Audio Feedback for Hand Gestures in Audio-Only Games
Recommendations
Spatial Audio Feedback for Hand Gestures in Games
SUI '15: Proceedings of the 3rd ACM Symposium on Spatial User InteractionWe use game prototypes to investigate different audio feedback designs for hand gestures for encouraging immersion. Replacing explicit audio instructions for hand positions and movements with responsive audio feedback, suggestive of interaction methods ...
Audio Feedback Design Principles for Hand Gestures in Audio-Only Games
AM '15: Proceedings of the Audio Mostly 2015 on Interaction With SoundThe design of audio feedback for touch-less gesture interaction with audio-only environments requires a structured approach. We present design principles for responsive audio feedback geared towards hand gestures in audio-only games, focusing on ...
Abacus Gestures: A Large Set of Math-Based Usable Finger-Counting Gestures for Mid-Air Interactions
Designing an extensive set of mid-air gestures that are both easy to learn and perform quickly presents a significant challenge. Further complicating this challenge is achieving high-accuracy detection of such gestures using commonly available hardware, ...
Comments