John Payne
ABSTRACT
We describe preliminary tests that form the first phase of research into issues involved with the design of spatial 3D gestures for video games. Early research on 3D gesture and spatial interaction was largely the domain of Virtual Reality (VR) [1]. More recent work looks at 3D gestures for mobile devices [2] and pervasive computing [3]. We are investigating issues affecting usability and fun [4] in the context of 3D gestures and spatial movement in video games where emotion, immediacy and immersion are more important than breadth of functionality and user task efficiency. These tests use our 3motion™ system, a wireless inertial motion tracking device and gesture SDK. This enables a range of gesture types from tight, precise movements to whole arm gestures, and from direct mapping of movement to recognition of 3D symbolic gestures. Four game scenarios using different spatial gesture characteristics were used to identify gameplay issues that have an impact on the design of 3D interaction.
- Hinckley, K. Pausch, R. Goble, J.C. Kassell, N.F. A Survey of Design Issues in Spatial Input. In Proc. 7th annual ACM symposium on user interface software and technology (1994) 213--222]] Google Scholar
Digital Library
- Marentakis, G. Brewster, S.A. A Study on Gestural Interaction with a 3D Audio Display. In Proc. Mobile HCI (2004) Vol. 3160, 180--191]]Google Scholar
- Corradini, A. Wesson, M.R. Cohen, P.R. A Map-Based System using Speech and 3D gesture for Pervasive Computing. In Proc. 4th IEEE ICMI (2002) 191.]] Google ScholarDigital Library
- Malone, T.W. What Makes Things Fun to Learn? Heuristics for Designing Instructional Computer Games. In Proc. 3rd ACM SIGSMALL symposium (1980) 162--169]] Google ScholarDigital Library
- Bolt, R. "Put That There": Voice and Gesture at the Graphics Interface. In Proc. SIGGRAPH '80, ACM Press (1980) 262--270]] Google ScholarDigital Library
- Keir, P. Elgoyhen, J. Naef, M. Payne, J. Horner, M. Anderson, P. Gesture-recognition with non-referenced tracking. 1st IEEE Symposium on 3D User interfaces (2006).]] Google ScholarDigital Library
- Kent, S. L. The first quarter: a 25-year history of video games. Bothwell, WA, BWD Press (2000)]] Google ScholarDigital Library
Index Terms
- Gameplay issues in the design of spatial 3D gestures for video games.
Recommendations
Understanding 3D mid-air hand gestures with interactive surfaces and displays: a systematic literature review
HCI '16: Proceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!3D gesture based systems are becoming ubiquitous and there are many mid-air hand gestures that exist for interacting with digital surfaces and displays. There is no well defined gesture set for 3D mid-air hand gestures which makes it difficult to ...
Developing Intuitive Gestures for Spatial Interaction with Large Public Displays
Proceedings of the Third International Conference on Distributed, Ambient, and Pervasive Interactions - Volume 9189Freehand gestures used in gestural-based interactive systems are often designed around technical limitations of gesture capturing technologies, resulting in gestures that may not be intuitive to users. In this paper, we investigated freehand gestures ...
Designing concurrent full-body gestures for intense gameplay
Full body gestures provide alternative input to video games that are more natural and intuitive. However, full-body game gestures designed by developers may not always be the most suitable gestures available. A key challenge in full-body game gestural ...
Comments