Cristóbal Martinez
ABSTRACT
HandJabber is a movement-based interactive sound installation and research environment for exploring collaborative creative expression. HandJabber utilizes the emergence of semantic meanings from gesture and interpersonal behavior as a single interface for music performance by responding to an individual participant's hand and arm gestures, and reacting to the non-verbal interpersonal behavior between two participants. Within this context, we explore three major areas of non-verbal behavior, (a) metaphoric hand and arm gesture, (b) interpersonal space, and (c) body orientation. Our poster presents results from informal user and case studies.
- Calbris, G. (1990). The Semiotics of French Gestures. (O. Doyle, Trans.). Bloomington, Indianapolis: Indiana University Press, 57--69, 85--93.Google Scholar
- Hall, J. A., Coats, J. E., and LeBeau, L. S. (2005). Nonverbal Behaviors and the Vertical Dimensions of Social Relations: A Meta-Analysis. Psychological Bulletin. 131, 6, 898--924.Google ScholarCross Ref
- Knapp, M. L., and Hall, J. A. (2007). Nonverbal Communication in Human Interaction (5th ed.). Belmont, CA: Wadsworth/Thomas Learning, 164--74, 369.Google Scholar
- Krueger, W. M. (2003). Responsive Environments. The New Media Reader (W.-F. Ed.). Cambridge, MA: The MIT Press (Originally published 1996).Google Scholar
- McNeill, D. (1996). Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Google Scholar
- Oviatt, S. and Cohen, P. (2000). Multimodal interfaces that process what comes naturally. Communications of the ACM, 43(3): 46. Google ScholarDigital Library
Index Terms
- HandJabber: an enactive framework for collaborative creative expression
Recommendations
Multimodal Collaboration in Expository Discourse: Verbal and Nonverbal Moves Alignment
Speech and ComputerAbstractThe paper explores multimodal collaboration in expository discourse considering verbal and nonverbal moves used by the participants in turn-taking. It reports the results of an experiment which tested speech, gesture and gaze alignment as affected ...
Non-Touch Hand Gesture Based Interface Design for 3D Sculpting System
HCIK '16: Proceedings of HCI KoreaGesture recognition technology provides new types of interaction from content consumption domain to productivity domain. The natural hand gesture is also applicable for art and design such as non-touch 3D sculpting system. This study aims to analyze ...
Statistical segmentation and recognition of fingertip trajectories for a gesture interface
ICMI '07: Proceedings of the 9th international conference on Multimodal interfacesThis paper presents a virtual push button interface created by drawing a shape or line in the air with a fingertip. As an example of such a gesture-based interface, we developed a four-button interface for entering multi-digit numbers by pushing ...
Comments