Gun A. Lee
ABSTRACT
Public information displays are evolving from passive screens into more interactive and smarter ubiquitous computing platforms. In this research we investigate applying gesture interaction and Augmented Reality (AR) technologies to make public information displays more intuitive and easy to use. We focus especially on designing intuitive gesture based interaction methods to use in combination with an augmented virtual mirror interface. As an initial step, we conducted a user study to indentify the gestures that users feel are natural for performing common tasks when interacting with augmented virtual mirror displays. We report initial findings from the study, discuss design guidelines, and suggest future research directions.
- Azuma, R. A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 355--385.Google Scholar
Digital Library
- Cheng, K. and Takatsuka, M. Interaction Paradigms for Bare-Hand Interaction with Large Displays at a Distance. In Human-Computer Interaction, Inaki Maurtua (Ed.), InTech (2009), 195--221.Google ScholarCross Ref
- Ehara, J. and Saito, H. Texture overlay for virtual clothing based on PCA of silhouettes. In Proc. of ISMAR 2006, IEEE (2006), 139--142. Google ScholarDigital Library
- Eisert, P., Fechteler, P. and Rurainsky, J. 3-D Tracking of Shoes for Virtual Mirror Applications. In Proc. of CVPR 2008, IEEE (2008), 1 -- 6.Google ScholarCross Ref
- Hespanhol, L., Tomitsch, M., Grace, K., Collins, A. and Kay, J. Investigating Intuitiveness and Effectiveness of Gestures for Free Spatial Interaction with Large Displays. In Proc. of PerDis '12, Article 6, ACM (2012), 1--6. Google ScholarDigital Library
- Krahnstoever, N., Kettebekov, S., Yeasin, M. and Sharma, R. A real-time framework for natural multimodal interaction with large screen displays. In Proc. of ICMI 2002, IEEE (2002), 349--354. Google ScholarDigital Library
- Microsoft Kinect for Windows Retail Clothing Scenario. http://www.microsoft.com/enus/showcase/details.aspx?uuid=960852fa-9bcd-4aadb292--9b78cec28659Google Scholar
- Motta, T. and Nedel, L. Interactive Public Displays: A Gesture-Based Proposal Using Kinect. SBC Journal on 3D Interactive Systems 4, 2 (2013), 43--54.Google Scholar
- Mottura, S., Greci, L., Travaini, E., Vigano, G. and Sacco, M. MagicMirror & FootGlove: A New System for the Customized Shoe Try-on. In Proc. of 17th CIRP Design Conf., Springer (2007).441--450.Google ScholarCross Ref
- Piumsomboon, T., Clark, A., Billinghurst, M. and Cockburn, A. User-Defined Gestures for Augmented Reality. In Proc. of INTERACT 2013, Part II, LNCS 8118, IFIP (2013), 282--299.Google ScholarDigital Library
- Poupyrev, I., Billinghurst, M., Weghorst, S. and Ichikawa, T. The Go-Go Interaction Technique: Nonlinear Mapping for Direct Manipulation in VR. In Proc. of UIST '96, ACM (1996), 79--80. Google ScholarDigital Library
- Roccetti, M., Marfia, G. and Semeraro, A. Playing into the wild: A gesture-based interface for gaming in public spaces. Journal of Visual Communication and Image Representation 23, 3 (2012), 426--440. Google ScholarDigital Library
- Vera, L., Gimeno, J., Coma, I. and Fernández, M. Augmented Mirror: Interactive Augmented Reality System Based on Kinect. In Proc. of INTERACT 2011, Part IV, LNCS 6949, IFIP (2001), 483--486. Google ScholarDigital Library
- Wobbrock, J. O., Aung, H. H., Rothrock, B. and Myers, B. A. Maximizing the guessability of symbolic input. In Proc. of CHI 2005 EA, ACM (2005), 1869--1872. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R. and Wilson, A. D. User- defined gestures for surface computing. In Proc. of CHI 2009, ACM (2009), 1083--1092. Google ScholarDigital Library
Index Terms
- User Defined Gestures for Augmented Virtual Mirrors: A Guessability Study
Recommendations
User-defined gestures for augmented reality
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsRecently there has been an increase in research of hand gestures for interaction in the area of Augmented Reality (AR). However this research has focused on developer designed gestures, and little is known about user preference and behavior for gestures ...
Tactile interaction gestures: a wearable hand tactile system for interacting with ubiquitous information
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersThe aim of this research is to study how haptic and sensing on the hand enable ubiquitous interaction with information through hand gestures. A wearable tactile system for the hand is developed offering distributed sensing and tactile feedback around ...
3D gesture interaction for handheld augmented reality
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive ApplicationsIn this paper, we present a prototype for exploring natural gesture interaction with Handheld Augmented Reality (HAR) applications, using visual tracking based AR and freehand gesture based interaction detected by a depth camera. We evaluated this ...
Comments