Hao Lü
ABSTRACT
Finger-based touch input has become a major interaction modality for mobile user interfaces. However, due to the low precision of finger input, small user interface components are often difficult to acquire and operate on a mobile device. It is even harder when the user is on the go and unable to pay close attention to the interface. In this paper, we present Gesture Avatar, a novel interaction technique that allows users to operate existing arbitrary user interfaces using gestures. It leverages the visibility of graphical user interfaces and the casual interaction of gestures. Gesture Avatar can be used to enhance a range of mobile interactions. A user study we conducted showed that compared to Shift (an alternative technique for target acquisition tasks), Gesture Avatar performed at a much lower error rate on various target sizes and significantly faster on small targets (1mm). It also showed that using Gesture Avatar while walking did not significantly impact its performance, which makes it suitable for mobile uses.
Supplemental Material
- Albinsson, P.-A. and Zhai, S. High precision touch screen interaction. Proc. CHI 2003, ACM Press (2003), 105--112. Google Scholar
Digital Library
- Android (operating system). http://en.wikipedia.org/wiki/Android_(operating_system).Google Scholar
- Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. Proc. CHI 2009, ACM Press (2009), 1923--1932. Google ScholarDigital Library
- Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. Proc. CHI 2006, ACM Press (2006), 1263--1272. Google ScholarDigital Library
- Bishop, C. M. Pattern Recognition and Machine Learning (Information Science and Statistics). 2006. Google ScholarDigital Library
- Blanch, R., Guiard, Y., and Beaudouin-Lafon, M. Semantic pointing: improving target acquisition with control-display ratio adaptation. Proc. CHI 2004, ACM Press (2004), 519--526. Google ScholarDigital Library
- Dixon, M. and Fogarty, J. Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure. Proc. CHI 2010, ACM Press (2010), 1525--1534. Google ScholarDigital Library
- Document Object Model. http://en.wikipedia.org/wiki/Document_Object_Model.Google Scholar
- Dulberg, M. S., Amant, R. S., and Zettlemoyer, L. S. An Imprecise Mouse Gesture for the Fast Activation of Controls. INTERACT, (1999), 375--382.Google Scholar
- Fitts, P. M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology 47, 6 (1954), 381--391.Google Scholar
- Grossman, T. and Balakrishnan, R. The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area. Proc. CHI 2005, ACM Press (2005), 281--290. Google ScholarDigital Library
- iPhone 4. http://en.wikipedia.org/wiki/IPhone_4.Google Scholar
- Kabbash, P., Buxton, W., and Sellen, A. Two-handed input in a compound task. Proc. CHI 1994, ACM Press (1994), 417--423. Google ScholarDigital Library
- Kara, L. B. and Stahovich, T. F. An Image-Based Trainable Symbol Recognizer for Sketch-Based Interfaces. AAAI Fall Symposium Series 2004: Making Pen-Based Interaction Intelligent and Natural, (2004).Google Scholar
- Li, Y., Hinckley, K., Guan, Z., and Landay, J. A. Experimental analysis of mode switching techniques in pen-based user interfaces. Proc. CHI 2005, ACM Press (2005), 461--470. Google ScholarDigital Library
- Norman, D. A. The way I see it: natural user interfaces are not natural. Interactions 17, 3 (2010), 6--10. Google ScholarDigital Library
- OpenCV. http://opencv.willowgarage.com/wiki/.Google Scholar
- Potter, R. L., Weldon, L. J., and Shneiderman, B. Improving the accuracy of touch screens: an experimental evaluation of three strategies. Proc. CHI 1988, ACM Press (1988), 27--32. Google ScholarDigital Library
- Ramos, G., Cockburn, A., Balakrishnan, R., and Beaudouin-Lafon, M. Pointing Lenses : Facilitating Stylus Input through Visual- and Motor-Space Magnification. Proc. CHI 2007, ACM Press (2007), 757--766. Google ScholarDigital Library
- Vogel, D. and Baudisch, P. Shift: a technique for operating pen-based interfaces using touch. Proc. CHI 2007, ACM Press (2007), 657--666. Google ScholarDigital Library
- Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. LucidTouch : a see-through mobile device. Proc. UIST 2007, ACM Press (2007), 269--278. Google ScholarDigital Library
- Wigdor, D., Leigh, D., Forlines, C., et al. Under the table interaction. Proc. UIST 2006, ACM Press (2006), 259--268. Google ScholarDigital Library
- Worden, A., Walker, N., Bharat, K., and Hudson, S. Making computers easier for older adults to use: area cursors and sticky icons. Proc. CHI 1997, ACM Press (1997), 266--271. Google ScholarDigital Library
- Yatani, K., Partridge, K., Bern, M., and Newman, M. W. Escape: a target selection technique using visually-cued gestures. Proc. CHI 2008, ACM Press (2008), 285--294. Google ScholarDigital Library
Index Terms
- Gesture avatar: a technique for operating mobile user interfaces using gestures
Recommendations
HoverFlow: expanding the design space of around-device interaction
MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and ServicesIn this paper we explore the design space of around-device interaction (ADI). This approach seeks to expand the interaction possibilities of mobile and wearable devices beyond the confines of the physical device itself to include the space around it. ...
Interaction and recognition challenges in interpreting children's touch and gesture input on mobile devices
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesAs mobile devices like the iPad and iPhone become increasingly commonplace, touchscreen interactions are quickly overtaking other interaction methods in terms of frequency and experience for many users. However, most of these devices have been designed ...
BezelCursor: bezel-initiated cursor for one-handed target acquisition on mobile touch screens
SA '13: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive ApplicationsUnimanual interaction allows the user to operate the mobile device in a distracted, multitasking scenario and frees the other hand for tasks like carrying a bag, writing a relevant note etc. In such scenarios, the thumb of the hand holding the device is ...
Comments