Gilles Bailly
Dong-Bach Vo
ABSTRACT
Interaction with TV sets, set-top boxes or media centers strongly differs from interaction with personal computers: not only does a typical remote control suffer strong form factor limitations but the user may well be slouching in a sofa. In the face of more and more data, features, and services made available on interactive televisions, we propose to exploit the new capabilities provided by gesture-aware remote controls. We report the data of three user studies that suggest some guidelines for the design of a gestural vocabulary and we propose five novel interaction techniques. Study 1 reports that users spontaneously perform pitch and yaw gestures as the first modality when interacting with a remote control. Study 2 indicates that users can accurately select up to 5 items with eyes-free roll gestures. Capitalizing on our findings, we designed five interaction techniques that use either device motion, or button-based interaction, or both. They all favor the transition from novice to expert usage for selecting favorites. Study 3 experimentally compares these techniques. It reveals that motion of the device in 3D space, associated with finger presses at the surface of the device, is achievable, fast and accurate. Finally, we discuss the integration of these techniques into a coherent multimedia menu system.
- Bailly, G., Lecolinet, E., Nigay, L. 2008. Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. ACM AVI'08, p. 15--22. Google Scholar
Digital Library
- Balakrishnan, R., Baudel, T., Kurtenbach, G., Fitzmaurice, G. 1997. The Rockin'Mouse: integral 3D manipu-lation on a plane. ACM CHI '97, p. 311--318. Google ScholarDigital Library
- Barkhuus, L. and Brown, B. 2009. Unpacking the television: User practices around a changing technology. ACM TOCHI. 16, 3, p. 1--22. Google ScholarDigital Library
- Baudel, T. and Beaudouin-Lafon, M. 1993. Charade: remote control of objects using free-hand gestures. Commun. ACM 36, 7 (Jul. 1993), 28--35. Google ScholarDigital Library
- Cao, X. and Balakrishnan, R. 2003. VisionWand: interaction techniques for large displays using a passive wand tracked in 3D. ACM UIST '03, p.173--182. Google ScholarDigital Library
- Cesar, P., and Chorianopoulos, K. 2009. The evolution of TV systems, content and users toward interactivity. New Foundation and Trends in HCI, vol.2: n°4, p.373--95. Google ScholarDigital Library
- Cho S-J., Oh J. K., Bang W.-C., Chang W., Choi E., Jing Y., Cho J., Kim D. Y. 2004. Magic wand: a hand-drawn gesture input device in 3-D space with inertial sensors. Frontiers in Handwriting Recognition. IWFHR-9 2004. p. 106- 111. Google ScholarDigital Library
- Cooper W. 2008. The interactive television user experience so far. Proc. ACM UXTV '08, p. 133--142. Google ScholarDigital Library
- http://sourceforge.net/projects/darwiin-remote/Google Scholar
- Freeman, W. T., and Weissman, C. 1995. Television control by hand gestures. Int. Workshop IEEE FG'95, p. 179--183.Google Scholar
- Gyration. http://www.gyration.com/Google Scholar
- Hogan, N., 1985, The mechanics of multi-joint posture and movement control, Biol. Cybern., 52:315--331.Google ScholarDigital Library
- Jones, E., Alexander, J., Andreou, A., Irani, P., Subra-manian, S. 2010. GesText: accelerometer-based gestural text-entry systems. ACM CHI'10, p. 2173--82. Google ScholarDigital Library
- Kela, J., Korpipää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L., and Marca, D. 2006. Accelerometer-based gesture control for a design environment. Personal Ubiquitous Comput. 10, 5 (Jul. 2006), 285--299. Google ScholarDigital Library
- Kiger. J. I. 1984. The depth/breadth trade-off in the design of menu-driven user interfaces. Int. J. Man-Mach. Stud. 20, 2 (March 1984), 201--213. Google ScholarDigital Library
- Kinect: http://www.xbox.com/kinectGoogle Scholar
- http://en.wikipedia.org/wiki/K_nearest_neighbor_algorithmGoogle Scholar
- Kurtenbach, G. and Buxton, W. 1991. Issues in combining marking and direct manipulation techniques. ACM UIST '91, 137--144. Google ScholarDigital Library
- Kurtenbach, G. and Buxton, W. 1993. The limits of expert performance using hierarchic marking menus. IFIP INTERACT '93 and ACM CHI '93, p. 482--487. Google ScholarDigital Library
- Kurtenbach, G. P., Sellen, A. J., and Buxton, W. A. 1993. An empirical evaluation of some articulatory and cognitive aspect of marking menus. Hum.-Comp. Int.. 8, 1 (Mar. 93), 1--23. Google ScholarDigital Library
- http://www.l5remote.com/Google Scholar
- http://www.logitech.com/en-us/remotes/universal-remotesGoogle Scholar
- http://en.wikipedia.org/wiki/Cross-validation_(statistics)Google Scholar
- Nelson, M. 1999. Remote controls. The Digital Knowledge Handbook, 3(4).Google Scholar
- Norman D. A. 2010 Natural User Interfaces are Not Natural. ACM magazine Interactions 17,3, p. 6--10. Google ScholarDigital Library
- Oakley, I. and Park, J. 2007. Designing eyes-free interaction. Springer HAID'07, p. 121--132. Google ScholarDigital Library
- Oakley, I. and Park, J. 2009. Motion marking menus: An eyes-free approach to motion input for handheld devices. Int. J. Hum.-Comput. Stud. 67, 6, p. 515--532. Google ScholarDigital Library
- Partridge, K., Chatterjee, Sazawal, V., Borrielo, G. 2002. TiltType: Accelerometer-Supported Text Entry for Very Small Devices. ACM UIST'02, p. 201--204. Google ScholarDigital Library
- Rahman, M., Gustafson, S., Irani, P., and Subramanian, S. 2009. Tilt techniques: investigating the dexterity of wrist-based input. ACM CHI '09, p. 1943--1952. Google ScholarDigital Library
- Rico, J. and Brewster, S. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. ACM CHI, p. 887--896. Google ScholarDigital Library
- Sazawal, V., Want, R., and Borriello, G. 2002. The Unigesture Approach. Springer Mobile HCI '02, p. 256--270. Google ScholarDigital Library
- Shoemaker, G., Findlater, L., Dawson, J. Q., and Booth, K. S. 2009. Mid-air text input techniques for very large wall displays. ACM GI'09, p. 231--238. Google ScholarDigital Library
- http://www.uwand.com/Google Scholar
- Wang, J., Zhai, S., and Canny, J. 2010. SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with motion gesture. ACM CHI '10, p. 15--24. Google ScholarDigital Library
- Wigdor, D. and Balakrishnan, R. 2003. TiltText: using tilt for text input to mobile phones. ACM UIST '03, p. 81--90. Google ScholarDigital Library
- Wilson, A. and Shafer, S. 2003. XWand: UI for intelligent spaces. ACM CHI '03, p. 545--552. Google ScholarDigital Library
- Wobbrock J. O., Morris M. R., Wilson A. D. 2009. User-defined gestures for surface computing. ACM CHI'09, p. 1083--1092. Google ScholarDigital Library
- http://www.voomote.tv/Google Scholar
- Zhao, S. and Balakrishnan, R. 2004. Simple vs. compound mark hierarchical marking menus. ACM UIST '04, p. 33--42. Google ScholarDigital Library
Index Terms
- Gesture-aware remote controls: guidelines and interaction technique
Recommendations
Demonstrating Proxemic Cursor Input for Touchless Displays
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User InteractionTouchless gesture interfaces often use cursor-based interactions, where widgets are targeted by a movable cursor and activated with a mid-air gesture. Proxemic cursor interactions are a novel alternative that facilitate faster selection without the ...
Eliciting Mid-Air Gestures for Wall-Display Interaction
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer InteractionFreehand mid-air gestures are a promising input method for interacting with wall displays. However, work on mid-air gestures for wall-display interaction has mainly explored what is technically possible, which might not result in gestures that users ...
Remote interaction for 3D manipulation
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsIn this paper, we present a two-handed 3D interaction approach for immersive virtual reality applications on a large vertical display. The proposed interaction scheme is based on hybrid motion sensing technology that tracks the 3D position and ...
Comments