Nikola Banovic
Frank Chun Yat Li
David Dearman
Koji Yatani
Khai N. Truong
ABSTRACT
Context menus, most commonly the right click menu, are a traditional method of interaction when using a keyboard and mouse. Context menus make a subset of commands in the application quickly available to the user. However, on tabletop touchscreen computers, context menus have all but disappeared. In this paper, we investigate how to design context menus for efficient unimanual multi-touch use. We investigate the limitations of the arm, wrist, and fingers and how it relates to human performance of multi-targets selection tasks on multi-touch surface. We show that selecting targets with multiple fingers simultaneously improves the performance of target selection compared to traditional single finger selection, but also increases errors. Informed by these results, we present our own context menu design for horizontal tabletop surfaces.
- Annett, M., Grossman, T., and Fitzmaurice, G. Medusa: A Proximity-Aware Multi-touch Tabletop. To appear in Proc. UIST'11. ACM, NY, 2011. Google Scholar
Digital Library
- Au, O. K. C., and Tai, C. L. Multitouch finger registration and its applications. In Proc. OZCHI '10, ACM, NY, 2010, pp. 41--48. Google ScholarDigital Library
- Bailly, G., Demeure, A., Lecolinet, E., and Nigay, L. MultiTouch menu (MTM). In Proc. IHM '08, ACM, New York, 2008, pp. 165--168. Google ScholarDigital Library
- Bailly, G., Lecolinet, E., and Guiard, Y. Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces. In Proc. CHI '10, ACM/SIGCHI, NY, 2010, pp. 591--594. Google ScholarDigital Library
- Bartindale, T., Harrison, C., Olivier, P., and Hudson S. E. SurfaceMouse: supplementing multi-touch interaction with a virtual mouse. In Proc. TEI '11, ACM, NY, 2010, pp. 293--296. Google ScholarDigital Library
- Benko, H., Wilson, A. D., and Baudisch, P. Precise selection techniques for multi-touch screens. In Proc. CHI '06, ACM/SIGCHI, NY, 2006, pp. 1263--1272. Google ScholarDigital Library
- Bier, E., Stone, M., Pier, K., Buxton, W., DeRose, T., Toolglass and magic lenses: the see-through interface. In Proc. SIGGRAPH '93, ACM, NY, 1993, pp. 73--80 Google ScholarDigital Library
- Brandl, P., Leitner, J., Seifried, T., Haller, M., Doray, B., and To, P. Occlusion-aware menu design for digital tabletops. In Proc. CHI '09, ACM/SIGCHI, NY, 2009, pp. 3223--3228. Google ScholarDigital Library
- Callahan, J., Hopkins, D., Weiser, M., and Shneiderman, B. 1988. An empirical comparison of pie vs. linear menus. In Proc. CHI '88. ACM/SIGCHI, New York, 1988, pp. 95--100. Google ScholarDigital Library
- Esenther A. and Ryall, K. 2006. Fluid DTMouse: better mouse support for touch-based interactions. In Proc. AVI '06, ACM, NY, pp. 112--115. Google ScholarDigital Library
- Forlines, C., Vogel, D., and Balakrishnan, R. Hybrid-Pointing: Fluid switching between absolute and relative pointing with a direct input device. In Proc. UIST '06, ACM/SIGCHI, NY, 2006, pp. 211--220. Google ScholarDigital Library
- Forlines, C., Wigdor, D., Shen, C., and Balakrishnan, R. Direct-touch vs. mouse input for tabletop displays. In Proc. CHI '07. ACM/SIGCHI, NY, 2007, pp. 647--656. Google ScholarDigital Library
- Häger-Ross, C. and Schieber, M. H. Quantifying the independence of human finger movements: comparisons of digits, hands, and movement frequencies. The Journal of Neuroscience (2000), pp. 8542--8550.Google ScholarCross Ref
- Hesselmann, T., Flöring, S., and Schmitt, M. Stacked Half-Pie menus: navigating nested menus on interactive tabletops. In Proc. ITS '09, ACM, NY, 2009, pp. 173--180. Google ScholarDigital Library
- Hinckley, K., Baudisch, P., Ramos, G., and Guimbretiere, F. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proc. CHI '05. ACM, New York, (2005), pp. 451--460. Google ScholarDigital Library
- Holz, C. and Baudisch, P. 2010. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proc. CHI '10, ACM/SIGCHI, NY, 2010, pp. 581--590. Google ScholarDigital Library
- Hopkins, D. The design and implementation of pie menus. Dr. Dobb's Journal, 16, 12 (1991), 16--26. Google ScholarDigital Library
- Kin, K., Agrawala, M., and DeRose, T. Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In Proc. GI 2009, Canadian Information Processing Society, Toronto, 2009, pp. 119--124. Google ScholarDigital Library
- Kurtenbach, G., and Buxton, W. User learning and performance with marking menus. In Proc. CHI'94, ACM/SIGCHI, NY, 1994, pp. 258--264 Google ScholarDigital Library
- Kurtenbach, G., Fitzmaurice, G. W., Owen, R. N, and Baudel, T. The Hotbox: efficient access to a large number of menu-items.. In Proc. CHI'99, ACM/SIGCHI, NY, 1999, pp. 231--237 Google ScholarDigital Library
- Lepinski, G. J., Grossman, T., and Fitzmaurice, G. The design and evaluation of multitouch marking menus. In Proc. CHI '10, ACM/SIGCHI, NY, 2010, pp. 2233--2242. Google ScholarDigital Library
- Li, Y., Hinckley, K., Guan, Z., and Landay, J. A. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI '05. ACM, New York, 2005, pp. 461--470. Google ScholarDigital Library
- Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. The design and evaluation of multi-finger mouse emulation techniques. In Proc. CHI '09, ACM/SIGCHI, NY, 2009, pp. 1073--1082. Google ScholarDigital Library
- Micire, M., Desai, M., Drury, J. L., McCann, E., Norton, A., Tsui, K. M. and Yanco, H. A. Design and validation of two-handed multi-touch tabletop controllers for robot teleoperation. In Proc. IUI '11, ACM, NY, 2011, pp. 145--154. Google ScholarDigital Library
- Moscovich, T. and Hughes, J. F. Indirect mappings of multi-touch input using one and two hands. In Proc. CHI '08, ACM/SIGCHI, NY, 2008, pp. 1275--1284. Google ScholarDigital Library
- North, C., Dwyer, T., Lee, B., Fisher, D., Isenberg, P., Robertson, G., and Quinn, K. I. Understanding multi-touch manipulation for surface computing. In Proc. HCII'09, Springer-Verlag, Berlin, 2009, pp. 236--249. Google ScholarDigital Library
- Pheasant, S. and Hastlegrave, C. Bodyspace: anthropometry, ergonomics and the design of the work. CRC, 2006.Google Scholar
- Reilly, K. and Hammond, G. Human Handedness: Is there a Difference in the Independence of the Digits on the Preferred and Non-preferred Hands. Experimental Brain Research, 156, 2 (2004), 255--262.Google Scholar
- Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proc. CHI '02, ACM/SIGCHI, NY, 2002, pp. 113--120. Google ScholarDigital Library
- Santello, M., Soechting, J. Matching object size by controlling finger span and hand shape. Somatosensory & Motor Research, 14, 3(1997), 203--212.Google Scholar
- Sasangohar, F., MacKenzie, I. S., & Scott, S. D. Evaluation of mouse and touch input for a tabletop display using Fitts' reciprocal tapping task. In Proc. HFES'09, Human Factors and Ergonomics Society, Santa Monica, CA, 2009, pp. 839--843.Google ScholarCross Ref
- van Doren, C. Cross-modality Matches of finger span and line length. Perception & Psychophysics, 57, 4 (1995), 555--568.Google ScholarCross Ref
- Vogel, D. and Balakrishnan, R. Occlusion-aware interfaces. In Proc. CHI '10, ACM/SIGCHI, NY, 2010, pp. 263--272. Google ScholarDigital Library
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. In Proc. CHI '09, ACM/SIGCHI, NY, 2009, pp. 1083--1092. Google ScholarDigital Library
- Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In Proc. UIST '03, ACM/SIGCHI, NY, 2003, pp. 193--202. Google ScholarDigital Library
- Wu, M., Shen, C., Ryall, K., Forlines, C., and Balakrishnan, R. Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces. In Proc. IEEE TABLETOP 2006. pp. 183--190. Google ScholarDigital Library
- Zhao, S., Agrawala, M., Hinckley, K. Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus. In Proc. CHI '06, ACM/SIGCHI, NY, 2006, pp. 1077--1086. Google ScholarDigital Library
Index Terms
- Design of unimanual multi-finger pie menu interaction
Recommendations
Design and evaluation of interaction models for multi-touch mice
GI '10: Proceedings of Graphics Interface 2010Adding multi-touch sensing to the surface of a mouse has the potential to substantially increase the number of interactions available to the user. However, harnessing this increased bandwidth is challenging, since the user must perform multi-touch ...
Design and evaluation of finger-count interaction: Combining multitouch gestures and menus
Selecting commands on multi-touch displays is still a challenging problem. While a number of gestural vocabularies have been proposed, these are generally restricted to one or two fingers or can be difficult to learn. We introduce Finger-Count gestures, ...
MultiTouch menu (MTM)
IHM '08: Proceedings of the 20th Conference on l'Interaction Homme-MachineThis paper describes a new menu technique called MultiTouch Menu, that is especially well suited for multitouch interactive surfaces. In contrast with traditional menu techniques, the MultiTouch menu makes the most of the new capabilities provided by ...
Comments