ABSTRACT
Selecting and moving digital content on interactive tabletops often involves accessing the workspace beyond arm's reach. We present Pointable, an in-air, bimanual perspective-based interaction technique that augments touch input on a tabletop for distant content. With Pointable, the dominant hand selects remote targets, while the non-dominant hand can scale and rotate targets with a dynamic C/D gain. We conducted 3 experiments; the first showed that pointing at a distance using Pointable has a Fitts' law throughput comparable to that of a mouse. In the second experiment, we found that Pointable had the same performance as multi-touch input in a resize, rotate and drag task. In a third study, we observed that when given the choice, over 75% of participants preferred to use Pointable over multi-touch for target manipulation. In general, Pointable allows users to manipulate out-of-reach targets, without loss of performance, while minimizing the need to lean, stand up, or involve collocated collaborators.
Supplemental Material
- Abednego, M., Lee, J., Moon, W., and Park, J. I-Grabber: Expanding Physical Reach in a Large-Display Tabletop Environment Through the Use of a Virtual Grabber. Proc. ITS, (2009), 61--64. Google ScholarDigital Library
- Baudisch, P., Cutrell, E., Robbins, D., et al. Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. Proc. INTERACT, (2003), 57--64.Google Scholar
- Bezerianos, A. and Balakrishnan, R. The vacuum: facilitating the manipulation of distant objects. Proc. CHI, (2005), 2--7. Google ScholarDigital Library
- Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. Proc. UIST, (2001), 219--226. Google ScholarDigital Library
- Fitts, P. M. The information capacity of the human motor system in controlling amplitude of movement. Journal of Experimental Psychology 47, (1954), 381--391.Google ScholarCross Ref
- Forlines, C., Wigdor, D., Shen, C., and Balakrishnan, R. Direct-touch vs. mouse input for tabletop displays. Proc. CHI, (2007), 647--656. Google ScholarDigital Library
- Grossman, T., Wigdor, D., and Balakrishnan, R. Multi-finger gestural interaction with 3d volumetric displays. Proc. UIST, (2004), 61--70. Google ScholarDigital Library
- Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior. (1987), 486--517.Google ScholarCross Ref
- Hill, A. and Johnson, A. Withindows: A Framework for Transitional Desktop and Immersive User Interfaces. IEEE SI3D, (2008), 3--10. Google ScholarDigital Library
- Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the Air: Adding Further Depth to Interactive Tabletops. Proc. UIST, (2009), 139--148. Google ScholarDigital Library
- Hinckley, K., Yatani, K., Pahud, M., et al. Pen + Touch = New Tools. Proc. UIST, (2010), 27--36. Google ScholarDigital Library
- Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. Proc. CHI, (2010), 581--590. Google ScholarDigital Library
- Jota, R., Nacenta, M. A., Jorge, J. A., Carpendale, S., and Greenberg, S. A comparison of ray pointing techniques for very large displays. Proc. GI, (2010), 269--276. Google ScholarDigital Library
- Kendon, A. Gesture: visible action as utterance. Cambridge University Press, 2004.Google ScholarCross Ref
- Khan, A., Fitzmaurice, G., Almeida, D., Burtnyk, N., and Kurtenbach, G. A remote control interface for large displays. Proc. UIST, (2004), 127--136. Google ScholarDigital Library
- Microsoft Kinect. http://www.xbox.com/en-US/kinect.Google Scholar
- Latulipe, C., Kaplan, C. S., and Clarke, C. L. A. Bimanual and unimanual image alignment: an evaluation of mouse-based techniques. Proc. UIST, (2005), 123--131. Google ScholarDigital Library
- MacKenzie, S. and Isokoski, P. Fitts' throughput and the speed-accuracy tradeoff. Proc. CHI, (2008), 1633--1636. Google ScholarDigital Library
- Microsoft Surface, http://www.microsoft.com/surface/.Google Scholar
- Myers, B., Bhatnagar, R., Nichols, J., et al. Interacting at a distance: measuring the performance of laser pointers and other devices. Proc. CHI, (2002), 33--40. Google ScholarDigital Library
- Myers, B. A. and Buxton, W. A Study in Two-Handed Input. Proc. CHI, (1986), 321--326. Google ScholarDigital Library
- Nacenta, M., Pinelle, D., Stuckel, D., and Gutwin, C. The effects of interaction technique on coordination in tabletop groupware. Proc. GI, (2007), 191--198. Google ScholarDigital Library
- Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., and Mackay, W. Mid-air pan-and-zoom on wall-sized displays. Proc. CHI, (2011), 177--186. Google ScholarDigital Library
- Oblong Industries, http://www.oblong.com/.Google Scholar
- Parker, J. K., Mandryk, R. L., Nunes, M. N., and Inkpen, K. M. TractorBeam selection aids: Improving target acquisition for pointing input on tabletop displays. Proc. INTERACT, (2005), 80--93. Google ScholarDigital Library
- Parker, J. K., Mandryk, R. L., and Inkpen, K. M. TractorBeam: seamless integration of local and remote pointing for tabletop displays. Proc. GI, (2005), 33--40. Google ScholarDigital Library
- Pierce, J., Forsberg, A., Conway, M., Hong, S., Zeleznik, R. C., and Mine, M. R. Image plane interaction techniques in 3D immersive environments. Proc. I3DG, (1997), 39--43. Google ScholarDigital Library
- Pierce, J. and Pausch, R. Comparing voodoo dolls and HOMER: exploring the importance of feedback in virtual environments. Proc. SIGCHI, (2002), 105--112. Google ScholarDigital Library
- Pinelle, D., Barjawi, M., Nacenta, M., and Mandryk, R. An evaluation of coordination techniques for protecting objects and territories in tabletop groupware. Proc. CHI, (2009), 2129--2138. Google ScholarDigital Library
- Reetz, A., Gutwin, C., Stach, T., Nacenta, M., and Subramanian, S. Superflick: a natural and efficient technique for long-distance object placement on digital tables. Proc. GI, (2006), 163--170. Google ScholarDigital Library
- Rekimoto, J. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. Proc. CHI, (2002), 113--120. Google ScholarDigital Library
- Ringel, M., Berg, H., Jin, Y., and Winograd, T. Barehands: implement-free interaction with a wall-mounted display. Proc. CHI EA, (2001), 368--374. Google ScholarDigital Library
- Scott, S. D., Carpendale, S., and Inkpen, K. M. Territoriality in collaborative tabletop workspaces. Proc. CSCW, (2004), 294--393. Google ScholarDigital Library
- Shoemaker, G., Tang, A., and Booth, K. S. Shadow Reaching: A New Perspective on Interaction for Large Wall Displays. Proc. UIST, (2007), 53--56. Google ScholarDigital Library
- SMART Technologies, http://www.smarttech.com/.Google Scholar
- Toney, A. and Thomas, B. H. Applying reach in direct manipulation user interfaces. Proc. OZCHI, (2006), 393--396. Google ScholarDigital Library
- Vogel, D. and Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. Proc. UIST, (2005), 33--42. Google ScholarDigital Library
- Welford, A. T. Fundamentals of Skill. Methuen, London, 1968.Google Scholar
- Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. Rock & rails: extending multi-touch interactions with shape gestures to enable precise spatial manipulations. Proc. CHI, (2011), 1581--1590. Google ScholarDigital Library
- Wilson, A. D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proc. UIST, (2010), 273--282. Google ScholarDigital Library
- Wilson, A. D. TouchLight: an imaging touch screen and display for gesture-based interaction. Proc. Multimodal Interfaces, (2004), 69--76. Google ScholarDigital Library
- Wu, M. and Balakrishnan, R. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. Proc. UIST, (2003), 193--202. Google ScholarDigital Library
Index Terms
- Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops
Recommendations
MultiPoint: Comparing laser and manual pointing as remote input in large display interactions
We present MultiPoint, a set of perspective-based remote pointing techniques that allows users to perform bimanual and multi-finger remote manipulation of graphical objects on large displays. We conducted two empirical studies that compared remote ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesIn this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Sinkpad: a malleable mouse pad consisted of an elastic material
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsThe computer mouse has been used for more than 40 years; users, however, can only perform simple actions. To solve this problem, we present "Sinkpad", an augmented mouse pad that has a malleable surface consisted of an elastic material. Sinkpad augments ...
Comments