Ken Hinckley
Koji Yatani
Hrvoje Benko
Bill Buxton
ABSTRACT
Manual Deskterity is a prototype digital drafting table that supports both pen and touch input. We explore a division of labor between pen and touch that flows from natural human skill and differentiation of roles of the hands. We also explore the simultaneous use of pen and touch to support novel compound gestures.
Supplemental Material
- Agarawala, A., Balakrishnan, R. Keepin' It Real: Pushing the Desktop Metaphor with Physics, Piles and the Pen. CHI 2006. Google Scholar
Digital Library
- Bondarenko, O. and Janssen, R. Documents at Hand: Learning from Paper to Improve Digital Technologies. CHI 2005. Google ScholarDigital Library
- Brandl, P., Forlines, C., Wigdor, D., Haller, M. and Shen, C. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. AVI '08 Conf. on Advanced Visual interfaces. p. 154--61. Google ScholarDigital Library
- Buxton, B., Sketching User Experiences: Getting the Design Right and the Right Design. 2007, Morgan Kaufman. Google ScholarDigital Library
- Buxton, W. Chunking and Phrasing and the Design of Human-Computer Dialogues. IFIP Information Processing `86.Google Scholar
- Buxton, W. A three-state model of graphical input. Proc. INTERACT'90. p. 449--56. Google ScholarDigital Library
- Cohen, P. The role of natural language in a multimodal interface. UIST'92. p. 143--49. Google ScholarDigital Library
- Cohen, P., et al. QuickSet: Multimodal Interaction for Distributed Applications. ACM Multimedial 97. Google ScholarDigital Library
- Engelhard, L. Native Dual Mode Digitizers: Supporting Pen, Touch and Multi-Touch Inputs in One Device on any LCD. Society for Information Display SID 08 Digest.Google Scholar
- Frisch, M., Heydekorn, J. and Dachselt, R. Investigating Multi-Touch and Pen Gestures for Diagram Editing on Interactive Surfaces. ITS '09 Conf. on Interactive Tabletops and Surfaces. Google ScholarDigital Library
- Greenberg, S., Boyle, M. and LaBerge, J., PDAs and Shared Public Displays: Making Personal Information Public, and Public Information Personal. Personal Technologies, 1999. 3(1): p. 54--64.Google Scholar
- Greenberg, S. and Buxton, B. Usability evaluation considered harmful (some of the time). CHI '08. p. 111--20. Google ScholarDigital Library
- Guiard, Y., Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. The Journal of Motor Behavior, 1987. 19(4): p. 486--517.Google Scholar
- Hartmann, B. Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. CSCW 2010. Google ScholarDigital Library
- Hinckley, K., et al. Codex: a dual screen tablet computer. CHI '09. p. 1933--42. Google ScholarDigital Library
- Hinckley, K., Guimbretiere, F., Baudisch, P., Sarin, R., Agrawala, M. and Cutrell, E. The Springboard: Multiple Modes in One Spring-Loaded Control. CHI 2006. Google ScholarDigital Library
- Hinckley, K., Pierce, J., Sinclair, M. and Horvitz, E. Sensing Techniques for Mobile Interaction. UIST 2000. p. 91--100. Google ScholarDigital Library
- Hinckley, K., et al. InkSeine: In Situ Search for Active Note Taking. CHI 2007. p. 251--60. Google ScholarDigital Library
- Kidd, A. The marks are on the knowledge worker. CHI '94. Google ScholarDigital Library
- Kurtenbach, G. and Buxton, W. Issues in Combining Marking and Direct Manipulation Techniques. UIST'91. p. 137--44. Google ScholarDigital Library
- Kurtenbach, G., Fitzmaurice, G., Baudel, T. and Buxton, B. The Design of a GUI Paradigm based on Tablets, Two--hands, and Transparency. CHI'97, p. 35--42. Google ScholarDigital Library
- Li, Y., Hinckley, K., Guan, Z., Landay, J., Experimental Analysis of Mode Switching Techniques in Pen-based User Interfaces. CHI 2005. p. 461--70. Google ScholarDigital Library
- Marshall, C. and Bly, S. Saving and Using Encountered Information: Implications for Electronic Periodicals. CHI 2005. Google ScholarDigital Library
- Roth, V. and Turner, T. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. CHI 2009. Google ScholarDigital Library
- Ruiz, J. and Lank, E. A study on the scalability of non-preferred hand mode manipulation. ICMI '07 Conf. on Multimodal interfaces. p. 170--77. Google ScholarDigital Library
- Terrenghi, L., Kirk, D., Sellen, A. and Izadi, S. Affordances for manipulation of physical versus digital media on interactive surfaces. CHI '07. p. 1157--66. Google ScholarDigital Library
- Wu, M., et al., Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces, IEEE Intl Workshop on Horizontal Interactive Human-Computer Systems. 2006. Google ScholarDigital Library
- Yee, K.-P. Two-Handed Interaction on a Tablet Display. CHI 2004. Google ScholarDigital Library
Index Terms
- Manual deskterity: an exploration of simultaneous pen + touch direct input
Recommendations
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technologyWe describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionThe proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets ...
Conté: multimodal input inspired by an artist's crayon
UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technologyConté is a small input device inspired by the way artists manipulate a real Conté crayon. By changing which corner, edge, end, or side is contacting the display, the operator can switch interaction modes using a single hand. Conté's rectangular prism ...
Comments