Florian Block
ABSTRACT
In spite of many advances in GUI workstations, the keyboard has remained limited to text entry and basic command invocation. In this work, we introduce the Touch-Display Keyboard (TDK), a novel keyboard that combines the physical-ergonomic qualities of the conventional keyboard with dynamic display and touch-sensing embedded in each key. The TDK effectively transforms the keyboard into an interactive surface that is seamlessly integrated with the interaction space of GUIs, extending graphical output, mouse interaction and three-state input to the keyboard. This gives rise to an entirely new design space of interaction across keyboard, mouse and screen, for which we provide a first systematic analysis in this paper. We illustrate the emerging design opportunities with a host of novel interaction concepts and techniques, and show how these contribute to expressiveness of GUIs, exploration and learning of keyboard interfaces, and interface customization across graphics display and physical keyboard.
Supplemental Material
- Fingerworks. http://www.fingerworks.com/.Google Scholar
- OLED Display Keyboard, United Keys Inc. http://www.unitedkeys.com/.Google Scholar
- Optimus Maximus Keyboard, ArtLebedev Studios. http://www.artlebedev.com/everything/optimus/.Google Scholar
- W. Fallot-Burghardt, M. Fjeld, C. Speirs, S. Ziegenspeck, H. Krueger, and T. L¨aubli. Touch&type: a novel pointing device for notebook computers. In Proc. NordiCHI '06, pages 465--468, 2006. Google ScholarDigital Library
- S. Greenberg and M. Boyle. Customizable physical interfaces for interacting with conventional applications. In Proc. UIST '02, pages 31--40, 2002. Google ScholarDigital Library
- D. Grolaux, J. Vanderdonckt, and P.V. Roy. Attach me, detach me, assemble me like you work. In Proc. INTERACT'05, pages 198--212.Google Scholar
- T. Grossman, P. Dragicevic, and R. Balakrishnan. Strategies for accelerating on-line learning of hotkeys. In Proc. CHI 2007, pages 1591--1600, 2007. Google ScholarDigital Library
- B. Hartmann, M. Ringel Morris, H. Benko, and A.D. Wilson. Augmenting interactive tables with mice & keyboards. In Proc. UIST '09, 2009. Google ScholarDigital Library
- M. Helander. Handbook of Human Computer Interaction. North-Holland, 1988. Google ScholarDigital Library
- E. Hoggan, S.A. Brewster, and J. Johnston. Investigating the effectiveness of tactile feedback for mobile touchscreens. In Proc. CHI '08, pages 1573--1582, 2008. Google ScholarDigital Library
- P. Holleis, J. HAkkilA, and J. Huhtala. Studying applications for touch-enabled mobile phone keypads. In Proc. TEI'08, pages 41--44, 2008. Google ScholarDigital Library
- A. Howes, S.J. Payne, and A. Woodward. The trouble with shortcuts. In CHI '00 Extended Abstracts, pages 267--268, 2000. Google ScholarDigital Library
- P. Isokoski. A minimal device-independent text input method. Technical Report A-1999-14, Department of Computer Science, University of Tampere, 1999.Google Scholar
- D.M. Lane, H.A. Napier, S.C. Peres, and A. Sandor. Hidden costs of graphical user interfaces: Failure to make the transition from menus and icon toolbars to keyboard shortcuts. In IJHCI, 18(2), pages 133--144, 2005.Google Scholar
- H. McLoone, K. Hinckley, and E. Cutrell. Binamual interaction on the microsoft office keyboard. In Proc. Interact '03, pages 49--56, 2003.Google Scholar
- D.L. Odell, R.C. Davis, A. Smith, and P.K. Wright. Toolglasses, marking menus, and hotkeys: A comparison of one and two-handed command selection techniques. In Proc. Graphics Interface 2004, pages 17--24, 2004. Google ScholarDigital Library
- J. Rekimoto, T. Ishizawa, C. Schwesig, and H. Oba. Presense: interaction techniques for finger sensing input devices. In Proc. UIST '03, pages 203--212, New York, NY, USA, 2003. ACM. Google ScholarDigital Library
- J. Rekimoto, B. Ullmer, and H. Oba. Datatiles: a modular platform for mixed physical and graphical interactions. In Proc. CHI '01, pages 269--276, 2001. Google ScholarDigital Library
- H. Roeber, J. Bacus, and C. Tomasi. Typing in thin air: the canesta projection keyboard -- a new method of interaction with electronic devices. In CHI Extended Abstracts 2003, pages 712--713, 2003. Google ScholarDigital Library
- A. Sears. Improving touchscreen keyboards: Design issues and a comparison with other devices. In Interacting with Computers, 3(3), pages 253--269, 1991.Google Scholar
- W. Stuerzlinger, O. Chapuis, D. Phillips, and N. Roussel. User interface fac¸ades: towards fully adaptable user interfaces. In Proc. UIST '06, pages 309--318, 2006. Google ScholarDigital Library
- C. Tomasi, A. Rafii, and I. Torunoglu. Full-size projection keyboard for handheld devices. In Com. of the ACM, 46(7), pages 70--75, 2003. Google ScholarDigital Library
- M. Weiss, J. Wagner, Y. Jansen, R. Jennings, R. Khoshabeh, J.D. Hollan, and J. Borchers. Slap widgets: Bridging the gap between virtual and physical controls on tabletops. In Proc. CHI '09, pages 481--490, 2009. Google ScholarDigital Library
- J. Zhang and D.A. Norman. Representations in distributed cognitive tasks. In Cognitive Science, 18, pages 87--122, 1994.Google ScholarCross Ref
Index Terms
- Touch-display keyboards: transforming keyboards into interactive surfaces
Recommendations
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyWe propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...
Gaze-touch: combining gaze with multi-touch for interaction on the same surface
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyGaze has the potential to complement multi-touch for interaction on the same surface. We present gaze-touch, a technique that combines the two modalities based on the principle of 'gaze selects, touch manipulates'. Gaze is used to select a target, and ...
Using tangible drawing tools on a capacitive multi-touch display
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and ComputersWe present an innovative drawing tool that can detect tangible drawing instruments on a capacitive multi-touch tablet. There are three core components to the system: the tangible hardware, the recognizer used to identify the tangibles, and the drawing ...
Comments