skip to main content
10.1145/2470654.2466236acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Kolibri: tiny and fast gestures for large pen-based surfaces

Published: 27 April 2013 Publication History

Abstract

Triggering commands on large interactive surfaces is less efficient than on desktop PCs. It requires either large physical movements to reach an interaction area (e.g., buttons) or additional operations to call context menus (e.g., dwell). There is a lack of efficient ways to trigger shortcuts. We introduce Kolibri - a pen-based gesture system that allows fast access of commands on interactive whiteboards. Users can draw tiny gestures (approx. 3 mm) anywhere on the surface to trigger commands without interfering with normal inking. This approach does neither require entering a gesture mode, nor dedicated gesture areas. The implementation relies on off-the-shelf hardware only. We tested the feasibility and explored the properties of this technique with several studies. The results from a controlled experiment show significant benefits of Kolibri comparing to an existing approach.

Supplementary Material

suppl.mov (chi0733-file3.mp4)
Supplemental video

References

[1]
Albinsson, P., Zhai, S. High precision touch screen interaction. In Proc. CHI '03, 2003, 105--112.
[2]
Anthony, L., and Wobbrock, J. O. A lightweight multistroke recognizer for user interface prototypes. In Proc. GI '10. CIPS, Toronto, Ontario, Canada, 2010, 245--252.
[3]
Bailly, G., Lecolinet, E., and Guiard, Y. Finger-count & radial-stroke shortcuts: 2 techniques for augmenting linear menus on multi-touch surfaces. In Proc. CHI 2010. ACM, NY, USA, 591--594.
[4]
Deming, K. and Lank, E. Managing Ambiguous Intention in Mode Inferencing. In Proc. of the AAAI Fall Symposium Series. 2004, 49--54.
[5]
Fitzmaurice, G., Khan, A., Piek, R., Buxton, W. and Kurtenbach, G. Tracking menus. In UIST '03. ACM, NY, USA, 2003, 71--79.
[6]
Forlines, C., Vogel, D., and Balakrishnan, R. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. In ProcUIST '06. ACM, New York, USA, 2006, pp. 211--220.
[7]
Geissler, J. Gedrics: the next generation of icons. In Proc. INTERACT '95, Lillehammer, Norway, 1995, 73--78.
[8]
Grossman, T., Dragicevic, P., and Balakrishnan, R. Strategies for accelerating on-line learning of hotkeys. In Proc. CHI '07. ACM, New York, NY, USA, 2007, 1591--1600.
[9]
Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M., and Balakrishnan, R. Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. In Proc. CHI '06, NY, USA, 2006, 861--870.
[10]
Guimbretière, F., and Winograd, T., FlowMenu: combining command, text, and data entry. In Proc. UIST 2000, ACM, NY, USA, 213--216.
[11]
Guimbretière, F., Stone, M., and Winograd, T. Fluid interaction with high-resolution wall-size displays. In Proc. UIST '01. ACM, NY, USA, 2001, 21--30.
[12]
Guimbretière, F.: Fluid interaction for high resolution wallsize displays. PhD thesis, Stanford University, Stanford, CA, USA, 2002.
[13]
Hinckley, K., Baudisch, P., Ramos, G., and Guimbretière, F. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proc. CHI '05. ACM, New York, NY, USA, 2005, 451--460.
[14]
Holz, Ch. and Baudisch, P. 2011. Understanding touch. In Proc. CHI '11. ACM, New York, NY, USA.
[15]
Kabbash, P., Buxton, W., and Sellen, A. Two-handed input in a compound task. In Proc. CHI 1994. ACM, NY, USA, 417--423.
[16]
Kristensson, P. O., and Zhai, S. Command strokes with and without preview: using pen gestures on keyboard for command selection. In Proc. CHI '07. ACM, New York, NY, USA, 2007, 1137--1146.
[17]
Kurtenbach, G. The Design and Evaluation of Marking Menus. Ph.D. Thesis, University of Toronto. Toronto, Ontario, Canada, 1993.
[18]
Li, Y. Protractor: A fast and accurate gesture recognizer. In Proc. CHI '10. Atlanta, Georgia (April 10-15, 2010). NY: ACM Press, pp. 2169--2172.
[19]
Li, Y., Hinckley, K., Guan Z., and Landay, J. A. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI '05. ACM, New York, NY, USA, 2005, 461--470.
[20]
Microsoft MSDN: Distinguishing Gestures from Other Pen Input, http://msdn.microsoft.com/en-us/library/ms700643%28v=vs.85%29.aspx
[21]
Moran, T. P., et al. Pen-based interaction techniques for organizing material on an electronic whiteboard. In Proc. UIST 1997. ACM, New York, NY, USA, 45--54.
[22]
Nielsen, J. Finding usability problems through heuristic evaluation. In Proc. CHI '92, ACM, NY, USA, 1992, 373--380.
[23]
Pedersen, E. R., McCall, K., Moran, T. P., and Halasz, F. G. Tivoli: an electronic whiteboard for informal workgroup meetings. In Proc. CHI '93. ACM, NY, USA, 1993, 391--398.
[24]
Potter, R., Weldon, L., and Shneiderman, B. Improving the accuracy of touch screens: an experimental evaluation of three strategies. In Proc. CHI '88, 1988, 27--32.
[25]
Ramos, G., Boulos, M., and Balakrishnan, R. Pressure widgets. In Proc. CHI '04. ACM, NY, USA, 2004, 487--494.
[26]
Roudaut, A., Lecolinet, E., and Guiard, Y. MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb. In Proc. CHI 2009. ACM, NY, USA.
[27]
Saund, E. and Lank, E. Stylus input and editing without prior selection of mode. In UIST '03. ACM, NY, USA, 2003, 213--216.
[28]
Song, H., Benko, H., Guimbretière, F., Izadi, S., Cao, X., and Hinckley, K. Grips and gestures on a multi-touch pen. In Proc. CHI '11. ACM, New York, NY, USA, 2011, 1323--1332.
[29]
Tan, D. S., Keyani P., and Czerwinski, M. Spy-resistant keyboard: more secure password entry on public touch screen displays. In Proc. OZCHI '05. Narrabundah, Australia, 2005, 1--10.
[30]
Tian, F., Xu, L., Wang, H., Zhang, X., Liu, Y., Setlur, V., and Dai, G. Tilt menu: Using the 3d orientation information of pen devices to extend the selection capability of penbased user interfaces, In Proc. CHI '08, ACM, Florence, Italy, 2008, 1371--1380.
[31]
Tsandilas, T., and Mackay, W. E. Knotty gestures: subtle traces to support interactive use of paper. In Proc. AVI 2010, ACM Press(2010), NY, USA, 147--154.
[32]
Viviani, P. and Flash, T. (1995) "Minimum Jerk, TwoThirds Power Law and Isochrony: Converging Approches to Movement Planning", Journal of Experimental Human Perception and Perfomance, Vol. 21 (1995), pp. 32--53.
[33]
Vogel, D. and Baudisch, P. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proc. CHI '07, 2007, 657--666.
[34]
Wolf, K. Microinteractions beside ongoing manual tasks. In Proc. TEI 2011. ACM, NY, USA, 447--448.
[35]
Xiaojun, Bi, Moscovich, T., Ramos, G., Balakrishnan, R., and Hinckley, K. An exploration of pen rolling for pen-based interaction. In Proc. UIST '08. ACM, New York, NY, USA, 2008, 191--200.
[36]
Zeleznik, R., and Miller, T. Fluid inking: augmenting the medium of free-form inking with gestures. In Proc. GI '06. CIPS, Toronto, Ontario, Canada, 2006, 155--162.

Cited By

View all
  • (2024)Design and Evaluation of Pen Body CommandsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2375703(1-12)Online publication date: 11-Jul-2024

Index Terms

  1. Kolibri: tiny and fast gestures for large pen-based surfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    April 2013
    3550 pages
    ISBN:9781450318990
    DOI:10.1145/2470654
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 April 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. fluid inking
    2. large interactive interfaces
    3. pen-input
    4. shortcuts
    5. small gestures
    6. whiteboard application

    Qualifiers

    • Research-article

    Conference

    CHI '13
    Sponsor:

    Acceptance Rates

    CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)6
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Design and Evaluation of Pen Body CommandsInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2375703(1-12)Online publication date: 11-Jul-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media