Article

Modeling human performance of pen stroke gestures

Authors:

Shumin ZhaiAuthors Info & Claims

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1495 - 1504

https://doi.org/10.1145/1240624.1240850

Published: 29 April 2007 Publication History

Abstract

This paper presents a quantitative human performance model of making single-stroke pen gestures within certain error constraints in terms of production time. Computed from the properties of Curves, Line segments, and Corners (CLC) in a gesture stroke, the model may serve as a foundation for the design and evaluation of existing and future gesture-based user interfaces at the basic motor control efficiency level, similar to the role of previous "laws of action" played to pointing, crossing or steering-based user interfaces. We report and discuss our experimental results on establishing and validating the CLC model, together with other basic empirical findings in stroke gesture production.

Supplementary Material

index.html (index.html)

Slides from the presentation

Download
.97 KB

Audio only (1240850.mp3)

Download
11.77 MB

Video (1240850.mp4)

Download
162.57 MB

References

[1]

Accot, J. and Zhai, S., Beyond Fitts' Law: Models for trajectory-based HCI tasks. Proc. ACM CHI Conference on Human Factors in Computing Systems (1997), 295--302.

Digital Library

[2]

Accot, J. and Zhai, S., More than dotting the i's -- foundations for crossing-based interfaces. Proc. ACM CHI Conference on Human Factors in Computing Systems (2002), 73--80.

Digital Library

[3]

Accot, J. and Zhai, S. Performance evaluation of input devices in trajectory-based tasks: an application of the steering law. Proc. ACM CHI (1999), 466--472.

Digital Library

[4]

Accot, J. and Zhai, S. Scale effects in steering law tasks. Proc. ACM CHI Conference on Human Factors in Computing Systems (2001), 1--8.

Digital Library

[5]

Cao, X. and Zhai, S. Modeling human performance of pen stroke gestures, IBM Research Report RJ10392, San Jose, CA (2006), 1--12.

[6]

Fitts, P.M. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, (1954). 381--391.

[7]

Goldberg, D. and Richardson, C., Touch-typing with a stylus. Proc. ACM CHI Conference on Human Factors in Computing Systems (1993), 80--87.

Digital Library

[8]

Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P. and Smith, M., Stitching: pen gestures that span multiple displays. Proc. the Working Conference on Advanced Visual Interfaces (2004), 23--31.

Digital Library

[9]

Isokoski, P., Model for unistroke writing time. Proc. ACM CHI Conference on Human Factors in Computing Systems (2001), 357--364.

Digital Library

[10]

Kristensson, P.-O. and Zhai, S., Relaxing Stylus Typing Precision by Geometric Pattern Matching. Proc. ACM Conference on Intelligent User Interfaces (2005), 151--158.

Digital Library

[11]

Kristensson, P.-O. and Zhai, S., SHARK2: a large vocabulary shorthand writing system for pen-based computers. Proc. the 17th annual ACM Symposium on User Interface Software and Technology (2004), 43--52.

Digital Library

[12]

Lank, E., Saund, E., Sloppy selection: Providing an accurate interpretation of imprecise selection gestures. Computers & Graphics, 29, 4 (2005). 490--500.

Digital Library

[13]

Long, C., Landay, J.A., Rowe, L.A. and Michiels, J. Visual similarity of pen gestures. Proc. ACM CHI Conference on Human Factors in Computing Systems (2000), 360--367.

Digital Library

[14]

Mayzner, M.S. and Tresselt, M.E. Tables of single-letter and digram frequency counts for various word-length and letter-position combinations. Psychonomic Monograph Supplements, 1, 2 (1965). 13--32.

[15]

Moran, T.P., Chiu, P., Melle, W.v. and Kurtenbach, G., Pen-based interaction techniques for organizing material on an electronic whiteboard. Proc. ACM Symposium on User Interface Software and Technology (1997), 127--136.

Digital Library

[16]

Pastel, R., Measuring the difficulty of steering through corners. Proc. ACM CHI Conference on Human Factors in Computing Systems (2006), 1087--1096.

Digital Library

[17]

Viviani, P. and Flash, T. Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. Journal of Experimental Psychology: Human Perception and Performance, 21, 1 (1995). 32--53.

[18]

Viviani, P. and Terzuolo, C. Trajectory determines movement dynamics. Neuroscience, 7, 2 (1982). 431--437.

[19]

Zhai, S., Accot, J. and Woltjer, R. Human Action Laws in Electronic Virtual Worlds -- an empirical study pf path steering performance in VR. Presence, 13 (2004). 113--127.

Digital Library

[20]

Zhai, S., Hunter, M. and Smith, B.A. Performance optimization of virtual keyboards. Human-Computer Interaction, 17, 2,3 (2002). 89--129.

[21]

Zhai, S., Kong, J. and Ren, X. Speed-accuracy trade-off in Fitts' law tasks -- on the equivalency of actual and nominal pointing precision. International Journal of Human-Computer Studies (2004). 61. 823--856.

Digital Library

[22]

Zhao, R., Incremental recognition in gesture-based and syntax-directed diagram editors. Proc. ACM CHI Conference on Human Factors in Computing Systems (1993), 95--100.

Digital Library

Cited By

Yamanaka SMiyashita H(2025)Spatial Variability Models for Straight Pen-stroking Tasks with Temporal ConstraintsJournal of Information Processing10.2197/ipsjjip.33.9133(91-103)Online publication date: 2025
https://doi.org/10.2197/ipsjjip.33.91
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Show More Cited By

Index Terms

Modeling human performance of pen stroke gestures
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

A comparative evaluation of finger and pen stroke gestures
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper reports an empirical investigation in which participants produced a set of stroke gestures with varying degrees of complexity and in different target sizes using both the finger and the pen. The recorded gestures were then analyzed according ...
Modeling Human Performance of Stroke-Based Text Entry
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Gesture typing is a popular stroke-based text input method for mobile devices. Instead of tapping, the user enters a word with a single continuous stroke by gesturing through all the letters. In this paper, we introduce a quantitative motor control ...
Phrasing techniques for multi-stroke selection gestures
GI '06: Proceedings of Graphics Interface 2006

Pen gesture interfaces have difficulty supporting arbitrary multiple-stroke selections because lifting the pen introduces ambiguity as to whether the next stroke should add to the existing selection, or begin a new one. We explore and evaluate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2007

1654 pages

ISBN:9781595935939

DOI:10.1145/1240624

General Chair:
Mary Beth Rosson
The Pennsylvania State University, USA
,
Program Chair:
David Gilmore
Intel, USA

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI07

Sponsor:

CHI07: CHI Conference on Human Factors in Computing Systems

April 28 - May 3, 2007

California, San Jose, USA

Acceptance Rates

CHI '07 Paper Acceptance Rate 182 of 840 submissions, 22%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

90
Total Citations
View Citations
1,811
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yamanaka SMiyashita H(2025)Spatial Variability Models for Straight Pen-stroking Tasks with Temporal ConstraintsJournal of Information Processing10.2197/ipsjjip.33.9133(91-103)Online publication date: 2025
https://doi.org/10.2197/ipsjjip.33.91
Andrei ABilius LVatavu R(2024)Take a Seat, Make a Gesture: Charting User Preferences for On-Chair and From-Chair Gesture InputProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642028(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642028
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Chu JAn DMa YCui WZhai SGu XBi X(2023)WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial NetworkProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581279(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581279
Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Bailly GKhamassi MGirard B(2023)Computational Model of the Transition from Novice to Expert Interaction TechniquesACM Transactions on Computer-Human Interaction10.1145/350555730:5(1-33)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3505557
Yamanaka SUsuba HStuerzlinger WMiyashita H(2022)The Effectiveness of Path-Segmentation for Modeling Lasso Times in Width-Varying PathsProceedings of the ACM on Human-Computer Interaction10.1145/35677376:ISS(640-659)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567737
Higashi TMaiden NSas C(2022)Improve User Experience by Adjusting Draft Design through Retouching System for Paper-cutting ProductionProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3535210(536-540)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3535210
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Vatavu RUngurean O(2022)Understanding Gesture Input Articulation with Upper-Body Wearables for Users with Upper-Body Motor ImpairmentsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501964(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501964
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten