Abstract
User interface modes are ubiquitous in both mouse-keyboard and pen-based user interfaces, but the requirement for prior setting of a user interface mode before performing an action imposes a persistent drag on system usability. This chapter reviews our research in approaches to avoiding prior deliberate mode setting while still allowing overloading of fundamental tap and gesture operations. We analyze the human–machine dynamics of UI protocols through a graphical notation called the Interaction Flow Diagram. Our framework offers a pyramid of methods ranging from simple UI design techniques, through recognition of gestures and canvas content, to modeling of user knowledge and goals. These are represented in four methods: Overloaded Loop Selection to infer rectangle versus lasso selection mode; the Inferred Mode Protocol for Inferring Draw/Select Mode; the Sloppy Selection method for inferring intended content of an ambiguous selection; and the Cycle Tap Selection Method for exploiting structure recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Accot, J., Zhai, S.: Beyond Fitts’ law: models for trajectory-based HCI tasks. In: Proc. ACM CHI, pp. 295–302 (1997)
Accot, J., Zhai, S.: More than dotting the i’s—foundations for crossing-based interfaces. In: Proc. CHI ’02 (SIGCHI Conference on Human Factors in Computing Systems), pp. 73–80 (2002)
Grossman, T., Hinckley, K., Baudisch, P., Agrawala, M., Balakrishnan, R.: Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. In: Proc. ACM CHI, pp. 861–870 (2006)
Hick, W.: On the rate of gain of information. Quarterly Journal of Experimental Psychology 4, 11–36 (1952)
Hinckley, K., Baudisch, P., Ramos, G., Guimbretiere, F.: Design and analysis of delimiters for selection-action pen gesture phrases in Scriboli. In: Proc. CHI ’05 (SIGCHI Conference on Human Factors in Computing Systems), pp. 451–460 (2005)
Hyman, R.: Stimulus information as a determinant of reaction time. Journal of Experimental Psychology 45, 188–196 (1953)
Lank, E., Saund, E.: Sloppy selection: providing an accurate interpretation of imprecise selection gestures. Computers and Graphics 29(4), 183–192 (2005). Special Issue on Pen Computing
Lank, E., Ruiz, J., Cowan, W.: Concurrent bimanual stylus interaction: a study of non-preferred hand mode manipulation. In: GI ’06 (Proceedings of Graphics Interface 2006), pp. 17–24, Quebec (2006)
Li, Y., Hinckley, K., Guan, Z., Landay, J.: Experimental analysis of mode switching techniques in pen-based user interfaces. In: Proc. CHI ’05 (SIGCHI Conference on Human Factors in Computing Systems), pp. 461–470 (2005)
Norman, D.: Steps toward a cognitive engineering: Design rules based on analyses of human error. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems, pp. 378–382, Gaithersburg, MA (1982)
Pedersen, E., McCall, K., Moran, T., Halasz, F.: Tivoli: an electronic whiteboard for informal workgroup meetings. In: Proc. ACM CHI, pp. 391–398 (1993)
Ramos, G., Balakrishnan, R.: Pressure marks. In: Proc. ACM CHI, pp. 1375–1384 (2007)
Ramos, G., Boulos, M., Balakrishnan, R.: Pressure widgets. In: Proc. CHI ’04 (SIGCHI Conference on Human Factors in Computing Systems), pp. 487–494 (2004)
Raskin, J.: The Humane Interface. Addison Wesley, Reading (2000)
Ruiz, J., Lank, E.: A study on the scalability of non-preferred hand mode manipulation. In: ICMI ’07: Proceedings of the 9th International Conference on Multimodal Interfaces, pp. 170–177, Nagoya, Aichi, Japan (2007)
Ruiz, J., Bunt, A., Lank, E.: A model of non-preferred hand mode switching. In: GI ’08 (Proceedings of Graphics Interface 2008), pp. 49–56, Windsor, Ontario, Canada (2008)
Saund, E., Lank, E.: Stylus input and editing without prior selection of mode. In: Proc. UIST ’03 (ACM Symposium on User Interface Software and Technology), pp. 213–216 (2003)
Saund, E., Fleet, D., Larner, D., Mahoney, J.: Perceptually-supported image editing of text and graphics. In: Proc. UIST ’03 (ACM Symposium on User Interface Software and Technology), pp. 183–192 (2003)
Sellen, A., Kurtenbach, G., Buxton, W.: The prevention of mode errors through sensory feedback. Human-Computer Interaction 7(2), 141–164 (1992)
http://www.usabilityfirst.com. June 2008
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Saund, E., Lank, E. (2011). Minimizing Modes for Smart Selection in Sketching/Drawing Interfaces. In: Jorge, J., Samavati, F. (eds) Sketch-based Interfaces and Modeling. Springer, London. https://doi.org/10.1007/978-1-84882-812-4_3
Download citation
DOI: https://doi.org/10.1007/978-1-84882-812-4_3
Publisher Name: Springer, London
Print ISBN: 978-1-84882-811-7
Online ISBN: 978-1-84882-812-4
eBook Packages: Computer ScienceComputer Science (R0)