research-article

Gestures and widgets: performance in text editing on multi-touch capable mobile devices

Authors:

Vittorio Fuccella,

Poika Isokoski,

Benoit MartinAuthors Info & Claims

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2785 - 2794

https://doi.org/10.1145/2470654.2481385

Published: 27 April 2013 Publication History

Abstract

We describe the design and evaluation of a gestural text editing technique for touchscreen devices. The gestures are drawn on top of the soft keyboard and interpreted as commands for moving the caret, performing selections, and controlling the clipboard. Our implementation is an Android service that can be used in any text editing task on Android-based devices. We conducted an experiment to compare the gestural editing technique against the widget-based technique available on a smartphone (Samsung Galaxy II with Android 2.3.5). The results show a performance benefit of 13-24% for the gestural technique depending on the font size. Subjective feedback from the participants was also positive. Because the two editing techniques use different input areas, they can co-exist on a device. This means that the gestural editing can be added on any soft keyboard without interfering with user experience for those users that choose not to use it.

References

[1]

Almaksour, A., Anquetil, E., Quiniou, S., and Cheriet, M. Personalizable pen-based interface using lifelong learning. In Proc. of ICFHR'10 (2010), 188--193.

Digital Library

[2]

Appert, C., and Zhai, S. Using strokes as command shortcuts: cognitive benefits and toolkit support. In Proc. of CHI'09, ACM (2009), 2289--2298.

Digital Library

[3]

Bangor, A., Kortum, P. T., and Miller, J. T. An Empirical Evaluation of the System Usability Scale. IJHCI 24, 6 (2008), 574--594.

[4]

Borenstein, N. S. The evaluation of text editors: a critical review of the roberts and morgan methodology based on new experiments. In Proc. of CHI'85, ACM (1985), 99--105.

Digital Library

[5]

Bragdon, A., Nelson, E., Li, Y., and Hinckley, K. Experimental analysis of touch-screen gesture designs in mobile environments. In Proc. of CHI '11, ACM (2011), 403--412.

Digital Library

[6]

Brooke, J. Sus: A quick and dirty usability scale. In Usability evaluation in industry, P. W. Jordan, B. Weerdmeester, A. Thomas, and I. L. Mclelland, Eds. Taylor and Francis, London, 1996.

[7]

Cockburn, A., Ahlström, D., and Gutwin, C. Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse. Int. J. Hum.-Comput. Stud. 70, 3 (Mar. 2012), 218--233.

Digital Library

[8]

Costagliola, G., Fuccella, V., and Capua, M. D. Interpreting gestures for text entry on touch screen devices. In Proceedings of The 16th International Conference on Distributed Multimedia Systems (2010), 315--320.

[9]

Costagliola, G., Fuccella, V., and Di Capua, M. Text entry with keyscretch. In Proceedings of the 16th international conference on Intelligent User Interfaces, ACM (2011), 277--286.

Digital Library

[10]

Embley, D. W., and Nagy, G. Can we expect to improve text editing performance? In Proc. of CHI '82, ACM (1982), 152--156.

Digital Library

[11]

Gould, J. D., and Alfaro, L. Revising documents with text editors, handwriting recognition, and speech recognition systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 26, 4 (Aug. 1984), 431--441.

[12]

Gould, J. D., Lewis, C., and Barnes, V. Cursor movement during text editing. ACM Trans. Inf. Syst. 3, 1 (Jan. 1985), 22--34.

Digital Library

[13]

Isokoski, P. Performance of menu-augmented soft keyboards. In Proc. of CHI '04, ACM (2004), 423--430.

Digital Library

[14]

Kristensson, P.-O., and Zhai, S. Shark2: a large vocabulary shorthand writing system for pen-based computers. In Proc. of UIST '04, ACM (2004), 43--52.

Digital Library

[15]

Kristensson, P. O., and Zhai, S. Command strokes with and without preview: using pen gestures on keyboard for command selection. In Proc. of CHI '07, ACM (2007), 1137--1146.

Digital Library

[16]

Mankoff, J., and Abowd, G. D. Cirrin: a word-level unistroke keyboard for pen input. In Proc. of the ACM UIST 98, ACM (1998), 213--214.

Digital Library

[17]

Pedersen, E. R., McCall, K., Moran, T. P., and Halasz, F. G. Tivoli: an electronic whiteboard for informal workgroup meetings. In Proc. of CHI '93, ACM (1993), 391--398.

Digital Library

[18]

Roberts, T. L. Evaluation of computer text editors. PhD thesis, Stanford, CA, USA, 1980. AAI8011699.

Digital Library

[19]

Roberts, T. L., and Moran, T. P. Evaluation of text editors. In Proc. of CHI '82, ACM (1982), 136--141.

Digital Library

[20]

Roberts, T. L., and Moran, T. P. The evaluation of text editors: methodology and empirical results. Commun. ACM 26, 4 (Apr. 1983), 265--283.

Digital Library

[21]

Rubine, D. Specifying gestures by example. In Proc. of SIGGRAPH '91, ACM (1991), 329--337.

Digital Library

[22]

Tesler, L. A personal history of modeless text editing and cut/copy-paste. Interactions 19, 4 (Aug. 2012), 70--75.

Digital Library

[23]

Westerman, W., Lamiraux, H., and Dreisbach, M. Swipe gestures for touch screen keyboards. US Patent 20080316183, 2008.

[24]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In Proc. of UIST '07, ACM (2007), 159--168.

Digital Library

[25]

Wolf, C. G., and Morrel-Samuels, P. The use of hand-drawn gestures for text editing. International Journal of Man-Machine Studies 27, 1 (1987), 91--102.

Digital Library

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Rakhmetulla GRen YArif A(2023)GeShort: One-Handed Mobile Text Editing and Formatting with Gestural Shortcuts and a Floating ClipboardProceedings of the ACM on Human-Computer Interaction10.1145/36042597:MHCI(1-23)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604259
Show More Cited By

Index Terms

Gestures and widgets: performance in text editing on multi-touch capable mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones

While advances in mobile text entry enable smartphone users to type almost as fast as on hardware keyboards, text-heavy activities are still not widely adopted. One reason is the lack of shortcut mechanisms. In this article, we determine shortcuts for ...
Virtual Stick in Caret Positioning on Touch Screens
IHM '13: Proceedings of the 25th Conference on l'Interaction Homme-Machine

We present our design exploration in the area of virtual stick controllers and a preliminary evaluation in an editing task. Virtual stick controllers are one solution to the problem of precise pointing on touch screens. They operate by using an area of ...
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Hover Widgets, a new technique for increasing the capabilities of pen-based interfaces. Hover Widgets are implemented by using the pen movements above the display surface, in the tracking state. Short gestures while hovering, followed by a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2013

3550 pages

ISBN:9781450318990

DOI:10.1145/2470654

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
1,495
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)2

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Rakhmetulla GRen YArif A(2023)GeShort: One-Handed Mobile Text Editing and Formatting with Gestural Shortcuts and a Floating ClipboardProceedings of the ACM on Human-Computer Interaction10.1145/36042597:MHCI(1-23)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604259
De Rosa MFuccella VCostagliola GAlbanese MGalasso FGalasso L(2023)Arrow2edit: A Technique for Editing Text on SmartphonesHuman-Computer Interaction10.1007/978-3-031-35596-7_27(416-432)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_27
Zhao MHuang HLi ZLiu RCui WToshniwal KGoel AWang AZhao XRashidian SBaig FPhi KZhai SRamakrishnan IWang FBi X(2022)EyeSayCorrect: Eye Gaze and Voice Based Hands-free Text Correction for Mobile DevicesProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511103(470-482)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511103
Giovanna Albanese MCostagliola GDe Rosa MFuccella V(2022)A technique to improve text editing on smartphones2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL/HCC53370.2022.9833120(1-3)Online publication date: 12-Sep-2022
https://doi.org/10.1109/VL/HCC53370.2022.9833120
Gu JLee G(2022)Towards More Direct Text Editing With Handwriting InterfacesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.204189339:1(233-248)Online publication date: 18-Apr-2022
https://doi.org/10.1080/10447318.2022.2041893
Zhao MCui WRamakrishnan IZhai SBi X(2021)Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for SmartphonesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474742(162-178)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474742
Lee LZhu YYau YHui PPirttikangas S(2021)Press-n-Paste: Copy-and-Paste Operations with Pressure-sensitive Caret Navigation for Miniaturized Surface in Mobile Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/34571465:EICS(1-29)Online publication date: 29-May-2021
https://dl.acm.org/doi/10.1145/3457146
Zhang MWen HCui WZhu SAndrew Schwartz HBi XWobbrock J(2021)AI-Driven Intelligent Text Correction Techniques for Mobile Text EntryArtificial Intelligence for Human Computer Interaction: A Modern Approach10.1007/978-3-030-82681-9_5(131-168)Online publication date: 5-Nov-2021
https://doi.org/10.1007/978-3-030-82681-9_5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten