research-article

TiltWriter: design and evaluation of a no-touch tilt-based text entry method for handheld devices

Authors:

Steven J. Castellucci,

I. Scott MacKenzie,

Ahmed Sabbir ArifAuthors Info & Claims

MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Article No.: 7, Pages 1 - 8

https://doi.org/10.1145/3365610.3365629

Published: 26 November 2019 Publication History

Abstract

Touch is the predominant method of text entry on mobile devices. However, these devices also facilitate tilt-based input using accelerometers and gyroscopes. This paper presents the design and evaluation of TiltWriter, a non-touch, tilt-based text entry technique. TiltWriter aims to supplement conventional techniques when precise touch is not convenient or possible (e.g., the user lacks sufficient motor skills). Two keyboard layouts were designed and evaluated: Qwerty, and "Custom", a layout inspired by the telephone keypad. Novice participants in a longitudinal study achieved speeds of 12.1 wpm for Qwerty, 10.7 wpm for Custom. Error rate averaged 0.76% for Qwerty, 0.62% for Custom. A post-study extended session yielded 15.2 wpm with Custom, versus 11.5 wpm with Qwerty. Results and participant feedback suggest that a selection dwell time between 700 - 800 ms benefits accuracy.

Supplementary Material

WMV File (a7-castellucci-supplement.wmv)

Download
47.55 MB

References

[1]

Oxford Text Archive. [n. d.]. British National Corpus (World edition). Retrieved May 20, 2001 from http://www.natcorp.ox.ac.uk

[2]

Ahmed Sabbir Arif. 2012. A Survey on Mobile Text Entry Handedness: How Do Users Input Text on Handheld Devices While Nomadic?. In 2012 4th International Conference on Intelligent Human Computer Interaction (IHCI). IEEE, 1--6.

[3]

Steven J. Castellucci and I. Scott MacKenzie. 2008. Unigest: Text Entry Using Three Degrees of Motion. In CHI'08 Extended Abstracts on Human Factors in Computing Systems. ACM, 3549--3554.

Digital Library

[4]

Sibo Chen, Junce Wang, Santiago Guerra, Neha Mittal, and Soravis Prakkamakul. 2019. Exploring Word-gesture Text Entry Techniques in Virtual Reality. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, LBW0233.

[5]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419--437.

[6]

Daniel Fitton, I. Scott MacKenzie, Janet C. Read, and Matthew Horton. 2013. Exploring Tilt-Based Text Input for Mobile Devices with Teenagers. In Proceedings of the 27th International BCS Human Computer Interaction Conference. British Computer Society, 25.

Digital Library

[7]

Joshua Goodman, Gina Venolia, Keith Steury, and Chauncey Parker. 2002. Language Modeling for Soft Keyboards. In Proceedings of the 7th international conference on Intelligent user interfaces. ACM, 194--195.

Digital Library

[8]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in psychology. Vol. 52. Elsevier, 139--183.

[9]

Interagency Language Roundtable (ILR). [n. d.]. Interagency Language Roundtable Language Skill Level Descriptions - Writing. Retrieved October 4, 2018 from http://www.govtilr.org/Skills/ILRscale5.htm

[10]

Eleanor Jones, Jason Alexander, Andreas Andreou, Pourang Irani, and Sriram Subramanian. 2010. GesText: Accelerometer-Based Gestural Text-Entry Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2173--2182.

Digital Library

[11]

Per Ola Kristensson. 2007. Discrete and Continuous Shape Writing for Text Entry and Control. Ph.D. Dissertation. Institutionen för datavetenskap.

[12]

Droid Life. 2013. Swiftkey Tilt is a Real Keyboard, Check It Out. Video. Retrieved October 9, 2019 from https://youtu.be/3rscERWxc-M?t=53

[13]

I. Scott MacKenzie. 2002. KSPC (keystrokes per character) as a Characteristic of Text Entry Techniques. In International Conference on Mobile Human-Computer Interaction. Springer, 195--210.

[14]

I. Scott MacKenzie. 2012. Human-Computer Interaction: An Empirical Research Perspective. Newnes.

[15]

I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. In CHI'03 extended abstracts on Human factors in computing systems. ACM, 754--755.

[16]

Microsoft. 2016. Download SwiftKey the Smart keyboard and Get More Done. Retrieved October 9, 2019 from https://www.microsoft.com/en-us/swiftkey

[17]

Lilian Genaro Motti, Nadine Vigouroux, and Philippe Gorce. 2013. Interaction Techniques for Older Adults Using Touchscreen Devices: a Literature Review. In Proceedings of the 25th Conference on l'Interaction Homme-Machine. ACM, 125.

Digital Library

[18]

Alexander Ng, Stephen A Brewster, and John H Williamson. 2014. Investigating the Effects of Encumbrance on One-and Two-Handed Interactions with Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1981--1990.

Digital Library

[19]

Nuance. [n. d.]. T9 Text Input: The Global Standard for Mobile Text Input. Retrieved August 1, 2018 from https://www.nuance.com/mobile/mobile-solutions/text-input-solutions/t9.html#tab3

[20]

Kurt Partridge, Saurav Chatterjee, Vibha Sazawal, Gaetano Borriello, and Roy Want. 2002. TiltType: Accelerometer-Supported Text Entry for Very Small Devices. In Proceedings of the 15th annual ACM symposium on User interface software and technology. ACM, 201--204.

Digital Library

[21]

Katrin Plaumann, Milos Babic, Tobias Drey, Witali Hepting, Daniel Stooß, and Enrico Rukzio. 2016. Towards Improving Touchscreen Input Speed and Accuracy on Smartphones for Tremor Affected Persons. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 357--360.

Digital Library

[22]

Ondrej Polacek, Thomas Grill, and Manfred Tscheligi. 2013. NoseTapping: What Else Can You Do With Your Nose?. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia. ACM, 32.

Digital Library

[23]

Jun Rekimoto. 1996. Tilting Operations for Small Screen Interfaces (Tech Note). In UIST, Vol. 96. 167--168.

Digital Library

[24]

Vibha Sazawal, Roy Want, and Gaetano Borriello. 2002. The Unigesture Approach One-Handed Text Entry for Small Devices. In International Conference on Mobile Human-Computer Interaction. Springer, 256--270.

[25]

Julia Schwarz, Robert Xiao, Jennifer Mankoff, Scott E. Hudson, and Chris Harrison. 2014. Probabilistic Palm Rejection using Spatiotemporal Touch Features and Iterative Classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2009--2012.

Digital Library

[26]

Miika Silfverberg, I. Scott MacKenzie, and Panu Korhonen. 2000. Predicting Text Entry Speed on Mobile Phones. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 9--16.

Digital Library

[27]

R William Soukoreff and I. Scott MacKenzie. 2003. Metrics for Text Entry Research: An Evaluation of MSD and KSPC, and A New Unified Error Metric. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 113--120.

[28]

Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 647.

Digital Library

[29]

STMicroelectronics. [n. d.]. L3GD20 - Low Power 3-axis Gyroscope. Retrieved August 1, 2018 from https://www.st.com/en/mems-and-sensors/13gd20.html

[30]

STMicroelectronics. [n. d.]. LIS3DH - 3-axis MEMS Accelerometer. Retrieved August 1, 2018 from https://www.st.com/en/mems-and-sensors/lis3dh.html

[31]

Robert J Teather and I Scott MacKenzie. 2014. Position vs. Velocity Control for Tilt-based Interaction. In Proceedings of Graphics Interface 2014. Canadian Information Processing Society, 51--58.

Digital Library

[32]

Ying-Chao Tung, Mayank Goel, Isaac Zinda, and Jacob O Wobbrock. 2018. RainCheck: Overcoming Capacitive Interference Caused by Rainwater on Smart-phones. In Proceedings of the 2018 on International Conference on Multimodal Interaction. ACM, 464--471.

[33]

Daniel Vogel and Patrick Baudisch. 2007. Shift: A Technique for Operating Pen-based Interfaces Using Touch. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 657--666.

Digital Library

[34]

William S Walmsley, W Xavier Snelgrove, and Khai N Truong. 2014. Disambiguation of Imprecise Input with One-dimensional Rotational Text Entry. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 1 (2014), 4.

Digital Library

[35]

Daniel Wigdor and Ravin Balakrishnan. 2003. TiltText: Using Tilt for Text Input to Mobile Phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology. ACM, 81--90.

Digital Library

[36]

Hui-Shyong Yeo, Xiao-Shen Phang, Steven J Castellucci, Per Ola Kristensson, and Aaron Quigley. 2017. Investigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4194--4202.

Digital Library

Cited By

Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2024)The Guided Evaluation MethodInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103317190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103317
Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2023)Does Repeatedly Typing the Same Phrase Provide a Good Estimate of Expert Text Entry Performance?Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585647(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585647
Rakhmetulla GArif A(2023)Crownboard: A One-Finger Crown-Based Smartwatch Keyboard for Users with Limited DexterityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580770(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580770
Show More Cited By

Recommendations

Text Input on Mobile Devices from Cultural and Educational Aspects

Tablet computers and other mobile devices are widely used in education and other life activities. However, touch screen keyboards are not adapted to languages using alphabets with more letters than the English alphabet has. In this paper, we analyze the ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
Investigating Cross-Device Interaction between a Handheld Device and a Large Display
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

There is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

November 2019

462 pages

ISBN:9781450376242

DOI:10.1145/3365610

General Chair:
Fabio Paternò
CNR-ISTI, Italy
,
Program Chairs:
Giulio Jacucci
University of Helsinki, Finland
,
Michael Rohs
University of Hannover, Germany
,
Carmen Santoro
CNR-ISTI, Italy

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MUM 2019

MUM 2019: 18th International Conference on Mobile and Ubiquitous Multimedia

November 26 - 29, 2019

Pisa, Italy

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
183
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2024)The Guided Evaluation MethodInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103317190:COnline publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103317
Mutasim ABatmaz AHudhud Mughrabi MStuerzlinger W(2023)Does Repeatedly Typing the Same Phrase Provide a Good Estimate of Expert Text Entry Performance?Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585647(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585647
Rakhmetulla GArif A(2023)Crownboard: A One-Finger Crown-Based Smartwatch Keyboard for Users with Limited DexterityProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580770(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580770
Zand GRen YArif A(2022)TiltWalker: Operating a Telepresence Robot with One-Hand by Tilt Controls on a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677256:ISS(381-406)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567725
He ZLutteroth CPerlin K(2022)TapGazer: Text Entry with Finger Tapping and Gaze-directed Word SelectionProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501838(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501838
Salkanovic ALjubic S(2022)LuxBoard: Ambient Light Manipulation for Contactless Text Entry on Mobile DevicesHuman-Computer Interaction. Technological Innovation10.1007/978-3-031-05409-9_10(126-139)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-05409-9_10
Ren YArif A(2021)Stepper, Swipe, Tilt, ForceProceedings of the ACM on Human-Computer Interaction10.1145/34885455:ISS(1-21)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488545
Jackson BCaraco LSpilka Z(2020)Arc-Type and Tilt-Type: Pen-based Immersive Text Input for Room-Scale VRProceedings of the 2020 ACM Symposium on Spatial User Interaction10.1145/3385959.3418454(1-10)Online publication date: 31-Oct-2020
https://dl.acm.org/doi/10.1145/3385959.3418454
Sharif MRakhmetulla GArif AJorge JFerreira AMarquardt NChevalier F(2020)TapStr: A Tap and Stroke Reduced-Qwerty for SmartphonesCompanion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces10.1145/3380867.3426208(47-50)Online publication date: 8-Nov-2020
https://dl.acm.org/doi/10.1145/3380867.3426208
Čejka JChmelík JLiarokapis F(2020)Exploring tilting methods for typing under waterMultimedia Tools and Applications10.1007/s11042-020-09305-7Online publication date: 17-Aug-2020
https://doi.org/10.1007/s11042-020-09305-7

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten