research-article

Extending mobile user ambient awareness for nomadic text entry

Authors:

Ahmed Sabbir Arif,

Benedikt Iltisberger,

Wolfgang StuerzlingerAuthors Info & Claims

OzCHI '11: Proceedings of the 23rd Australian Computer-Human Interaction Conference

Pages 21 - 30

https://doi.org/10.1145/2071536.2071539

Published: 28 November 2011 Publication History

Abstract

Nowadays, we input text not only on stationary devices, but also on handheld devices while walking, driving, or commuting. Text entry on the move, which we term as nomadic text entry, is generally slower. This is partially due to the need for users to move their visual focus from the device to their surroundings for navigational purposes and back. To investigate if better feedback about users' surroundings on the device can improve performance, we present a number of new and existing feedback systems: textual, visual, textual & visual, and textual & visual via translucent keyboard. Experimental comparisons between the conventional and these techniques established that increased ambient awareness for mobile users enhances nomadic text entry performance. Results showed that the textual and the textual & visual via translucent keyboard conditions increased text entry speed by 14% and 11%, respectively, and reduced the error rate by 13% compared to the regular technique. The two methods also significantly reduced the number of collisions with obstacles.

References

[1]

Antania, S., Kasturi, R., and Jain, R. A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video. Pattern Recognition 35, 4 (2002), 945--965.

[2]

Arif, A. S. and Stuerzlinger, W. Analysis of text entry performance metrics. In Proc. TIC-STH 2009, IEEE Press (2009), 100--105.

[3]

Arif, A. S. and Stuerzlinger, W. Predicting the cost of error correction in character-based text entry technologies. In Proc. CHI 2010, ACM Press (2010), 5--14.

Digital Library

[4]

Barnard, L., Yi, J. S., Jacko, J. A., and Sears, A. An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices. Int. J. Hum.-Comput. Stud. 62, 4 (2005), 487--520.

Digital Library

[5]

Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. Multimodal 'eyes-free' interaction techniques for wearable devices. In Proc. CHI 2003, ACM Press (2003), 473--480.

Digital Library

[6]

Chamberlain, A. and Kalawsky, R. A comparative investigation into two pointing systems for use with wearable computers while mobile. In Proc. ISWC 2004, IEEE Press (2004), 110--117.

Digital Library

[7]

Crease, M., Lumsden, J., and Longworth, B. A technique for incorporating dynamic paths in lab-based mobile evaluations. In Proc. BCS-HCI 2007, British Computer Society (2007), 99--108.

Digital Library

[8]

Gould, J. D., Conti, J. and Hovanyecz, T. Composing letters with a simulated listening typewriter. In Proc. CHI 1982, ACM Press (1982), 367--370.

Digital Library

[9]

Hillman, E. J., Bloomberg, J. J., McDonald, P. V., and Cohen, H. S. Dynamic visual acuity while walking in normals and labyrinthine-deficient patients. Journal of Vestibular Research 9, 1 (1999), 49--57.

[10]

Hoggan, E., Brewster, S. A., and Johnston, J. Investigating the effectiveness of tactile feedback for mobile touchscreens. In Proc. CHI 2008, ACM Press (2008), 1573--1582.

Digital Library

[11]

Lin, M., Goldman, R., Price, K. J., Sears, A., and Jacko, J. How do people tap when walking? An empirical investigation of nomadic data entry. Int. J. Hum.-Comput. Stud. 65, 9 (2007), 759--769.

Digital Library

[12]

Lin, M., Price, K. J., Goldman, R., Sears, A., and Jacko, J. Tapping on the move - Fitts' law under mobile conditions. In Proc. IRMA 2005, Idea Group Publishing (2005), 132--135.

[13]

Lumsden, J. and Gammell, A. Mobile note taking: Investigating the efficacy of mobile text entry. In Proc. MobileHCI 2004, ACM Press (2004), 156--167.

[14]

MacKay, B., Dearman, D., Inkpen, K., and Watters, C. Walk 'n scroll: a comparison of software-based navigation techniques for different levels of mobility. In Proc. MobileHCI 2005, ACM Press (2005), 183--190.

Digital Library

[15]

MacKenzie, I. S. and Soukoreff, R. W. Phrase sets for evaluating text entry techniques. Ext. Abstracts CHI 2003, ACM Press (2003), 754--755.

Digital Library

[16]

Mankoff, J. and Abowd, G. D. Error correction techniques for handwriting, speech, and other ambiguous or error prone systems. Technical Report, Georgia Institute of Technology, Atlanta, GA (1999), GIT-GVU-99-18.

[17]

Marentakis, G. N. and Brewster, S. A. Effects of feedback, mobility and index of difficulty on deictic spatial audio target acquisition in the horizontal plane. In Proc. CHI 2006, ACM Press (2006), 359--368.

Digital Library

[18]

Meyer, D. E. and Kieras, D. E. A computational theory of executive cognitive processes and multiple-task performance: part 1. Basic mechanisms. Psychological Review 104, 1 (1997), 3--65.

[19]

Mizobuchi, S., Chignell, M., and Newton, D. Mobile text entry: relationship between walking speed and text input task difficulty. In Proc. MobileHCI 2005, ACM Press (2005), 122--128.

Digital Library

[20]

Mustonen, T., Olkkonen, M., and Hakkinen, J. Examining mobile phone text legibility while walking. Ext. Abstracts CHI 2004, ACM Press (2004), 1243--1246.

Digital Library

[21]

Salthouse, T. A. Perceptual, cognitive, and motoric aspects of transcription typing. Psychological Bulletin 99, 3 (1986), 303--319.

[22]

Soukoreff, R. W. and MacKenzie, I. S. Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In Proc. CHI 2003, ACM Press (2003), 113--120.

Digital Library

[23]

Wang, R. F. and Brockmole, J. R. Human navigation in nested environments. J Exp Psychol Learn Mem Cogn 29, 3 (2003), 398--404.

[24]

Wang, R. F. and Spelke, E. S. Updating egocentric representations in human navigation. Cognition 77, 3 (2000), 215--250.

[25]

Wang, R. F. Representing a stable environment by egocentric updating and invariant representations. Spatial Cognition & Computation 1, 4 (1999), 431--455.

Digital Library

[26]

Yatani, K. and Truong, K. N. An evaluation of stylus-based text entry methods on handheld devices in stationary and mobile settings. In Proc. MobileHCI 2007, ACM Press (2007), 487--494.

Digital Library

[27]

Zickuhr, K. Generations and their gadgets. Technical Report, Pew Research Center, Washington, DC (2011). http://pewinternet.org/Reports/2011/Generations-and-gadgets.aspx.

Cited By

Karimi PBrady EMartin-Hammond ABolchini D(2023)“I stepped into a puddle”: Non-Visual Texting in Nomadic ContextsProceedings of the 20th International Web for All Conference10.1145/3587281.3587285(32-43)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587285
Li ZYu CGu YShi Y(2023)ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581055(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581055
Ren YArif A(2021)Stepper, Swipe, Tilt, ForceProceedings of the ACM on Human-Computer Interaction10.1145/34885455:ISS(1-21)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488545
Show More Cited By

Index Terms

Extending mobile user ambient awareness for nomadic text entry
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Eyes-free text entry with error correction on touchscreen mobile devices
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

We present an eyes-free text entry method for mobile touchscreen devices. Input progresses by inking Graffiti strokes using a finger on a touchscreen. The system includes a word-level error correction algorithm. Auditory and tactile feedback guide eyes-...
LuxBoard: Ambient Light Manipulation for Contactless Text Entry on Mobile Devices
Human-Computer Interaction. Technological Innovation
Abstract
In this paper, we present a proof-of-concept for text entry technique that requires no direct contact with the mobile device and relies exclusively on built-in light sensor utilization. Simple in-air gestures, performed above the smartphone screen,...
Nomadic Data Entry: Empirically Derived Performance Models for Data Entry Tasks in Mobile Situations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '11: Proceedings of the 23rd Australian Computer-Human Interaction Conference

November 2011

363 pages

ISBN:9781450310901

DOI:10.1145/2071536

Conference Chair:
Duncan Stevenson
Australian National University

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OzCHI '11

Sponsor:

Human Factors & Ergonomics Soc

OzCHI '11: The Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

November 28 - December 2, 2011

Canberra, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
276
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Karimi PBrady EMartin-Hammond ABolchini D(2023)“I stepped into a puddle”: Non-Visual Texting in Nomadic ContextsProceedings of the 20th International Web for All Conference10.1145/3587281.3587285(32-43)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587285
Li ZYu CGu YShi Y(2023)ResType: Invisible and Adaptive Tablet Keyboard Leveraging Resting FingersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581055(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581055
Ren YArif A(2021)Stepper, Swipe, Tilt, ForceProceedings of the ACM on Human-Computer Interaction10.1145/34885455:ISS(1-21)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3488545
Turner CChaparro BHe J(2020)Typing on a Smartwatch While Mobile: A Comparison of Input MethodsHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/001872081989129163:6(974-986)Online publication date: 7-Feb-2020
https://doi.org/10.1177/0018720819891291
Akpinar EYeşilada YTemizer S(2020)The Effect of Context on Small Screen and Wearable Device Users’ Performance - A Systematic ReviewACM Computing Surveys10.1145/338637053:3(1-44)Online publication date: 28-May-2020
https://dl.acm.org/doi/10.1145/3386370
Pandey LAlizadeh AArif AO'Brien HFreund LArapakis IHoeber OLopatovska I(2020)Enabling Predictive Number Entry and Editing on Touchscreen-Based Mobile DevicesProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3377957(13-22)Online publication date: 14-Mar-2020
https://dl.acm.org/doi/10.1145/3343413.3377957
Lee LBraud TLam KYau YHui P(2020)From seen to unseen: Designing keyboard-less interfaces for text entry on the constrained screen real estate of Augmented Reality headsetsPervasive and Mobile Computing10.1016/j.pmcj.2020.10114864(101148)Online publication date: Apr-2020
https://doi.org/10.1016/j.pmcj.2020.101148
Pandey LArif APaternò FJacucci GRohs MSantoro C(2019)Context-sensitive app prediction on the suggestion bar of a mobile keyboardProceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia10.1145/3365610.3368414(1-5)Online publication date: 26-Nov-2019
https://dl.acm.org/doi/10.1145/3365610.3368414
Misra Márquez Segura EArif AArnedo JNacke LVanden Abeele VToups Dugas P(2019)Exploring the Pace of an Endless Runner Game in Stationary and Mobile SettingsExtended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts10.1145/3341215.3356256(543-550)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3341215.3356256
DeLong SArif AMazalek AKhamis MSorce SCauchard JGentile V(2019)Design and evaluation of graphical feedback on tangible interactions in a low-resolution edge displayProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324954(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324954
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten