research-article

Public Access

Passive Haptic Training to Improve Speed and Performance on a Keypad

Authors:

Wolfgang Stuerzlinger,

Thad StarnerAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 3

Article No.: 100, Pages 1 - 13

https://doi.org/10.1145/3132026

Published: 11 September 2017 Publication History

Abstract

Learning text entry systems is challenging, yet necessary. Many layouts and keyboards exist, but they rely on laborious learning techniques. Passive haptic learning (PHL) has already demonstrated some benefit for learning the Braille text entry system. Could this computing-enabled technique be used to improve desktop keyboard typing skills? It is unknown whether passive haptic training can improve speed on a motor task (as opposed to initial learning). We use a randomized numeric keypad to examine users’ typing performance with or without passive haptic training. When users were prevented from looking at the keyboard, the PHL group demonstrated consistent accuracy (-0.011 KSPC) while those in the control group greatly increased their error (+1.26 KSPC on average). This result is consistent with the finding that PHL users looked significantly less at the keyboard. In a second, longer study, users exposed to PHL were found to significantly improve their typing speed (mean increase of 11 WPM) versus control (mean increase of 2.2 WPM).

References

[1]

Xiaojun Bi, Barton A Smith, and Shumin Zhai. 2010. Quasi-qwerty soft keyboard optimization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 283--286.

Digital Library

[2]

Stephen Brewster, Faraz Chohan, and Lorna Brown. 2007. Tactile Feedback for Mobile Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 159--162.

Digital Library

[3]

Thomas Allen Bullock, Lorraine C Schmertzing, and D Education Center. 2010. Instructional experiences of fifth grade students with keyboarding instruction. PDF accessed on November 1 (2010).

[4]

Becky Chwirka, Burke Gurney, and Patricia A Burtner. 2002. Keyboarding and visual-motor skills in elementary students: A pilot study. Occupational Therapy in Health Care 16, 2-3 (2002), 39--51.

[5]

Edward Clarkson, James Clawson, Kent Lyons, and Thad Starner. 2005. An empirical study of typing rates on mini-QWERTY keyboards. In CHI extended abstracts on Human factors in computing systems. ACM, 1288--1291.

Digital Library

[6]

William E Cooper. 1983. Cognitive aspects of skilled typewriting. Springer Science 8 Business Media.

[7]

Arindam Das and Wolfgang Stuerzlinger. 2007. A cognitive simulation model for novice text entry on cell phone keypads. In Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore! ACM, 141--147.

Digital Library

[8]

Ludovic Dovat, Olivier Lambercy, Roger Gassert, Thomas Maeder, Ted Milner, Teo Chee Leong, and Etienne Burdet. 2008. HandCARE: a cable-actuated rehabilitation system to train hand function after stroke. Transactions on Neural Systems and Rehabilitation Engineering 16, 6 (2008), 582--591.

[9]

David Feygin, Madeleine Keehner, and R Tendick. 2002. Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, HAPTICS. IEEE, 40--47.

Digital Library

[10]

Julia K. Harpole. 2015. 5 Things you Should Know Before you Consider Court Reporting School. https://stenofabulous.com/2015/01/5-things-you-should-know-before-you-consider-court-reporting-school. (2015). Accessed: 2017-4-24.

[11]

Lynda S. Hartman. 2005. Handwriting / Keyboarding Rates. http://www.qiat.org/docs/resourcebank/hwriting_kybding_rate_info.pdf, (2005). Accessed: 2017-4-24.

[12]

Lynda S. Hartman. 2005. Typing Agent Keys to Keyboarding Success. http://wis.cromwell.k12.ct.us/common/pages/DisplayFile.aspx?itemId=1919671, (2005). Accessed: 2017-4-24.

[13]

Kevin Huang, Ellen Yi-Luen Do, and Thad Starner. 2008. PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills. In Proceedings of the International Symposium on Wearable Computers (ISWC). IEEE, 41--44.

Digital Library

[14]

Kevin Huang, Thad Starner, Ellen Do, Gil Weiberg, Daniel Kohlsdorf, Claas Ahlrichs, and Ruediger Leibrandt. 2010. Mobile music touch: mobile tactile stimulation for passive learning. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 791--800.

Digital Library

[15]

Seungwoo Je, Brendan Rooney, Liwei Chan, and Andrea Bianchi. 2017. tactoRing: A Skin-Drag Discrete Display. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3106--3114.

Digital Library

[16]

Gavin Jenkins. 2015. Hanging Out with America’s Elite, Underappreciated Court Reporters. https://www.vice.com/en_us/article/hanging-out-with-americas-elite-underappreciated-court-reporters-812. (2015). Accessed: 2017-4-24.

[17]

Daniel Kohlsdorf and Thad Starner. 2010. Mobile music touch: The effect of primary tasks on passively learning piano sequences. In Proceedings of the International Symposium on Wearable Computers (ISWC). IEEE, 1--8.

[18]

Katherine J Kuchenbecker, Jonathan Fiene, and Günter Niemeyer. 2006. Improving contact realism through event-based haptic feedback. Transactions on visualization and computer graphics 12, 2 (2006), 219--230.

Digital Library

[19]

Ville Lehtinen, Antti Oulasvirta, Antti Salovaara, and Petteri Nurmi. 2012. Dynamic tactile guidance for visual search tasks. In Proceedings of the 25th annual symposium on User interface software and technology. ACM, 445--452.

Digital Library

[20]

Craig Edwin Lewiston. 2008. MaGKeyS: A haptic guidance keyboard system for facilitating sensorimotor training and rehabilitation. Ph.D. Dissertation. Citeseer.

[21]

Jenna Lüttgen and Herbert Heuer. 2013. The influence of robotic guidance on different types of motor timing. Journal of motor behavior 45, 3 (2013), 249--258.

[22]

Kent Lyons, Daniel Plaisted, and Thad Starner. 2004. Expert chording text entry on the twiddler one-handed keyboard. In Proceedings of the International Symposium on Wearable Computers (ISWC), Vol. 1. IEEE, 94--101.

Digital Library

[23]

I Scott MacKenzie and Kumiko Tanaka-Ishii. 2010. Text entry systems: Mobility, accessibility, universality. Morgan Kaufmann.

Digital Library

[24]

Edgar Matias, I Scott MacKenzie, and William Buxton. 1993. Half-QWERTY: A one-handed keyboard facilitating skill transfer from QWERTY. In Proceedings of the INTERACT and CHI Conference on Human Factors in Computing Systems. ACM, 88--94.

Digital Library

[25]

Edgar Matias, I. Scott MacKenzie, and William Buxton. 1996. One-handed Touch Typing on a QWERTY Keyboard. Human-Computer Interact. 11, 1 (March 1996), 1--27.

Digital Library

[26]

Everett M Rogers. 2010. Diffusion of innovations. Simon and Schuster.

[27]

Harriet Rogers, Jody Laehn, Anne Lang, Deb OfiLeary, and Mary Sommers. 2003. The status of elementary keyboarding: A longitudinal study. Unpublished research study, Whitewater, WI: UW-Whitewater (2003).

[28]

Janet Rogers and Jane Case-Smith. 2002. Relationships between handwriting and keyboarding performance of sixth-grade students. American Journal of Occupational Therapy 56, 1 (2002), 34--39.

[29]

Jesse Sargent, Stephen Dopkins, John Philbeck, and David Chichka. 2010. Chunking in spatial memory. Journal of Experimental Psychology: Learning, memory, and cognition 36, 3 (2010), 576.

[30]

Caitlyn Seim, John Chandler, Kayla DesPortes, Siddharth Dhingra, Miru Park, and Thad Starner. 2014. Passive haptic learning of Braille typing. In Proceedings of the International Symposium on Wearable Computers. ACM, 111--118.

Digital Library

[31]

Caitlyn Seim, Tanya Estes, and Thad Starner. 2015. Towards Passive Haptic Learning of piano songs. In World Haptics Conference (WHC). IEEE, 445--450.

[32]

Caitlyn Seim, Saul Reynolds-Haertle, Sarthak Srinivas, and Thad Starner. 2016. Tactile taps teach rhythmic text entry: passive haptic learning of morse code. In Proceedings of the International Symposium on Wearable Computers. ACM, 164--171.

Digital Library

[33]

Caitlyn E Seim, David Quigley, and Thad E Starner. 2014. Passive haptic learning of typing skills facilitated by wearable computers. In CHI Extended Abstracts on Human Factors in Computing Systems. ACM, 2203--2208.

Digital Library

[34]

Charles H Shea, Qin Lai, Charles Black, and Jin-Hoon Park. 2000. Spacing practice sessions across days benefits the learning of motor skills. Human movement science 19, 5 (2000), 737--760.

[35]

Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomic Bulletin 8 Review 20, 1 (2013), 21--53.

[36]

Daniel Spelmezan, Deepak Ranjan Sahoo, and Sriram Subramanian. 2017. Sparkle: Hover Feedback with Touchable Electric Arcs. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3705--3717.

Digital Library

[37]

Evan Strasnick, Jessica R Cauchard, and James A Landay. 2017. BrushTouch: Exploring an Alternative Tactile Method for Wearable Haptics. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, 3120--3125.

Digital Library

[38]

Jane Bruner Wallace. 2000. The Effects of Color-Coding on Keyboarding Instruction of Third Grade Students. (2000).

[39]

Behymer-J. Waner, K. and S. McCrary. 1992. Two points of view on elementary school keyboarding. Business Education Forum, 27--29.

[40]

Bernhard Weber, Simon Schätzle, Thomas Hulin, Carsten Preusche, and Barbara Deml. 2011. Evaluation of a vibrotactile feedback device for spatial guidance. In World Haptics Conference (WHC). IEEE, 349--354.

[41]

Camille K Williams and Heather Carnahan. 2014. Motor Learning Perspectives on HapticTraining for the Upper Extremities. Transactions on Haptics 7, 2 (2014), 240--250.

Digital Library

[42]

Xiaoli Yang, Youn K Kim, Qian Wu, and Qing Chen. 2006. Hand function training in haptic virtual environment. In Proceedings of the International Conference on Mechatronics and Automation. IEEE, 395--399.

Cited By

Furuya SOku TNishioka HHirano M(2025)Surmounting the ceiling effect of motor expertise by novel sensory experience with a hand exoskeletonScience Robotics10.1126/scirobotics.adn380210:98Online publication date: 15-Jan-2025
https://doi.org/10.1126/scirobotics.adn3802
Gemicioglu THopper EDwivedi BKulkarni RBhandarkar ARajan PEng NRamanujam ARamey CGilliland SMason CSeim CStarner T(2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699748
Caulfield MForsyth JDeportes LCastaneda D(2024)Braille Learning using Haptic Feedback2024 Systems and Information Engineering Design Symposium (SIEDS)10.1109/SIEDS61124.2024.10534648(460-465)Online publication date: 3-May-2024
https://doi.org/10.1109/SIEDS61124.2024.10534648
Show More Cited By

Passive Haptic Training to Improve Speed and Performance on a Keypad
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

Towards haptic learning on a smartwatch
ISWC '18: Proceedings of the 2018 ACM International Symposium on Wearable Computers

Haptic technology can be used as a tool for learning. Can even the haptic elements in a smartwatch teach a new skill? Here we present a case of using a smartwatch for passive tactile learning. We use the Sony Smartwatch 3 to teach users Morse code while ...
Passive haptic learning of Braille typing
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

Passive Haptic Learning (PHL) is the acquisition of sensorimotor skills without active attention to learning. One method is to "teach" motor skills using vibration cues delivered by a wearable, tactile interface while the user is focusing on another, ...
Passive haptic learning of typing skills facilitated by wearable computers
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Passive Haptic Learning (PHL) allows people to learn "muscle memory" through vibration stimuli without devoting attention to the stimulus. PHL can be facilitated by wearable computers such as gloves with an embedded tactile interface. Previous work on ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 3

September 2017

2023 pages

EISSN:2474-9567

DOI:10.1145/3139486

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017

Accepted: 01 June 2017

Revised: 01 March 2017

Received: 01 February 2017

Published in IMWUT Volume 1, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
780
Total Downloads

Downloads (Last 12 months)144
Downloads (Last 6 weeks)29

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Furuya SOku TNishioka HHirano M(2025)Surmounting the ceiling effect of motor expertise by novel sensory experience with a hand exoskeletonScience Robotics10.1126/scirobotics.adn380210:98Online publication date: 15-Jan-2025
https://doi.org/10.1126/scirobotics.adn3802
Gemicioglu THopper EDwivedi BKulkarni RBhandarkar ARajan PEng NRamanujam ARamey CGilliland SMason CSeim CStarner T(2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699748
Caulfield MForsyth JDeportes LCastaneda D(2024)Braille Learning using Haptic Feedback2024 Systems and Information Engineering Design Symposium (SIEDS)10.1109/SIEDS61124.2024.10534648(460-465)Online publication date: 3-May-2024
https://doi.org/10.1109/SIEDS61124.2024.10534648
Niijima A(2023)Learning Effects and Retention of Electrical Muscle Stimulation in Piano PlayingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611373(104-108)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611373
Hsu HLin CLin YWu PKato HSu FKuo L(2021)Effects of vibrotactile-enhanced music-based intervention on sensorimotor control capacity in the hand of an aging brain: a pilot feasibility randomized crossover trialBMC Geriatrics10.1186/s12877-021-02604-021:1Online publication date: 23-Nov-2021
https://doi.org/10.1186/s12877-021-02604-0
Holman MGoldberg GDarter B(2020)Accuracy and precision of a wrist movement when vibrotactile prompts inform movement speedSomatosensory & Motor Research10.1080/08990220.2020.1765766(1-7)Online publication date: 14-May-2020
https://doi.org/10.1080/08990220.2020.1765766
Takakura RHakka KShizuki B(2019)Exploration of Passive Haptics Based Learning Support Method for Touch TypingProceedings of the 31st Australian Conference on Human-Computer-Interaction10.1145/3369457.3369524(529-533)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3369457.3369524
Pescara EPolly TSchankin ABeigl MFarrahi KHarle RLane N(2019)Reevaluating passive haptic learning of morse codeProceedings of the 2019 ACM International Symposium on Wearable Computers10.1145/3341163.3347714(186-194)Online publication date: 9-Sep-2019
https://dl.acm.org/doi/10.1145/3341163.3347714
Yoon SMa SLee WThakurdesai SSun DRibeiro FHolbery JGuimbretière FBernstein MReinecke K(2019)HapSenseProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347888(949-961)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347888
Chacon DVelloso EHoang TWolf KKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)SpinalLogProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3295626(5-14)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3295626
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents