Skip to main content
SpringerLink
Log in

Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices

  • Original Paper
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

Recently touch screens are widely used for mobile devices to provide intuitive and natural interactions with hands and fingers. However, the lack of tactile responses makes it difficult for users to get key-click confirmations during text entry with soft keyboards. This paper examines the effect of tactile feedback on typing performance with the soft QWERTY keyboard, the most commonly-used, multi-finger text entry and thumb typing methods in mobile devices. In order to investigate the typing performance, we implemented tactile feedback functions by embedding multiple piezoelectric actuators that was attached under the touchscreen to simulate the key-click effect in commercial mobile platforms, MS Surface Pro (tablet) and Nokia Lumia520 (phone). We conducted an experiment of transcription tasks to measure typing performance and user preference. The experiments involved transcribing given phrases with three feedback conditions: visual only, visual with audio, and visual with tactile. The results showed that the typing performance (KSPC, WPM, UER, CER) has been significantly improved by adding tactile feedback to the existing visual display on a commercial tablet and phone. A further quantitative analysis by questionnaire also showed that all of the participants preferred tactile or aural feedback to visual feedback only. This study thus provides researchers and designers with practical guidelines regarding tactile feedback on commercial mobile devices.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Findlater L, Wobbrock J (2012) Personalized input: improving ten-finger touchscreen typing through automatic adaptation. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 815–824

  2. Li F, Guy R, Yatani K, Truong K (2011) The 1line keyboard: a QWERTY layout in a single line. In: Proceedings of the 24th annual ACM symposium on user interface software and technology, pp 461–470

  3. Goel M, Jansen A, Mandel, T, Patel SN, and Wobbrock J (2013) Contexttype: using hand posture information to improve mobile touch screen text entry. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2795–2798

  4. Rabin E, Gordon AM (2004) Tactile feedback contributes to consistency of finger movements during typing. Exp Brain Res 1553:362–369

    Article  Google Scholar 

  5. Findlater L, Wobbrock J, Wigdor D (2011) Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces, In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 2453–2462

  6. Jansen Y, Karrer T, Borchers J (2010) MudPad: localized tactile feedback on touch surfaces. In: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology, pp 385–386

  7. Kyung KU, Lee JY, Srinivasan MA (2009) Precise manipulation of GUI on a touch screen with haptic cues. In: Proceedings on the 3rd joint eurohaptics symposium and symposium on haptic interfaces for virtual environment and teleoperator systems, pp 202–207

  8. Brewster SA, Chohan F, Brown L (2007) Tactile feedback for mobile interactions. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 159–162

  9. Hoggan E, Brewster SA, Johnston J (2008) Investigating the effectiveness of tactile feedback for mobile touchscreens. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 1573–1582

  10. McAdam C, Brewster SA (2009) Distal tactile feedback for text entry on tabletop computers. In: Proceedings of the 23rd british HCI group annual conference on people and computers: celebrating people and technology british computer society, pp 504–511

  11. Hoffmann A, Spelmezan D, Borchers J (2009) TypeRight: a keyboard with tactile error prevention. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2265–2268

  12. MacKenzie IS, Soukoreff RW (2003) Phrase sets for evaluating text entry techniques. In: CHI’03 extended abstracts on human factors in computing systems, pp 754–755

  13. Chen HY, Park J, Dai S, Tan HZ (2011) Design and evaluation of identifiable key-click signals for mobile devices. IEEE Trans Haptics 4(4):229–241

    Article  Google Scholar 

  14. Soukoreff RW, MacKenzie IS (2003) Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 113–120

  15. Koskinen E, Kaaresoja T, Laitinen P (2008) Feel-good Touch: finding the most pleasant tactile feedback for a mobile touch screen button. In: Proceedings of the 10th international conference on multimodal interfaces ACM, pp 297–304

  16. Soukoreff RW, MacKenzie IS (2001) Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. In: CHI’01 extended abstracts on human factors in computing systems ACM, pp 319–320

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Korea Advanced Institute of Science Technology, 291 Daehak-ro, Yuseong-gu, Daejeon, Korea

    Byungkil Han

  2. Department of Information and Telecommunication Engineering, Incheon National University, 119 Academy-ro, Yeonsu-gu, Incheon, Korea

    Kwangtaek Kim

Authors
  1. Byungkil Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kwangtaek Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kwangtaek Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Han, B., Kim, K. Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices. J Multimodal User Interfaces 9, 173–181 (2015). https://doi.org/10.1007/s12193-015-0177-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-015-0177-4

Keywords

Search

Navigation