Skip to main content
SpringerLink
Log in

QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input

  • Conference paper
  • First Online:
Universal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12188))

Included in the following conference series:

Abstract

We developed QB-Gest, a bimanual text entry method based on simple gestures where users drag their thumbs in the direction of the desired letter while visualizing the Qwerty-layout. In an experiment with four sessions of testing, 20 users achieved text entry rates of 11.1 wpm eyes-free and 14.1 wpm eyes-on. An expert user achieved an eyes-free rate of 24.9 wpm after 10 rounds of entering the-quick-brown-fox phrase. The method holds potential for users with low vision and certain types of reduced motor function.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Smith, A.L., Chaparro, B.S.: Smartphone text input method performance, usability, and preference with younger and older adults. Hum. Factors 57(6), 1015–1028 (2015)

    Article  Google Scholar 

  2. Leiva, L.A., Sahami, A., Catala, A., Henze, N., Schmidt, A.: Text entry on tiny QWERTY soft keyboards. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), pp. 669–678. ACM, New York (2015)

    Google Scholar 

  3. Azenkot, S., Lee, N.B.: Exploring the use of speech input by blind people on mobile devices. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013), Article 11. ACM, New York (2013)

    Google Scholar 

  4. Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., Gonçalves, D.: Blind people and mobile touch-based text-entry: acknowledging the need for different flavors. In: The proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011), pp. 179–186. ACM, New York (2011)

    Google Scholar 

  5. Azenkot, S., Bennett, C.L., Ladner, R.E.: DigiTaps: eyes-free number entry on touchscreens with minimal audio feedback. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST 2013), pp. 85–90. ACM, New York (2013)

    Google Scholar 

  6. Goh, T., Kim, S.W.: Eyes-free text entry interface based on contact area for people with visual impairment. In: Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST 2014 Adjunct), pp. 69–70. ACM, New York (2014)

    Google Scholar 

  7. Tinwala, H., MacKenzie, I.S.: Eyes-free text entry with error correction on touchscreen mobile devices. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI 2010), pp. 511–520. ACM, New York (2010)

    Google Scholar 

  8. Azenkot, S., Zhai, S.: Touch behavior with different postures on soft smartphone keyboards. In: Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2012), pp. 251–260. ACM, New York (2012)

    Google Scholar 

  9. MacKenzie, I.S., Zhang, S.X.: The design and evaluation of a high-performance soft keyboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1999), pp. 25–31. ACM, New York (1999)

    Google Scholar 

  10. MacKenzie, I.S.: Human-Computer Interaction: An Empirical Research Perspective. Morgan Kaufmann, Waltham (2013)

    Google Scholar 

  11. Zhai, S., Smith, B.A.: Alphabetically biased virtual keyboards are easier to use: layout does matter. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2001), pp. 321–322. ACM, New York (2001)

    Google Scholar 

  12. Bi, X., Smith, B.A., Zhai, S.: Quasi-qwerty soft keyboard optimization. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2010), pp. 283–286. ACM, New York (2010)

    Google Scholar 

  13. Raynal, M.: KeyGlasses: semi-transparent keys on soft keyboard. In: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS 2014), pp. 347–349. ACM, New York (2014)

    Google Scholar 

  14. Kane, S.K., Jayant, C., Wobbrock, J.O., Ladner, R.E.: Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and accessibility (Assets 2009), pp. 115–122. ACM, New York (2009)

    Google Scholar 

  15. MacKenzie, I.S., Buxton, W.: Extending Fitts’ law to two-dimensional tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1992), pp. 219–226. ACM, New York (1992)

    Google Scholar 

  16. Shi, W., Yu, C., Yi, X., Li, Z., Shi. Y.: TOAST: ten-finger eyes-free typing on touchable surfaces. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2(1) (2018). Article 33

    Google Scholar 

  17. Lu, Y., Yu, C., Yi, X., Shi, Y., Zhao, S.: BlindType: eyes-free text entry on handheld touchpad by leveraging thumb’s muscle memory. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1(2) (2017). Article 18

    Google Scholar 

  18. Zhu, S., Luo, T., Bi, X., Zhai, S.: Typing on an invisible keyboard. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Paper 439. ACM, New York (2018)

    Google Scholar 

  19. Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets 2008), pp. 73–80. ACM, New York (2008)

    Google Scholar 

  20. Guerreiro, J., Rodrigues, A., Montague, K., Guerreiro, T., Nicolau, H., Gonçalves, D.: TabLETS get physical: non-visual text entry on tablet devices. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), pp. 39–42. ACM, New York (2015)

    Google Scholar 

  21. Ward, D.J., Blackwell, A.F., MacKay, D.J.C.: Dasher—a data entry interface using continuous gestures and language models. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST 2000), pp. 129–137. ACM, New York (2000)

    Google Scholar 

  22. Polacek, O., Sporka, A.J., Slavik, P.: Text input for motor-impaired people. Univ. Access Inf. Soc. 16(1), 51–72 (2017)

    Article  Google Scholar 

  23. Lyons, K., et al.: Twiddler typing: one-handed chording text entry for mobile phones. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2004), pp. 671–678. ACM, New York (2004)

    Google Scholar 

  24. Sandnes, F.E.: Can spatial mnemonics accelerate the learning of text input chords? In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2006), pp. 245–249. ACM, New York (2006)

    Google Scholar 

  25. Frey, B., Rosier, K., Southern, C., Romero, M.: From texting app to braille literacy. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2012), pp. 2495–2500. ACM, New York (2012)

    Google Scholar 

  26. Goldberg, D., Richardson, C.: Touch-typing with a stylus. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems (CHI 1993), pp. 80–87. ACM, New York (1993)

    Google Scholar 

  27. Wobbrock, J.O., Myers, B.A., Aung, H.H., LoPresti, E.F.: Text entry from power wheelchairs: edgewrite for joysticks and touchpads. In: Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility (Assets 2004), pp. 110–117. ACM, New York (2003)

    Google Scholar 

  28. Castellucci, S.J., MacKenzie, I.S.:. Graffiti vs. unistrokes: an empirical comparison. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), pp. 305–308. ACM, New York (2008)

    Google Scholar 

  29. Wobbrock, J.O., Myers, B.A., Kembel, J.A.: EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST 2003), pp. 61–70. ACM, New York (2003)

    Google Scholar 

  30. Sandnes, F.E., Tan, T.B., Johansen, A., Sulic, E., Vesterhus, E., Iversen, E.R.: Making touch-based kiosks accessible to blind users through simple gestures. Univ. Access Inf. Soc. 11(4), 421–431 (2012)

    Article  Google Scholar 

  31. Chen, X., Grossman, T., Fitzmaurice, G.: Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 615–620. ACM (2014)

    Google Scholar 

  32. Bi, X., Chelba, C., Ouyang, T., Partridge, K., Zhai, S.: Bimanual gesture keyboard. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST 2012), pp. 137–146. ACM, New York (2012)

    Google Scholar 

  33. Lai, J., Zhang, D., Wang, S., Kilic, I.L., Zhou, L.: A thumb stroke-based virtual keyboard for sight-free text entry on touch-screen mobile phones. In: Hawaii International Conference on System Sciences (2018)

    Google Scholar 

  34. Banovic, N., Yatani, K., Truong, K.N.: Escape-keyboard: a sight-free one-handed text entry method for mobile touch-screen devices. Int. J. Mob. Hum. Comput. Interact. 5(3), 42–61 (2013)

    Article  Google Scholar 

  35. Armstrong, P., Wilkinson. B.: Text entry of physical and virtual keyboards on tablets and the user perception. In: Proceedings of the 28th Australian Conference on Computer-Human Interaction (OzCHI 2016), pp. 401–405. ACM, New York (2016)

    Google Scholar 

  36. Sandnes, F.E., Aubert, A.: Bimanual text entry using game controllers: relying on users’ spatial familiarity with QWERTY. Interact. Comput. 19(2), 140–150 (2007)

    Article  Google Scholar 

  37. Fredkin, E.: Trie memory. Commun. ACM 3(9), 490–499 (1960)

    Article  Google Scholar 

  38. MacKenzie, I.S.: KSPC (keystrokes per character) as a characteristic of text entry techniques. In: Paternò, F. (ed.) Mobile HCI 2002. LNCS, vol. 2411, pp. 195–210. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45756-9_16

    Chapter  Google Scholar 

  39. Matias, E., MacKenzie, I.S., Buxton, W.: Half-QWERTY: typing with one hand using your two-handed skills. In: Plaisant, C. (ed.) Conference Companion on Human Factors in Computing Systems (CHI 1994), pp. 51–52. ACM, New York (1994)

    Google Scholar 

  40. MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: CHI 2003 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2003), pp. 754–755. ACM, New York (2003)

    Google Scholar 

  41. MacKenzie, I.S., Soukoreff. R.W.: A character-level error analysis technique for evaluating text entry methods. In: Proceedings of the Second Nordic Conference on Human-computer Interaction (NordiCHI 2002), pp. 243–246. ACM, New York (2002)

    Google Scholar 

  42. Kurtenbach, G., Buxton, W.: User learning and performance with marking menus. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1994), pp. 258–264. ACM, New York (1994)

    Google Scholar 

  43. MacKenzie, I.S., Castellucci, S.: Reducing visual demand for gestural text input on touchscreen devices. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2012), pp. 2585–2590. ACM, New York (2012)

    Google Scholar 

  44. Sandnes, F.E., Huang, Y.-P.: Chording with spatial mnemonics: automatic error correction for eyes-free text entry. J. Inf. Sci. Eng. 22(5), 1015–1031 (2006)

    Google Scholar 

  45. Wobbrock, J.O., Findlater, L., Gergle, D., Higgins, J.J.: The aligned rank transform for nonparametric factorial analyses using only anova procedures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), pp. 143–146. ACM, New York (2011)

    Google Scholar 

  46. Bonner, M.N., Brudvik, J.T., Abowd, Gregory D., Edwards, W.K.: No-look notes: accessible eyes-free multi-touch text entry. In: Floréen, P., Krüger, A., Spasojevic, M. (eds.) Pervasive 2010. LNCS, vol. 6030, pp. 409–426. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12654-3_24

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Oslo Metropolitan University, 0130, Oslo, Norway

    Linghui Ye & Frode Eika Sandnes

  2. Institute of Technology, Kristiania University College, 0153, Oslo, Norway

    Frode Eika Sandnes

  3. Department of Computer Science, York University, Toronto, ON, M3J 1P3, Canada

    I. Scott MacKenzie

Authors
  1. Linghui Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Frode Eika Sandnes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. I. Scott MacKenzie
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frode Eika Sandnes .

Editor information

Editors and Affiliations

  1. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  2. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ye, L., Sandnes, F.E., MacKenzie, I.S. (2020). QB-Gest: Qwerty Bimanual Gestural Input for Eyes-Free Smartphone Text Input. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Design Approaches and Supporting Technologies. HCII 2020. Lecture Notes in Computer Science(), vol 12188. Springer, Cham. https://doi.org/10.1007/978-3-030-49282-3_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49282-3_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49281-6

  • Online ISBN: 978-3-030-49282-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation