Skip to main content
SpringerLink
Log in
Book cover

International Conference on Human-Computer Interaction

HCII 2020: HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality pp 314–329Cite as

Text Input in Virtual Reality Using a Tracked Drawing Tablet

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12428))

Abstract

We present an experiment evaluating the effectiveness of a tracked drawing tablet for use in virtual reality (VR) text input. Participants first completed a text input pre-test, entering several phrases using a physical keyboard. Participants then entered text in VR using an HTC Vive, with a tracker mounted on a drawing tablet with a QWERTY soft keyboard overlaid on the virtual tablet. This was similar to text input using stylus-supported mobile devices. Our results indicate that not only did participants prefer the Vive controller, it also offered superior entry speed (16.31 wpm vs. 12.79 wpm with the tablet and stylus) and error rates (4.1% vs. 6.4%). Pre-test scores were also correlated to measured entry speeds, and reveal that user typing speed on physical keyboards provides a modest predictor of VR text input speed (R2 of 0.6 for the Vive controller, 0.45 for the tablet).

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Available at http://www.yorku.ca/mack/HCIbook/.

References

  1. Aguerreche, L., Duval, T., Lécuyer, A.: Reconfigurable tangible devices for 3D virtual object manipulation by single or multiple users. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, pp. 227–230 (2010)

    Google Scholar 

  2. Bovet, S., et al.: Using traditional keyboards in VR: steam VR developer kit and pilot game user study. In: IEEE Games, Entertainment, Media Conference, pp. 132–135 (2018)

    Google Scholar 

  3. Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., INC (2004)

    Google Scholar 

  4. Bowman, D.A., Rhoton, C.J., Pinho, M.S.: Text input techniques for immersive virtual environments: an empirical comparison. Proc. Human Factors Ergon. Soc. Ann. Meeting 46(26), 2154–2158 (2002)

    Article  Google Scholar 

  5. Brooks, J.F.P., Insko, B.E.: Passive Haptics Significantly Enhances Virtual Environments. The University of North Carolina at Chapel Hill

    Google Scholar 

  6. Cechanowicz, J., Dawson, S., Victor, M., Subramanian, S.: Stylus based text input using expanding CIRRIN. Adv. Vis. Interfaces, pp. 163–166 (2006)

    Google Scholar 

  7. Chen, T.-T., Hsu, C.-H., Chung, C.-H., Wang, Y.-S., Babu, S.V.: iVRNote: design, creation and evaluation of an interactive note-taking interface for study and reflection in VR learning environments. In: IEEE Conference on Virtual Reality and 3D User Interfaces, 172–180 (2019)

    Google Scholar 

  8. Franzluebbers, A., Johnsen, K.: Performance benefits of high-fidelity passive haptic feedback in virtual reality training. In: ACM Symposium on Spatial User Interaction, pp. 16–24 (2018)

    Google Scholar 

  9. Goldberg, D., Richardson, C.: Touch-typing with a stylus. In: Proceedings of the INTERACT 1993 and Conference on Human Factors in Computing Systems, pp. 80–87 (1993)

    Google Scholar 

  10. González, G., Molina, J.P., García, A.S., Martínez, D., González, P.: Evaluation of text input techniques in immersive virtual environments. New Trends on Human-Computer Interaction: Research, Development, New Tools and Methods. Springer. 109–118

    Google Scholar 

  11. Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., Kristensson, P.O.: Effects of hand representations for typing in virtual reality. In: IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 151–158 (2018)

    Google Scholar 

  12. Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., Kristensson, P.O.: Text entry in immersive head-mounted display-based virtual reality using standard keyboards. In: IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 159–166 (2018)

    Google Scholar 

  13. Gugenheimer, J., Dobbelstein, D., Winkler, C., Haas, G., Rukzio, E.: FaceTouch: enabling touch interaction in display fixed uis for mobile virtual reality. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 49–60 (2016)

    Google Scholar 

  14. Henrikson, R., Araujo, B., Chevalier, F., Singh, K., Balakrishnan, R.: Multi-device storyboards for cinematic narratives in VR. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pp. 787–796 (2016)

    Google Scholar 

  15. Hoffman, H.G.: Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In: Proceedings of the Virtual Reality Annual International Symposium, pp. 59–63 (1998)

    Google Scholar 

  16. Isokoski, P., Raisamo, R.: Quikwriting as a multi-device text entry method. In: Proceedings of the Third Nordic Conference on Human-Computer Interaction, pp. 105–108 (2004)

    Google Scholar 

  17. Katzakis, N., Teather, R.J., Kiyokawa, K., Takemura, H.: INSPECT: extending plane-casting for 6-DOF control. In: Proceedings IEEE Symposium on 3D User Interfaces, pp. 165–166 (2015)

    Google Scholar 

  18. Kim, Y.R., Kim, G.J.: HoVR-Type: smartphone as a typing interface in VR using hovering. In: IEEE International Conference on Consumer Electronics (ICCE), pp. 200–203 (2017)

    Google Scholar 

  19. Knierim, P., Schwind, V., Feit, A.M., Nieuwenhuizen, F., Henze, N.: Physical keyboards in virtual reality: analysis of typing performance and effects of avatar hands. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 1–9 (2018)

    Google Scholar 

  20. Költringer, T., Isokoski, P., Grechenig, T.: TwoStick: writing with a game controller. In: Proceedings of Graphics Interface, 103–110 (2007)

    Google Scholar 

  21. Kuester, F., Chen, M., Phair, M.E., Mehring, C.: Towards keyboard independent touch typing in VR, p. 86, February 2006

    Google Scholar 

  22. Lindeman, R.R.W., Sibert, J.J.L., Hahn, J.K.J.J.K.: Towards usable VR: an empirical study of user interfaces for immersive virtual environments. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp. 64–71 (1999)

    Google Scholar 

  23. MacKenzie, I.S., Soukoreff, R.W.: A character-level error analysis technique for evaluating text entry methods. In: Proceedings of the Second Nordic Conference on Human-Computer Interaction, pp. 243–246 (2004)

    Google Scholar 

  24. MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: Extended Abstracts on Human Factors in Computing Systems, pp. 754–755 (2003)

    Google Scholar 

  25. MacKenzie, I.S., Soukoreff, R.W.: Text entry for mobile computing: models and methods, theory and practice. Hum.-Comput. Interact. 17(2–3), 147–198 (2002)

    Article  Google Scholar 

  26. Markussen, A., Jakobsen, M.R., Hornbæk, K., Markussen, A., Jakobsen, M.R., Hornbæk, K.: Vulture: a mid-air word-gesture keyboard. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems - CHI 2014, pp. 1073–1082 (2014)

    Google Scholar 

  27. McClelland, J.C., Teather, R.J., Girouard, A.: Haptobend: shape-changing passive haptic feedback in virtual reality. In: Proceedings of the 5th Symposium on Spatial User Interaction, pp. 82–90 (2017)

    Google Scholar 

  28. Mehring, C., Kuester, F., Singh, K.D., Chen, M.: KITTY: keyboard independent touch typing in VR. In: Virtual Reality Annual International Symposium, pp. 243–244 (2004)

    Google Scholar 

  29. Natapov, D., Castellucci, S.J., MacKenzie, I.S.: ISO 9241-9 evaluation of video game controllers. In: Proceedings of Graphics Interface, pp. 223–230 (2009)

    Google Scholar 

  30. Perlin, K.: Quikwriting: continuous stylus-based text entry. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, pp. 215–216 (1998)

    Google Scholar 

  31. Pick, S., Puika, A.S., Kuhlen, T.W.: SWIFTER: design and evaluation of a speech-based text input metaphor for immersive virtual environments. In: IEEE Symposium on 3D User Interfaces (3DUI), pp. 109–112 (2016)

    Google Scholar 

  32. Poupyrev, I., Tomokazu, N., Weghorst, S.: Virtual notepad: handwriting in immersive VR. In: Proceedings IEEE Virtual Reality Annual International Symposium, pp. 126–132 (1998)

    Google Scholar 

  33. Prätorius, M., Burgbacher, U., Valkov, D., Hinrichs, K.: Sensing thumb-to-finger taps for symbolic input in VR/AR environments. IEEE Comput. Graph. Appl. 35(5), 42–54 (2015). https://doi.org/10.1109/MCG.2015.106

    Article  Google Scholar 

  34. Rajanna, V., Paulin Hansen, J.: Gaze typing in virtual reality: impact of keyboard design, selection method, and motion. Proc. ACM Sympos. Eye Track. Res. Appl. 15(1–15), 10 (2018)

    Google Scholar 

  35. Reyal, S., Zhai, S., Kristensson, P.O.: Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild, pp. 679–688, April 2015

    Google Scholar 

  36. De Sa Medeiros, D.P., De Carvalho, F.G., Raposo, A.B., Dos Santos, I.H.F.: An interaction tool for immersive environments using mobile devices. In: XV Symposium on Virtual and Augmented Reality, pp. 90–96 (2013)

    Google Scholar 

  37. Shibata, T., Afergan, D., Kong, D., Yuksel, B.F., MacKenzie, S., Jacob, R.J.K.: Text entry for ultra-small touchscreens using a fixed cursor and movable keyboard. In: Proceedings of the Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3770–3773 (2016)

    Google Scholar 

  38. Shneiderman, B.: The limits of speech recognition. Commun. ACM, 2000, 319–365 (2000)

    Google Scholar 

  39. Soukoreff, R.W., MacKenzie, I.S.: Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. Extended Abstracts Hum. Factors Comput. Syst., pp. 319–320 (2001)

    Google Scholar 

  40. Soukoreff, R.W., MacKenzie, I.S.: Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. Proceedings of the ACM Conference on Human Factors in Computing Systems – CHI 2003, 113–120 (2003)

    Article  Google Scholar 

  41. Speicher, M., Feit, A.M., Ziegler, P., Krüger, A.: Selection-based text entry in virtual reality. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 1–13 (2018)

    Google Scholar 

  42. Tuttle, A.J., Savadatti, S., Johnsen, K.: Facilitating collaborative engineering analysis problem solving in immersive virtual reality. In: American Society for Engineering Education (2019)

    Google Scholar 

  43. Vertanen, K.: Efficient Correction Interfaces for Speech Recognition. University of Cambridge (2009)

    Google Scholar 

  44. Walker, J., Kuhl, S., Vertanen, K.: Decoder-assisted typing using an HMD and a physical keyboard. In: Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, p. 16 (2016)

    Google Scholar 

  45. Walker, J., Li, B., Vertanen, K., Kuhl, S.: Efficient typing on a visually occluded physical keyboard. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 5457–5461 (2017)

    Google Scholar 

  46. Wang, C.-Y., Chu, W.-C., Chiu, P.-T., Hsiu, M.-C., Chiang, Y.-H., Chen, M.Y.: PalmType: using palms as keyboards for smart glasses. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI 2015 (2015)

    Google Scholar 

  47. Wang, J., Lindeman, R.W.: Object impersonation: towards effective interaction in tablet- and HMD-based hybrid virtual environments. In: IEEE Virtual Reality (VR), pp. 111–118 (2015)

    Google Scholar 

  48. Whitmire, E., et al.: DigiTouch: reconfigurable thumb-to-finger input and text entry on head-mounted displays. Displays. PACM Interact. Mob. Wearable Ubiquitous Technol. 1, 113 (2017)

    Google Scholar 

  49. William Soukoreff, R., Scott Mackenzie, I.: Theoretical upper and lower bounds on typing speed using a stylus and a soft keyboard. Behav. Inf. Technol. 14(6), 370–379 (1995)

    Google Scholar 

  50. Wilson, A.D., Agrawala, M.: Text entry using a dual joystick game controller. In: ACM Conference on Human Factors in Computing Systems, 475–478 (2006)

    Google Scholar 

  51. Wobbrock, J.O., Myers, B.A., Kembel, J.A.: EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion. In: ACM Symposium on User Interface Software and Technology, pp. 61–70 (2003)

    Google Scholar 

  52. Xin, Y., Chun, Y., Mingrui, Z., Sida, G., Ke Sun, Y.S.: ATK: enabling ten-finger freehand typing in air based on 3D hand tracking data. In: ACM Symposium on User Interface Software & Technology, pp. 539–548 (2015)

    Google Scholar 

  53. Xu, W., Liang, H.N., Zhao, Y., Zhang, T., Yu, D., Monteiro, D.: RingText: dwell-free and hands-free text entry for mobile head-mounted displays using head motions. IEEE Trans. Visual. Comput. Graph. 25(5), 1991–2001 (2019)

    Google Scholar 

  54. Yatani, K., Truong, K.N.: An evaluation of stylus-based text entry methods on handheld devices studied in different user mobility states. Pervasive Mobile Comput. 5(5), 496–508 (2009)

    Article  Google Scholar 

  55. Yu, C., Gu, Y., Yang, Z., Yi, X., Luo, H., Shi, Y.: Tap, Dwell or Gesture?: exploring head-based text entry techniques for HMDs. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 4479–4488 (2017)

    Google Scholar 

  56. Yu, D., Fan, K., Zhang, H., Monteiro, D., Xu, W., Liang, H.N.: PizzaText: text entry for virtual reality systems using dual thumbsticks. IEEE Trans. Visual. Comput. Graph. 24(11), 2927–2935 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Kyle Johnsen and A. J. Tuttle for sharing their tablet driver source code. We also thank our participants. This research was supported by NSERC.

Author information

Authors and Affiliations

  1. Carleton University, 1125 Colonel by Dr, Ottawa, ON, K1S 5B6, Canada

    Seyed Amir Ahmad Didehkhorshid, Siju Philip, Elaheh Samimi & Robert J. Teather

Authors
  1. Seyed Amir Ahmad Didehkhorshid
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siju Philip
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elaheh Samimi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Robert J. Teather
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Robert J. Teather .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  3. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Didehkhorshid, S.A.A., Philip, S., Samimi, E., Teather, R.J. (2020). Text Input in Virtual Reality Using a Tracked Drawing Tablet. In: Stephanidis, C., Chen, J.Y.C., Fragomeni, G. (eds) HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality. HCII 2020. Lecture Notes in Computer Science(), vol 12428. Springer, Cham. https://doi.org/10.1007/978-3-030-59990-4_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59990-4_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59989-8

  • Online ISBN: 978-3-030-59990-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation