Skip to main content
SpringerLink
Log in

Continuous-Touch Text Entry for AR Glasses

  • Conference paper
  • First Online:
Virtual Reality and Mixed Reality (EuroXR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 13105))

Included in the following conference series:

Abstract

The emergence of Augmented Reality (AR) has brought new challenges to the design of text entry interfaces. When wearing a pair of head-mounted AR glasses, a user’s visual focus could be anywhere 360 \(^\circ \)C around her. For example, a technician is looking up at an airplane engine, meanwhile sharing her view with remote technicians through the sensors on the AR glasses. In such a scenario, the technician has to keep her gaze at the parts and look away from input devices such as a wireless keyboard or a touchscreen. Thus, she will have limited ability to input text for tasks like taking notes about a certain engine part. In this work, we designed and developed two innovative text entry interfaces: Continuous-touch T9 (CTT9) and Continuous-touch Dual Ring (CTDR). Our methods employ a smartphone touchscreen and a projected text entry layout in AR space to help the users input texts without looking at the smartphone. Our user studies suggest the effectiveness of CTT9 and CTDR and provide clues on how to optimize them. Based on the user study results, we provide insights about applying the proposed Continuous-touch (CT) paradigms to text entry for AR glasses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Budhiraja, R., Lee, G.A., Billinghurst, M.: Using a HHD with a HMD for mobile AR interaction. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1–6 (2013)

    Google Scholar 

  2. Doronichev, A.: Daydream Labs: exploring and sharing VR’s possibilities. https://blog.google/products/google-ar-vr/daydream-labs-exploring-and-sharing-vrs/. Accessed 26 July 2021

  3. Fashimpaur, J., Kin, K., Longest, M.: Pinchtype: text entry for virtual and augmented reality using comfortable thumb to fingertip pinches. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA 2020), pp. 1–7. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3334480.3382888

  4. Grubert, J., Witzani, L., Ofek, E., Pahud, M., Kranz, M., Kristensson, P.: Text entry in immersive head-mounted display-based virtual reality using standard keyboards. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 159–166 (2018)

    Google Scholar 

  5. Gugenheimer, J., Dobbelstein, D., Winkler, C., Haas, G., Rukzio, E.: FaceTouch: enabling touch interaction in display fixed UIs for mobile virtual reality. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST 2016), pp. 49–60 (2016)

    Google Scholar 

  6. Jiang, H., Weng, D.: HiPad: text entry for head-mounted displays using circular touchpad. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 692–703 (2020)

    Google Scholar 

  7. Lee, Y., Kim, G.J.: Vitty: virtual touch typing interface with added finger buttons. In: Virtual, Augmented and Mixed Reality, pp. 111–119 (2017)

    Google Scholar 

  8. MacKenzie, I.S.: A note on calculating text entry speed. https://www.yorku.ca/mack/RN-TextEntrySpeed.html. Accessed 26 July 2021

  9. MacKenzie, I.S.: Fitts’ law as a research and design tool in human-computer interaction. Hum.-Comput. Interac. 7, 91–139 (1992)

    Article  Google Scholar 

  10. MacKenzie, I.S., Soukoreff, R.W.: Text entry for mobile computing: models and methods, theory and practice. Hum.-Comput. Interac. 17(2–3), 147–198 (2002)

    Article  Google Scholar 

  11. MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: Extended Abstracts on Human Factors in Computing Systems (CHI 2003), pp. 754–755. CHI EA 2003 (2003)

    Google Scholar 

  12. Mankoff, J., Abowd, G.D.: Cirrin: a word-level unistroke keyboard for pen input. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology (1998)

    Google Scholar 

  13. Millette, A., McGuffin, M.J.: Dualcad: integrating augmented reality with a desktop GUI and smartphone interaction. In: 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pp. 21–26 (2016)

    Google Scholar 

  14. Misra, S., Singha, J., Laskar, R.H.: Vision-based hand gesture recognition of alphabets, numbers, arithmetic operators and ascii characters in order to develop a virtual text-entry interface system. Neural Comput. Appl. 29(8), 117–135 (2018)

    Article  Google Scholar 

  15. Soukoreff, R.W., MacKenzie, I.S.: Metrics for text entry research: An evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2003) (2003)

    Google Scholar 

  16. Surale, H.B., Gupta, A., Hancock, M., Vogel, D.: TabletInVR: exploring the design space for using a multi-touch tablet in virtual reality. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13 (2019)

    Google Scholar 

  17. Walker, J., Li, B., Vertanen, K., Kuhl, S.: Efficient typing on a visually occluded physical keyboard. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 5457–5461 (2017)

    Google Scholar 

  18. Whitmire, E., et al.: DigiTouch: reconfigurable thumb-to-finger input and text entry on head-mounted displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1(3) (2017)

    Google Scholar 

  19. Xu, W., Liang, H.N., Zhao, Y., Zhang, T., Yu, D., Monteiro, D.: RingText: dwell-free and hands-free text entry for mobile head-mounted displays using head motions. IEEE Trans. Visual. Comput. Graph. 25(5), 1991–2001 (2019)

    Article  Google Scholar 

  20. Yu, C., Gu, Y., Yang, Z., Yi, X., Luo, H., Shi, Y.: Tap, dwell or gesture? exploring head-based text entry techniques for hmds. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 4479–4488 (2017)

    Google Scholar 

  21. Yu, D., Fan, K., Zhang, H., Monteiro, D., Xu, W., Liang, H.N.: PizzaText: text entry for virtual reality systems using dual thumbsticks. IEEE Trans. Visual. Comput. Graph. 24(11), 2927–2935 (2018)

    Article  Google Scholar 

  22. Zhu, F., Grossman, T.: BISHARE: exploring bidirectional interactions between smartphones and head-mounted augmented reality. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 2020), pp. 1–14 (2020)

    Google Scholar 

Download references

Acknowledgement

The authors would like to thank Chris Vick for proofreading and Baosong Xu and Chao Ren for helping with user studies. The first author was partially supported by a gift grant from OPPO.

Author information

Authors and Affiliations

  1. Kennesaw State University, Marietta, GA, 30060, USA

    Chao Mei

  2. OPPO US Research Center, InnoPeak Technology, Inc., Palo Alto, CA, 94303, USA

    Chao Mei, Buyi Xu & Yi Xu

Authors
  1. Chao Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Buyi Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao Mei .

Editor information

Editors and Affiliations

  1. University Paris-Saclay, Orsay, France

    Patrick Bourdot

  2. Universitat Politècnica de València, Valencia, Valencia, Spain

    Mariano Alcañiz Raya

  3. Los Andes University, Bogota, Colombia

    Pablo Figueroa

  4. University of Minnesota, Minneapolis, MN, USA

    Victoria Interrante

  5. RWTH Aachen University, Aachen, Nordrhein-Westfalen, Germany

    Torsten W. Kuhlen

  6. University of Central Florida, Orlando, FL, USA

    Dirk Reiners

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mei, C., Xu, B., Xu, Y. (2021). Continuous-Touch Text Entry for AR Glasses. In: Bourdot, P., Alcañiz Raya, M., Figueroa, P., Interrante, V., Kuhlen, T.W., Reiners, D. (eds) Virtual Reality and Mixed Reality. EuroXR 2021. Lecture Notes in Computer Science(), vol 13105. Springer, Cham. https://doi.org/10.1007/978-3-030-90739-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90739-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90738-9

  • Online ISBN: 978-3-030-90739-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation