Work in Progress

Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual Reality

Authors:

Tafadzwa Joseph Dube,

Ahmed Sabbir ArifAuthors Info & Claims

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 47, Pages 1 - 8

https://doi.org/10.1145/3569009.3573117

Published: 26 February 2023 Publication History

Abstract

Free-hand mid-air Qwerty enables entering text in virtual reality without the use of controllers. However, it is much slower and more error prone than its physical counterpart, primarily due to the absence of haptic feedback and reduced spatial awareness. In this paper, we design three different ultrasonic haptic feedback for mid-air Qwerty: feedback only on keypress, on both touch and keypress, and gradual feedback that increases intensity as users push down a key. In a pilot study, the touch & press feedback performed significantly better both quantitatively and qualitatively. We then compare a mid-air Qwerty with and without touch & press feedback in a user study. Results revealed that haptic feedback improves entry speed by 16% and reduces error rate by 26%. Besides, most participants feel that it improves presence and spatial awareness in the virtual-world by maintaining a higher consistency with the real-world, and significantly reduces mental demand, effort, and frustration.

Supplementary Material

MP4 File (TEI_2023_Ultrasonic_Keyboard_Video.mp4)

Demonstration video

Download
38.70 MB

References

[1]

Ferran Argelaguet, Ludovic Hoyet, Michael Trico, and Anatole Lecuyer. 2016. The Role of Interaction in Virtual Embodiment: Effects of the Virtual Hand Representation. In 2016 IEEE Virtual Reality (VR). IEEE, Washington, DC, USA, 3–10. https://doi.org/10.1109/VR.2016.7504682

[2]

Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2009. Analysis of Text Entry Performance Metrics. In 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). IEEE, Washington, DC, USA, 100–105. https://doi.org/10.1109/TIC-STH.2009.5444533

[3]

Sabah Boustila, Thomas Guégan, Kazuki Takashima, and Yoshifumi Kitamura. 2019. Text Typing in VR Using Smartphones Touchscreen and HMD. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka,Japan, 860–861. https://doi.org/10.1109/VR.2019.8798238

[4]

Sidney Bovet, Aidan Kehoe, Katie Crowley, Noirin Curran, Mario Gutierrez, Mathieu Meisser, Damien O Sullivan, and Thomas Rouvinez. 2018. Using Traditional Keyboards in VR: SteamVR Developer Kit and Pilot Game User Study. In 2018 IEEE Games, Entertainment, Media Conference (GEM). 1–9. https://doi.org/10.1109/GEM.2018.8516449

[5]

Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013. UltraHaptics: Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology(UIST ’13). Association for Computing Machinery, New York, NY, USA, 505–514. https://doi.org/10.1145/2501988.2502018

Digital Library

[6]

Patricia Ivette Cornelio Martinez, Silvana De Pirro, Chi Thanh Vi, and Sriram Subramanian. 2017. Agency in Mid-Air Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2426–2439.

Digital Library

[7]

Seyed Amir Ahmad Didehkhorshid, Siju Philip, Elaheh Samimi, and Robert J. Teather. 2020. Text Input in Virtual Reality Using a Tracked Drawing Tablet. In HCI International 2020 – Late Breaking Papers: Virtual and Augmented Reality(Lecture Notes in Computer Science). Springer International Publishing, Cham, Switzerland, 314–329. https://doi.org/10.1007/978-3-030-59990-4_24

Digital Library

[8]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text Entry in Virtual Reality: A Comprehensive Review of the Literature. In Human-Computer Interaction. Recognition and Interaction Technologies(Lecture Notes in Computer Science), Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 419–437. https://doi.org/10.1007/978-3-030-22643-5_33

Digital Library

[9]

Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2020. Impact of Key Shape and Dimension on Text Entry in Virtual Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–10. https://doi.org/10.1145/3334480.3382882

Digital Library

[10]

Tafadzwa Joseph Dube, Kevin Johnson, and Ahmed Sabbir Arif. 2022. Shapeshifter: Gesture Typing in Virtual Reality with a Force-based Digital Thimble. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3491101.3519679

Digital Library

[11]

Tafadzwa Joseph Dube, Yuan Ren, Hannah Limerick, I. Scott Mackenzie, and Ahmed Sabbir Arif. 2022. Push, Tap, Dwell, and Pinch: Evaluation of Four Mid-Air Selection Methods Augmented with Ultrasonic Haptic Feedback. Proceedings of the ACM on Human-Computer Interaction 6, ISS (Nov. 2022), 565:1–565:19. https://doi.org/10.1145/3567718

Digital Library

[12]

John Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 289–300. https://doi.org/10.1109/ISMAR.2019.00027

[13]

Jacqui Fashimpaur, Kenrick Kin, and Matt Longest. 2020. PinchType: Text Entry for Virtual and Augmented Reality Using Comfortable Thumb to Fingertip Pinches. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–7. https://doi.org/10.1145/3334480.3382888

Digital Library

[14]

Conor R. Foy, John J. Dudley, Aakar Gupta, Hrvoje Benko, and Per Ola Kristensson. 2021. Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–11.

Digital Library

[15]

William Frier, Damien Ablart, Jamie Chilles, Benjamin Long, Marcello Giordano, Marianna Obrist, and Sriram Subramanian. 2018. Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air. In Haptics: Science, Technology, and Applications(Lecture Notes in Computer Science), Domenico Prattichizzo, Hiroyuki Shinoda, Hong Z. Tan, Emanuele Ruffaldi, and Antonio Frisoli (Eds.). Springer International Publishing, Cham, 270–281. https://doi.org/10.1007/978-3-319-93445-7_24

[16]

Orestis Georgiou, Hannah Limerick, Loïc Corenthy, Mark Perry, Mykola Maksymenko, Sam Frish, Jörg Müller, Myroslav Bachynskyi, and Jin Ryong Kim. 2019. Mid-Air Haptic Interfaces for Interactive Digital Signage and Kiosks. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3290607.3299030

Digital Library

[17]

Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Effects of Hand Representations for Typing in Virtual Reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 151–158. https://doi.org/10.1109/VR.2018.8446250

[18]

Jens Grubert, Lukas Witzani, Eyal Ofek, Michel Pahud, Matthias Kranz, and Per Ola Kristensson. 2018. Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 159–166. https://doi.org/10.1109/VR.2018.8446059

[19]

Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1991–1995.

Digital Library

[20]

Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16). Association for Computing Machinery, Tokyo, Japan, 49–60. https://doi.org/10.1145/2984511.2984576

Digital Library

[21]

Aakar Gupta, Majed Samad, Kenrick Kin, Per Ola Kristensson, and Hrvoje Benko. 2020. Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 350–360. https://doi.org/10.1109/ISMAR50242.2020.00062

[22]

Sidhant Gupta, Dan Morris, Shwetak N. Patel, and Desney Tan. 2013. AirWave: Non-Contact Haptic Feedback Using Air Vortex Rings. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing(UbiComp ’13). Association for Computing Machinery, New York, NY, USA, 419–428. https://doi.org/10.1145/2493432.2493463

Digital Library

[23]

Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9 (Oct. 2006), 904–908. https://doi.org/10.1177/154193120605000909 Publisher: SAGE Publications Inc.

[24]

Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology. Vol. 52. Elsevier, Amsterdam, The Netherlands, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9

[25]

Jay Henderson, Jessy Ceha, and Edward Lank. 2020. STAT: Subtle Typing Around the Thigh for Head-Mounted Displays. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3379503.3403549

Digital Library

[26]

Juan David Hincapié-Ramos, Xiang Guo, Paymahn Moghadasian, and Pourang Irani. 2014. Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’14). Association for Computing Machinery, Toronto, Ontario, Canada, 1063–1072. https://doi.org/10.1145/2556288.2557130

Digital Library

[27]

Adrian H. Hoppe, Leonard Otto, Florian van de Camp, Rainer Stiefelhagen, and Gabriel Unmüßig. 2018. qVRty: Virtual Keyboard with a Haptic, Real-World Representation. In HCI International 2018 – Posters’ Extended Abstracts(Communications in Computer and Information Science), Constantine Stephanidis (Ed.). Springer International Publishing, Cham, 266–272. https://doi.org/10.1007/978-3-319-92279-9_36

[28]

Seki Inoue, Yasutoshi Makino, and Hiroyuki Shinoda. 2015. Active Touch Perception Produced by Airborne Ultrasonic Haptic Hologram. In 2015 IEEE World Haptics Conference (WHC). 362–367. https://doi.org/10.1109/WHC.2015.7177739

[29]

Bret Jackson, Logan B Caraco, and Zahara M Spilka. 2020. Arc-Type and Tilt-Type: Pen-Based Immersive Text Input for Room-Scale VR. In Symposium on Spatial User Interaction. ACM, Virtual Event Canada, 1–10. https://doi.org/10.1145/3385959.3418454

Digital Library

[30]

Haiyan Jiang and Dongdong Weng. 2020. HiPad: Text Entry for Head-Mounted Displays Using Circular Touchpad. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Atlanta, GA, USA, 692–703. https://doi.org/10.1109/VR46266.2020.1581236395562

[31]

Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. HiFinger: One-Handed Text Entry Technique for Virtual Environments Based on Touches between Fingers. Sensors (Basel, Switzerland) 19, 14 (July 2019), 3063. https://doi.org/10.3390/s19143063

[32]

Sooyoung Kim and Gerard Jounghyun Kim. 2004. Using Keyboards with Head Mounted Displays. In Proceedings of the 2004 ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry(VRCAI ’04). Association for Computing Machinery, Singapore, 336–343. https://doi.org/10.1145/1044588.1044662

Digital Library

[33]

Youngwon R. Kim and Gerard J. Kim. 2017. HoVR-Type: Smartphone as a Typing Interface in VR Using Hovering. In 2017 IEEE International Conference on Consumer Electronics (ICCE). IEEE, Las Vegas, NV, USA, 200–203. https://doi.org/10.1109/ICCE.2017.7889285

[34]

Pascal Knierim, Thomas Kosch, Johannes Groschopp, and Albrecht Schmidt. 2020. Opportunities and Challenges of Text Input in Portable Virtual Reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, Honolulu, HI, USA, 1–8. https://doi.org/10.1145/3334480.3382920

Digital Library

[35]

Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3173574.3173919

Digital Library

[36]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1471–1482.

Digital Library

[37]

Xueshi Lu, Difeng Yu, Hai-Ning Liang, Xiyu Feng, and Wenge Xu. 2019. DepthText: Leveraging Head Movements towards the Depth Dimension for Hands-Free Text Entry in Mobile Virtual Reality Systems. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, Japan, 1060–1061. https://doi.org/10.1109/VR.2019.8797901

[38]

X. Lu, D. Yu, H.-N. Liang, W. Xu, Y. Chen, X. Li, and K. Hasan. 2020. Exploration of Hands-Free Text Entry Techniques For Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, Recife/Porto de Galinhas, Brazil, 344–349. https://doi.org/10.1109/ISMAR50242.2020.00061

[39]

I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase Sets for Evaluating Text Entry Techniques. In CHI ’03 Extended Abstracts on Human Factors in Computing Systems(CHI EA ’03). Association for Computing Machinery, Ft. Lauderdale, Florida, USA, 754–755. https://doi.org/10.1145/765891.765971

Digital Library

[40]

Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, Seoul, Republic of Korea, 2143–2152. https://doi.org/10.1145/2702123.2702382

Digital Library

[41]

Manuel Meier, Paul Streli, Andreas Fender, and Christian Holz. 2021. TaplD: Rapid Touch Interaction in Virtual Reality Using Wearable Sensing. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 519–528. https://doi.org/10.1109/VR50410.2021.00076

[42]

Manuel Meier, Paul Streli, Andreas Fender, and Christian Holz. 2021. TaplD: Rapid Touch Interaction in Virtual Reality Using Wearable Sensing. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 519–528. https://doi.org/10.1109/VR50410.2021.00076

[43]

Tim Menzner, Alexander Otte, Travis Gesslein, Jens Grubert, Philipp Gagel, and Daniel Schneider. 2019. A Capacitive-Sensing Physical Keyboard for VR Text Entry. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, Osaka, Japan, Japan, 1080–1081. https://doi.org/10.1109/VR.2019.8797754

[44]

Gerald M. Murch. 1984. Physiological Principles for the Effective Use of Color. IEEE Computer Graphics and Applications 4, 11 (Nov. 1984), 48–55. https://doi.org/10.1109/MCG.1984.6429356

[45]

Sachith Muthukumarana, Don Samitha Elvitigala, Juan Pablo Forero Cortes, Denys J.C. Matthies, and Suranga Nanayakkara. 2020. Touch Me Gently: Recreating the Perception of Touch Using a Shape-Memory Alloy Matrix. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[46]

Anh Nguyen, Samuel Bittman, and Markus Zank. 2020. Text Input Methods in Virtual Reality Using Radial Layouts. In 26th ACM Symposium on Virtual Reality Software and Technology(VRST ’20). Association for Computing Machinery, New York, NY, USA, 1–3. https://doi.org/10.1145/3385956.3422114

Digital Library

[47]

Duc-Minh Pham and Wolfgang Stuerzlinger. 2019. HawKEY: Efficient and Versatile Text Entry for Virtual Reality. In 25th ACM Symposium on Virtual Reality Software and Technology(VRST ’19). Association for Computing Machinery, Parramatta, NSW, Australia, 1–11. https://doi.org/10.1145/3359996.3364265

Digital Library

[48]

Vijay Rajanna and John Paulin Hansen. 2018. Gaze Typing in Virtual Reality: Impact of Keyboard Design, Selection Method, and Motion. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications(ETRA ’18). Association for Computing Machinery, Warsaw, Poland, 1–10. https://doi.org/10.1145/3204493.3204541

Digital Library

[49]

Ismo Rakkolainen, Antti Sand, and Roope Raisamo. 2019. A Survey of Mid-Air Ultrasonic Tactile Feedback. In 2019 IEEE International Symposium on Multimedia (ISM). 94–944. https://doi.org/10.1109/ISM46123.2019.00022

[50]

Mark Richardson, Matt Durasoff, and Robert Wang. 2020. Decoding Surface Touch Typing from Hand-Tracking. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology(UIST ’20). Association for Computing Machinery, New York, NY, USA, 686–696. https://doi.org/10.1145/3379337.3415816

Digital Library

[51]

Daniel Schneider, Alexander Otte, Travis Gesslein, Philipp Gagel, Bastian Kuth, Mohamad Shahm Damlakhi, Oliver Dietz, Eyal Ofek, Michel Pahud, Per Ola Kristensson, Jörg Müller, and Jens Grubert. 2019. ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 25, 11 (Nov. 2019), 3190–3201. https://doi.org/10.1109/TVCG.2019.2932239

Digital Library

[52]

R. William Soukoreff and I. Scott MacKenzie. 2003. Metrics for Text Entry Research: An Evaluation of MSD and KSPC, and a New Unified Error Metric. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’03). ACM, New York, NY, USA, 113–120. https://doi.org/10.1145/642611.642632 event-place: Ft. Lauderdale, Florida, USA.

Digital Library

[53]

Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-Based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–13. https://doi.org/10.1145/3173574.3174221

Digital Library

[54]

Robert J. Stone. 2001. Haptic Feedback: A Brief History from Telepresence to Virtual Reality. In Haptic Human-Computer Interaction(Lecture Notes in Computer Science), Stephen Brewster and Roderick Murray-Smith (Eds.). Springer, Berlin, Heidelberg, 1–16. https://doi.org/10.1007/3-540-44589-7_1

[55]

Ultraleap. 2020. Leap Motion Developer. https://developer.leapmotion.com.

[56]

Ultraleap Ltd. 2021. STRATOS Explore. https://www.ultraleap.com/datasheets/STRATOS_Explore_Development_Kit_datasheet.pdf

[57]

Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y. Chen. 2015. PalmType: Using Palms as Keyboards for Smart Glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 153–160. https://doi.org/10.1145/2785830.2785886

Digital Library

[58]

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 113:1–113:21. https://doi.org/10.1145/3130978

Digital Library

[59]

Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A Virtual Reality Keyboard with Realistic Haptic Feedback in a Fully Immersive Virtual Environment. Virtual Reality 21, 1 (March 2017), 19–29. https://doi.org/10.1007/s10055-016-0296-6

Digital Library

[60]

Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376306

Digital Library

[61]

Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology(UIST ’19). Association for Computing Machinery, New York, NY, USA, 883–899. https://doi.org/10.1145/3332165.3347865

Digital Library

[62]

Chun Yu, Yizheng Gu, Zhican Yang, Xin Yi, Hengliang Luo, and Yuanchun Shi. 2017. Tap, Dwell or Gesture? Exploring Head-Based Text Entry Techniques for HMDs. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, Denver, Colorado, USA, 4479–4488. https://doi.org/10.1145/3025453.3025964

Digital Library

Cited By

Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Chen LChen H(2024)User Authentication Using Typing Habits in Virtual Reality2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC54092.2024.10831104(3068-3075)Online publication date: 6-Oct-2024
https://doi.org/10.1109/SMC54092.2024.10831104
Kato SShizuki B(2023)Hover-Based Japanese Input Method without Restricting Arm Position for XRProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638405(564-572)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638405
Show More Cited By

Index Terms

Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Understanding and Designing Embodied Experiences Through Mid-air Tactile Stimulation
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

Current attempts to render touch in multimedia technology still represents a challenge. Touch is indeed a complex system and there are many aspects to take into account when trying to rendering it (e.g. the compliance of an object, its weight, ...
A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment

This study presents a 3D virtual reality (VR) keyboard system with realistic haptic feedback. The system uses two five-fingered data gloves to track finger positions and postures, uses micro-speakers to create simulated vibrations, and uses a head-...
Text Entry on Tiny QWERTY Soft Keyboards
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

The advent of wearables (e.g., smartwatches, smartglasses, and digital jewelry) anticipates the need for text entry methods on very small devices. We conduct fundamental research on this topic using 3 qwerty-based soft keyboards for 3 different screen ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2023

709 pages

ISBN:9781450399777

DOI:10.1145/3569009

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 February 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

TEI '23

Sponsor:

SIGCHI

TEI '23: Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 26 - March 1, 2023

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
249
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)4

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Chen LChen H(2024)User Authentication Using Typing Habits in Virtual Reality2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC54092.2024.10831104(3068-3075)Online publication date: 6-Oct-2024
https://doi.org/10.1109/SMC54092.2024.10831104
Kato SShizuki B(2023)Hover-Based Japanese Input Method without Restricting Arm Position for XRProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638405(564-572)Online publication date: 2-Dec-2023
https://dl.acm.org/doi/10.1145/3638380.3638405
Dudley JZheng JGupta ABenko HLongest MWang RKristensson P(2023)Evaluating the Performance of Hand-Based Probabilistic Text Input Methods on a Mid-Air Virtual Qwerty KeyboardIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332023829:11(4567-4577)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320238

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten