skip to main content
10.1145/3313831.3376306acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard

Published: 23 April 2020 Publication History

Abstract

We present a bimanual text input method on a miniature fingertip keyboard, that invisibly resides on the first segment of a user's index finger on both hands. Text entry can be carried out using the thumb-tip to tap the tip of the index finger. The design of our keyboard layout followed an iterative process, where we first conducted a study to understand the natural expectation of the handedness of the keys in a QWERTY layout for users. Among a choice of 67,108,864 design variations, we identified 1295 candidates offering a good satisfaction for user expectations. Based on these results, we computed an optimized bimanual keyboard layout, while considering the joint optimization problems of word ambiguity and movement time. Our user evaluation revealed that participants achieved an average text entry speed of 23.4 WPM.

Supplemental Material

MP4 File
Preview video
MP4 File
Supplemental video
ZIP File
It contains a PDF file that includes a revision list as well as the paper with all revisions highlighted.

References

[1]
Sunggeun Ahn, Seongkook Heo and Geehyuk Lee. 2017. Typing on a Smartwatch for Smart Glasses. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17), 201--209. DOI=http://dx.doi.org/10.1145/3132272.3134136
[2]
Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge and Shumin Zhai. 2012. Bimanual gesture keyboard. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12), 137--146. DOI=https://doi.org/10.1145/2380116.2380136
[3]
Xiaojun Bi, Yang Li and Shumin Zhai. 2013. FFitts law: modeling finger touch with fitts' law. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1363--1372. DOI=http://dx.doi.org/10.1145/2470654.2466180
[4]
Xiaojun Bi and Shumin Zhai. 2016. IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 49--58. DOI=https://doi.org/10.1145/2858036.2858421
[5]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13), 255--260. DOI=http://dx.doi.org/10.1145/2501988.2502016
[6]
Xiang 'Anthony' Chen, Tovi Grossman and George Fitzmaurice. 2014. Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14), 615--620. DOI=http://dx.doi.org/10.1145/2642918.2647354
[7]
Hyeonjoong Cho, Miso Kim and Kyeongeun Seo. 2014. A text entry technique for wrist-worn watches with tiny touchscreens Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology (UIST '14), 79--80. DOI=http://dx.doi.org/10.1145/2658779.2658785
[8]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of experimental psychology Fitts. 47 (6), 381. DOI=https://doi.org/10.1037/h0055392
[9]
Mayank Goel, Leah Findlater and Jacob Wobbrock. 2012. WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2687--2696. DOI=https://doi.org/10.1145/2207676.2208662
[10]
Mayank Goel, Alex Jansen, Travis Mandel, Shwetak N Patel and Jacob O Wobbrock. 2013. ContextType: using hand posture information to improve mobile touch screen text entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2795--2798. DOI=https://doi.org/10.1145/2470654.2481386
[11]
Jun Gong, Zheer Xu, Qifan Guo, Teddy Seyed, Xiang 'Anthony' Chen, Xiaojun Bi and Xing-Dong Yang. 2018. WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), 1--14. DOI=http://dx.doi.org/10.1145/3173574.3173755
[12]
Jun Gong, Yang Zhwoang, Xia Zhou and Xing-Dong Yang. 2017. Pyro: Thumb-Tip Gesture Recognition Using Pyroelectric Infrared Sensing Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17), 553--563. DOI=http://dx.doi.org/10.1145/3126594.3126615
[13]
Mitchell Gordon, Tom Ouyang and Shumin Zhai. 2016. WatchWriter: Tap and Gesture Typing on a Smartwatch Miniature Keyboard with Statistical Decoding. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 3817--3821
[14]
Tovi Grossman, Xiang Anthony Chen and George Fitzmaurice. 2015. Typing on Glasses: Adapting Text Entry to Smart Eyewear Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15), 144--152. DOI=http://dx.doi.org/10.1145/2785830.2785867
[15]
Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 59--70. DOI=http://dx.doi.org/10.1145/2858036.2858052
[16]
Jonggi Hong, Seongkook Heo, Poika Isokoski and Geehyuk Lee. 2015. SplitBoard: A Simple Split Soft Keyboard for Wristwatch-sized Touch Screens Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1233--1236. DOI=http://dx.doi.org/10.1145/2702123.2702273
[17]
Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 1526--1537. DOI=http://dx.doi.org/10.1145/2858036.2858483
[18]
Hsin-Liu Kao, Christian Holz, Asta Roseway, Andres Calvo and Chris Schmandt. 2016. DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16), 16--23. DOI=http://dx.doi.org/10.1145/2971763.2971777
[19]
Junhyeok Kim, William Delamare and Pourang Irani. 2018. ThumbText: Text Entry for Wearable Devices Using a Miniature Ring. In Proceedings of the 44th Graphics Interface Conference (GI '18), 18--25. DOI= https://doi.org/10.20380/GI2018.04
[20]
Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja and Ivan Poupyrev. 2016. Soli: ubiquitous gesture sensing with millimeter wave radar. ACM Trans. Graph. 5, 4, Article 142 (July 2016), 19 pages. DOI=http://dx.doi.org/10.1145/2897824.2925953
[21]
Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui and Eric Paulos. 2016. Skintillates: Designing and Creating Epidermal Interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16), 853--864. DOI=http://dx.doi.org/10.1145/2901790.2901885
[22]
Yiqin Lu, Chun Yu, Xin Yi, Yuanchun Shi and Shengdong Zhao. 2017. BlindType: Eyes-Free Text Entry on Handheld Touchpad by Leveraging Thumb's Muscle Memory. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 18 (June 2017), 24 pages. DOI=http://dx.doi.org/10.1145/3090083
[23]
I Scott MacKenzie and William Buxton. 1992. Extending Fitts' law to two-dimensional tasks. in Proceedings of the SIGCHI conference on Human factors in computing systems (CHI '92), 219--226. DOI=https://doi.org/10.1145/142750.142794
[24]
I. Scott MacKenzie and R. William Soukoreff. 2003. Phrase sets for evaluating text entry techniques. In CHI '03 Extended Abstracts on Human Factors in Computing System (CHI EA '03), 754--755. DOI=http://dx.doi.org/10.1145/765891.765971
[25]
Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian and Jürgen Steimle. 2018. Multi-Touch Skin: A Thin and Flexible Multi-Touch Sensor for On-Skin Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), Paper 33, 12 pages. DOI=https://doi.org/10.1145/3173574.3173607
[26]
Stephen Oney, Chris Harrison, Amy Ogan and Jason Wiese. 2013. ZoomBoard: a diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2799--2802. DOI=http://dx.doi.org/10.1145/2470654.2481387
[27]
Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen and Per Ola Kristensson. 2013. Improving two-thumb text entry on touchscreen devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2765--2774. DOI=https://doi.org/10.1145/2470654.2481383
[28]
Yuan-Fu Shao, Masatoshi Chang-Ogimoto, Reinhard Pointner, Yu-Chih Lin, Chen-Ting Wu and Mike Chen. 2016. SwipeKey: a swipe-based keyboard design for smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16), 60--71. DOI=http://dx.doi.org/10.1145/2935334.2935336
[29]
Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F. Yuksel, I. Scott MacKenzie and Robert J.K. Jacob. 2016. DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16), 575--582. DOI=http://dx.doi.org/10.1145/2984511.2984591
[30]
Brian A Smith, Xiaojun Bi and Shumin Zhai. 2015. Optimizing touchscreen keyboards for gesture typing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3365--3374. DOI=https://doi.org/10.1145/2702123.2702357
[31]
Hsin-Ruey Tsai, Cheng-Yuan Wu, Lee-Ting Huang and Yi-Ping Hung. 2016. ThumbRing: private interactions using one-handed thumb motion input on finger segments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16), 791--798. DOI=http://dx.doi.org/10.1145/2957265.2961859
[32]
Saiwen Wang, Jie Song, Jaime Lien, Ivan Poupyrev and Otmar Hilliges. 2016. Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16), 851--860. DOI=https://doi.org/10.1145/2984511.2984565
[33]
Yanan Wang, Shijian Luo, Hebo Gong, Fei Xu, Rujia Chen, Shuai Liu and Preben Hansen. 2018. SKIN+: Fabricating Soft Fluidic User Interfaces for Enhancing On-Skin Experiences and Interactions. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18), 1--6. DOI=http://dx.doi.org/10.1145/3170427.3188443
[34]
Martin Weigel and Jürgen Steimle. 2017. DeformWear: Deformation Input on Tiny Wearable Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 28 (June 2017), 23 pages. DOI=http://dx.doi.org/10.1145/3090093
[35]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2991--3000. DOI=http://dx.doi.org/10.1145/2702123.2702391
[36]
Martin Weigel, Aditya Shekhar Nittala, Alex Olwal and Jürgen Steimle. 2017. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 3095--3105. DOI=http://dx.doi.org/10.1145/3025453.3025704
[37]
Pui Chung Wong, Kening Zhu and Hongbo Fu. 2018. FingerT9: Leveraging Thumb-to-finger Interaction for Same-side-hand Text Entry on Smartwatches. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), Paper 178, 10 pages. DOI=http://dx.doi.org/10.1145/3173574.3173752
[38]
Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19), 883--899. DOI=https://doi.org/10.1145/3332165.3347865
[39]
Xin Yi, Chun Yu, Weinan Shi, Xiaojun Bi and Yuanchun Shi. 2017. Word clarity as a metric in sampling keyboard test sets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 4216--4228. DOI=https://doi.org/10.1145/3025453.3025701
[40]
Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi and Yuanchun Shi. 2017. COMPASS: Rotational Keyboard on Non-Touch Smartwatches Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 705--715. DOI=http://dx.doi.org/10.1145/3025453.3025454
[41]
Chun Yu, Ke Sun, Mingyuan Zhong, Xincheng Li, Peijun Zhao and Yuanchun Shi. 2016. One-Dimensional Handwriting: Inputting Letters and Words on Smart Glasses. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 71--82. DOI=http://dx.doi.org/10.1145/2858036.2858542
[42]
Mingyuan Zhong, Chun Yu, Qian Wang, Xuhai Xu and Yuanchun Shi. 2018. ForceBoard: Subtle Text Entry Leveraging Pressure. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), Paper 528, 10 pages. DOI=https://doi.org/10.1145/3173574.3174102
[43]
Suwen Zhu, Tianyao Luo, Xiaojun Bi and Shumin Zhai. 2018. Typing on an Invisible Keyboard. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18), 1--13. DOI=http://dx.doi.org/10.1145/3173574.3174013
[44]
Suwen Zhu, Jingjie Zheng, Shumin Zhai and Xiaojun Bi. 2019. i'sFree: Eyes-Free Gesture Typing via a Touch-Enabled Remote Control. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), Paper 448, 12 pages. DOI=https://doi.org/10.1145/3290605.3300678.

Cited By

View all
  • (2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
  • (2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
  • (2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. bimanual input
    2. micro finger gesture
    3. text entry
    4. wearable

    Qualifiers

    • Research-article

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)144
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
    • (2024)TipTopTyping: A Thumb-to-Finger Text Input Method and Character Layout Optimized for Mobile Spatial ComputingProceedings of Mensch und Computer 202410.1145/3670653.3670669(196-206)Online publication date: 1-Sep-2024
    • (2024)TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676330(1-16)Online publication date: 13-Oct-2024
    • (2024)GestureMark: Shortcut Input Technique using Smartwatch Touch Gestures for XR GlassesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652941(63-71)Online publication date: 4-Apr-2024
    • (2024)FanPad: A Fan Layout Touchpad Keyboard for Text Entry in VR2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00045(222-232)Online publication date: 16-Mar-2024
    • (2024)CrossKeys: Text Entry for Virtual Reality Using a Single Controller via Wrist RotationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2358456(1-13)Online publication date: 5-Jun-2024
    • (2023)Which Thumb, the Left or Right, Touches the Letter Keys on a Smartphone QWERTY Soft Keyboard during Two-Thumb Key Entry?Applied Sciences10.3390/app13221241713:22(12417)Online publication date: 16-Nov-2023
    • (2023)Abacus GesturesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108987:3(1-30)Online publication date: 27-Sep-2023
    • (2023)STAR: Smartphone-analogous Typing in Augmented RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606803(1-13)Online publication date: 29-Oct-2023
    • (2023)Skinergy: Machine-Embroidered Silicone-Textile Composites as On-Skin Self-Powered Input SensorsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606729(1-15)Online publication date: 29-Oct-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media