Sunggeun Ahn
Seongkook Heo
Geehyuk Lee
ABSTRACT
While smart glasses make information more accessible in mobile scenarios, entering text on these devices is still difficult. In this paper, we suggest using a smartwatch as an indirect input device for smart glasses text entry. With the watch-glasses combination, users do not need to lift the arm to touch the glasses nor need to carry a special external input device. To prove the feasibility of the suggested combination, we implemented two text entry methods: a modified version of SwipeBoard, which we adapted for the suggested combination, and HoldBoard, which we newly designed and implemented specifically for the suggested combination. We evaluated the performances of the two text entry methods through two user studies, and could show that they are faster than prior art for smart glasses text entry in a seated condition. A further study showed that they are competitive with the prior art also in a walking condition.
- Chaparro, B. S., He, J., Turner, C., and Turner, K. Is touch-based text input practical for a smartwatch? In International Conference on Human-Computer Interaction, Springer (2015), 3--8. Google Scholar
Cross Ref
- Chen, X. A., Grossman, T., and Fitzmaurice, G. Swipeboard: A text entry technique for ultra-small interfaces that supports novice to expert transitions. In Proc. UIST '14, ACM (2014), 615--620. Google ScholarDigital Library
- Gordon, M., Ouyang, T., and Zhai, S. Watchwriter: Tap and gesture typing on a smartwatch miniature keyboard with statistical decoding. In Proc. CHI '16, ACM (2016), 3817--3821. Google ScholarDigital Library
- Grossman, T., Chen, X. A., and Fitzmaurice, G. Typing on glasses: Adapting text entry to smart eyewear. In Proc. MobileHCI '15, ACM (2015), 144--152. Google ScholarDigital Library
- Gupta, A., and Balakrishnan, R. Dualkey: Miniature screen text entry via finger identification. In Proc. CHI '16, ACM (2016), 59--70. Google ScholarDigital Library
- Harrison, C., and Faste, H. Implications of location and touch for on-body projected interfaces. In Proc. DIS '14, ACM (2014), 543--552. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Providing dynamically changeable physical buttons on a visual display. In Proc. CHI '09, ACM (2009), 299--308. Google ScholarDigital Library
- Hincapié-Ramos, J. D., Guo, X., Moghadasian, P., and Irani, P. Consumed endurance: A metric to quantify arm fatigue of mid-air interactions. In Proc. CHI '14, ACM (2014), 1063--1072. Google ScholarDigital Library
- Hinckley, K., Heo, S., Pahud, M., Holz, C., Benko, H., Sellen, A., Banks, R., O'Hara, K., Smyth, G., and Buxton, W. Pre-touch sensing for mobile interaction. In Proc. CHI '16, ACM (2016), 2869--2881. Google ScholarDigital Library
- Hong, J., Heo, S., Isokoski, P., and Lee, G. Splitboard: A simple split soft keyboard for wristwatch-sized touch screens. In Proc. CHI '15, ACM (2015), 1233--1236. Google ScholarDigital Library
- Hsieh, Y.-T., Jylhä, A., Orso, V., Gamberini, L., and Jacucci, G. Designing a willing-to-use-in-public hand gestural interaction technique for smart glasses. In Proc. CHI '16, ACM (2016), 4203--1215. Google ScholarDigital Library
- Kolly, S. M., Wattenhofer, R., and Welten, S. A personal touch: Recognizing users based on touch screen behavior. In Proc. PhoneSense '12, ACM (2012), 1:1--1:5. Google ScholarDigital Library
- Li, F. C. Y., Guy, R. T., Yatani, K., and Truong, K. N. The 1line keyboard: A qwerty layout in a single line. In Proc. UIST '11, ACM (2011), 461--470. Google ScholarDigital Library
- Lyons, K., Plaisted, D., and Starner, T. Expert chording text entry on the twiddler one-handed keyboard. In Proc. ISWC04, vol. 1, IEEE (2004), 94--101. Google ScholarDigital Library
- MacKenzie, I. S., and Soukoreff, R. W. Phrase sets for evaluating text entry techniques. In Proc. CHIEA'03, ACM (2003), 754--755. Google ScholarDigital Library
- MacKenzie, I. S., and Tanaka-Ishii, K. Text entry systems: Mobility, accessibility, universality. Morgan Kaufmann, 2010.Google ScholarDigital Library
- Markussen, A., Jakobsen, M. R., and Hornbæk, K. Vulture: A mid-air word-gesture keyboard. In Pro. CHI '14, ACM (2014), 1073--1082. Google ScholarDigital Library
- Ni, T., Bowman, D., and North, C. Airstroke: Bringing unistroke text entry to freehand gesture interfaces. In Proc. CHI'11, ACM (2011), 2473--2476. Google ScholarDigital Library
- Oney, S., Harrison, C., Ogan, A., and Wiese, J. Zoomboard: A diminutive qwerty soft keyboard using iterative zooming for ultra-small devices. In Proc. CHI'13, ACM (2013), 2799--2802. Google ScholarDigital Library
- Pizza, S., Brown, B., McMillan, D., and Lampinen, A. Smartwatch in vivo. In Proc. CHI'16, ACM (2016), 5456--5469.Google ScholarDigital Library
- Rico, J., and Brewster, S. Usable gestures for mobile interfaces: Evaluating social acceptability. In Proc. CHI'10, ACM (2010), 887--896. Google ScholarDigital Library
- Rosenberg, R., and Slater, M. The chording glove: a glove-based text input device. IEEE Trans. Syst., Man, Cybern 29, 2 (1999), 186--191. Google ScholarDigital Library
- Shibata, T., Afergan, D., Kong, D., Yuksel, B. F., MacKenzie, I. S., and Jacob, R. J. Driftboard: A panning-based text entry technique for ultra-small touchscreens. In Proc. UIST'16, ACM (2016), 575--582. Google ScholarDigital Library
- Worldwide Wearables Market to Nearly Double by 2021, According to IDC. http://www.idc.com/getdoc.jsp?containerId=prUS42818517.Google Scholar
- Vertanen, K., Memmi, H., Emge, J., Reyal, S., and Kristensson, P. O. Velocitap: Investigating fast mobile text entry using sentence-based decoding of touchscreen keyboard input. In Proc. CHI'15, ACM (2015), 659--668. Google ScholarDigital Library
- Wang, C.-Y., Chu, W.-C., Chiu, P.-T., Hsiu, M.-C., Chiang, Y.-H., and Chen, M. Y. Palmtype: Using palms as keyboards for smart glasses. In Proc. MobileHCI'15, ACM (2015), 153--160. Google ScholarDigital Library
- Yi, X., Yu, C., Xu, W., Bi, X., and Shi, Y. Compass: Rotational keyboard on non-touch smartwatches. In Proc. CHI'17, ACM (2017), 705--715. Google ScholarDigital Library
- Yi, X., Yu, C., Zhang, M., Gao, S., Sun, K., and Shi, Y. Atk: Enabling ten-finger freehand typing in air based on 3d hand tracking data. In Proc. UIST'15, ACM (2015), 539--548. Google ScholarDigital Library
- Yu, C., Sun, K., Zhong, M., Li, X., Zhao, P., and Shi, Y. One-dimensional handwriting: Inputting letters and words on smart glasses. In Proc. CHI'16, ACM (2016), 71--82. Google ScholarDigital Library
Index Terms
- Typing on a Smartwatch for Smart Glasses
Recommendations
Gaze-Assisted Typing for Smart Glasses
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyText entry is expected to be a common task for smart glass users, which is generally performed using a touchpad on the temple or by a promising approach using eye tracking. However, each approach has its own limitations. For more efficient text entry, ...
Gestural Text Input Using a Smartwatch
AVI '16: Proceedings of the International Working Conference on Advanced Visual InterfacesOne challenge with modern smartwatches is text input. In this paper we explore the use of gestural interaction with a smartwatch to support text input. The inertial measurement unit of a smartwatch is used to capture gestural interaction by a user, and ...
Typing on Glasses: Adapting Text Entry to Smart Eyewear
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and ServicesText entry for smart eyewear is generally limited to speech-based input due to constraints of the input channels. However, many smart eyewear devices are now including a side touchpad making gesture-based text entry feasible. The Swipeboard technique, ...
Comments