T. R. Beelders
ABSTRACT
A popular word processor application was adapted to include the use of eye gaze and speech as a modality for text entry. An onscreen keyboard was used whereby users were expected to focus on the desired character and then issue a verbal command in order to type the character in the document. Measures of speed and accuracy were captured and analyzed. Results indicate that the keyboard is superior to the gaze and speech entry method in terms of both speed and accuracy. Keyboard button sizes and spacing between the buttons did not affect either measure in any way.
- Anderson, T. 2009. Pro Office 2007 development with VSTO. United States of America: APress. Google Scholar
Digital Library
- Hansen, J. P., Hansen, D. W. and Johansen, A. S. 2001. Bringing gaze-based interaction back to basics. In C. Stephanidis (Ed.) Universal Access in HCI (UAHCI): Towards an Information Society for All - Proceedings of the 9th International Conference on Human-Computer Interaction (HCII'01), 325--328. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
- Jacob, R. J. K. (1993a). Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces. In H. R. Hartson and D. Hix (Eds), Advances in Human-Computer Interaction, 4, 151--190. Norwood, New Jersey: Ablex Publishing.Google Scholar
- Jacob, R. J. K. and Karn, K. S. 2003. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises (Section Commentary). In J. Hyona, R. Radach and H. Deubel (Eds) The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research (pp. 573--605). Amsterdam: Elsevier Science.Google Scholar
- Just, M. A. and Carpenter, P. A. 1976. Eye fixations and cognitive processes. Cognitive Psychology, 8, 441--480.Google Scholar
- Klarlund, N. 2003. Editing by Voice and the Role of Sequential Symbol Systems for Improved Human-to-Computer Information Rates. In Proceedings of ICASSP, Hong Kong, 553--556. Google ScholarDigital Library
- Land, M. F. and Tatler, B. W. 2009. Looking and acting: Vision and eye movements in natural behaviour. United States of America: Oxford University Press.Google Scholar
- Levenshtein, V. I. 1965. Binary codes capable of correcting deletions, insertions, and reversals. Doklady Akademii Nauk, 163, 845--848.Google Scholar
- MacKenzie, I. S. 2002. A note on calculating text entry speed. Retrieved 14 June 2010 from http://www.yorku.ca/mack/RN-TextEntrySpeed.html.Google Scholar
- MacKenzie, I. S. and Soukoreff, R. W. 2002. A character-level error analysis technique for evaluating text entry methods. In Proceedings of NordiCHI 2002, Aarhus, Denmark, 243--246. Google ScholarDigital Library
- MacKenzie, I. S. and Soukoreff, R. W. 2003. Phrase sets for evaluating text entry techniques. In Extended Abstracts of the ACM Conference on Human Factors in Computing Systems -- CHI 2003, Fort Lauderdale, Florida, United States of America, 754--755. Google ScholarDigital Library
- Maglio, P. P., Matlock, T., Campbell, C. S., Zhai, S. and Smith, B. A. 2000. Gaze and speech in attentive user interfaces. In Proceedings of the Third International Conference on Advances in Multimodal Interfaces, Vancouver, Canada, 1--7. Google ScholarDigital Library
- Majaranta, P. (2009). Text entry by eye gaze. Dissertations in Interactive Technology, number 11, University of Tampere.Google Scholar
- Miniotas, D., Špakov, O. and Evreinov, G. 2003. Symbol Creator: An alternative eye-based text entry technique with low demand for screen space. In Proceedings of Human Computer Interaction -- INTERACT '03, Zurich, Switzerland, 137--143.Google Scholar
- Morimoto, C. H. and Amir, A. 2010. Context switching for fast key selection in text entry applications. In Proceedings of the 2010 Symposium on Eye Tracking Research and Applications (ETRA), 271--274. Google ScholarDigital Library
- Read, J. 2005. On the application of text input metrics to handwritten text input. Text Input Workshop, Dagstuhl, Germany.Google Scholar
- Read, J., MacFarlane, S. and Casey, C. 2001. Measuring the usability of text input methods for children. In Proceedings of Human-Computer Interaction (HCI) 2001, New Orleans, United States of America, 559--572.Google Scholar
- Tan, Y. K., Sherkat, N. and Allen, T. 2003. Eye gaze and speech for data entry: A comparison of different data entry methods. In Proceedings of the International Conference on Multimedia and Expo, Baltimore, Maryland, United States of America, 41--44. Google ScholarDigital Library
- Tanaka, K. 1999. A robust selection system using realtime multi-modal user-agent interactions. In Proceedings of IUI'99, 105--108. Google ScholarDigital Library
- Tanenhaus, M. K., Spivey-Knowlton, M., Eberhard, K. and Sedivy, J. 1995. Integration of visual and linguistic information during spoken language comprehension. Science, 268, 1632--1634.Google ScholarCross Ref
- Vertanen, K. and MacKay, D. J. C. 2010. Speech Dasher: Fast writing using speech and gaze. In Proceedings of CHI 2010, Atlanta, Georgia, United States of America, 595--598. Google ScholarDigital Library
- Wobbrock, J. O., Rubinstein, J., Sawyer, M. W. and Duchowski, A. T. 2008. Longitudinal evaluation of discrete consecutive gaze gestures for text entry. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA), Savannah, Georgia, United States of America, 11--18. Google ScholarDigital Library
Index Terms
- Measuring the performance of gaze and speech for text input
Recommendations
GlanceWriter: Writing Text by Glancing Over Letters with Gaze
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsWriting text with eye gaze only is an appealing hands-free text entry method. However, existing gaze-based text entry methods introduce eye fatigue and are slow in typing speed because they often require users to dwell on letters of a word, or mark the ...
Using eye gaze and speech to simulate a pointing device
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsThe performance of eye gaze and speech when used as a pointing device was tested using the ISO multi-directional tapping task. Eye gaze and speech were used for target selection as is, as well as with the use of a gravitational well and in conjunction ...
Error recovery in a blended style eye gaze and speech interface
ICMI '03: Proceedings of the 5th international conference on Multimodal interfacesIn the work carried out earlier [1][2], it was found that an eye gaze and speech enabled interface was the most preferred form of data entry method when compared to other methods such as mouse and keyboard, handwriting and speech only. It was also found ...
Comments