short-paper

Personalized unknown word detection in non-native language reading using eye gaze

Authors:

Sakriani Sakti,

Satoshi NakamuraAuthors Info & Claims

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

Pages 66 - 70

https://doi.org/10.1145/2993148.2993167

Published: 31 October 2016 Publication History

Abstract

This paper proposes a method to detect unknown words during natural reading of non-native language text by using eye-tracking features. A previous approach utilizes gaze duration and word rarity features to perform this detection. However, while this system can be used by trained users, its performance is not sufficient during natural reading by untrained users. In this paper, we 1) apply support vector machines (SVM) with novel eye movement features that were not considered in the previous work and 2) examine the effect of personalization. The experimental results demonstrate that learning using SVMs and proposed eye movement features improves detection performance as measured by F-measure and that personalization further improves results.

References

[1]

C. Cortes and V. Vapnik. Support-vector networks. Machine learning, 20(3):273–297, 1995.

[2]

A. Duchowski. Eye tracking methodology: Theory and practice, volume 373. Springer Science & Business Media, 2007.

Digital Library

[3]

Y. Ehara, N. Shimizu, T. Ninomiya, and H. Nakagawa. Personalized reading support for second-language web documents by collective intelligence. In Proceedings of the 15th international conference on Intelligent user interfaces, pages 51–60. ACM, 2010.

Digital Library

[4]

B. Gagl, S. Hawelka, and F. Hutzler. Systematic influence of gaze position on pupil size measurement: analysis and correction. Behavior research methods, 43(4):1171–1181, 2011.

[5]

A. Hyrskykari. Eyes in attentive interfaces: Experiences from creating iDict, a gaze-aware reading aid. Tampereen yliopisto, 2006.

[6]

A. Kilgarriff. BNC database and word frequency lists. HTTP:< http://www. kilgarriff. co. uk/bnc-readme. html>(accessed 24 Feb 2016), 1995.

[7]

P. Koehn. Statistical significance tests for machine translation evaluation. In Empirical Methods in Natural Language Processing (EMNLP), pages 388–395. Citeseer, 2004.

[8]

K. Kunze, H. Kawaichi, K. Yoshimura, and K. Kise. Towards inferring language expertise using eye tracking. In Computer-Human Interaction (CHI)’13 Extended Abstracts on Human Factors in Computing Systems, pages 217–222. ACM, 2013.

Digital Library

[9]

P. Mart´ınez-Gómez and A. Aizawa. Recognition of understanding level and language skill using measurements of reading behavior. In Proceedings of the 19th international conference on Intelligent User Interfaces, pages 95–104. ACM, 2014.

Digital Library

[10]

K. Rayner. Eye movements in reading and information processing: 20 years of research. Psychological bulletin, 124(3):372, 1998.

[11]

J. B. Rotter. Social learning and clinical psychology. 1954.

[12]

H. Schmid. Probabilistic part-of-speech tagging using decision trees. In Proceedings of the international conference on new methods in language processing, volume 12, pages 44–49. Citeseer, 1994.

[13]

L. E. Sibert and R. J. Jacob. Evaluation of eye gaze interaction. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pages 281–288. ACM, 2000.

Digital Library

[14]

C. Ware and H. H. Mikaelian. An evaluation of an eye tracker as a device for computer input2. In ACM SIGCHI Bulletin, volume 17, pages 183–188. ACM, 1987.

Digital Library

[15]

P. E. Woodford. The test of english for international communication (TOEIC). 1980.

Cited By

Higasa TTanaka KFeng QMorishima S(2024)Keep Eyes on the Sentence: An Interactive Sentence Simplification System for English Learners Based on Eye Tracking and Large Language ModelsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650792(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650792
Higashimura RWatanabe KVargo AIwata MDengel AKise K(2024)Estimating Unknown English Words From User Smartphone Reading BehaviorsIEEE Access10.1109/ACCESS.2024.345751012(140223-140234)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3457510
Higasa TTanaka KFeng QMorishima S(2023)Gaze-Driven Sentence Simplification for Language Learners: Enhancing Comprehension and ReadabilityCompanion Publication of the 25th International Conference on Multimodal Interaction10.1145/3610661.3616177(292-296)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3610661.3616177
Show More Cited By

Index Terms

Personalized unknown word detection in non-native language reading using eye gaze
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Reading with Screen Magnification: Eye Movement Analysis Using Compensated Gaze Tracks
ETRA '24: Proceedings of the 2024 Symposium on Eye Tracking Research and Applications

Eye movements while reading with screen magnification (which requires manual scrolling to center the magnified portion of the screen within the viewport) pose interpretation challenges. Standard representations in terms of alternating fixations and ...
Communication Interface with Eye-Gaze and Head Gesture Using Successive DP Matching and Fuzzy Inference

This paper proposes a communication interface with eye-gaze and head gesture. Visual sensorimotor integration with eye-head cooperation is considered, especially head gesture accompanied with vestibulo-ocular reflex is used for selecting object in the ...
Analysis of eye tracking movements using FIR median hybrid filters
ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applications

This paper presents an approach of using FIR Median Hybrid Filters for analysis of eye tracking movements. The proposed filter can remove the eye blink artifact from the eye movement signal. The background of the project is described first. The whole ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal Interaction

October 2016

605 pages

ISBN:9781450345569

DOI:10.1145/2993148

General Chairs:
Yukiko I. Nakano
Seikei University, Japan
,
Elisabeth André
Augsburg University, Germany
,
Toyoaki Nishida
Kyoto University, Japan
,
Program Chairs:
Louis-Philippe Morency
Carnegie Mellon University, USA
,
Carlos Busso
University of Texas at Dallas, USA
,
Catherine Pelachaud
ISIR, France / University of Paris6, France

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

KAKEN

Conference

ICMI '16

Sponsor:

SIGCHI

ICMI '16: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 12 - 16, 2016

Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
201
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Higasa TTanaka KFeng QMorishima S(2024)Keep Eyes on the Sentence: An Interactive Sentence Simplification System for English Learners Based on Eye Tracking and Large Language ModelsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650792(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650792
Higashimura RWatanabe KVargo AIwata MDengel AKise K(2024)Estimating Unknown English Words From User Smartphone Reading BehaviorsIEEE Access10.1109/ACCESS.2024.345751012(140223-140234)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3457510
Higasa TTanaka KFeng QMorishima S(2023)Gaze-Driven Sentence Simplification for Language Learners: Enhancing Comprehension and ReadabilityCompanion Publication of the 25th International Conference on Multimodal Interaction10.1145/3610661.3616177(292-296)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3610661.3616177
Ding JZhao BHuang YWang YShi Y(2023)GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) LearnersExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585790(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585790
Higashimura RVargo AIwata MKise K(2022)Helping Mobile Learners Know Unknown Words through their Reading BehaviorCHI Conference on Human Factors in Computing Systems Extended Abstracts10.1145/3491101.3519620(1-5)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519620
Lunte TBoll S(2020)Towards a gaze-contingent reading assistance for children with difficulties in readingProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3418014(1-4)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3418014
Yu YLiu GOdobez J(2019)Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze ModelComputer Vision – ECCV 2018 Workshops10.1007/978-3-030-11012-3_35(456-474)Online publication date: 29-Jan-2019
https://doi.org/10.1007/978-3-030-11012-3_35
Siegfried RYu YOdobez JLank EVinciarelli AHoggan ESubramanian SBrewster S(2017)Towards the use of social interaction conventions as prior for gaze model adaptationProceedings of the 19th ACM International Conference on Multimodal Interaction10.1145/3136755.3136793(154-162)Online publication date: 3-Nov-2017
https://dl.acm.org/doi/10.1145/3136755.3136793

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten