research-article

Semantic interpretation of eye movements using designed structures of displayed contents

Authors:

Takashi MatsuyamaAuthors Info & Claims

Gaze-In '12: Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Article No.: 17, Pages 1 - 3

https://doi.org/10.1145/2401836.2401853

Published: 26 October 2012 Publication History

Get Access

Abstract

This paper presents a novel framework to interpret eye movements using semantic relations and spatial layouts of displayed contents, i.e., the designed structure. We represent eye movements in a multi-scale, interval-based manner and associate them with various semantic relations derived from the designed structure. In preliminary experiments, we apply the proposed framework to the eye movements when browsing catalog contents, and confirm the effectiveness of the framework via user-state estimation.

References

[1]

R. Bednarik, H. Vrzakova, and M. Hradis. What do you want to do next: A novel approach for intent prediction in gaze-based interaction. In ETRA, pages 83--90, 2012.

Digital Library

Google Scholar

[2]

B. Brandherm, H. Prendinger, and M. Ishizuka. Interest estimation based on dynamic bayesian networks for visual attentive presentation agents. In ICMI, pages 346--349, 2007.

Digital Library

Google Scholar

[3]

S. Eivazi and R. Bednarik. Predicting problem-solving behavior and performance levels from visual attention data. In IUI, pages 9--16, 2011.

Google Scholar

[4]

S. Eivazi, R. Bednarik, M. Tukiainen, M. von und zu Fraunberg, V. Leinonen, and J. E. Jääskeläinen. Gaze Behaviour of Expert and Novice Microneurosurgeons Differs During Observations of Tumor Removal Recordings. In ETRA, pages 377--380, 2012.

Digital Library

Google Scholar

[5]

Y. Nakano and R. Ishii. Estimating user's engagement from eye-gaze behaviors in human-agent conversations. In IUI, pages 139--148, 2010.

Digital Library

Google Scholar

[6]

P. Qvarfordt and S. Zhai. Conversing with the user based on eye-gaze patterns. In CHI, pages 221--230, 2005.

Digital Library

Google Scholar

[7]

A. Witkin. Scale-space filtering. In IJCAI, pages 1019--1022, 1983.

Digital Library

Google Scholar

[8]

A. Yarbus. Eye movements and vision. Plenum, 1967.

Google Scholar

[9]

R. Yonetani, H. Kawashima, and T. Matsuyama. Multi-mode saliency dynamics model for analyzing gaze and attention. In ETRA, pages 115--122, 2012.

Digital Library

Google Scholar

Cited By

View all

Nishiyasu TSato Y(2024)Gaze Scanpath Transformer: Predicting Visual Search Target by Spatiotemporal Semantic Modeling of Gaze Scanpath2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW63382.2024.00067(625-635)Online publication date: 17-Jun-2024
https://doi.org/10.1109/CVPRW63382.2024.00067
Ishikawa EEpps JChen FOviatt SMase KSears AJokinen KSchuller B(2013)Modeling semantic aspects of gaze behavior while catalog browsingProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2532197(357-360)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2522848.2532197
Okada TYamazoe HMitsugami IYagi Y(2013)Preliminary Analysis of Gait Changes That Correspond to Gaze DirectionsProceedings of the 2013 2nd IAPR Asian Conference on Pattern Recognition10.1109/ACPR.2013.184(788-792)Online publication date: 5-Nov-2013
https://dl.acm.org/doi/10.1109/ACPR.2013.184

Index Terms

Semantic interpretation of eye movements using designed structures of displayed contents
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A method to recognize eye movements based on uplift movement of skin
UbiComp/ISWC '19 Adjunct: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers

Movements of human eyes provide useful insights for understanding human's physical and mental condition and ability, which has high attention in various industrial and academic fields. Although many methods for sensing eye movements have been proposed, ...
User Eye Fatigue Detection via Eye Movement Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

In this study we propose and evaluate a novel approach that allows detection of physical eye fatigue. The proposed approach is based on the analysis of the recorded eye movements via what is called behavioral scores. These easy-to-compute scores can be ...
Interacting with eye movements in virtual environments
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Eye movement-based interaction offers the potential of easy, natural, and fast ways of interacting in virtual environments. However, there is little empirical evidence about the advantages or disadvantages of this approach. We developed a new ...

Comments

Information & Contributors

Information

Published In

Gaze-In '12: Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

October 2012

88 pages

ISBN:9781450315166

DOI:10.1145/2401836

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI '12

Sponsor:

SIGCHI

ICMI '12: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

October 26, 2012

California, Santa Monica

Acceptance Rates

Overall Acceptance Rate 19 of 21 submissions, 90%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
104
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Nishiyasu TSato Y(2024)Gaze Scanpath Transformer: Predicting Visual Search Target by Spatiotemporal Semantic Modeling of Gaze Scanpath2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW63382.2024.00067(625-635)Online publication date: 17-Jun-2024
https://doi.org/10.1109/CVPRW63382.2024.00067
Ishikawa EEpps JChen FOviatt SMase KSears AJokinen KSchuller B(2013)Modeling semantic aspects of gaze behavior while catalog browsingProceedings of the 15th ACM on International conference on multimodal interaction10.1145/2522848.2532197(357-360)Online publication date: 9-Dec-2013
https://dl.acm.org/doi/10.1145/2522848.2532197
Okada TYamazoe HMitsugami IYagi Y(2013)Preliminary Analysis of Gait Changes That Correspond to Gaze DirectionsProceedings of the 2013 2nd IAPR Asian Conference on Pattern Recognition10.1109/ACPR.2013.184(788-792)Online publication date: 5-Nov-2013
https://dl.acm.org/doi/10.1109/ACPR.2013.184

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A method to recognize eye movements based on uplift movement of skin

User Eye Fatigue Detection via Eye Movement Behavior

Interacting with eye movements in virtual environments

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations