skip to main content
10.1145/1743666.1743692acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

Inferring object relevance from gaze in dynamic scenes

Published: 22 March 2010 Publication History

Abstract

As prototypes of data glasses having both data augmentation and gaze tracking capabilities are becoming available, it is now possible to develop proactive gaze-controlled user interfaces to display information about objects, people, and other entities in real-world setups. In order to decide which objects the augmented information should be about, and how saliently to augment, the system needs an estimate of the importance or relevance of the objects of the scene for the user at a given time. The estimates will be used to minimize distraction of the user, and for providing efficient spatial management of the augmented items. This work is a feasibility study on inferring the relevance of objects in dynamic scenes from gaze. We collected gaze data from subjects watching a video for a pre-defined task. The results show that a simple ordinal logistic regression model gives relevance rankings of scene objects with a promising accuracy.

References

[1]
Hardoon, D., Shawe-Taylor, J., Ajanki, A., Puolamäki, K., and Kaski, S. 2007. Information retrieval by inferring implicit queries from eye movements. In International Conference on Artificial Intelligence and Statistics (AISTATS '07).
[2]
Henderson, J. M. 2003. Human gaze control during real-world scene perception. Trends in Cognitive Sciences 7, 11, 498--504.
[3]
Hyrskykari, A., Majaranta, P., Aaltonen, A., and Räihä, K.-J. 2000. Design issues of 'idict': A gaze-assisted translation aid. In Proceedings of ETRA 2000, Eye Tracking Research and Applications Symposium, ACM Press, ACM Press, 9--14.
[4]
Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11, 1254--1259.
[5]
Kandemir, M., Saarinen, V.-M., and Kaski, S. 2010. Inferring object relevance from gaze in dynamic scenes. In To Appear in Short Paper Proceedings of ETRA 2000, Eye Tracking Research and Applications Symposium.
[6]
Klami, A., Saunders, C., de Campos, T. E., and Kaski, S. 2008. Can relevance of images be inferred from eye movements? In MIR '08: Proceeding of the 1st ACM international conference on Multimedia information retrieval, ACM, New York, NY, USA, 134--140.
[7]
Kozma, L., Klami, A., and Kaski, S. 2009. GaZIR: Gaze-based zooming interface for image retrieval. In Proc. ICMIMLMI 2009, The Eleventh International Conference on Multimodal Interfaces and The Sixth Workshop on Machine Learning for Multimodal Interaction, ACM, New York, NY, USA, 305--312.
[8]
McCullagh, P., and Nelder, J. 1989. Generalized Linear Models. Chapman & Hall/CRC.
[9]
Qvarfordt, P., and Zhai, S. 2005. Conversing with the user based on eye-gaze patterns. In CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, New York, NY, USA, 221--230.
[10]
Torralba, A., Oliva, A., Castelhano, M. S., and Henderson, J. M. 2006. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 113, 4, 766--786.
[11]
Ward, D. J., and MacKay, D. J. C. 2002. Fast hands-free writing by gaze direction. Nature 418, 6900, 838.
[12]
Zhang, L., Tong, M. H., Marks, T. K., Shan, H., and Cottrell, G. W. 2008. Sun: A bayesian framework for saliency using natural statistics. Journal of Vision 8, 7 (12), 1--20.

Cited By

View all
  • (2022)Lessons Learned from an Eye Tracking Study for Targeted Advertising in the Wild2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops53856.2022.9767470(539-544)Online publication date: 21-Mar-2022
  • (2021)Is This Really Relevant? A Guide to Best Practice Gaze-based Relevance Prediction ResearchAdjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450614.3464476(220-228)Online publication date: 21-Jun-2021
  • (2021)Conditioning Gaze-Contingent Systems for the Real World: Insights from a Field Study in the Fast Food IndustryExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451658(1-7)Online publication date: 8-May-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications
March 2010
353 pages
ISBN:9781605589947
DOI:10.1145/1743666
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 March 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. gaze tracking
  3. information retrieval
  4. intelligent user interfaces
  5. machine learning
  6. ordinal logistic regression

Qualifiers

  • Research-article

Conference

ETRA '10
ETRA '10: Eye Tracking Research and Applications
March 22 - 24, 2010
Texas, Austin

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Lessons Learned from an Eye Tracking Study for Targeted Advertising in the Wild2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops53856.2022.9767470(539-544)Online publication date: 21-Mar-2022
  • (2021)Is This Really Relevant? A Guide to Best Practice Gaze-based Relevance Prediction ResearchAdjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450614.3464476(220-228)Online publication date: 21-Jun-2021
  • (2021)Conditioning Gaze-Contingent Systems for the Real World: Insights from a Field Study in the Fast Food IndustryExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451658(1-7)Online publication date: 8-May-2021
  • (2021)Exploring Gaze-Based Prediction Strategies for Preference Detection in Dynamic Interface ElementsProceedings of the 2021 Conference on Human Information Interaction and Retrieval10.1145/3406522.3446013(129-139)Online publication date: 14-Mar-2021
  • (2021)The Subconscious Director: Dynamically Personalizing Videos Using Gaze DataProceedings of the 26th International Conference on Intelligent User Interfaces10.1145/3397481.3450679(98-108)Online publication date: 14-Apr-2021
  • (2019)Deep Spatio-Temporal Modeling for Object-Level Gaze-Based Relevance Assessment2019 27th European Signal Processing Conference (EUSIPCO)10.23919/EUSIPCO.2019.8902990(1-5)Online publication date: Sep-2019
  • (2019)Gaze-based Product FilteringAdjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332167.3357120(75-77)Online publication date: 14-Oct-2019
  • (2017)Gaze-informed multimodal interactionThe Handbook of Multimodal-Multisensor Interfaces10.1145/3015783.3015794(365-402)Online publication date: 24-Apr-2017
  • (2012)Gaze-Aware Systems and Attentive ApplicationsGaze Interaction and Applications of Eye Tracking10.4018/978-1-61350-098-9.ch013(175-195)Online publication date: 2012
  • (2012)Designing for the eyeProceedings of the 24th Australian Computer-Human Interaction Conference10.1145/2414536.2414609(479-488)Online publication date: 26-Nov-2012
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media