skip to main content
10.1145/3267305.3267607acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
poster

Eye Tracking and Gesture Based Interaction for Target Selection on Large Displays

Published: 08 October 2018 Publication History

Abstract

Mouse based target selection requires much movement when locating targets across long distance on large displays. Eye tracking technique can locate targets more easily and quickly across long distance, and has a high potential for fast targets selection on large displays. However, eye tracking still faces to challenges, such as low accuracy, and high error rate of selection operation, especially for gaze-only interaction. This paper proposed a multimodal interaction method that combined gaze with gestures. This method utilized gaze for rough selection first, and then utilized hand gesture to confirm accurate selection. Furthermore, when targets are small and crowded, we used semi-fixed gaze cursor and secondary selection mechanism to optimize the selection process. Finally we conducted a pilot study, and the results showed that the selection speed and accuracy rate of our method was higher than the gaze only input and similar to mouse input.

References

[1]
Ribel Fares, Shaomin Fang, Oleg Komogortsev. 2013. Can we beat the mouse with MAGIC?. In Proceedings of the SIGCHI (CHI '13), 1387--1390.
[2]
Daniel Horodniczy, Jeremy R. Cooperstock. 2017. Free the Hands! Enhanced Target Selection via a Variable-Friction Shoe. In Proceedings of the SIGCHI (CHI '17), 255--259.
[3]
Christof Lutteroth, Moiz Penkar, Gerald Weber. 2015. Gaze vs. Mouse: A fast and accurate gaze-only click alternative. In Proceedings of ACM Symposium on User Interface Software & Technology (UIST '15), 385--394.
[4]
Linda E. Sibert, Robert J. K. Jacob. 2000. Evaluation of eye gaze interaction. In Proceedings of the SIGCHI (CHI '00), 281--288.
[5]
Sophie Stellmach, Raimund Dachselt. 2012. Look & touch: gaze-supported target acquisition. In Proceedings of the SIGCHI (CHI '12), 2981--2990.
[6]
Shumin Zhai, Carlos Morimoto, Steven Ihde. 1999. Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the SIGCHI (CHI '99), 246--253.

Cited By

View all
  • (2024)LookToFocus: Image Focus via Eye TrackingProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656358(1-7)Online publication date: 4-Jun-2024
  • (2024)Optimization of Display Content Switching Under Multiple Large-Screen Displays: A Multi-channel Interaction Usability EvaluationDesign, User Experience, and Usability10.1007/978-3-031-61351-7_15(217-231)Online publication date: 17-Jun-2024

Index Terms

  1. Eye Tracking and Gesture Based Interaction for Target Selection on Large Displays

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers
    October 2018
    1881 pages
    ISBN:9781450359665
    DOI:10.1145/3267305
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 October 2018

    Check for updates

    Author Tags

    1. Gaze
    2. gesture
    3. multimodal interaction
    4. user interface

    Qualifiers

    • Poster
    • Research
    • Refereed limited

    Funding Sources

    Conference

    UbiComp '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)18
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)LookToFocus: Image Focus via Eye TrackingProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656358(1-7)Online publication date: 4-Jun-2024
    • (2024)Optimization of Display Content Switching Under Multiple Large-Screen Displays: A Multi-channel Interaction Usability EvaluationDesign, User Experience, and Usability10.1007/978-3-031-61351-7_15(217-231)Online publication date: 17-Jun-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media