short-paper

Eye Caramba: Gaze-based Assistance for Virtual Reality Aiming and Throwing Tasks in Games

Authors:

Martin Johannes Dechant,

Michael Lankes,

Christian Wolff,

Regan MandrykAuthors Info & Claims

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Article No.: 63, Pages 1 - 6

https://doi.org/10.1145/3379156.3391841

Published: 02 June 2020 Publication History

Abstract

Gaze-based interaction in Virtual Reality (VR) has been attracting attention recently due to rapid advances in eye tracking technology in head-mounted displays. Since gazes are a natural and intuitive interaction modality for human beings, gaze-based interaction could enhance player experience in immersive VR games. Aiming assistance is a common feature in games to balance difficulty for different player skills. Previous work has investigated different aim assistance approaches and identified various shortcomings. We hypothesize that “bullet magnetism” is a promising technique for VR and could be enhanced by extending its functionality through players’ gazes. In this paper, we present a gaze-based aiming assistance approach and propose a study design to evaluate its performance and player experience in a “Mexican-style” VR first-person shooter game.

References

[1]

Hoorieh Afkari, Shahram Eivazi, Roman Bednarik, and Susanne Mäkelä. 2014. The Potentials for Hands-Free Interaction in Micro-Neurosurgery. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational(Helsinki, Finland) (NordiCHI ’14). Association for Computing Machinery, New York, NY, USA, 401–410. https://doi.org/10.1145/2639189.2639213

Digital Library

[2]

Domna Banakou, Sameer Kishore, and Mel Slater. 2018. Virtually being Einstein results in an improvement in cognitive task performance and a decrease in age bias. Frontiers in Psychology 9, JUN (2018). https://doi.org/10.3389/fpsyg.2018.00917

[3]

Scott Bateman, Regan Mandryk, Tadeusz Stach, and Carl Gutwin. 2011. Target Assistance for Subtly Balancing Competitive Play. Conference on Human Factors in Computing Systems - Proceedings, 2355–2364. https://doi.org/10.1145/1978942.1979287

Digital Library

[4]

Jonas Blattgerste, Patrick Renner, and Thies Pfeiffer. 2018. Advantages of Eye-Gaze over Head-Gaze-Based Selection in Virtual and Augmented Reality under Varying Field of Views. In Proceedings of the Workshop on Communication by Gaze Interaction (Warsaw, Poland) (COGAIN ’18). Association for Computing Machinery, New York, NY, USA, Article Article 1, 9 pages. https://doi.org/10.1145/3206343.3206349

Digital Library

[5]

Barbaros Bostan and S Ogut. 2009. Game challenges and difficulty levels: lessons learned From RPGs. International Simulation and Gaming Association ConferenceAugust (2009), 1–11. https://www.google.de/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&cad=rja&uact=8&ved=0CCAQFjAA&url=http://www.silentblade.com/presentations/bostan_ogut_full_paper.pdf&ei=gzPzU9j7F8ep4gT62oDoAQ&usg=AFQjCNFFc3YabSbvnyVK_7cFaLASKCkx5w&sig2=x26UCkf9n-q

[6]

C. Christou, A. Tzanavari, K. Herakleous, and C. Poullis. 2016. Navigation in virtual reality: Comparison of gaze-directed and pointing motion control. In 2016 18th Mediterranean Electrotechnical Conference (MELECON). 1–6. https://doi.org/10.1109/MELCON.2016.7495413

[7]

Nathan Cournia, John D. Smith, and Andrew T. Duchowski. 2003. Gaze- vs. Hand-Based Pointing in Virtual Environments. In CHI ’03 Extended Abstracts on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI EA ’03). Association for Computing Machinery, New York, NY, USA, 772–773. https://doi.org/10.1145/765891.765982

[8]

Luis Gustavo Rotoly de Lima, André de Lima Salgado, and André Pimenta Freire. 2015. Evaluation of the User Experience and Intrinsic Motivation with Educational and Mainstream Digital Games. In Proceedings of the Latin American Conference on Human Computer Interaction (Córdoba, Argentina) (CLIHC ’15). Association for Computing Machinery, New York, NY, USA, Article Article 11, 7 pages. https://doi.org/10.1145/2824893.2824904

[9]

Rita F. de Oliveira, Raôul R. D. Oudejans, and Peter J. Beek. 2008. Gaze Behavior in Basketball Shooting. Research Quarterly for Exercise and Sport 79, 3 (2008), 399–404. https://doi.org/10.1080/02701367.2008.10599504 arXiv:https://doi.org/10.1080/02701367.2008.10599504PMID: 18816952.

[10]

Martin Dechant, Ian Stavness, Aristides Mairena, and Regan L. Mandryk. 2018. Empirical Evaluation of Hybrid Gaze-Controller Selection Techniques in a Gaming Context. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 73–85. https://doi.org/10.1145/3242671.3242699

Digital Library

[11]

Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The Impact of Avatar Realism and Eye Gaze Control on Perceived Quality of Communication in a Shared Immersive Virtual Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 529–536. https://doi.org/10.1145/642611.642703

Digital Library

[12]

Carl Gutwin, Rodrigo Vicencio-Moreira, and Regan L. Mandryk. 2016. Does Helping Hurt? Aiming Assistance and Skill Development in a First-Person Shooter Game. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (Austin, Texas, USA) (CHI PLAY ’16). Association for Computing Machinery, New York, NY, USA, 338–349. https://doi.org/10.1145/2967934.2968101

Digital Library

[13]

John Paulin Hansen, Vijay Rajanna, I. Scott MacKenzie, and Per Bundefinedkgaard. 2018. A Fitts’ Law Study of Click and Dwell Interaction by Gaze, Head and Mouse with a Head-Mounted Display. In Proceedings of the Workshop on Communication by Gaze Interaction (Warsaw, Poland) (COGAIN ’18). Association for Computing Machinery, New York, NY, USA, Article Article 7, 5 pages. https://doi.org/10.1145/3206343.3206344

Digital Library

[14]

Felix Hülsmann, Timo Dankert, and Thies Pfeiffer. 2011. Comparing Gaze-based and Manual Interaction in a Fast-paced Gaming Task in Virtual Reality. Proceedings of the Workshop Virtuelle & Erweiterte Realität.

[15]

Poika Isokoski, Markus Joos, Oleg Spakov, and Benoét Martin. 2009. Gaze controlled games. Universal Access in the Information Society 8, 4 (2009), 323–337. https://doi.org/10.1007/s10209-009-0146-3

Digital Library

[16]

Mohamed Khamis, Carl Oechsner, Florian Alt, and Andreas Bulling. 2018. VRpursuits: Interaction in Virtual Reality Using Smooth Pursuit Eye Movements. In Proceedings of the 2018 International Conference on Advanced Visual Interfaces(Castiglione della Pescaia, Grosseto, Italy) (AVI ’18). Association for Computing Machinery, New York, NY, USA, Article Article 18, 8 pages. https://doi.org/10.1145/3206505.3206522

Digital Library

[17]

Michael Lankes, Bernhard Maurer, and Barbara Stiglbauer. 2016. An Eye for an Eye: Gaze Input in Competitive Online Games and Its Effects on Social Presence. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (Osaka, Japan) (ACE ’16). Association for Computing Machinery, New York, NY, USA, Article Article 17, 9 pages. https://doi.org/10.1145/3001773.3001774

Digital Library

[18]

Michael Lankes, Joshua Newn, Bernhard Maurer, Eduardo Velloso, Martin Dechant, and Hans Gellersen. 2018. EyePlay Revisited: Past, Present and Future Challenges for Eye-Based Interaction in Games. In CHI PLAY ’18 Extended Abstracts. Melbourne, 689–693.

[19]

Yang LI, Jin HUANG, Feng TIAN, Hong-An WANG, and Guo-Zhong DAI. 2019. Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware 1, 1 (2019), 84 – 112. https://doi.org/10.3724/SP.J.2096-5796.2018.0006

[20]

Francisco Lopez Luro and Veronica Sundstedt. 2019. A comparative study of eye tracking and hand controller for aiming tasks in virtual reality. Eye Tracking Research and Applications Symposium (ETRA) (2019). https://doi.org/10.1145/3317956.3318153

Digital Library

[21]

Bernhard Maurer, Michael Lankes, and Manfred Tscheligi. 2018. Where the eyes meet: Lessons learned from shared gaze-based interactions in cooperative and competitive online games. Entertainment Computing 27 (2018), 47 – 59. https://doi.org/10.1016/j.entcom.2018.02.009

[22]

Y. K. Meena, H. Cecotti, K. Wong-Lin, and G. Prasad. 2017. A multimodal interface to resolve the Midas-Touch problem in gaze controlled wheelchair. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 905–908. https://doi.org/10.1109/EMBC.2017.8036971

[23]

Yun Suen Pai, Tilman Dingler, and Kai Kunze. 2019. Assessing Hands-Free Interactions for VR Using Eye Gaze and Electromyography. Virtual Real. 23, 2 (June 2019), 119–131. https://doi.org/10.1007/s10055-018-0371-2

Digital Library

[24]

Ken Pfeuffer, Benedikt Mayer, Diako Mardanbegi, and Hans Gellersen. 2017. Gaze + Pinch Interaction in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 99–108. https://doi.org/10.1145/3131277.3132180

Digital Library

[25]

T. Piumsomboon, G. Lee, R. W. Lindeman, and M. Billinghurst. 2017. Exploring natural eye-gaze-based interaction for immersive virtual reality. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 36–39. https://doi.org/10.1109/3DUI.2017.7893315

[26]

Richard M Ryan and Edward L Deci. 2000. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being., 68–78 pages. https://doi.org/10.1037/0003-066X.55.1.68

[27]

Valentin Schwind, Jan Leusmann, and Niels Henze. 2019. Understanding Visual-Haptic Integration of Avatar Hands Using a Fitts’ Law Task in Virtual Reality. In Mensch und Computer 2019 (2019-09-08). ACM Press. https://doi.org/10.1145/3340764.3340769

[28]

Valentin Schwind, Lorraine Lin, Massimiliano Di Luca, Sophie Jörg, and James Hillis. 2018. Touch with Foreign Hands: The Effect of Virtual Hand Appearance on Visual-Haptic Integration. In Proceedings of the ACM Symposium on Applied Perception (SAP ’18) (2018-08-03). ACM, New York, NY. https://doi.org/10.1145/3225153.3225158

Digital Library

[29]

Vildan Tanriverdi and Robert J. K. Jacob. 2000. Interacting with Eye Movements in Virtual Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI ’00). Association for Computing Machinery, New York, NY, USA, 265–272. https://doi.org/10.1145/332040.332443

Digital Library

[30]

Jayson Turner, Eduardo Velloso, Hans Gellersen, and Veronica Sundstedt. 2014. EyePlay: Applications for Gaze in Games. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play (Toronto, Ontario, Canada) (CHI PLAY ’14). Association for Computing Machinery, New York, NY, USA, 465–468. https://doi.org/10.1145/2658537.2659016

Digital Library

[31]

Eduardo Velloso and Marcus Carter. 2016. The Emergence of EyePlay: A Survey of Eye Interaction in Games. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (Austin, Texas, USA) (CHI PLAY ’16). Association for Computing Machinery, New York, NY, USA, 171–185. https://doi.org/10.1145/2967934.2968084

Digital Library

[32]

Rodrigo Vicencio-Moreira, Regan L. Mandryk, and Carl Gutwin. 2015. Now You Can Compete With Anyone: Balancing Players of Different Skill Levels in a First-Person Shooter Game. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2255–2264. https://doi.org/10.1145/2702123.2702242

Digital Library

[33]

Rodrigo Vicencio-Moreira, Regan L. Mandryk, Carl Gutwin, and Scott Bateman. 2014. The Effectiveness (or Lack Thereof) of Aim-Assist Techniques in First-Person Shooter Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 937–946. https://doi.org/10.1145/2556288.2557308

Digital Library

[34]

V. Vinayagamoorthy, M. Garau, A. Steed, and M. Slater. 2004. An eye gaze model for dyadic interaction in an immersive virtual environment: Practice and experience. Computer Graphics Forum 23, 1 (2004), 1–11. https://doi.org/10.1111/j.1467-8659.2004.00001.x

[35]

Nienke Vos, Henny van der Meijden, and Eddie Denessen. 2011. Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Computers & Education 56 (2011), 127–137.

Digital Library

[36]

Thomas Waltemate, Dominik Gall, Daniel Roth, Mario Botsch, and Marc Erich Latoschik. 2018. The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response. IEEE Transactions on Visualization and Computer Graphics 24, 4(2018), 1643–1652. https://doi.org/10.1109/TVCG.2018.2794629

Digital Library

Cited By

Severitt BCastner NWahl S(2024)Bi-Directional Gaze-Based Communication: A ReviewMultimodal Technologies and Interaction10.3390/mti81201088:12(108)Online publication date: 4-Dec-2024
https://doi.org/10.3390/mti8120108
Colley MWanner BRädler MRötzer MFrommel JHirzle TJansen PRukzio E(2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641909
Zhang HYin LZhang H(2024)A real-time camera-based gaze-tracking system involving dual interactive modes and its application in gamingMultimedia Systems10.1007/s00530-023-01204-930:1Online publication date: 16-Jan-2024
https://dl.acm.org/doi/10.1007/s00530-023-01204-9
Show More Cited By

Eye Caramba: Gaze-based Assistance for Virtual Reality Aiming and Throwing Tasks in Games
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views
COGAIN '18: Proceedings of the Workshop on Communication by Gaze Interaction

The current best practice for hands-free selection using Virtual and Augmented Reality (VR/AR) head-mounted displays is to use head-gaze for aiming and dwell-time or clicking for triggering the selection. There is an observable trend for new VR and AR ...
Snap, Pursuit and Gain: Virtual Reality Viewport Control by Gaze
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

Head-mounted displays let users explore virtual environments through a viewport that is coupled with head movement. In this work, we investigate gaze as an alternative modality for viewport control, enabling exploration of virtual worlds with less head ...
Don’t make me sick: investigating the incidence of cybersickness in commercial virtual reality headsets
Abstract
The resurgence of interest in the use of virtual reality (VR) technology for research and entertainment purposes has led to an increase in concerns about human factor issues inherent in VR technology. One issue that has received a great deal of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

June 2020

305 pages

ISBN:9781450371346

DOI:10.1145/3379156

Editors:
Andreas Bulling
University of Stuttgart, Germany
,
Anke Huckauf
Ulm University, Germany
,
Eakta Jain
University of Florida, USA
,
Ralph Radach
University of Wuppertal, Germany
,
Daniel Weiskopf
University of Stuttgart, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ETRA '20

Sponsor:

ETRA '20: 2020 Symposium on Eye Tracking Research and Applications

June 2 - 5, 2020

Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
387
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)2

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Severitt BCastner NWahl S(2024)Bi-Directional Gaze-Based Communication: A ReviewMultimodal Technologies and Interaction10.3390/mti81201088:12(108)Online publication date: 4-Dec-2024
https://doi.org/10.3390/mti8120108
Colley MWanner BRädler MRötzer MFrommel JHirzle TJansen PRukzio E(2024)Effects of a Gaze-Based 2D Platform Game on User Enjoyment, Perceived Competence, and Digital Eye StrainProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641909(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641909
Zhang HYin LZhang H(2024)A real-time camera-based gaze-tracking system involving dual interactive modes and its application in gamingMultimedia Systems10.1007/s00530-023-01204-930:1Online publication date: 16-Jan-2024
https://dl.acm.org/doi/10.1007/s00530-023-01204-9
Rings SSchmidt SSchmelter TBrosius MSteinicke F(2023)Gaze Assistance for Older Adults during Throwing in Virtual Reality and its Effects on Performance and MotivationProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615706(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615706
Chen YHsieh CJie MHan PHung Y(2023)Leap to the Eye: Implicit Gaze-based Interaction to Reveal Invisible Objects for Virtual Environment Exploration2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00036(214-222)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00036
Vlahovic SSuznjevic MSkorin-Kapov L(2022)A Framework for the Classification and Evaluation of Game Mechanics for Virtual Reality GamesElectronics10.3390/electronics1118294611:18(2946)Online publication date: 17-Sep-2022
https://doi.org/10.3390/electronics11182946
Lankes MRamirez Gomez A(2022)GazeCues: Exploring the Effects of Gaze-based Visual Cues in Virtual Reality Exploration GamesProceedings of the ACM on Human-Computer Interaction10.1145/35495006:CHI PLAY(1-25)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.1145/3549500
Halbig ALatoschik M(2021)A Systematic Review of Physiological Measurements, Factors, Methods, and Applications in Virtual RealityFrontiers in Virtual Reality10.3389/frvir.2021.6945672Online publication date: 14-Jul-2021
https://doi.org/10.3389/frvir.2021.694567

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten