skip to main content
10.1145/3613905.3650876acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Eye Ball: Gazing as a Dilemma in a Competitive Virtual Reality Game

Published: 11 May 2024 Publication History

Abstract

In the evolving landscape of gaming technology, our research explores the integration of eye-tracking in VR games, moving beyond traditional applications. This paper presents "Eye Ball," a competitive VR game that introduces a novel gaze-based mechanic, creating strategic dilemmas in gameplay. Our approach utilizes the qualities of gaze behavior to enhance social interaction in games, offering a more immersive gaming experience. In "Eye Ball," players can generate a shield by closing their eyes, providing protection at the strategic cost of visual awareness. This mechanic challenges traditional game design, balancing the power of protection with the vulnerability of reduced situational awareness. A comparative study was conducted to examine the effects of this gaze-based dilemma. Our findings demonstrate the potential of gaze mechanics in enhancing the depth of social VR games. Our research contributes to the broader field of HCI, highlighting the potential of gaze interaction in creating immersive and socially complex gaming experiences.

Supplemental Material

MP4 File
Talk Video
Transcript for: Talk Video

References

[1]
Deepak Akkil, Jobin Mathew James, Poika Isokoski, and Jari Kangas. 2016. GazeTorch: Enabling Gaze Awareness in Collaborative Physical Tasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). ACM, New York, NY, USA, 1151–1158. https://doi.org/10.1145/2851581.2892459
[2]
Jeremy N. Bailenson, Andrew C. Beall, Jack Loomis, Jim Blascovich, and Matthew Turk. 2004. Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments. Presence: Teleoper. Virtual Environ. 13, 4 (Aug. 2004), 428–441. https://doi.org/10.1162/1054746041944803
[3]
Paulo Bala, Lucilia Noóbrega, Guilherme Neves, Lai’s Lopes, Joana Morna, João Camacho, and Cristina Freitas. 2015. Keyewai: Looking at Cooperation in a Holographic Projection Screen. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (, Seoul, Republic of Korea, ) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 61–64. https://doi.org/10.1145/2702613.2728652
[4]
Richard Bates, Stephen Vickers, and Howell O Istance. 2010. Gaze interaction with virtual on-line communities: levelling the playing field for disabled users. Universal Access in the Information Society 9, 3 (2010), 261–272.
[5]
Marcus Carter, Joshua Newn, Eduardo Velloso, and Frank Vetere. 2015. Remote Gaze and Gesture Tracking on the Microsoft Kinect: Investigating the Role of Feedback. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (Parkville, VIC, Australia) (OzCHI ’15). Association for Computing Machinery, New York, NY, USA, 167–176. https://doi.org/10.1145/2838739.2838778
[6]
Emiliano Castellina and Fulvio Corno. 2008. Multimodal gaze interaction in 3D virtual environments. Cogain 8, 2008 (2008), 33–37.
[7]
Martin Dechant, Ian Stavness, Aristides Mairena, and Regan L. Mandryk. 2018. Empirical Evaluation of Hybrid Gaze-Controller Selection Techniques in a Gaming Context. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (, Melbourne, VIC, Australia, ) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 73–85. https://doi.org/10.1145/3242671.3242699
[8]
Soussan Djamasbi and Siavash Mortazavi. 2015. Generation Y, Baby Boomers, and Gaze Interaction Experience in Gaming. In Proceedings of the 2015 48th Hawaii International Conference on System Sciences(HICSS ’15). IEEE Computer Society, Washington, DC, USA, 482–490. https://doi.org/10.1109/HICSS.2015.64
[9]
Inger M. Ekman, Antti W. Poikola, and Meeri K. Mäkäräinen. 2008. Invisible Eni: Using Gaze and Pupil Size to Control a Game. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy) (CHI EA ’08). ACM, New York, NY, USA, 3135–3140. https://doi.org/10.1145/1358628.1358820
[10]
Julia Grech and Jacek Matulewski. 2023. Evaluation of several gaze control methods for a board game with no time pressure. Procedia Computer Science 225 (2023), 2457–2466. https://doi.org/10.1016/j.procs.2023.10.237 27th International Conference on Knowledge Based and Intelligent Information and Engineering Sytems (KES 2023).
[11]
K. Gupta, G. A. Lee, and M. Billinghurst. 2016. Do You See What I See? The Effect of Gaze Tracking on Task Space Remote Collaboration. IEEE Transactions on Visualization and Computer Graphics 22, 11 (Nov 2016), 2413–2422. https://doi.org/10.1109/TVCG.2016.2593778
[12]
Poika Isokoski, Markus Joos, Oleg Spakov, and Benoit Martin. 2009. Gaze Controlled Games. Univers. Access Inf. Soc. 8, 4 (Oct. 2009), 323–337. https://doi.org/10.1007/s10209-009-0146-3
[13]
Howell Istance, Aulikki Hyrskykari, Lauri Immonen, Santtu Mansikkamaa, and Stephen Vickers. 2010. Designing Gaze Gestures for Gaming: An Investigation of Performance. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (Austin, Texas) (ETRA ’10). ACM, New York, NY, USA, 323–330. https://doi.org/10.1145/1743666.1743740
[14]
Patrick Jermann, Marc-Antoine Nüssli, and Weifeng Li. 2010. Using Dual Eye-tracking to Unveil Coordination and Expertise in Collaborative Tetris. In Proceedings of the 24th BCS Interaction Specialist Group Conference (Dundee, United Kingdom) (BCS ’10). British Computer Society, Swinton, UK, UK, 36–44. http://dl.acm.org/citation.cfm?id=2146303.2146309
[15]
Michael Lankes. 2020. Social Gaze in Minimalist Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Virtual Event, Canada) (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA, 450–460. https://doi.org/10.1145/3410404.3414265
[16]
Michael Lankes, Bernhard Maurer, and Barbara Stiglbauer. 2016. An Eye for an Eye: Gaze Input in Competitive Online Games and Its Effects on Social Presence. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (Osaka, Japan) (ACE ’16). Association for Computing Machinery, New York, NY, USA, Article 17, 9 pages. https://doi.org/10.1145/3001773.3001774
[17]
Michael Lankes, Matej Rajtár, Oleg Denisov, and Bernhard Maurer. 2018. Socialeyes: Social Gaze in Collaborative 3D Games. In Proceedings of the 13th International Conference on the Foundations of Digital Games (Malmö, Sweden) (FDG ’18). Association for Computing Machinery, New York, NY, USA, Article 3, 10 pages. https://doi.org/10.1145/3235765.3235766
[18]
Bernhard Maurer, Michael Lankes, Barbara Stiglbauer, and Manfred Tscheligi. 2016. EyeCo: Effects of Shared Gaze on Social Presence in an Online Cooperative Game. In Entertainment Computing - ICEC 2016, Günter Wallner, Simone Kriglstein, Helmut Hlavacs, Rainer Malaka, Artur Lugmayr, and Hyun-Seung Yang (Eds.). Springer International Publishing, Cham, 102–114.
[19]
Diego Navarro and Veronica Sundstedt. 2017. Simplifying Game Mechanics: Gaze As an Implicit Interaction Method. In SIGGRAPH Asia 2017 Technical Briefs (Bangkok, Thailand) (SA ’17). ACM, New York, NY, USA, Article 4, 4 pages. https://doi.org/10.1145/3145749.3149446
[20]
Joshua Newn, Fraser Allison, Eduardo Velloso, and Frank Vetere. 2018. Looks Can Be Deceiving: Using Gaze Visualisation to Predict and Mislead Opponents in Strategic Gameplay. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, Article 261, 12 pages. https://doi.org/10.1145/3173574.3173835
[21]
Joshua Newn, Eduardo Velloso, Fraser Allison, Yomna Abdelrahman, and Frank Vetere. 2017. Evaluating Real-Time Gaze Representations to Infer Intentions in Competitive Turn-Based Strategy Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Amsterdam, The Netherlands) (CHI PLAY ’17). ACM, New York, NY, USA, 541–552. https://doi.org/10.1145/3116595.3116624
[22]
Joshua Newn, Eduardo Velloso, Marcus Carter, and Frank Vetere. 2016. Exploring the Effects of Gaze Awareness on Multiplayer Gameplay. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (, Austin, Texas, USA, ) (CHI PLAY Companion ’16). Association for Computing Machinery, New York, NY, USA, 239–244. https://doi.org/10.1145/2968120.2987740
[23]
Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. GazeArchers: Playing with Individual and Shared Attention in a Two-player Look&Shoot Tabletop Game. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (Rovaniemi, Finland) (MUM ’16). ACM, New York, NY, USA, 213–216. https://doi.org/10.1145/3012709.3012717
[24]
Argenis Ramirez Gomez and Hans Gellersen. 2019. Looking Outside the Box: Reflecting on Gaze Interaction in Gameplay. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (, Barcelona, Spain, ) (CHI PLAY ’19). Association for Computing Machinery, New York, NY, USA, 625–637. https://doi.org/10.1145/3311350.3347150
[25]
Argenis Ramirez Gomez and Hans Gellersen. 2019. SuperVision: Playing with Gaze Aversion and Peripheral Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300703
[26]
Argenis Ramirez Gomez and Hans Gellersen. 2020. KryptonEyed: Playing with Gaze Without Looking. In Proceedings of the 15th International Conference on the Foundations of Digital Games (Bugibba, Malta) (FDG ’20). Association for Computing Machinery, New York, NY, USA, Article 52, 4 pages. https://doi.org/10.1145/3402942.3403017
[27]
Argenis Ramirez Gomez and Michael Lankes. 2021. Eyesthetics: Making Sense of the Aesthetics of Playing with Gaze. Proc. ACM Hum.-Comput. Interact. 5, CHI PLAY, Article 259 (oct 2021), 24 pages. https://doi.org/10.1145/3474686
[28]
Argenis Ramirez Gomez and Michael Lankes. 2021. Eyesthetics: Making Sense of the Aesthetics of Playing with Gaze. Proc. ACM Hum.-Comput. Interact. 5, CHI PLAY, Article 259 (oct 2021), 24 pages. https://doi.org/10.1145/3474686
[29]
Sven Seele, Sebastian Misztal, Helmut Buhler, Rainer Herpers, and Jonas Schild. 2017. Here’s Looking At You Anyway! How Important is Realistic Gaze Behavior in Co-Located Social Virtual Reality Games?. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (Amsterdam, The Netherlands) (CHI PLAY ’17). Association for Computing Machinery, New York, NY, USA, 531–540. https://doi.org/10.1145/3116595.3116619
[30]
Suleman Shahid, Emiel Krahmer, and Marc Swerts. 2012. Video-mediated and co-present gameplay: Effects of mutual gaze on game experience, expressiveness and perceived social presence. Interacting with Computers 24, 4 (05 2012), 292–305. https://doi.org/10.1016/j.intcom.2012.04.006 arXiv:https://academic.oup.com/iwc/article-pdf/24/4/292/2015009/iwc24-0292.pdf
[31]
Suleman Shahid, Emiel Krahmer, and Marc Swerts. 2012. Video-mediated and co-present gameplay: Effects of mutual gaze on game experience, expressiveness and perceived social presence☆. Interacting with Computers 24, 4 (05 2012), 292–305. https://doi.org/10.1016/j.intcom.2012.04.006 arXiv:http://oup.prod.sis.lan/iwc/article-pdf/24/4/292/2015009/iwc24-0292.pdf
[32]
Veronica Sundstedt. 2010. Gazing at Games: Using Eye Tracking to Control Virtual Characters. In ACM SIGGRAPH 2010 Courses (Los Angeles, California) (SIGGRAPH ’10). Association for Computing Machinery, New York, NY, USA, Article 5, 160 pages. https://doi.org/10.1145/1837101.1837106
[33]
Eduardo Velloso and Marcus Carter. 2016. The Emergence of EyePlay: A Survey of Eye Interaction in Games. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (, Austin, Texas, USA, ) (CHI PLAY ’16). Association for Computing Machinery, New York, NY, USA, 171–185. https://doi.org/10.1145/2967934.2968084
[34]
Eduardo Velloso, Amy Fleming, Jason Alexander, and Hans Gellersen. 2015. Gaze-Supported Gaming: MAGIC Techniques for First Person Shooters. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (, London, United Kingdom, ) (CHI PLAY ’15). Association for Computing Machinery, New York, NY, USA, 343–347. https://doi.org/10.1145/2793107.2793137
[35]
Melodie Vidal. 2014. Shynosaurs: A Game of Attention Dilemma. In Proceedings of the First ACM SIGCHI Annual Symposium on Computer-human Interaction in Play (Toronto, Ontario, Canada) (CHI PLAY ’14). ACM, New York, NY, USA, 391–394. https://doi.org/10.1145/2658537.2662979
[36]
Melodie Vidal, Remi Bismuth, Andreas Bulling, and Hans Gellersen. 2015. The Royal Corgi: Exploring Social Gaze Interaction for Immersive Gameplay. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 115–124. https://doi.org/10.1145/2702123.2702163
[37]
Oleg Špakov, Howell Istance, Kari-Jouko Räihä, Tiia Viitanen, and Harri Siirtola. 2019. Eye Gaze and Head Gaze in Collaborative Games. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (Denver, Colorado) (ETRA ’19). Association for Computing Machinery, New York, NY, USA, Article 85, 9 pages. https://doi.org/10.1145/3317959.3321489
[38]
Theresa F. Wechsler, Martin Kocur, Sandra Schumacher, Mirjam Rubenbauer, Andreas Ruider, Martin Brockelmann, Michael Lankes, Christian Wolff, and Andreas Mühlberger. 0. Looking fear in the eye: Gamified virtual reality exposure towards spiders for children using attention based feedback. Clinical Child Psychology and Psychiatry 0, 0 (0), 13591045231194103. https://doi.org/10.1177/13591045231194103 arXiv:https://doi.org/10.1177/13591045231194103PMID: 37592910.
[39]
Tom Wilcox, Mike Evans, Chris Pearce, Nick Pollard, and Veronica Sundstedt. 2008. Gaze and Voice Based Game Interaction: The Revenge of the Killer Penguins. In ACM SIGGRAPH 2008 Posters (Los Angeles, California) (SIGGRAPH ’08). Association for Computing Machinery, New York, NY, USA, Article 81, 1 pages. https://doi.org/10.1145/1400885.1400972

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Check for updates

Author Tags

  1. Gaze-based interaction
  2. VR games
  3. social games

Qualifiers

  • Work in progress
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '24

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 242
    Total Downloads
  • Downloads (Last 12 months)242
  • Downloads (Last 6 weeks)30
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media