short-paper

Understanding Game Roles and Strategy Using a Mixed Methods Approach

Authors:

Kaitlyn M Roose,

Elizabeth S. VeinottAuthors Info & Claims

ETRA '21 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Article No.: 4, Pages 1 - 5

https://doi.org/10.1145/3448018.3458006

Published: 25 May 2021 Publication History

Abstract

In this paper, we use the Tracer Method to examine a complex and team-oriented, first-person shooter game to determine how the output can better inform Esports training. The Tracer Method combines eye tracking with Critical Decision Method to focus the analyses on the critical aspects of gameplay, while providing insight into the most frequent visual search transitions across game areas of interest. We examined the differences across three in-game roles and three decision types (strategic, operational, and tactical) using network centrality diagrams and entropy measures. No differences in overall stationary entropy were found for either role or decision type. However, each game role and decision type produced a different network centrality diagram, indicating different visual search transitions, which could support training of Esport players.

References

[1]

Serkan Alkan and Kursat Cagiltay. 2007. Studying computer game learning experience through eye tracking. British Journal of Educational Technology 38, 3 (2007), 538–542. https://doi.org/10.1111/j.1467-8535.2007.00721.x arXiv:https://bera-journals.onlinelibrary.wiley.com/doi/pdf/10.1111/j.1467-8535.2007.00721.x

[2]

Blizzard 2016. Overwatch. [Video Game].

[3]

Stephanie Brams, Gal Ziv, Oron Levin, Jochim Spitz, Johan Wagemans, Mark Williams, and Werner F. Helsen. 2019. The relationship between gaze behavior, expertise, and performance: A systematic review. Psychological Bulletin 145, 10 (2019), 980–1027.

[4]

Michael Burch and Kuno Kurzhals. 2020. Visual Analysis of Eye Movements During Game Play. In ACM Symposium on Eye Tracking Research and Applications (Stuttgart, Germany) (ETRA ’20 Short Papers). Association for Computing Machinery, New York, NY, USA, Article 59, 5 pages. https://doi.org/10.1145/3379156.3391839

Digital Library

[5]

Lynne Cooke. 2010. Assessing Concurrent Think-Aloud Protocol as a Usability Test Method: A Technical Communication Approach. IEEE Transactions on Professional Communication 53, 3(2010), 202–215. https://doi.org/10.1109/TPC.2010.2052859

[6]

Beth Crandall, Gary Klein, and Robert R. Hoffman. 2006. Working minds: A practitioner’s guide to cognitive task analysis.MIT Press.

[7]

Andrew T. Duchowski. 2017. Eye tracking methodology: Theory and practice.Springer.

Digital Library

[8]

Magy Seif El-Nasr and Su Yan. 2006. Visual Attention in 3D Video Games. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Hollywood, California, USA) (ACE ’06). Association for Computing Machinery, New York, NY, USA, 22–es. https://doi.org/10.1145/1178823.1178849

Digital Library

[9]

Sanne Elling, Leo Lentz, and Menno de Jong. 2011. Retrospective Think-Aloud Method: Using Eye Movements as an Extra Cue for Participants’ Verbalizations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1161–1170. https://doi.org/10.1145/1978942.1979116

Digital Library

[10]

Sanne Elling, Leo Lentz, and Menno de Jong. 2012. Combining Concurrent Think-Aloud Protocols and Eye-Tracking Observations: An Analysis of Verbalizations and Silences. IEEE Transactions on Professional Communication 55, 3(2012), 206–220. https://doi.org/10.1109/TPC.2012.2206190

[11]

Daniel Himmelstein, Yitong Liu, and Jamie L. Shapiro. 2017. An Exploration of Mental Skills Among Competitive League of Legend Players. Int. J. Gaming Comput. Mediat. Simul. 9, 2 (April 2017), 1–21. https://doi.org/10.4018/IJGCMS.2017040101

Digital Library

[12]

Robert J.K. Jacob and Keith S. Karn. 2003. Commentary on Section 4 - Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises. In The Mind’s Eye, J. Hyönä, R. Radach, and H. Deubel (Eds.). North-Holland, Amsterdam, 573–605. https://doi.org/10.1016/B978-044451020-4/50031-1

[13]

Francisco Lopez Luro and Veronica Sundstedt. 2019. A Comparative Study of Eye Tracking and Hand Controller for Aiming Tasks in Virtual Reality. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (Denver, Colorado) (ETRA ’19). Association for Computing Machinery, New York, NY, USA, Article 68, 9 pages. https://doi.org/10.1145/3317956.3318153

Digital Library

[14]

Gwen Mullinix, Oliver Gray, Juan Colado, Elizabeth S. Veinott, James Leonard, Elizabeth L. Papautsky, Chris Argenta, Marcia Clover, Steven Sickles, Edward Castronova, Peter M. Todd, Travis Ross, Jared Lorince, Jared Hoteling, Sharon Mayell, Chris Hale, Elizabeth Whitaker, Robert R. Hoffman, Olivia Fox, and John Flach. 2013. Heuristica: Designing a serious game for improving decision making. In 2013 IEEE International Games Innovation Conference (IGIC). 250–255. https://doi.org/10.1109/IGIC.2013.6659159

[15]

Esdras Paravizo and Renato Rodrigues Luvizoto de Souza. 2019. Playing for Real: An Exploratory Analysis of Professional Esports Athletes’ Work. In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018), Sebastiano Bagnara, Riccardo Tartaglia, Sara Albolino, Thomas Alexander, and Yushi Fujita(Eds.). Springer International Publishing, Cham, 507–515.

[16]

Mathew Pluss, Kyle JM Bennett, Andrew R. Novak, Derek Panchuk, Aaron Coutts, and Job Fransen. 2019. Esports: the chess of the 21st century. Frontiers in Psychology 10, 156 (2019).

[17]

Alex Poole and Linden J. Ball. 2006. Eye Tracking in HCI and Usability Research. In Encyclopedia of Human Computer Interaction, Claude Ghaoui (Ed.). IGI Global, 211–219. https://doi.org/10.4018/978-1-59140-562-7.ch034

[18]

Daniel Railsback and Nicholas Caporusso. 2019. Investigating the Human Factors in eSports Performance. In Advances in Human Factors in Wearable Technologies and Game Design, Tareq Z. Ahram (Ed.). Springer International Publishing, Cham, 325–334.

[19]

Tony Renshaw, Richard Stevens, and Paul D. Denton. 2009. Towards understanding engagement in games: An eye-tracking study. On the Horizon 17, 4 (2009), 408–420.

[20]

Detlef Rhenius and Gerhard Deffner. 1990. Evaluation of Concurrent Thinking Aloud Using Eye-tracking Data. Proceedings of the Human Factors Society Annual Meeting 34, 17(1990), 1265–1269. https://doi.org/10.1177/154193129003401719

[21]

Kaitlyn M. Roose and Elizabeth S. Veinott. 2020. Leveling Up: Using the Tracer Method to Address Training Needs for Esports Players. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1(2020), 1780–1784. https://doi.org/10.1177/1071181320641430

[22]

Kaitlyn M. Roose, Elizabeth S. Veinott, and Shane T. Mueller. 2018. The Tracer Method: The Dynamic Duo Combining Cognitive Task Analysis and Eye Tracking. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Melbourne, VIC, Australia) (CHI PLAY ’18 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 585–593. https://doi.org/10.1145/3270316.3271522

Digital Library

[23]

J. David Smith and T. C. Nicholas Graham. 2006. Use of Eye Movements for Video Game Control. In Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Hollywood, California, USA) (ACE ’06). Association for Computing Machinery, New York, NY, USA, 20–es. https://doi.org/10.1145/1178823.1178847

Digital Library

[24]

Diane H Sonnenwald and Linda G Pierce. 2000. Information behavior in dynamic group work contexts: interwoven situational awareness, dense social networks and contested collaboration in command and control. Information Processing & Management 36, 3 (2000), 461–479. https://doi.org/10.1016/S0306-4573(99)00039-4

Digital Library

[25]

Elizabeth S. Veinott and Cheryl Irwin. 1993. Analysis of communication in the standard versus automated aircraft. In Proceedings of the Seventh International Symposium on Aviation Psychology. Ohio State University Press, 584–588.

[26]

Sarah A. Vitak, John E. Ingram, Andrew T. Duchowski, Steven Ellis, and Anand K. Gramopadhye. 2012. Gaze-Augmented Think-Aloud as an Aid to Learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2991–3000. https://doi.org/10.1145/2207676.2208710

Digital Library

[27]

Elizabeth Whitaker, Ethan Trewhitt, and Elizabeth S. Veinott. 2019. Intelligent Tutoring Design Alternatives in a Serious Game. In Adaptive Instructional Systems. Springer International Publishing, 151–165. https://doi.org/10.1007/978-3-030-22341-0_13

[28]

Carol E. Zsambok and Gary Klein (Eds.). 2014. Naturalistic decision making (2nd Ed). Psychology Press.

Cited By

Gruner MSchrills TFranke T(2023)Pre-defined Emergencies on Demand: Simulation-Based Analysis of Information Processing in Emergency DispatchingDigital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management10.1007/978-3-031-35741-1_28(368-382)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35741-1_28

Index Terms

Understanding Game Roles and Strategy Using a Mixed Methods Approach

Index terms have been assigned to the content through auto-classification.

Recommendations

Energy-Efficient ECG Signal Compression for User Data Input in Cyber-Physical Systems by Leveraging Empirical Mode Decomposition
Special Issue on Human-Interaction-Aware Data Analytics for CPS

Human physiological data are naturalistic and objective user data inputs for a great number of cyber-physical systems (CPS). Electrocardiogram (ECG) as a widely used physiological golden indicator for certain human state and disease diagnosis is often ...
Adding unit test experience to a usability centered project course
SIGCSE '14: Proceedings of the 45th ACM technical symposium on Computer science education

This HCI course incorporated unit testing as a quality improvement initiative with an Experiential Learning Model. The focus of the research was on observation and conceptualization---students should be able to associate the benefits of usability and ...
Introductory programming: a systematic literature review
ITiCSE 2018 Companion: Proceedings Companion of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education

As computing becomes a mainstream discipline embedded in the school curriculum and acts as an enabler for an increasing range of academic disciplines in higher education, the literature on introductory programming is growing. Although there have been ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '21 Short Papers: ACM Symposium on Eye Tracking Research and Applications

May 2021

232 pages

ISBN:9781450383455

DOI:10.1145/3448018

Editors:
Andreas Bulling
University of Stuttgart, Germany
,
Anke Huckauf
Ulm University, Germany
,
Hans Gellersen
Aarhus University, Denmark
,
Daniel Weiskopf
University of Stuttgart, Germany
,
Mihai Bace
ETH Zürich, Switzerland
,
Teresa Hirzle
Ulm University, Germany
,
Florian Alt
Bundeswehr University Munich, Germany
,
Thies Pfeiffer
Hochschule Emden/Leer, Germany
,
Roman Bednarik
University of Eastern Finland, Finland
,
Krzysztof Krejtz
SWPS University of Social Sciences and Humanities, Poland
,
Tanja Blascheck
University of Stuttgart, Germany
,
Michael Burch
University of Applied Sciences, Chur, Switzerland
,
Peter Kiefer
ETH Zurich, Switzerland
,
Michael Dodd
University of Nebraska-Lincoln, USA
,
Bonita Sharif
University of Nebraska-Lincoln, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

ETRA '21

Sponsor:

SIGGRAPH

ETRA '21: 2021 Symposium on Eye Tracking Research and Applications

May 25 - 27, 2021

Virtual Event, Germany

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
158
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)5

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gruner MSchrills TFranke T(2023)Pre-defined Emergencies on Demand: Simulation-Based Analysis of Information Processing in Emergency DispatchingDigital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management10.1007/978-3-031-35741-1_28(368-382)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35741-1_28

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten