skip to main content
10.1145/3670653.3670678acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmundcConference Proceedingsconference-collections
research-article
Open access

Statistical Analysis of Eye Movement Data for Beginners

Published: 01 September 2024 Publication History

Abstract

Data processing and (statistical) data analysis are important tasks in empirical research. However, they present a particular hurdle for beginners. For one, they require knowledge of statistical methods, their prerequisites, or use cases; For another, one needs either programming skills or some software system to carry out the analyses efficiently. Empirical eye tracking research poses a further hurdle; Data from an eye tracker is processed more elaborately and usually merged with data from other sources (e.g., questionnaires). In this article, we take a closer look at the possibilities that prospective eye tracking researchers have on their way from data collection to publication-ready analysis. We show that there is currently no software system that allows valid statistical analyses of eye tracking data to be performed without prior knowledge – which means that prospective eye tracking researchers need to learn or be taught the basics before performing actual analyses. As a solution, we present a novel tool: eyenalyzer. It guides through the analysis process – even without prior knowledge and therefore suitable for beginners. In the article, after highlighting the need for the tool, we discuss its development, give a glimpse at the user interface, and point out contribution and future work.

References

[1]
Julia Arnold, Kerstin Kremer, and Jürgen Mayer. 2017. Scaffolding beim Forschenden Lernen: Eine empirische Untersuchung zur Wirkung von Lernunterstützungen. Zeitschrift für Didaktik der Naturwissenschaften 23 (11 2017), 21–37. Issue 1. https://doi.org/10.1007/s40573-016-0053-0
[2]
Christoph Berger, Martin Winkels, Alexander Lischke, and Jacqueline Höppner. 2012. GazeAlyze: A MATLAB toolbox for the analysis of eye movement data. Behavior Research Methods 44 (6 2012), 404–419. Issue 2. https://doi.org/10.3758/s13428-011-0149-x
[3]
Christopher Blake. 2013. Eye-Tracking: Grundlagen und Anwendungsfelder. In Handbuch standardisierte Erhebungsverfahren in der Kommunikationswissenschaft, Wiebke Möhring and Daniela Schlütz (Eds.). Springer VS, Wiesbaden, Germany, 367–387.
[4]
John Brooke. 1996. Usability Evaluation In Industry (1 ed.). CRC Press, Boca Raton, FL, USA, Chapter SUS: A ’Quick and Dirty’ Usability Scale, 189–194.
[5]
Edwin Dalmaijer, Sebastiaan Mathôt, and Stefan Van der Stigchel. 2014. PyGaze: An open-source, cross-platform toolbox for minimal-effort programming of eyetracking experiments. Behav. Res. Methods 46 (12 2014), 913–921. Issue 4. https://doi.org/10.3758/s13428-013-0422-2
[6]
Nicola Döring and Jürgen Bortz. 2016. Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschaften (5 ed.). Springer, Berlin, Germany.
[7]
Andy Field and Graham Hole. 2003. How to Design and Report Experiments (1 ed.). SAGE Publications, Thousand Oaks, CA, USA.
[8]
International Organization for Standardization. 2018. Ergonomics of human-system interaction - Part 11: Usability: Definitions and concepts (ISO 9241-11:2018(E))., 36 pages.
[9]
International Organization for Standardization. 2020. Ergonomics of human-system interaction - Part 110: Interaction principles (ISO 9241-110:2020(E))., 40 pages.
[10]
Agostino Gibaldi and Silvio Sabatini. 2021. The saccade main sequence revised: A fast and repeatable tool for oculomotor analysis. Behav. Res. Methods 53 (2 2021), 167–187. Issue 1. https://doi.org/10.3758/s13428-020-01388-2
[11]
Lisa Grabinger, Florian Hauser, and Jürgen Mottok. 2022. Accessing the presentation of causal graphs and an application of gestalt principles with eye tracking. In Proceedings of the 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (Honolulu, HI, USA) (SANER ’22). IEEE, New York, NY, USA, 1267–1274. https://doi.org/10.1109/SANER53432.2022.00153
[12]
Lisa Grabinger, Florian Hauser, and Jürgen Mottok. 2024. On eye tracking in software engineering [Manuscript accepted for publication in SN Comput. Sci.].
[13]
Lisa Grabinger, Florian Hauser, and Jürgen Mottok. 2024. On the perception of graph layouts. J. Softw. 36 (5 2024), 1–18. Issue 5. https://doi.org/10.1002/smr.2599
[14]
Alan Hevner. 2007. A three cycle view of design science research. Scand. J. Inf. Syst. 19, Article 4 (7 2007), 6 pages. Issue 2.
[15]
Eric Horster. 2022. Digitales Tourismusmarketing: Grundlagen, Suchmaschinenmarketing, User-Experience-Design, Social-Media-Marketing und Mobile Marketing. Springer Gabler, Wiesbaden, Germany.
[16]
Vassilios Krassanakis, Vassiliki Filippakopoulou, and Byron Nakos. 2014. EyeMMV toolbox: An eye movement post-analysis tool based on a two-step spatial dispersion threshold for fixation identification. J. Eye Mov. Res. 7 (3 2014), 1–10. Issue 1. https://doi.org/10.16910/jemr.7.1.1
[17]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In HCI and Usability for Education and Work (Graz, Austria), Vol. 5298. Springer, Berlin, Germany, 63–76. https://doi.org/10.1007/978-3-540-89350-9_6
[18]
James Lewis and Jeff Sauro. 2018. Item benchmarks for the system usability scale. J. Usability Stud. 13 (5 2018), 158–167. Issue 3. https://doi.org/10.5555/3294033.3294037
[19]
Sebastiaan Mathôt, Daniel Schreij, and Jan Theeuwes. 2012. OpenSesame: An open-source, graphical experiment builder for the social sciences. Behav. Res. Methods 44 (6 2012), 314–324. Issue 2. https://doi.org/10.3758/s13428-011-0168-7
[20]
Jürgen Mottok, Florian Hauser, Lisa Grabinger, Timur Ezer, and Fabian Engl. 2024. An educational perspective on eye tracking in engineering sciences. In Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (Glasgow, United Kingdom) (ETRA ’24). ACM, New York, NY, USA, Article 66, 7 pages. https://doi.org/10.1145/3649902.3653945
[21]
Jakob Nielsen. 1994. Enhancing the explanatory power of usability heuristics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI 1994). ACM, New York, NY, USA, 152–158. https://doi.org/10.1145/191666.191729
[22]
Jonathan Peirce, Jeremy Gray, Sol Simpson, Michael MacAskill, Richard Höchenberger, Hiroyuki Sogo, Erik Kastman, and Jonas Lindelôv. 2019. PsychoPy2: Experiments in behavior made easy. Behav. Res. Methods 51 (2 2019), 195–203. Issue 1. https://doi.org/10.3758/s13428-018-01193-y
[23]
Bonita Sharif, Timothy Shaffer, Jenna Wise, and Jonathan Maletic. 2016. Tracking developers’ eyes in the IDE. IEEE Software 33 (5 2016), 105–108. Issue 3.
[24]
Benoît De Smet, Lorent Lempereur, Zohreh Sharafi, Yann Gaël Guéhéneuc, Giuliano Antoniol, and Naji Habra. 2014. TAUPE: visualizing and analyzing eye-tracking data. Sci. Comput. Program. 79 (1 2014), 260–278. Issue 1. https://doi.org/10.1016/j.scico.2012.01.004
[25]
Hiroyuki Sogo. 2013. GazeParser: An open-source and multiplatform library for low-cost eye tracking and analysis. Behav. Res. Methods 45 (9 2013), 684–695. Issue 3. https://doi.org/10.3758/s13428-012-0286-x
[26]
Adrian Voßkühler, Volkhard Nordmeier, Lars Kuchinke, and Arthur Jacobs. 2008. OGAMA (Open Gaze and Mouse Analyzer): Open-source software designed to analyze eye and mouse movements in slideshow study designs. Behav. Res. Methods 40 (11 2008), 1150–1162. Issue 4. https://doi.org/10.3758/BRM.40.4.1150
[27]
Carina Wong. 2022. How to Teach People A New Way Of Thinking: Buckminster Fuller Knows. https://medium.com/@CarinaWong1/how-to-teach-people-a-new-way-of-thinking-buckminster-fuller-knows-6c42dee956e1

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
MuC '24: Proceedings of Mensch und Computer 2024
September 2024
719 pages
ISBN:9798400709982
DOI:10.1145/3670653
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2024

Check for updates

Author Tags

  1. data analysis
  2. empirical research
  3. eye tracking
  4. statistics
  5. tool

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • BMBF

Conference

MuC '24
MuC '24: Mensch und Computer 2024
September 1 - 4, 2024
Karlsruhe, Germany

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 166
    Total Downloads
  • Downloads (Last 12 months)166
  • Downloads (Last 6 weeks)47
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media