skip to main content
10.1145/3593663.3593683acmotherconferencesArticle/Chapter ViewAbstractPublication PagesecseeConference Proceedingsconference-collections
short-paper

The Expert’s View: Eye Movement Modeling Examples in Software Engineering Education

Published: 19 June 2023 Publication History

Abstract

This study investigates the impact of eye movement modeling examples in Software Engineering education. Software Engineering is a highly visual domain. The daily tasks of a software engineer (e.g., formulating requirements, creating UML diagrams, or conducting a code review) require in many cases the use of certain visual strategies. Although these strategies can be found for experts, it has been observed in different eye tracking studies that students have difficulties in learning and applying them. To familiarize students with these visual strategies and to provide them with a better understanding for the cognitive processes involved, a total of seven eye movement modeling examples was created. The seven eye movement modeling examples cover relevant parts of an introductory Software Engineering lecture; they are focused on typical situations in which visual strategies are applied. The results of a questionnaire-based evaluation shows that students consider the eye movement modeling examples as useful, feel supported in their learning process, and would like to see more use of them in the Software Engineering lecture. Furthermore, the students suggested that eye movement modeling examples should also be used in other lectures.

References

[1]
Roman Bednarik, Carsten Schulte, Lea Budde, Birte Heinemann, and Hana Vrzakova. 2018. Eye-movement Modeling Examples in Source Code Comprehension. In Proceedings of the 18th ACM Koli Calling. Koli, 1–8. https://doi.org/10.1145/3279720.3279722
[2]
Andrew Begel and Hana Vrzakova. 2018. Eye movements in code review. In Proceedings of the Workshop on Eye Movements in Programming (EMIP). ACM, Warsaw, 1–5. https://doi.org/10.1145/3216723.3216727
[3]
Teresa Busjahn, Roman Bednarik, Andrew Begel, Martha Crosby, James H. Paterson, Carsten Schulte, Bonita Sharif, and Sascha Tamm. 2015. Eye Movements in Code Reading: Relaxing the Linear Order. In Proceedings of the 23rd IEEE International Conference on Program Comprehension (ICPC). IEEE, Florence, 255–265. https://doi.org/10.1109/ICPC.2015.36
[4]
Selina N. Emhardt, Ellen Kok, Tamara van Gog, Saskia Brandt-Gruwel, Tim van Marlen, and Halszka Jarodzka. 2023. Visualizing a Task Performer’s Gaze to Foster Observers’ Performance and Learning—a Systematic Literature Review on Eye Movement Modeling Examples. Educational Psychology Review 35, 1 (mar 2023), 23. https://doi.org/10.1007/s10648-023-09731-7
[5]
Andreas Gegenfurtner, Erno Lehtinen, and Roger Säljö. 2011. Expertise Differences in the Comprehension of Visualizations: A Meta-Analysis of Eye-Tracking Research in Professional Domains. Educational Psychology Review 23, 4 (2011), 523–552. https://doi.org/10.1007/s10648-011-9174-7
[6]
Andreas Gegenfurtner and Jeroen J G Van Merriënboer. 2017. Methodologies for Studying Visual Expertise. Frontline Learning Research 5, 3 (2017), 1–13. https://doi.org/10.14786/flr.v5i3.316
[7]
Florian Hauser, Lisa Grabinger, and Jürgen Mottok. 2023. Visual Expertise in Code Reviews - Using Holistic Models of Image Perception to Analyze and Interpret Eye Movements. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA). ACM, Tübingen, Germany.
[8]
Florian Hauser, Rebecca Reuter, Andreas Gegenfurtner, Hans Gruber Gruber, and Jürgen Mottok. 2019. Eye movements in software modelling - What do they tell us about heuristics?. In Proceedings of the International Conference of Education, Research and Innovation (ICERI). IATED Academy, Seville, 6064–6070. https://doi.org/10.21125/iceri.2019.1469
[9]
Florian Hauser, Rebecca Reuter, Ivonne Hutzler, Jürgen Mottok, and Hans Gruber. 2018. Eye Movements in Software Engineering - What Differs the Expert From the Novice?. In Proceedings of the International Conference of Education, Research and Innovation (ICERI). IATED Academy, Seville, 632–642. https://doi.org/10.21125/iceri.2018.1129
[10]
Florian Hauser, Stefan Schreistetter, Rebecca Reuter, Jurgen Horst Mottok, Hans Gruber, Kenneth Holmqvist, and Nick Schorr. 2020. Code Reviews in C++. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA). ACM, Stuttgart, 1–5. https://doi.org/10.1145/3379156.3391980
[11]
Ivonne Hutzler, Florian Hauser, Rebecca Reuter, Jürgen Mottok, and Hans Gruber. 2018. Will the Noun/Verb Analysis Be Used To Generate Class Diagrams? an Eye Tracking Study. In Proceedings of the International Conference of Education, Research and Innovation (ICERI). IATED Academy, Seville, 505–514. https://doi.org/10.21125/iceri.2018.1103
[12]
Halszka Jarodzka, Thomas Balslev, Kenneth Holmqvist, Marcus Nyström, Katharina Scheiter, Peter Gerjets, and Berit Eika. 2012. Conveying clinical reasoning based on visual observation via eye-movement modelling examples. Instructional Science 40, 5 (sep 2012), 813–827. https://doi.org/10.1007/s11251-012-9218-5
[13]
Halszka Jarodzka, Kenneth Holmqvist, and Hans Gruber. 2017. Eye tracking in Educational Science: Theoretical frameworks and research agenda. Journal of Eye Movement Research 10, 1 (2017), 1–18.
[14]
David Jonassen. 1999. Designing Constructivist Learning Environments. In Instructional design theories and models: A new paradigm of instructional theory, C. Reigeluth (Ed.). Lawrence Erlbaum Associates, Mahwah, Chapter 10, 215–239.
[15]
M. David Merrill. 2002. First principles of instruction. Educational Technology Research and Development 50, 3 (sep 2002), 43–59. https://doi.org/10.1007/BF02505024
[16]
Markus Nivala, Florian Hauser, Jurgen Mottok, and Hans Gruber. 2016. Developing visual expertise in software engineering: An eye tracking study. In Proceedings of the Global Engineering Education Conference (EDUCON). IEEE, Abu Dhabi, 613–620. https://doi.org/10.1109/EDUCON.2016.7474614
[17]
Unaizah Obaidellah, Mohammed Al Haek, and Peter C.-H. Cheng. 2018. A Survey on the Usage of Eye-Tracking in Computer Programming. Comput. Surveys 51, 1 (jan 2018), 1–58. https://doi.org/10.1145/3145904
[18]
Rebecca Reuter, Theresa Stark, Yvonne Sedelmaier, Dieter Landes, Jurgen Mottok, and Christian Wolff. 2020. Insights in students’ problems during UML modeling. Proceedings of the Global Engineering Education Conference (EDUCON) 2020-April (2020), 592–600. https://doi.org/10.1109/EDUCON45650.2020.9125110
[19]
Zohreh. Sharafi, Zéphyrin Soh, and Yann-Gaël Guéhéneuc. 2015. A systematic literature review on the usage of eye-tracking in software engineering. Information and Software Technology 67, 7 (2015), 79–107. https://doi.org/10.1016/j.infsof.2015.06.008
[20]
Bonita Sharif, Michael Falcone, and Jonathan I Maletic. 2012. An eye-tracking study on the role of scan time in finding source code defects. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA). ACM Press, New York, New York, 381. https://doi.org/10.1145/2168556.2168642
[21]
Heather Sheridan and Eyal M. Reingold. 2017. The holistic processing account of visual expertise in medical image perception: A review. Frontiers in Psychology 8 (2017), 1–11. https://doi.org/10.3389/fpsyg.2017.01620
[22]
Theresa Stark. 2021. Learning from Eye Movement Modelling Examples : Effects on Performance and Visual Behaviour University of Regensburg Faculty of Human Sciences Department of Educational Science. Master Thesis. University of Regensburg.
[23]
Hidetake Uwano, Masahide Nakamura, Akito Monden, and Ken-ichi Matsumoto. 2006. Analyzing Individual Performance of Source Code Review Using Reviewers’ Eye Movement. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA). ACM, San Diego, CA, 133–140. https://doi.org/10.1145/1117309.1117357
[24]
Tamara van Gog, Halszka Jarodzka, Katharina Scheiter, Peter Gerjets, and Fred Paas. 2009. Attention guidance during example study via the model’s eye movements.Computers in Human Behavior 25 (2009), 785–791.
[25]
Tamara van Gog and Nikol Rummel. 2010. Example-Based Learning: Integrating Cognitive and Social-Cognitive Research Perspectives. Educational Psychology Review 22, 2 (jun 2010), 155–174. https://doi.org/10.1007/s10648-010-9134-7
[26]
Tim van Marlen, Margot van Wermeskerken, Halszka Jarodzka, and Tamara van Gog. 2016. Showing a model’s eye movements in examples does not improve learning of problem-solving tasks. Computers in Human Behavior 65 (2016), 448–459. https://doi.org/10.1016/j.chb.2016.08.041

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ECSEE '23: Proceedings of the 5th European Conference on Software Engineering Education
June 2023
264 pages
ISBN:9781450399562
DOI:10.1145/3593663
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Software engineering education
  2. expertise
  3. eye movement modeling examples
  4. eye tracking
  5. instructional design

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Funding Sources

  • German Federal Ministry of Education and Research - HASKI
  • German Federal Ministry of Education and Research - Eyes on Future
  • German Federal Ministry of Education and Research and DLR - EVELIN

Conference

ECSEE 2023

Acceptance Rates

Overall Acceptance Rate 11 of 16 submissions, 69%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 63
    Total Downloads
  • Downloads (Last 12 months)26
  • Downloads (Last 6 weeks)3
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media