short-paper

Evaluating similarity measures for gaze patterns in the context of representational competence in physics education

Authors:

Saleh Mozaffari,

Andreas DengelAuthors Info & Claims

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

Article No.: 51, Pages 1 - 5

https://doi.org/10.1145/3204493.3204564

Published: 14 June 2018 Publication History

Abstract

The competent handling of representations is required for understanding physics' concepts, developing problem-solving skills, and achieving scientific expertise. Using eye-tracking methodology, we present the contributions of this paper as follows: We first investigated the preferences of students with the different levels of knowledge; experts, intermediates, and novices, in representational competence in the domain of physics problem-solving. It reveals that experts more likely prefer to use vector than other representations. Besides, a similar tendency of table representation usage was observed in all groups. Also, diagram representation has been used less than others. Secondly, we evaluated three similarity measures; Levenshtein distance, transition entropy, and Jensen-Shannon divergence. Conducting Recursive Feature Elimination technique suggests Jensen-Shannon divergence is the best discriminating feature among the three. However, investigation on mutual dependency of the features implies transition entropy mutually links between two other features where it has mutual information with Levenshtein distance (Maximal Information Coefficient = 0.44) and has a correlation with Jensen-Shannon divergence (r(18313) = 0.70, p < .001).

References

[1]

Jennifer L Docktor and José P Mestre. 2014. Synthesis of discipline-based education research in physics. Physical Review Special Topics-Physics Education Research 10, 2 (2014), 020119.

[2]

Robert J Dufresne, William J Gerace, and William J Leonard. 1997. Solving physics problems with multiple representations. Physics Teacher 35 (1997), 270--275.

[3]

Ronald Fedkiw, Jos Stam, and Henrik Wann Jensen. 2001. Visual simulation of smoke. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, 15--22.

Digital Library

[4]

Isabelle Guyon, Jason Weston, Stephen Barnhill, and Vladimir Vapnik. 2002. Gene selection for cancer classification using support vector machines. Machine learning 46, 1--3 (2002), 389--422.

Digital Library

[5]

Patricia Heller and Mark Hollabaugh. 1992. Teaching problem solving through cooperative grouping. Part 2: Designing problems and structuring groups. American journal of Physics 60, 7 (1992), 637--644.

[6]

Kenneth Holmqvist, Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van de Weijer. 2011. Eye tracking: A comprehensive guide to methods and measures. OUP Oxford.

[7]

Ignace TC Hooge and Guido Camps. 2013. Scan path entropy and arrow plots: Capturing scanning behavior of multiple observers. Frontiers in Psychology 4 (2013), 996.

[8]

Shoya Ishimaru, Syed Saqib Bukhari, Carina Heisel, Nicolas Großmann, Pascal Klein, Jochen Kuhn, and Andreas Dengel. 2018. Augmented Learning on Anticipating Textbooks with Eye Tracking. In Positive Learning in the Age of Information. Springer, 387--398.

[9]

Halszka Jarodzka, Katharina Scheiter, Peter Gerjets, and Tamara Van Gog. 2010. In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction 20, 2 (2010), 146--154.

[10]

Daniel J Jobson, Zia-ur Rahman, and Glenn A Woodell. 1996. Retinex image processing: Improved fidelity to direct visual observation. In Color and Imaging Conference, Vol. 1996. Society for Imaging Science and Technology, 124--125.

[11]

Daniel Aaron Kartch and Donald P Greenberg. 2000. Efficient rendering and compression for full-parallax computer-generated holographic stereograms. Citeseer.

[12]

Justin B Kinney and Gurinder S Atwal. 2014. Equitability, mutual information, and the maximal information coefficient. Proceedings of the National Academy of Sciences 111, 9 (2014), 3354--3359.

[13]

Pascal Klein, Jouni Viiri, Saleh Mozaffari, Andreas Dengel, and Jochen Kuhn. 2018. Instruction-based clinical eye-tracking study on the visual interpretation of divergence: How do students look at vector field plots? Physical Review Physics Education Research 14, 1 (2018), 010116.

[14]

Patrick B Kohl and Noah D Finkelstein. 2005. Student representational competence and self-assessment when solving physics problems. Physical Review Special Topics-Physics Education Research 1, 1 (2005), 010104.

[15]

Patrick B Kohl and Noah D Finkelstein. 2006. Effects of representation on students solving physics problems: A fine-grained characterization. Physical Review Special Topics-Physics Education Research 2, 1 (2006), 010106.

[16]

K. Krejtz, T. Szmidtand A. Duchowski, and I. Krejtz. 2014. Entropy-based statistical analysis of eye movement transitions. In Proceedings of the Symposium on Eye Tracking Research and Applications. ACM, 159--166.

Digital Library

[17]

Vladimir I Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. In Soviet physics doklady, Vol. 10. 707--710.

[18]

David E Meltzer. 2005. Relation between studentsâĂ&Zacute; problem-solving performance and representational format. American journal of physics 73, 5 (2005), 463--478.

[19]

Saleh Mozaffari, Syed Saqib Bukhari, and Andreas Dengel. 2015. Analysis of text layout quality using wearable eye trackers. In Multimedia & Expo Workshops (ICMEW), 2015 IEEE International Conference on. IEEE, 1--6.

[20]

Saleh Mozaffari, Syed Saqib Bukhari, and Andreas Dengel. 2016a. eyeReading: Interaction with Text through Eyes. In Proceedings of The Ninth International Conference on Mobile Computing and Ubiquitous Networking, Vol. 2016. 1--2.

[21]

Saleh Mozaffari, Pascal Klein, Mohammad Al-Naser, Syed Saqib Bukhari, Jochen Kuhn, and Andreas Dengel. 2016b. A Study on Representational Competence in Physics Using Mobile Eye Tracking Systems. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, 1029--1032.

Digital Library

[22]

Saleh Mozaffari, Pascal Klein, Syed Saqib Bukhari, Jochen Kuhn, and Andreas Dengel. 2016c. Entropy based transition analysis of eye movement on physics representational competence. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 1027--1034.

Digital Library

[23]

Pasi Nieminen, Antti Savinainen, and Jouni Viiri. 2010. Force Concept Inventory-based multiple-choice test for investigating studentsâĂ&Zacute; representational consistency., 020109 pages.

[24]

Frederic I Parke and Keith Waters. 2008. Computer facial animation. CRC Press.

Digital Library

[25]

Fabio Pellacini, Kiril Vidimče, Aaron Lefohn, Alex Mohr, Mark Leone, and John Warren. 2005. Lpics: a hybrid hardware-accelerated relighting engine for computer cinematography. In ACM Transactions on Graphics (TOG), Vol. 24. ACM, 464--470.

Digital Library

[26]

Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychological bulletin 124, 3 (1998), 372.

[27]

Alan Van Heuvelen. 1991. Learning to think like a physicist: A review of research-based instructional strategies. American Journal of physics 59, 10 (1991), 891--897.

[28]

Alan Van Heuvelen and Xueli Zou. 2001. Multiple representations of work-energy processes. American Journal of Physics 69 (2001), 184--194.

[29]

Hector Yee, Sumanita Pattanaik, and Donald P Greenberg. 2001. Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments. ACM Transactions on Graphics (TOG) 20, 1 (2001), 39--65.

Digital Library

[30]

Jiaje Zhang and Donald A Norman. 1994. Representations in distributed cognitive tasks. Cognitive science 18, 1 (1994), 87--122.

Cited By

Zajenkowska ABodecka-Zych MDuda EGagnon JKrejtz K(2024)“The way I see it makes me believe you intentionally did it”: Intentionality ascription and gaze transition entropy in violent offendersBiological Psychology10.1016/j.biopsycho.2024.108962(108962)Online publication date: Dec-2024
https://doi.org/10.1016/j.biopsycho.2024.108962
Qu-Lee JSeidel BHarel DGranot YBalcetis E(2022)The relationship between visual confirmation bias, belief consistency, and belief polarizationComprehensive Results in Social Psychology10.1080/23743603.2022.20262146:1-3(1-38)Online publication date: 10-May-2022
https://doi.org/10.1080/23743603.2022.2026214
Sood ETannert SMüller PBulling ALarochelle HRanzato MHadsell RBalcan MLin H(2020)Improving natural language processing tasks with human gaze-guided neural attentionProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496255(6327-6341)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3496255
Show More Cited By

Index Terms

Evaluating similarity measures for gaze patterns in the context of representational competence in physics education
1. Information systems
  1. Information retrieval
    1. Document representation
      1. Content analysis and feature selection
    2. Retrieval tasks and goals
      1. Clustering and classification
      2. Information extraction
2. Social and professional topics
  1. Professional topics
    1. Computing education
      1. Student assessment

Recommendations

Entropy based transition analysis of eye movement on physics representational competence
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

In this paper, we have conducted an eye tracking experiment by employing an inexpensive, lightweight, and portable eye tracker paired with a tablet. Students were instructed to solve the physics problems by presenting them three coherent representations ...
A study on representational competence in physics using mobile eye tracking systems
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

In this paper, we have conducted an eye tracking experiment by employing an inexpensive, lightweight, and portable eye tracker paired with a tablet. Students were instructed to solve the physics problems by presenting them three coherent representations ...
When Similarity Measures Lie
SISAP 2015: Proceedings of the 8th International Conference on Similarity Search and Applications - Volume 9371

Do similarity or distance measures ever go wrong? The inherent subjectivity in similarity discernment has long supported the view that all judgements of similarity are equally valid, and that any selected similarity measure may only be considered more ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '18: Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications

June 2018

595 pages

ISBN:9781450357067

DOI:10.1145/3204493

Conference Chairs:
Bonita Sharif
Youngstown State University
,
Krzysztof Krejtz
University of Social Sciences and Humanities, Warsaw, Poland

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ETRA '18

Sponsor:

ETRA '18: 2018 Symposium on Eye Tracking Research and Applications

June 14 - 17, 2018

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Sponsor:
sigchi
sigchi

2025 Symposium on Eye Tracking Research and Applications

May 26 - 29, 2025

Tokyo , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
220
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)7

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zajenkowska ABodecka-Zych MDuda EGagnon JKrejtz K(2024)“The way I see it makes me believe you intentionally did it”: Intentionality ascription and gaze transition entropy in violent offendersBiological Psychology10.1016/j.biopsycho.2024.108962(108962)Online publication date: Dec-2024
https://doi.org/10.1016/j.biopsycho.2024.108962
Qu-Lee JSeidel BHarel DGranot YBalcetis E(2022)The relationship between visual confirmation bias, belief consistency, and belief polarizationComprehensive Results in Social Psychology10.1080/23743603.2022.20262146:1-3(1-38)Online publication date: 10-May-2022
https://doi.org/10.1080/23743603.2022.2026214
Sood ETannert SMüller PBulling ALarochelle HRanzato MHadsell RBalcan MLin H(2020)Improving natural language processing tasks with human gaze-guided neural attentionProceedings of the 34th International Conference on Neural Information Processing Systems10.5555/3495724.3496255(6327-6341)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.5555/3495724.3496255
Mozaffari SKlein PAl-Naser MKüchemann SKuhn JWidmann TDengel A(2020)Quantifying Gaze-Based Strategic Patterns in Physics Vector Field DivergenceAgents and Artificial Intelligence10.1007/978-3-030-71158-0_22(465-481)Online publication date: 22-Feb-2020
https://dl.acm.org/doi/10.1007/978-3-030-71158-0_22

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten