skip to main content
10.1145/3306500.3306584acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesic4eConference Proceedingsconference-collections
research-article

Characteristics of visual attention for the assessment of conceptual change: an eye-tracking study

Published: 10 January 2019 Publication History

Abstract

Conceptual change is one of the core goals in science education, meanwhile an effective assessment to it is indispensable. However, the assessment is in difficulties on account of the heavy workload of traditional methods for teachers and long feedback time for students. An online assessment system with a function to track students' visual attention was proposed to solve this dilemma. This study investigated the characteristics of visual attention of 'conceptual change group' (CCG) and 'non-conceptual change group' (NCCG) when solving a task involving misconceptions, which laid a foundation for realizing this ideal. A mixed design with two-factor repeated-measures analysis of variance and heatmap analyses were used to study the static characteristics of visual attention distributions. Lag sequential analyses were performed to explore the dynamic characteristics of visual attention transactions among areas of interest (AOIs). The results showed that visual attention is located more on the areas relevant to scientific conception in the CCG, while visual attention was located more on areas relevant to the misconception in the NCCG. When students faced information differing from their own conceptions, visual attention transactions between the information and the out-of-AOI area were two-way. When students faced information that was consistent with their own conceptions, visual attention transactions between the information and the out-of-AOI area were one-way. These differences in characteristics of visual attention between the CCG and the NCCG arise from the differences in conceptual change between them, so combining the static and dynamic visual attention characteristics can provide us with the basis on eye movement for online assessment of conceptual change.

References

[1]
Bakeman, R. and Quera, V., 1995. Analyzing interaction: Sequential analysis with SDIS and GSEQ. Cambridge University Press, New York.
[2]
Carmi, R. and Itti, L., 2006. Visual causes versus correlates of attentional selection in dynamic scenes. Vision Research 46, 26 (Dec), 4333--4345.
[3]
Clement, J., 1982. Students' preconceptions in introductory mechanics. American Journal of Physics 50, 1, 66--71.
[4]
Duit, R. and Treagust, D.F., 2012. How Can Conceptual Change Contribute to Theory and Practice in Science Education? In Second International Handbook of Science Education, J.B. FRASER, K. TOBIN and J.C. MCROBBIE Eds. Springer Netherlands, Dordrecht, 107--118.
[5]
Dunbar, K.N., Fugelsang, J.A., and Stein, C., 2007. Do Naïve Theories Ever Go Away? Using Brain and Behavior to Understand Changes in Concepts. In Proceedings of the Thinking with data:33rd Carnegie Symposium on Cognition (Mahwah, New Jersey 2007), Lawrence Erlbaum Associates 193--206.
[6]
Goldberg, J.H. and Helfman, J.I., 2010. Scanpath clustering and aggregation. In Proceedings of the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (Austin, Texas 2010), ACM, 1743721, 227--234.
[7]
Holmqvist, K., Nystr M, M., Andersson, R., Dewhurst, R., Jarodzka, H., and Van De Weijer, J., 2011. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, Oxford.
[8]
Jarodzka, H., Scheiter, K., Gerjets, P., and Van Gog, T., 2010. In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction 20, 2 (Apr), 146--154.
[9]
Lelliott, A. and Rollnick, M., 2010. Big Ideas: A review of astronomy education research 1974--2008. International Journal of Science Education 32, 13, 1771--1799.
[10]
Lindner, M.A., Eitel, A., Thoma, G.B., Dalehefte, I.M., Ihme, J.M., and Koller, O., 2014. Tracking the Decision-Making Process in Multiple-Choice Assessment: Evidence from Eye Movements. Applied Cognitive Psychology 28, 5 (Sep-Oct), 738--752.
[11]
Madsen, A.M., Larson, A.M., Loschky, L.C., and Rebello, N.S., 2012. Differences in visual attention between those who correctly and incorrectly answer physics problems. Physical Review Special Topics-Physics Education Research 8, 1 (May 11).
[12]
Peirce, C.S., 1877. The fixation of belief. Popular Science Monthly 12, 1--15.
[13]
Peterson, R.F. and Treagust, D.F., 1989. GRADE-12 STUDENTS MISCONCEPTIONS OF COVALENT BONDING AND STRUCTURE. Journal of Chemical Education 66, 6 (Jun), 459--460.
[14]
Potvin, P., Masson, S., Lafortune, S., and Cyr, G., 2015. PERSISTENCE OF THE INTUITIVE CONCEPTION THAT HEAVIER OBJECTS SINK MORE: A REACTION TIME STUDY WITH DIFFERENT LEVELS OF INTERFERENCE. International Journal of Science and Mathematics Education 13, 1 (Feb), 21--43.
[15]
Rayner, K., 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 85, 3, 618--660.
[16]
Trumper, R., 2006. Teaching future teachers basic astronomy concepts - Seasonal changes - At a time of reform in science education. Journal of Research in Science Teaching 43, 9 (Nov), 879--906.
[17]
Tsai, M.-J., Hou, H.-T., Lai, M.-L., Liu, W.-Y., and Yang, F.-Y., 2012. Visual attention for solving multiple-choice science problem: An eye-tracking analysis. Computers & Education 58, 1 (Jan), 375--385.
[18]
Tsai, M.-J., Huang, L.-J., Hou, H.-T., Hsu, C.-Y., and Chiou, G.-L., 2016. Visual behavior, flow and achievement in game-based learning. Computers & Education 98(Jul), 115--129.
[19]
Yang, F.Y., Chang, C.Y., Chien, W.R., Chien, Y.T., and Tseng, Y.H., 2013. Tracking learners' visual attention during a multimedia presentation in a real classroom. Computers & Education 62(Mar), 208--220.

Index Terms

  1. Characteristics of visual attention for the assessment of conceptual change: an eye-tracking study

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      IC4E '19: Proceedings of the 10th International Conference on E-Education, E-Business, E-Management and E-Learning
      January 2019
      469 pages
      ISBN:9781450366021
      DOI:10.1145/3306500
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 10 January 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. assessment
      2. conceptual change
      3. eye-tracking
      4. visual attention

      Qualifiers

      • Research-article

      Funding Sources

      • Natural Science Foundation of China

      Conference

      IC4E 2019

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 132
        Total Downloads
      • Downloads (Last 12 months)16
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 03 Mar 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media