Abstract
Reading is a complex task that can provide valuable information about our perceptual and cognitive processes. To understand how people read, researchers have embraced the use of eye-tracking techniques. Recent research work studies the eye movements during reading of short sentences, and however, the extension of these findings to natural reading has not been yet studied in depth. The visual analysis of eye movement data has become an emerging field providing important means to support statistical analysis and hypothesis building. In this work, we focus on the visual analysis of the natural reading of a particular type of text, the micro-stories, which are short-length texts that condense a large amount of information. We present a novel visualization technique for analyzing eye movement data during the reading of micro-stories. In the design of the proposed technique, we consider all the characteristics defined for a typical reading experiment, integrating all of them into a single view. We also provide associated interactions to facilitate exploration. Our novel technique allows the analysis of eye movements during micro-story reading helping the experts to explore relationships among characteristics and to discover hidden relations that help to understand the cognitive process involved.
Graphical abstract
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bax S (2013) The cognitive processing of candidates during reading tests: evidence from eye-tracking. Lang Test 30(4):441–465. https://doi.org/10.1177/0265532212473244
Beymer D, Russell DM (2005) Webgazeanalyzer: a system for capturing and analyzing web reading behavior using eye gaze. In: CHI’05 extended abstracts on human factors in computing systems. ACM, pp 1913–1916. https://doi.org/10.1145/1056808.1057055
Biondi J, Fernandez G, Castro S, Agamennoni O (2018) Eye-movement behavior identification for ad diagnosis. J Integr Neurosci 17(4):349–354. https://doi.org/10.31083/j.jin.2018.04.0416
Blascheck T, Sharif B (2019) Visually analyzing eye movements on natural language texts and source code snippets. In: ETRA ’19: proceedings of the 11th ACM symposium on eye tracking research & applications. pp 1–9. https://doi.org/10.1145/3314111.3319917
Blascheck T, Raschke M, Ertl T (2013) Circular heat map transition diagram. In: Proceedings of the 2013 conference on eye tracking South Africa. ACM, pp 58–61. https://doi.org/10.1145/2509315.2509326
Blascheck T, Kurzhals K, Raschke M, Burch M, Weiskopf D, Ertl T (2014) State-of-the-art of visualization for eye tracking data. In: EuroVis (STARs). https://doi.org/10.2312/eurovisstar.20141173.063-082
Blascheck T, Schweizer M, Beck F, Ertl T (2017) Visual comparison of eye movement patterns. Comput Graph Forum 36(3):87–97. https://doi.org/10.1111/cgf.13170
Burch M (2022) Eye Tracking and visual analytics. River Publishers Information S, River Publishers. https://books.google.com.ar/books?id=rbGjzgEACAAJ
Burch M, Weiskopf D (2014) On the benefits and drawbacks of radial diagrams. Handbook of human centric visualization. Springer, New York, pp 429–451
Burch M, Bott F, Beck F, Diehl S (2008) Cartesian vs. radial–a comparative evaluation of two visualization tools. In: International symposium on visual computing. Springer, pp 151–160. https://doi.org/10.1007/978-3-540-89639-5_15
Burch M, Wallner G, Broeks N, Piree L, Boonstra N, Vlaswinkel P, Franken S, Van Wijk V (2021) The power of linked eye movement data visualizations. In: ACM symposium on eye tracking research and applications. pp 1–11
Chen S, Epps J, Ruiz N, Chen F (2011) Eye activity as a measure of human mental effort in hci. In: Proceedings of the 16th international conference on Intelligent user interfaces. pp 315–318. https://doi.org/10.1145/1943403.1943454
Draper GM, Livnat Y, Riesenfeld RF (2009) A survey of radial methods for information visualization. IEEE Trans Vis Comput Graph 15(5):759–776. https://doi.org/10.1109/TVCG.2009.23
Fernández G, Biondi J, Castro S, Agamenonni O (2016) Pupil size behavior during online processing of sentences. J Integr Neurosci 15(04):485–496. https://doi.org/10.1142/S0219635216500266
Flück D (2020) Coblis-color blindness simulator. https://www.color-blindness.com/coblis-color-blindness-simulator/
Goldberg JH, Helfman JI (2010) Scanpath clustering and aggregation. In: Proceedings of the 2010 symposium on eye-tracking research & applications. ACM, pp 227–234 https://doi.org/10.1145/1743666.1743721
Goldberg JH, Kotval XP (1999) Computer interface evaluation using eye movements: methods and constructs. Int J Ind Ergon 24(6):631–645. https://doi.org/10.1016/S0169-8141(98)00068-7
Holmqvist K, Nyström M, Andersson R, Dewhurst R, Jarodzka H, Van de Weijer J (2011) Eye tracking: a comprehensive guide to methods and measures. OUP Oxford, Oxford
Hyönä J, Kaakinen JK (2019) Eye movements during reading. Eye movement research. Springer, New York, pp 239–274
Hyönä J, Nurminen AM (2006) Do adult readers know how they read? Evidence from eye movement patterns and verbal reports. Br J Psychol 97(1):31–50. https://doi.org/10.1348/000712605X53678
Hyönä J, Lorch RF Jr, Rinck M (2003) Eye movement measures to study global text processing. The Mind’s Eye. Elsevier, Hoboken, pp 313–334
Just MA, Carpenter PA (1993) The intensity dimension of thought: pupillometric indices of sentence processing. Can J Exp Psychol 47(2):310. https://doi.org/10.1037/h0078820
Kim M, Draper GM (2014) Radial vs. cartesian revisited: a comparison of space-filling visualizations. In: Proceedings of the 7th international symposium on visual information communication and interaction. pp 196–199. https://doi.org/10.1145/2636240.2636871
Kliegl R (2007) Toward a perceptual-span theory of distributed processing in reading: a reply to rayner, pollatsek, drieghe, slattery, and reichle. J Exp Psychol Gen 136(3):530. https://doi.org/10.1037/0096-3445.136.3.530
Kumar A, Netzel R, Burch M, Weiskopf D, Mueller K (2016) Multi-similarity matrices of eye movement data. In: 2016 IEEE second workshop on eye tracking and visualization (ETVIS). IEEE, pp 26–30. https://doi.org/10.1109/ETVIS.2016.7851161
Leckner S (2012) Presentation factors affecting reading behaviour in readers of newspaper media: an eye-tracking perspective. Vis Commun 11(2):163–184. https://doi.org/10.1177/1470357211434029
López A, Conde X (2012) Cyber-literature, micro-stories and their exploitation. Ars Aeterna 4(1):1–16
Lorigo L, Haridasan M, Brynjarsdóttir H, Xia L, Joachims T, Gay G, Granka L, Pellacini F, Pan B (2008) Eye tracking and online search: lessons learned and challenges ahead. J Am Soc Inf Sci Technol 59(7):1041–1052. https://doi.org/10.1002/asi.20794
Lou Y, Liu Y, Kaakinen JK, Li X (2017) Using support vector machines to identify literacy skills: evidence from eye movements. Behav Res Methods 49(3):887–895. https://doi.org/10.3758/s13428-016-0748-7
Mackworth JF, Mackworth N (1958) Eye fixations recorded on changing visual scenes by the television eye-marker. JOSA 48(7):439–445. https://doi.org/10.1364/JOSA.48.000439
Noton D, Stark L (1971) Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vis Res 11(9):929. https://doi.org/10.1016/0042-6989(71)90213-6
Parker AJ, Slattery TJ (2019) Word frequency, predictability, and return-sweep saccades: towards the modeling of eye movements during paragraph reading. J Exp Psychol Hum Percept Perform 45(12):1614. https://doi.org/10.1037/xhp0000694
Peterson CS, Saddler JA, Blascheck T, Sharif B (2019) Visually analyzing students’ gaze on c++ code snippets. In: Proceedings of the 6th international workshop on eye movements in programming. IEEE Press, pp 18–25. https://doi.org/10.1109/EMIP.2019.00011
Raney GE, Campbell SJ, Bovee JC (2014) Using eye movements to evaluate the cognitive processes involved in text comprehension. J Vis Exp 83:e50780. https://doi.org/10.3791/50780
Rayner K (1998) Eye movements in reading and information processing: 20 years of research. Psychol Bull 124(3):372. https://doi.org/10.1037/0033-2909.124.3.372
Rayner K (2009) Eye movements in reading: models and data. J Eye Mov Res 2(5):1
Rayner K, Kambe G, Duffy SA (2000) The effect of clause wrap-up on eye movements during reading. Q J Exp Psychol Sect A 53(4):1061–1080. https://doi.org/10.1080/713755934
Rayner K, Cook AE, Juhasz BJ, Frazier L (2006) Immediate disambiguation of lexically ambiguous words during reading: evidence from eye movements. Br J Psychol 97(4):467–482. https://doi.org/10.1348/000712605X89363
Reichle ED, Rayner K, Pollatsek A (2003) The ez reader model of eye-movement control in reading: comparisons to other models. Behav Brain Sci 26(4):445–476
Van der Schoot M, Vasbinder AL, Horsley TM, Reijntjes A, van Lieshout EC (2009) Lexical ambiguity resolution in good and poor comprehenders: an eye fixation and self-paced reading study in primary school children. J Educ Psychol 101(1):21
Schotter ER, Tran R, Rayner K (2014) Don’t believe what you read (only once) comprehension is supported by regressions during reading. Psychol Sci 25(6):1218–1226. https://doi.org/10.1177/0956797614531148
Špakov O, Siirtola H, Istance H, Räihä KJ (2017) Visualizing the reading activity of people learning to read. J Eye Mov Res 10(5):1–12. https://doi.org/10.16910/JEMR.10.5.5
Tang S, Reilly RG, Vorstius C (2012) Eyemap: a software system for visualizing and analyzing eye movement data in reading. Behav Res Methods 44(2):420–438. https://doi.org/10.3758/s13428-011-0156-y
Valls F (2008) Soplando vidrio: y otros estudios sobre el microrrelato español, vol 108. Páginas de espuma
van der Wel P, van Steenbergen H (2018) Pupil dilation as an index of effort in cognitive control tasks: a review. Psychon Bull Rev 25(6):2005–2015. https://doi.org/10.3758/s13423-018-1432-y
Yang CK, Wacharamanotham C (2018) Alpscarf: Augmenting scarf plots for exploring temporal gaze patterns. In: Extended abstracts of the 2018 CHI Conference on human factors in computing systems. ACM, p LBW503 https://doi.org/10.1145/3170427.3188490
Yi JS, Ah Kang Y, Stasko J, Jacko JA (2007) Toward a deeper understanding of the role of interaction in information visualization. IEEE Trans Vis Comput Graph 13(6):1224–1231
Zagermann J, Pfeil U, Reiterer H (2016) Measuring cognitive load using eye tracking technology in visual computing. In: Proceedings of the sixth workshop on beyond time and errors on novel evaluation methods for visualization. ACM, pp 78–85. https://doi.org/10.1145/2993901.2993908
Zhan Z, Zhang L, Mei H, Fong PS (2016) Online learners’ reading ability detection based on eye-tracking sensors. Sensors 16(9):1457. https://doi.org/10.3390/s16091457
Zimmerman C, Gerson S, Monroe A, Kearney A (2007) Physics is harder than psychology... or is it?: Developmental differences in calibration of domain-specific texts. In: Proceedings of the annual meeting of the cognitive science society, vol. 29
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Luque, L., Ganuza, M.L., Castro, S.M. et al. Visual analysis of eye movements during micro-stories reading. J Vis 25, 1085–1101 (2022). https://doi.org/10.1007/s12650-022-00845-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12650-022-00845-8