Abstract
Eye tracking has become an increasingly important technology in many fields of research, such as marketing, human computer interaction, psychology, and also in human cognition. Understanding the human eye movements, while viewing specific scenarios, can be of great support for improving visual stimuli. However, the challenging problem with this kind of spatio-temporal data is to find quantitative links between eye movements and human cognition. This paper introduces the information channel based on saccade direction. The gaze transition between different saccade directions is modeled as a discrete information channel, which we call saccade direction information channel. The channel is applied to an eye-tracking dataset on Van Gogh’s paintings observation. In our results, horizontal saccades are more frequent than vertical saccades, and the information conveyed in horizontal/vertical displacements, measured as the mutual information of the channel, is higher than in diagonal displacements. By comparing the results to our previous spatial gaze channel between Areas of Interest (AOIs) we constate that the spatial channel discriminates better between the observed images, while the direction channel discriminates better between observers.
Supported by the National Natural Science Foundation of China under grant No. 61702359, and by Grant PID2019-106426RB-C31 funded by MCIN/AEI/10.13039/501100011033.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Noton, D., Stark, L.: Scanpaths in eye movements during pattern perception. Science 171(3968), 308–311 (1971)
Liman, T.G., Zangemeister, W.H.: Scanpath eye movements during visual mental imagery in a simulated hemianopia paradigm. J. Eye Mov. Res. 5(1), 308–311 (2012). https://doi.org/10.16910/jemr.5.1.2
Lévêque, L., Bosmans, H., Cockmartin, L., Liu, H.: State of the art: eye-tracking studies in medical imaging. IEEE Access 6, 37023–37034 (2018)
Huckauf, A., Urbina, M.H.: Object selection in gaze controlled systems: what you don’t look at is what you get. ACM Trans. Appl. Percept. 8(2), 1–14 (2011)
Silva, Y., Simoes, W., Naves, E., Filho, T., Lucena, V.: Teleoperation training environment for new users of electric powered wheelchairs based on multiple driving methods. IEEE Access 6, 55099–55111 (2018)
Breeden, K., Hanrahan, P.: Gaze data for the analysis of attention in feature films. ACM Trans. Appl. Percept. 14(4), 23 (2017)
Rienks, R., Poppe, R., Heylen, D.: Differences in head orientation behavior for speakers and listeners: an experiment in a virtual environment. ACM Trans. Appl. Percept. 7(1), 2 (2016)
van Wermeskerken, M., van Gog, T.: Seeing the instructor’s face and gaze in demonstration video examples affects attention allocation but not learning. Comput. Educ. 113, 98–107 (2017)
Was, C., Sansosti, F., Morris, B.: Eye-Tracking Technology Applications in Educational Research. IGI Global (2016). https://doi.org/10.4018/978-1-5225-1005-5
Ellis, E.M., Borovsky, A., Elman, J.L., Evans, J.L.: Novel word learning: an eye-tracking study. are 18-month-old late talkers really different from their typical peers? IEEE Trans. Affect. Comput. 58, 143–157 (2015)
Duchowski, A., Driver, J., Jolaoso, S., Tan, W., Ramey, B., Robbins, A.: Scanpath comparison revisited. In: Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications, pp. 219–226 (2010)
de Bruin, J.A., Malan, K.M., Eloff, J.H.P.: Saccade deviation indicators for automated eye tracking analysis. In: Proceedings of the 2013 Conference on Eye Tracking South, pp. 47–54 (2013)
Duchowski, A.T., Price, M.M., Meyer, M., Orero, P.: Aggregate gaze visualization with real-time heatmaps. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 13–20, June 2012
Sun, W., Chen, Z., Wu, F.: Visual scanpath prediction using IOR-ROI recurrent mixture density network. IEEE Trans. Pattern Anal. Mach. Intell. 43(6), 2101–2118 (2021)
Bao, W., Chen, Z.: Human scanpath prediction based on deep convolutional saccadic model. Neurocomputing 404(3), 154–164 (2020)
Zhang, A.T., Le Meur, B.O.: How old do you look? Inferring your age from your gaze. In: International Conference on Image Processing. Athènes, Greece, October 2018
Fuhl, W., et al.: Encodji: encoding gaze data into emoji space for an amusing scanpath classification approach; ). In: Proceedings of the 11th ACM Symposium on Eye Tracking Research and Applications. ETRA 2019. Association for Computing Machinery, New York (2019)
Ponsoda, V., Scott, D., Findlay, J.M.: A probability vector and transition matrix analysis of eye movements during visual search. Acta Physiol. (Oxf) 88(2), 167–185 (1995)
Tatler, B.W., Vincent, B.T.: Systematic tendencies in scene viewing. J. Eye Mov. Res. 2(2), 1–18 (2008)
Smith, T.J., Henderson, J.M.: Facilitation of return during scene viewing. In: Visual Cognition, vol. 17, pp. 1083–1108 (2009)
Ma, L., Sbert, M., Feixas, M.: Gaze information channel. In: Proceedings of Pacific Rim Conference on Multimedia, pp. 575–585 (2018)
Hao, Q., Ma, L., Sbert, M., Feixas, M., Zhang, J.: Gaze information channel in van Gogh’s paintings. Entropy 22(5), 540 (2020)
Hao, Q., Sbert, M., Ma, L.: Gaze information channel in cognitive comprehension of poster reading. Entropy 21(5), 444 (2019)
Le Meur, O., Liu, Z.: Saccadic model of eye movements for free-viewing condition. Vision. Res. 116, 152–164 (2015)
Foulsham, T., Kingstone, A.: Asymmetries in the direction of saccades during perception of scenes and fractals: effects of image type and image features. Vision. Res. 50(8), 779–795 (2010)
Ellis, S.R., Stark, L.: Statistical dependency in visual scanning. Hum. Factors 28(4), 421–438 (1986)
Besag, J., Mondal, D.: Exact goodness-of-fit tests for Markov chains. Biometrics 69(2), 488–496 (2013)
Krejtz, K., Szmidt, T., Duchowski, A.T., Krejtz, I.: Entropy-based statistical analysis of eye movement transitions. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 159–166 (2014)
Krejtz, K., et al.: Gaze transition entropy. ACM Trans. Appl. Percept. 13(1), 4 (2015)
Raptis, G.E., Fidas, C.A., Avouris, N.M.: On implicit elicitation of cognitive strategies using gaze transition entropies in pattern recognition tasks. In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1993–2000 (2017)
Shiferaw, B., Downey, L., Crewther, D.: A review of gaze entropy as a measure of visual scanning efficiency. Neurosci. Biobehav. Rev. 96, 353–366 (2019)
Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J. 27(3), 379–423 (1948)
Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley Series in Telecommunications. Wiley, Hoboken (1991)
Rigau, J., Feixas, M., Sbert, M.: Informational dialogue with van Gogh’s paintings. In: Computational Aesthetics in Graphics, Visualization, and Imaging. The Eurographics Association (2008)
Rigau, J., Feixas, M., Sbert, M., Wallraven, C.: Toward Auvers period: Evolution of van Gogh’s style. In: Computational Aesthetics, pp. 99–106 (2010)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hao, Q., Sbert, M., Feixas, M., Zhang, Y., Vila, M., Zhang, J. (2023). Saccade Direction Information Channel. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Lecture Notes in Computer Science, vol 13623. Springer, Cham. https://doi.org/10.1007/978-3-031-30105-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-30105-6_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-30104-9
Online ISBN: 978-3-031-30105-6
eBook Packages: Computer ScienceComputer Science (R0)