Abstract
Two experiments examined the eye movements made when remembering pictures of real-world objects and scenes, and when those images are imagined rather than inspected. In Experiment 1 arrays of simple objects were first shown, and eye movements used to indicate the location of an object declared as having been present in the array. Experiment 2 investigated the similarity of eye fixation scanpaths between the initial encoding of a picture of a real-world scene and a second viewing of a picture and when trying to imagine that picture using memory. Closer similarities were observed between phases that involved more similar tasks, and the scanpaths were just as similar when the task was presented immediately or after two days. The possibility raised by these results is that images can be retrieved from memory by re-instating the sequence of fixations made during their initial encoding.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yarbus, A.L.: Eye Movements and Vision. Plenum, New York (1967)
Mackworth, N.H., Morandi, A.J.: The gaze selects informative details within pictures. Percept. and Psychophysics 2, 547–552 (1967)
Underwood, G., Jebbett, L., Roberts, K.: Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search. Quart. J. Exp. Psychol. 57A, 165–182 (2004)
Oyekoya, O.K., Stentiford, F.W.M.: Eye tracking as a new interface for image retrieval. BT Tech. J. 22, 161–169 (2004)
Noton, D., Stark, L.: Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vis. Res. 11, 929–942 (1971a)
Noton, D., Stark, L.: Eye movements and visual perception. Sci. Am. 224, 34–43 (1971b)
Foulsham, T., Underwood, G.: What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. J. Vis. 8(2):6, 1–17 (2008)
Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vis. Res. 40, 1489–1506 (2000)
Underwood, G., Foulsham, T., van Loon, E., Underwood, J.: Visual attention, visual saliency, and eye movements during the inspection of natural scenes. In: Mira, J., Álvarez, J.R. (eds.) IWINAC 2005. LNCS, vol. 3562, pp. 459–468. Springer, Heidelberg (2005)
Underwood, G., Foulsham, T.: Visual saliency and semantic incongruency influence eye movements when inspecting pictures. Quart. J. Exp. Psychol. 59, 1931–1949 (2006)
Brandt, S.A., Stark, L.W.: Spontaneous eye movements during visual imagery reflect the content of the visual scene. J. Cog. Neuro. 9, 27–38 (1997)
Holsanova, J., Hedberg, B., Nilsson, N.: Visual and verbal focus patterns when describing pictures. In: Becker, W., Deubel, H., Mergner, T. (eds.) Current Oculomotor Research: Physiological and Psychological Aspects, pp. 303–304. Plenum, New York (1998)
Johansson, R., Holsanova, J., Holmqvist, K.: Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cog. Sci. 30, 1053–1079 (2006)
Laeng, B., Teodorescu, D.-S.: Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cog. Sci. 26, 207–231 (2002)
Kosslyn, S.M.: Image and Brain. MIT Press, Cambridge (1994)
Privitera, C.M., Stark, L.W.: Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Trans. Patt. Anal. Mach. Intell. 22, 970–982 (2000)
Levenshtein, V.: Binary codes capable of correcting deletions, insertions and reversals. Soviet Physice - Doklady 10, 707–710 (1966)
Stark, L., Ellis, S.R.: Scanpaths revisited: cognitive models direct active looking. In: Fisher, D.F., Monty, R.A., Senders, J.W. (eds.) Eye Movements: Cognition and Visual Perception, pp. 193–227. Erlbaum, Hillsdale (1981)
Pylyshyn, Z.W.: Mental imagery: In search of a theory. Behav. Brain Sci. 25, 157–238 (2002)
Cerf, M., Harel, J., Huth, A., Einhäuser, W., Koch, C.: Decoding what people see from where they look: Predicting visual stimuli from scanpaths. In: Paletta, L., Tsotsos, J.K. (eds.) Proceedings of the 5th International Workshop on Attention in Cognitive Systems, Santorini, Greece, pp. 194–206 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Underwood, G., Mennie, N., Humphrey, K., Underwood, J. (2008). Remembering Pictures of Real-World Images Using Eye Fixation Sequences in Imagery and in Recognition. In: Caputo, B., Vincze, M. (eds) Cognitive Vision. ICVW 2008. Lecture Notes in Computer Science, vol 5329. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92781-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-92781-5_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92780-8
Online ISBN: 978-3-540-92781-5
eBook Packages: Computer ScienceComputer Science (R0)