Abstract
We present a biologically plausible computational model for solving the visual feature binding problem. The binding problem appears to be due to the distributed nature of visual processing in the primate brain, and the gradual loss of spatial information along the processing hierarchy. The model relies on the reentrant connections so ubiquitous in the primate brain to recover spatial information, and thus allows features represented in different parts of the brain to be integrated in a unitary conscious percept. We demonstrate the ability of the Selective Tuning model of visual attention [1] to recover spatial information, and based on this we propose a general solution to the feature binding problem. The solution is used to simulate the results of a recent neurophysiology study on the binding of motion and color. The example demonstrates how the method is able to handle the difficult case of transparency.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Tsotsos, J.K., Culhane, S.M., Wai, W.Y.K., Lai, Y.H., Davis, N., Nuflo, F.: Modeling visual-attention via selective tuning. Artif. Intell. 78(1-2), 507–545 (1995)
Goodale, M.A., Milner, D.A.: Separate visual pathways for perception and action. Trends in Neuroscience 15(1), 20–25 (1992)
Roskies, A.L.: The binding problem. Neuron 24(1), 7–9 (1999)
Rosenblatt, F.: Principles of Neurodynamics: Perceptions and the Theory of Brain Mechanisms. Spartan Books (1961)
Treisman, A.M., Schmidt, H.: Illusory conjunctions in the perception of objects. Cognit Psychol. 14(1), 107–141 (1982)
Wolfe, J.M., Cave, K.R.: The psychophysical evidence review for a binding problem in human vision. Neuron 24(1), 11–17 (1999)
Schoenfeld, M.A., Tempelmann, C., Martinez, A., Hopf, J.M., Sattler, C., Heinze, H.J., Hillyard, S.A.: Dynamics of feature binding during object-selective attention. Proceedings of the National Academy of Sciences of the United States of America 100(20), 11806–11811 (2003)
Karayanidis, F., Michie, P.T.: Evidence of visual processing negativity with attention to orientation and color in central space. Electroencephalography and Clinical Neurophysiology 103(2), 282–297 (1997)
Cortese, F., Bernstein, L.J., Alain, C.: Binding visual features during high-rate serial presentation. Neuroreport 10(7), 1565–1570 (1999)
Smid, H.G.O.M., Jakob, A., Heinze, H.J.: An event-related brain potential study of visual selective attention to conjunctions of color and shape. Psychophysiology 36(2), 264–279 (1999)
Schoenfeld, M.A., Woldorff, M., Duzel, E., Scheich, H., Heinze, H.J., Mangun, G.R.: Form-from-motion: MEG evidence for time course and processing sequence meg evidence for time course and processing sequence. Journal of Cognitive Neuroscience 15(2), 157–172 (2003)
Tsotsos, J.K., Liu, Y., Martinez-Trujillo, J.C., Pomplun, M., Simine, E., Zhou, K.: Attending to visual motion. Comput. Vis. Image Und. 100(1-2), 3–40 (2005)
Cutzu, F., Tsotsos, J.K.: The selective tuning model of attention: psychophysical evidence for a suppressive annulus around an attended item. Vision Research 43(2), 205–219 (2003)
Hopf, J.M., Boehler, C.N., Luck, S.J., Tsotsos, J.K., Heinze, H.J., Schoenfeld, M.A.: Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. Proceedings of the National Academy of Sciences of the United States of America 103(4), 1053–1058 (2006)
Treisman, A.M., Gelade, G.: Feature-integration theory of attention. Cognitive Psychology 12(1), 97–136 (1980)
Taraborelli, D.: Feature binding and object perception. Does object awareness require feature conjunction? In: ESPP 2002. 10th Annual Meeting of the European Society for Philosophy and Psychology, Lyon (2002)
Robertson, L.: Space, Objects, Brains and Minds. Essays in Cognitive Psychology. Psychology Press (2004)
Koch, C.: A theoretical analysis of the electrical properties of an x-cell in the cat’s LGN: does the spine-triad circuit subserve selective visual attention? Technical report, MIT, Artificial Intelligence Laboratory (1984)
Sherman, S.M., Koch, C.: The control of retinogeniculate transmission in the mammalian lateral geniculate nucleus. Experimental Brain Research 63, 1–20 (1986)
Li, Z.: A saliency map in primary visual cortex. Trends in Cognitive Sciences 6(1), 9–16 (2002)
Lee, T., Yang, C., Romero, R., Mumford, D.: Neural activity in early visual cortex reflects behavioral experience and higher order perceptual saliency. Nature Neuroscience 5(6), 589–597 (2002)
Moran, J., Desimone, R.: Selective attention gates visual processing in the extrastriate cortex. Science 229(4715), 782–784 (1985)
Tsotsos, J.K.: Analyzing vision at the complexity level. Behavioral and Brain Sciences 13(3), 423–444 (1990)
Schall, J.D.: Neural basis of saccade target selection. Reviews in Neuroscience 6(1), 63–85 (1995)
Steinman, B.A., Steinman, S.B., Lehmkuhle, S.: Visual attention mechanisms show a center-surround organization. Vision Research 35(13), 1859–1869 (1995)
Caputo, G., Guerra, S.: Attentional selection by distracter suppression. Vision Research 38(5), 669–689 (1998)
Bahcall, D.O., Kowler, E.: Attentional interference at small spatial separations. Vision Research 39(1), 71–86 (1999)
Mounts, J.R., Melara, R.D.: Attentional selection of objects or features: Evidence from a modified search task. Perception & Psychophysics 61(2), 322–341 (1999)
Mounts, J.R.: Evidence for suppressive mechanisms in attentional selection: feature singletons produce inhibitory surrounds. Perception & Psychophysics 62(5), 969–983 (2000)
Vanduffel, W., Tootell, R.B.H., Orban, G.A.: Attention-dependent suppression of metabolic activity in the early stages of the macaque visual system. Cerebral Cortex 10(2), 109–126 (2000)
Kristjansson, A., Nakayama, K.: The attentional blink in space and time. Vision Res. 42(17), 2039–2050 (2002)
Slotnick, S.D., Hopfinger, J.B., Klein, S.A., Sutter, E.E.: Darkness beyond the light: attentional inhibition surrounding the classic spotlight. Neuroreport 13(6), 773–778 (2002)
Slotnick, S.D., Schwarzbach, J., Yantis, S.: Attentional inhibition of visual processing in human striate and extrastriate cortex. Neuroimage 19(4), 1602–1611 (2003)
Müller, N.G., Kleinschmidt, A.: The attentional ‘spotlight’s’ penumbra: center-surround modulation in striate cortex. Neuroreport 15(6), 977–980 (2004)
Schall, J.D.: On the role of frontal eye field in guiding attention and saccades. Vision Research 44(12), 1453–1467 (2004)
Müller, N.G., Mollenhauer, M., Rösler, A., Kleinschmidt, A.: The attentional field has a Mexican hat distribution. Vision Research 45(9), 1129–1137 (2005)
Rothenstein, A.L., Zaharescu, A., Tsotsos, J.K.: Second-order (non-Fourier) attention-based face detection. In: Kollias, S., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 518–527. Springer, Heidelberg (2006)
Bellhumer, P.N., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(7), 711–720 (1997)
Rothenstein, A.L., Tsotsos, J.K.: Selective Tuning: Feature Binding Through Selective Attention. In: Kollias, S., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 548–557. Springer, Heidelberg (2006)
Földiák, P., Young, M.: Sparse coding in the primate cortex. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, pp. 895–898. MIT Press, Cambridge (1995)
Mehta, A.D., Ulbert, I., Schroeder, C.E.: Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. Cerebral Cortex 10(4), 343–358 (2000)
Bullier, J.: Integrated model of visual processing. Brain Research Reviews 36(2-3), 96–107 (2001)
Barlow, H.B.: Single units and sensation: A neuron doctrine for perceptual psychology? Perception 1(4), 371–394 (1972)
Milner, P.: A model for visual shape recognition. Psychol. Rev. 81, 521–535 (1974)
von der Malsburg, C.: Nervous structures with dynamical links. Ber. Bunsenges. Phys. Chem. 89, 703–710 (1985)
Singer, W.: Neuronal synchrony: a versatile code for the definition of relations? Neuron 24, 49–65 (1999)
Shadlen, M.N., Movshon, J.A.: Synchrony unbound: a critical evaluation of the temporal binding hypothesis. Neuron 24, 67–77 (1999)
Biederman, I.: Perceiving real-world scenes. Science 177(43), 77–80 (1972)
Thorpe, S., Fize, D., Marlot, C.: Speed of processing in the human visual system. Nature 381(6582), 520–522 (1996)
Evans, K.K., Treisman, A.M.: Perception of objects in natural scenes: Is it really attention free? Journal of Experimental Psychology: Human Perception and Performance 31(6), 1476–1492 (2005)
Haynes, J.D., Tregellas, J., Rees, G.: Attentional integration between anatomically distinct stimulus representations in early visual cortex. Proc. Natl. Acad. Sci. 102(41), 14925–14930 (2005)
Pollen, D.A.: Explicit neural representations, recursive neural networks and conscious visual perception. Cerebral Cortex 13(8), 807–814 (2003)
Rothenstein, A.L., Zaharescu, A., Tsotsos, J.K.: TarzaNN: A general purpose neural network simulator for visual attention modeling. In: Paletta, L., Tsotsos, J.K., Rome, E., Humphreys, G.W. (eds.) WAPCV 2004. LNCS, vol. 3368, pp. 159–167. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rothenstein, A.L., Tsotsos, J.K. (2007). Modeling the Dynamics of Feature Binding During Object-Selective Attention. In: Paletta, L., Rome, E. (eds) Attention in Cognitive Systems. Theories and Systems from an Interdisciplinary Viewpoint. WAPCV 2007. Lecture Notes in Computer Science(), vol 4840. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77343-6_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-77343-6_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77342-9
Online ISBN: 978-3-540-77343-6
eBook Packages: Computer ScienceComputer Science (R0)