Skip to main content

A Generic Model of Visual Selective Attention

  • Conference paper
  • First Online:
Brain-Inspired Computing (BrainComp 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8603))

Included in the following conference series:

  • 1059 Accesses

Abstract

We present a computational model for the understanding of the fundamental principles of visual selective attention. The model has important medical, social and engineering applications that could benefit the general public. The design of the model is guided by the state of the art in neurophysiological evidence and its performance has been evaluated by comparisons to behavioral data from psychological studies.

The model effectively links low level neural interactions with behavioral data, thus providing concrete explanations for psychological phenomena. The model was used to simulate finding from several behavioral experiments on visual selective attention, with emphasis on those eliciting controversies in the scientific literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barkley, R.A.: Behavioral inhibition, sustained attention, and executive functions constructing a unifying theory of ADHD. Psychol. Bull. 121, 65–94 (1997)

    Article  Google Scholar 

  2. Laurens, K.R., Kiehl, K.A., Ngan, E.T., Liddle, P.F.: Attention orienting dysfunction during salient novel stimulus processing in schizophrenia. Schizophrenia Res. 75, 159–171 (2005)

    Article  Google Scholar 

  3. Posner, M.I., Rothbart, M.K.: Research on attention networks as a model for the integration of psychological science. Ann. Rev. Psychol. 58, 1–23 (2007)

    Article  Google Scholar 

  4. Buschman, J., Miller, K.: Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices. Science 315(5820), 1860–1862 (2007)

    Article  Google Scholar 

  5. Corbetta, M., Patel, G., Shulman, L.G.: The reorienting system of the human brain: from environment to theory of mind. Neuron 58(3), 306–324 (2008)

    Article  Google Scholar 

  6. Kastner, S., Ungerleider, L.G.: Mechanisms of visual attention in the human cortex. Ann. Rev. Neurosci. 23, 315–341 (2000)

    Article  Google Scholar 

  7. Raymond, J.E., Shapiro, K.L., Arnell, K.M.: Temporary suppression of visual processing in an RSVP task: An attentional blink? J. Exp. Psychol. Hum. Percept. Perform. 18(3), 849–860 (1992)

    Article  Google Scholar 

  8. Neokleous, Kleanthis C., Avraamides, Marios N., Neocleous, Costas K., Schizas, Christos N.: A neural network computational model of visual selective attention. In: Palmer-Brown, Dominic, Draganova, Chrisina, Pimenidis, Elias, Mouratidis, Haris (eds.) EANN 2009. CCIS, vol. 43, pp. 350–358. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  9. Neokleous, C.K., Avraamides, N.M., Neocleous, K.C., Schizas, C.N.: A neural network model of the attentional blink phenomenon. Int. J. Eng. Intell. Syst. Electr. Eng. Commun. 17, 115–126 (2009)

    Google Scholar 

  10. Lavie, N.: Perceptual load as a necessary condition for selective attention. J. Exp. Psychol. Hum. Percept. Perform. 21(3), 451–468 (1995)

    Article  Google Scholar 

  11. Neokleous, K.C., Avraamides, M.N., Schizas, C.N.: Computational modeling of visual selective attention based on correlation and synchronization of neural activity. In: Iliadis, L., Vlahavas, I., Bramer, M. (eds.) Artificial Intelligence Applications and Innovations III, pp. 215–223. Springer, Boston (2009)

    Chapter  Google Scholar 

  12. Neokleous, K.C., Koushiou, M., Avraamides, M.N., Schizas, C.N.: A coincidence detector neural network model of selective attention. In: Proceedings of the 31st Annual Meeting of the Cognitive Science Society, Amsterdam, The Netherlands (2009)

    Google Scholar 

  13. Desimone, R., Duncan, J.: Neural mechanisms of selective visual-attention. Ann. Rev. Neurosci. 18, 193–222 (1995)

    Article  Google Scholar 

  14. Reynolds, J.H., Desimone, R.: Interacting roles of attention and visual salience in V4. Neuron 37, 853–863 (2003)

    Article  Google Scholar 

  15. Reynolds, J.H., Pasternak, T., Desimone, R.: Attention increases sensitivity of V4 neurons. Neuron 26(3), 703–714 (2000)

    Article  Google Scholar 

  16. Ioannides, A.A., Poghosyan, V.: Spatiotemporal dynamics of early spatial and category-specific attentional modulations. NeuroImage 60, 1638–1651 (2012)

    Article  Google Scholar 

  17. Nothdurft, H.C., Gallant, J.L., Van Essen, D.C.: Response modulation by texture surround in primate area V1: Correlates of popout under anesthesia. Vis. Neurosci. 1999(16), 15–34 (1999)

    Google Scholar 

  18. Wachtler, T., Sejnowski, T.J., Albright, T.D.: Representation of color stimuli in awake macaque primary visual cortex. Neuron 37(4), 681–691 (2003)

    Article  Google Scholar 

  19. Shibata, K., Yamagishi, N., Goda, N., Yoshioka, T., Yamashita, O., Sato, M.A., Kawato, M.: The effects of feature attention on pre-stimulus cortical activity in the human visual system. Cereb. Cortex 18, 1664–1675 (2008)

    Article  Google Scholar 

  20. VanRullen, R.: Visual saliency and spike timing in the ventral visual pathway. J. Physiol. 97, 365–377 (2003)

    Google Scholar 

  21. Chelazzi, L., Miller, E.K., Duncan, J., Desimone, R.: A neural basis for visual search in inferior temporal cortex. Nature 363, 345–347 (1993)

    Article  Google Scholar 

  22. Fries, P., Reynolds, J.H., Rori, A.E., Desimone, R.: Modulation of oscillatory neuronal synchronization by selective visual attention. Science 291, 1560–1563 (2001)

    Article  Google Scholar 

  23. Gregoriou, G.G., Stephen, J.G., Huihui, Z., Desimone, R.: High-frequency, long-range coupling between prefrontal and visual cortex during attention. Science 324(5931), 1207–1210 (2009)

    Article  Google Scholar 

  24. Rolls, E.T., Deco, G.: The Noisy Brain: Stochastic Dynamics as a Principle of Brain Function. Oxford University Press, Oxford (2010)

    Google Scholar 

  25. Koch, C., Ullman, S.: Shifts in selective visual attention: Towards the underlying neural circuitry. Hum. Neurobiol. 4(4), 219–227 (1985)

    Google Scholar 

  26. Walther, D., Koch, C.: Modeling attention to salient proto-objects. Neural Netw. 19, 1395–1407 (2006)

    Article  MATH  Google Scholar 

  27. Zhaoping, L., Dayan, P.: Pre-attentive visual selection. Neural Netw. 19, 1437–1439 (2006)

    Article  Google Scholar 

  28. Silver, M.A., Ress, D., Heeger, D.J.: Neural correlates of sustained spatial attention in human early visual cortex. J. Neurophysiol. 97, 229–237 (2007)

    Article  Google Scholar 

  29. Shibata, K., Yamagishi, N., Goda, N., Yoshioka, T., Yamashita, O., Sato, M.A., Kawato, M.: The effects of feature attention on pre-stimulus cortical activity in the human visual system. Cereb. Cortex 18, 1664–1675 (2008)

    Article  Google Scholar 

  30. Crick, F., Koch, C.: Towards a neurobiological theory of consciousness. Semin. Neurosci. 2, 263–275 (1990)

    Google Scholar 

  31. Spruston, N.: Pyramidal neurons: Dendritic structure and synaptic integration. Nat. Rev. Neurosci. 9, 206–221 (2008)

    Article  Google Scholar 

  32. Treue, S.: Visual attention: the where, what, how and why of saliency. Curr. Opin. Neurobiol. 13, 428–432 (2003)

    Article  Google Scholar 

  33. Ogawa, T., Komatsu, H.: Target selection in area V4 during a multidimensional visual search task. J. Neurosci. 24, 6371–6382 (2004)

    Article  Google Scholar 

  34. Rolls, E.T., Tovee, M.J., Panzeri, S.: The neurophysiology of backward visual masking: Information analysis. J. Cogn. Neurosci. 11, 300–311 (1999)

    Article  Google Scholar 

  35. Keysers, C., Perrett, D.I.: Visual masking and RSVP reveal neural competition. Trends Cogn. Sci. 6, 120–125 (2002)

    Article  Google Scholar 

  36. Ioannides, A.A., Taylor, J.G.: Testing models of attention with MEG. In: Proceedings of the IJCNN’03, pp. 287–297 (2003)

    Google Scholar 

  37. Luck, S.J.: The operation of attention—millisecond by millisecond—over the first half second. In: Ogmen, H., Breitmeyer, B.G. (eds.) The First Half Second: The Microgenesis and Temporal Dynamics of Unconscious and Conscious Visual Processes. MIT Press, Cambridge (2005)

    Google Scholar 

  38. Naccache, L., Blandin, E., Dehaene, S.: Unconscious masked priming depends on temporal attention. Psychol. Sci. 13, 416–424 (2002)

    Article  Google Scholar 

  39. Neokleous, K.C., Avraamides, M.N., Neokelous, C.K., Schizas, C.N.: Selective attention and consciousness: Investigating their relation through computational modeling. Cogn. Comput. 3, 321–331 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christos N. Schizas .

Editor information

Editors and Affiliations

Appendices

Appendix

The basic computational unit used in the model is the graded response neuron, defined by the membrane Eq. A1.

$$ \tau_{m} \frac{dV}{dt} = E_{L} - V(t) + R_{m} I_{s} (t) $$
(A1)

V is the membrane potential of each neuron, τm is the membrane time constant, and EL is the resting potential of the membrane. The membrane potential can be seen as a measure of the extent to which a node is excited. Is(t) represents the total synaptic current and is a simple combination of pre-synaptic excitation and bias currents that increase the membrane potential, with inhibition currents that reduce the membrane potential of the node. The total summation of the excitatory and inhibitory currents influences the actual membrane potential at each time instance. Finally, Rm is the membrane resistance of the neuron. In brief, Eq. 1 determines how the membrane potential V of each neuron develops over time after an input current Is is applied. The value of the membrane potential increases until it reaches a specific threshold (Vth) at which a spike is emitted and V resets to its initial condition or resting potential Vres. Subsequently, a refractory period of 2 ms is applied before the neuron model is allowed to integrate again any pre-synaptic currents.

The term Is in Eq. A1 quantifies the synaptic currents that are mediated by the excitatory receptors AMPA and NMDA (activated by glutamate, gAMPA and gNMDA) and the inhibitory receptor GABAA and GABAB, as shown in Eq. A2.

$$ I_{s} \left( t \right) = \left( {I_{AMPA} \left( t \right) + I_{NMDA} \left( t \right) + I_{{GABA_{A} }} \left( t \right) + I_{{GABA_{B} }} \left( t \right)} \right) $$
(A2)

For the following analysis, the synaptic inputs will be considered as the total excitatory and inhibitory synaptic currents (Iexc(t) + Iinh(t)).

In the framework of the integrate-and-fire model, each pre-synaptic spike generates a post-synaptic current pulse that is driven towards the input of the following neuron as shown in (A3).

$$ I_{s} \left( t \right) = \left( {I_{exc} \left( t \right) + I_{inh} \left( t \right) = g_{exc} \left( t \right)(Es_{exc} - V) + g_{inh} \left( t \right)(Es_{inh} - V)} \right) $$
(A3)

Where

$$ g_{exc} \left( t \right) = \bar{g}_{exc} w_{exc} P_{s} \left( t \right),g_{inh} \left( t \right) = \bar{g}_{inh} w_{inh} P_{s} \left( t \right) $$
(A4)

is the maximal excitatory or inhibitory conductance and wexc, winh refer to the excitatory and inhibitory synaptic weights.

Ps(t) determines the synaptic conductivity and can be modeled by a simple exponential decay with time constant Ï„s as shown in (A5).

$$ P_{s} = \frac{1}{{e^{{\frac{t}{{\tau_{s} }}}} }} + \frac{{(\Theta (t - t_{k} )e^{{\frac{{t_{k} }}{{\tau_{s} }}}} )}}{{e^{{\frac{t}{{\tau_{s} }}}} }} $$
(A5)

In (A5), Θ represents the Heaviside step function (zero for negative arguments, unity for zero or positive arguments

$$ \Theta (x) = \left\{ {\begin{array}{*{20}c} 0 \\ 1 \\ \end{array} \, \begin{array}{*{20}c} {x < 0} \\ {x >= 0} \\ \end{array} } \right. $$
(A6)

Coincidence Detector Nodes

Traditionally, coincidence detector neurons are modeled with a very short membrane time constant Ï„m that can change rapidly. However, another way to model coincidence detection is based on a simple case in which separate inputs converge on a common target.

More precisely, if Ψ(t) is a binary row vector denoting the states of neuron A and B at time t and C(t + 1) the state of neuron C at t + 1.

$$ C(t + 1) =\Theta (\varPsi (t) - \theta ) $$
(A7)

With Θ being the Heaviside step function, and θ the specific threshold for a number of pre-synaptic spikes that are needed to arrive synchronously in order for the output neuron C to induce a spike.

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Neokleous, K.C., Avraamides, M.N., Schizas, C.N. (2014). A Generic Model of Visual Selective Attention. In: Grandinetti, L., Lippert, T., Petkov, N. (eds) Brain-Inspired Computing. BrainComp 2013. Lecture Notes in Computer Science(), vol 8603. Springer, Cham. https://doi.org/10.1007/978-3-319-12084-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12084-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12083-6

  • Online ISBN: 978-3-319-12084-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics