Abstract
The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach a predictive and attentive consensus between what is expected and what is there in the outside world. It is suggested that all conscious states in the brain are resonant states, and that these resonant states trigger learning of sensory and cognitive representations when they amplify and synchronize distributed neural signals that are bound by the resonance. Thus, processes of learning, intention, attention, synchronization, and consciousness are intimately bound up together. The name Adaptive Resonance Theory, or ART, summarizes the predicted link between these processes. Illustrative psychophysical and neurobiological data have been explained and quantitatively simulated using these concepts in the areas of early vision, visual object recognition, auditory streaming, and speech perception, among others. It is noted how these mechanisms seem to be realized by known laminar circuits of the visual cortex. In particular, they seem to be operative at all levels of the visual system. Indeed, the mammalian neocortex, which is the seat of higher biological intelligence in all modalities, exhibits a remarkably uniform laminar architecture, with six characteristic layers and sublamina. These known laminar ART, or LAMINART, models illustrate the emerging paradigm of Laminar Computing which is attempting to answer the fundamental question: How does laminar computing give rise to biological intelligence? These laminar circuits also illustrate the fact that, in a rapidly growing number of examples, an individual model can quantitatively simulate the recorded dynamics of identified neurons in anatomically characterized circuits and the behaviors that they control. In this precise sense, the classical Mind/Body problem is starting to get solved. It is further noted that many parallel processing streams of the brain often compute properties that are complementary to each other, much as a lock fits a key or the pieces of a puzzle fit together. Hierarchical and parallel interactions within and between these processing streams can overcome their complementary deficiencies by generating emergent properties that compute complete information about a prescribed form of intelligent behavior. This emerging paradigm of Complementary Computing is proposed to be a better paradigm for understanding biological intelligence than various previous proposals, such as the postulate of independent modules that are specialized to carry out prescribed intelligent tasks. Complementary computing is illustrated by the fact that sensory and cognitive processing in the What processing stream of the brain, that passes through cortical areas V1-V2-V4-IT on the way to prefrontal cortex, obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain’s Where/How processing stream, that passes through cortical areas V1-MT-MST-PPC on the way to prefrontal cortex. These complementary properties enable sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports their spatial and motor processes cannot lead to resonance. Because ART principles and mechanisms clarify how incremental learning can occur autonomously without a loss of stability under both unsupervised and supervised conditions in response to a rapidly changing world, algorithms based on ART have been used in a wide range of applications in science and technology.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Baloch, A.A., Grossberg, S.: A neural model of high-level motion processing: Line motion and formotion dynamics. Vision Research 37, 3037–3059 (1997)
Banuet, J.-P., Grossberg, S.: Probing cognitive processes through the structure of event-related potentials during learning: An experimental and theoretical analysis. Applied Optics 26, 4931–4946 (1987); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Boardman, I., Grossberg, S., Myers, C., Cohen, M.A.: Neural dynamics of perceptual order and context effects for variable-rate speech syllables. Perception and Psychophysics 61, 1477–1500 (1999)
Bradski, G., Grossberg, S.: Fast-learning VIEWNET architectures for recognizing three-dimensional objects from multiple two-dimensional views. Neural Networks 8, 1053–1080 (1995)
Bradski, G., Carpenter, G.A., Grossberg, S.: Working memory networks for learning temporal order with application to three-dimensional visual object recognition. Neural Computation 4, 270–286 (1992)
Bradski, G., Carpenter, G.A., Grossberg, S.: STORE working memory networks for storage and recall of arbitrary temporal sequences. Biological Cybernetics 71, 469–480 (1994)
Carpenter, G.A.: Neural network models for pattern recognition and associative memory. Neural Networks 2, 243–257 (1989); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Carpenter, G.A.: Distributed learning, recognition, and prediction byART and ARTMAP neural networks. Neural Networks 10, 1473–1494 (1997)
Carpenter, G.A., Grossberg, S.: A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing 37, 54–115 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)
Carpenter, G.A., Grossberg, S.: ART 2: Self-organization of stable category recognition codes for analog input patterns. Applied Optics 26, 4919–4930 (1987); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Carpenter, G.A., Grossberg, S.: ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures. Neural Networks 3, 129–152 (1990); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Carpenter, G.A., Grossberg, S.: A self-organizing neural network for supervised learning, recognition, and prediction. IEEE Communications Magazine, 38–49 (September 1992)
Carpenter, G.A., Grossberg, S.: Normal and amnesic learning, recognition, and memory by a neural model of cortico-hippocampal interactions. Trends in Neurosciences 16, 131–137 (1993)
Carpenter, G.A., Grossberg, S., Markuzon, N., Reynolds, J.H., Rosen, D.B.: Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimentional maps. IEEE Transactions on Neural Networks 3, 698–713 (1992)
Carpenter, G.A., Grossberg, S., Reynolds, J.H.: ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks 4, 565–588 (1991); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Carpenter, G.A., Grossberg, S., Reynolds, J.H.: A fuzzy ARTMAP nonparametric probability estimator for nonstationary pattern recognition problems. IEEE Transactions on Neural Networks 6, 1330–1336 (1995)
Carpenter, G.A., Grossberg, S., Rosen, D.B.: ART 2-A: An adaptive resonance algorithm for rapid category learning and recognition. Neural Networks 4, 493–504 (1991)
Chey, J., Grossberg, S., Mingolla, E.: Neural dynamics of motion grouping: From aperture ambiguity to object speed and direction. Journal of the Optical Society of America A 14, 2570–2594 (1997)
Cohen, M.A., Grossberg, S.: Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Transactrions on Systems, Man, and Cybernetics 13, 815–826 (1983); Reprinted in Grossberg, S.: The Adaptive Brain, vol. I. Elsevier Science, Amsterdam (1987)
Cohen, M.A., Grossberg, S.: Neural dynamics of speech and language coding: Developmental programs, perceptual grouping, and competition for short term memory. Human Neurobiology 5, 1–22 (1986); Reprinted in Grossberg, S.: The Adaptive Brain, vol. II. Elsevier Science, Amsterdam (1987)
Cohen, M.A., Grossberg, S.: Masking fields: A massively parallel neural architecture for learning, recognizing, and predicting multiple groupings of patterned data. Applied Optics 26, 1866–1891 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)
Cohen, M.A., Grossberg, S., Stork, D.G.: Speech perception and production by a self-organizing neural network. In: Lee, Y.C. (ed.) Evolution, Learning, Cognition, and Advanced Architectures., World Scientific, Singapore (1988); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Ellias, S.A., Grossberg, S.: Pattern formation, contrast control, and oscillations in the short-term memory of shunting on-center off-surround networks. Biological Cybernetics 20, 69–98 (1975)
Gove, A., Grossberg, S., Mingolla, E.: Brightness perception, illusory contours, and corticogeniculate feedback. Visual Neuroscience 12, 1027–1052 (1995)
Granger, E., Rubin, M., Grossberg, S., Lavoie, P.: A what-and-where fusion neural network for recognition and tracking of multiple radar emitters. Neural Networks 14, 325–344 (2001)
Grossberg, S.: On learning and energy-entropy dependence in recurrent and nonrecurrent signed networks. Journal of Statistical Physics 1, 319–350 (1969)
Grossberg, S.: Pavlovian pattern learning by nonlinear neural networks. Proceedings of the National Academy of Sciences 68, 828–831 (1971)
Grossberg, S.: Pattern learning by functional-differential neural networks with arbitrary path weights. In: Schmitt, K. (ed.) Delay and functional-differential equations and their applications, Academic Press, New York (1972)
Grossberg, S.: Contour enhancement, short term memory, and constancies in reverberating neural Networks. Studies in Applied Mathematics LII, 213–257 (1973); Reprinted in Grossberg, S.: Studies of Mind and Brain.Kluwer/Reidel, New York (1982)
Grossberg, S.: Classical and instrumental learning by neural networks. In: Rosen, R., Snell, F. (eds.) Progress in Theoretical Biology, vol. 3, pp. 51–141. Academic Press, New York (1974)
Grossberg, S.: Adaptive pattern classification and universal recoding, I: Parallel development and coding of neural feature detectors. Biological Cybernetics 23, 121–134 (1976); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)
Grossberg, S.: Adaptive pattern classification and universal recoding, II: Feedback, expectation, olfaction, and illusions. Biological Cybernetics 23, 187–202 (1976)
Grossberg, S.: Pattern formation by the global limits of a nonlinear competitive interaction in n dimensions. Journal of Mathematical Biology 4, 237–256 (1977)
Grossberg, S.: A theory of human memory: Self-organization and performance of sensory-motor codes, maps and plans. In: Rosen, R., Snell, F. (eds.) Progress in Theoretical Biology, vol. 5, pp. 233–374. Academic Press, New York (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)
Grossberg, S.: Behavioral contrast in short term memory: serial binary memory models or parallel continuous memory models. Journal of Mathematical Psychology 17, 199–219 (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)
Grossberg, S.: Competition, decision, and consensus. Journal of Mathematical Analysis and Applications 66, 470–493 (1978); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)
Grossberg, S.: Decisions, patterns, and oscillations in nonlinear competitive systems with applications to Volterra-Lotka systems. Journal of Theoretical Biology 73, 101–130 (1978)
Grossberg, S.: Biological competition: Decision rules, pattern formation, and oscillations. Proceedings of the National Academy of Sciences 77, 2338–2342 (1980)
Grossberg, S.: How does a brain build a cognitive code? Psychological Review 87, 1–51 (1980); Reprinted in Grossberg, S.: Studies of Mind and Brain. Kluwer/Reidel, New York (1982)
Grossberg, S.: Studies of Mind and Brain: Neural principles of learning, perception, development, cognition, and motor control. Kluwer/Reidel, New York (1982)
Grossberg, S.: Associative and competitive principles of learning and development: The temporal unfolding and stability of STM and LTM patterns. In: Amari, S., Arbib, M. (eds.) Competition and Cooperation in Neural Nets. Lecture Notes in Biomathematics, vol. 45, pp. 295–341. Springer, New York (1982); Reprinted in Gossberg, S.: The Adaptive Brain, vol. I. Elsevier Science, Amsterdam (1987)
Grossberg, S.: Processing of expected and unexpected events during conditioning and attention: A psychophysiological theory. Psychological Review 89, 529–572 (1982)
Grossberg, S.: Some normal and abnormal behavioral syndromes due to transmitter gating of opponent processes. Biological Psychiatry 19, 1075–1118 (1984)
Grossberg, S.: Some psychophysiological and pgharmacological correlates of a developmental, cognitive, and motivational theory. In: Karrer, R., Cohen, J., Tueting, P. (eds.) Brain and Information: Event Related Potentials, vol. 425, pp. 58–151. New York Academy of Sciences (1984); Reprinted in Grossberg, S.: The Adaptive Brain, vol. 1. Elsevier Science, Amsterdam (1987)
Grossberg, S.: Unitization, automaticity, temporal order, and word recognition. Cognition and Brain Theory 7, 263–283 (1984)
Grossberg, S.: Competitive learning: From interactive activation to adaptive resonance. Cognitive Science 11, 23–63 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1982)
Grossberg, S.: The Adaptive Brain, vol. I & II. Elsevier Science, Amsterdam (1987)
Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)
Grossberg, S.: Nonlinear neural networks: Principles, mechanisms, and architectures. Neural Networks 1, 17–61 (1988); Reprinted in Carpenter, G.A., Grossberg, S.: Pattern Recognition by Self-Organizing Neural Networks. MIT Press, Cambridge (1991)
Grossberg, S.: The attentive brain. American Scientist 83, 438–449 (1995)
Grossberg, S.: How does the cerebral cortex work: Learning, attention, and grouping by the laminar circuits of visual cortex. Spatial Vision 12, 163–186 (1999)
Grossberg, S.: The link between brain learning, attention, and consciousness. Consciousness and Cognition 8, 1–44 (1999)
Grossberg, S.: Pitch-based streaming in auditory perception. In: Griffith, N., Todd, P. (eds.) Musical networks: Parallel Distributed Perception and Performance, pp. 117–140. MIT Press, Cambridge (1999)
Grossberg, S.: The complementary brain: Unifying brain dynamics and modularity. Trends in Cognitive Sciences, 233–246 (2000)
Grossberg, S.: The imbalanced brain: From normal behavior to schizophrenia. Biological Psychiatry, 81–98 (2000)
Grossberg, S.: How hallucinations may arise from brain mechanisms of learning, attention, and volition. Journal of the International Neuropsychological Society 6, 583–592 (2000)
Grossberg, S., Boardman, I., Cohen, M.A.: Neural dynamics of variable-rate speech categorization. Journal of Experimental Psychology: Human Perception and Performance 23, 481–503 (1997)
Grossberg, S., Grunewald, A.: Cortical synchronization and perceptual framing. Journal of Cognitive Neuroscience 9, 117–132 (1997)
Grossberg, S., Howe, P.D.L.: A laminar cortical model of stereopsis and three-dimensional surface perception. Vision Research (2002) (in press)
Grossberg, S., Levine, D.: Some developmental and attentional biases in the contrast enhancement and short-term memory of recurrent neural networks. Journal of Theoretical Biology 53, 341–380 (1976)
Grossberg, S., Levine, D.: Neural dynamics of attentionally modulated Pavlovian cnditioning: Blocking, interstimulus interval, and secondary conditioning. Applied Optics 26, 5015–5030 (1987); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)
Grossberg, S., Merrill, J.W.L.: A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. Cognitive Brain Research 1, 3–38 (1992)
Grossberg, S., Merrill, J.W.L.: The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. Journal of Cognitive Neuroscience 8, 257–277 (1996)
Grossberg, S., Mingolla, E., Ross, W.D.: A neural theory of attentive visual search: Interactions of boundary, surface, spatial, and object representations. Psychological Review 101, 470–489 (1994)
Grossberg, S., Mingolla, E., Ross, W.D.: Visual brain and visual perception: How does the cortex do perceptual grouping? Trends in Neurosciences 20, 106–111 (1997)
Grossberg, S., Mingolla, E., Viswanathan, L.: Neural dynamics of motion integration and segmentation within and across apertures. Vision Research 41, 2521–2553 (2001)
Grossberg, S., Myers, C.: The resonant dynamics of speech perception: Interword integration and duration-dependent backward effects. Psychological Review 107, 735–767 (2000)
Grossberg, S., Raizada, R.D.S.: Contrast-sensitive perceptual grouping and object-based attention in the laminar circuits of primary visual cortex. Vision Research 40, 1413–1432 (2000)
Grossberg, S., Schmajuk, N.A.: Neural dynamics of attentional modulated Pavlovian conditioning: Conditioned reinforcement, inhibition, and opponent processing. Psychobiology 15, 195–240; Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge (1988)
Grossberg, S., Somers, D.: Synchronized oscillations during cooperative feature linking in a cortical model of visual perception. Neural Networks 4, 453–466 (1991)
Grossberg, S., Stone, G.: Neural dynamics of attention switching and temporal order information in short term memory. Memory and Cognition 14, 451–468 (1986); Reprinted in Grossberg, S.: Neural Networks and Natural Intelligence. MIT Press, Cambridge, MA (1988)
Grossberg, S., Stone, G.: Neural dynamics of word recognition and recall: Attentional priming, learning, and resonance. Psychological Review 93, 46–74 (1986); Reprinted in Grossberg, S.: The Adaptive Brain, vol. II. Elsevier Science, Amsterdam (1987)
Grossberg, S., Williamson, J.R.: A self-organizing neural system for learning to recognize textured scenes. Vision Research 39, 1385–1406 (1999)
Grossberg, S., Williamson, J.R.: A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning. Cerebral Cortex 11, 37–58 (2001)
Grunewald, A., Grossberg, S.: Self-organization of binocular disparity tuning by reciprocal corticogeniculate interactions. Journal of Cognitive Neuroscience 10, 100–215 (1998)
Olson, S.J., Grossberg, S.: A neural network model for the development of simple and complex cell receptive fields within cortical maps of orientation and ocular dominance. Neural Networks 11, 189–208 (1998)
Raizada, R.D.S., Grossberg, S.: Context-sensitive binding by the laminar circuits of V1 and V2: A unified model of perceptual groupiing, attention, and orientation contrast. Visual Cognition 8, 431–466 (2001)
Raizada, R., Grossberg, S.: Towards a Theory of the Laminar Architecture of Cerebral Cortex: Computational Clues from the Visual System. Cerebral Cortex 13, 100–113 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Grossberg, S. (2003). The Brain’s Cognitive Dynamics: The Link between Learning, Attention, Recognition, and Consciousness. In: Palade, V., Howlett, R.J., Jain, L. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2003. Lecture Notes in Computer Science(), vol 2773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45224-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-45224-9_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40803-1
Online ISBN: 978-3-540-45224-9
eBook Packages: Springer Book Archive