Skip to main content
Log in

Towards a neurally-inspired computer architecture

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

The first two main rounds of neural computing focused on adaptation and self-organization in neural networks, and on use of analog VLSI for compartmental modeling of the neuron, respectively. This paper is a prospectus for a third round of neural computing: analyzing the architecture of the primate brain to extract neural information processing principles and translate them into biologically-inspired operating systems and computer architectures. The way in which the cerebellum interacts with other brain regions in learning how to better control and coordinate movements provides a case study to introduce key ideas for these three rounds of neural computation. It is argued that the third round will develop and exploit general insights into brain architectures, their function and dynamics, that will provide a principled combination of cooperative computation, learning and perceptual robotics (i.e., the integration of action, perception and computation). This new effort is motivated by recent advances in computational neuroscience research, studying examples of system evolution ranging from low-level vision to how the interactions between frontal and parietal cortices serve action recognition (the mirror system), and language. The paper also notes the vast difference between the slow biological evolution of diverse brains and the needs of computer technology for explicit tools for the design and testing of novel programs and architectures, and suggests the challenges of developing a reflection methodology for wrapping modules with descriptions that can be automatically updated as the module itself adapts through learning. The Appendix provides a road map for approaching the voluminous literature on brain theory and neural networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Amari S and Arbib MA (1977) Competition and cooperation in neural nets. In: Metzler J (ed) Systems Neuroscience, pp. 119–165. Academic Press

  • Arbib MA (1964) Brains, Machines and Mathematics. McGraw-Hill, New York

    Google Scholar 

  • Arbib MA (1981) Perception structures and distributed motor control. In: Brooks VB (ed) Handbook of Physiology, Section 2: The Nervous System, Vol. II, Motor Control, Part I, pp. 1449–1480. American Physiological Society

  • Arbib MA (1989) The Metaphorical Brain 2: Neural Network and Beyond. Wiley-Interscience, New York

    Google Scholar 

  • Arbib MA (ed) (1995) The Handbook of Brain Theory and Neural Networks. Bradford Books/The MIT Press

  • Arbib MA (1988) Neural computing: The challenge of the neurally-inspired. EDUCOM Bulletin 23(1): 2–12

    Google Scholar 

  • Arbib MA (2001) Grounding the mirror system hypothesis for the evolution of the languageready brain. In: Angelo Cangelosi and Domenico Parisi (eds) Simulating the Evolution of Language. Springer-Verlag

  • Arbib MA (2002) The mirror system, imitation, and the evolution of language. In: Chrystopher Nehaniv and Kerstin Dautenhahn (eds) Imitation in Animals and Artifacts. The MIT Press, to appear

  • Arbib MA (ed) (2003) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press

  • Arbib MA (2003a) From Rana computatrix to human language: Towards a computational neuroethology of language evolution. Phil Trans R Soc Lond, in press

  • Arbib MA (2003b) Schema theory. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press

  • Arbib MA, Alexander A and Weitzenfeld W (2002) NSL Neural Simulation Language. In: Arbib MA and Grethe JS (eds) Computing the Brain: A Guide to Neuroinformatics, pp. 71–90. Academic Press, San Diego, CA

    Google Scholar 

  • Arbib MA, Billard A, Iacoboni M and Oztop E (2000) Synthetic brain imaging: Grasping, mirror neurons and imitation. Neural Networks 13: 975–997

    Google Scholar 

  • Arbib MA, Bischoff A, Fagg AH and Grafton ST (1994) Synthetic PET: Analyzing large-scale properties of neural networks. Human Brain Mapping 2: 225–233

    Google Scholar 

  • Arbib MA, Érdi P and Szentágothai J (1998) Neural Organization: Structure, Function, and Dynamics. The MIT Press, Cambridge, MA

    Google Scholar 

  • Arbib MA, Iberall T and Lyons D (1985) Coordinated control program for movements of the hand. In: Goodwin AW and Darian-Smith I (eds) Hand Function and the Neocortex, Exp Brain Res Suppl 10, pp. 111–129

  • Arbib MA and Ehrig H (1990) Linking schemas and module specifications for distributed systems. Proceedings of the Workshop on Distributed Computing Systems. Cario

  • Atkeson CG, Moore AW and Schaal S (1997) Locally weighted learning for control. Artificial Intelligence Review 11: 75–113

    Google Scholar 

  • Bartlett FC (1932) Remembering. Cambridge University Press

  • Barto AG, Sutton RS and Brouwer P (1981) Associative search network: A reinforcement learning associative memory. Biol Cybernetics 40: 201–211

    Google Scholar 

  • Bell AJ and Sejnowski TJ (1995) An information maximization approach to blind separation and blind deconvolution. Neural Computation 7: 1129–1159

    Google Scholar 

  • Bellman KL (1993) Flexible Software Environments Supporting the Design of Complex Systems, Proceedings of the Artificial Intelligence in Logistics Meeting, 8-10 March 1993. Williamsburg, Va, American Defense Preparedness Association

    Google Scholar 

  • Bellman KL (2000) Developing a concept of self for constructed autonomous systems. In: Proceedings of EMCRS'2000: The 15th European Meeting on Cybernetics and Systems Research, Symposium on Autonomy Control: Lessons from the Emotional, 25-28 April 2000, Vienna Volume, pp. 693–698

  • Bridgeman B, Gemmer A, Forsman T and Huemer V (2000) Processing spatial information in the sensorimotor branch of the visual system. Vision Research 40: 3539–3552

    Google Scholar 

  • Bridgeman B, Peery S and Anand S (1997) Interaction of cognitive and sensorimotor maps of visual space. Perception and Psychophysics 59: 456–469

    Google Scholar 

  • Castiello U, Paulignan Y and Jeannerod M (1991) Temporal dissociation of motor responses and subjective awareness: A study in normal subjects. Brain 114: 2639–2655

    Google Scholar 

  • Corballis MC (2002) From Hand to Mouth: The Origins of Language. Princeton University Press, Princeton, NJ

    Google Scholar 

  • Damper RI, French RLB and Scutt TW (2000) ARBIB: An autonomous robot based on inspiration from biology. Robotics and Autonomous Systems 31: 247–274

    Google Scholar 

  • Dayan P, Hinton GE, Neal RM and Zemel RS (1995) The Helmholtz machine. Neural Computation 7: 889–904

    Google Scholar 

  • Douglas R and Rasche C (2003) Silicon neurons. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press

  • Doya K (1999) What are the computations in the cerebellum, the basal ganglia, and the cerebral cortex. Neural Networks 12: 961–974

    Google Scholar 

  • Fagg AH and Arbib MA (1998) Modeling parietal-premotor interactions in primate control of grasping. Neural Networks 11: 1277–1303

    Google Scholar 

  • Gibson JJ (1966) The Senses Considered as Perceptual Systems. Allen and Unwin

  • Goldman-Rakic PS (1990) Parallel systems in the cerebral cortex: The topography of cognition. In: Arbib MA and Robinson JA (eds) Natural and Artificial Parallel Computation, pp. 155–176. The MIT Press, Cambridge, MA

    Google Scholar 

  • Goodale MA and Milner AD (1992) Separate visual pathways for perception and action. Trends in Neuroscience 15: 20–25

    Google Scholar 

  • Goodale MA, Milner AD, Jakobson LS and Carey DP (1991) A neurological dissociation between perceiving objects and grasping them. Nature 349: 154–156

    Google Scholar 

  • Head H and Holmes G (1911) Sensory disturbances from cerebral lesions. Brain 34: 102–254

    Google Scholar 

  • Hebb Donald O (1949) The Organization of Behavior. J. Wiley and Sons, New York

    Google Scholar 

  • Hewes G (1973) Primate communication and the gestural origin of language. Current Anthropology 14: 5–24

    Google Scholar 

  • Jackson JH (1878-1879) On affections of speech from disease of the brain. Brain 1: 304–330, 2: 203-222, 323-356

    Google Scholar 

  • Iberall T, Binghma G and Arbib MA (1986) Opposition space as a structuring concept for the analysis of skilled hand movements. Experimental Brain Research Series 15: 158–173

    Google Scholar 

  • Jacobs RA, Jordan MI, Nowlan SJ and Hinton GE (1991) Adaptive mixtures of local experts. Neural Computation 3: 79–87

    Google Scholar 

  • Jeannerod M and Biguer B (1982) Visuomotor mechanisms in reaching within extra-personal space. In: Ingle DJ, Mansfield RJW and Goodale MA (eds) Advances in the Analysis of Visual Behavior, pp. 387–409. The MIT Press, Cambridge, MA

    Google Scholar 

  • Jennerod M, Arbib MA, Rizzolatti G and Sakata H (1995) Grasping objects: The cortical mechanisms of visuomotor transformation. Trends in Neurosciences 18: 314–320

    Google Scholar 

  • Kiczales G, des Rivieres J and Bobrow DG (1991) the Art of the Meta-Object Protocol. The MIT Press, Cambridge, MA

    Google Scholar 

  • Kimura D (1993) Neuromotor Mechanisms in Human Communication. Oxford University Press, Oxford, New York

    Google Scholar 

  • Kohonen T (1988) Self-Organization and Associative Memory, 2nd Edition. Springer-Verlag

  • Kornfeld WA and Hewitt C (1981) The scientific community metaphor. IEEE Trans on Systems, Man and Cybernetics 11: 23–33

    Google Scholar 

  • Landauer CA and Bellman KL (1993) The Role of Self-Referential Logics in a Software Architecture Using Wrappings. Proceedings of ISS '93: The 3rd Irvine Software Symposium, 30 April 1993. UC Irvine, California

    Google Scholar 

  • Landauer CA and Bellman KL (1996) Constructed complex systems: Issues, architectures and wrappings. In: Proceedings EMCSR 96: Thirteenth European Meeting on Cybernetics and Systems Research, Symposium on Complex Systems Analysis and Design, 9-12 April 1996, Vienna, pp. 233–238

  • Lyons DM and Arbib MA (1989) A formal model of computation for sensory-based robotics. IEEE Trans on Robotics and Automation 5: 280–293

    Google Scholar 

  • McCulloch WS and Pitts WH (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5: 115–133

    Google Scholar 

  • McCulloch WS, Arbib MA and Cowan JD (1962) Neurological models and integrative processes. In: Yovits MC, Jacobi GT and Goldstein GD (eds) Self-Organizing Systems, pp. 49–59. Spartan Books

  • Mead C (1989) Analog VLSI and Neural Systems. Addison-Wesley, Reading, MA

    Google Scholar 

  • Mead C and Conway L (1980) Introduction to VLSI Systems. Addison-Wesley, Reading, MA

    Google Scholar 

  • Minsky ML (1961) Steps toward artificial intelligence. Proc IRE 49: 8–30

    Google Scholar 

  • Minsky ML (1985) The Society of Mind. Simon and Schuster, New York

    Google Scholar 

  • Newell KM, Scully DM, McDonald PV and Baillargeon R (1989) Task constraints and infant grip configurations. Development Pyshobiology 22: 817–831

    Google Scholar 

  • Nolfi S and Parisi D (2003) Evolution of Artificial Neural Networks. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, Second Edition. Bradford Books/The MIT Press

  • Oztop E and Arbib MA (2002) Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics 87: 116–140

    Google Scholar 

  • Oztop E, Bradley N and Arbib MA (2003) Learning to Grasp I: The Infant Learning to Grasp Model (ILGM), to appear

  • Piaget J (1971) Biology and Knowledge. Edinburgh University Press, Edinburgh

    Google Scholar 

  • Prager JM and Arbib MA (1982) Computing the optic flow: The MATCH algorithm and prediction. Computer Vision, Graphics and Image Processing 24: 271–304

    Google Scholar 

  • Rall W(1995) Perspective on neuron model complexity. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, pp. 728–732. A Bradford Book/The MIT Press

  • Rizzolatti G and Arbib MA (1998) Language within our grasp. Trends in Neurosciences 21(5): 188–194

    Google Scholar 

  • Rizzolatti G, Camarda R, Fogassi L, Gentilucci M, Luppino G and Matelli M (1988) Functional oraganization of inferior Area 6 in the Macaque Monkey II. Area F5 and the control of distal movements. Exp Brain Res 71: 491–507

    Google Scholar 

  • Rizzolatti G, Fadiga L, Gallese V and Fogassi L (1996a) Premotor cortex and the recognition of motor actions. Cogn Brain Res 3: 131–141

    Google Scholar 

  • Rizzolatti G, Fadiga L, Matelli M, Bettinardi V, Perani D and Fazio F (1996) Localization of grasp representations in humans by positron emission tomography: 1. Observation versus execution. Exp Brain Res 111: 246–252

    Google Scholar 

  • Rosenblatt F (1958) The perceptron: A probabilistic model for information storage and organization in the brain. Psychol Rev 65: 386–408

    Google Scholar 

  • Rumelhart DE and McCelland JL (eds) (1986) Parallel Distributed Processing: Explorations in the Miscrostructure of Cognition. A Bradford Book/The MIT Press, Cambridge, MA

    Google Scholar 

  • Rumelhart DE, Hinton GE and Williams RJ (1986) Learning and internal representations by error propagation. In: Rumelhart D and McClelland J (eds) Parallel Distributed Processing: Explorations in the Microstructure of Cognition 1, pp. 318–362. The MIT Press

  • Schölkopf B and Smola AJ (2002) Learning with Kernels. The MIT Press, Cambridge, MA

    Google Scholar 

  • Stokoe WC (2001) Language in Hand: Why Sign Came Before Speech. Gallaudet University Press, Washington, DC

    Google Scholar 

  • Sutton RS and Barto AG (1998) Reinforcement Learning: An Introduction. The MIT Press, Cambridge, MA

    Google Scholar 

  • Taira M, Mine S, Georgopoulos AP, Murata A and Sakata H (1990) Parietal cortex neurons of the monkey related to the visual guidance of hand movement. Exp Brain Res 83: 29–36

    Google Scholar 

  • Turing AM (1936) On computable numbers with an application to the entscheidungsproblem. Proc London Math Soc Ser 2(42): 230–265

    Google Scholar 

  • Turing AM (1952) The chemical basis of morphogenesis. Phil Trans Roy Soc Lond B237: 37–72

    Google Scholar 

  • Umilta MA, Kohler E, Gallese V, Fogassi L, Fadiga L, Keysers C and Rizzolatti G (2001) I know what you are doing: A neurophysiological study. Neuron 31: 155–165

    Google Scholar 

  • Ungeleider LG and Mishkin M (1982) Two cortical visual systems. In: Ingle DJ, Goodale MA and Mansfield RJW (eds) Analysis of Visual Behavior. The MIT Press, Cambridge, MA

    Google Scholar 

  • von der Malsburg C (1988) Pattern recognition by labeled graph matching. Neural Networks 1: 141–148

    Google Scholar 

  • von Neumann J (1966) Theory of Self-Reproducing Automata (edited and completed by Burks AW). University of Illinois Press, Champaign, IL

    Google Scholar 

  • von Neumann J, Burks A and Goldsteine HH (1947-1948) Planning and Coding of Problems for an Electronic Computing Instrument. Institute for Advanced Study, Princeton (reprinted in von Neumann's, Collected Works 5: 80–235)

    Google Scholar 

  • Weitzenfeld A and Arbib MA (1994) NSL - Neural Simulation Language. In: Skrzypek J (ed) Neural Network Simulation Environments, pp. 73–93. Kluwer Academic Publishers, Boston, MA

    Google Scholar 

  • Wiener N (1948) Cybernetics: Or Control and Communication in the Animal and the Machine. The Technology Press and Wiley (Second Edition, The MIT Press, 1961)

  • Williams CKI (1998) Prediction with Gaussian processes: From linear regression to linear prediction and beyond. In: Jordan MI (ed) Learning in Graphical Models, pp. 599–621. Kluwer Academic Publishers, Dordrecht

    Google Scholar 

  • Willshaw DJ and von der Malsburg C (1976) How patterned neural connections can be set up by self-organization. Proc R Soc Lond B194: 431–445

    Google Scholar 

  • Zukow-Goldring P, Arbib MA and Oztop E (2002) Language and Mirror System: A Perception/Action Based Approach to Communicative Development (Working Draft, 22 June 2002)

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arbib, M.A. Towards a neurally-inspired computer architecture. Natural Computing 2, 1–46 (2003). https://doi.org/10.1023/A:1023390900317

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1023390900317

Navigation