Abstract
Using associative memories and sparse distributed representations we have developed a system that can learn to associate words with objects, properties like colors, and actions. This system is used in a robotics context to enable a robot to respond to spoken commands like ”bot show plum” or ”bot put apple to yellow cup”. This involves parsing and understanding of simple sentences and “symbol grounding”, for example, relating the nouns to concrete objects sensed by the camera and recognized by a neural network from the visual input.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pulvermüller, F.: Words in the brain’s language. Behavioral and Brain Sciences 22, 253–336 (1999)
Hebb, D.: The organization of behavior. A neuropsychological theory. Wiley, New York (1949)
Braitenberg, V.: Cell assemblies in the cerebral cortex. In: Heim, R., Palm, G. (eds.) Theoretical approaches to complex systems. Lecture notes in biomathematics (21), pp. 171–188. Springer, Heidelberg (1978)
Palm, G.: Neural Assemblies. An Alternative Approach to Artificial Intelligence. Springer, Berlin (1982)
Palm, G.: Cell assemblies as a guideline for brain research. Concepts in Neuroscience 1, 133–148 (1990)
Palm, G.: On the internal structure of cell assemblies. In: Aertsen, A. (ed.) Brain Theory. Elsevier, Amsterdam (1993)
Palm, G.: Local rules for synaptic modification in neural networks. Journal of Computational Neuroscience (1990)
Palm, G.: Rules for synaptic changes and their relevance for the storage of information in the brain. Cybernetics and Systems Research (1982)
Palm, G.: Associative memory and threshold control in neural networks. In: Casti, J., Karlqvist, A. (eds.) Real Brains - Artificial Minds. North-Holland, New York (1987)
Rizzolatti, G., Fadiga, L., Fogassi, L., Gallese, V.: Resonance behaviors and mirror neurons. Archives Italiennes de Biologie 137, 85–100 (1999)
Fay, R., Kaufmann, U., Knoblauch, A., Markert, H., Palm, G.: Combining visual attention, object recognition and associative information processing in a neurobotic system. In: [27]
Fay, R., Kaufmann, U., Knoblauch, A., Markert, H., Palm, G.: Integrating object recognition, visual attention, language and action processing on a robot in a neurobiologically plausible associative architecture. Accepted at Ulm NeuroRobotics workshop (2004)
Knoblauch, A.: Synchronization and pattern separation in spiking associative memory and visual cortical areas. PhD thesis, Department of Neural Information Processing, University of Ulm, Germany (2003)
Knoblauch, A., Fay, R., Kaufmann, U., Markert, H., Palm, G.: Associating words to visually recognized objects. In: Coradeschi, S., Saffiotti, A. (eds.) Anchoring symbols to sensor data. Papers from the AAAI Workshop. Technical Report WS-04-03, pp. 10–16. AAAI Press, Menlo Park (2004)
Pulvermüller, F.: The neuroscience of language: on brain circuits of words and serial order. Cambridge University Press, Cambridge (2003)
Knoblauch, A., Pulvermüller, F.: Sequence detector networks and associative learning of grammatical categories. In: [27]
Hopcroft, J., Ullman, J.: Formal languages and their relation to automata. Addison-Wesley, Reading (1969)
Chomsky, N.: Syntactic structures. Mouton, The Hague (1957)
Willshaw, D., Buneman, O., Longuet-Higgins, H.: Non-holographic associative memory. Nature 222, 960–962 (1969)
Palm, G.: On associative memories. Biological Cybernetics 36, 19–31 (1980)
Palm, G.: Memory capacities of local rules for synaptic modification. A comparative review. Concepts in Neuroscience 2, 97–128 (1991)
Schwenker, F., Sommer, F., Palm, G.: Iterative retrieval of sparsely coded associative memory patterns. Neural Networks 9, 445–455 (1996)
Sommer, F., Palm, G.: Improved bidirectional retrieval of sparse patterns stored by hebbian learning. Neural Networks 12, 281–297 (1999)
Hopfield, J.: Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Science, USA 79, 2554–2558 (1982)
Knoblauch, A., Palm, G.: Pattern separation and synchronization in spiking associative memories and visual areas. Neural Networks 14, 763–780 (2001)
Fay, R., Kaufmann, U., Schwenker, F., Palm, G.: Learning object recognition in an neurobotic system. Acctepted at 3rd workshop SOAVE 2004 - SelfOrganization of AdaptiVE behavior, Illmenau, Germany (2004)
Wermter, S., Palm, G., Elshaw, M. (eds.): Biomimetic Neural Learning for Intelligent Robots. LNCS (LNAI), vol. 3575. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Markert, H., Knoblauch, A., Palm, G. (2005). Detecting Sequences and Understanding Language with Neural Associative Memories and Cell Assemblies. In: Wermter, S., Palm, G., Elshaw, M. (eds) Biomimetic Neural Learning for Intelligent Robots. Lecture Notes in Computer Science(), vol 3575. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11521082_7
Download citation
DOI: https://doi.org/10.1007/11521082_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27440-7
Online ISBN: 978-3-540-31896-5
eBook Packages: Computer ScienceComputer Science (R0)