Abstract
Neurocognitive processes responsible for representation of meaning and understanding of words are investigated. First a review of current knowledge about word representation, recent experiments linking it to associative memory and to right hemisphere synchronous activity is presented. Various conjectures on how meaning arises and how reasoning and problem solving is done are presented. These inspirations are used to make systematic approximation to spreading activation in semantic memory networks. Using hierarchical ontologies representations of short texts are enhanced and it is shown that high-dimensional vector models may be treated as a snapshot approximation of the neural activity. Clustering short medical texts into different categories is greatly enhanced by this process, thus facilitating understanding of the text.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Rumelhart, D.E., McClelland, J.L. (eds.): Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1 & 2. MIT Press, Cambridge (1986)
Lamb, S.: Pathways of the Brain: The Neurocognitive Basis of Language. J. Benjamins Publishing, Amsterdam & Philadelphia (1999)
Pulvermüller, F.: The Neuroscience of Language. On Brain Circuits of Words and Serial Order. Cambridge University Press, Cambridge, UK (2003)
Pulvermüller, F., Shtyrov, Y., Ilmoniemi, R.: Brain signatures of meaning access in action word recognition. Journal of Cognitive Neuroscience 17, 884–892 (2005)
Crestani, F.: Application of Spreading Activation Techniques in Information Retrieval. Artifical Intelligence Review 11, 453–482 (1997)
Crestani, F., Lee, P.L.: Searching the web by constrained spreading activation. Information Processing & Management 36, 585–605 (2000)
Tsatsaronis, G., Vazirgiannis, M., Androutsopoulos, I.: Word Sense Disambiguation with Spreading Activation Networks Generated from Thesauri, 20th Int. Joint Conf. in Artificial Intelligence, Hyderabad, India, pp. 1725–1730 (2007)
Manning, C.D, Schütze, H.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA (1999)
Caplan, D., Waters, G.S.: Verbal working memory and sentence comprehension. Behavioral and Brain Sciences 22, 77–94 (1999)
Damasio, H., Grabowski, T.J., Tranel, D., Hichwa, R.D., Damasio, A.R.: A neural basis for lexical retrieval. Nature 380, 499–505 (1996)
Martin, A., Wiggs, C.L, Ungerleider, L.G, Haxby, J.V: Neural correlates of category-specific knowledge. Nature 379, 649–652 (1996)
Collins, A.M., Loftus, E.F.: A spreading-activation theory of semantic processing. Psychological Reviews 82, 407–428 (1975)
Collins, A.M., Quillian, M.R.: Retrieval time from semantic memory. Journal of Verbal Learning and Verbal Behavior 8, 240–247 (1969)
Sowa, J.F. (ed.): Principles of Semantic Networks: Explorations in the Representation of Knowledge. Morgan Kaufmann Publishers, San Mateo, CA (1991)
Lehmann, F.(eds.): Semantic Networks in Artificial Intelligence. Pergamon, Oxford (1992)
Szymanski, J., Sarnatowicz, T., Duch, W.: Towards Avatars with Artificial Minds: Role of Semantic Memory. Journal of Ubiquitous Computing and Intelligence (in press)
Szymanski, J., Duch, W. (eds.): Semantic Memory Knowledge Acquisition Through Active Dialogues. Int. Joint Conf. on Neural Networks (in press). IEEE Press, Orlando (2007)
UMLS Knowledge Sources, available at http://www.nlm.nih.gov/research/umls
Bowden, E.M., Jung-Beeman, M., Fleck, J., Kounios, J.: New approaches to demystifying insight. Trends in Cognitive Science 9, 322–328 (2005)
Jung-Beeman, M., Bowden, E.M., Haberman, J., Frymiare, J.L., Arambel-Liu, S., Greenblatt, R., Reber, P.J.: Neural activity when people solve verbal problems with insight. PLoS Biology 2, 500–510 (2004)
Gaillard, R., Naccache, L., Pinel, P., Clémenceau, S., Volle, E., Hasboun, D., Dupont, S., Baulac, M., Dehaene, S., Adam, C., Cohen, L.: Direct intracranial, FMRI, and lesion evidence for the causal role of left inferotemporal cortex in reading. Neuron 50, 19–204 (2006)
Matykiewicz, P., Duch, W., Pestian, J.: Nonambiguous Concept Mapping in Medical Domain, Lecture Notes in Artificial Intelligence. In: Rutkowski, L., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2006. LNCS (LNAI), vol. 4029, pp. 941–950. Springer, Heidelberg (2006)
Itert, L., Duch, W., Pestian, J.: Medical document categorization using a priori knowledge. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3696, pp. 641–646. Springer, Heidelberg (2005)
Mednick, S.A.: The associative basis of the creative process. Psychological Review 69, 220–232 (1962)
Gruszka, A., Nęcka, E.: Priming and acceptance of close and remote associations by creative and less creative people. Creativity Research Journal 14, 193–205 (2002)
Duch, W., Pilichowski, M.: Experiments with computational creativity. Neural Information Processing – Letters and Reviews 11 (in press 2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Duch, W., Matykiewicz, P., Pestian, J. (2007). Towards Understanding of Natural Language: Neurocognitive Inspirations. In: de Sá, J.M., Alexandre, L.A., Duch, W., Mandic, D. (eds) Artificial Neural Networks – ICANN 2007. ICANN 2007. Lecture Notes in Computer Science, vol 4669. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74695-9_97
Download citation
DOI: https://doi.org/10.1007/978-3-540-74695-9_97
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74693-5
Online ISBN: 978-3-540-74695-9
eBook Packages: Computer ScienceComputer Science (R0)