Skip to main content
Springer Nature Link
Log in

Connectionist Representations for Natural Language: Old and New

  • Conference paper
Konnektionismus in Artificial Intelligence und Kognitionsforschung

Part of the book series: Informatik-Fachberichte ((INFORMATIK,volume 252))

  • 75 Accesses

Abstract

Connectionist natural language processing research has been in the literature for less than a decade and yet it is already claimed that it has established a whole new way of looking at representation. This article presents a survey of the main representational techniques employed in connectionist research on natural language processing and assesses claims as to their novelty value i.e. whether or not they add anything new to Classical representation schemes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  • Chalmers, D.J. (in press) Syntactic Transformations on Distributed Representations. Connection Science, 2.1.

    Google Scholar 

  • Cottrell, G.W. (1985) A Connectionist Approach to Word Sense Disambiguation. PhD Thesis, TR154, Department of Computer Science, University of Rochester, NY.

    Google Scholar 

  • Cottrell, G.W., Munro, P. & Zipser, D. (1989) Image Compression by Back Propagation: An Example of Extensional Programming. In N.E. Sharkey (Ed) Models of Cognition: A Review of Cognitive Science. Norwood, N.J.: Ablex.

    Google Scholar 

  • Dolan, C.P. & Smolensky, P. (1989) Tensor Production System: a Modular Architecture and Representation. Connection Science 1(1), 53–68.

    Article  Google Scholar 

  • Elman, J.L (1988) Finding the structure in time. TR 880, CRL, University of California, San Diego.

    Google Scholar 

  • Elman, J.L. (1989) Representation and structure in connectionist models. IR 8903, CRL, University of California, San Diego.

    Google Scholar 

  • Feldman, J.A. (1989) Neural Representation of Conceptual Knowledge. In N.E. Sharkey (Ed) Models of Cognition: A Review of Cognitive Science. Norwood, N.J.: Ablex.

    Google Scholar 

  • Fillmore, C.J. (1968) The Case for Case. In E. Bach and R. Harris (Eds) Universalsin Linguistic Theory. Holt, Rhinehart & Winston.

    Google Scholar 

  • Fodor, J.A. & McLaughlin, B. (1990) Connectionism and the Problems of Systemacity I:Why Smolensky’s Solution Doesn’t Work. Cognition, 35, 183–204.

    Article  Google Scholar 

  • Fodor, J.A, & Pylyshyn, Z.W. (1988). Connectionism and Cognitive Architecture: A Critical Analysis. Cognition, 28, 2–71.

    Article  Google Scholar 

  • Hinton, G.E. (1981) Implementing Semantic Networks in Parallel Hardware. In G.E. Hinton & J.A. Anderson (Eds) Parallel Models of Associative Memory. Hillsdale, N.J.: Lawrence Erlbaum.

    Google Scholar 

  • Hinton, G.E. (1986) Learning Distributed Representations of Concepts. Proceedings of the Eighth Annual Conference of the Cognitive Science Society.

    Google Scholar 

  • Hinton, G.E. (1989) Connectionist Learning Procedures. Artificial Intelligence, 40, 184–235.

    Article  Google Scholar 

  • Hinton, G.E., McClelland, J.L. & Rumelhart, D.E. (1986) Distributed Representations. In D.E. Rumelhart & J.L. McClelland (Eds) Parallel Distributed Processing, Volume 1. Cambridge, MA: MIT.

    Google Scholar 

  • Hopfield, J.J. (1982) Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy of Sciences, USA, 79, 2554–2558.

    Article  MathSciNet  Google Scholar 

  • Hornik, K. Stinchcombe, M. & White, H. (1989) Multilayer Feedfoewrad Network are Univesal Approximators. Discussion paper 88–45R. Department of Economics, UCSD.

    Google Scholar 

  • Jordan, M.I. (1986) Attractor Dynamics and parallelism in a Connectionist Sequential Machine. Proceedings of the 8th Annual Conference of the Cognitive Science Society, Amherst, MA. 531–545.

    Google Scholar 

  • Kohonen, T. (1982) Clustering, Taxonomy, and Topological Maps of Patterns. In M. Lang (Ed) Proceedings of the Sixth International Conference on Pattern Recognition. Silver Spring, MD: IEEE Computer Society Press.

    Google Scholar 

  • Kolen, J.F. & Pollack, J.B. (1990) Back Propagation is Sensitive to Initial Conditions. Technical Report 90-JK-BPSIC. Ohio Satat University.

    Google Scholar 

  • McClelland, J.L. & Kawamoto A.H. (1986) Mechanisms of Sentence Processing:Assigning Roles to Constituents. In J.L. McClelland & D.E. Rumelhart (Eds) Parallel Distributed Processing Volume 2. Cambridge, MA: MIT.

    Google Scholar 

  • McClelland, J.L. & Rumelhart, D.E. (1981) An Interactive Activation Model of Effects in Letter Perception: Part I. An Account of Basic Findings. Psychological Review, 88, 375–407.

    Article  Google Scholar 

  • Miikkulainen, R. & Dyer, M. G. (1987) Building Distributed Representations without Microfeatures. Technical Report UCLA-AI-87–17, AI Laboratory, Computer Science Department, University of California at Los Angeles, CA.

    Google Scholar 

  • Minsky, M. (1975) A Framework for Representing Knowledge. In P.H. Winston (Ed) The Psychology of Computer Vision. New York: McGraw-Hill.

    Google Scholar 

  • Minsky, M. (1975) A Framework for Representing Knowledge. In P.H. Winston (Ed) The Psychology of Computer Vision. New York: McGraw-Hill.

    Google Scholar 

  • Robbins, A. (1989) The Distributed Representation of Type and Category. Connection Science1. 4.

    Article  Google Scholar 

  • Schank, R.C. (1972) Conceptual dependency: a theory of natural language understanding. Cognitive Psychology, 3, 552–631.

    Article  Google Scholar 

  • Sejnowski, T.J. & Rosenberg, C.R. (1986) A Parallel Network that Learns to Read Out Loud. Technical Report JHU/SECS-86/01. John Hopkins University.

    Google Scholar 

  • Servan-Schreiber, D., Cleermans, A., & McClelland, J.L. (1988) Encoding sequential structure in simple recurrent nets. TR CMU-CS-88–183. Computer Science department, Carnegie-Mellon University.

    Google Scholar 

  • Sharkey, N.E. (1989a) The Lexical Distance Model and Word Priming. Proceedings of the Eleventh Cognitive Science Society.

    Google Scholar 

  • Sharkey, N.E. (1989b) Lexical Representations for Prepositional Attachment. Report to British Telecom CONNEX Project.

    Google Scholar 

  • Sharkey, N.E. (1989c) A PDP Learning Approach to Natural Language Understanding. In I. Aleksander (Ed) Neural Computing Architectures. London: North Oxford Academic.

    Google Scholar 

  • Sharkey, N.E. (1989c) A PDP Learning Approach to Natural Language Understanding. In I. Aleksander (Ed) Neural Computing Architectures. London: North Oxford Academic.

    Google Scholar 

  • Shastri L. & Feldman J.A. (1986) Neural Nets, Routines and Semantic Networks. In N.E. Sharkey (Ed) Advances in Cognitive Science. Chichester: Ellis Horwood.

    Google Scholar 

  • Shastri L. & Feldman J.A. (1986) Neural Nets, Routines and Semantic Networks. In N.E. Sharkey (Ed) Advances in Cognitive Science. Chichester: Ellis Horwood.

    Google Scholar 

  • Smolensky, P. (1988) On the Proper Treatment of Connectionism. Behavioraland Brain Sciences, 11, 1–74.

    Article  Google Scholar 

  • Smolensky, P. (1988) On the Proper Treatment of Connectionism. Behavioraland Brain Sciences, 11, 1–74.

    Article  Google Scholar 

  • Smolensky, P. (1988) On the Proper Treatment of Connectionism. Behavioraland Brain Sciences, 11, 1–74.

    Article  Google Scholar 

  • Touretzky, D.S. & Geva, S. (1987) A Distributed Connectionist Representation for Concept Structures. Proceedings of the Ninth Annual Conference of the Cognitive Science Society, 155–164.

    Google Scholar 

  • Touretzky, D.S. & Hinton, G.E. (1988) A Distributed Connectionist Production System. Cognitive Science 12(3), 423 - 466.

    Article  Google Scholar 

  • Van Gelder, T. (1990) Compositionality: a Connectionist Variation on a Classical Theme. Cognitive Science, 14.

    Google Scholar 

  • Wickelgren, W.W.A.(1969) Context-sensitive coding, associative memory, and serial order in (speech) behavior. Psychological Review, 76, 1–15.

    Article  Google Scholar 

  • Willshaw, D.J. & von der Malsburg, C. (1979) A Marker Induction Mechanism for the Establishment of Ordered Neural Mapping: Its Application to the Retino-tectal Connections. In Philos, Trans, Roy, Soc. Lond. B 287, 203 - 243.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Exeter, UK

    Noel E. Sharkey

Authors
  1. Noel E. Sharkey
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institut für Medizinische Kybernetik und Artificial Intelligence, Universität Wien, Freyung 6/2, A-1010, Wien, Österreich

    Georg Dorffner

Rights and permissions

Reprints and permissions

Copyright information

© 1990 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sharkey, N.E. (1990). Connectionist Representations for Natural Language: Old and New. In: Dorffner, G. (eds) Konnektionismus in Artificial Intelligence und Kognitionsforschung. Informatik-Fachberichte, vol 252. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-76070-9_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-76070-9_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-53131-9

  • Online ISBN: 978-3-642-76070-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation