Skip to main content
SpringerLink
Log in

Symbolic Processing Techniques in Connectionist Networks and Their Application to High-Level Cognitive Tasks

  • Conference paper
Book cover Wissensbasierte Systeme

Part of the book series: Informatik-Fachberichte ((INFORMATIK,volume 227))

  • 69 Accesses

Abstract

Symbolic and distributed connectionist systems live in distinct processing niches. Symbolic systems supply variables, bindings, logical rules, constituent structure, tokens (versus types), hierarchies and inheritance. In contrast, distributed connectionist systems supply statistically based associations, reconstructive memories, graceful error degradation, automatic category/prototype formation and generalization to novel instances. High-level cognitive tasks, such as language comprehension, require symbolic processing capabilities; however, the brain gains its robustness from its distributed connectionist nature. Clearly, a synthesis is desirable and this paper surveys a range of techniques, being explored at the UCLA Artificial Intelligence Laboratory, for giving symbolic capabilities to connectionist systems. These techniques include: 1) use of signature activation to represent bindings in localist, spreading activation networks, 2) parallel distributed semantic networks (PDS) for integrating distributed connectionist networks with the structure of semantic networks, 3) symbol recirculation methods for automatically forming distributed representations of symbols, and 4) tensor manipulation networks for binding distributed symbols.

The research reported here was supported in part by grants from the JTF Program of the DoD (monitored by JPL), the ITA Foundation, Office of Naval Research, the Keck Foundation and the Hughes Artificial Intelligence Center. Hardware grants in support of this research were supplied by Apollo Computer, Hewlitt-Packard, the Keck Foundation and the National Science Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Anderson, J. R. and E. Rosenfeld (eds.) Neurocomputing: Foundations of Research. Bradford Book/MIT Press, Cambridge MA. 1988.

    Google Scholar 

  • Chomsky, N. A Review of B. F. Skinner’s Verbal Behavior. In Language, Vol. 35, No.1, pp. 26–58. 1959.

    Article  Google Scholar 

  • Churchland, P. Neurophilosophy: Toward a Unified Science of Mind-Brain. MIT Press, Cambridge MA. 1986.

    Google Scholar 

  • Dolan, C. and M. G. Dyer. Symbolic Schemata, Role Binding and the Evolution of Structure in Connectionist Memories. Proceedings of the IEEE First Annual International Conference on Neural Networks. San Diego, CA, June 1987.

    Google Scholar 

  • Dolan, C. P. and M. G. Dyer. Parallel Retrieval and Application of Conceptual Knowledge. In Touretzky, Hinton and Sejnowski (Eds.). Proceedings of the 1988 Connectionist Models Summerschool. Morgan Kaufmann Publishers, San Mateo, CA. 1989.

    Google Scholar 

  • Dreyfus, H. L. and S. E. Dreyfus. Making a Mind Versus Modeling a Brain: Artificial Intelligence Back at a Branchpoint. Daedalus: Journal of the American Academy of Arts and Sciences. Special Issue on Artificial Intelligence, pp. 15-43. Winter, 1988.

    Google Scholar 

  • Dyer, M. G. In-Depth Understanding: A Computer Model of Integrated Processing for Narrative Comprehension. MIT Press. Cambridge, MA 1983.

    Google Scholar 

  • Dyer, M. G. Symbolic NeuroEngineering for Natural Language Processing: A Multilevel Research Approach. In J. Barnden and J. Pollack (Eds.). Advances in Connectionist and Neural Computation Theory. Ablex Publ. 1989 (in press).

    Google Scholar 

  • Dyer, M. G., Cullingford, R. & Alvarado, S. SCRIPTS. In Shapiro (ed.) Encyclopedia of Artificial Intelligence. John Wiley & Sons, 1987.

    Google Scholar 

  • Dyer, M. G., Flowers, M. and Wang, Y. A. Distributed Symbol Discovery through Symbol Recirculation: Toward Natural Language processing in Distributed Connectionist Networks. To appear in Reilly and Sharkey (Eds.). Connectionist Approaches to Natural Language Understanding. Horth-Holland Publ., (in press).

    Google Scholar 

  • Ellman, J. L. Finding Structure in Time. Technical Report 8801, Center for Research in Language. UCSD, San Diego. 1988.

    Google Scholar 

  • Feldman, J. A. Neural Representation of Conceptual Knowledge. In Nadel, Cooper, Culicover and Harnish (Eds.). Neural Connections, Mental Computation. MIT Press, Cambridge MA. 1989.

    Google Scholar 

  • Feldman, J. A. and D. H. Ballard, Connectionist Models and Their Properties. Cognitive Science. Vol. 6, 1982.

    Google Scholar 

  • Fodor, J. A. and Z. W. Pylyshyn. Connectionism and Cognitive Architecture: A Critical Analysis. In Pinker and Mehler (eds.) Connections and Symbols, Bradford books/MIT Press, 1988.

    Google Scholar 

  • Grossberg, S. (ed.) Neural Networks and Natural Intelligence. Bradford Books/MIT Press, Cambridge MA. 1988.

    Google Scholar 

  • Hendler, J. A. Integrated Marker-Passing and Problem-Solving: A Spreading Activation Approach to Improved Choice in Planning. Lawrence Erlbaum Associates, Hillsdale, NY. 1988.

    Google Scholar 

  • Hinton, G. E., McClelland, J. L. and D. E. Rumelhart. Distributed Representations. In Rumelhart and McClelland. Parallel Distributed Processing, Vol. 1, Bradford Book/MIT Press. 1986.

    Google Scholar 

  • Lachter, J. and T. G. Bever. The Relationship between Linguistic Structure and Associative Theories of Language learning - A Constructive Critique of Some Connectionist Learning Models. In Pinker and Mehler (eds.) Connections and Symbols, Bradford books/MIT Press, 1988.

    Google Scholar 

  • Lange, T. E. and M. G. Dyer. Dynamic, Non-Local Role Bindings and Inferencing in a Localist Network for Natural Language Understanding. In D. Touretzky (Ed.). Advances in Neural Information Processing Systems 1, Morgan Kaufmann Publ. San Mateo CA. 1989a.

    Google Scholar 

  • Lange, T. E. and M. G. Dyer. Frame Selection in a Connectionist Model of High-Level Inferencing. Proceedings of the Eleventh Annual Conference of the Cognitive Science Society (Cog- Sci-89), Ann Arbor MI, 1989.

    Google Scholar 

  • McClelland, J. L. and Kawamoto, A. H. Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences. In McClelland and Rumelhart (eds) Parallel Distributed Processing. Vol 2, Cambridge, MA: MIT Press/Bradford Books, 1986.

    Google Scholar 

  • Miikkulainen, R. & Dyer, M. G. Forming Global Representations with Extended Backpropagation. Proceedings of the IEEE Second Annual International Conference on Neural Networks (ICNN-88), San Diego, CA. July 1988.

    Google Scholar 

  • Miikkulainen, R. & Dyer, M. G. Encoding Input/Output Representations in Connectionist Cognitive Systems. In Touretzky, Hinton and Sejnowski (Eds.). Proceedings of the 1988 Connectionist Models Summerschool. Morgan Kaufmann Publishers, San Mateo, CA. 1989a.

    Google Scholar 

  • Miikkulainen, R. & Dyer, M. G. A Modular Neural Network Architecture for Sequential Paraphrasing of Script-Based Stories. Proceedings of the International Joint Conference on Neural Networks (IJCNN-89). Wash. D. C. 1989b.

    Google Scholar 

  • Minsky, M. A Framework for Representing Knowledge. In P. Winston (Ed.). Psychology of Computer Vision. McGraw-Hill, 1975.

    Google Scholar 

  • Newell, A. Physical Symbol Systems. Cognitive Science (2), 1980.

    Google Scholar 

  • Pinker, S. and J. Mehler (eds.). Connections and Symbols. Bradford Book, MIT Press, 1988. (Special issue of Cognition: An International Journal of Cognitive Science, Vol. 28).

    Google Scholar 

  • Pinker, S. and and Prince, A. On Language and Connectionism: Analysis of a Parallel Distributed Processing Model of Language Acquisition. In Pinker and Mehler (eds.) Connections and Symbols, Bradford books/MIT Press, 1988.

    Google Scholar 

  • Pollack, J. Recursive Auto-Associative Memory: Devising Compositional Distributed Representations. Proceedings of the Tenth Annual Conference of the Cognitive Science Society (Cog-Sci-88). Montreal, 1988.

    Google Scholar 

  • Reeke Jr., G. N. and G. M. Edelman. Real Brains and Artificial Intelligence. Daedalus: Journal of the American Academy of Arts and Sciences. Special Issue on Artificial Intelligence, pp. 143-173. Winter, 1988.

    Google Scholar 

  • Rumelhart, D. E., J. L. McClelland (Eds.) Parallel Distributed Processing: Explorations into the Microstructure of Cognition (Vols. 1 and 2). Bradford Book/MIT Press, Cambridge, MA. 1986a.

    Google Scholar 

  • Rumelhart, D., Hinton, G. and R. Williams. Learning Internal Representations by Error Propagation. In Rumelhart & McClelland, Parallel Distributed Processing. 1986.

    Google Scholar 

  • Schank, R. C. and R. Abelson, Scripts, Plans, Goals and Understanding, Hillsdale, NJ: LEA Press, 1977.

    MATH  Google Scholar 

  • Shastri, L. Semantic Networks: An Evidential Formalization and its Connectionist Realization. Morgan Kaufmann Publ. SAn Mateo, CA. 1988.

    MATH  Google Scholar 

  • Smolensky, P. A Method for Connectionist Variable Binding. Technical Report CU-CS-356- 87, Dept. of Computer Science and Institute of Cognitive Science, Univ. of Colorado, Boulder, CO, 1987.

    Google Scholar 

  • Smolensky, P. “On the Proper Treatment of Connectionism”, The Behavioral and Brain Sciences, Vol. 11, No. 1, 1988.

    Google Scholar 

  • Sumida, R.A. and M. G. Dyer. Storing and Generalizing Multiple Instances while Maintaining Knowledge-Level Parallelism. Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89). Detroit, MI, 1989.

    Google Scholar 

  • Touretzky, D. S. (Ed.). Advances in Neural Information Processing Systems 1. Morgan Kaufman Publishers, CA. 1989.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, UCLA, 3532 Boelter Hall, Los Angeles, CA, 90024, USA

    Michael G. Dyer

Authors
  1. Michael G. Dyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institut für Informatik, Technische Universität München, Postfach 202420, D-8000, München 2, Germany

    W. Brauer  & C. Freksa  & 

Rights and permissions

Reprints and permissions

Copyright information

© 1989 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Dyer, M.G. (1989). Symbolic Processing Techniques in Connectionist Networks and Their Application to High-Level Cognitive Tasks. In: Brauer, W., Freksa, C. (eds) Wissensbasierte Systeme. Informatik-Fachberichte, vol 227. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-75182-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-75182-0_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-51838-9

  • Online ISBN: 978-3-642-75182-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation