Skip to main content

Compositionality and Contextuality: The Symbolic and Statistical Theories of Meaning

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11939))

Abstract

Compositionality and contextuality give two fundamental principles of linguistic analysis, and yet there is a conflict between them as Burge, Dummett, and others find. Here we aim at elucidating conceptual views underlying their tension in light of both symbolic and statistical paradigms of semantics, arguing, inter alia, that: (i) the conflict is a case of vicious circle analogous to hermeneutic circularity, and may be understood as a tension between symbolic and statistical semantics; (ii) the productivity, systematicity, and learnability of language can be accounted for in accordance with the principle of contextuality as well as compositionality; and (iii) the Chomsky versus Norvig debate on the (symbolic versus statistical) nature of language may be considered a broader manifestation of the tension in the form of the traditional conflict in philosophy between rationalist and empiricist worldviews. We conclude the paper with an outlook for the Kantian synthesis of them, especially the categorical integration of symbolic and statistical AI.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Baroni, M., et al.: Frege in space: a program of compositional distributional semantics. Linguist. Issues Lang. Technol. 9, 5–110 (2014)

    Google Scholar 

  2. Bourguignat, C.: Interpretable VS Powerful Predictive Models: Why We Need Them Both, Medium, 17 September 2014. Accessed on 16 July 2019

    Google Scholar 

  3. Burge, T.: Truth, Thought, Reason: Essays on Frege. Clarendon, Oxford (2005)

    Book  Google Scholar 

  4. Chomsky, N.: Syntactic Structures. Mouton & Co, Berlin (1957)

    MATH  Google Scholar 

  5. Chomsky, N.: Recent contributions to the theory of innate ideas. In: Stitch, S. (ed.) Innate Ideas. California University Press, Berkeley (1975)

    MATH  Google Scholar 

  6. Chomsky, N., Ronat, M.: Language and Responsibility: Based on Conversations with Mitsou Ronat. Pantheon Books, Paris (1979)

    Google Scholar 

  7. Chomsky, N.: Keynote Panel: The Golden Age - A Look at the Original Roots of Artificial Intelligence, Cognitive Science, and Neuroscience, MIT Symposium on Brains, Minds, and Machines. Accessed on 23 June 2019

    Google Scholar 

  8. Coecke, B., et al.: Mathematical foundations for a compositional distributional model of meaning. Linguist. Anal. 36, 345–384 (2010)

    Google Scholar 

  9. Davidson, D.: Truth and Meaning. Synthese 17, 304–323 (1967)

    Article  Google Scholar 

  10. Domingos, P., et al.: Unifying logical and statistical AI. In: Proceedings of the 31st Annual ACM/IEEE Symposium on Logic in Computer Science, pp. 1–11 (2016)

    Google Scholar 

  11. Dummett, M.: The Interpretation of Frege’s Philosophy. Duckworth, London (1981)

    Google Scholar 

  12. Evans, J.: The History and Practice of Ancient Astronomy. Oxford University Press, Oxford (1998)

    Google Scholar 

  13. Frege, G.: The Foundations of Arithmetic. Basil Blackwell, Oxford (1953). (originally 1884)

    MATH  Google Scholar 

  14. Frege, G.: Compound thoughts. Mind 72, 1–17 (1963). (originally 1923)

    Article  Google Scholar 

  15. Frege, G.: The Philosophical and Mathematical Correspondence. University of Chicago Press, Chicago (1980)

    MATH  Google Scholar 

  16. Gold, K.: Norvig vs. Chomsky and the Fight for the Future of AI, TOR.COM, 21 June 2011. Accessed on 26 June 2019

    Google Scholar 

  17. Janssen, T.: Frege, contextuality and compositionality. J. Logic Lang. Inf. 10, 87–114 (2001)

    Article  MathSciNet  Google Scholar 

  18. Katz, Y.: Noam Chomsky on Where Artificial Intelligence Went Wrong, The Atlantic, 1 November 2012. Accessed on 23 June 2019

    Google Scholar 

  19. Kuhn, M., Johnson, K.: Applied Predictive Modeling. Springer, New York (2013). https://doi.org/10.1007/978-1-4614-6849-3

    Book  MATH  Google Scholar 

  20. Landauer, T.: On the computational basis of learning and cognition: arguments from LSA. Psychol. Learn. Motiv. 41, 43–84 (2002)

    Article  Google Scholar 

  21. Markie, P.: Rationalism vs. Empiricism, Stanford Encyclopedia of Philosophy (2017)

    Google Scholar 

  22. Maxwell, J.C.: The Scientific Letters and Papers of James Clerk Maxwell: 1846–1862. Cambridge University Press, Cambridge (1990)

    MATH  Google Scholar 

  23. Norvig, P.: On chomsky and the two cultures of statistical learning. Berechenbarkeit der Welt?, pp. 61–83. Springer, Wiesbaden (2017). https://doi.org/10.1007/978-3-658-12153-2_3

    Chapter  Google Scholar 

  24. Pelletier, F.J.: The principle of semantic compositionality. Topoi 13, 11–24 (1994)

    Article  MathSciNet  Google Scholar 

  25. Pelletier, F.J.: Did frege believe frege’s principle? J. Logic Lang. Inf. 10, 87–114 (2001)

    Article  MathSciNet  Google Scholar 

  26. Szabó, Z.G.: Compositionality, Stanford Encyclopedia of Philosophy (2017)

    Google Scholar 

  27. Turney, P., Pantel, P.: From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 37, 141–188 (2010)

    Article  MathSciNet  Google Scholar 

  28. Wittgenstein, L.: Tractatus Logico-Philosophicus. Humanities Press, New York (1961). (originally 1922)

    MATH  Google Scholar 

  29. Wittgenstein, L.: Zettel. University of California Press, California (1967)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yoshihiro Maruyama .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Maruyama, Y. (2019). Compositionality and Contextuality: The Symbolic and Statistical Theories of Meaning. In: Bella, G., Bouquet, P. (eds) Modeling and Using Context. CONTEXT 2019. Lecture Notes in Computer Science(), vol 11939. Springer, Cham. https://doi.org/10.1007/978-3-030-34974-5_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-34974-5_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-34973-8

  • Online ISBN: 978-3-030-34974-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics