Skip to main content

Modelling Lexical Decision Using Corpus Derived Semantic Representations in a Connectionist Network

  • Conference paper
4th Neural Computation and Psychology Workshop, London, 9–11 April 1997

Part of the book series: Perspectives in Neural Computing ((PERSPECT.NEURAL))

  • 120 Accesses

Abstract

Connectionist models of the mapping from orthography or phonology to random binary semantic vectors allow the simulation of lexical decision with reaction times that show patterns of semantic and associative priming similar to those found experimentally with human subjects. The co-occurrence statistics of words in large corpora allow the generation of vectors whose distribution correlates with the perceived semantic relatedness of the words. Here we discuss the use of these more realistic corpus derived semantic representations in connectionist models of lexical decision. We find lexical decision priming that correlates with distances in the semantic vector space, but the reaction times are very noisy. Averages over many words and/or many networks are required for the relationships to become clear. The question of associative priming remains open.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Neely JH. Semantic Priming Effects in Visual Word Recognition: A Selective Review of Current Findings and Theories. In Besner Dand Humphreys GW (Eds) Basic Processes in Reading: Visual Word Recognition. Erlbaum, Hillsdale NJ, 1991, pp 264–336

    Google Scholar 

  2. Shelton JR and Martin RC. How Semantic is Automatic Semantic Priming? Journal of Experimental Psychology: Learning, Memory and Cognition 1992; 18: 191–210

    Google Scholar 

  3. Moss HE, Ostrin RK, Tyler LK and Marslen-Wilson WD. Accessing Different Types of Lexical Semantic Information: Evidence From Priming. Journal of Experimental Psychology: Learning, Memory and Cognition 1995; 21: 1–21

    Google Scholar 

  4. Plaut DC. Semantic and Associative Priming in a Distributed Attractor Network. Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society. Erlbaum, Mahwah NJ, 1995, pp 37–42

    Google Scholar 

  5. Bullinaria JA. Modelling Lexical Decision: Who Needs a Lexicon? In Keating JG (Ed) Neural Computing Research and Applications III. St. Patrick’s College, Maynooth Ireland, 1995, pp 62–69

    Google Scholar 

  6. Lund K, Burgess C and Atchley RA. Semantic and Associative Priming in High-Dimensional Semantic Space. Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society. Erlbaum, Mahwah NJ, 1995, pp 660–665

    Google Scholar 

  7. Plaut DC and Shallice T. Deep Dyslexia: A Case Study of Connectionist Neuropsychology. Cognitive Neuropsychology 1993; 10: 377–500

    Article  Google Scholar 

  8. McClelland JL. On the Time Relations of Mental Processes: An Examination of Systems of Processes in Cascade. Psychological Review 1979; 86: 287–330

    Article  Google Scholar 

  9. Moss HE, Hare ML, Day P and Tyler LK. A Distributed Memory Model of the Associative Boost in Semantic Priming. Connection Science 1994; 6: 413–427

    Article  Google Scholar 

  10. Brown PF, Della Pietra VJ, deSouza PV, Lai JC and Mercer RL. Class-based n-gram models of natural language. Computational Linguistics 1992; 18: 467–479

    Google Scholar 

  11. Huckle C. Grouping Words Using Statistical Context. Proceedings of the Seventh Conference of the European Chapter of the Association for Computational Linguistics. Morgan Kaufmann, San Francisco CA, 1995, pp 278–280

    Book  Google Scholar 

  12. Landauer TK and Dumais ST. A Solution to Plato’s Problem: The Latent Semantic Analysis Theory of Acquisition, Induction and Representation of Knowledge. Psychological Review 1997; 104: 211–240

    Article  Google Scholar 

  13. Schütze H. Word Space. In Hanson SJ, Cowan JD and Giles CL (Eds) Advances in Neural Information Processing Systems 5. Morgan Kauffmann, San Mateo CA, 1993, pp 895–902

    Google Scholar 

  14. Patel M, Bullinaria JA and Levy JP. Extracting Semantic Representations from Large Text Corpora. Proceedings of the Fourth Neural Computation and Psychology Workshop. Springer Verlag, London, 1997

    Google Scholar 

  15. Zipf GK. The Psycho-biology of Language. Houghton Mifflin, Boston, 1935

    Google Scholar 

  16. Bullinaria JA. Modelling Reaction Times. In Smith LS and Hancock PJB (Eds), Neural Computation and Psychology. Springer, London, 1997, pp 34–48

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag London Limited

About this paper

Cite this paper

Bullinaria, J.A., Huckle, C.C. (1998). Modelling Lexical Decision Using Corpus Derived Semantic Representations in a Connectionist Network. In: Bullinaria, J.A., Glasspool, D.W., Houghton, G. (eds) 4th Neural Computation and Psychology Workshop, London, 9–11 April 1997. Perspectives in Neural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-1546-5_17

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-1546-5_17

  • Publisher Name: Springer, London

  • Print ISBN: 978-3-540-76208-9

  • Online ISBN: 978-1-4471-1546-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics