Skip to main content

Wide Coverage Incremental Parsing by Learning Attachment Preferences

  • Conference paper
  • First Online:
AI*IA 2001: Advances in Artificial Intelligence (AI*IA 2001)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2175))

Included in the following conference series:

Abstract

This paper presents a novel method for wide coverage parsing using an incremental strategy, which is psycholinguistically motivated. A recursive neural network is trained on treebank data to learn first pass attachments, and is employed as a heuristic for guidingpa rsingde cision. The parser is lexically blind and uses beam search to explore the space of plausible partial parses and returns the full analysis havinghi ghest probability. Results are based on preliminary tests on the WSJ section of the Penn treebank and suggest that our incremental strategy is a computationally viable approach to parsing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Bader and I. Lasser. German verb-final clauses and sentence processing. In C. Clifton, L. Frazier, and K. Reyner, editors, Perspectives on Sentence Processing, pages-. Lawrence Erlbaum Associates, 1994.

    Google Scholar 

  2. E. Charniak. Statistical parsingw ith a context-free grammar and word statistics. In Proc. of AAAI97, 1997.

    Google Scholar 

  3. M. Collins. A new statistical parser based on bigram lexical dependencies. In Proc. of 34th ACL, pages 184–191, 1996.

    Google Scholar 

  4. K. M. Eberhard, M. J. Spivey-Knowlton, J.C. Sedivy, and M. K. Tanenhaus. Eye movements as a window into real-time spoken language comprehension in natural contexts. Journal of Psycholinguistic Research, 24:409–436, 1995.

    Article  Google Scholar 

  5. P. Frasconi, M. Gori, and A. Sperduti. A general framework for adaptive processingo f data structures. IEEE Trans. on Neural Networks, 9(5):768–786, 1998.

    Article  Google Scholar 

  6. L. Frazier. Syntactic processing: Evidence from dutch. Natural Language and Linguistic Theory, 5:519–559, 1987.

    Article  Google Scholar 

  7. U. Hermjakob and R. J. Mooney. Learningp arse and translation decisions from examples with rich context. In Proceedings of ACL97, pages 482–489, 1997.

    Google Scholar 

  8. Y. Kamide and D. C. Mitchell. Incremental pre-head attachment in japanese parsing. Language and Cognitive Processes, 14(5-6):631–662, 1999.

    Article  Google Scholar 

  9. P.C.R. Lane and J.B. Henderson. Incremental syntactic parsingof natural language corpora with simple synchrony networks. IEEE Transactions on Knowledge and Data Engineering, 13(2):219–231, 2001.

    Article  Google Scholar 

  10. V. Lombardo and P. Sturt. Incrementality and lexicalism: A treebank study. In S. Stevenson and P. Merlo, editors, Lexical Representations in Sentence Processing. John Benjamins, 1999.

    Google Scholar 

  11. W. Marslen-Wilson. Linguistic structure and speech shadowing at very short latencies. Nature, 244:522–533, 1973.

    Article  Google Scholar 

  12. D. Milward. Dynamic dependency grammar. Linguistics and Philosophy, 17(6), 1994.

    Google Scholar 

  13. D.C. Mitchell, F. Cuetos, M.M.B. Corley, and M. Brysbaert. Exposure-based models of human parsing: evidence for the use of coarse-grained (nonlexical) statistical records. Journal of Psycholinguistics Research, 24, 1995.

    Google Scholar 

  14. A. Ratnaparkhi. A linear observed time statistical parser based on maximum entropy models. In Proceedings of EMNLP97, 1997.

    Google Scholar 

  15. B. Roark and M. Johnson. Efficient probabilistic top-down and left-corner parsing. In Proc. of ACL99, 1999.

    Google Scholar 

  16. E. P. Stabler. The finite connectivity of linguistic structure. In C. Clifton, L. Frazier, and K. Reyner, editors, Perspectives on Sentence Processing, pages 303–336. Lawrence Erlbaum Associates, 1994.

    Google Scholar 

  17. M. J. Steedman. Grammar, interpretation and processingfrom the lexicon. In W. M. Marslen-Wilson, editor, Lexical Representation and Process, pages 463–504. MIT Press, 1989.

    Google Scholar 

  18. P. Sturt and M. Crocker. Monotonic syntactic processing: a cross-linguistic study of attachment and reanalysis. Language and Cognitive Processes, 11(5):449–494, 1996.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Costa, F., Lombardo, V., Frasconi, P., Soda, G. (2001). Wide Coverage Incremental Parsing by Learning Attachment Preferences. In: Esposito, F. (eds) AI*IA 2001: Advances in Artificial Intelligence. AI*IA 2001. Lecture Notes in Computer Science(), vol 2175. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45411-X_30

Download citation

  • DOI: https://doi.org/10.1007/3-540-45411-X_30

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42601-1

  • Online ISBN: 978-3-540-45411-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics