Abstract
In this paper we introduce a system for the robust analysis of English using the apporach of Dynamic Syntax, in which the syntactic process is modelled as the word-by-word construction of a semantic representation. We argue that the inherent incrementality of the approach, in contrast with the essentially static assumptions of standard generative grammar, has clear advantages for the task of language modelling. To demonstrate its potential we show that this syntactic approach consistently outperforms a standard trigram model in word recovery tasks on parsable sentences. Furthermore, these results are achieved without recourse to hand-prepared training data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Milward, D.: Dynamic Dependency Grammar. Linguistics and Philosophy 17, 561–605 (1994)
Kempson, R., Meyer-Viol, W., Gabbay, D.: Dynamic Syntax: the flow of language understanding. Blackwell, Oxford (2001)
Hausser, R.: Complexity in Left-Associative Grammar. Theoretical Computer Science 106, 283–308 (1992)
Chomsky, N.: Syntactic structures. Mouton, The Hague (1957)
Schank, R.C.: Conceptual information processing. Elsevier, Amsterdam (1975)
Jackendoff, R.: Semantic structures. MIT Press, Cambridge (1990)
Goldberg, A.E.: Constructions: a construction grammar approach to argument structure. University of Chicago Press, Chicago (1995)
Kilgarriff, A., Tugwell, D.: Sketching words. In: Corréard, M.-H. (ed.) Lexicography and Natural Language Processing: A Festschrift in Honour of B.T.S. Atkins, EURALEX, pp. 125–137
Chelba, C., Jelinek, F.: Exploiting syntactic structure for language modeling. In: Proceedings of 36th ACL and 17th COLING, pp. 225–231 (1998)
Roark, B.: Probabilistic top-down parsing and language modeling. Computational Linguistics 27(2), 249–276 (2001)
Chen, S.F., Goodman, J.: An empirical study of smoothing techniques for language modeling. In: Proceedings of 34th ACL, pp. 310–318 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tugwell, D. (2006). Language Modelling with Dynamic Syntax. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2006. Lecture Notes in Computer Science(), vol 4188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11846406_36
Download citation
DOI: https://doi.org/10.1007/11846406_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39090-9
Online ISBN: 978-3-540-39091-6
eBook Packages: Computer ScienceComputer Science (R0)