Abstract
Collocations – word combinations occurring together more often than by chance – have a wide range of NLP applications. Many approaches for automating collocation extraction based on lexical association measures have been proposed in the literature. This paper presents TermeX – a tool for efficient extraction of collocations based on a variety of association measures. TermeX implements POS filtering and lemmatization, and is capable of extracting collocations up to length four. We address trade-offs between high memory consumption and processing speed and propose an efficient implementation. Our implementation allows for processing time linear to corpus size and memory consumption linear to the number of word types.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sag, I.A., Baldwin, T., Bond, F., Copestake, A., Flickinger, D.: Multiword expressions: A pain in the neck for NLP. In: Gelbukh, A. (ed.) CICLing 2002. LNCS, vol. 2276, p. 1. Springer, Heidelberg (2002)
Benson, M.: Collocations and general-purpose dictionaries. International Journal of Lexicography 3(1), 23–35 (1990)
Yarowsky, D.: One sense per collocation. In: Proceedings of ARPA Human Language Technology Workshop (1993)
Mihalcea, R., Faruque, E.: Senselearner: Minimally supervised word sense disambiguation for all words in open text. In: Proceedings of ACL/SIGLEX Senseval (2004)
McCardell Doerr, R.: A lexical semantic and statistical approach to lexical collocation extraction for natural language generation. AI Magazine 16, 105 (1995)
Orilac, B., Dillinger, M.: Collocation extraction for machine translation. In: Machine Translation Summit IX, pp. 292–298 (2003)
Barlow, M.: Collocate 1.0: Locating collocations and terminology. TX: Athelstan (2004)
Aroonmanakun, W.: Collocation extract (2000), http://pioneer.chula.ac.th/~awirote/colloc/
Chamblon Systems, Inc.: Terminology extractor (2004), http://www.chamblon.com/terminologyextractor.htm
Seretan, V., Nerima, L., Wehrli, E.: A tool for multi-word collocation extraction and visualization in multilingual corpora. In: Proceedings of the 11th EURALEX International Congress (2004)
Petrović, S., Šnajder, J., Dalbelo Bašić, B.: Extending lexical association measures for collocation extraction. Computer, Speech and Language (submitted, 2008)
Lesk, M.E.: Lex – a lexical analyzer generator. Technical report, AT&T Bell Laboratories, Murray Hill, New Jersey (1975)
Erjavec, T., Krstev, C., Petkevič, V., Simov, K., Tadić, M., Vitas, D.: The MULTEXT-East morphosyntactic specifications for Slavic languages. In: Proceedings of the EACL 2003 Workshop on Morphological Processing of Slavic Languages (2003)
Gamma, E., Helm, R., Johnson, R., Vlissides, J.M.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional Computer Series, Reading (2000)
Eckel, B.: Thinking in Java, 4th edn. Prentice-Hall, Englewood Cliffs (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Delač, D., Krleža, Z., Šnajder, J., Dalbelo Bašić, B., Šarić, F. (2009). TermeX: A Tool for Collocation Extraction. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2009. Lecture Notes in Computer Science, vol 5449. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00382-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-00382-0_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00381-3
Online ISBN: 978-3-642-00382-0
eBook Packages: Computer ScienceComputer Science (R0)