Abstract
Query translation is the most widely used approach for cross-language information retrieval (CLIR). The major challenge of query translation is translating Out-Of-Vocabulary (OOV) terms. This paper proposes three methods to improve OOV translation mining for query translation. Firstly, Co-occurrence information is utilized to extract topic words and to expand the source language query with the translations of topic words for collecting relevant bilingual snippets. Secondly, an improved frequency change measurement method which combines context dependency is utilized to extract valid OOV translation candidates from noisy, small-sized bilingual snippets. Thirdly, for choosing the proper translation, a combination model considering frequency-distance, surface patterns matching and phonetic features is proposed to pick out the appropriate translation(s). Experimental results show that this OOV translation mining approach for query translation has substantial CLIR performance improvement.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ballesteros, L. and Croft, W. B.: Phrasal Translation and Query Expansion Techniques for Cross-Language Information Retrieval. In: Proc. of 20th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 84-91. Philadelphia, USA (1997)
Chien, L.-F.: PAT-tree-based Keyword Extraction for Chinese Information Retrieval. In: Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval, ACM Press, Philadelphia (1997)
Cheng, P.–J., Teng, J.-W., Chen, R.-C., Wang, J.-H., Lu, W.-H., Chien, L.-F.: Translating Unknown Queries with Web Corpora for Cross-language Information Retrieval. In: The Proceedings of 27th ACM SIGIR, pp. 146–153. ACM Press, New York (2004)
Fang, G., Yu, H., Nishino, F.: Chinese-English Term Translation Mining Based on Semantic Prediction. In: Proceedings of the 21th International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics Main Conference Poster Session, pp. 199–206 (2006)
He, D., Wu, D.: Enhancing query translation with relevance feedback in translingual information retrieval. Information Processing and Management, In Press, Corrected Proof, Available online (2009)
Huang, F., Zhang, Y., Vogel, S.: Mining Key Phrase Translation from Web Corpora. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pp. 483–490 (2005)
Lin, D., Zhao, S., Derme, B.V., Pasca, M.: Mining Parenthetical Translations from the Web by Word Alignment. In: Proceedings of 46th Meeting of the Association for Computational Linguistics: Human Language Technology, pp. 994–1002 (2008)
Lu, C., Xu, Y., Geva, S.: Web-Based Query Translation for English-Chinese CLIR. Computational Linguistics and Chinese Language Processing 13(1), 61–90 (2008)
Lu, W.-H., Chien, L.-F., Lee, H.-J.: Translation of Web Queries Using Anchor Text Mining. Asian Language Information Processing 1(2), 159–172 (2002)
Lu, W.-H., Lin, J.-H., Chang, Y.-S.: Improving Translation of Queries with Infrequent Unknown Abbreviations and Proper Names. Computational Linguistics and Chinese Language Processing 13(1), 91–120 (2008)
Nagata, M., Saito, T., Suzuki, K.: Using The Web as a Bilingual Dictionary. In: 39th Meeting of the Association for Computational Linguistics 2001 Workshop Data-Driven Methods in Machine Translation, pp. 95–102 (2001)
Pirkola, A., Hedlund, T., Keskustalo, H., Järvelin, K.: Dictionary-based Cross-language Information Retrieval: Problems, Methods, and Research Findings. Information Retrieval 4(3/4), 209–230 (2001)
Silva, J.F.d., Dias, G., Guilloré, S., Pereira, J.G.: Using LocalMaxs Algorithm for the Extraction of Contiguous and Non-contiguous Multiword Lexical Units. In: Progress in Artificial Intelligence: 9th Portuguese Conference on Artificial Intelligence, pp. 113–132 (1999)
Wan, S., Verspoor, C.M.: Automatic English-Chinese Name Transliteration for Development of Multilingual Resources. In: Proceedings of 36th Annual Meeting of the Association for Computational Linguistics, Montreal, Quebec, Canada, pp. 1352–1357 (1998)
Sun, J., Yao, J.-M., Zhang, J., Zhu, Q.-M.: Web Mining of OOV Translations. Journal of Information & Computational Science 5(1), 1–6 (2008)
Wu, J.-C., Lin, T., Chang, J.S.: Learning Source-Target Surface Patterns for Web-based Terminology Translation. In: Proceedings of the 43th Annual Meeting of the Association for Computational Linguistics Interactive Poster and Demonstration Sessions, Ann Arbor, pp. 37–40 (2005)
Yan, Z.-X., Feng, Y.-H., Hong, Y., Yao, J.-M.: Parallel Resources Mining From Bilingual Web Pages. In: Conference of China Information Retrieval (CCIR), pp. 513–524 (2009)
Zhang, Y., Vines, P.: Using the Web for Automated Translation Extraction in Cross-Language Information Retrieval. In: Proceedings of SIGIR Conference, pp. 162–169 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ge, Y.D., Hong, Y., Yao, J.M., Zhu, Q.M. (2010). Improving Web-Based OOV Translation Mining for Query Translation. In: Cheng, PJ., Kan, MY., Lam, W., Nakov, P. (eds) Information Retrieval Technology. AIRS 2010. Lecture Notes in Computer Science, vol 6458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17187-1_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-17187-1_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17186-4
Online ISBN: 978-3-642-17187-1
eBook Packages: Computer ScienceComputer Science (R0)