Skip to main content
SpringerLink
Log in

An Overview of Cross-Language Information Retrieval

  • Conference paper
  • First Online:
Artificial Intelligence and Security (ICAIS 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12239))

Included in the following conference series:

Abstract

With the development of the Internet, various language resources are becoming more and more abundant. Users are no longer satisfied with obtaining information expressed only in their mother tongue, and there is a growing need to retrieve documents in other languages. It demands the advancement of technologies to eliminate the communication barriers among languages. Cross-language information retrieval (CLIR), as a sub-field of information retrieval, can meet the purpose of users to retrieve information in other languages which are different from the queries, thus greatly improving the ability of users to retrieve multi-language documents. This paper introduces the translation techniques such as query translation, document translation and machine translation used in cross-language information retrieval, and analyzes their advantages and disadvantages. Besides, we also discuss the main challenges in cross-language information retrieval. We also introduce some of the latest algorithms and techniques, such as word embedding and query expansion. Finally, we summarize the overview and make a further outlook about CLIR.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ballesteros, L., Croft, B.: Dictionary methods for cross-lingual information retrieval. In: Wagner, R.R., Thoma, H. (eds.) DEXA 1996. LNCS, vol. 1134, pp. 791–801. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0034731

    Chapter  Google Scholar 

  2. Bhattacharya, P., Goyal, P., Sarkar, S.: Using word embeddings for query translation for hindi to english cross language information retrieval. Computación y Sistemas 20(3), 435–447 (2016)

    Article  Google Scholar 

  3. Braschler, M., Schäuble, P.: Using corpus-based approaches in a system for multilingual information retrieval. Inf. Retrieval 3(3), 273–284 (2000)

    Article  MATH  Google Scholar 

  4. Buckley, C., Singhal, A., Mitra, M., Salton, G.: New retrieval approaches using smart: Trec 4. In: Proceedings of the Fourth Text REtrieval Conference (TREC-4), pp. 25–48 (1995)

    Google Scholar 

  5. Carpineto, C., Romano, G.: A survey of automatic query expansion in information retrieval. ACM Comput. Surv. (CSUR) 44(1), 1 (2012)

    Article  MATH  Google Scholar 

  6. Chandra, G., Dwivedi, S.K.: A literature survey on various approaches of word sense disambiguation. In: 2014 2nd International Symposium on Computational and Business Intelligence, pp. 106–109. IEEE (2014)

    Google Scholar 

  7. Chen, J., Nie, J.Y.: Automatic construction of parallel English-Chinese corpus for cross-language information retrieval. In: Proceedings of the Sixth Conference on Applied natural language processing, pp. 21–28. Association for Computational Linguistics (2000)

    Google Scholar 

  8. Chengzhi, L.S.Z.: Survey of multilingual document representation. Data Anal. Knowl. Discovery 26(6), 33–41 (2010)

    Google Scholar 

  9. Croft, W.B., Turtle, H.R., Lewis, D.D.: The use of phrases and structured queries in information retrieval. In: Proceedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 32–45. ACM (1991)

    Google Scholar 

  10. Diekema, A.R.: Translation events in cross-language information retrieval: lexical ambiguity, lexical holes, vocabulary mismatch, and correct translations (2003)

    Google Scholar 

  11. Dini, L., Peters, W., Liebwald, D., Schweighofer, E., Mommers, L., Voermans, W.: Cross-lingual legal information retrieval using a wordnet architecture. In: Proceedings of the 10th International Conference on Artificial Intelligence and Law, pp. 163–167. ACM (2005)

    Google Scholar 

  12. Faruqui, M., Dyer, C.: Improving vector space word representations using multilingual correlation. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 462–471 (2014)

    Google Scholar 

  13. Franz, M., McCarley, J.S., Roukos, S.: Ad hoc and Multilingual Information Retrieval at IBM, pp. 157–168. NIST special publication SP (1999)

    Google Scholar 

  14. Gaillard, B., Bouraoui, J.L., De Neef, E.G., Boualem, M.: Query expansion for cross language information retrieval improvement. In: 2010 Fourth International Conference on Research Challenges in Information Science (RCIS), pp. 337–342. IEEE (2010)

    Google Scholar 

  15. Gao, L.: Research on the Query Expansion of Tibetan-Chinese Cross-language Information Retrieval Based on Topic Model. Master’s thesis, Minzu University of China (2017)

    Google Scholar 

  16. Hua-yun, Y., Qi-ping, L., Liang-jun, X.: Survey on relevance feedback for information retrieval. Appl. Res. Comput. 26(1), 11–14 (2009)

    Google Scholar 

  17. Huang, G., Wang, M., Hao, Y.: A novel cross language information retrieval model based on interlingua semantics. J. Chin. Inf. Process. 23(2), 77–82 (2009)

    Google Scholar 

  18. Hull, D.A., Grefenstette, G.: Querying across languages: a dictionary-based approach to multilingual information retrieval. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 49–57. Citeseer (1996)

    Google Scholar 

  19. Jun-Lin, Z., Wei-Min, Q., Lin, D., Yu-Fang, S.: State-of-the-art:cross-language information retrieval. Comput. Sci. 31(7), 16–19 (2004)

    Google Scholar 

  20. Kayode, K., Ayetiran, E.: Survey on cross-lingual information retrieval. Int. J. Sci. Eng. Res. 9, 484–491 (2018)

    Google Scholar 

  21. Kuzi, S., Shtok, A., Kurland, O.: Query expansion using word embeddings. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 1929–1932. ACM (2016)

    Google Scholar 

  22. Landauer, T.K.: Fully automatic cross-language document retrieval using latent semantic indexing. In: Proceedings of the Sixth Annual Conference of the UW Centre for the New Oxford English Dictionary and Text Research (1990)

    Google Scholar 

  23. Lyons, J.: Language and Linguistics. Cambridge University Press, Cambridge (1981)

    Google Scholar 

  24. Ma, L., Lai, W., Zhao, X.: Mongolian-chinese cross-language query expansion based on cross-language word vectors. J. Chin. Inf. Process. 33(6), 27–34 (2019)

    Google Scholar 

  25. McCarley, J.S.: Should we translate the documents or the queries in cross-language information retrieval? In: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics on Computational Linguistics, pp. 208–214. Association for Computational Linguistics (1999)

    Google Scholar 

  26. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space (2013). arXiv preprint arXiv:1301.3781

  27. Mikolov, T., Le, Q.V., Sutskever, I.: Exploiting similarities among languages for machine translation (2013). arXiv preprint arXiv:1309.4168

  28. Moulinier, I., Molina-Salgado, H.: Thomson legal and regulatory experiments for CLEF 2002. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 155–163. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45237-9_12

    Chapter  Google Scholar 

  29. Nie, J.: Cross-language Information Retrieval: Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers, San Rafael (2010)

    Google Scholar 

  30. Oard, D.W., He, D., Wang, J.: User-assisted query translation for interactive cross-language information retrieval. Inf. Process. Manage. 44(1), 181–211 (2008)

    Article  Google Scholar 

  31. Pennington, J., Socher, R., Manning, C.: Glove: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)

    Google Scholar 

  32. Pfeifer, U., Poersch, T., Fuhr, N.: Retrieval effectiveness of proper name search methods. Inf. Process. Manage. 32(6), 667–679 (1996)

    Article  Google Scholar 

  33. Picchi, E., Peters, C.: Cross-language information retrieval: A system for comparable corpus querying. In: Cross-Language Information Retrieval, pp. 81–92. Springer, Boston (1998)

    Google Scholar 

  34. Pigur, V.: Multilanguage information-retrieval systems: Integration levels and language support. Autom. Documentation Math. Linguis. 13(1), 36–46 (1979)

    Google Scholar 

  35. Pirkola, A., et al.: The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval. In: Sigir 1998, pp. 55–63 (1998)

    Google Scholar 

  36. Qu, P., Li, L., Zhang, L.: A review of advanced topics in informationretrieval. Library and Information Service 3 (2008)

    Google Scholar 

  37. Qu, Y., Grefenstette, G., Evans, D.A.: Resolving translation ambiguity using monolingual corpora. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 223–241. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45237-9_19

    Chapter  Google Scholar 

  38. Raju, B.N., Raju, M.B., Satyanarayana, K.: Translation approaches in cross language information retrieval. In: International Conference on Computing and Communication Technologies, pp. 1–4. IEEE (2014)

    Google Scholar 

  39. Rumelhart, D.E., Hinton, G.E., Williams, R.J., et al.: Learning representations by back-propagating errors. Cogn. Model. 5(3), 1 (1988)

    MATH  Google Scholar 

  40. Salton, G.: Experiments in Multi-lingual Information Retrieval. Cornell University, Technical report (1972)

    Google Scholar 

  41. araic Sheridan, P., Ballerini, J.P.: Experiments in multilingual information retrieval using the spider system. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 58–65. Citeseer (1996)

    Google Scholar 

  42. Voorhees, E.M., Harman, D.: Overview of the sixth text retrieval conference (TREC-6). Inf. Process. Manage. 36(1), 3–35 (2000)

    Article  Google Scholar 

  43. Vulić, I., Moens, M.F.: Monolingual and cross-lingual information retrieval models based on (bilingual) word embeddings. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 363–372. ACM (2015)

    Google Scholar 

  44. Wang, M., Niu, S., Gao, Z.: A novel scene text recognition method based on deep learning. Comput. Mater. Continua 60, 781–794 (2019)

    Google Scholar 

  45. Wu, D., He, D.: A study of query translation using google machine translation system. In: 2010 International Conference on Computational Intelligence and Software Engineering, pp. 1–4. IEEE (2010)

    Google Scholar 

  46. Xu, F., Zhang, X., Yang, Z.: Investigation on the Chinese text sentiment analysis based on convolutional neural networks in deep learning. Comput. Mater. Continua 58, 697–709 (2019)

    Google Scholar 

  47. Xu, H., Wang, H.: Research on query translation method in cross-language information retrieval. Digit. Libr. Forum 4, 41–46 (2009)

    Google Scholar 

  48. Yin, L., Meng, X., Li, J., Sun, J.: Relation extraction for massive news texts. Comput. Mater. Continua 58, 275–285 (2019)

    Google Scholar 

  49. Zhou, D., Truran, M., Brailsford, T., Wade, V., Ashman, H.: Translation techniques in cross-language information retrieval. ACM Comput. Surv. (CSUR) 45(1), 1 (2012)

    Article  Google Scholar 

  50. Zuccon, G., Koopman, B., Bruza, P., Azzopardi, L.: Integrating and evaluating neural word embeddings in information retrieval. In: Proceedings of the 20th Australasian Document Computing Symposium, p. 12. ACM (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information Engineer, Minzu University of China, Beijing, 100081, China

    Liang Zhang & Xiaobing Zhao

  2. Minority Languages Branch, National Language Resource and Monitoring Research Center, Beijing, 100081, China

    Liang Zhang & Xiaobing Zhao

Authors
  1. Liang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaobing Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaobing Zhao .

Editor information

Editors and Affiliations

  1. Nanjing University of Information Science, Nanjing, China

    Xingming Sun

  2. Nanjing University of Information Science, Nanjing, China

    Jinwei Wang

  3. Purdue University, West Lafayette, IN, USA

    Elisa Bertino

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, L., Zhao, X. (2020). An Overview of Cross-Language Information Retrieval. In: Sun, X., Wang, J., Bertino, E. (eds) Artificial Intelligence and Security. ICAIS 2020. Lecture Notes in Computer Science(), vol 12239. Springer, Cham. https://doi.org/10.1007/978-3-030-57884-8_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-57884-8_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-57883-1

  • Online ISBN: 978-3-030-57884-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation