Abstract
CLEF, the Cross-Language Evaluation Forum, continued to grow substantially in the second year of its existence. Building on the success of the first CLEF campaign in 2000 and of its predecessors, the TREC cross-language tracks, CLEF 2001 attracted 34 participating groups which submitted nearly 200 different result sets. A description of the various tracks, and a summary of the main results and research directions are given in this overview. In addition, the CLEF multilingual test collection is examined with respect to the completeness of its relevance assessments. The analysis indicates that the test collection is stable and well suited for use in future evaluations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bertoldi, N., Federico, M.: ITC-irst at CLEF 2001: Monolingual and Bilingual Tracks. In this volume.
Blustein, J.: IR STAT PAK. URL: http://www.csd.uwo.ca/~jamie/IRSP-overview.html
Braschler, M.: CLEF 2000 — Overview of Results. In Peters, C. (Ed.) Cross-Language Information Retrieval and Evaluation. Workshop of the Cross-Language Evaluation Forum, CLEF 2000, Revised Papers. Pages 89–101
Braschler, M., Krause, J., Peters, C., Schäuble, P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Seventh Text REtrieval Conference (TREC-7), NIST Special Publicatio 500-242, Pages 25–32.
Chen, A.:Multilingual Information Retrieval using English and Chinese Queries. In this volume.
Gey, F. C., Jiang, H., Perelman, N.: Working with Russian Queries for the GIRT, Bilingual and Multilingual CLEF Tasks. In this volume.
Harman, D., Braschler, M., Hess, M., Kluck, M., Peters, C., Schäuble, P., Sheridan P.: CLIR Evaluation at TREC. In Peters, C. (Ed.) Cross-Language Information Retrieval and Evaluation. Workshop of the Cross-Language Evaluation Forum, CLEF 2000, Revised Papers. Pages 7–23.
Hull, D. A: Using Statistical Testing in the Evaluation of Retrieval Experiments. In Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Pittsburg, USA, 1993.
Jones, G. J. F., Lam-Adesina, A. M.: Experiments with Machine Translation for Bilingual Retrieval. In this volume.
Lin, W. C., Chen, H.-H.: Using Co-Occurrence, Augmented Restrictions, and C-E WordNet for Chinese-English Cross-Language Information Retrieval at CLEF 2001. In this volume.
McNamee, P., Mayfield, J.: JHU/APL Experiments at CLEF: Translation Resources and Score Normalization. In this volume.
Monz, C., de Rijke, M.: Shallow Morphological Analysis in Monolingual Information Retrieval for Dutch, German and Italian. In this volume
Nie, J.-Y., Simard, M.: Using Statistical Translation Models for Bilingual IR. In this volume.
Oard, D., Gonzalo, J.: The CLEF 2001 Interactive Track. In this volume.
Peters, C.: Introduction. In this volume.
Peters, C., Braschler, M.: European research letter: Cross-language system evaluation: The CLEF campaigns, In Journal of the American Society for Information Science and Technology, Volume 52, Issue 12, pages 1067–1072
Sahlgren, M., Karlgren, J.: Vector-based Semantic Analysis using Random Indexing for Cross-lingual Query Expansion. In this volume.
Schäuble, P. Sheridan, P.: Cross-Language Information Retrieval (CLIR) Track Overview. In Proceedings of the Sixth Text Retrieval Conference (TREC6) (1997)
Tague-Sutcliffe, J.: The Pragmatics of Information Retrieval Experimentation, Revisited. In Sparck-Jones, K. and Willett, P. (Eds.): Readings in Information Retrieval, Morgan Kaufmann Publishers, San Francisco, CA, USA, 1997.
Tague-Sutcliffe, J., Blustein, J.: A Statistical Analysis of the TREC-3 Data. In Proceedings of the Third Text REtrieval Conference (TREC-3), NIST Special Publication 500-226. Page 385ff.
Voorhees, E. M., Harman, D.: Overview of the Eighth Text REtrieval Conference (TREC-8). In Proceedings of the Eighth Text Retrieval Conference (TREC8) (1999)
Zobel, J.: How reliable are the results of large-scale information retrieval experiments? In Proceedings of the 21 st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Braschler, M. (2002). CLEF 2001 — Overview of Results. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds) Evaluation of Cross-Language Information Retrieval Systems. CLEF 2001. Lecture Notes in Computer Science, vol 2406. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45691-0_2
Download citation
DOI: https://doi.org/10.1007/3-540-45691-0_2
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44042-0
Online ISBN: 978-3-540-45691-9
eBook Packages: Springer Book Archive