Abstract
In its third year, the CLEF campaign has again seen considerable growth on multiple fronts. While the explosive growth in the number of participants has slowed somewhat, the number of actual experiments has grown considerably, as has their complexity (more data to process and more languages to handle). The main tracks of the CLEF 2002 campaign attracted 37 participating groups who submitted nearly 300 different experiments. In this overview, a description of the tracks and tasks, and a summary of the principal research results are given. As for the last two years, we have also examined the multilingual test collection produced as a result of the campaign with respect to the completeness of its relevance assessments, with very favorable findings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agosti, M., Bacchin, M., Ferro, N., Melucci, M.: Improving the Automatic Retrieval of Text Documents. This volume.
Blustein, J.: IR STAT PAK. URL: http://www.csd.uwo.ca/~jamie/IRSP-overview.html.
Brand, R., Brünner, M.: Océ at CLEF 2002. This volume.
Braschler, M.: CLEF 2000 — Overview of Results. In: Cross-Language Information Retrieval and Evaluation. Workshop of the Cross-Language Evaluation Forum, CLEF 2000, Revised Papers. Pages 89-101, 2001.
Braschler, M.: CLEF 2001 — Overview of Results. In: Evaluation of Cross-Language Information Retrieval Systems. Second Workshop of the Cross-Language Evaluation Forum, CLEF 2001, Revised Papers. Pages 9-26, 2002.
Braschler, M., Göhring, A., Schäuble, P.: Eurospider at CLEF 2002. This volume.
Braschler, M., Krause, J., Peters, C., Schäuble, P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Seventh Text REtrieval Conference (TREC-7), NIST Special Publication 500-242, Pages 25-32, 1998.
Chen, A.: Cross-language Retrieval Experiments at CLEF 2002. This volume.
Gonzalo, J., Oard, D.W.: The CLEF 2002 Interactive Track. This volume.
Jones, G.J.F and Federico, M. CLEF2002 Cross-Language Spoken Document Retrieval Pilot Track Report. This volume.
Harman, D., Braschler, M., Hess, M., Kluck, M., Peters, C., Schäuble, P., Sheridan P.: CLIR Evaluation at TREC. In: Cross-Language Information Retrieval and Evaluation. Workshop of the Cross-Language Evaluation Forum, CLEF 2000, Revised Papers. Pages 7-23, 2001.
Hull, D. A: Using Statistical Testing in the Evaluation of Retrieval Experiments. In: Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Pittsburg, USA, Pages 329-338, 1993.
Lam-Adesina, A. M., Jones, G. J. F.: Exeter at CLEF 2002: Experiments with Machine Translation for Monlingual and Bilingual Retrieval. This volume.
Lin, W.-C., Chen, H.-H.: Merging Mechanisms in Multilingual Information Retrieval. This volume.
MacFarlane, A.: PLIERS and Snowball at CLEF 2002. This volume.
McNamee, P., Mayfield, J.: Scalable Multilingual Information Access. This volume.
Martinez, F., Ureña, L. A., Martín, M. T.: SINAI at CLEF 2002: Experimenting with Merging Strategies. This volume.
Moulinier, I., Molina-Salgado, H.: Thomson Legal and Regulatory Experiments for CLEF 2002. This volume.
Nie, J.-Y., Jin, F.: A Multilingual Approach to Multilingual Information Retrieval. This volume.
Orengo, V. M., Huyck, C.: Portuguese-English Experiments using Latent Semantic Indexing. This volume.
Peters, C., Braschler, M.: European Research Letter: Cross-language system evaluation: The CLEF campaigns, In: Journal of the American Society for Information Science and Technology, Volume 52, Issue 12, pages 1067–1072, 2001.
Sahlgren, M., Karlgren, J., Cöster, R., Järvinen, T.: SICS at CLEF 2002: Automatic Query Expansion using Random Indexing. This volume.
Savoy, J.: Report on CLEF 2002 Experiments: Combining Multiple Sources of Evidence. This volume.
Schäuble, P. Sheridan, P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Sixth Text Retrieval Conference (TREC-6), NIST Special Publication 500-240, Pages 31-43, 1997.
Tague-Sutcliffe, J.: The Pragmatics of Information Retrieval Experimentation, Revisited. In: Readings in Information Retrieval, Morgan Kaufmann Publishers, San Francisco, CA, USA, Pages 205-216, 1997.
Tague-Sutcliffe, J., Blustein, J.: A Statistical Analysis of the TREC-3 Data. In: Proceedings of the Third Text REtrieval Conference (TREC-3), NIST Special Publication 500-226. Page 385ff, 1994.
Vilares, J., Alonso, M. A., Ribadas, F. J., Vilares, M.: COLE Experiments in the CLEF 2002 Spanish Monolingual Track. This volume.
Voorhees, E., Buckley, C.: The Effect of Topic Set Size on Retrieval Experiment Error. In: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Pages 316-323, 2002.
Vorhees, E., Harman, D.: Overview of the Eighth Text REtrieval Conference (TREC-8). In: Proceedings of the Eighth Text Retrieval Conference (TREC-8), NIST Special Publication 500-246, Pages 1-24, 1999.
Zobel, J.: How reliable are the results of large-scale information retrieval experiments? In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Pages 307-314, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Braschler, M. (2003). CLEF 2002 — Overview of Results. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds) Advances in Cross-Language Information Retrieval. CLEF 2002. Lecture Notes in Computer Science, vol 2785. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45237-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-45237-9_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40830-7
Online ISBN: 978-3-540-45237-9
eBook Packages: Springer Book Archive