Abstract
With the increasing importance of the “Global Information Society“ and as the world’s depositories of online collections proliferate, there is a growing need for systems that enable access to information of interest wherever and however it is stored, regardless of form or language. In recognition of this, five years ago, the DELOS Network for Digital Libraries launched the Cross-Language Evaluation Forum (CLEF), with the objective of promoting multi lingual information access by providing the research community with an infra structure for testing and evaluating systems operating in multilingual contexts and a common platform for the comparison of methodologies and results. In this paper, we outline the various activities initiated by CLEF over the years in order to meet the emerging needs of the application communities, and trace the impact of these activities on advances in multilingual system development.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Braschler, M., Peters, C.: Cross-Language Evaluation Forum: Objectives, Results, Achievements. Information Retrieval 7(1-2), 7–31 (2004)
Cleverdon, C.: The Cranfield Tests on Index Language Devices. In: Spärck-Jones, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 47–59. Morgan Kaufmann, San Francisco (1997)
Gey, F., Kando, N., Peters, C.: Cross-Language Information Retrieval: the Way Ahead. Information Processing and Management 4(3) (Forthcoming)
Gurrin, C., Smeaton, A.F.: Improving Evaluation of Web Search Systems. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 25–40. Springer, Heidelberg (2003)
Kando, N.: Evaluation of Information Access Technologies at the NTCIR Workshop. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 29–43. Springer, Heidelberg (2004) (in print)
Bailey, P., Craswell, N., Hawking, D.: Engineering a multi-purpose test collection for web retrieval experiments. Information Processing and Management 39(6), 853–871 (2003)
Oard, D., Gonzalo, J.: The CLEF 2001 Interactive Track. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 308–319. Springer, Heidelberg (2002)
Gonzalo, J., Oard, D.: The CLEF 2002 Interactive Track. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 372–382. Springer, Heidelberg (2003)
Oard, D., Gonzalo, J.: The CLEF 2003 Interactive Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 425–434. Springer, Heidelberg (2004) (in print)
Gonzalo, J., Oard, D.: CLEF 2004 Working Notes (2004), See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WN-Contents.html
Maybury, M.: Toward a Question Answering Roadmap, MITRE Tech. Report (2002)
Magnini, B., Romagnoli, S., Vallin, A., Herrera, J., Peñas, A., Peinado, V., Verdejo, F., de Rijke, M.: The Multiple Language Question Answering Track at CLEF 2003. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 471–486. Springer, Heidelberg (2004) (in print)
Magnini, B., Vallin, A., Ayache, C., Erbach, G., Peñas, A., de Rijke, M., Rocha, P., Simov, K., Sutcliffe, R.: Overview of the CLEF (2004), Multilingual Question Answering Track. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 371–391. Springer, Heidelberg (2005) See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WNContents.html
Jones, G.J.F., Federico, M.: CLEF 2002 Cross-Language Spoken Document Retrieval Pilot Track Report. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 446–457. Springer, Heidelberg (2003)
Federico, M., Jones, G.J.F.: The CLEF 2003 Cross-Language Spoken Document Retrieval Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 646–652. Springer, Heidelberg (2004) (in print)
Clough, P.D., Sanderson, M.: The CLEF 2003 Cross Language Image Retrieval Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 581–593. Springer, Heidelberg (2004) (in print)
Clough, P.D., Sanderson, M., Müller, H.: The CLEF Cross Language Image Retrieval Track (ImageCLEF). In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 597–613. Springer, Heidelberg (2005) See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WN-Contents.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Peters, C. (2005). Comparative Evaluation of Cross-language Information Retrieval Systems. In: Hemmje, M., Niederée, C., Risse, T. (eds) From Integrated Publication and Information Systems to Information and Knowledge Environments. Lecture Notes in Computer Science, vol 3379. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31842-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-31842-2_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24551-3
Online ISBN: 978-3-540-31842-2
eBook Packages: Computer ScienceComputer Science (R0)