Skip to main content
Springer Nature Link
Log in

On the Evaluation of Snippet Selection for WebCLEF

  • Conference paper
Evaluating Systems for Multilingual and Multimodal Information Access (CLEF 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5706))

Included in the following conference series:

Abstract

WebCLEF is about supporting a user who is an expert in writing a survey article on a specific topic with a clear goal and audience by generating a ranked list with relevant snippets. This paper focuses on the evaluation methodology of WebCLEF. We show that the evaluation method and test set used for WebCLEF 2007 cannot be used to evaluate new systems and give recommendations how to improve the evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Rose, D.E., Levinson, D.: Understanding user goals in web search. In: Proceedings of the 13th international conference on World Wide Web. ACM, New York (2004)

    Google Scholar 

  2. Jijkoun, V., de Rijke, M.: Overview of WebCLEF 2007. In: Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D.W., Peñas, A., Petras, V., Santos, D. (eds.) CLEF 2007. LNCS, vol. 5152, pp. 725–731. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  3. Jijkoun, V., de Rijke, M.: The University of Amsterdam at Web CLEF 2007: Using Centrality to Rank Web Snippets. In: CLEF 2007, Budapest, Hungary (2007)

    Google Scholar 

  4. Voorhees, E.M., Tice, D.M.: The TREC-8 question answering track evaluation. In: Text Retrieval Conference TREC-8, pp. 83–105 (1999)

    Google Scholar 

  5. Pehcevski, J., Thom, J.A.: HiXEval: Highlighting XML Retrieval Evaluation. In: Fuhr, N., Lalmas, M., Malik, S., Kazai, G. (eds.) INEX 2005. LNCS, vol. 3977, pp. 43–57. Springer, Heidelberg (2006)

    Google Scholar 

  6. Lin, C.-Y.: ROUGE: a Package for Automatic Evaluation of Summaries. In: Proceedings of Workshop on Text Summarization, Barcelona, Spain (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Twente, The Netherlands

    Arnold Overwijk, Dong Nguyen, Claudia Hauff, Dolf Trieschnigg, Djoerd Hiemstra & Franciska de Jong

Authors
  1. Arnold Overwijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dong Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Claudia Hauff
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dolf Trieschnigg
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Djoerd Hiemstra
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Franciska de Jong
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Istituto di Scienza e Tecnologie dell’Informazione, CNR, Pisa, Italy

    Carol Peters

  2. RWTH Aachen University, Aachen, Germany

    Thomas Deselaers

  3. University of Padua, Padua, Italy

    Nicola Ferro

  4. LSI-UNED, Madrid, Spain

    Julio Gonzalo  & Anselmo Peñas  & 

  5. Dublin City University, Dublin 9, Ireland

    Gareth J. F. Jones

  6. Helsinki University of Technology, Espoo, Finland

    Mikko Kurimo

  7. University of Hildesheim, Hildesheim, Germany

    Thomas Mandl

  8. Humboldt University Berlin, Germany

    Vivien Petras

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Overwijk, A., Nguyen, D., Hauff, C., Trieschnigg, D., Hiemstra, D., de Jong, F. (2009). On the Evaluation of Snippet Selection for WebCLEF. In: Peters, C., et al. Evaluating Systems for Multilingual and Multimodal Information Access. CLEF 2008. Lecture Notes in Computer Science, vol 5706. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04447-2_103

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04447-2_103

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04446-5

  • Online ISBN: 978-3-642-04447-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics