Skip to main content

Lexical and Algorithmic Stemming Compared for 9 European Languages with Hummingbird SearchServerTM at CLEF 2003

  • Conference paper
Comparative Evaluation of Multilingual Information Access Systems (CLEF 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3237))

Included in the following conference series:

Abstract

Hummingbird participated in the monolingual information retrieval tasks of the Cross-Language Evaluation Forum (CLEF) 2003: for natural language queries in 9 European languages (German, French, Italian, Spanish, Dutch, Finnish, Swedish, Russian and English), find all the relevant documents (with high precision) in the CLEF 2003 document sets. SearchServer produced the highest mean average precision score of the submitted automatic Title+Description runs for German, Finnish and Dutch, the CLEF languages for which SearchServer could find words which are parts of compounds. In a comparison of experimental SearchServer lexical stemmers with Porter’s algorithmic stemmers, the biggest differences (most of them significant) were for languages in which compound words are frequent. For the other languages, typically the lexical stemmers performed inflectional stemming while the algorithmic stemmers often additionally performed derivational stemming; these differences did not pass a significance test.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Braschler, M., Peters, C.: CLEF 2003: Methodology and Metrics. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 7–20. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  2. Cross-Language Evaluation Forum web site, http://www.clef-campaign.org/

  3. Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman & Hall/CRC (1993)

    Google Scholar 

  4. Hodgson, A.: Converting the Fulcrum Search Engine to Unicode. In: Sixteenth International Unicode Conference, Amsterdam, The Netherlands (March 2000)

    Google Scholar 

  5. NTCIR (NII-NACSIS Test Collection for IR Systems) Home Page, http://research.nii.ac.jp/~ntcadm/index-en.html

  6. Porter, M.F.: Snowball: A language for stemming algorithms (October 2001), http://snowball.tartarus.org/texts/introduction.html

  7. Robertson, S.E., Walker, S., Jones, S., Hancock-Beaulieu, M.M., Gatford, M. (City University): Okapi at TREC-3. In: Harman, D.K. (ed.) Overview of the Third Text REtrieval Conference (TREC-3), NIST Special Publication 500-226, http://trec.nist.gov/pubs/trec3/t3_proceedings.html

  8. Text REtrieval Conference (TREC) Home Page, http://trec.nist.gov/

  9. Tomlinson, S.: Experiments in 8 European Languages with Hummingbird SearchServerTM at CLEF 2002. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  10. Tomlinson, S.: Hummingbird SearchServerTM at TREC 2001. In: Voorhees, E.M., Harman, D.K. (eds.) Proceedings of the Tenth Text REtrieval Conference (TREC 2001), NIST Special Publication 500-250 (2001), http://trec.nist.gov/pubs/trec10/t10_proceedings.html

  11. The Unicode Standard Version 3.0. The Unicode Consortium. Addison-Wesley, London (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tomlinson, S. (2004). Lexical and Algorithmic Stemming Compared for 9 European Languages with Hummingbird SearchServerTM at CLEF 2003. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds) Comparative Evaluation of Multilingual Information Access Systems. CLEF 2003. Lecture Notes in Computer Science, vol 3237. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30222-3_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30222-3_27

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24017-4

  • Online ISBN: 978-3-540-30222-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics