Abstract
The quality of stemming algorithms is typically measured in two different ways: (i) how accurately they map the variant forms of a word to the same stem; or (ii) how much improvement they bring to Information Retrieval. In this paper, we evaluate different Portuguese stemming algorithms in terms of accuracy and in terms of their aid to Information Retrieval. The aim is to assess whether the most accurate stemmers are also the ones that bring the biggest gain in Information Retrieval. Our results show that some kind of correlation does exist, but it is not as strong as one might have expected.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Flores, F.N.: http://www.inf.ufrgs.br/~fnflores/paice_tool
Alvares, R.V., Garcia, A.C.B., Ferraz, I.: STEMBR: A Stemming Algorithm for the Brazilian Portuguese Language. In: Bento, C., Cardoso, A., Dias, G. (eds.) EPIA 2005. LNCS (LNAI), vol. 3808, pp. 693–701. Springer, Heidelberg (2005)
CLEF. Cross-Language Evaluation Forum, http://www.clef-campaign.org (July 11, 2007)
ELDA. ELDA, http://www.elra.info/ (October 15, 2008)
Harman, D.: How Effective is Suffixing? Journal of the American Society for Information Science 42(1), 7–15 (1991)
Hull, D.A.: Stemming Algorithms: A Case Study for Detailed Evaluation. Journal of the American Society for Information Science 47(1), 70–84 (1996)
Kraaij, W., Pohlmann, R.: Evaluation of a Dutch Stemming Algorithm. In: T.G. Publishing (ed.) The New Review of Document & Text Management, London, UK, pp. 25–43 (1995)
Krovetz, R.: Viewing Morphology as an Inference Process. In: 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 191–202 (1993)
Lovins, J.B.: Development of a Stemming Algorithm. Mechanical Translation and Computational Linguistics 11, 22–31 (1968)
Orengo, V.M., Buriol, L.S., Coelho, A.R.: A Study on the Use of Stemming for Monolingual Ad-Hoc Portuguese Information Retrieval. In: Peters, C., Clough, P., Gey, F.C., Karlgren, J., Magnini, B., Oard, D.W., de Rijke, M., Stempfhuber, M. (eds.) CLEF 2006. LNCS, vol. 4730, pp. 91–98. Springer, Heidelberg (2007)
Orengo, V.M., Huyck, C.R.: A Stemming Algorithm for the Portuguese Language. In: 8th International Symposium on String Processing and Information Retrieval (SPIRE), Laguna de San Raphael, Chile, pp. 183–193 (2001)
Paice, C.D.: Another Stemmer. SIGIR Forum 24, 56–61 (1990)
Paice, C.D.: An Evaluation Method for Stemming Algorithms. In: Croft, W.B., van Rijsbergen, C.J. (eds.) 17th ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 42–50. ACM, Dublin (1994)
Porter, M.F.: An Algorithm for Suffix Stripping. Program 14(3), 130–137 (1980)
Savoy, J.: IR Multilingual Resources at UniNE (Portuguese Stemmer) (October 6, 2009)
Snowball, http://snowball.tartarus.org/portuguese/voc.txt (July 29, 2003)
Snowball_Stemmers. Snowball Stemmers, http://snowball.tartarus.org/texts/stemmersoverview.html (October 28, 2008)
Zettair, www.seg.rmit.edu.au/zettair/ (cited 2007, June 11, 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Flores, F.N., Moreira, V.P., Heuser, C.A. (2010). Assessing the Impact of Stemming Accuracy on Information Retrieval. In: Pardo, T.A.S., Branco, A., Klautau, A., Vieira, R., de Lima, V.L.S. (eds) Computational Processing of the Portuguese Language. PROPOR 2010. Lecture Notes in Computer Science(), vol 6001. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12320-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-12320-7_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12319-1
Online ISBN: 978-3-642-12320-7
eBook Packages: Computer ScienceComputer Science (R0)