Abstract
Best match systems in Information Retrieval have long been one of the most predominant models used in both research and practice. It is argued that the effectiveness of these types of systems for the ad hoc task in IR has plateaued. In this short paper, we conduct experiments to find the upper limits of performance of these systems from three different perspectives. Our results on TREC data show that there is much room for improvement in terms of term-weighting and query reformulation in the ad hoc task given an entire information need.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Armstrong, T.G., Moffat, A., Webber, W., Zobel, J.: Improvements that don’t add up: ad-hoc retrieval results since 1998. In: CIKM 2009, pp. 601–610. ACM, New York (2009)
Graf, E., Azzopardi, L., van Rijsbergen, K.: Automatically generating queries for prior art search. In: Peters, C., Caputo, B., Gonzalo, J., Jones, G.J.F., Kalpathy-Cramer, J., Müller, H., Tsikrika, T. (eds.) CLEF 2009. LNCS, vol. 6242, pp. 480–490. Springer, Heidelberg (2010)
Kumaran, G., Carvalho, V.R.: Reducing long queries using query quality predictors. In: SIGIR, pp. 564–571 (2009)
Popescu-Belis, A., Kilgour, J., Poller, P., Nanchen, A., Boertjes, E., de Wit, J.: Automatic content linking: speech-based just-in-time retrieval for multimedia archives. In: SIGIR 2010, p. 703. ACM, New York (2010)
Yang, L., Wang, L., Geng, B., Hua, X.-S.: Query sampling for ranking learning in web search. In: SIGIR 2009, pp. 754–755. ACM, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cummins, R., Lalmas, M., O’Riordan, C. (2011). The Limits of Retrieval Effectiveness. In: Clough, P., et al. Advances in Information Retrieval. ECIR 2011. Lecture Notes in Computer Science, vol 6611. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20161-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-20161-5_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20160-8
Online ISBN: 978-3-642-20161-5
eBook Packages: Computer ScienceComputer Science (R0)