Abstract
Passage retrieval and pseudo relevance feedback/query expansion have been reported as two effective means for improving document retrieval in literature. Relevance models, while improving retrieval in most cases, hurts performance on some heterogeneous collections. Previous research has shown that combining passage-level evidence with pseudo relevance feedback brings added benefits. In this paper, we study passage retrieval with relevance models in the language-modeling framework for document retrieval. An adaptive passage retrieval approach is proposed to document ranking based on the best passage of a document given a query. The proposed passage ranking method is applied to two relevance-based language models: the Lavrenko-Croft relevance model and our robust relevance model. Experiments are carried out with three query sets on three different collections from TREC. Our experimental results show that combining adaptive passage retrieval with relevance models (particularly the robust relevance model) consistently outperforms solely applying relevance models on full-length document retrieval.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Abdul-Jaleel, N., et al.: UMASS at TREC2004. In: Thirteen Text Retrieval Conference Notebook (2004)
Clarke, C., Craswell, N., Soboroff, I.: Overview of the TREC 2004 terabyte track. In: Thirteen Text Retrieval Conference Notebook (2004)
Cronen-Townsend, S., Zhou, Y., Croft, W.B.: A framework for selective query expansion. In: Proc. 13th Int. Conf. on Information and Knowledge Management, pp. 236–237 (2004)
Hiemstra, D.: Using language models for information retrieval. PhD thesis, University of Twente (2001)
Jiang, J., Zhai, C.: UIUC in HARD 2004 – Passage Retrieval using HMMs. In: Thirteen Text Retrieval Conference Notebook (2004)
Kaszkiel, M., Zobel, J.: Passage retrieval revisited. In: Proc. 20th ACM-SIGIR Conf. on Research and Development in Information Retrieval, pp. 178–185 (1997)
Kaszkiel, M., Zobel, J.: Effective ranking with arbitrary passages. Journal of the American Society for Information Science and Technology 52(4), 344–364 (2001)
Kraaij, W., Westerveld, T., Hiemstra, D.: The importance of prior probabilities for entry page search. In: 25th ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 27–34 (2002)
Krovetz, R.: Viewing morphology as an inference process. In: Proc. 16th ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 191–202 (1993)
Lafferty, J., Zhai, C.: Document language models, query models, and risk minimization for information retrieval. In: 24th ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 111–119 (2001)
Lavrenko, V., Croft, W.B.: Relevance-based language models. In: Proc. 24th ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 120–127 (2001)
Lavrenko, V., Croft, W.B.: Relevance models in information retrieval. In: Croft, W.B., Lafferty, J. (eds.) Language modeling for information retrieval, pp. 11–56. Kluwer Academic Publishers, Dordrecht (2003)
Li, X., Croft, W.B.: Time-based language models. In: Proc. 12th Int. Conf. on Information and Knowledge Management, pp. 469–475 (2003)
Li, X.: A new robust relevance model in the language model framework, Information Processing and Management (2007), doi:10.1016/j.ipm.2007.07.005
Liu, X., Croft, W.B.: Passage retrieval based on language models. In: Proc. 11th Int. Conf. on Information and Knowledge Management, pp. 375–382 (2002)
Miller, D.H., Leek, T., Schwartz, R.: A hidden Markov model information retrieval system. In: Proc. 22nd ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 214–221 (1999)
Ponte, J.: A Language modeling approach to information retrieval. PhD thesis, UMass-Amherst (1998)
Ponte, J., Croft, W.B.: A language modeling approach to information retrieval. In: Proc. 21st ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 275–281 (1998)
Song, F., Croft, W.B.: A general language model for information retrieval. In: Proc. 22nd ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 279–280 (1999)
Tao, T., Zhai, C.: A two-stage mixture model for pseudo feedback. In: Proc.27th ACM SIGIR Conf. Research and Development in Information Retrieval, pp. 486–487 (2004)
Tao, T., Zhai, C.: Regularized estimation of mixture models for robust pseudo-relevance feedback. In: Proc. 29th ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 162–169 (2006)
Zhai, C., Lafferty, J.: Model-based feedback in the language modeling approach to information retrieval. In: Proc. 10th Int. Conf. on Information and Knowledge Management, pp. 403–410 (2001)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, X., Zhu, Z. (2008). Enhancing Relevance Models with Adaptive Passage Retrieval. In: Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., White, R.W. (eds) Advances in Information Retrieval. ECIR 2008. Lecture Notes in Computer Science, vol 4956. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78646-7_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-78646-7_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78645-0
Online ISBN: 978-3-540-78646-7
eBook Packages: Computer ScienceComputer Science (R0)