Bin Tan
ABSTRACT
In this paper we study term-based feedback for information retrieval in the language modeling approach. With term feedback a user directly judges the relevance of individual terms without interaction with feedback documents, taking full control of the query expansion process. We propose a cluster-based method for selecting terms to present to the user for judgment, as well as effective algorithms for constructing refined query language models from user term feedback. Our algorithms are shown to bring significant improvement in retrieval accuracy over a non-feedback baseline, and achieve comparable performance to relevance feedback. They are helpful even when there are no relevant documents in the top.
- J. Allan. Relevance feedback with too much data. In Proceedings of the 18th annual international ACM SIGIR conference on research and development in information retrieval, pages 337--343, 1995. Google Scholar
Digital Library
- J. Allan. HARD track overview in TREC 2005 -- High Accuracy Retrieval from Documents. In The Fourteenth Text REtrieval Conference, 2005.Google Scholar
- P. Anick. Using terminological feedback for web search refinement: a log-based study. In Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval, pages 88--95, 2003. Google ScholarDigital Library
- P. G. Anick and S. Tipirneni. The paraphrase search assistant: terminological feedback for iterative information seeking. In Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval, pages 153--159, 1999. Google ScholarDigital Library
- C. Buckley, G. Salton, J. Allan, and A. Singhal. Automatic query expansion using SMART. In Proceedings of the Third Text REtrieval Conference, 1994.Google Scholar
- D. Harman. Towards interactive query expansion. In Proceedings of the 11th annual international ACM SIGIR conference on research and development in information retrieval, pages 321--331, 1988. Google ScholarDigital Library
- N. A. Jaleel, A. Corrada-Emmanuel, Q. Li, X. Liu, C. Wade, and J. Allan. UMass at TREC 2003: HARD and QA. In TREC, pages 715--725, 2003.Google Scholar
- H. Joho, C. Coverson, M. Sanderson, and M. Beaulieu. Hierarchical presentation of expansion terms. In Proceedings of the 2002 ACM symposium on applied computing, pages 645--649, 2002. Google ScholarDigital Library
- K. S. Jones, S. Walker, and S. E. Robertson. A probabilistic model of information retrieval: development and status. Technical Report 446, Computer Laboratory, University of Cambridge, 1998.Google Scholar
- D. Kelly, V. D. Dollu, and X. Fu. The loquacious user: a document-independent source of terms for query expansion. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, pages 457--464, 2005. Google ScholarDigital Library
- D. Kelly and X. Fu. Elicitation of term relevance feedback: an investigation of term source and context. In Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, 2006. Google ScholarDigital Library
- J. Koenemann and N. Belkin. A case for interaction: A study of interactive information retrieval behavior and effectiveness. In Proceedings of the SIGCHI conference on human factors in computing systems, pages 205--212, 1996. Google ScholarDigital Library
- V. Lavrenko and W. B. Croft. Relevance-based language models. In Research and Development in Information Retrieval, pages 120--127, 2001. Google ScholarDigital Library
- Y. Nemeth, B. Shapira, and M. Taeib-Maimon. Evaluation of the real and perceived value of automatic and interactive query expansion. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval, pages 526--527, 2004. Google ScholarDigital Library
- J. Ponte. A Language Modeling Approach to Information Retrieval. PhD thesis, University of Massachusetts at Amherst, 1998. Google ScholarDigital Library
- S. E. Robertson, S. Walker, S. Jones, M. Beaulieu, and M. Gatford. Okapi at TREC-3. In Proceedings of the Third Text REtrieval Conference, 1994.Google Scholar
- J. Rocchio. Relevance feedback in information retrieval. In The SMART retrieval system, pages 313--323. 1971.Google Scholar
- I. Ruthven. Re-examining the potential effectiveness of interactive query expansion. In Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval, pages 213--220, 2003. Google ScholarDigital Library
- G. Salton and C. Buckley. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41:288--297, 1990.Google ScholarCross Ref
- X. Shen, B. Tan, and C. Zhai. Implicit user modeling for personalized search. In Proceedings of the 14th ACM international conference on information and knowledge management, pages 824--831, 2005. Google ScholarDigital Library
- X. Shen and C. Zhai. Active feedback in ad hoc information retrieval. In Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval, pages 59--66, 2005. Google ScholarDigital Library
- A. Spink. Term relevance feedback and query expansion: relation to design. In Proceedings of the 17th annual international ACM SIGIR conference on research and development in information retrieval, pages 81--90, 1994. Google ScholarDigital Library
- J. Xu and W. B. Croft. Query expansion using local and global document analysis. In Proceedings of the 19th annual international ACM SIGIR conference on research and development in information retrieval, pages 4--11, 1996. Google ScholarDigital Library
- H. Zaragoza, N. Craswell, M. Taylor, S. Saria, and S. Robertson. Microsoft cambridge at TREC-13: Web and HARD tracks. In Proceedings of the 13th Text REtrieval Conference, 2004.Google Scholar
- C. Zhai and J. Lafferty. Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the tenth international conference on information and knowledge management, pages 403--410, 2001. Google ScholarDigital Library
- C. Zhai, A. Velivelli, and B. Yu. A cross-collection mixture model for comparative text mining. In Proceedings of the tenth ACM SIGKDD international conference on knowledge discovery and data mining, pages 743--748, 2004. Google ScholarDigital Library
Index Terms
- Term feedback for information retrieval with language models
Recommendations
A Term Cluster Query Expansion Model Based on Classification Information in Natural Language Information Retrieval
AICI '10: Proceedings of the 2010 International Conference on Artificial Intelligence and Computational Intelligence - Volume 02A natural language information retrieval system ranks related documents according to criteria based on user query keywords and document similarities. However, many efforts have been made to make more useful query keywords because users do not use many ...
Classifying and filtering blind feedback terms to improve information retrieval effectiveness
RIAO '10: Adaptivity, Personalization and Fusion of Heterogeneous InformationThe classification of blind relevance feedback (BRF) terms described in this paper aims at increasing precision or recall by determining which terms decrease, increase or do not change the corresponding information retrieval (IR) performance metric. ...
Elicitation of term relevance feedback: an investigation of term source and context
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrievalTerm relevance feedback has had a long history in information retrieval. However, research on interactive term relevance feedback has yielded mixed results. In this paper, we investigate several aspects related to the elicitation of term relevance ...
Comments