skip to main content
10.1145/1062745.1062864acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
Article

Comparing relevance feedback algorithms for web search

Published: 10 May 2005 Publication History

Abstract

We evaluate three different relevance feedback (RF)algorithms, Rocchio, Robertson/Sparck-Jones (RSJ)and Bayesian, in the context of Web search. We use a target-testing experimental procedure whereby a user must locate a specific document. For user relevance feedback, we consider all possible user choices of indicating zero or more relevant documents from a set of 10 displayed documents. Examination of the effects of each user choice permits us to compute an upper-bound on the performance of each RF algorithm.We ind that there is a significant variation in the upper-bound performance o the three RF algorithms and that the Bayesian algorithm approaches the best possible.

References

[1]
Cox,I. J., Miller, M. L., Minka, T. P., Papathomas, T. V.,and Yianilos, P. N. The Bayesian Image Retrieval System, PicHunter: Theory, Implementation and Psychophysical Experiments. IEEE Transactions on Image Processing,9(1): 20--37,2000.
[2]
Dean J.,Henzinger M.R.Finding Related Pages in the World Wide Web.In Proceedings o the 8th International World Wide Web Conference 1998, pages 389--401.
[3]
Harman,D. Relevance Feedback revisited. Proceedings of SIGIR 1992,Copenhagen,1992.
[4]
Jansen,B. J., Spink, A.& Saracevic, T. 1999. The use of relevance eedback on the web:Implications for web IR system design.1999 World Conference on the WWW and Internet, Honolulu, Hawaii
[5]
MSN Search (http://search.msn.com)
[6]
Robertson, S. E., Sparck-Jones, K. Relevance weighting of search terms. Journal of the American Society or Information Science 27, 1976, pp.129--146.
[7]
Rocchio, J. Relevance feedback informarian retrieval. In Gerard Salton (ed.):The Smart Retrieval System - Experiments in Automatic Document Processing, pp.313--323. Prentice-Hall, Englewood Cliffs, N.J., 1971
[8]
Vinay, V., Cox, I. J., Milic-Frayling, N., Wood, K. Evaluating Relevance Feedback Algorithms for Searching on Small Displays. ECIR 2005.

Cited By

View all
  • (2018)An intelligent approach to design of E-Commerce metasearch and ranking system using next-generation big data analyticsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2018.02.015Online publication date: Mar-2018
  • (2012)Intelligent Social Media Indexing and Sharing Using an Adaptive Indexing Search EngineACM Transactions on Intelligent Systems and Technology10.1145/2168752.21687613:3(1-27)Online publication date: 1-May-2012
  • (2011)Interactive Query Expansion With the Use of Clustering-by-Directions AlgorithmIEEE Transactions on Industrial Electronics10.1109/TIE.2010.204531558:8(3168-3173)Online publication date: Aug-2011
  • Show More Cited By

Index Terms

  1. Comparing relevance feedback algorithms for web search

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '05: Special interest tracks and posters of the 14th international conference on World Wide Web
    May 2005
    454 pages
    ISBN:1595930515
    DOI:10.1145/1062745
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 May 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. evaluation
    2. relevance feedback
    3. web search

    Qualifiers

    • Article

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)An intelligent approach to design of E-Commerce metasearch and ranking system using next-generation big data analyticsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2018.02.015Online publication date: Mar-2018
    • (2012)Intelligent Social Media Indexing and Sharing Using an Adaptive Indexing Search EngineACM Transactions on Intelligent Systems and Technology10.1145/2168752.21687613:3(1-27)Online publication date: 1-May-2012
    • (2011)Interactive Query Expansion With the Use of Clustering-by-Directions AlgorithmIEEE Transactions on Industrial Electronics10.1109/TIE.2010.204531558:8(3168-3173)Online publication date: Aug-2011
    • (2009)Semi-automatic entity set refinementProceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics10.5555/1620754.1620796(290-298)Online publication date: 31-May-2009
    • (2009)Collective Evolutionary Indexing of Multimedia ObjectsProceedings of the International Conference on Computational Science and Its Applications: Part I10.1007/978-3-642-02454-2_73(937-948)Online publication date: 9-Jul-2009
    • (2008)An Interactive Search Method Based on User PreferencesDecision Analysis10.1287/deca.1080.01255:4(203-229)Online publication date: Dec-2008
    • (2008)On the conceptual tag refinementProceedings of the 2008 ACM symposium on Applied computing10.1145/1363686.1364238(2331-2335)Online publication date: 16-Mar-2008
    • (2007)Ontology construction and concept reuse with formal concept analysis for improved web document retrievalWeb Intelligence and Agent Systems10.5555/1377757.13777645:1(109-126)Online publication date: 1-Jan-2007
    • (2007)Exploiting underrepresented query aspects for automatic query expansionProceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining10.1145/1281192.1281216(191-200)Online publication date: 12-Aug-2007
    • (2007)P-TAGProceedings of the 16th international conference on World Wide Web10.1145/1242572.1242686(845-854)Online publication date: 8-May-2007
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media