Skip to main content

The Effect of Adding Relevance Information in a Relevance Feedback Environment

  • Conference paper
SIGIR ’94

Abstract

The effects of adding information from relevant documents are examined in the TREC routing environment. A modified Rocchio relevance feedback approach is used, with a varying number of relevant documents retrieved by an initial SMART search, and a varying number of terms from those relevant documents used to expand the initial query. Recall-precision evaluation reveals that as the amount of expansion of the query due to adding terms from relevant documents increases, so does the effectiveness. There appears to be a linear relationship between the log of the number of terms added and the recall-precision effectiveness. There also appears to be a linear relationship between the log of the number of known relevant documents and the recall-precision effectiveness.

This study was supported in part by the National Science Foundation under garant IRI 93-0124.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Gerard Salton. Automatic Text Processing—the Transformation, Analysis and Retrieval of Information by Computer. Addison-Wesley Publishing Co., Reading, MA, 1989.

    Google Scholar 

  2. Gerard Salton and Chris Buckley. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41 (4): 288–297, 1990.

    Article  Google Scholar 

  3. David Haines and W. Bruce Croft. Relevance feedback and inference networks. In Robert Korfhage, Edie Rasmussen, and Peter Willett, editors, Proceedings of the Sixteenth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2–11, New York, 1993. Association for Computer Machinery.

    Google Scholar 

  4. D. K. Harman. Overview of the first Text REtrieval Conference (TREC-1). In D. K. Harman, editor, Proceedings of the First Text REtrieval Conference (TREC-1), pages 1–20. NIST Special Publication 500–207, March 1993.

    Google Scholar 

  5. D. K. Harman. Overview of the second Text REtrieval Conference (TREC-2). In D. K. Harman, editor, Proceedings of the Second Text REtrieval Conference (TREC-2). NIST Special Publication (in preparation).

    Google Scholar 

  6. Chris Buckley, Gerard Salton, and James Allan. Automatic retrieval with locality information using SMART. In D. K. Harman, editor, Proceedings of the First Text REtrieval Conference (TREC-1), pages 59–72. NIST Special Publication 500–207, March 1993.

    Google Scholar 

  7. Chris Buckley, Jaynes Allan, and Gerard Salton. Automatic routing and ad-hoc retrieval using SMART: TREC 2. In D. K. Harman, editor, Proceedings of the Second Text REtrieval Conference (TREC-2). NIST Special Publication (in preparation).

    Google Scholar 

  8. J.J. Rocchio. Relevance feedback in information retrieval. In Gerard Salton, editor, The SMART Retrieval System-Experiments in Automatic Document Processing, pages 313–323. Prentice Hall, Englewood Cliffs, NJ, 1971.

    Google Scholar 

  9. S.E. Robertson and K. Sparck Jones. Relevance weighting of search terms. Journal of the American Society for Information Science, 27 (3): 129–146, May-June 1976.

    Google Scholar 

  10. S.E. Robertson, C.J. van Rijsbergen, and M.F. Porter. Probabilistic models of indexing and searching. In R.N. Oddy, S.E. Robertson, C.J. van Rijsbergen, and P.W. Williams, editors, Information Retrieval Research. Butterworths, London, 1981.

    Google Scholar 

  11. Y.K. Chang, C. Cirillo, and J. Razon. Evaluation of feedback retrieval using modified freezing, residual collection, and test and control groups. In Gerard Salton, editor, The SMART Retrieval System—Experiments in Automatic Document Processing, chapter 17, pages 355–370. Prentice Hall, Englewood Cliffs, NJ, 1971.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1994 Springer-Verlag London Limited

About this paper

Cite this paper

Buckley, C., Salton, G., Allan, J. (1994). The Effect of Adding Relevance Information in a Relevance Feedback Environment. In: Croft, B.W., van Rijsbergen, C.J. (eds) SIGIR ’94. Springer, London. https://doi.org/10.1007/978-1-4471-2099-5_30

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2099-5_30

  • Publisher Name: Springer, London

  • Print ISBN: 978-3-540-19889-5

  • Online ISBN: 978-1-4471-2099-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics