A total relevance and document interaction effects model for the evaluation of information retrieval processes

https://doi.org/10.1016/0306-4573(88)90043-XGet rights and content

Abstract

The article presents a model based on the notion of the total relevance of a set of documents. The concept of a total relevance function is subsequently derived from the notion of cumulated relevance implied in the traditional summation of relevance ratings over the documents in a collection or in retrieved sets of documents. The model is intended to make explicit the perceptual underpinnings of relevance assessments while allowing for the consideration of interdocument dependencies as perceived by the user. Within this framework, it is proposed that an appropriate metric for gauging the performances of information retrieval systems is a measure of the (relative) total relevance that a user can obtain from a set of documents sequentially scanned and evaluated in an information retrieval environment. Some implications of the model are noted.

References (37)

  • C. Cleverdon

    User evaluation of information retrieval systems

    Journal of Documentation

    (June 1974)
  • C. Cleverdon

    Redundancy, relevance and value to the user in the outputs of information retrieval systems

    Journal of Documentation

    (September 1976)
  • C. Cleverdon et al.

    Factors determining the performance of indexing systems. Volume I:Design, Volume II: Test results

    (1966)
  • W.S. Cooper

    Expected search length: A single measure of retrieval effectiveness based on weak ordering action of retrieval systems

    Journal of the American Society for Information Science

    (1968)
  • W.S. Cooper

    On selecting a measure of retrieval effectiveness

    Journal of the American Society for Information Science

    (March/April 1973)
  • W.S. Cooper

    On selecting a measure of retrieval effectiveness. Part II: implementation of the philosophy

    Journal of the American Society for Information Science

    (November/December 1973)
  • M.E. Eisenberg et al.

    Order effects: A preliminary study of the possible influence of presentation order on user judgement of document relevance

  • D. Ellis

    Theory and explanation in information retrieval research

    Journal of Information Science

    (1984)
  • Cited by (0)

    Author to whom all correspondence should be addressed

    View full text