Provider selection — Design and implementation of the Medoc Broker

Abstract

One of the objectives of the Medoc system is transparent searching in heterogeneous distributed bibliographic and full text data-bases (information providers). For a sufficiently large number of information providers an automatic method for provider selection becomes necessary. We take a decision-theoretic approach: we estimate the cost for retrieving n relevant documents from each provider, then choose the combination which minimizes total costs. The main cost factor is the total number of relevant in each database; additional factors are the retrieval quality of the database, the costs for retrieving a document from the database, and the user-specific costs for retrieving a non-relevant or a relevant document, respectively. In this paper, we also describe a first implementation of the approach where each factor is made explicit so that the implementation can easily be adapted for specific situations.