Abstract
This paper discusses a flat distributed search system in which selecting the relevant servers to a given query becomes difficult due to the lack of global knowledge at each server. To ensure the quality of the query results, Markov Decision Processes (MDPs) are set up for the query terms among all the autonomous search servers in the system. A new server ranking method is also designed for this MDP based system. The simulation reveals that query results with satisfactory quality can be achieved since the global optimal servers are obtained by the precomputed MDP policies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Baumgarten, C.: A probabilistic model for distributed information retrieval. In: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia PA, USA, pp. 258–266 (1997)
Callan, J., Lu, Z., Croft, W.: Searching distributed collections with inference networks. In: Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 21–28 (1995)
French, J.C., Powell, A.L., Viles, C.L., Emmitt, T., Prey, K.J.: Evaluating database selection techniques: A testbed and experiment. In: Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 121–129 (1998)
Harman, D.: Ranking algorithms. In: Information Retrieval: Data Structures and Algorithms, pp. 293–362. Prentice-Hall, Englewood Cliffs (1992)
Jansen, B.J., Spink, A., Bateman, J., Saracevic, T.: Real life information retrieval: A study of user queries on the Web. SIGIR Forum 32(1), 5–17 (1998)
Meng, W., Liu, K.-L., Yu, C., Wang, X., Chang, Y., Rishe, N.: Determing text databases to search in the internet. In: Proceedings of the 24th VLDB Conference, New York, USA, pp. 14–25 (1998)
Puterman, M.L.: Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons, Chichester (1994)
Sheldon, M.A., Duda, A., Gifford, D.K.: Discover: A resource discovery system based on content routing. Computer Networks and ISDN Systems 27(6), 953–972 (1995)
Viles, C., French, J.: Dissemination of collection wide information in a distributed information retrieval system. In: Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 12–20 (1995)
Weider, C., Spero, S.: Architecture for the WHOIS++ index service. Internet Working Draft (1993)
Xu, J., Callan, J.: Effective retrieval with distributed collections. In: Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 112–120 (1998)
Yuwono, B., Lee, D.L.: Server ranking for distributed text retrieval systems on the Internet. In: Proceedings of the Fifth International Conference on Database Systems for Advanced Applications, Melbourne, Australia (April 1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shen, Y., Lee, D.L., Zhang, L.W. (1999). A Distributed Search System Based on Markov Decision Processes. In: Hui, L.C.K., Lee, DL. (eds) Internet Applications. ICSC 1999. Lecture Notes in Computer Science, vol 1749. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-46652-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-46652-9_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66903-6
Online ISBN: 978-3-540-46652-9
eBook Packages: Springer Book Archive