Skip to main content

A Distributed Search System Based on Markov Decision Processes

  • Conference paper
Internet Applications (ICSC 1999)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1749))

Included in the following conference series:

  • 353 Accesses

Abstract

This paper discusses a flat distributed search system in which selecting the relevant servers to a given query becomes difficult due to the lack of global knowledge at each server. To ensure the quality of the query results, Markov Decision Processes (MDPs) are set up for the query terms among all the autonomous search servers in the system. A new server ranking method is also designed for this MDP based system. The simulation reveals that query results with satisfactory quality can be achieved since the global optimal servers are obtained by the precomputed MDP policies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Baumgarten, C.: A probabilistic model for distributed information retrieval. In: Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Philadelphia PA, USA, pp. 258–266 (1997)

    Google Scholar 

  2. Callan, J., Lu, Z., Croft, W.: Searching distributed collections with inference networks. In: Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 21–28 (1995)

    Google Scholar 

  3. French, J.C., Powell, A.L., Viles, C.L., Emmitt, T., Prey, K.J.: Evaluating database selection techniques: A testbed and experiment. In: Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 121–129 (1998)

    Google Scholar 

  4. Harman, D.: Ranking algorithms. In: Information Retrieval: Data Structures and Algorithms, pp. 293–362. Prentice-Hall, Englewood Cliffs (1992)

    Google Scholar 

  5. Jansen, B.J., Spink, A., Bateman, J., Saracevic, T.: Real life information retrieval: A study of user queries on the Web. SIGIR Forum 32(1), 5–17 (1998)

    Article  Google Scholar 

  6. Meng, W., Liu, K.-L., Yu, C., Wang, X., Chang, Y., Rishe, N.: Determing text databases to search in the internet. In: Proceedings of the 24th VLDB Conference, New York, USA, pp. 14–25 (1998)

    Google Scholar 

  7. Puterman, M.L.: Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons, Chichester (1994)

    MATH  Google Scholar 

  8. Sheldon, M.A., Duda, A., Gifford, D.K.: Discover: A resource discovery system based on content routing. Computer Networks and ISDN Systems 27(6), 953–972 (1995)

    Article  Google Scholar 

  9. Viles, C., French, J.: Dissemination of collection wide information in a distributed information retrieval system. In: Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 12–20 (1995)

    Google Scholar 

  10. Weider, C., Spero, S.: Architecture for the WHOIS++ index service. Internet Working Draft (1993)

    Google Scholar 

  11. Xu, J., Callan, J.: Effective retrieval with distributed collections. In: Proceedings of the 21th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, pp. 112–120 (1998)

    Google Scholar 

  12. Yuwono, B., Lee, D.L.: Server ranking for distributed text retrieval systems on the Internet. In: Proceedings of the Fifth International Conference on Database Systems for Advanced Applications, Melbourne, Australia (April 1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shen, Y., Lee, D.L., Zhang, L.W. (1999). A Distributed Search System Based on Markov Decision Processes. In: Hui, L.C.K., Lee, DL. (eds) Internet Applications. ICSC 1999. Lecture Notes in Computer Science, vol 1749. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-46652-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-46652-9_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-66903-6

  • Online ISBN: 978-3-540-46652-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics