Skip to main content

Information Sharing and Searching via Collaborative Reinforcement Learning

  • Conference paper
Artificial Intelligence: Theories and Applications (SETN 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7297))

Included in the following conference series:

Abstract

This paper proposes a method for computing a routing policy-value function for effective information sharing and searching in arbitrary networks of agents through collaborative reinforcement learning. This is done by means of local computations performed by agents and payoff propagation. The aim is to ‘tune’ a network of agents for efficient and effective information searching and sharing, without altering the topology or imposing an overlay structure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cooper, B.F., Garcia-Molina, H.: Ad hoc, self-supervising peer-to-peer search networks. ACM Transactions on Information Systems (TOIS)archive 23(2), 169–200 (2005)

    Article  Google Scholar 

  2. Goldman, C., Zilberstein, S.: Decentralized Control of Cooperative Systems: Categorization and Complexity Analysis. JAIR 22, 143–174 (2004)

    MathSciNet  MATH  Google Scholar 

  3. Goldman, C., Zilberstein, S.: Optimizing Information Exchange in Cooperative Multi-agent Systems. In: Proc. of AAMAS 2003 (July 2003)

    Google Scholar 

  4. Guestrin, C., Koller, D., Parr, R.: Multiagent planning with factored MDPs. In: NIPS, vol. 14 (2002)

    Google Scholar 

  5. Kok, J.R., Vlassis, N.: Collaborative Reinforcement Learning by Payoff Propagation. JMLR 7, 1789–1828 (2006)

    MathSciNet  MATH  Google Scholar 

  6. Kschischang, F.R., Frey, B.J., Loeliger, H.-A.: Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory 47(2) (2001)

    Google Scholar 

  7. Velagapudi, P., Prokopyev, O., Scerri, P., Sycara, P.: Analyzing the Performance of Randomized Information Sharing. In: Proc. of AAMAS 2009, pp. 821–828 (2009)

    Google Scholar 

  8. Vouros, G.: Information Searching and Sharing in Large-Scale Dynamic Networks. In: Proc. of AAMAS 2007, pp. 235–242 (2007)

    Google Scholar 

  9. Vouros, G.: Searching and Sharing Information in Networks of Heterogeneous Agents. In: Proc. of AAMAS 2008, Poster (2008)

    Google Scholar 

  10. Xu, Y., Scerri, P., Yu, B., Lewis, M., Sycara, K.: A POMDP Approach to Token-Based Team Coordination. In: Proc. of AAMAS 2005, Utrecht, July 25-29. ACM Press (2005)

    Google Scholar 

  11. Xu, Y., Lewis, M., Sycara, K., Scerri, P.: Information Sharing in Large Scale Teams. In: Proc. of Workshop on Challenges in Coordination of Large Scale MultiAgent Systems (2004)

    Google Scholar 

  12. Xu, Y., Liao, E., Scerri, P., Yu, B., Lewis, M., Sycara, K.: Towards Flexible Coordination of Large Scale Multi-Agent Systems. In: Challenges of Large Scale Coordination (2005)

    Google Scholar 

  13. Xu, Y., Scerri, P., Yu, B., Okamoto, S., Lewis, M., Sycara, K.: An Integrated Token Based Algorithm for Scalable Coordination. In: Proc. of AAMAS 2005, pp. 407–414 (2005)

    Google Scholar 

  14. Xuan, P., Lesser, V., Zilberstein, S.: Communication Decisions in Multi-agent Cooperation: Model and Experiments. In: Proc. of AGENTS 2001, pp. 616–623 (2001)

    Google Scholar 

  15. Zhang, Y., Volz, R., Ioeger, T.R., Yen, J.: A Decision Theoretic Approach for Designing Proactive Communication in Multi-Agent Teamwork. In: SAC 2004, pp. 64–71 (2004)

    Google Scholar 

  16. Zhang, H., Lesser, V.: A Reinforcement Learning based Distributed Search Algorithm For Hierarchical Peer-to-Peer Information Retrieval Systems. In: Proc. of AAMAS 2007, pp. 231–238 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vouros, G.A. (2012). Information Sharing and Searching via Collaborative Reinforcement Learning. In: Maglogiannis, I., Plagianakos, V., Vlahavas, I. (eds) Artificial Intelligence: Theories and Applications. SETN 2012. Lecture Notes in Computer Science(), vol 7297. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30448-4_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30448-4_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30447-7

  • Online ISBN: 978-3-642-30448-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics