Skip to main content

Advertisement

Springer Nature Link
Log in

Handling Communication Restrictions and Team Formation in Congestion Games

  • Published:
Autonomous Agents and Multi-Agent Systems Aims and scope Submit manuscript

Abstract

There are many domains in which a multi-agent system needs to maximize a “system utility” function which rates the performance of the entire system, while subject to communication restrictions among the agents. Such communication restrictions make it difficult for agents that take actions to optimize their own “private” utilities to also help optimize the system utility. In this article we show how previously introduced utilities that promote coordination among agents can be modified to be effective in domains with communication restrictions. The modified utilities provide performance improvements of up to 75 over previously used utilities in congestion games (i.e., games where the system utility depends solely on the number of agents choosing a particular action). In addition, we show that in the presence of severe communication restrictions, team formation for the purpose of information sharing among agents leads to an additional 25 improvement in system utility. Finally, we show that agents’ private utilities and team sizes can be manipulated to form the best compromise between how “aligned” an agent’s utility is with the system utility and how easily an agent can learn that utility.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Agogino A., Tumer K. (2004). Efficient evaluation functions for multi-rover systems. In The genetic and evolutionary computation conference (pp. 1–12). Seatle, WA.

  2. Agogino, A., & Tumer, K. (2005a). Multi agent reward analysis for learning in noisy domains. In Proceedings of the fourth international joint conference on autonomous agents and multi-agent systems. Utrecht, Netherlands.

  3. Agogino, A., & Tumer, K. (2005b). Reinforcement learning in large multi-agent systems. In AAMAS-05 workshop on coordination of large scale multi-agent systems. Utrecht, Netherlands.

  4. W.B. Arthur (1994) ArticleTitleComplexity in economic theory: Inductive reasoning and bounded rationality The American Economic Review. 84 IssueID2 406–411

    Google Scholar 

  5. T. Balch R.C. Arkin (1994) ArticleTitleCommunication in reactive multiagent robotic systems Autonomous Robots 1 IssueID1 27–52 Occurrence Handle10.1007/BF00735341

    Article  Google Scholar 

  6. Blumrosen L., Nisan N. (2002). Auctions with severely bounded communication. In The 43rd annual IEEE symposium on foundations of computer science. Vancouver, Canada.

  7. Boutilier C. (1996). Planning, learning and coordination in multiagent decision processes. In Proceedings of the sixth conference on theoretical aspects of rationality and knowledge, Holland.

  8. Brooks, C. H., & Durfee, E. H. (2003). Congregation formation in multiagent systems. Autonomous Agents and Multi-Agent Systems Journal, 145–170.

  9. Busetta, P., Dona, A., & Nori, M. (2002). Channeled multicast for group communications. In Proceedings of the first international joint conference on autonomous agents and multi-agent systems (pp. 1280–1287). Bologna, Italy.

  10. P. Cohen H.N. Levesque (1991) ArticleTitleTeamwork Special Issue on Cognitive Science and AI. 25 IssueID4 487–512

    Google Scholar 

  11. Crites, R. H., & Barto, A. G. (1996). Improving elevator performance using reinforcement learning. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo, (Eds.), Advances in neural information processing systems Vol. 8 (pp. 1017–1023).

  12. Dastani, M., van der Ham, J., & Dignum, F. (2002). Communication for goal directed agents. In Proceedings of the agent communication languages and conversation policies. Bologna, Italy.

  13. Dignum, F., Dunin-Keplicz, B., & Verbrugge, R. (2000). Agent theory for team formation by dialogue. In Proceedings of the agents, theories, architectures and languages (ATAL 2000) (pp. 150–166). Boston, MA.

  14. Fox, D., Burgard, W. Kruppa, H., & Thrun, S. (2000). A probabilistic approach to collaborative multi-robot localization. Autonomous Robots.

  15. Fredslund, J., & Mataric, M. J. (2002). Robots in formation using local information. In Proceedings, 7th international conference on intelligent autonomous systems (IAS-7) (pp. 100–107). Marina del Rey, CA.

  16. Gage, D. (1993). How to communicate with zillions of robots. In Proceedings of SPIE mobile robots VIII (pp. 250–257). Boston, MA.

  17. B. Grosz S. Kraus (1996) ArticleTitleCollaborative plans for complex group action Artificial Intelligence 2 IssueID86 269–357 Occurrence Handle97i:68181

    MathSciNet  Google Scholar 

  18. T. Groves (1973) ArticleTitleIncentives in teams Econometrica 41 617–631 Occurrence Handle0311.90002 Occurrence Handle55 #14127

    MATH  MathSciNet  Google Scholar 

  19. Hu, J., & Wellman, M. P. (1998). Multiagent reinforcement learning: Theoretical framework and an algorithm. In Proceedings of the fifteenth international conference on machine learning (pp. 242–250).

  20. Ketchpel, S. P. (1994). Forming coalitions in the face of uncertain rewards. In National conference on artificial intelligence (pp. 414–419).

  21. S. Kraus (1997) ArticleTitleNegotiation and cooperation in multi-agent environments Artificial Intelligence 94 79–97 Occurrence Handle10.1016/S0004-3702(97)00025-8 Occurrence Handle0904.68168

    Article  MATH  Google Scholar 

  22. Mataric, M. J. (1994). Reward functions for accelerated learning. In Machine learning: Proceedings of the eleventh international conference (pp. 181–189). San Francisco, CA.

  23. Nicholson, W. (1998), Microeconomic theory, 7th ed. The Dryden Press.

  24. Petersen, S. A., & Divitini, M. (2002). Using agents to support the selection of virtual enterprise teams. In Proceedings of fourth international bi-conference workshop on agent-oriented information systems (AOIS-2002) (at AAMAS 2002). Bologna, Italy.

  25. D. Pynadath M. Tambe (2002) ArticleTitleThe communicative multiagent team decision problem: Analyzing teamwork theories and models Journal of Artificial Intelligence Research. 16 389–423 Occurrence Handle2003m:68127

    MathSciNet  Google Scholar 

  26. Pynadath, D., Tambe, M., Chauvat, N., & Cavedon, L. (1999). Toward team-oriented programming. In Proceedings of the agents, theories, architectures and languages (ATAL’99) (pp. 77–91). Orlando, Florida.

  27. T. Sandholm V.R. Lesser (1997) ArticleTitleCoalitions among computationally bounded agents Artificial Intelligence 94 99–137 Occurrence Handle98e:90237

    MathSciNet  Google Scholar 

  28. Sen, S., Sekaran, M., & Hale, J. (1994). Learning to coordinate without sharing information. In Proceedings of the twelfth national conference on artificial intelligence (pp. 426–431). Seattle, WA.

  29. I.A. Smith P.R. Cohen (1995) Toward a semantics for a speech act based agent communications language T. Finin J. Mayfield (Eds) Proceedings of the CIKM ’95 workshop on intelligent information agents Maryland Baltimore

    Google Scholar 

  30. Stroupe, A., Martin, M. C., & Balch, T. (2001). Distributed sensor fusion for object position estimation by multi-robot systems. In IEEE international conference on robotics and automation, May, 2001.

  31. S. Talukdar L. Baerentzen A. Gove P. Souza Particlede (1998) ArticleTitleAsynchronous teams: Cooperation schemes for autonomous agents Journal of Heuristics. 4 295–321 Occurrence Handle10.1023/A:1009669824615

    Article  Google Scholar 

  32. Tumer K., Agogino A. (2005). Coordinating multi-rover systems: Evaluation functions for dynamic and noisy environments. In The genetic and evolutionary computation conference. Washington, DC.

  33. Tumer, K., Agogino, A., & Wolpert, D. (2002). Learning sequences of actions in collectives of autonomous agents. In Proceedings of the first international joint conference on autonomous agents and multi-agent systems (pp. 378–385). Bologna, Italy.

  34. K. Tumer D. Wolpert (Eds) (2004) Collectives and the design of complex systems Springer New York

    Google Scholar 

  35. W. Vickrey (1961) ArticleTitleCounterspeculation, auctions and competitive sealed tenders Journal of Finance 16 8–37

    Google Scholar 

  36. Wolpert, D., & Lawson, J. (2002). Designing agent collectives for systems with Markovian dynamics. In Proceedings of the first international joint conference on autonomous agents and multi-agent systems. Bologna, Italy.

  37. D.H. Wolpert K. Tumer (2001) ArticleTitleOptimal payoff functions for members of collectives Advances in Complex Systems 4 IssueID2/3 265–279

    Google Scholar 

  38. Wolpert, D. H., Tumer, K., & Frank, J. (1999). Using collective intelligence to route internet traffic. In Advances in neural information processing systems. Vol. 11 (pp. 952–958).

  39. D.H. Wolpert K. Wheeler K. Tumer (2000) ArticleTitleCollective intelligence for control of distributed dynamical systems Europhysics Letters 49 IssueID6 708–714 Occurrence Handle10.1209/epl/i2000-00208-x

    Article  Google Scholar 

  40. Xuan, P., Lesser, V., & Zilberstein, S. (2001). Communication decisions in multi-agent cooperation: Model and experiments. In Proceedings of the fifth international conference on autonomous agents (pp. 616–623). Montreal.

Download references

Author information

Authors and Affiliations

  1. University of California, Santa Cruz, USA

    Adrian K. Agogino

  2. NASA Ames Research Center, USA

    Kagan Tumer

Authors
  1. Adrian K. Agogino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kagan Tumer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adrian K. Agogino.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Agogino, A.K., Tumer, K. Handling Communication Restrictions and Team Formation in Congestion Games. Auton Agent Multi-Agent Syst 13, 97–115 (2006). https://doi.org/10.1007/s10458-006-6105-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10458-006-6105-y

Keywords

Search

Navigation