Article

Conflicts in teamwork: hybrids to the rescue

Authors:

P. VarakanthamAuthors Info & Claims

AAMAS '05: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems

Pages 3 - 10

https://doi.org/10.1145/1082473.1082474

Published: 25 July 2005 Publication History

Abstract

Today within the AAMAS community, we see at least four competing approaches to building multiagent systems: belief-desire-intention (BDI), distributed constraint optimization (DCOP), distributed POMDPs, and auctions or game-theoretic approaches. While there is exciting progress within each approach, there is a lack of cross-cutting research. This paper highlights hybrid approaches for multiagent teamwork. In particular, for the past decade, the TEAMCORE research group has focused on building agent teams in complex, dynamic domains. While our early work was inspired by BDI, we will present an overview of recent research that uses DCOPs and distributed POMDPs in building agent teams. While DCOP and distributed POMDP algorithms provide promising results, hybrid approaches help us address problems of scalability and expressiveness. For example, in the BDI-POMDP hybrid approach, BDI team plans are exploited to improve POMDP tractability, and POMDPs improve BDI team plan performance. We present some recent results from applying this approach in a Disaster Rescue simulation domain being developed with help from the Los Angeles Fire Department.

References

[1]

S. Ali, S. Koenig, and M. Tambe. Preprocessing techniques for accelerating the dcop algorithm adopt. In AAMAS, 2005.

Digital Library

[2]

D. Bernstein, S. Zilberstein, and N. Immerman. The complexity of decentralized control of markov decision processes. In UAI, 2000.

Digital Library

[3]

E. Bowring, M. Tambe, and M. Yokoo. Distributed multi-criteria coordination in multi-agent systems. In Workshop on DALT, 2005.

[4]

B. Grosz and S. Kraus. Collaborative plans for complex group action. AIJ, 86:269--357, 1996.

Digital Library

[5]

G. Kaminka, D. V. Pynadath, and M. Tambe. Monitoring teams by overhearing: A multi-agent plan recognition approach. JAIR, 17, 2002.

Digital Library

[6]

G. Kaminka and M. Tambe. Robust multi-agent teams via socially-attentive monitoring. JAIR, 12:105--147, 2000.

Digital Library

[7]

V. Lesser, C. Ortiz, and M. Tambe. Distributed sensor nets: A multiagent perspective. Kluwer academic publishers, 2003.

Digital Library

[8]

H. Levesque, P. R. Cohen, and J. H. T. Nunes. On acting together. In AAAI, 1990.

Digital Library

[9]

R. Maheswaran, J. Pearce, P. Varakantham, E. Bowring, and M. Tambe. Valuation of possible states: A unifying quantitative framework for evaluating privacy in collaboration. In AAMAS, 2005.

[10]

R. Maheswaran, J. P. Pearce, and M. Tambe. Distributed algorithms for DCOP: A graphical-game-based approach. In PDCS, 2004.

[11]

R. Maheswaran and T. Basar. Coalition formation in proportionality fair divisible auctions. In AAMAS, 2003.

Digital Library

[12]

R. Mailler. Comparing two approaches to dynamic, distributed constraint satisfaction. In AAMAS, 2005.

Digital Library

[13]

S. Minton, M. D. Johnston, A. B. Philips, and P. Laird. Minimizing conflicts: A heuristic method for constraint-satisfaction and scheduling problems. Artificial Intelligence, 58:161--205, 1992.

Digital Library

[14]

P. Modi, H. Jung, M. Tambe, W. Shen, and S. Kulkarni. A dynamic distributed constraint satisfaction approach to resource allocation. In CP, 2001.

Digital Library

[15]

P. Modi, W. Shen, M. Tambe, and M. Yokoo. Adopt: Asynchronous distributed constraint optimization with quality guarantees. AIJ, 161:149--180, 2005.

Digital Library

[16]

R. Nair and M. Tambe. Hybrid bdi-pomdp framework for multiagent teaming. JAIR, 23:367--413, 2005.

[17]

R. Nair, M. Tambe, M. Yokoo, D. Pynadath, and S. Marsella. Taming decentralized pomdps: Towards efficient policy computation for multiagent settings. In IJCAI, 2003.

Digital Library

[18]

R. Nair, P. Varakantham, M. Yokoo, and M. Tambe. Networked distributed pomdps: A synergy of distributed constraint optimization and pomdps. In IJCAI, 2005.

Digital Library

[19]

P. Paruchuri, M. Tambe, F. Ordonez, and S. Kraus. Towards a formalization of teamwork with resource constraints. In AAMAS, 2004.

Digital Library

[20]

J. Pearce, R. T. Maheswaran, and M. Tambe. Dcop games for multi-agent coordination. In Workshop on DCR, 2005.

[21]

J. Pearce, R. T. Maheswaran, and M. Tambe. How local is that optimum? k-optimality for dcop. In AAMAS, 2005.

Digital Library

[22]

D. Pynadath and M. Tambe. Automated teamwork among heterogeneous software agents and humans. JAAMAS, 7:71--100, 2003.

Digital Library

[23]

P. Scerri, A. Farinelli, S. Okamoto, and M. Tambe. Allocating tasks in extreme teams. In AAMAS, 2005.

Digital Library

[24]

P. Scerri, L. Johnson, D. Pynadath, P. Rosenbloom, M. Si, N. Schurr, and M. Tambe. A prototype infrastructure for distributed robot, agent, person teams. In AAMAS, 2003.

Digital Library

[25]

P. Scerri, D. Pynadath, and M. Tambe. Towards adjustable autonomy for the real-world. JAIR, 17:171--228, 2002.

[26]

N. Schurr, J. Marecki, P. Scerri, J. Lewis, and M. Tambe. The defacto system: Training tool for incident commanders. In IAAI, 2005.

Digital Library

[27]

M. Tambe. Towards flexible teamwork. JAIR, 7:83--124, 1997.

Digital Library

[28]

M. Tambe, D. Pynadath, and N. Chauvat. Building dynamic agent organizations in cyberspace. IEEE Internet Computing, 4, 2000.

Digital Library

[29]

M. Tambe, G. Kaminka, S. Marsella, I. Muslea, and T. Raines. Two fielded teams and two experts: A robocup response challenge from the trenches. In IJCAI, 1999.

Digital Library

[30]

M. Tambe, W. Johnson, R. Jones, F. Koss, J. Laird, P. Rosenbloom, and K. Schwamb. Intelligent agents for interactive simulation environments. AI Magazine, page 16(1), 1995.

[31]

M. Tambe and W. Zhang. Towards flexible teamwork in persistent teams. JAAMAS, 3:159--183, 1998.

Digital Library

[32]

P. Varakantham, R. Maheswaran, and M. Tambe. Exploiting belief bounds: Practical pomdps for personal assistant agents. In AAMAS, 2005.

Digital Library

[33]

J. Yen, J. Yin, T. R. Ioerger, M. S. Miller, D. Xu, and R. A. Volz. Cast: Collaborative agents for simulating teamwork. In IJCAI, 2001.

Digital Library

[34]

M. Yokoo and K. Hirayama. Distributed breakout algorithm for solving distributed constraint satisfaction problems. In ICMAS, 1996.

Digital Library

Cited By

Seo SHan BUnhelkar VAgmon NAn BRicci AYeoh W(2023)Automated Task-Time Interventions to Improve Teamwork using Imitation LearningProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598655(335-344)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598655
Jaafar NAhmad MAhmad A(2016)The rationality of sincere software agent in task completion2016 2nd International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR)10.1109/ISAMSR.2016.7810004(63-68)Online publication date: Aug-2016
https://doi.org/10.1109/ISAMSR.2016.7810004
HolmesParker CAgogino ATumer K(2016)Combining reward shaping and hierarchies for scaling to large multiagent systemsThe Knowledge Engineering Review10.1017/S026988891500015631:1(3-18)Online publication date: 11-Feb-2016
https://doi.org/10.1017/S0269888915000156
Show More Cited By

Index Terms

Conflicts in teamwork: hybrids to the rescue
1. Computing methodologies
  1. Artificial intelligence
    1. Control methods
    2. Search methodologies
2. Theory of computation
  1. Design and analysis of algorithms
    1. Algorithm design techniques
      1. Dynamic programming

Recommendations

A hybrid POMDP-BDI agent architecture with online stochastic planning and plan caching

This article presents an agent architecture for controlling an autonomous agent in stochastic, noisy environments. The architecture combines the partially observable Markov decision process (POMDP) model with the belief-desire-intention (BDI) framework. ...
Ad hoc teamwork by learning teammates' task

This paper addresses the problem of ad hoc teamwork, where a learning agent engages in a cooperative task with other (unknown) agents. The agent must effectively coordinate with the other agents towards completion of the intended task, not relying on ...
Integrating BDI Agents with Agent-Based Simulation Platforms

Agent-based models (ABMs) are increasingly being used for exploring and supporting decision making about social science scenarios involving modelling of human agents. However existing agent-based simulation platforms (e.g., SWARM, Repast) provide ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AAMAS '05: Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems

July 2005

1407 pages

ISBN:1595930930

DOI:10.1145/1082473

Program Chairs:
Michal Pechoucek
Czech Republic
,
Donald Steiner
USA
,
Simon Thompson
UK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

AAMAS05

Sponsor:

SIGAI

AAMAS05: AAMAS '05 - Fourth International Joint Conference on Autonomous Agents and Multiagent Systems 2005

July 25 - 29, 2005

The Netherlands

Acceptance Rates

Overall Acceptance Rate 1,155 of 5,036 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,106
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seo SHan BUnhelkar VAgmon NAn BRicci AYeoh W(2023)Automated Task-Time Interventions to Improve Teamwork using Imitation LearningProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598655(335-344)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598655
Jaafar NAhmad MAhmad A(2016)The rationality of sincere software agent in task completion2016 2nd International Symposium on Agent, Multi-Agent Systems and Robotics (ISAMSR)10.1109/ISAMSR.2016.7810004(63-68)Online publication date: Aug-2016
https://doi.org/10.1109/ISAMSR.2016.7810004
HolmesParker CAgogino ATumer K(2016)Combining reward shaping and hierarchies for scaling to large multiagent systemsThe Knowledge Engineering Review10.1017/S026988891500015631:1(3-18)Online publication date: 11-Feb-2016
https://doi.org/10.1017/S0269888915000156
Holzinger ARöcker CZiefle M(2015)From Smart Health to Smart HospitalsSmart Health10.1007/978-3-319-16226-3_1(1-20)Online publication date: 25-Feb-2015
https://doi.org/10.1007/978-3-319-16226-3_1
Jennings NMoreau LNicholson DRamchurn SRoberts SRodden TRogers A(2014)Human-agent collectivesCommunications of the ACM10.1145/262955957:12(80-88)Online publication date: 26-Nov-2014
https://dl.acm.org/doi/10.1145/2629559
Bowring ETambe M(2012)Introducing Multiagent Systems to Undergraduates through Games and ChocolateComputer Engineering10.4018/978-1-61350-456-7.ch511(1246-1260)Online publication date: 2012
https://doi.org/10.4018/978-1-61350-456-7.ch511
Kalech M(2012)Diagnosis of coordination failuresAutonomous Agents and Multi-Agent Systems10.1007/s10458-010-9144-324:1(69-103)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1007/s10458-010-9144-3
Kotenko IKonovalov AShorov A(2012)Agent-based simulation of cooperative defence against botnetsConcurrency and Computation: Practice & Experience10.1002/cpe.185824:6(573-588)Online publication date: 1-Apr-2012
https://dl.acm.org/doi/10.1002/cpe.1858
Bowring ETambe M(2011)Introducing Multiagent Systems to Undergraduates through Games and ChocolateMulti-Agent Systems for Education and Interactive Entertainment10.4018/978-1-60960-080-8.ch006(101-114)Online publication date: 2011
https://doi.org/10.4018/978-1-60960-080-8.ch006
Sadik SRahman AAli AAhmad HSuguri H(2010)Modeling high assurance agent-based Earthquake Management System using formal techniquesThe Journal of Supercomputing10.1007/s11227-009-0266-952:2(97-118)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1007/s11227-009-0266-9
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten