ABSTRACT
Distributed systems based on cooperative multi-agents have been used in a wide range of application domains. However, the need for real-time processing in large and dynamic search spaces has led to new challenges. In addition to the constraints in time and computational resources, the agents have to operate under highly dynamic conditions in complex environments. Finding optimal solutions within time constraints may not be always possible. Anytime algorithms have shown great promise in providing approximate solutions. The quality of these intermediate/partial solutions depends on the amount of computational resources available for processing. The key insight that we describe in this paper is that anytime algorithms can be leveraged in a partial processing paradigm where the partial solutions can be used to quickly identify potential solutions and thereby efficiently utilize resources, even under dynamic conditions. The partial solutions can also be used for a coarse grained categorization of large search spaces that can support a mix of explorative and exploitative agent behaviors. We will describe how explicit modeling of the dynamism using a simple but unique search space model can help agents adapt to the changing information space. We describe a generic multi-agent framework that leverages our search space model while modeling various aspects of agent behavior such as candidate selection, agent interactions, etc. This framework can be used to design agents to work with partial processing in various application domains. We will develop suitable testbeds, simulation experiments, algorithms and performance metrics to validate the framework.
- C. Carrascosa, J. Bajo, V. Julian, J. Corchado, and V. Botti. Hybrid multi-agent architecture as a real-time problem-solving model. Expert Systems with Applications, 34(1): 2--17, 2008. Google ScholarDigital Library
- P. Hoen, K. Tuyls, L. Panait, S. Luke, and J. La Poutre. An overview of cooperative and competitive multiagent learning. In K. Tuyls, P. Hoen, K. Verbeeck, and S. Sen, editors, Learning and Adaption in Multi-Agent Systems, volume 3898 of Lecture Notes in Computer Science, pages 1--46. Springer Berlin/Heidelberg, 2006. Google ScholarDigital Library
- S. Koenig and X. Sun. Comparing real-time and incremental heuristic search for real-time situated agents. Autonomous Agents and Multi-Agent Systems, 18(3): 313--341, 2009. Google ScholarDigital Library
- W. S. Lovejoy. A survey of algorithmic methods for partially observable markov decision processes. Annals of Operations Research, 28(1): 47--65, 1991. Google ScholarDigital Library
- R. L. Raffard, C. J. Tomlin, and S. P. Boyd. Distributed optimization for cooperative agents: Application to formation flight. In Proceedings of the 43rd IEEE Conference on Decision and Control, 2004.Google ScholarCross Ref
- S. Ross, J. Pineau, S. Paquet, and B. Chaib-draa. Online planning algorithms for pomdps. Journal of Artificial Intelligence Research, 32: 663--704, 2008. Google ScholarDigital Library
- E. Santos Jr, E. Santos, H. Nguyen, L. Pan, and J. Korah. Large-scale distributed foraging, gathering, and matching for information retrieval: Assisting the geo-spatial intelligence analyst. In Proceedings of SPIE, volume 5803, page 66, 2005.Google Scholar
- E. Santos Jr, E. Santos, H. Nguyen, L. Pan, and J. Korah. A large-scale distributed framework for information retrieval in large dynamic search spaces. Applied Intelligence, 35: 375--398, 2011. Google ScholarDigital Library
- E. Santos Jr, E. Santos, H. Nguyen, L. Pan, J. Korah, H. Xia, F. Yu, and D. Li. E-Government Diffusion, Policy and Impact: Advanced Issues and Practices, chapter Analyst-Ready Large Scale Real Time Information Retrieval Tool for E-Governance, pages 268--294. IGI Global, 2009.Google ScholarCross Ref
- E. Santos Jr, E. E. Santos, H. Nguyen, L. Pan, J. Korah, Q. Zhao, and M. Pittkin. I-FGM information retrieval in highly dynamic search spaces. In Proceedings of SPIE, volume 6229, page 622901, 2006.Google Scholar
- E. Santos Jr and E. S. Santos. A framework for building knowledge-based under uncertainty. Journal of Experimental and Theoretical Artificial Intelligence, 11: 265--286, 1999.Google ScholarCross Ref
- E. Santos Jr, S. E. Shimony, and E. M. Williams. Solving hard computational problems through collections (portfolios) of cooperative heterogeneous algorithms. In Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference, pages 356--360, 1999. Google ScholarDigital Library
- R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998. Google ScholarDigital Library
- K. Vikhorev, N. Alechina, and B. Logan. The ARTS real-time agent architecture. In Proceedings of Second Workshop on Languages, Methodologies and Development Tools for Multi-agent Systems (LADS2009), Turin, Italy, September 2009. Google ScholarDigital Library
- S. Zilberstein. Using anytime algorithms in intelligent systems. AI Magazine, 17(3): 73--83, 1996.Google ScholarDigital Library
Index Terms
- Multi-agent framework for real-time processing of large and dynamic search spaces
Recommendations
Design of Multi Agent System for Resource Allocation and Monitoring
The objective of Resource Allocation and Monitoring System is to make the procedures involved in allocating fund resources to competing clients transparent so that deserving candidates get funds. Proactive and goal directed behaviour of agents make the ...
Anytime Multi-Agent Path Finding via Large Neighborhood Search
AAMAS '21: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent SystemsMulti-Agent Path Finding (MAPF) is the challenging problem of computing collision-free paths for a cooperative team of moving agents. Algorithms for solving MAPF can be categorized on a spectrum. At one end are (bounded-sub)optimal algorithms that can ...
Subjective partial cooperation in multi-agent local search
AAMAS '14: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systemsA partial cooperative model that was recently proposed offers a balance between the two extreme scenarios commonly assumed in multi-agent systems, either completely competitive or fully cooperative agents. Partial cooperative agents act cooperatively in ...
Comments