skip to main content
10.1145/2245276.2245420acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Multi-agent framework for real-time processing of large and dynamic search spaces

Published:26 March 2012Publication History

ABSTRACT

Distributed systems based on cooperative multi-agents have been used in a wide range of application domains. However, the need for real-time processing in large and dynamic search spaces has led to new challenges. In addition to the constraints in time and computational resources, the agents have to operate under highly dynamic conditions in complex environments. Finding optimal solutions within time constraints may not be always possible. Anytime algorithms have shown great promise in providing approximate solutions. The quality of these intermediate/partial solutions depends on the amount of computational resources available for processing. The key insight that we describe in this paper is that anytime algorithms can be leveraged in a partial processing paradigm where the partial solutions can be used to quickly identify potential solutions and thereby efficiently utilize resources, even under dynamic conditions. The partial solutions can also be used for a coarse grained categorization of large search spaces that can support a mix of explorative and exploitative agent behaviors. We will describe how explicit modeling of the dynamism using a simple but unique search space model can help agents adapt to the changing information space. We describe a generic multi-agent framework that leverages our search space model while modeling various aspects of agent behavior such as candidate selection, agent interactions, etc. This framework can be used to design agents to work with partial processing in various application domains. We will develop suitable testbeds, simulation experiments, algorithms and performance metrics to validate the framework.

References

  1. C. Carrascosa, J. Bajo, V. Julian, J. Corchado, and V. Botti. Hybrid multi-agent architecture as a real-time problem-solving model. Expert Systems with Applications, 34(1): 2--17, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. P. Hoen, K. Tuyls, L. Panait, S. Luke, and J. La Poutre. An overview of cooperative and competitive multiagent learning. In K. Tuyls, P. Hoen, K. Verbeeck, and S. Sen, editors, Learning and Adaption in Multi-Agent Systems, volume 3898 of Lecture Notes in Computer Science, pages 1--46. Springer Berlin/Heidelberg, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. S. Koenig and X. Sun. Comparing real-time and incremental heuristic search for real-time situated agents. Autonomous Agents and Multi-Agent Systems, 18(3): 313--341, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. W. S. Lovejoy. A survey of algorithmic methods for partially observable markov decision processes. Annals of Operations Research, 28(1): 47--65, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. R. L. Raffard, C. J. Tomlin, and S. P. Boyd. Distributed optimization for cooperative agents: Application to formation flight. In Proceedings of the 43rd IEEE Conference on Decision and Control, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  6. S. Ross, J. Pineau, S. Paquet, and B. Chaib-draa. Online planning algorithms for pomdps. Journal of Artificial Intelligence Research, 32: 663--704, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. E. Santos Jr, E. Santos, H. Nguyen, L. Pan, and J. Korah. Large-scale distributed foraging, gathering, and matching for information retrieval: Assisting the geo-spatial intelligence analyst. In Proceedings of SPIE, volume 5803, page 66, 2005.Google ScholarGoogle Scholar
  8. E. Santos Jr, E. Santos, H. Nguyen, L. Pan, and J. Korah. A large-scale distributed framework for information retrieval in large dynamic search spaces. Applied Intelligence, 35: 375--398, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. E. Santos Jr, E. Santos, H. Nguyen, L. Pan, J. Korah, H. Xia, F. Yu, and D. Li. E-Government Diffusion, Policy and Impact: Advanced Issues and Practices, chapter Analyst-Ready Large Scale Real Time Information Retrieval Tool for E-Governance, pages 268--294. IGI Global, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  10. E. Santos Jr, E. E. Santos, H. Nguyen, L. Pan, J. Korah, Q. Zhao, and M. Pittkin. I-FGM information retrieval in highly dynamic search spaces. In Proceedings of SPIE, volume 6229, page 622901, 2006.Google ScholarGoogle Scholar
  11. E. Santos Jr and E. S. Santos. A framework for building knowledge-based under uncertainty. Journal of Experimental and Theoretical Artificial Intelligence, 11: 265--286, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  12. E. Santos Jr, S. E. Shimony, and E. M. Williams. Solving hard computational problems through collections (portfolios) of cooperative heterogeneous algorithms. In Proceedings of the Twelfth International Florida Artificial Intelligence Research Society Conference, pages 356--360, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. K. Vikhorev, N. Alechina, and B. Logan. The ARTS real-time agent architecture. In Proceedings of Second Workshop on Languages, Methodologies and Development Tools for Multi-agent Systems (LADS2009), Turin, Italy, September 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. S. Zilberstein. Using anytime algorithms in intelligent systems. AI Magazine, 17(3): 73--83, 1996.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Multi-agent framework for real-time processing of large and dynamic search spaces

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SAC '12: Proceedings of the 27th Annual ACM Symposium on Applied Computing
        March 2012
        2179 pages
        ISBN:9781450308571
        DOI:10.1145/2245276
        • Conference Chairs:
        • Sascha Ossowski,
        • Paola Lecca

        Copyright © 2012 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 26 March 2012

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        SAC '12 Paper Acceptance Rate270of1,056submissions,26%Overall Acceptance Rate1,650of6,669submissions,25%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader