Abstract
A formalization of multi-agent systems (MAS) as hidden Markov models (HMM) is proposed and investigated from a view point of interaction among agents and environments. Conventional formalizations of agents as HMM do not take changes of environments in account, so that it is hard to analyze behaviors of agents that act in dynamic environments. The proposed formalization enables HMM to handles changes of environment and interaction among agents via environment directly inside of state-transitions. I first investigate HMM that represents changes of the environment in the same state-transitions of agent itself. Then I derive a structured model in which environment, agent, and another agent are treated as separated state-transitions and coupled with each other. For this model, in order to reduce the number of parameters, I introduce “symmetricity” among agents. Moreover, I discuss relation between reducing dependency in transitions and assumption of cooperative behaviors in MAS.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Yoshua Bengio and Paolo Frasconi. An input output hmm architecuture. In G. Tesauro, D. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, pages 427–434. The MIT Press, 1995.
Matthew Brand. Coupled hideen markov models for modeling interacting processes. Perceptual Computing/Learning and Common Sense Technical Report 405, MIT Lab, jun 1997.
Zoubin Ghahramani and Michael I. Jordan. Factorial hidden markov models. Machine Learning, 29:245–275, 1997.
Coupled hidden Markov models for complex action recognition. Matthew brand and nuria oliver and alex pentland. Perceptual Computing/Learning and Common Sense Technical Report 407, MIT Media Lab, 20 1996.
Michael I. Jordan, Zoubin Ghahramani, Tommi Jaakkola, and Lawrence K. Saul. An introduction to variational methods for graphical models. Machine Learning, 37(2):183–233, 1999.
Michael I. Jordan, Zoubin Ghahramani, and Lawrence K. Saul. Hidden markov decision trees. In Michael C. Mozer, Michael I. Jordan, and Thomas Petsche, editors, Advances in Neural Information Processing Systems, volume 9, page 501. The MIT Press, 1997.
Michael I. Jordan, Zoubin Ghahramani, and Lawrence K. Saul. Hidden markov decision trees. In Michael C. Mozer, Michael I. Jordan, and Thomas Petsche, editors, Advances in Neural Information Processing Systems 9, page 501. The MIT Press, 1997.
Nuria M. Oliver, Barbara Rosario, and Alex Pentland. A bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):831–843, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Itsuki, N. (2002). Hidden Markov Modeling for Multi-agent Systems. In: Ishizuka, M., Sattar, A. (eds) PRICAI 2002: Trends in Artificial Intelligence. PRICAI 2002. Lecture Notes in Computer Science(), vol 2417. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45683-X_16
Download citation
DOI: https://doi.org/10.1007/3-540-45683-X_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44038-3
Online ISBN: 978-3-540-45683-4
eBook Packages: Springer Book Archive