Skip to main content
Log in

Bayesian Update of Recursive Agent Models

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

We present a framework for Bayesian updating of beliefs about models of agent(s) based on their observed behavior. We work within the formalism of the Recursive Modeling Method (RMM) that maintains and processes models an agent may use to interact with other agent(s), the models the agent may think the other agent has of the original agent, the models the other agent may think the agent has, and so on. The beliefs about which model is the correct one are incrementally updated based on the observed behavior of the modeled agent and, as the result, the probability of the model that best predicted the observed behavior is increased. Analogously, the models on deeper levels of modeling can be updated; the models that the agent thinks another agent uses to model the original agent are revised based on how the other agent is expected to observe the original agent's behavior, and so on. We have implemented and tested our method in two domains, and the results show a marked improvement in the quality of interactions with the belief update in both domains.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Albrecht, D., Zukerman, I., Nicholson, A. and Bud, A.: 1997, Towards a Bayesian model for keyhole plan recognition in large domains. In Proceedings of the Sixth International Conference on User Modeling, Chia Laguna, Italy, 363-365.

  • Albrecht, D., Zukerman, I. and Nicholson, A.: 1998, Bayesian models for keyhole plan recognition in an adventure game. In this issue.

  • Allen, J. F.: 1990, Two views of intention. In: P. R. Cohen, J. Morgan and M. E. Pollack (eds), Intentions in Communication. MIT Press.

  • Binmore, K.: 1982, Essays on Foundations of Game Theory. Pitman.

  • Chiu, B. C. and Webb, G. I.: 1998, Using decision trees for agent modelling: A study on improving prediction performance. In this issue.

  • Clark, H. H. and Marshall, C. R.: 1981, Definite reference and mutual knowledge. In: A. K. Joshi, B. L. Webber and I. A. Sag (eds), Elements of Discourse Understanding. Cambridge, U.K.: Cambridge University Press, 10-63.

    Google Scholar 

  • Cooper, G. and Herskovits, E.: 1992, A Bayesian method for the induction of probabilistic networks form data. Machine Learning (9), 309-347.

    Google Scholar 

  • Dennett, D.: 1986, Intentional systems. In: D. Dennett (ed), Brainstorms. MIT Press.

  • Friedman, N. and Halpern, J. Y.: 1994, A knowledge-based framework for belief change Part i: Foundations. In: Proceedings of Sixth Conference on Theoretical Aspects of Reasoning about Knowledge, 44-64.

  • Gmytrasiewicz, P. J. and Durfee, E. H.: 1995, A rigorous, operational formalization of recursive modeling. In: Proceedings of the First International Conference on Multiagent Systems, ICMAS'95, 125-132.

  • Gmytrasiewicz, P. J.: 1996, An approach to user modeling in decision support systems. In: Proceedings of the Fifth International Conference on User Modeling, Chia Laguna, Italy, 121-127.

  • Halpern, J. Y. and Moses, Y.: 1990, Knowledge and common knowledge in a distributed environment. Journal of the ACM 37(3), 549-587.

    Google Scholar 

  • Howard, R. A. and Matheson, J. E.: 1984, Influence diagrams. In: R. A. Howard and J. E. Matheson (eds), Readings on Principles and Applications of Decision Analysis. Strategic Decisions Group, Menlo Park, CA., 721-762.

    Google Scholar 

  • Huber, M. J., Durfee, E. H. and Wellman, M. P.: 1994, The automated mapping of plans for plan recognition. In: Proceedings of 1994 Conference on Uncertainty in Artificial Intelligence, 344-351.

  • Jameson, A., Schäfer, R., Simons, J. and Weis, T.: 1995, Adaptive provision of evaluation-oriented information: Tasks and techniques. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, Chia Laguna, Italy, 1886-1893.

  • Jameson, A.: 1989, But what will the listener think? belief ascription and image maintenance in dialog. In: A. Kobsa and W. Wahlster (eds), User Models in Dialog Systems. Springer-Verlag.

  • Levy, R. and Rosenschein, J. S.: 1992, A game theoretic approach to the pursuit problem. In: Working Papers of the Eleventh International Workshop on Distributed Artificial Intelligence, 195-213.

  • Myerson, R. B.: 1991, Game Theory: Analysis of Conflict. Harvard University Press.

  • Noh, S. and Gmytrasiewicz P. J.: 1997, Agent modeling in antiair defense. In: Proceedings of the Sixth International Conference on User Modeling, Chia Laguna, Italy, 389-400.

  • Pearl, J.: 1988, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufman.

  • Poh, K. L. and Horvitz, E. J.: 1996, A graph-theoretic analysis of information value. In: Proceedings of the Twelfth Conference on Uncertainty in Artificial Intelligence (UAI-96), 427-435.

  • Russell, S. and Norvig, P.: 1994, Artificial Intelligence: A Modern Approach. Prentice Hall.

  • Sen, S. and Knight, L.: 1995, A genetic prototype learner. In: Proceedings of the International Joint Conference on Artificial Intelligence, 84-89.

  • Sprites, P., Glymour, C. and Scheines, R.: 1993, Causation, Prediction and Search. Springer-Verlag.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gmytrasiewicz, P.J., Noh, S. & Kellogg, T. Bayesian Update of Recursive Agent Models. User Modeling and User-Adapted Interaction 8, 49–69 (1998). https://doi.org/10.1023/A:1008269427670

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008269427670

Navigation