Abstract
This paper presents a formulation of an optimality principle for a new class of concurrent decision systems formed by products of deterministic Markov decision processes (MDPs). For a single MDP, the optimality principle reduces to the usual Bellman’s equation. The formulation is significant because it provides a basis for the development of optimisation algorithms for decentralised decision systems including a recently proposed method based on Petri Net unfoldings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bertsekas, D.P.: Dynamic Programming and Optimal Control, vol. 1 and 2. Athena Scientific, Belmont (2001)
Ghallab, M., Nau, D., Traverso, P.: Automated Planning: Theory and Practice. Morgan Kaufmann, San Francisco (2004)
Hickmott, S.L.: Directed Unfolding: Reachability Analysis of Concurrent Systems and Applications to Automated Planning, Ph.D. Thesis, School of Electrical and Electronic Engineering, The University of Adelaide (2008)
Hickmott, S., Rintanen, J., Thiébaux, S., White, L.B.: Planning via Petri Net Unfolding. In: Proc. 20th Int. Joint Conf. on Artificial Intelligence, India, pp. 1904–1911 (2007)
Bonet, B., Haslum, P., Hickmott, S., Thiébaux, S.: Directed Unfolding of Petri Nets. In: Workshop on Unfolding and Partial Order Techniques. In 28th Int. Conf. of Application and Theory of Petri Nets and other Models of Concurrency, Poland (2007)
Esparza, J., Heljanko, K.: Unfoldings: A Partial Order Approach to Model Checking. Springer, Berlin (2008)
Murata, T.: Petri Nets: Properties, Analysis and Applications. Proceedings of the IEEE 77(4), 541–580 (1989)
Benveniste, A., Fabre, E., Haar, S.: Markov Nets: Probabilistic Models for Distributed and Concurrent Systems, Rapport de Recherche INRIA RR-4253 (September 2001)
Haar, S.: Probabilistic Cluster Unfoldings. Fundamenta Informaticae 53, 3-4, 281–314 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
White, L.B., Hickmott, S.L. (2008). An Optimality Principle for Concurrent Systems. In: Wobcke, W., Zhang, M. (eds) AI 2008: Advances in Artificial Intelligence. AI 2008. Lecture Notes in Computer Science(), vol 5360. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89378-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-89378-3_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89377-6
Online ISBN: 978-3-540-89378-3
eBook Packages: Computer ScienceComputer Science (R0)