Abstract
Models that are suitable for planning are not always easy to specify. In this paper we investigate the conversion of Petri nets into factored Markov decision processes: the former are relatively easy to build while the latter are adequate for policy generation. To represent probabilities that are needed when planning under uncertainty, we introduce factored Petri nets; we then describe the conversion of factored Petri nets in Markov decision processes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Marsan, M.A., Balbo, G., Conte, G., Donatelli, S., Franceschinis, G.: Modeling with Generalized Stochastic Petri Nets. John Wiley and Sons, Chichester (1995)
Zhou, M., Venkatesh, K.: Modeling, Simulation and Control of Flexible Manufacturing Systems – A Petri Net Approach. World Scientific, Singapore (1999)
Hass, P.J.: Stochastic Petri nets for modeling and simulation. In: Winter Simulation Conference, Washington, pp. 101–112 (2004)
Jensen, K.: An introduction to the theoretical aspects of colored Petri Nets. In: de Bakker, J.W., de Roever, W.-P., Rozenberg, G. (eds.) REX 1993. LNCS, vol. 803, pp. 230–272. Springer, Heidelberg (1994)
Jensen, K.: An introduction to the practical use of colored Petri nets, pp. 237–292. Springer, Berlin (1998)
Jensen, K., Kristensen, L.M., Cristensen, S.: The Practioners Guide to Coloured Petri Nets, pp. 98–132. Springer, Berlin (1998)
Miyagi, P.E.: Controle Programavel. Editora Edgard Blcher (1996)
Russel, S., Norvig, P.: Inteligencia Artificial. Editora Campus (2004)
Puterman, M.L.: Markov Decision Processes. Wiley Series in Probability and Mathematical Statistics. John Wiley and Sons, New York (1994)
Trevisan, F.W., Cozman, F.G., Barros, L.N.: Planning under risk and Knightian uncertainty. In: International Joint Conference on Artificial Intelligence, pp. 2023–2028 (2007)
Delgado, K.V., Barros, L.N., Cozman, F.G., Shirota, R.: Representing and solving factored Markov decision processes with imprecise probabilities. In: 6th International Symposium on Imprecise Probability: Theories and Applications, Durham, United Kingdom, pp. 169–178 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Eboli, M.G., Cozman, F.G. (2010). Markov Decision Processes from Colored Petri Nets. In: da Rocha Costa, A.C., Vicari, R.M., Tonidandel, F. (eds) Advances in Artificial Intelligence – SBIA 2010. SBIA 2010. Lecture Notes in Computer Science(), vol 6404. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16138-4_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-16138-4_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16137-7
Online ISBN: 978-3-642-16138-4
eBook Packages: Computer ScienceComputer Science (R0)