Skip to main content
Springer Nature Link
Log in

Markov Decision Processes from Colored Petri Nets

  • Conference paper
Advances in Artificial Intelligence – SBIA 2010 (SBIA 2010)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6404))

Included in the following conference series:

Abstract

Models that are suitable for planning are not always easy to specify. In this paper we investigate the conversion of Petri nets into factored Markov decision processes: the former are relatively easy to build while the latter are adequate for policy generation. To represent probabilities that are needed when planning under uncertainty, we introduce factored Petri nets; we then describe the conversion of factored Petri nets in Markov decision processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Marsan, M.A., Balbo, G., Conte, G., Donatelli, S., Franceschinis, G.: Modeling with Generalized Stochastic Petri Nets. John Wiley and Sons, Chichester (1995)

    MATH  Google Scholar 

  2. Zhou, M., Venkatesh, K.: Modeling, Simulation and Control of Flexible Manufacturing Systems – A Petri Net Approach. World Scientific, Singapore (1999)

    Book  Google Scholar 

  3. Hass, P.J.: Stochastic Petri nets for modeling and simulation. In: Winter Simulation Conference, Washington, pp. 101–112 (2004)

    Google Scholar 

  4. Jensen, K.: An introduction to the theoretical aspects of colored Petri Nets. In: de Bakker, J.W., de Roever, W.-P., Rozenberg, G. (eds.) REX 1993. LNCS, vol. 803, pp. 230–272. Springer, Heidelberg (1994)

    Chapter  Google Scholar 

  5. Jensen, K.: An introduction to the practical use of colored Petri nets, pp. 237–292. Springer, Berlin (1998)

    Google Scholar 

  6. Jensen, K., Kristensen, L.M., Cristensen, S.: The Practioners Guide to Coloured Petri Nets, pp. 98–132. Springer, Berlin (1998)

    Google Scholar 

  7. Miyagi, P.E.: Controle Programavel. Editora Edgard Blcher (1996)

    Google Scholar 

  8. Russel, S., Norvig, P.: Inteligencia Artificial. Editora Campus (2004)

    Google Scholar 

  9. Puterman, M.L.: Markov Decision Processes. Wiley Series in Probability and Mathematical Statistics. John Wiley and Sons, New York (1994)

    Book  MATH  Google Scholar 

  10. Trevisan, F.W., Cozman, F.G., Barros, L.N.: Planning under risk and Knightian uncertainty. In: International Joint Conference on Artificial Intelligence, pp. 2023–2028 (2007)

    Google Scholar 

  11. Delgado, K.V., Barros, L.N., Cozman, F.G., Shirota, R.: Representing and solving factored Markov decision processes with imprecise probabilities. In: 6th International Symposium on Imprecise Probability: Theories and Applications, Durham, United Kingdom, pp. 169–178 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Escola Politécnica da Universidade de São Paulo, Av. Prof. Mello Moraes 2231, São Paulo, Brazil

    Monica Góes Eboli & Fabio Gagliardi Cozman

Authors
  1. Monica Góes Eboli
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fabio Gagliardi Cozman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. FURG, Centro de Ciências Computacionais, Universidade Federal do Rio Grande, Av. Itália, km 8 – Campus Carreiros, 96.201-900, Rio Grande, RS, Brazil

    Antônio Carlos da Rocha Costa

  2. UFRGS, Instituto de Informática, Universidade Federal do Rio Grande do Sul, Av. Bento Conçalves 9.500, 91501-970, Porto Alegre, RS, Brazil

    Rosa Maria Vicari

  3. Departamento de Ciência da Computação, Centro Universitário da FEI, Av. Humberto A. C. Branco 3972, 09850-901, São Bernardo do Campo, SP, Brazil

    Flavio Tonidandel

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Eboli, M.G., Cozman, F.G. (2010). Markov Decision Processes from Colored Petri Nets. In: da Rocha Costa, A.C., Vicari, R.M., Tonidandel, F. (eds) Advances in Artificial Intelligence – SBIA 2010. SBIA 2010. Lecture Notes in Computer Science(), vol 6404. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16138-4_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16138-4_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16137-7

  • Online ISBN: 978-3-642-16138-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics