Skip to main content

A Nondeterministic Dynamic Programming Model

  • Conference paper
  • 1117 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3214))

Abstract

In this paper we consider a dynamic programming model with nondeterministic system. Nondeterministic is a type of the transition systems. It means that a single state yields more than one state in the next stage. We newly introduce this nondeterministic system and study on related optimization problems. Nondeterministic dynamic programming covers traditional ones and has a strong possibility for applying the idea of dynamic programming to more various problems.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bellman, R.E.: Dynamic Programming. Princeton Univ. Press, NJ (1957)

    Google Scholar 

  2. Bellman, R.E., Zadeh, L.A.: Decision-making in a fuzzy environment. Management Sci. 17, B141–B164 (1970)

    Article  MathSciNet  Google Scholar 

  3. Fujita, T.: Re-examination of Markov Policies for Additive Decision Process. Bull. Informatics and Cybernetics 29, 51–65 (1997)

    MATH  Google Scholar 

  4. Fujita, T., Iwamoto, S.: Fractional Markov decision processes. In: Wang, H.F., Wen, U.P. (eds.) Proceedings of The Eighth Bellman Continuum, December, pp. 7–11. National Tsing Hua University, Hsinchu (2000)

    Google Scholar 

  5. Fujita, T., Tsurusaki, K.: Stochastic Optimization of Multiplicative Functions with Negative Value. J. Operations Res. Soc. Japan 41, 351–373 (1998)

    MATH  MathSciNet  Google Scholar 

  6. Howard, R.A.: Dynamic Programming and Markov Processes. MIT Press, Cambridge (1960)

    MATH  Google Scholar 

  7. Iwamoto, S.: Theory of Dynamic Program: Japanese. Kyushu Univ. Press, Fukuoka (1987)

    Google Scholar 

  8. Iwamoto, S.: Maximizing threshold probability through invariant imbedding. In: Wang, H.F., Wen, U.P. (eds.) Proceedings of The Eighth Bellman Continuum, pp. 17–22. National Tsing Hua University, Hsinchu (2000)

    Google Scholar 

  9. Iwamoto, S.: A class of dual fuzzy dynamic programs. Appl. Math. Comput. 120, 91–108 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  10. Iwamoto, S., Tsurusaki, K., Fujita, T.: On Markov policies for minimax decision processes. J. Math. Anal. Appl. 253, 58–78 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  11. Lew, A.: A Petri net model for discrete dynamic programming. In: Proceedings of the 9th Bellman Continuum: International Workshop on Uncertain Systems and Soft Computing, Beijing, China, pp. 16–21 (2002)

    Google Scholar 

  12. Puterman, M.L.: Markov Decision Processes: discrete stochastic dynamic programming. Wiley & Sons, New York (1994)

    MATH  Google Scholar 

  13. Sniedovich, M.: Dynamic Programming. Marcel Dekker, Inc. NY (1992)

    Google Scholar 

  14. Stokey, N.L., Lucas, R.E.: Recursive Methods in Economic Dynamics. Harvard University Press, Cambridge (1989)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fujita, T., Ueno, T., Iwamoto, S. (2004). A Nondeterministic Dynamic Programming Model. In: Negoita, M.G., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2004. Lecture Notes in Computer Science(), vol 3214. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30133-2_161

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30133-2_161

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23206-3

  • Online ISBN: 978-3-540-30133-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics