Abstract
We show the existence ofaverage cost (AC-) optimal policy for an inventory system withuncountable state space; in fact, the AC-optimal cost and an AC-optimal stationary policy areexplicitly computed. In order to do this, we use a variant of thevanishing discount factor approach, which have been intensively studied in recent years but the available results not cover the inventory problem we are interested in.
Similar content being viewed by others
References
Araposthatis A et al. (1993) Discrete-time controlled Markov processes with average cost criterion: A survey. SIAM J. Control and Optim. 31:282–344
Cavazos-Cadena R (1994) A note on vanishing interest rate approach in average Markov decision chains with continuous and bounded cost. Syst. Control Lett. 24:373–383
Cavazos-Cadena R, Fernandez-Gaucherand E (1993) Denumerable controlled Markov chains with strong average optimality criterion: Bounded and unbounded cost. Working paper # 93-15, System and Industrial Engineering Department, The University of Arizona, Tucson, Az
Cavazos-Cadena R, Sennott LI (1992) Comparing recent assumption for the existence of average optimal stationary policies. Oper. Res. Lett. 11:33–37
Hernández-Lerma O (1991) Average optimality in dynamic programming on Borel spaces-Unbounded cost and controls. Syst. Control Lett. 17:237–242
Hernández-Lerma O, Lasserre JB (1990) Average cost optimal policies for Markov control processes with Borel state space and unbounded costs. Syst. Control Lett. 15:349–356
Hernández-Lerma O, Lasserre JB (1995) Discrete-time Markov control processes: Basic optimality criteria. Springer-Verlag, New York
Hu QY (1992) Discounted and average Markov decision processes with unbounded rewards: New conditions. J. Math. Anal, and Appl. 171:111–124
Luque-Vásquez F, Hernández-Lerma O (1995) A counterexample on the semicontinuity of minima. Proc. Amer. Math. Soc. 123:3175–3176
Montes-de-Oca R, Minjárez Sosa IA, Hernández-Lerma O (1994) Conditions for average optimality in Markov control processes on Borel spaces. Bol. Soc. Mat. Mexicana 39:39–50
Royden HL (1989) Real analysis. McMillan Publishing Co
Schäl M (1993) Average optimality in dynamic programming with general state space. Math. Oper. Res. 18:163–172
Sennott LI (1989) Average cost optimal stationary policies in infinite state Markov decision processes with unbounded exist. Oper. Res. 37:626–633
Sennott LI (1995) Another set of conditions for average optimality in Markov control processes. Syst. Control Lett. 24:147–151
Author information
Authors and Affiliations
Additional information
The work of the first author (OVA) was partially supported by Fondo del Sistema de Investigación del Mar de Cortéz under grant SIMAC/94/CT-005. The work of the second author (RMdO) was partially supported by Consejo Nacional de Ciencia y Tecnologia (CONACyT) under grant 0635P-E9506.
Rights and permissions
About this article
Cite this article
Vega-Amaya, O., Montes-de-Oca, R. Application of average dynamic programming to inventory systems. Mathematical Methods of Operations Research 47, 451–471 (1998). https://doi.org/10.1007/BF01198405
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01198405