Abstract
In a zero-sum stochastic game, at each stage, two opponents make decisions which determine a stage reward and the law of the state of nature at the next stage, and the aim of the players is to maximize the weighted-average of the stage rewards. In this paper we solve the constant-payoff conjecture formulated by Sorin, Venel and Vigeral in 2010 for two classes of stochastic games with weighted-average rewards: (1) absorbing games, a well-known class of stochastic games where the state changes at most once during the game, and (2) smooth stochastic games, a newly introduced class of stochastic games where the state evolves smoothly under optimal play.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Attia L, Oliu-Barton M (2019) A formula for the value of a stochastic game. Proc Natl Acad Sci 116(52):26435–26443
Bewley T, Kohlberg E (1976) The asymptotic theory of stochastic games. Math Op Res 1:197–208
Blackwell D, Ferguson TS (1968) The big match. Ann Math Stat 39:159–163
Freidlin MI, Wentzell AD (1984) Random perturbations of dynamical systems. Springer, Berlin
Gillette D (1957) Stochastic games with zero stop probabilities, contributions to the theory of games, III. In: Dresher M, Tucker AW, Wolfe P (eds) Annals of the mathematical studies. Princeton University Press, New Jersey, pp 179–187
Kohlberg E (1974) Repeated games with absorbing states. Ann Stat 2:724–738
Laraki R (2010) Explicit formulas for repeated games with absorbing states. Int J Game Theory 39:53–69
Mertens J-F, Neyman A (1981) Stochastic games. Int J Game Theory 10:53–66
Mertens J-F, Neyman A (1982) Stochastic games. Proc Natl Acad Sci USA 79:2145–2146
Neyman A, Sorin S (2010) Repeated games with public uncertain duration process. Int J Game Theory 39:29–52
Neyman Abraham (2017) Continuous-time stochastic games. Games Econ Behav 104:92–130
Oliu-Barton M, Ziliotto B (2021) Constant payoff in zero-sum stochastic games, to appear in Annals of IHP Probability
Shapley LS (1953) Stochastic games. Proc Natl Acad Sci USA 39:1095–1100
Sorin S, Venel X, Vigeral G (2010) Asymptotic properties of optimal trajectories in dynamic programming. Sankhya A 72:237–245
Sorin S, Vigeral G (2020) Limit optimal trajectories in zero-sum stochastic games. Dyn Games Appl 10:555–572
Ziliotto B (2016) A Tauberian theorem for nonexpansive operators and applications to zero-sum stochastic games. Math Op Res 41:1522–1534
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Oliu-Barton, M. Weighted-average stochastic games with constant payoff. Oper Res Int J 22, 1675–1696 (2022). https://doi.org/10.1007/s12351-021-00625-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12351-021-00625-6