Abstract
The optimal policy and the value function of a problem of optimal switching between a Wiener process and a deterministic motion on a segment are found in the present article. The speed of the motion is equal to 1 and it is in direction to the nearest end of the segment. For every switching a positive payment has to be paid. The problem is to minimize the sum of the first exit time of the process and the total payment. It turns out that there exist four different optimal rules depending on the length of the segment and the switching cost.
Similar content being viewed by others
References
Donchev D (1991) Some topics of the controlled Markov processes with a continuous time parameter. Thesis of dissertation, Steklov Institute of Mathematics M
Krylov N (1977) Controlled diffusion processes M 400
Kolmogorov A, Fomin S (1981) Elements of function theory and functional analysis M 544
Mazziotto G, Millet A (1987) Stochastic control of two-parameter processes application: The two-armed bandit problem. Stochastic 22: 251–288
Tanaka T (1991) Optimal switching for two-parameter stochastic processes. Stochastic Processes and their Applications 38: 135–156
Tanaka T (1991) The system of quasi-variational inequalities attached to two-armed bandit problem. Preprint
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Donchev, D.S. An example of optimal switching between a wiener process and a deterministic motion with a non-zero switching cost. ZOR - Methods and Models of Operations Research 41, 57–70 (1995). https://doi.org/10.1007/BF01415065
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01415065