Salah M. Yousif
ABSTRACT
This paper presents a system stochastic model described by Kolmogorov's differential equations which they lead in the steady state to the system balance equations. Applications of this model to some engineering simulation situations are briefly treated.
- 1.Bhat, U. Narayan. Elements of Applied Stochastic Processes. New York, John Wiley, 1972.]]Google Scholar
- 2.Ross, Sheldon M. Introduction to Probability Models, New York, Academic Press, 1972.]] Google ScholarDigital Library
Index Terms
- The exponential Markov stochastic model
Recommendations
Stochastic policy search for variance-penalized semi-Markov control
WSC '11: Proceedings of the Winter Simulation ConferenceThe variance-penalized metric in Markov decision processes (MDPs) seeks to maximize the average reward minus a scalar times the variance of rewards. In this paper, our goal is to study the same metric in the context of the semi-Markov decision process (...
Stochastic Comparisons for Non-Markov Processes
A technique is developed for comparing a non-Markov process to a Markov process on a general state space with many possible stochastic orderings. Two such comparisons with a common Markov process yield a comparison between two non-Markov processes. The ...
Structure-preserving stochastic conformal exponential integrator for linearly damped stochastic differential equations
In this paper, we study the linearly damped stochastic differential equations, which have the invariants satisfying a linear differential equation whose coefficients are linear constant or time-dependent. A stochastic exponential integrator is proposed ...
Comments