ABSTRACT
This paper describes in language free flow diagram form, a program for simulating Markov processes (MARKOV) intended for use by someone with programming experience. The program establishes the initial state of the process (if it is unknown), the present state, the previous state, and the number of transitions from each state to all states. These parameters can be used to determine various characteristics of Markov processes of interest to the systems analyst.
- 1.Cohen, B.P., A Probability Model for Conformity, Sociometry, 21, 1, 1958, pp. 69-81.Google ScholarCross Ref
- 2.Prais, S.J., Measuring Social Mobility, J.R. Statist. Soc., A118, pp. 56-66, 1955.Google Scholar
- 3.Zahl, S., A Markov Process Model for Follow-Up studies, Human Biology, 27, pp. 90-120, 1955.Google Scholar
Index Terms
- Markov: A general purpose simulation program
Recommendations
Markov Model of Malicious Code Propagation
CICC-ITOE '10: Proceedings of the 2010 International Conference on Innovative Computing and Communication and 2010 Asia-Pacific Conference on Information Technology and Ocean EngineeringIn this paper, propagation process of malicious code in computer networks are analyzed by discrete-state Markov model. Computer system without defense mechanism of virus in the networks can be classified: susceptible(S), quarantine(Q), infection(I) and ...
Ergodicity in Parametric Nonstationary Markov Chains: An Application to Simulated Annealing Methods
<P>A nonstationary Markov chain is weakly ergodic if the dependence of the state distribution on the starting state vanishes as time tends to infinity. A chain is strongly ergodic if it is weakly ergodic and converges in distribution. In this paper we ...
Exploring the state sequence space for hidden Markov and semi-Markov chains
The knowledge of the state sequences that explain a given observed sequence for a known hidden Markovian model is the basis of various methods that may be divided into three categories: (i) enumeration of state sequences; (ii) summary of the possible ...
Comments