Abstract
This work is devoted to stochastic systems arising from empirical measures of random sequences (termed primary sequences) that are modulated by another Markov chain. The Markov chain is used to model random discrete events that are not represented in the primary sequences. One novel feature is that in lieu of the usual scaling in empirical measure sequences, the authors consider scaling in both space and time, which leads to new limit results. Under broad conditions, it is shown that a scaled sequence of the empirical measure converges weakly to a number of Brownian bridges modulated by a continuous-time Markov chain. Ramifications and special cases are also considered.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Gharehshiran O, Krishnamurthy V, and Yin G, Distributed energy-aware diffusion least mean squares: Game-theoretic learning, IEEE J. Selected Topics in Signal Processing, 2013, 7: 821–836.
Hamdi M, Krishnamurthy V, and Yin G, Tracking a Markov-modulated probability mass function with applications on dynamic random graphs, IEEE Trans. Information Theory, 2014, 60: 6609–6625.
Engle R F, Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation, Econometrica, 1982, 50: 987–1007.
Hamilton J D and Susmel R, Autoregressive conditional heteroskedasticity and changes in regime, J. Econometrics, 1994, 64: 307–333.
Bollerslev T, Generalized autoregressive conditional heteroskedasticity, J. Econometrics, 1986, 31: 307–327.
Bensoussan A, Yan Z, and Yin G, Threshold-type policies for real options using regime-switching models, SIAM Journal on Financial Mathematics, 2012, 3: 667–689.
Yin G and Zhu C, Hybrid Switching Diffusions: Properties and Applications, Springer, New York, 2010.
Nguyen S L and Yin G, Asymptotic properties of Markov modulated random sequences with fast and slow time scales, Stochastics, 2010, 82: 445–474.
Mei H and Yin G, Convergence and convergence rates for approximating ergodic means of functions of solutions to stochastic differential equations with Markov switching, Stochastic Process Appl., 2015, 125: 3104–3125.
Courtois P J, Decomposability: Queueing and Computer System Applications, Academic Press, New York, NY, 1977.
Simon H A and Ando A, Aggregation of variables in dynamic systems, Econometrica, 1961, 29: 111–138.
Yin G and Zhang Q, Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach, 2nd Ed., Springer-Verlag, New York, NY, 2013.
Yin G and Zhang Q, Discrete-Time Markov Chains: Two-Time-Scale Methods and Applications, Springer, New York, NY, 2005.
Ethier S N and Kurtz T G, Markov Processes: Characterization and Convergence, J. Wiley, New York, 1986.
Pollard D, Convergence of Stochastic Processes, Springer, New York, 1984.
Kushner H J, Approximation and Weak Convergence Methods for Random Processes, with applications to Stochastic Systems Theory, MIT Press, Cambridge, MA, 1984.
Billingsley P, Convergence of Probability Measures, J. Wiley, New York, NY, 1968.
Karlin S and Taylor H M, A First Course in Stochastic Processes, 2nd Edition, Academic Press, New York, NY, 1975.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by the Air Force Office of Scientific Research under Grant No. FA9550-15-1-0131.
This paper was recommended for publication by Editor ZHANG Bingyu.
Rights and permissions
About this article
Cite this article
Yin, G., Bui, T. Stochastic systems arising from Markov modulated empirical measures. J Syst Sci Complex 30, 999–1011 (2017). https://doi.org/10.1007/s11424-016-5248-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11424-016-5248-4