skip to main content
10.1145/1837856.1837860acmotherconferencesArticle/Chapter ViewAbstractPublication PagesqtnaConference Proceedingsconference-collections
research-article

Markov chains with block-structured state-dependent events: formulation and correlation analysis

Published:24 July 2010Publication History

ABSTRACT

The literature on queueing systems with state-dependent parameters includes a variety of features, such as finite populations, server vacations, variable service rates, queue length dependence, retrials, and control of the admission upon arrival. The complexity of the stochastic models obtained by combining these non-homogeneous features and the method of stages causes practical difficulties. From the point of view of the numerical implementation, the large dimensionality of the underlying matrix representations is a serious problem that requires attention. Specifically, this is a key aspect if an arbitrary, even infinite number of Markovian arrival processes and phase-type distributions are involved. These considerations on the inherent difficulties associated with the stochastic modeling of block-structured state-dependent (BSDE) Markov chains provide the motivation for our study. In this paper, we briefly present the BSDE approach to construct either a specific part or the whole stochastic system in continuous time, modeling a state-dependent phenomenon operating in the presence of phases. A variant of the approach also holds in discrete time. We focus on the correlation structure and present two measures of correlation between events.

References

  1. J. R. Artalejo and A. Gómez-Corral, Retrial Queueing Systems: A Computational Approach. Berlin: Springer-Verlag, 2008.Google ScholarGoogle Scholar
  2. J. R. Artalejo and A. Gómez-Corral, "A State-dependent Markov-modulated Mechanism for Generating Events and Stochastic Models," Mathematical Methods in the Applied Sciences, to appear, 2010. (DOI: 10.1002/mma.l252, available online.)Google ScholarGoogle Scholar
  3. J. R. Artalejo and Q.-L. Li, "Performance Analysis of a Block-structured Discrete-time Retrial Queue with State-dependent Arrivals," Discrete Event Dynamic Systems, vol. 20, pp. 325--347, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. D. P. Gaver, P. A. Jacobs and G. Latouche, "Finite birth-and-death models in randomly changing environments," Advances in Applied Probability, vol. 16, pp. 715--731, 1984.Google ScholarGoogle ScholarCross RefCross Ref
  5. Q.-M. He and M. F. Neuts, "Markov chains with marked transitions," Stochastic Processes and Their Applications, vol. 74, pp. 37--52, 1998.Google ScholarGoogle ScholarCross RefCross Ref
  6. Q.-L. Li, Constructive Computation in Stochastic Models with Applications: The RG-factorizations. Beijing, Berlin Heidelberg: Tsinghua University Press, Springer-Verlag, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. D. M. Lucantoni, "New results on the single server queue with a batch Markovian arrival process," Stochastic Models, vol. 7, pp. 1--46, 1991.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. B. Moler and C. F. Van Loan, "Nineteen dubious ways to compute the exponential of a matrix, twenty-five years later," SIAM Review, vol. 45, pp. 3--49, 2003.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. F. Neuts, Matrix-geometric Solutions in Stochastic Models: An Algorithmic Approach. Baltimore: The Johns Hopkins University Press, 1981.Google ScholarGoogle Scholar
  10. M. F. Neuts, Structured Stochastic Matrices of M/G/1 Type and Their Applications. New York: Marcel Dekker, Inc, 1989.Google ScholarGoogle Scholar
  11. M. F. Neuts, Algorithmic Probability: A Collection of Problems. London: Chapman & Hall, 1995.Google ScholarGoogle Scholar

Index Terms

  1. Markov chains with block-structured state-dependent events: formulation and correlation analysis

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Other conferences
            QTNA '10: Proceedings of the 5th International Conference on Queueing Theory and Network Applications
            July 2010
            213 pages
            ISBN:9781450302128
            DOI:10.1145/1837856

            Copyright © 2010 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 24 July 2010

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader