Skip to main content
Log in

The Transform Likelihood Ratio Method for Rare Event Simulation with Heavy Tails

  • Published:
Queueing Systems Aims and scope Submit manuscript

Abstract

We present a novel method, called the transform likelihood ratio (TLR) method, for estimation of rare event probabilities with heavy-tailed distributions. Via a simple transformation (change of variables) technique the TLR method reduces the original rare event probability estimation with heavy tail distributions to an equivalent one with light tail distributions. Once this transformation has been established we estimate the rare event probability via importance sampling, using the classical exponential change of measure or the standard likelihood ratio change of measure. In the latter case the importance sampling distribution is chosen from the same parametric family as the transformed distribution. We estimate the optimal parameter vector of the importance sampling distribution using the cross-entropy method. We prove the polynomial complexity of the TLR method for certain heavy-tailed models and demonstrate numerically its high efficiency for various heavy-tailed models previously thought to be intractable. We also show that the TLR method can be viewed as a universal tool in the sense that not only it provides a unified view for heavy-tailed simulation but also can be efficiently used in simulation with light-tailed distributions. We present extensive simulation results which support the efficiency of the TLR method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. S. Asmussen, Applied Probability and Queues (Wiley, New York, 1987).

    Google Scholar 

  2. S. Asmussen and K. Binswanger, Simulation of ruin probabilities for subexponential claims, ASTIN Bulletin 27(2) (1997) 297–318.

    Google Scholar 

  3. S. Asmussen, K. Binswanger and B. Højgaard, Rare events simulations for heavy-tailed distributions, Bernoulli 6 (2000) 303–322.

    Google Scholar 

  4. S. Asmussen, D.P. Kroese and R.Y. Rubinstein, Heavy tails, importance sampling and cross-entropy, Submitted.

  5. S. Asmussen and R.Y. Rubinstein, Complexity properties of steady-state rare-events simulation in queueing models, in: Advances in Queueing: Theory, Methods and Open Problems (CRC Press, Boca Raton, FL, 1995) pp. 429–462.

    Google Scholar 

  6. P.T. de Boer, D.P. Kroese and R.Y. Rubinstein, Estimating buffer overflows in three stages using cross-entropy, in: Proc. of the 2002 Winter Simulation Conf., San Diego, 2002, pp. 301–309.

  7. P.T. de Boer, D.P. Kroese and R.Y. Rubinstein, A fast cross-entropy method for estimating buffer overflows in queueing networks, Managm. Sci. (2004) to appear.

  8. T. Homem de Mello and R.Y. Rubinstein, Rare event probability estimation for static models via cross-entropy and importance sampling, Submitted.

  9. P. Embrechts and N. Veraverbeke, Estimates for the probability of ruin with special empahsis on the possibility of large claims, Insurance Math. Economics 1 (1982), 55–72.

    Google Scholar 

  10. P.W. Glynn and D.L. Iglehart, Importance sampling for stochastic simulations, Managm. Sci. 35 (1989) 1367–1392.

    Google Scholar 

  11. P. Heidelberger, Fast simulation of rare events in queueing and reliability models, ACM Trans. Modeling Comput. Simulation 5 (1995) 43–85.

    Google Scholar 

  12. S. Juneja and P. Shahabuddin, Simulating heavy tailed processes using delayed hazard rate twisting, ACM Trans. Modeling Comput. Simulation 12 (2002) 94–118.

    Google Scholar 

  13. I. Kovalenko, Approximations of queues via small parameter method, in: Advances in Queueing: Theory, Methods and Open Problems, ed. J.H. Dshalalow (CRC Press, New York, 1995) pp. 481–509.

    Google Scholar 

  14. R.Y. Rubinstein, Optimization of computer simulation models with rare events, European J. Oper. Res. 99 (1997) 89–112.

    Google Scholar 

  15. R.Y. Rubinstein, The cross-entropy method for combinatorial and continuous optimization, Methodology Computing in Appl. Probab. 2 (1999) 127–190.

    Google Scholar 

  16. R.Y. Rubinstein and D.P. Kroese, The Cross-Entropy Method: A Unified Approach to Combinatorial Optimisation, Monte-Carlo Simulation and Machine Learning (Springer, New York, 2004).

    Google Scholar 

  17. R.Y. Rubinstein and B. Melamed, Modern Simulation and Modeling, Wiley Series in Probability and Statistics (Wiley, New York, 1998).

    Google Scholar 

  18. J.S. Sadowsky, On the optimality and stability of exponential twisting in Monte Carlo simulation, IEEE Trans. Inform. Theory 39 (1993) 119–128.

    Google Scholar 

  19. P. Shahabuddin, Rare event simulation of stochastic systems, in: Proc. of the 1995 Winter Simulation Conf., Washington, DC, 1995 (IEEE Press, New York, 1995) pp. 178–185.

    Google Scholar 

  20. D. Siegmund, Importance sampling in the Monte Carlo study of sequential tests, Ann. Statist. 4 (1976) 673–684.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kroese, D., Rubinstein, R. The Transform Likelihood Ratio Method for Rare Event Simulation with Heavy Tails. Queueing Systems 46, 317–351 (2004). https://doi.org/10.1023/B:QUES.0000027989.97672.be

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:QUES.0000027989.97672.be

Navigation