skip to main content
research-article

Performance of folded variance estimators for simulation

Published:07 October 2010Publication History
Skip Abstract Section

Abstract

We extend and analyze a new class of estimators for the variance parameter of a steady-state simulation output process. These estimators are based on “folded” versions of the standardized time series (STS) of the process, and are analogous to the area and Cramér--von Mises estimators calculated from the original STS. In fact, one can apply the folding mechanism more than once to produce an entire class of estimators, all of which reuse the same underlying data stream. We show that these folded estimators share many of the same properties as their nonfolded counterparts, with the added bonus that they are often nearly independent of the nonfolded versions. In particular, we derive the asymptotic distributional properties of the various estimators as the run length increases, as well as their bias, variance, and mean squared error. We also study linear combinations of these estimators, and we show that such combinations yield estimators with lower variance than their constituents. Finally, we consider the consequences of batching, and we see that the batched versions of the new estimators compare favorably to benchmark estimators such as the nonoverlapping batch means estimator.

Skip Supplemental Material Section

Supplemental Material

References

  1. }}Aktaran-Kalayci, T., Alexopoulos, C., Argon, N. T., Goldsman, D., and Wilson, J. R. 2007. Exact expected values of variance estimators in steady-state simulation. Naval Res. Logistics 54, 4, 397--410.Google ScholarGoogle ScholarCross RefCross Ref
  2. }}Alexopoulos, C., Argon, N. T., Goldsman, D., Steiger, N. M., Tokol, G., and Wilson, J. R. 2007a. Efficient computation of overlapping variance estimators for simulation. INFORMS J. Comput. 19, 3, 314--327. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. }}Alexopoulos, C., Argon, N. T., Goldsman, D., Tokol, G., and Wilson, J. R. 2007b. Overlapping variance estimators for simulation. Oper. Res. 55, 6, 1090--1103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. }}Antonini, C. 2005. Folded variance estimators for stationary processes. Ph.D. dissertation, School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA.Google ScholarGoogle Scholar
  5. }}Antonini, C., Alexopoulos, C., Goldsman, D., and Wilson, J. R. 2007. Folded standardized time series area variance estimators for simulation. In Proceedings of the Winter Simulation Conference. S. G. Henderson et al. Eds., Institute of Electrical and Electronics Engineers, Piscataway, NJ, 455--462. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. }}Antonini, C., Alexopoulos, C., Goldsman, D., and Wilson, J. R. 2009. Area variance estimators for simulation using folded standardized time series. IIE Trans. 41, 134--144.Google ScholarGoogle ScholarCross RefCross Ref
  7. }}Atkinson, K. 1988. An Introduction to Numerical Analysis. Wiley, New York.Google ScholarGoogle Scholar
  8. }}Billingsley, P. 1968. Convergence of Probability Measures. Wiley, New York.Google ScholarGoogle Scholar
  9. }}Box, G. E. P. 1954. Some theorems on quadratic forms applied in the study of analysis of variance problems, I. Effect of inequality of variance in the one-way classification. Ann. Math. Stat. 25, 290--302.Google ScholarGoogle ScholarCross RefCross Ref
  10. }}Calvin, J. M. 2007. Simulation output analysis using integrated paths. ACM Trans. Model. Comput. Simul. 17, 3, 13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. }}Calvin, J. M. and Nakayama, M. K. 2006. Permuted standardized time series estimators for steady-state simulation. Math. Oper. Res. 31, 2, 351--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. }}Chien, C.-H., Goldsman, D., and Melamed, B. 1997. Large-sample results for batch means. Manage. Sci. 43, 1288--1295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. }}Conway, R. W. 1963. Some tactical problems in digital simulation. Manage. Sci. 10, 47--61.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. }}Conway, R. W., Johnson, B. M., and Maxwell, M. L. 1959. Some problems of digital simulation. Manage. Sci. 6, 92--110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. }}Crane, M. A. and Lemoine, A. J. 1977. An Introduction to the Regenerative Method for Simulation Analysis. Springer, Berlin. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. }}Fishman, G. S. 1973. Statistical analysis for queueing simulations. Manage. Sci. 20, 363--369.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. }}Fishman, G. S. and Yarberry, L. S. 1997. An implementation of the batch means method. INFORMS J. Comput. 9, 296--310.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. }}Foley, R. D. and Goldsman, D. 1999. Confidence intervals using orthonormally weighted standardized time series. ACM Trans. Model. Simul. 9, 297--325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. }}Glynn, P. W. and Iglehart, D. L. 1990. Simulation output analysis using standardized time series. Math. Oper. Res. 15, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. }}Glynn, P. W. and Whitt, W. 1991. Estimating the asymptotic variance with batch means. Oper. Res. Lett. 10, 431--435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. }}Goldsman, D., Kang, K., and Seila, A. F. 1999. Cramér--von Mises variance estimators for simulations. Oper. Res. 47, 299--309. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. }}Goldsman, D. and Meketon, M. S. 1986. A comparison of several variance estimators. Tech. rep., School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA.Google ScholarGoogle Scholar
  23. }}Goldsman, D., Meketon, M. S., and Schruben, L. W. 1990. Properties of standardized time series weighted area variance estimators. Manage. Sci. 36, 602--612. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. }}Goldsman, D. and Schruben, L. W. 1990. New confidence interval estimators using standardized time series. Manage. Sci. 36, 393--397. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. }}Grenander, U. and Rosenblatt, M. 1957. Statistical Analysis of Stationary Time Series. Wiley, New York.Google ScholarGoogle Scholar
  26. }}Hald, A. 1952. Statistical Theory with Engineering Applications. Wiley, New York.Google ScholarGoogle Scholar
  27. }}Heidelberger, P. and Welch, P. D. 1981. A spectral method for confidence interval generation and run length control in simulations. Commun. ACM 24, 233--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. }}Lada, E. K. and Wilson, J. R. 2006. A wavelet-based spectral procedure for steady-state simulation analysis. European J. Oper. Res. 174, 3, 1769--1801.Google ScholarGoogle ScholarCross RefCross Ref
  29. }}Law, A. M. 2007. Simulation Modeling and Analysis 4th Ed., McGraw-Hill, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. }}L'Ecuyer, P. 1999. Good parameters and implementations for combined multiple recursive random number generators. Oper. Res. 47, 159--164. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. }}Meketon, M. S. and Schmeiser, B. W. 1984. Overlapping batch means: Something for nothing? In Proceedings of the Winter Simulation Conference. S. Sheppard et al. Eds., Institute of Electrical and Electronics Engineers, Piscataway, NJ, 227--230. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. }}Satterthwaite, F. E. 1941. Synthesis of variance. Psychometrika 6, 309--316.Google ScholarGoogle ScholarCross RefCross Ref
  33. }}Schmeiser, B W. 1982. Batch size effects in the analysis of simulation output. Oper. Res. 30, 556--568.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. }}Schruben, L. W. 1983. Confidence interval estimation using standardized time series. Oper. Res. 31, 1090--1108.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. }}Shorack, G. R. and Wellner, J. A. 1986. Empirical Processes with Applications to Statistics. Wiley, New York.Google ScholarGoogle Scholar
  36. }}Song, W.-M. and Schmeiser, B. W. 1995. Optimal mean-squared-error batch sizes. Manage. Sci. 41, 110--123. Google ScholarGoogle ScholarCross RefCross Ref
  37. }}Steiger, N. M., Lada, E. K., Wilson, J. R., Joines, J. A., Alexopoulos, C., and Goldsman, D. 2005. ASAP3: A batch means procedure for steady-state simulation analysis. ACM Trans. Model. Comput. Simul. 15, 1, 39--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. }}Steiger, N. M. and Wilson, J. R. 2001. Convergence properties of the batch-means method for simulation output analysis. INFORMS J. Comput.13, 4, 277--293. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. }}Welch, P. D. 1987. On the relationship between batch means, overlapping batch means, and spectral estimation. In Proceedings of the Winter Simulation Conference. A. Thesen et al. Eds., Institute of Electrical and Electronics Engineers, Piscataway, NJ, 320--323. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Performance of folded variance estimators for simulation

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Modeling and Computer Simulation
        ACM Transactions on Modeling and Computer Simulation  Volume 20, Issue 3
        September 2010
        192 pages
        ISSN:1049-3301
        EISSN:1558-1195
        DOI:10.1145/1842713
        Issue’s Table of Contents

        Copyright © 2010 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 7 October 2010
        • Accepted: 1 March 2009
        • Revised: 1 February 2009
        • Received: 1 May 2008
        Published in tomacs Volume 20, Issue 3

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader