Huashuai Qu
Abstract
We introduce an approach for enhancing stochastic kriging in the setting where additional direct gradient information is available (e.g., provided by techniques such as perturbation analysis or the likelihood ratio method). The new approach, called gradient extrapolated stochastic kriging (GESK), incorporates direct gradient estimates by extrapolating additional responses. For two simplified settings, we show that GESK reduces mean squared error (MSE) compared to stochastic kriging under certain conditions on step sizes. Since extrapolation step sizes are crucial to the performance of the GESK model, we propose two different approaches to determine the step sizes: maximizing penalized likelihood and minimizing integrated mean squared error. Numerical experiments are conducted to illustrate the performance of the GESK model and to compare it with alternative approaches.
- J. J. Alonso and H. S. Chung. 2002. Using gradients to construct cokriging approximation models for high-dimensional design optimization problems. In 40th AIAA Aerospace Sciences Meeting and Exhibit, AIAA. 2002--0317.Google Scholar
- B. E. Ankenman, B. L. Nelson, and J. Staum. 2010. Stochastic kriging for simulation metamodeling. Operations research 58, 2 (March 2010), 371--382. Google ScholarDigital Library
- R. R. Barton. 2009. Simulation optimization using metamodels. In Proceedings of the 2009 Winter Simulation Conference, M. D. Rossetti, R. R. Hill, B. Johansson, A. Dunkin, and R. G. Ingalls (Eds.). Institute of Electrical and Electronics Engineers, Inc, Piscataway, New Jersey, 230--238. Google ScholarDigital Library
- R. R. Barton and M. Meckesheimer. 2006. Metamodel-based simulation optimization. In Handbooks in Operations Research and Management Science: Simulation, S. G. Henderson and B. L. Nelson (Eds.). Elsevier, 535--574.Google Scholar
- X. Chen, B. E. Ankenman, and B. L. Nelson. 2012. The effects of common random numbers on stochastic kriging metamodels. ACM Transactions on Modeling and Computer Simulation 22, 2 (March 2012), Article 7, 20 pages. Google ScholarDigital Library
- X. Chen, B. E. Ankenman, and B. L. Nelson. 2013. Enhancing stochastic kriging metamodels with gradient estimators. Operations Research 61, 2 (2013), 512--528.Google ScholarCross Ref
- T. Chu, J. Zhu, and H. Wang. 2011. Penalized maximum likelihood estimation and variable selection in geostatistics. Annals of Statistics 39, 5 (2011), 2607--2625.Google ScholarCross Ref
- M. C. Fu. 2008. What you should know about simulation and derivatives. Naval Research Logistics 55, 8 (2008), 723--736.Google ScholarCross Ref
- M. C. Fu and H. Qu. 2014. Regression models augumented with direct stochastic gradient estimators. INFORMS Journal on Computing 26, 3, 484--499. Google ScholarDigital Library
- P. Glasserman. 1991. Gradient Estimation via Perturbation Analysis. Kluwer Academic, Boston, MA.Google Scholar
- Y. C. Ho, L. Shi, L. Dai, and W. Gong. 1992. Optimizing discrete event dynamic systems via the gradient surface method. Discrete Event Dynamic Systems: Theory and Applications 2 (Jan. 1992), 99--120.Google Scholar
- J. P. C. Kleijnen and W. C. M. van Beers. 2005. Robustness of kriging when interpolating in random simulation with heterogeneous variances: Some experiments. European Journal of Operational Research 165, 3 (2005), 826--834.Google ScholarCross Ref
- P. L’Ecuyer. 1990. A unified view of the IPA, SF, and LR gradient estimation techniques. Management Science 36 (1990), 1364--1383. Google ScholarDigital Library
- R. Li and A. Sudjianto. 2005. Analysis of computer experiments using penalized likelihood in Gaussian kriging models. Technometrics 47, 2 (May 2005), 111--121.Google ScholarCross Ref
- W. Liu. 2003. Development of Gradient-enhanced Kriging Approximations for Multidisciplinary Design Optimization. Ph.D. Dissertation. University of Notre Dame.Google Scholar
- H. Qu and M. C. Fu. 2012. On direct gradient enhanced simulation metamodels. In Proceedings of the 2012 Winter Simulation Conference. Institute of Electrical and Electronics Engineers, Article 43, 12 pages. Google ScholarDigital Library
- R. Y. Rubinstein and A. Shapiro. 1993. Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method. John Wiley & Sons.Google Scholar
- T. J. Santner, B. Williams, and W. Notz. 2003. The Design and Analysis of Computer Experiments. Springer-Verlag.Google Scholar
- J. Staum. 2009. Better simulation metamodeling: The why, what, and how of stochastic kriging. In Proceedings of the 2009 Winter Simulation Conference, M. D. Rossetti, R. R. Hill, B. Johansson, A. Dunkin, and R. G. Ingalls (Eds.). Institute of Electrical and Electronics Engineers, Piscataway, NJ, 119--133. Google ScholarDigital Library
- W. C. M. van Beers and J. P. C. Kleijnen. 2008. Customized sequential designs for random simulation experiments: Kriging metamodeling and bootstrapping. European Journal of Operational Research 186, 3 (2008), 1099--1113.Google ScholarCross Ref
- W. Xie, B. L. Nelson, and J. Staum. 2010. The influence of correlation functions on stochastic kriging metamodels. In Proceedings of the 2010 Winter Simulation Conference. Institute of Electrical and Electronics Engineers, Piscataway, NJ, 1067--1078. Google ScholarDigital Library
- F. Zhang and Q. Zhang. 2006. Eigenvalue inequalities for matrix product. IEEE Transactions on Automatic Control 51, 9 (Sept. 2006), 1506--1509.Google ScholarCross Ref
Index Terms
- Gradient Extrapolated Stochastic Kriging
Recommendations
Some Monotonicity Results for Stochastic Kriging Metamodels in Sequential Settings
Stochastic kriging SK and stochastic kriging with gradient estimators SKG are useful methods for effectively approximating the response surface of a simulation model. In this paper, we show that in a fully sequential setting when all model parameters ...
Sample and Computationally Efficient Stochastic Kriging in High Dimensions
High-dimensional Simulation Metamodeling
Stochastic kriging has been widely employed for simulation metamodeling to predict the response surface of complex simulation models. However, its use is limited to cases where the design space is low-dimensional ...
Stochastic kriging has been widely employed for simulation metamodeling to predict the response surface of complex simulation models. However, its use is limited to cases where the design space is low-dimensional because in general the sample complexity (...
Generalized polynomial chaos-informed efficient stochastic Kriging
AbstractStochastic kriging (SK) offers an explicit way to characterize heterogeneous noise variance in stochastic computer simulations and has gained considerable traction recently as a surrogate model. Nevertheless, SK relies on tedious Monte ...
Highlights- Generalized polynomial chaos (gPC) is built as surrogate for the simulator.
- gPC ...
Comments