Abstract
Currently, surrogate models have been used in various fields due to their ability to save high computational cost of simulation. However, in practical engineering applications, the surrogate model constructed from the initial sample set may suffer from insufficient accuracy. Therefore, building a usable surrogate model usually requires further infilling with some new samples. The adaptive sampling can be produced new samples to gradually expand the dataset, thereby improving the accuracy of the initial model. Thus, this work develops a general adaptive sampling approach based on the average uncertainty. The new samples are generated at the point with the maximum value of the average uncertainty. Then, the initial model is updated until the updated model achieves acceptable accuracy. Six test functions and an engineering problem are employed to test the performance of the proposed approach. The results show that the proposed approach has higher priority than other approaches under the same number of added samples. Furthermore, the performance of the proposed approach is tested again by setting a stopping criterion. The proposed approach can satisfy the stopping criterion with the least number of iterations, meaning that this approach can save a lot of computational cost compared to other approaches. This work provides a reference for the design and optimization of engineering problems.
Similar content being viewed by others
Data availability
The results provided in this paper are generated by MATLAB codes developed by the authors. The codes and data can be available upon request by contacting the corresponding author via email.
References
Liu J, Yi J, Zhou Q (2022) A sequential multi-fidelity surrogate model-assisted contour prediction method for engineering problems with expensive simulations. Eng Comput 38:31–49
Qian J, Yi J, Cheng Y (2020) A sequential constraints updating approach for Kriging surrogate model-assisted engineering optimization design problem. Eng Comput 36(3):993–1009
Garud SS, Karimi IA, Kraft M (2017) Design of Computer Experiments: A Review. Comput Chem Eng 106:71–95
Mackman T, Allen C, Ghoreyshi M, Badcock K (2013) Comparison of adaptive sampling methods for generation of surrogate aerodynamic models. AIAA J 51(4):797–808
Mckay MD, Beckman RJ, Conover WJ (2000) A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code. Technometrics 42(1):55–61
Gunst RF, Mason RL (2009) Fractional factorial design. Wiley Interdiscip Rev Comput Stat 1(2):234–244
Johnson ME, Moore LM, Ylvisaker D (1990) Minimax and maximin distance designs. J Stat Plan Infer 26(2):131–148
Currin C, Mitchell T, Morris M (1991) Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J Am Stat Assoc 86(416):953–963
Zhai Z, Li H, Wang X (2022) An adaptive sampling method for Kriging surrogate model with multiple outputs. Eng Comput 38:277–295
Qiao P, Wu Y, Ding J (2021) A new sequential sampling method of surrogate models for design and optimization of dynamic systems. Mech Mach Theory 158:104248
Novák L, Vořechovský M, Sadílek V (2021) Variance-based adaptive sequential sampling for Polynomial Chaos Expansion. Comput Method Appl M 386:114105
Li X, Han X, Chen Z (2022) A multi-constraint failure-pursuing sampling method for reliability-based design optimization using adaptive Kriging. Eng Comput 38:297–310
Zhang Y, Kim NH, Haftka RT (2020) General-surrogate adaptive sampling using interquartile range for design space exploration. ASME J Mech Des 142(5):051402
Kushner HJ (1964) A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise. J Fluid Eng 86(1):97–106
Forrester AIJ, Keane AJ (2009) Recent advances in surrogate-based optimization. Prog Aerosp Sci 45(1–3):50–79
Cox DD, John S (1992) SDO: A Statistical Method for Global Optimization. IEEE International Conference on Systems, Man and Cybernetics, Vol. 2, Chicago, IL, Oct. 18–21, IEEE Xplore, pp 1241–1246
Schonlau M, Welch WJ, Jones DR (1998) Global Versus Local Search in Constrained Optimization of Computer Models. New Developments and Applications in Experimental Design, N. Flournoy, W. F. Rosenberger, and W. K. Wong, eds., Institute of Mathematical Statistics, Hayward, CA, pp 11–25
Viana FAC, Haftka RT, Steffen V (2009) Multiple surrogates: how cross-validation errors can help us to obtain the best predictor. Struct Multidiscip Optim 39(4):439–457
Jin R, Chen W, Sudjitanto A (2002) On Sequential Sampling for Global Metamodeling in Engineering Design,” Det02: ASME 2002 Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 2, Montreal, Quebec, Canada, Sept. 29–Oct. 2, pp. 539–548.
Xu S, Liu H, Wang X, Jiang X (2014) A robust error-pursuing sequential sampling approach for global metamodeling based on Voronoi diagram and cross validation. ASME J Mech Des 136(7):071009
Lv LY, Shi ML, Song XG, Sun W, Zhang J (2020) A Fast-converging ensemble infilling approach balancing global exploration and local exploitation: the go-inspired hybrid infilling strategy. ASME J Mech Des 142(2):021403
Kaminsky AL, Wang Y, Pant K (2021) An efficient batch k-fold cross-validation Voronoi adaptive sampling technique for global surrogate modeling. ASME J Mech Des 143(1):011706
Mohammadi H, Challenor P, Williamson D (2022) Cross-validation–based adaptive sampling for Gaussian process models. SIAM/ASA J Uncertain 10(1):294–316
Le GL, Cannamela C (2015) Cokriging-based sequential design strategies using fast cross-validation techniques for multi-fidelity computer codes. Technometrics 57(3):418–427
Lam CQ (2008) Sequential adaptive designs in computer experiments for response surface model fit. The Ohio State University, Columbus, OH
Seung HS, Opper M, Sompolinsky H (1992) Query by committee. In: Proceedings of the fifth annual workshop on computational learning theory. Pittsburgh. ACM, 287–294
Liu HT, Ong YS, Cai JF (2018) A survey of adaptive sampling for global metamodeling in support of simulation-based complex engineering design. Struct Multidiscip Optim 57(1):393–416
Fuhg JN, Fau A, Nackenhorst U (2021) State-of-the-art and comparative review of adaptive sampling methods for kriging. Arch Comput Method E 28(4):2689–2747
Burbidge R, Rowland JJ, King RD (2007) Active learning for regression based on query by committee. In: International Conference on Intelligent Data Engineering and Automated Learning. Springer, pp 209–218
Settles B (2009) Active Learning Literature Survey. Technical Report TR-1648. University of Wisconsin, Madison, Department of Computer Sciences
Krogh A, Vedelsby J (1994) Neural network ensembles, cross validation, and active learning. In: Advances in Neural Information Processing Systems, pp 231–238
Eason J, Cremaschi S (2014) Adaptive sequential sampling for surrogate model generation with artificial neural networks. Comput Chem Eng 68:220–232
Gazut S, Martinez JM, Dreyfus G, Oussar Y (2008) Towards the optimal design of numerical experiments. IEEE Trans Neural Netw 19(5):874–882
Acar E (2010) Various approaches for constructing an ensemble of metamodels using local measures. Struct Multidiscip Optim 42(6):879–896
Hu J, Peng Y, Lin Q (2022) An ensemble weighted average conservative multi-fidelity surrogate modeling method for engineering optimization. Eng Comput 38:2221–2244
Ferreira WG, Serpa AL (2016) Ensemble of metamodels: the augmented least squares approach. Struct Multidiscip Optim 53(5):1019–1046
Arlot S, Celisse A (2010) A survey of cross-validation procedures for model selection. Stat Surv 4:40–79
Viana FAC (2010) SURROGATES Toolbox User’s Guide. Gainesville, FL
Kuhnt S, Steinberg DM (2010) Design and analysis of computer experiments. AStA Adv Stat Anal 94(4):307–309
Forrester DAIJ, Sóbester DA, Keane AJ (2008) Engineering design via surrogate modelling: a practical guide. Wiley, New York
Acknowledgements
This research is funded by the National Key Research and Development Program of China (No. 2018YFB1700704) and the National Natural Science Foundation of China (No. 52075068).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, S., Liang, P., Li, J. et al. GAS-AU: an average uncertainty-based general adaptive sampling approach. Engineering with Computers 40, 839–853 (2024). https://doi.org/10.1007/s00366-023-01824-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-023-01824-9