Abstract
The process of constructing computationally benign approximations of expensive computer simulation codes, or metamodeling, is a critical component of several large-scale multidisciplinary design optimization (MDO) approaches. Such applications typically involve complex models, such as finite elements, computational fluid dynamics, or chemical processes. The decision regarding the most appropriate metamodeling approach usually depends on the type of application. However, several newly proposed kernel-based metamodeling approaches can provide consistently accurate performance for a wide variety of applications. The authors recently proposed one such novel and effective metamodeling approach—the extended radial basis function (E-RBF) approach—and reported highly promising results. To further understand the advantages and limitations of this new approach, we compare its performance to that of the typical RBF approach, and another closely related method—kriging. Several test functions with varying problem dimensions and degrees of nonlinearity are used to compare the accuracies of the metamodels using these metamodeling approaches. We consider several performance criteria such as metamodel accuracy, effect of sampling technique, effect of sample size, effect of problem dimension, and computational complexity. The results suggest that the E-RBF approach is a potentially powerful metamodeling approach for MDO-based applications, as well as other classes of computationally intensive applications.







Similar content being viewed by others
Abbreviations
- f(x):
-
Computationally expensive analysis
- \(\tilde{f}(x)\) :
-
Computationally benign metamodel of f(x)
- F :
-
Vector of n p exact function values
- m :
-
Number of design variables (dimension of the problem)
- n :
-
Degree of the monomial term in nonradial basis functions
- n p :
-
Number of data points evaluated
- n t :
-
Number of test points for evaluating accuracy
- r :
-
Radial distance from a given data point
- x :
-
Design variable vector
- x i :
-
i-th Design configuration, or data point
- x j :
-
j-th Element of the vector x
- γ:
-
Smoothness parameter in nonradial basis functions
- θ:
-
Correlation parameters for kriging
- ξi :
-
Coordinate vector of point x relative to data point x i
- ξ i j :
-
j-th Element of vector ξi
- E-RBF:
-
Extended radial basis function
- HSS:
-
Hammersley sequence sampling
- LHS:
-
Latin hypercube sampling
- MDO:
-
Multidisciplinary design optimization
- NRMSE:
-
Normalized root mean squared error
- NMAX:
-
Normalized maximum absolute error
- RBF:
-
Radial basis function
- RND:
-
Random sampling
- RSM:
-
Response surface methodology
References
Kleijnen JPC (1987) Statistical tools for simulation practitioners. Marcel Dekker, New York
Barton RR (1992) Metamodels for simulation input–output relations. In: Proceedings of the 24th conference on winter simulation, Arlington, pp 289–299
Barton RR (1998) Simulation metamodels. In: Proceedings of the 30th conference on winter simulation, Washington D.C., pp 167–176
Simpson TW, Peplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17:129–150
Giunta AA, Balabanov V, Haim D, Grossman B, Mason WH, Watson LT, Haftka RT (1997) Multidisciplinary optimisation of a supersonic transport using design of experiments theory and response surface modeling. Aeronaut J 101(1008):347–356
Koch PN, Simpson TW, Allen JK, Mistree F (1999) Statistical approximations for multidisciplinary design optimization: the problem of size. J Aircraft 36(1):275–286
Hosder S, Watson LT, Grossman B, Mason WH, Kim H, Haftka RT, Cox SE (2001) Polynomial response surface approximations for the multidisciplinary design optimization of high speed civil transport. Optim Eng 2(4):431–452
Simpson TW, Mauery TM, Korte JK, Mistree F (2001) Kriging models for global approximation in simulation-based multidisciplinary design optimization. AIAA J 39(12):2233–2241
Jin R, Du X, Chen W (2003) The use of metamodeling techniques for optimization under uncertainty. Struct Multidiscip Optim 25(2):99–116
Myers RH, Montgomery DC (2002) Response surface methodology, 2nd edn. Wiley, New York
Box GE, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New York
Hussain MF, Barton RR, Joshi SB (2002) Metamodeling: radial basis functions, versus polynomials. Eur J Operat Res 138(1):142–154
Powell MJD (1987) Radial basis functions for multivariable interpolation: a review, chapter 3. In: Mason JC, Cox MG (eds) Algorithms for approximation. Oxford University Press, New York, pp 141–167
Krishnamurthy T (2003) Response surface approximation with augmented and compactly supported radial basis functions. In: 44th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics, and materials conference AIAA-2003-1748, Norfolk
Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Englewood Cliffs
Papadrakakis M, Lagaros ND, Tsompanakis Y (1998) Structural optimization using evolution strategies and neural networks. Comput Methods Appl Mech Eng 156(1–4):309–333
Martin JD, Simpson TW (2004) On the use of kriging models to approximate deterministic computer models. In: Proceedings of DETC’04, ASME 2004 international design engineering technical conferences and computers and information in engineering conference DETC2004/DAC-57300, September–October 2004, Salt Lake City
Sacks J, Schiller SB, Welch WJ (1989) Design for computer experiments. Technometrics 31(1):41–47
Sacks J, Welch W, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423
Girosi F (1998) An equivalence between sparse approximation and support vector machines. Neural Comput 10(6):1455–1480
Simpson TW, Clarke SM, Griebsch JH (2005) Analysis of support vector machines for approximation of complex engineering analysis. ASME J Mech Des (in press)
Mullur AA, Messac A (2005) Extended radial basis functions: more flexible and effective metamodeling. AIAA J 43(6):1306–1315
Giunta AA, Watson LT (1998) A comparison of approximation modeling techniques: polynomial versus interpolating models. In: Collection of technical papers—7th AIAA/USAF/NASA/ISSMO symposium on multidisciplinary analysis and optimization, number AIAA-1998-4758, pp 392–404
Jin R, Chen W, Simpson T (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13
Cherrie JB, Beatson RK, Newsam GN (2002) Fast evaluation of radial basis functions: methods for generalized multiquadrics in \({\mathbb{R}}^{n*}.\) Siam J Sci Comput 23(5):1549–1571
Sasena MJ (2002) Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. PhD Thesis, University of Michigan
Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE—a matlab kriging toolbox, version 2.0. Informatics and mathematical modelling report IMM-REP-2002-12, Technical University of Denmark
Simpson T, Dennis L, Chen W (2002) Sampling strategies for computer experiments: design and analysis. Int J Reliabil Appl 23(2):209–240
Kalagnanam JR, Diwekar UM (1997) An efficient sampling technique for off-line quality control. Technometrics 39(3):308–319
Messac A, Mullur AA (2004) Pseudo response surface (PRS) methodology: collapsing computational requirements. In: 10th AIAA/ISSMO multidisciplinary analysis and optimization conference AIAA-2004-4376, August–September 2004, Albany
Trefethen LN, Bau D (1997) Numerical linear algebra. Society for Industrial and Applied Mathematics, Philapdelphia
Lophaven SN, Nielsen HB, Sondergaard J (2002) Aspects of the matlab toolbox DACE. Informatics and mathematical modelling report IMM-REP-2002-13, Technical University of Denmark
Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060
Acknowledgements
Support from the National Science Foundation Award number DMI-0354733 is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix A: List of engineering examples
1.1 Weld design problem (WELD) [21]
A simple welded beam structure is subjected to a combined bending and shear load. The design variables are weld height h, weld length l, bar thickness t, and width b. Force acting on the beam, F=6,000 lbs; shear strength, τd=13,600 psi; bending strength, σmax=30,000 psi; Young’s modulus of the beam material, E=30×106 psi; shear modulus, G=12×106 psi. The variable bounds are: 0.125 in ≤ h ≤ 2.0 in; 2.0 in ≤ l ≤ 10.0 in; 2.0 in ≤ t ≤ 10.0 in; 0.125 in ≤ b ≤ 2.0 in. The function approximated is the shear stress in the weld, given by
where
1.2 Two bar truss under compressive loading (TRUSS) [21]
The second response is the safety constraint function of a two-bar truss under compressive loading. The constants are: the load, 2P=66,000 lbs, the span 2B=60 in, thickness of the members T=0.1 in, material density, ρ=0.3 lbs/in3, and the Young’s modulus, E=30×106 psi. Also, the bounds on the design variables are given as 0.5 in ≤ D ≤ 5 in, and 5 in ≤ H ≤ 50 in.
The response to be approximated is the buckling constraint expression given by
where σc is the critical buckling stress, and s is the compressive stress induced in the bar, as given below.
Appendix B: List of mathematical functions
Table 5 contains the list of functions used in the comparative study, along with their sources.
Rights and permissions
About this article
Cite this article
Mullur, A.A., Messac, A. Metamodeling using extended radial basis functions: a comparative approach. Engineering with Computers 21, 203–217 (2006). https://doi.org/10.1007/s00366-005-0005-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-005-0005-7