Skip to main content
Log in

Metamodeling using extended radial basis functions: a comparative approach

  • Original Article
  • Published:
Engineering with Computers Aims and scope Submit manuscript

Abstract

The process of constructing computationally benign approximations of expensive computer simulation codes, or metamodeling, is a critical component of several large-scale multidisciplinary design optimization (MDO) approaches. Such applications typically involve complex models, such as finite elements, computational fluid dynamics, or chemical processes. The decision regarding the most appropriate metamodeling approach usually depends on the type of application. However, several newly proposed kernel-based metamodeling approaches can provide consistently accurate performance for a wide variety of applications. The authors recently proposed one such novel and effective metamodeling approach—the extended radial basis function (E-RBF) approach—and reported highly promising results. To further understand the advantages and limitations of this new approach, we compare its performance to that of the typical RBF approach, and another closely related method—kriging. Several test functions with varying problem dimensions and degrees of nonlinearity are used to compare the accuracies of the metamodels using these metamodeling approaches. We consider several performance criteria such as metamodel accuracy, effect of sampling technique, effect of sample size, effect of problem dimension, and computational complexity. The results suggest that the E-RBF approach is a potentially powerful metamodeling approach for MDO-based applications, as well as other classes of computationally intensive applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Abbreviations

f(x):

Computationally expensive analysis

\(\tilde{f}(x)\) :

Computationally benign metamodel of f(x)

F :

Vector of n p exact function values

m :

Number of design variables (dimension of the problem)

n :

Degree of the monomial term in nonradial basis functions

n p :

Number of data points evaluated

n t :

Number of test points for evaluating accuracy

r :

Radial distance from a given data point

x :

Design variable vector

x i :

i-th Design configuration, or data point

x j :

j-th Element of the vector x

γ:

Smoothness parameter in nonradial basis functions

θ:

Correlation parameters for kriging

ξi :

Coordinate vector of point x relative to data point x i

ξ i j :

j-th Element of vector ξi

E-RBF:

Extended radial basis function

HSS:

Hammersley sequence sampling

LHS:

Latin hypercube sampling

MDO:

Multidisciplinary design optimization

NRMSE:

Normalized root mean squared error

NMAX:

Normalized maximum absolute error

RBF:

Radial basis function

RND:

Random sampling

RSM:

Response surface methodology

References

  1. Kleijnen JPC (1987) Statistical tools for simulation practitioners. Marcel Dekker, New York

    MATH  Google Scholar 

  2. Barton RR (1992) Metamodels for simulation input–output relations. In: Proceedings of the 24th conference on winter simulation, Arlington, pp 289–299

  3. Barton RR (1998) Simulation metamodels. In: Proceedings of the 30th conference on winter simulation, Washington D.C., pp 167–176

  4. Simpson TW, Peplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17:129–150

    Article  MATH  Google Scholar 

  5. Giunta AA, Balabanov V, Haim D, Grossman B, Mason WH, Watson LT, Haftka RT (1997) Multidisciplinary optimisation of a supersonic transport using design of experiments theory and response surface modeling. Aeronaut J 101(1008):347–356

    Google Scholar 

  6. Koch PN, Simpson TW, Allen JK, Mistree F (1999) Statistical approximations for multidisciplinary design optimization: the problem of size. J Aircraft 36(1):275–286

    Google Scholar 

  7. Hosder S, Watson LT, Grossman B, Mason WH, Kim H, Haftka RT, Cox SE (2001) Polynomial response surface approximations for the multidisciplinary design optimization of high speed civil transport. Optim Eng 2(4):431–452

    Article  MATH  Google Scholar 

  8. Simpson TW, Mauery TM, Korte JK, Mistree F (2001) Kriging models for global approximation in simulation-based multidisciplinary design optimization. AIAA J 39(12):2233–2241

    Google Scholar 

  9. Jin R, Du X, Chen W (2003) The use of metamodeling techniques for optimization under uncertainty. Struct Multidiscip Optim 25(2):99–116

    Article  Google Scholar 

  10. Myers RH, Montgomery DC (2002) Response surface methodology, 2nd edn. Wiley, New York

    MATH  Google Scholar 

  11. Box GE, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New York

    MATH  Google Scholar 

  12. Hussain MF, Barton RR, Joshi SB (2002) Metamodeling: radial basis functions, versus polynomials. Eur J Operat Res 138(1):142–154

    Article  MATH  Google Scholar 

  13. Powell MJD (1987) Radial basis functions for multivariable interpolation: a review, chapter 3. In: Mason JC, Cox MG (eds) Algorithms for approximation. Oxford University Press, New York, pp 141–167

  14. Krishnamurthy T (2003) Response surface approximation with augmented and compactly supported radial basis functions. In: 44th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics, and materials conference AIAA-2003-1748, Norfolk

  15. Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice-Hall, Englewood Cliffs

    MATH  Google Scholar 

  16. Papadrakakis M, Lagaros ND, Tsompanakis Y (1998) Structural optimization using evolution strategies and neural networks. Comput Methods Appl Mech Eng 156(1–4):309–333

    Article  MATH  Google Scholar 

  17. Martin JD, Simpson TW (2004) On the use of kriging models to approximate deterministic computer models. In: Proceedings of DETC’04, ASME 2004 international design engineering technical conferences and computers and information in engineering conference DETC2004/DAC-57300, September–October 2004, Salt Lake City

  18. Sacks J, Schiller SB, Welch WJ (1989) Design for computer experiments. Technometrics 31(1):41–47

    Article  MathSciNet  Google Scholar 

  19. Sacks J, Welch W, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–423

    Article  MATH  MathSciNet  Google Scholar 

  20. Girosi F (1998) An equivalence between sparse approximation and support vector machines. Neural Comput 10(6):1455–1480

    Article  PubMed  Google Scholar 

  21. Simpson TW, Clarke SM, Griebsch JH (2005) Analysis of support vector machines for approximation of complex engineering analysis. ASME J Mech Des (in press)

  22. Mullur AA, Messac A (2005) Extended radial basis functions: more flexible and effective metamodeling. AIAA J 43(6):1306–1315

    Article  Google Scholar 

  23. Giunta AA, Watson LT (1998) A comparison of approximation modeling techniques: polynomial versus interpolating models. In: Collection of technical papers—7th AIAA/USAF/NASA/ISSMO symposium on multidisciplinary analysis and optimization, number AIAA-1998-4758, pp 392–404

  24. Jin R, Chen W, Simpson T (2001) Comparative studies of metamodelling techniques under multiple modelling criteria. Struct Multidiscip Optim 23(1):1–13

    Article  Google Scholar 

  25. Cherrie JB, Beatson RK, Newsam GN (2002) Fast evaluation of radial basis functions: methods for generalized multiquadrics in \({\mathbb{R}}^{n*}.\) Siam J Sci Comput 23(5):1549–1571

    Article  MATH  MathSciNet  Google Scholar 

  26. Sasena MJ (2002) Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. PhD Thesis, University of Michigan

  27. Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE—a matlab kriging toolbox, version 2.0. Informatics and mathematical modelling report IMM-REP-2002-12, Technical University of Denmark

  28. Simpson T, Dennis L, Chen W (2002) Sampling strategies for computer experiments: design and analysis. Int J Reliabil Appl 23(2):209–240

    Google Scholar 

  29. Kalagnanam JR, Diwekar UM (1997) An efficient sampling technique for off-line quality control. Technometrics 39(3):308–319

    Article  MATH  Google Scholar 

  30. Messac A, Mullur AA (2004) Pseudo response surface (PRS) methodology: collapsing computational requirements. In: 10th AIAA/ISSMO multidisciplinary analysis and optimization conference AIAA-2004-4376, August–September 2004, Albany

  31. Trefethen LN, Bau D (1997) Numerical linear algebra. Society for Industrial and Applied Mathematics, Philapdelphia

    MATH  Google Scholar 

  32. Lophaven SN, Nielsen HB, Sondergaard J (2002) Aspects of the matlab toolbox DACE. Informatics and mathematical modelling report IMM-REP-2002-13, Technical University of Denmark

  33. Meckesheimer M, Booker AJ, Barton RR, Simpson TW (2002) Computationally inexpensive metamodel assessment strategies. AIAA J 40(10):2053–2060

    Article  Google Scholar 

Download references

Acknowledgements

Support from the National Science Foundation Award number DMI-0354733 is gratefully acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Achille Messac.

Appendices

Appendix A: List of engineering examples

1.1 Weld design problem (WELD) [21]

A simple welded beam structure is subjected to a combined bending and shear load. The design variables are weld height h, weld length l, bar thickness t, and width b. Force acting on the beam, F=6,000 lbs; shear strength, τd=13,600 psi; bending strength, σmax=30,000 psi; Young’s modulus of the beam material, E=30×106 psi; shear modulus, G=12×106 psi. The variable bounds are: 0.125 in ≤ h ≤ 2.0 in; 2.0 in ≤ l ≤ 10.0 in; 2.0 in ≤ t ≤ 10.0 in; 0.125 in ≤ b ≤ 2.0 in. The function approximated is the shear stress in the weld, given by

$$f_{1} = \left(\tau_{1}^{2} + 2 \tau_{1} \tau_{2} \cos \theta + \tau_{2}^{2}\right)^{1/2},$$
(31)

where

$$\begin{aligned} \cos \theta =& l/2R; \quad \tau_{1} = \frac{F}{\sqrt{2} h l}; \quad \tau_{2} = \frac{MR}{J};\\ R =& \left[\frac{l^{2}}{4} + \left(\frac{t + h}{2}\right)^{2}\right]^{1/2};\\ M =& F \left(L + \frac{l}{2}\right);\\ J =& \sqrt{2} h l \left[\frac{l^{2}}{12}+ \left(\frac{t+h}{2}\right)^{2}\right].\\ \end{aligned}$$

1.2 Two bar truss under compressive loading (TRUSS) [21]

The second response is the safety constraint function of a two-bar truss under compressive loading. The constants are: the load, 2P=66,000 lbs, the span 2B=60 in, thickness of the members T=0.1 in, material density, ρ=0.3 lbs/in3, and the Young’s modulus, E=30×106 psi. Also, the bounds on the design variables are given as 0.5 in ≤ D ≤ 5 in, and 5 in ≤ H ≤ 50 in.

The response to be approximated is the buckling constraint expression given by

$$f_{2} = \left(s/\sigma_{\rm c}\right) - 1,$$
(32)

where σc is the critical buckling stress, and s is the compressive stress induced in the bar, as given below.

$$\sigma_{\rm c} = \frac{\pi^{2} E(D^{2} + T^{2})}{8(B^{2}+H^{2})}; \quad s = \frac{P \sqrt{B^2 + H^2}}{\pi TDH}.$$
(33)

Appendix B: List of mathematical functions

Table 5 contains the list of functions used in the comparative study, along with their sources.

Table 5 Mathematical functions

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mullur, A.A., Messac, A. Metamodeling using extended radial basis functions: a comparative approach. Engineering with Computers 21, 203–217 (2006). https://doi.org/10.1007/s00366-005-0005-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00366-005-0005-7

Keywords

Navigation