Skip to main content
Log in

A Radial Basis Function Method for Global Optimization

  • Published:
Journal of Global Optimization Aims and scope Submit manuscript

Abstract

We introduce a method that aims to find the global minimum of a continuous nonconvex function on a compact subset of \(\mathbb{R}^d \). It is assumed that function evaluations are expensive and that no additional information is available. Radial basis function interpolation is used to define a utility function. The maximizer of this function is the next point where the objective function is evaluated. We show that, for most types of radial basis functions that are considered in this paper, convergence can be achieved without further assumptions on the objective function. Besides, it turns out that our method is closely related to a statistical global optimization method, the P-algorithm. A general framework for both methods is presented. Finally, a few numerical examples show that on the set of Dixon-Szegö test functions our method yields favourable results in comparison to other global optimization methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Alotto, P., Caiti, A., Molinari, G. and Repetto, M. (1996), A Multiquadrics-based Algorithm for the Acceleration of Simulated Annealing Optimization Procedures, IEEE Transactions on Magnetics 32(3): 1198-1201.

    Google Scholar 

  2. Dixon, L.C.W. and Szegö, G. (1978), The Global Optimization Problem: An Introduction, in: Dixon, L. and Szegö, G. (eds), Towards Global Optimization 2, North-Holland, Amsterdam, pp. 1-15.

    Google Scholar 

  3. Gutmann, H.-M. On the semi-norm of radial basis function interpolants, Report DAMTP2000/NA04, University of Cambridge.

  4. Horst, R. and Pardalos, P.M. (1994), Handbook of Global Optimization, Kluwer, Dordrecht.

    Google Scholar 

  5. Huyer, W. and Neumaier, A. (1999), Global optimization by multilevel coordinate search, Journal of Global Optimization 14(4): 331-355.

    Google Scholar 

  6. Ishikawa, T. and Matsunami, M. (1997), An Optimization Method Based on Radial Basis Functions, IEEE Transactions on Magnetics 33(2): 1868-1871.

    Google Scholar 

  7. Ishikawa, T., Tsukui, Y. and Matsunami, M. (1999), A Combined Method for the Global Optimization Using Radial Basis Function and Deterministic Approach, IEEE Transactions on Magnetics 35(3): 1730-1733.

    Google Scholar 

  8. Jones, D.R. (1996), Global optimization with response surfaces, presented at the Fifth SIAM Conference on Optimization, Victoria, Canada.

  9. Jones, D.R., Perttunen, C. and Stuckman, B.E. (1993), Lipschitz Optimization Without the Lipschitz Constant, Journal of Optimization Theory and Applications 78(1): 157-181.

    Google Scholar 

  10. Jones, D.R., Schonlau, M. and Welch,W.J. (1998), Efficient Global Optimization of Expensive Black-Box Functions, Journal of Global Optimization 13(4): 455-492.

    Google Scholar 

  11. Kushner, H.J. (1962), A Versatile Model of a Function of Unknown and Time Varying Form, Journal of Mathematical Analysis and Applications 5: 150-167.

    Google Scholar 

  12. Kushner, H.J. (1964), A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise, Journal of Basic Engineering 86: 97-106.

    Google Scholar 

  13. Levy, A.V. and Montalvo, A. (1985), The Tunneling Algorithm for the Global Minimization of Functions, SIAM Journal on Scientific and Statistical Computing 6(1): 15-29.

    Google Scholar 

  14. Powell, M.J.D. (1981), Approximation Theory and Methods, Cambridge University Press.

  15. Powell, M.J.D. (1992), The Theory of Radial Basis Function Approximation in 1990, in: Light, W. (ed.), Advances in Numerical Analysis, Volume 2: Wavelets, Subdivision Algorithms and Radial Basis Functions, Oxford University Press, pp. 105-210.

  16. Powell, M.J.D. (1999), Recent research at Cambridge on radial basis functions, in: M. Müller, M. Buhmann, D. Mache and M. Felten (eds), New Developments in Approximation Theory, International Series of Numerical Mathematics, Vol. 132, Birkhauser Verlag, Basel, pp. 215-232.

    Google Scholar 

  17. Schaback, R. (1993), Comparison of radial basis function interpolants, in: K. Jetter and F. Utreras (eds), Multivariate Approximations: From CAGD to Wavelets, World Scientific, Singapore, pp. 293-305.

    Google Scholar 

  18. Storn, R. and Price, K. (1997), Differential Evolution-A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces, Journal of Global Optimization 11(4): 341-359.

    Google Scholar 

  19. Törn, A. and Žilinskas, A. (1987), Global Optimization, Springer, Berlin.

    Google Scholar 

  20. Whitney, H. (1934), Analytic extension of differentiable functions defined in closed sets, Transactions of the American Mathematical Society 36: 63-89.

    Google Scholar 

  21. Žilinskas, A. (1982), Axiomatic Approach to Statistical Models and their Use in Multimodal Optimization Theory, Mathematical Programming 22(1): 104-116.

    Google Scholar 

  22. Žilinskas, A. (1985), Axiomatic Characterization of a Global Optimization Algorithm and Investigation of its Search Strategy, Operations Research Letters 4(1): 35-39.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gutmann, HM. A Radial Basis Function Method for Global Optimization. Journal of Global Optimization 19, 201–227 (2001). https://doi.org/10.1023/A:1011255519438

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1011255519438

Navigation