Skip to main content

Laplace Method and Applications to Optimization Problems

  • Reference work entry
Encyclopedia of Optimization

Background

Laplace's method is based on an ingenious trick used by Laplace in one his papers [19]. The technique is most frequently used to perform asymptotic evaluations to integrals that depend on a scalar parameter t, as t tends to infinity. Its use can be theoretically justified for integrals in the following form:

$$ I(t)=\int_\mathcal A \exp\left\{\frac{-f(x)}{T(t)}\right\} \text{d}\Lambda(x)\:. $$

Where \( f:\mathbb R^n\rightarrow \mathbb R \), \( T:\mathbb R\rightarrow \mathbb R \), are assumed to be smooth, and \( T(t)\rightarrow 0 \) as t tends to ∞. \( \mathcal A \) is some compact set, and Λ is some measure on \( \mathcal B \) (the \( \sigma- \)field generated by \( \mathcal A \)). We know that since \( \mathcal A \) is compact, the continuous function f will have a global minimum in \( \mathcal A \). For simplicity, assume that the global minimum x * is unique, and that it occurs in the interior \( \mathcal A \). Under these conditions, and as ttends to infinity, only...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 2,500.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 2,499.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aluffi-Pentini F, Parisi V, Zirilli F (1985) Global optimization and stochastic differential equations. J Optim Theory Appl 47(1):1–16

    Article  MathSciNet  MATH  Google Scholar 

  2. Bender CM, Orszag SA (1999) Advanced mathematical methods for scientists and engineers I. Asymptotic methods and perturbation theory, Reprint of the 1978 original. Springer, New York

    MATH  Google Scholar 

  3. Chiang TS, Hwang CR, Sheu SJ (1987) Diffusion for global optimization in \( {\bf R}^n \). SIAM J Control Optim 25(3):737–753

    Article  MathSciNet  MATH  Google Scholar 

  4. de Bruijn NG (1981) Asymptotic methods in analysis, 3rd edn. Dover Publications Inc., New York

    MATH  Google Scholar 

  5. Dem\( ^\prime \)yanov VF, Malozëmov VN (1990) Introduction to minimax. Translated from the Russian by Louvish D, Reprint of the 1974 edn. Dover Publications Inc., New York

    Google Scholar 

  6. Gelfand SB, Mitter SK (1991) Recursive stochastic algorithms for global optimization in \( {\bf R}\sp d \). SIAM J Control Optim 29(5):999–1018

    Article  MathSciNet  MATH  Google Scholar 

  7. Geman S, Hwang CR (1986) Diffusions for global optimization. SIAM J Control Optim 24(5):1031–1043

    Article  MathSciNet  MATH  Google Scholar 

  8. Gidas B (1986) The Langevin equation as a global minimization algorithm. In: Disordered systems and biological organization (Les Houches 1985). NATO Adv Sci Inst Ser F Comput Systems Sci, vol 20. Springer, Berlin, pp 321–326

    Google Scholar 

  9. Gidas B (1987) Simulations and global optimization. In: Random media (Minneapolis, MN, 1985), IMA Vol Math Appl, vol 7. Springer, New York, pp 129–145

    Google Scholar 

  10. Gidas B (1985) Metropolis-type Monte Carlo simulation algorithms and simulated annealing. In: Topics in contemporary probability and its applications. Probab Stochastics Ser. CRC, Boca Raton, FL, pp 159–232

    Google Scholar 

  11. Hwang CR (1980) Laplace's method revisited: weak convergence of probability measures. Ann Probab 8(6):1177–1182

    Article  MathSciNet  MATH  Google Scholar 

  12. Kushner HJ (1987) Asymptotic global behavior for stochastic approximation and diffusions with slowly decreasing noise effects: global minimization via Monte Carlo. SIAM J Appl Math 47(1):169–185

    Article  MathSciNet  MATH  Google Scholar 

  13. Li-Zhi L, Liqun Q, Hon WT (2005) A gradient-based continuous method for large-scale optimization problems. J Glob Optim 31(2):271

    Article  MATH  Google Scholar 

  14. Martin OC, Monasson R, Zecchina R (2001) Statistical mechanics methods and phase transitions in optimization problems. Theoret Comput Sci 265(1–2):3–67

    Article  MathSciNet  MATH  Google Scholar 

  15. Papadimitriou CH (1994) Computational complexity. Addison-Wesley, Reading, MA

    MATH  Google Scholar 

  16. Parpas P, Rustem B, Pistikopoulos E (2006) Linearly constrained global optimization and stochastic differential equations. J Glob Optim 36(2):191–217

    Article  MathSciNet  MATH  Google Scholar 

  17. Polak E, Royset JO, Womersley RS (2003) Algorithms with adaptive smoothing for finite minimax problems. J Optim Theory Appl 119(3):459–484

    Article  MathSciNet  MATH  Google Scholar 

  18. Rustem B, Howe M (2002) Algorithms for worst-case design and applications to risk management. Princeton University Press, Princeton, NJ

    MATH  Google Scholar 

  19. Stigler SM (1986) Laplace's 1774 memoir on inverse probability. Statist Sci 1(3):359–378

    Article  MathSciNet  Google Scholar 

  20. Talagrand M (2003) Spin glasses: a challenge for mathematicians. Ergebnisse der Mathematik und ihrer Grenzgebiete. 3. Folge (Results in Mathematics and Related Areas. 3rd Series). A Series of Modern. Surveys in Mathematics, vol 46. Springer, Berlin

    Google Scholar 

  21. Xu S (2001) Smoothing method for minimax problems. Comput Optim Appl 20(3):267–279

    Article  MathSciNet  MATH  Google Scholar 

  22. Zirilli F (1982) The use of ordinary differential equations in the solution of nonlinear systems of equations. In: Nonlinear optimization (Cambridge 1981). NATO Conf Ser II: Systems Sci. Academic Press, London, pp 39–46

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag

About this entry

Cite this entry

Parpas, P., Rustem, B. (2008). Laplace Method and Applications to Optimization Problems . In: Floudas, C., Pardalos, P. (eds) Encyclopedia of Optimization. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-74759-0_322

Download citation

Publish with us

Policies and ethics