Skip to main content

Optimizing Continuous Problems Using Estimation of Distribution Algorithm Based on Histogram Model

  • Conference paper
Simulated Evolution and Learning (SEAL 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4247))

Included in the following conference series:

Abstract

In the field of estimation of distribution algorithms, choosing probabilistic model for optimizing continuous problems is still a challenging task. This paper proposes an improved estimation of distribution algorithm (HEDA) based on histogram probabilistic model. By utilizing both historical and current population information, a novel learning method – accumulation strategy – is introduced to update the histogram model. In the sampling phase, mutation strategy is used to increase the diversity of population. In solving some well-known hard continuous problems, experimental results support that HEDA behaves much better than the conventional histogram-based implementation both in convergence speed and scalability. Compared with UMDA-Gaussian, SGA and CMA-ES, the proposed algorithms exhibit excellent performance in the test functions.

The work is funded by National Key Project for Basic Research of China (G2002cb312205).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Larrañaga, P., Lozano, J.A.: Estimation of Distribution Algorithms: A new Tool for Evolutionary Computation. Kluwer Academic Publishers, Dordrecht (2002)

    MATH  Google Scholar 

  2. Pelikan, M.: Hierarchical Bayesian optimization algorithm: Toward a new generation of evolutionary algorithms. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  3. Očenášek, J.: Parallel Estimation of Distribution Algorithms. Ph.D. Dissertation in Brno University of Technology (2002)

    Google Scholar 

  4. Pelikan, M., David, E.G., Tsutsui, S.: Combining the Strengths of the Bayesian Optimization Algorithm and Adaptive Evolution Strategies. IlliGAL Report No. 2001023 (2001)

    Google Scholar 

  5. Tsutsui, S., Pelikan, M., Goldberg, D.E.: Evolutionary Algorithm Using Marginal Histogram Models in Continuous Domain. IlliGAL Report No. 2001019, UIUC (2001)

    Google Scholar 

  6. Larrañaga, P., Etxeberria, R., Lozano, J.A., Peña, J.M.: Optimization by Learning and Simulation of Bayesian and Gaussian Networks. Technical Report EHU-KZAA-IK-4/99, University of the Basque Country (1999)

    Google Scholar 

  7. Larrañaga, P., Etxeberria, R., Lozano, J.A., Peňa, J.M.: Optimization in Continuous Domains by Learning and Simulation of Gaussian networks. In: Proceedings of the Genetic and Evolutionary Computation Conference. Las Vegas, Nevada (2000)

    Google Scholar 

  8. Sebag, M., Ducolombier, A.: Extending population-based incremental learning to continuous search spaces. Parallel Problem Solving from Nature – PPSN V, pp. 418–427. Springer, Heidelberg (1998)

    Google Scholar 

  9. Larrañaga, P., Lozano, J.A., Bengoetxea, E.: Estimation of Distribution Algorithms based on multivariate normal and Gaussian networks. Technical report KZZA-IK-1-01, University of the Basque Country (2001)

    Google Scholar 

  10. Bosman, P., Thierens, D.: Expanding from Discrete to Continuous Estimation of Distribution Algorithms: IDEA. Parallel Problem Solving From Nature- PPSN VI, pp. 767–776 (2000)

    Google Scholar 

  11. Hansen, N., Mueller, S.D., Koumoutsakos, P.: Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES). Evolutionary Computation 11, 1–18 (2003)

    Article  Google Scholar 

  12. Ahn, C.W.: Real-coded Bayesian Optimization Algorithm. Advances in Evolutionary Algorithms: Theory, Design and Practice 18, 85–124 (2006)

    Google Scholar 

  13. URL: http://lautaro.bionik.tu-berlin.de/user/niko/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ding, N., Zhou, S., Sun, Z. (2006). Optimizing Continuous Problems Using Estimation of Distribution Algorithm Based on Histogram Model. In: Wang, TD., et al. Simulated Evolution and Learning. SEAL 2006. Lecture Notes in Computer Science, vol 4247. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11903697_69

Download citation

  • DOI: https://doi.org/10.1007/11903697_69

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-47331-2

  • Online ISBN: 978-3-540-47332-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics