Skip to main content

Real-Coded Extended Compact Genetic Algorithm Based on Mixtures of Models

  • Chapter
Linkage in Evolutionary Computation

Part of the book series: Studies in Computational Intelligence ((SCI,volume 157))

Summary

This paper presents a real-coded estimation distribution algorithm (EDA) inspired to the extended compact genetic algorithm (ECGA) and the real-coded Bayesian Optimization Algorithm (rBOA). Like ECGA, the proposed algorithm partitions the problem variables into a set of clusters that are manipulated as independent variables and estimates the population distribution using marginal product models (MPMs); like rBOA, it employs finite mixtures of models and it does not use any sort of discretization. Accordingly, the proposed real-coded EDA can be either viewed as the extension of the ECGA to real-valued domains by means of finite mixture models or as a simplification of the real-coded BOA to the marginal product models (MPMs). The results reported here show that the number of evaluations required by the proposed algorithm scales sub-quadratically with the problem size in additively separable problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ahn, C.W.: Theory, Design, and Application of Efficient Genetic and Evolutionary Algorithms. PhD thesis, NWC Lab, Department of Information and Communications Gwangju Institute of Science and Technology (GIST) (Febraury 2005)

    Google Scholar 

  2. Ahn, C.W.: Advances in Evolutionary Algorithms: Theory, Design and Practice. Studies in Computational Intelligence. Springer, Heidelberg (2006)

    MATH  Google Scholar 

  3. Ahn, C.W., Ramakrishna, R.: On the Scalability of Real-coded Bayesian Optimization Algorithms. IEEE Transactions on Evolutionary Computation (in press, 2008)

    Google Scholar 

  4. Ahn, C.W., Ramakrishna, R.S., Goldberg, D.E.: Real-Coded Bayesian Optimization Algorithm: Bringing the Strength of BOA into the Continuous World. In: Deb, K., et al. (eds.) GECCO 2004. LNCS, vol. 3102, pp. 840–851. Springer, Heidelberg (2004)

    Google Scholar 

  5. Bosman, P.A.: Design and application of iterated density-estimation evolutionary algorithms. PhD thesis, Utrecht University, TB Utrecht, The Netherlands (2003)

    Google Scholar 

  6. Chen, C.-H., Chen, Y.-P.: Real-coded ECGA for economic dispatch. In: Lipson, H. (ed.) GECCO, pp. 1920–1927. ACM, New York (2007)

    Chapter  Google Scholar 

  7. Chen, C.-H., Liu, W.-N., Chen, Y.-P.: Adaptive discretization for probabilistic model building genetic algorithms. In: Cattolico, M. (ed.) GECCO, pp. 1103–1110. ACM, New York (2006)

    Chapter  Google Scholar 

  8. de la Ossa, L., Sastry, K., Lobo, F.G.: χ-ary extended compact genetic algorithm in C++. IlliGAL Report No. 2006013, University of Illinois at Urbana-Champaign, Urbana, IL (March 2006)

    Google Scholar 

  9. Fossati, L., Lanzi, P.L., Sastry, K., Goldberg, D.E., Gomez, O.: A simple real-coded extended compact genetic algorithm. In: Proceedings of the 2007 Congress on Evolutionary Computation (CEC2007), pp. 342–348. IEEE, Singapore (2007)

    Chapter  Google Scholar 

  10. Grahl, J., Bosman, P.A., Minner, S.: Convergence phases, variance trajectories, and runtime analysis of continuous edas on the sphere function. In: Thierens, D., et al. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference GECCO 2007, vol. I, pp. 516–522. ACM Press, New York (2007)

    Chapter  Google Scholar 

  11. Harik, G.: Linkage learning via probabilistic modeling in the ECGA. IlliGAL Report No. 99010, University of Illinois at Urbana-Champaign, Urbana, IL (January 1999)

    Google Scholar 

  12. Harik, G.R.: Finding multimodal solutions using restricted tournament selection. In: Proceedings of the Sixth International Conference on Genetic Algorithms, pp. 24–31 (1995); (Also IlliGAL Report No. 94002)

    Google Scholar 

  13. Harik, G.R., Lobo, F.G., Sastry, K.: Linkage learning via probabilistic modeling in the ECGA. In: Pelikan, M., Sastry, K., Cantú-Paz, E. (eds.) Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications, ch. 3, pp. 39–61. Springer, Berlin (2006)

    Chapter  Google Scholar 

  14. Hartigan, J.: Clustering algorithms. John Wiley & Sons, New York (1975)

    MATH  Google Scholar 

  15. Higuchi, T., Tsutsui, S., Yamamura, M.: Theoretical analysis of simplex crossover for real-coded genetic algorithms. In: PPSN VI: Proceedings of the 6th International Conference on Parallel Problem Solving from Nature, pp. 365–374. Springer, London (2000)

    Chapter  Google Scholar 

  16. Inza, I., Larrañaga, P., Sierra, B.: Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation. In: Feature subset selection by estimation of distribution algorithms, pp. 265–290. Kluwer Academic Publishers, Dordrecht (2002)

    Google Scholar 

  17. Larrañaga, P., Lozano, J.A. (eds.): Estimation of distribution algorithms. Kluwer Academic Publishers, Boston (2002)

    MATH  Google Scholar 

  18. Li, M., Goldberg, D.E., Sastry, K., Yu, T.-L.: Real-coded ECGA for solving decomposable real-valued optimization problems. In: Srinivasan, D., Wang, L. (eds.) 2007 IEEE Congress on Evolutionary Computation, 25-28 September. IEEE Computational Intelligence Society, pp. 2194–2201. IEEE Press, Singapore (2007)

    Google Scholar 

  19. Lozano, J.A., Larrañaga, P., Inza, I., Bengoetxea, E.: Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms. Studies in Fuzziness and Soft Computing. Springer, New York (2006)

    MATH  Google Scholar 

  20. Mühlenbein, H., Paaß, G.: From recombination of genes to the estimation of distributions I. Binary parameters. Parallel Problem Solving from Nature 4, 178–187 (1996)

    Article  Google Scholar 

  21. Pelikan, M.: Hierarchical Bayesian Optimization Algorithm (Toward a New Generation of Evolutionary Algorithms). Springer, Heidelberg (2005)

    MATH  Google Scholar 

  22. Pelikan, M., Goldberg, D.E., Cantú-Paz, E.: Linkage learning, estimation distribution, and Bayesian networks. Evolutionary Computation 8(3), 314–341 (2000)

    Article  Google Scholar 

  23. Pelikan, M., Goldberg, D.E., Tsutsui, S.: Combining The Strengths Of Bayesian Optimization Algorithm And Adaptive Evolution Strategies, pp. 512–519 (2002)

    Google Scholar 

  24. Pelikan, M., Goldberg, D.E., Tsutsui, S.: Getting the best of both worlds: Discrete and continuous genetic and evolutionary algorithms in concert. Inf. Sci. 156(3-4), 147–171 (2003)

    Article  MathSciNet  Google Scholar 

  25. Pelikan, M., Sastry, K., Cantú-Paz, E.: Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications. Studies in Computational Intelligence. Springer, New York (2006)

    MATH  Google Scholar 

  26. Rissanen, J.J.: Modelling by shortest data description. Automatica 14, 465–471 (1978)

    Article  MATH  Google Scholar 

  27. Sastry, K.: Evaluation-relaxation schemes for genetic and evolutionary algorithms. Master’s thesis, University of Illinois at Urbana-Champaign, Urbana, IL (2001); (Also IlliGAL Report No 2002004)

    Google Scholar 

  28. Sastry, K., Goldberg, D.E.: Probabilistic model building and competent genetic programming. In: Riolo, R.L., Worzel, B. (eds.) Genetic Programming Theory and Practise, ch. 13, pp. 205–220. Kluwer, Dordrecht (2003)

    Google Scholar 

  29. Sebag, M., Ducoulombier, A.: Extending population-based incremental learning to continuous search spaces. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, H.-P. (eds.) PPSN 1998. LNCS, vol. 1498, pp. 418–427. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  30. Tsutsui, S., Goldberg, D.E.: Simplex crossover and linkage identification: Single-stage evolution vs. multi-stage evolution. In: Proceedings of the 2002 Congress on Evolutionary Computation, 2002 (CEC 2002), pp. 974–979 (2002)

    Google Scholar 

  31. Tsutsui, S., Pelikan, M., Goldberg, D.E.: Evolutionary algorithm using marginal histogram in continuous domain. In: Optimization by Building and Using Probabilistic Models (OBUPM 2001), San Francisco, California, USA, vol. 7, pp. 230–233 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ying-ping Chen Meng-Hiot Lim

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Lanzi, P.L., Nichetti, L., Sastry, K., Voltini, D., Goldberg, D.E. (2008). Real-Coded Extended Compact Genetic Algorithm Based on Mixtures of Models. In: Chen, Yp., Lim, MH. (eds) Linkage in Evolutionary Computation. Studies in Computational Intelligence, vol 157. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85068-7_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85068-7_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85067-0

  • Online ISBN: 978-3-540-85068-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics