skip to main content
10.1145/2001858.2002071acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
tutorial

Are evolutionary algorithm competitions characterizing landscapes appropriately

Published:12 July 2011Publication History

ABSTRACT

Currently, researchers in the field of Evolutionary Algorithms (EAs) are very interested in competitions where new algorithm implementations are evaluated and compared. Usually, EA users perform their algorithm selection by following the results published in these competitions, which are typically focused on average performance measures over benchmark sets. These sets are very complete but the functions within them are usually classified into binary classes according to their separability and modality. Here we show that this binary classification could produce misleading conclusions about the performance of the EAs and, consequently, it is necessary to consider finer grained features so that better conclusions can be obtained about what scenarios are adequate or inappropriate for an EA. In particular, new elements are presented to study separability and modality in more detail than is usually done in the literature. The need for such detail in order to understand why things happen the way they do is made evident over three different EAs.

References

  1. D. H. Ackley. A connectionist machine for genetic hillclimbing. Kluwer, Boston, 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. E. Alba, B. Dorronsoro, M. Giacobini, and M. Tomassini. Decentralized cellular evolutionary algorithms. Handbook of Bioinspired Algorithms and Applications, 7:103--120, 2005.Google ScholarGoogle Scholar
  3. A. Auger and N. Hansen. A Restart CMA Evolution Strategy with Increasing Population Size. In Proceedings of the 2005 IEEE Congress on Evolutionary Computation, 2005., volume 2, pages 1769--1776, Apr 2005.Google ScholarGoogle ScholarCross RefCross Ref
  4. P. Caamaño, A. Prieto, J. A. Becerra, F. Bellas, and R. J. Duro. Real-valued multimodal fitness landscape characterization for evolution. In Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I, ICONIP'10, pages 567--574, Berlin, Heidelberg, 2010. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. P. Caamano, F. Bellas, J. A. Becerra, and R. J. Duro. Application domain study of evolutionary algorithms in optimization problems. In Proceedings of the 10th annual conference on Genetic and evolutionary computation, GECCO '08, pages 495--502, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Garnier and L. Kallel. How to detect all maxima of a function? In Proceedings of the Second EVONET Summer School on Theoretical Aspects of Evolutionary Computing, pages 343--370, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. D. E. Goldberg. Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1989. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. F. Herrera, M. Lozano, and J. L. Verdegay. Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis. Artificial Intelligence Review, 12:265--319, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. J. Liang, T. P. Runarsson, E. Mezura-Montes, M. Clerc, P. N. Suganthan, C. A. C. Coello, and K. Deb. Problem Definitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization. Technical report, Nanyang Technological University, 2006.Google ScholarGoogle Scholar
  10. M. Locatelli. A note on the Griewank test function. Journal of Global Optimization, 25(2):169--174, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. D. Mosk-Aoyama and D. Shah. Computing separable functions via gossip. In PODC '06: Proceedings of the twenty-fifth annual ACM symposium on Principles of distributed computing, pages 113--122, New York, NY, USA, 2006. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Nimtawat and P. Nanakorn. Automated layout design of beam-slab floors using a genetic algorithm. Computers and Structures, 87(21-22):1308 -- 1330, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. G. Rawlins. Foundations of Genetic Algorithms. Morgan Kaufmann, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. J. Rönkkönen, S. Kukkonen, and K. V. Price. Real-Parameter Optimization with Differential Evolution. In The 2005 IEEE International Congress on Evolutionary Computation (CEC'05), page 12, Apr 2005.Google ScholarGoogle Scholar
  15. M. M. Stickberger. Genetics. Collier-McMillan Ltd, 1968.Google ScholarGoogle Scholar
  16. R. Storn and K. V. Price. Differential Evolution -- A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces. Journal of Global Optimization, 11:341--359, Nov 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. P. N. Suganthan, N. Hansen, J. J. Liang, K. Deb, Y. P. Chen, A. Auger, and S. Tiwari. Problem definitions and evaluation criteria for the CEC 2005 Special Session on Real Parameter Optimization. Technical report, Nanyang Technological University, 2005.Google ScholarGoogle Scholar
  18. H. Tang, S. Xue, and C. Fan. Differential evolution strategy for structural system identification. Computers and Structures, 86(21-22):2004 -- 2012, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. K. Tang, X. Li, P. N. Suganthan, Z. Yang, and T. Weise. Benchmark Functions for the CEC 2010 Special Session and Competition on Large-Scale Global Optimization. Technical report, University of Science and Technology of China (USTC), School of Computer Science and Technology, Nature Inspired Computation and Applications Laboratory (NICAL): Héféi, \=Anhu\=í, China, Jan. 8, 2010.Google ScholarGoogle Scholar
  20. M.-H. Tseng and H.-C. Liao. The genetic algorithm for breast tumor diagnosis--The case of DNA viruses. Applied Soft Computing, 9(2):703--710, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. L. D. Whitley, K. E. Mathias, S. B. Rana, and J. Dzubera. Building Better Test Functions. In Proceedings of the 6th International Conference on Genetic Algorithms, pages 239--247, San Francisco, CA, USA, 1995. Morgan Kaufmann Publishers Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Are evolutionary algorithm competitions characterizing landscapes appropriately

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      GECCO '11: Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
      July 2011
      1548 pages
      ISBN:9781450306904
      DOI:10.1145/2001858

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 12 July 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • tutorial

      Acceptance Rates

      Overall Acceptance Rate1,669of4,410submissions,38%

      Upcoming Conference

      GECCO '24
      Genetic and Evolutionary Computation Conference
      July 14 - 18, 2024
      Melbourne , VIC , Australia

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader