Skip to main content
SpringerLink
Log in

Self-adaptive randomized and rank-based differential evolution for multimodal problems

  • Published:
Journal of Global Optimization Aims and scope Submit manuscript

Abstract

Differential Evolution (DE) is a widely used successful evolutionary algorithm (EA) based on a population of individuals, which is especially well suited to solve problems that have non-linear, multimodal cost functions. However, for a given population, the set of possible new populations is finite and a true subset of the cost function domain. Furthermore, the update formula of DE does not use any information about the fitness of the population. This paper presents a novel extension of DE called Randomized and Rank-based Differential Evolution (R2DE) and its self-adaptive version SAR2DE to improve robustness and global convergence speed on multimodal problems by introducing two multiplicative terms in the DE update formula. The first term is based on a random variate of a Cauchy distribution, which leads to a randomization. The second term is based on ranking of individuals, so that R2DE exploits additional information provided by the population fitness. In extensive experiments conducted with a wide range of complexity settings, we show that the proposed heuristics lead to an overall improvement in robustness and speed of convergence compared to several global optimization techniques, including DE, Opposition based Differential Evolution (ODE), DE with Random Scale Factor (DERSF) and the self-adaptive Cauchy distribution based DE (NSDE).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ali M.M., Törn A.: Population set-based global optimization algorithms: some modifications and numerical studies. Comput. Oper. Res. 31(10), 1703–1725 (2004)

    Article  Google Scholar 

  2. Ali M.M., Khompatraporn C., Zabinsky Z.B.: A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems. J. Global Optim. 31(4), 635–672 (2005)

    Article  Google Scholar 

  3. Bersini, H., Dorigo, M., Langerman, S., Seront, G., Gambardella, L.M.: Results of the first international contest on evolutionary optimisation (1st iceo). In: International Conference on Evolutionary Computation, pp. 611–615 (1996)

  4. Breiman L., Cutler A.: A deterministic algorithm for global optimization. Math. Program. 58(2), 179–199 (1993)

    Article  Google Scholar 

  5. Brest J., Greiner S., Boskovic B., Mernik M., Zumer V.: Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems. Evol. Comput. IEEE Transact. 10(6), 646–657 (2006)

    Article  Google Scholar 

  6. Das, S., Konar, A., Chakraborty, U.k.: Improved differential evolution algorithms for handling noisy optimization problems, vol 2, pp. 1691–1698 (2005a)

  7. Das, S., Konar, A., Chakraborty, U.K.: Two improved differential evolution schemes for faster global search. In: GECCO ’05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 991–998, New York, NY, USA, ACM (2005b)

  8. Das S., Abraham A., Chakraborty U.K., Konar A.: Differential evolution using a neighborhood-based mutation operator. IEEE Transact. Evol. Comput. 13(3), 526–553 (2009)

    Article  Google Scholar 

  9. Fan H.-Y., Lampinen J.: A trigonometric mutation operation to differential evolution. J. Global Optim. 27(1), 105–129 (2003)

    Article  Google Scholar 

  10. Haflidason, S., Neville, R.: On the significance of the permutation problem in neuroevolution. In: GECCO ’09: Proceedings of the 11th Annual conference on Genetic and Evolutionary Computation, pp. 787–794, New York, NY, USA, ACM (2009)

  11. Hansen, N., Ros, R., Mauny, N., Schoenauer, M., Auger, A.: Pso facing non-separable and ill-conditioned problems. Research Report 6447, INRIA, February 2008. http://hal.inria.fr/inria-00250078/en

  12. Kaelo P., Ali M.M.: Probabilistic adaptation of point generation schemes in some global optimization algorithms. J. Optim. Methods Softw. 21(3), 343–357 (2006)

    Article  Google Scholar 

  13. Koumousis V.K., Katsaras C.P.: A saw-tooth genetic algorithm combining the effects of variable population size and reinitialization to enhance performance. IEEE Trans. Evol. Comput. 10(1), 19–28 (2006)

    Article  Google Scholar 

  14. Levy A.V., Montalvo A.: The tunneling algorithm for the global minimization of functions. SIAM J. Sci. Stat. Comput. 6(1), 15–29 (1985)

    Article  Google Scholar 

  15. Liu J., Lampinen J.: A fuzzy adaptive differential evolution algorithm. Soft Comput. 9(6), 448–462 (2005)

    Article  Google Scholar 

  16. Locatelli M.: A note on the griewank test function. J. Global Optim. 25(2), 169–174 (2003)

    Article  Google Scholar 

  17. Michalewicz, Z.: Genetic algorithms + data structures = evolution programs (2nd, extended ed.). Springer-Verlag New York, Inc., New York, NY, USA (1994)

  18. Moré J.J., Garbow B.S., Hillstrom K.E.: Testing unconstrained optimization software. ACM Trans. Math. Softw. 7(1), 17–41 (1981)

    Article  Google Scholar 

  19. Noman, N., Iba, H.: Enhancing differential evolution performance with local search for high dimensional function optimization. In: GECCO ’05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, pp. 967–974, New York, NY, USA, ACM (2005)

  20. Omran, M., Salman, A., Engelbrecht, A.: Self-adaptive differential evolution. In Hao, Y., Liu, J., Wang, Y.-P., Cheung, Y.-M., Yin, H., Jiao, L., Ma, J., Jiao, Y.-C. (ed.) Computational Intelligence and Security, vol. 3801 of Lecture Notes in Computer Science, pp. 192–199. Springer Berlin /Heidelberg (2005)

  21. Onwubolu, G.C., Babu, B.: New Optimization Techniques in Engineering. Springer, ISBN-13: 978-3540201670 (2004)

  22. Price, K.V.: Differential evolution: a fast and simple numerical optimizer. In: Biennial Conference of the North American Fuzzy Information Processing Society, NAFIPS, pp. 524–527. IEEE Press, New York. ISBN:0-7803-3225-3, June (1996)

  23. Price, W.L.: A controlled random search procedure for global optimisation (1977)

  24. Price K.V., Storn R.M., Lampinen J.A.: Differential Evolution A Practical Approach to Global Optimization. Natural Computing Series. Springer-Verlag, Berlin, Germany (2005)

    Google Scholar 

  25. Qin A., Huang V., Suganthan P.: Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans. Evol. Comput. 13(2), 398–417 (2009)

    Article  Google Scholar 

  26. Rahnamayan S., Tizhoosh H.R., Salama M.M.A.: Opposition-based differential evolution. IEEE Trans. Evol. Comput. 12(1), 64–79 (2008)

    Article  Google Scholar 

  27. Ronkkonen, J., Lampinen, J.: On Using Normally Distributed Mutation Step Length for the Differential Evolution Algorithm, pp. 11–18. Brno, Czech Republic, June (2003)

  28. Salomon R.: Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. a survey of some theoretical and practical aspects of genetic algorithms. Biosystems 39(3), 263–278 (1996)

    Article  Google Scholar 

  29. Shang Y.-W., Qiu Y.-H.: A note on the extended rosenbrock function. Evol. Comput. 14, 119–126 (2006)

    Article  Google Scholar 

  30. Shi, Y.-J., Teng, H.-F., Li, Z.-Q.: Cooperative co-evolutionary differential evolution for function optimization. In: Proceedings 1st International Conference Advances in Natural Computer, pp. 1080–1088. Changsha, China, Aug. (2005)

  31. Soliman, O., Bui, L.: A Self-adaptive Strategy for Controlling Parameters in Differential Evolution, pp. 2837–2842. June (2008)

  32. Soliman, O., Bui, L., Abbass, H.: The Effect of a Stochastic Step Length on the Performance of the Differential Evolution Algorithm. pp. 2850–2857, Sep. (2007)

  33. Storn, R., Price, K.: Differential evolution—a simple and efficient adaptive scheme for global optimization over continuous spaces. Technical Report TR-95-012, ICSI, March (1995)

  34. Storn, R., Price, K.: Minimizing the real functions of the icec’96 contest by differential evolution. In: IEEE International Conference on Evolutionary Computation, pp. 842–844. Nagoya, May (1996)

  35. Storn R., Price K.: Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)

    Article  Google Scholar 

  36. Sun J., Zhang Q., Tsang E.P.: De/eda: a new evolutionary algorithm for global optimization. Inform. Sci. 169(3–4), 249–262 (2005)

    Article  Google Scholar 

  37. Tasoulis, D.K., Pavlidis, N.G., Plagianakos, V.P., Vrahatis, M.N.: Parallel differential evolution

  38. Teo J.: Exploring dynamic self-adaptive populations in differential evolution. Soft Comput. 10(8), 673–686 (2006)

    Article  Google Scholar 

  39. Torn A., Zilinskas A.: Global Optimization. Springer-Verlag New York, Inc., New York, NY, USA (1989)

    Google Scholar 

  40. Urfalioglu, O.: Robust estimation of camera rotation, translation and focal length at high outlier rates. In: Proceedings International Canadian Conference on Computer and Robot Vision, pp. 464–471. May (2004)

  41. Urfalioglu, O., Mikulastik, P., Stegmann, I.: Scale invariant robust registration of 3d-point data and a triangle mesh by global optimization. In: Proceedings of Advanced Concepts for Intelligent Vision Systems, (2006)

  42. Vesterstrom, J., Thomsen, R.: A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems. In: Evolutionary Computation, 2004. CEC2004. Congress on, vol. 2, pp. 1980–1987. June (2004)

  43. Weissenfeld, A., Urfalioglu, O., Liu, K., Ostermann, J.: Robust rigid head motion estimation based on differential evolution. In: Proceedings of International Conference on Multimedia and Expo (2006)

  44. Yang, Z., Tang, K., Yao, X.: Self-adaptive Differential Evolution with Neighborhood Sarch, pp. 1110–1116, June (2008)

  45. Yang Z., Yao X., He J.: Making a difference to differential evolution. In: Siarry, P., Michalewicz, Z. (eds) Advances in Metaheuristics for Hard Optimization, Natural Computing Series, pp. 397–414. Springer, Berlin Heidelberg (2008)

    Chapter  Google Scholar 

  46. Zabinsky, Z.B., Graesser, D.L., Tuttle, M.E., Kim, G.-I.: Global Optimization of Composite Laminates using Improving Hit and Run, pp. 343–368 (1992)

  47. Zaharie, D.: Critical Values for the Control Parameters of Differential Evolution Algorithmss, pp. 62–67, Brno, Czech Republic (2002)

  48. Zhenyu, G., Bo, C., Min, Y., Binggang, C.: Self-adaptive chaos differential evolution. In: Jiao, L., Wang, L., Gao, X., Liu, J., Wu, F., (eds.) Advances in Natural Computation, vol. 4221 of Lecture Notes in Computer Science, pp. 972–975. Springer Berlin/Heidelberg (2006)

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Electronics Engineering, Bilkent University, 06800, Ankara, Turkey

    Onay Urfalioglu & Orhan Arikan

Authors
  1. Onay Urfalioglu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Orhan Arikan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Onay Urfalioglu.

Additional information

This work was funded by the Turkish Scientific and Technical Research Council (TUBITAK).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Urfalioglu, O., Arikan, O. Self-adaptive randomized and rank-based differential evolution for multimodal problems. J Glob Optim 51, 607–640 (2011). https://doi.org/10.1007/s10898-011-9646-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10898-011-9646-9

Keywords

Search

Navigation