Skip to main content
SpringerLink
Log in

Cooperative co-evolution with sensitivity analysis-based budget assignment strategy for large-scale global optimization

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Cooperative co-evolution has proven to be a successful approach for solving large-scale global optimization (LSGO) problems. These algorithms decompose the LSGO problems into several smaller subcomponents using a decomposition method, and each subcomponent of the variables is optimized by a certain optimizer. They use a simple technique, the round-robin method, to equally assign the computational time. Since the standard cooperative co-evolution algorithms allocate the computational budget equally, the performance of these algorithms deteriorates for solving LSGO problems with subcomponents by various effects on the objective function. For this reason, it could be very useful to detect the subcomponents’ effects on the objective function in LSGO problems. Sensitivity analysis methods can be employed to identify the most significant variables of a model. In this paper, we propose a cooperative co-evolution algorithm with a sensitivity analysis-based budget assignment method (SACC), which can allocate the computational time among all subcomponents based on their different effects on the objective function, accordingly. SACC is benchmarked on imbalanced LSGO problems. Simulation results confirm that SACC obtains a promising performance on the majority of the imbalanced LSGO benchmark functions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Campolongo F, Cariboni J, Saltelli A (2007) An effective screening design for sensitivity analysis of large models. Environ Model Softw 22(10):1509–1518

    Article  Google Scholar 

  2. Chen S, Montgomery J, Bolufé-Röhler A (2015) Measuring the curse of dimensionality and its effects on particle swarm optimization and differential evolution. Appl Intell 42(3):514–526

    Article  Google Scholar 

  3. Chen W, Tang K (2013) Impact of problem decomposition on cooperative coevolution. In: IEEE congress on evolutionary computation (CEC), 2013. IEEE, pp 733–740

  4. Chen W, Weise T, Yang Z, Tang K (2010) Large-scale global optimization using cooperative coevolution with variable interaction learning. In: Parallel problem solving from nature, PPSN XI. Springer, pp 300–309

  5. Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7(Jan):1–30

    MathSciNet  MATH  Google Scholar 

  6. Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Article  Google Scholar 

  7. Ekström PA (2005) Eikos: a simulation toolbox for sensitivity analysis in matlab. Uppsala University, Uppsala

    Google Scholar 

  8. García S, Fernández A, Luengo J, Herrera F The software for computing the advanced multiple comparison, http://sci2s.ugr.es/sicidm

  9. García S, Fernández A, Luengo J, Herrera F (2010) Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf Sci 180(10):2044–2064

    Article  Google Scholar 

  10. Hasanzadeh M, Meybodi M R, Ebadzadeh MM (2013) Adaptive cooperative particle swarm optimizer. Appl Intell 39(2):397–420

    Article  Google Scholar 

  11. Li X, Tang K, Omidvar MN, Yang Z, Qin K (2013) Benchmark functions for the cec’2013 special session and competition on large-scale global optimization. Gene 7:33

    Article  Google Scholar 

  12. Liu J, Tang K (2013) Scaling up covariance matrix adaptation evolution strategy using cooperative coevolution. In: Intelligent data engineering and automated learning–IDEAL 2013. Springer, pp 350–357

  13. Liu Y, Yao X, Zhao Q, Higuchi T (2001) Scaling up fast evolutionary programming with cooperative coevolution. In: Proceedings of the 2001 congress on evolutionary computation, 2001. IEEE, vol 2, pp 1101–1108

  14. Mahdavi S, Shiri ME, Rahnamayan S (2014) Cooperative co-evolution with a new decomposition method for large-scale optimization. In: 2014 IEEE congress on evolutionary computation (CEC). IEEE, pp 1285–1292

  15. Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: a survey. Inf Sci 295:407–428

    Article  MathSciNet  Google Scholar 

  16. Morris M D (1991) Factorial sampling plans for preliminary computational experiments. Technometrics 33(2):161–174

    Article  Google Scholar 

  17. Omidvar MN, Li X (2011) A comparative study of CMA-ES on large scale global optimisation. In: AI 2010: advances in artificial intelligence. Springer, pp 303–312

  18. Omidvar MN, Li X, Mei Y, Yao X (2014) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evol Comput 18(3):378–393

    Article  Google Scholar 

  19. Omidvar MN, Li X, Tang K (2015) Designing benchmark problems for large-scale continuous optimization. Inf Sci 316:419–436. Elsevier

    Article  Google Scholar 

  20. Omidvar MN, Li X, Yang Z, Yao X (2010) Cooperative co-evolution for large scale optimization through more frequent random grouping. In: IEEE Congress on evolutionary computation (CEC), 2010. IEEE, pp 1–8

  21. Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: IEEE congress on evolutionary computation (CEC), 2010. IEEE, pp 1–8

  22. Omidvar MN, Li X, Yao X (2011) Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms. In: Proceedings of the 13th annual conference on genetic and evolutionary computation. ACM, pp 1115–1122

  23. Potter MA (1997) The design and analysis of a computational model of cooperative coevolution. PhD thesis, Citeseer

  24. Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: Parallel problem solving from nature-PPSN III. Springer, pp 249–257

  25. Rabitz H, Aliş ÖF (1999) General foundations of high-dimensional model representations. J Math Chem 25(2–3):197–233

    Article  MathSciNet  MATH  Google Scholar 

  26. Ray T, Yao X (2009) A cooperative coevolutionary algorithm with correlation based adaptive variable partitioning. In: IEEE Congress on evolutionary computation, 2009. CEC’09. IEEE, pp 983–989

  27. Saltelli A, Chan K, Scott EM, et al (2000) Sensitivity analysis, vol 134. Wiley, New York

    Google Scholar 

  28. Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M, Tarantola S (2008) Global sensitivity analysis: the primer. Wiley

  29. Sayed E, Essam D, Sarker R (2012) Dependency identification technique for large scale optimization problems. In: IEEE Congress on evolutionary computation (CEC), 2012. IEEE, pp 1–8

  30. Sayed E, Essam D, Sarker R (2012) Using hybrid dependency identification with a memetic algorithm for large scale optimization problems. In: Simulated evolution and learning. Springer, pp 168–177

  31. Shan S, Wang GG (2010) Metamodeling for high dimensional simulation-based design problems. J Mech Des 132(5):051009

    Article  Google Scholar 

  32. Sheskin DJ (2003) Handbook of parametric and nonparametric statistical procedures. CRC Press

  33. Shi Y-j, Teng H-f, Li Z-q (2005) Cooperative co-evolutionary differential evolution for function optimization. In: Advances in natural computation. Springer, pp 1080–1088

  34. Singh HK, Ray T (2010) Divide and conquer in coevolution: a difficult balancing act. In: Agent-based evolutionary search. Springer, pp 117–138

  35. Tang K, Li X, Suganthan PN, Yang Z, Weise T (2010) Benchmark functions for the CEC’2010 special session and competition on large-scale global optimization. Technical report, Nature Inspired Computation and Applications Laboratory (NICAL), USTC, China

  36. Tenne Y, Goh C-K (2010) Computational intelligence in expensive optimization problems, vol 2. Springer

  37. Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239

    Article  Google Scholar 

  38. Weise T, Chiong R, Tang K (2012) Evolutionary optimization: pitfalls and booby traps. J Comput Sci Technol 27(5):907–936

    Article  MathSciNet  MATH  Google Scholar 

  39. Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985– 2999

    Article  MathSciNet  MATH  Google Scholar 

  40. Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: IEEE Congress on evolutionary computation, 2008. CEC 2008. (IEEE world congress on computational intelligence). IEEE, pp 1663–1670

  41. Yang Z, Tang K, Yao X (2008) Self-adaptive differential evolution with neighborhood search. In: IEEE Congress on evolutionary computation, 2008. CEC 2008. (IEEE world congress on computational intelligence). IEEE, pp 1110–1116

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Computer, and Software Engineering, University of Ontario Institute of Technology (UOIT), 2000 Simcoe Street North, Oshawa, ON, L1H 7K4, Canada

    Sedigheh Mahdavi & Shahryar Rahnamayan

  2. Department of Mathematics and Computer Science, Amirkabir University of Technology, Tehran, Iran

    Mohammad Ebrahim Shiri

Authors
  1. Sedigheh Mahdavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shahryar Rahnamayan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammad Ebrahim Shiri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shahryar Rahnamayan.

Ethics declarations

Conflict of interests

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Appendix

Appendix

Tables 20, 21, and 22 present the normal coefficient corresponding to non-separable subcomponents in the modified CEC-2010 test functions with normal weights.

Table 20 The normal coefficients for single-group m-nonseparable functions (f 4– f 8)
Full size table
Table 21 The normal coefficients for \(\frac {n}{2m}\)-group m-nonseparable functions (f 9– f 13)
Full size table
Table 22 The normal coefficients for \(\frac {n}{m}\)-group m-nonseparable functions (f 14– f 18).
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mahdavi, S., Rahnamayan, S. & Shiri, M.E. Cooperative co-evolution with sensitivity analysis-based budget assignment strategy for large-scale global optimization. Appl Intell 47, 888–913 (2017). https://doi.org/10.1007/s10489-017-0926-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-017-0926-z

Keywords

Search

Navigation