Skip to main content
SpringerLink
Log in

GPU-based cooperative coevolution for large-scale global optimization

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

To resolve the issue of the curse of dimensionality in continuous large-scale optimization problems, the cooperative coevolution divide-and-conquer framework was proposed by dividing the problem into several subcomponents either randomly or based on the interaction between variables, each of which can be optimized separately using metaheuristic suboptimizers. The goal of researchers is to optimize the performance of algorithms in terms of both quality of solution and computational speed, seeing that large-scale optimization can be a computationally expensive process. This work proposes a parallel implementation to the cooperative coevolution framework for solving large-scale global optimization problems using the Graphics Processing Unit (GPU) and CUDA platform. A distributed variant of the cooperative coevolution framework is outlined to expose a degree of parallelism. Features of the GPU parallel technology and CUDA platform such as shared and global memories are used to optimize the subcomponents of the problem in parallel, speeding up the optimization process while attempting to maintain comparable search quality to works in the literature. The CEC 2010 large-scale global optimization benchmark functions are used for conducting experiments and comparing results in terms of improvements in search quality and search efficiency. Results of proposed parallel implementation show that a speedup of up to x13.01 is possible on large-scale global optimization benchmarks using the GPUs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

All data generated or analyzed during this study are included in this published article.

References

  1. Bell JE, McMullen PR (2004) Ant colony optimization techniques for the vehicle routing problem. Adv Eng Inform 18(1):41–48

    Article  Google Scholar 

  2. Sama M, D’Ariano A, Corman F, Pacciarelli D (2017) Metaheuristics for efficient aircraft scheduling and re-routing at busy terminal control areas. Transp Res Part C: Emerg Technol 80:485–511

    Article  Google Scholar 

  3. Deng G-F, Lin W-T (2011) Ant colony optimization-based algorithm for airline crew scheduling problem. Expert Syst Appl 38(5):5787–5793

    Article  Google Scholar 

  4. Bellman R (1956) Dynamic programming and Lagrange multipliers. Proc Natl Acad Sci USA 42(10):767

    Article  MATH  Google Scholar 

  5. Deb, K., Myburgh, C.: Breaking the billion-variable barrier in real-world optimization using a customized evolutionary algorithm. In: Proceedings of the genetic and evolutionary computation conference 2016, pp. 653–660 (2016)

  6. Hlaing ZCSS, Khine MA (2011) Solving traveling salesman problem by using improved ant colony optimization algorithm. Int J Inform Educ Technol 1(5):404

    Google Scholar 

  7. Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22(2):387–408

    Article  Google Scholar 

  8. Molina D, Poyatos J, Del Ser J, García S, Hussain A, Herrera F (2020) Comprehensive taxonomies of nature-and bio-inspired optimization: inspiration versus algorithmic behavior, critical analysis recommendations. Cognit Comput 12(5):897–939

    Article  Google Scholar 

  9. Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B (Cybernetics) 26(1):29–41

    Article  Google Scholar 

  10. Katoch S, Chauhan SS, Kumar V (2021) A review on genetic algorithm: past, present, and future. Multimed Tools Appl 80(5):8091–8126

    Article  Google Scholar 

  11. Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359

    Article  MATH  Google Scholar 

  12. Dreo J (2007) Dreaming of Metaheuristics. http://nojhan.free.fr/metah/

  13. Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: International conference on parallel problem solving from nature, pp. 249–257. Springer

  14. Ma X, Li X, Zhang Q, Tang K, Liang Z, Xie W, Zhu Z (2018) A survey on cooperative co-evolutionary algorithms. IEEE Trans Evolut Comput 23(3):421–441

    Article  Google Scholar 

  15. Jamil M, Yang X-S (2013) A literature survey of benchmark functions for global optimisation problems. Int J Math Model Numer Optim 4(2):150–194

    MATH  Google Scholar 

  16. Tang K, Yáo X, Suganthan PN, MacNish C, Chen Y-P, Chen C-M, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspir Comput Appl Lab, USTC, China 24:1–18

    Google Scholar 

  17. Tang K, Li X, Suganthan PN, Yang Z, Weise T (2009) Benchmark functions for the CEC’2010 special session and competition on large-scale global optimization. Technical report, Nature Inspired Computation and Applications Laboratory

    Google Scholar 

  18. Li X, Tang K, Omidvar MN, Yang Z, Qin K, China H (2013) Benchmark functions for the cec 2013 special session and competition on large-scale global optimization. Gene 7(33):8

    Google Scholar 

  19. Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: IEEE Congress on evolutionary computation, pp. 1–8. IEEE

  20. Chen, W., Weise, T., Yang, Z., Tang, K.: Large-scale global optimization using cooperative coevolution with variable interaction learning. In: International conference on parallel problem solving from nature, pp. 300–309 (2010). Springer

  21. Guan S, Wang Y, Liu H (2017) A new cooperative co-evolution algorithm based on variable grouping and local search for large scale global optimization. J Netw Intell 2(4):339–350

    Google Scholar 

  22. Chen A, Ren Z, Guo W, Liang Y, Feng Z (2022) An efficient adaptive differential grouping algorithm for large-scale black-box optimization. IEEE Trans Evolut Comput

  23. Li J-Y, Zhan Z-H, Tan KC, Zhang J (2022) Dual differential grouping: A more general decomposition method for large-scale optimization. IEEE Trans Cybern

  24. Ma X, Huang Z, Li X, Wang L, Qi Y, Zhu Z (2022) Merged differential grouping for large-scale global optimization. IEEE Trans Evolut Comput

  25. Omidvar MN, Li X, Mei Y, Yao X (2013) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evolut Comput 18(3):378–393

    Article  Google Scholar 

  26. Vakhnin A, Sopov E (2021) Investigation of improved cooperative coevolution for large-scale global optimization problems. Algorithms 14(5):146

    Article  Google Scholar 

  27. El-Abd M (2022) Hybrid cooperative co-evolution for large scale optimization. In: 2014 IEEE symposium on swarm intelligence, pp. 1–6 (2014). IEEE

  28. Yang Z, Tang K, Yao X (2008) Self-adaptive differential evolution with neighborhood search. In: 2008 IEEE congress on evolutionary computation (IEEE World Congress on Computational Intelligence), pp. 1110–1116. IEEE

  29. NVIDIA Vingelmann P, Fitzek FHP CUDA, (2020) release: 10.2.89. https://developer.nvidia.com/cuda-toolkit

  30. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. HotCloud 10(10–10):95

    Google Scholar 

  31. Tan X, Lee H, Shin S-Y (2021) Cooperative coevolution differential evolution based on spark for large-scale optimization problems. J Inform Commun Converg Eng 19(3):155–160

    Google Scholar 

  32. Wang S, Gao B, Wang K, Lauw H (2011) Ccrank: Parallel learning to rank with cooperative coevolution. In: Proceedings of the AAAI conference on artificial intelligence, vol. 25

  33. Danoy G, Schleich J, Bouvry P, Dorronsoro B (2014) A parallel multi-objective cooperative coevolutionary algorithm for optimising small-world properties in vanets. CLEI Electr J 17(1):2–2

    Google Scholar 

  34. Cao B, Li W, Zhao J, Yang S, Kang X, Ling Y, Lv Z (2016) Spark-based parallel cooperative co-evolution particle swarm optimization algorithm. In: 2016 IEEE international conference on web services (ICWS), pp. 570–577. IEEE

  35. Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Information sciences 178(15):2985–2999

    Article  MATH  Google Scholar 

  36. Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: 2008 IEEE congress on evolutionary computation (IEEE World Congress on Computational Intelligence), pp. 1663–1670. IEEE

  37. De Falco I, Cioppa AD, Trunfio GA (2017) Large scale optimization of computationally expensive functions: an approach based on parallel cooperative coevolution and fitness metamodeling. In:Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1788–1795

  38. Cao B, Zhao J, Yang P, Lv Z, Liu X, Kang X, Yang S, Kang K, Anvari-Moghaddam A (2018) Distributed parallel cooperative coevolutionary multi-objective large-scale immune algorithm for deployment of wireless sensor networks. Future Gener Comput Syst 82:256–267

    Article  Google Scholar 

  39. Atashpendar A, Dorronsoro B, Danoy G, Bouvry P (2018) A scalable parallel cooperative coevolutionary PSO algorithm for multi-objective optimization. J Parall Distrib Comput 112:111–125

    Article  Google Scholar 

  40. Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evolut Comput 8(2):173–195

    Article  Google Scholar 

  41. Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evolut Comput 6(2):182–197

    Article  Google Scholar 

  42. Zitzler E, Laumanns M, Thiele L(2001) Spea2: Improving the strength pareto evolutionary algorithm. TIK-report 103

  43. Nebro AJ, Durillo JJ, Luna F, Dorronsoro B, Alba E (2009) Mocell: a cellular genetic algorithm for multiobjective optimization. Int J Intell Syst 24(7):726–746

    Article  MATH  Google Scholar 

  44. Yang P, Tang K, Yao X (2019) A parallel divide-and-conquer-based evolutionary algorithm for large-scale optimization. IEEE Access 7:163105–163118

    Article  Google Scholar 

  45. He Z, Peng H, Chen J, Deng C, Wu Z (2021) A spark-based differential evolution with grouping topology model for large-scale global optimization. Clust Comput 24:515–535

    Article  Google Scholar 

  46. Fabris F, Krohling RA (2012) A co-evolutionary differential evolution algorithm for solving min-max optimization problems implemented on GPU using C-CUDA. Expert Syst Appl 39(12):10324–10333

    Article  Google Scholar 

  47. Blecic I, Cecchini A, Trunfio GA (2014) Fast and accurate optimization of a GPU-accelerated CA urban model through cooperative coevolutionary particle swarms. Proc Comput Sci 29:1631–1643

    Article  Google Scholar 

  48. Liu Z-H, Li X-H, Wu L-H, Zhou S-W, Liu K (2015) GPU-accelerated parallel coevolutionary algorithm for parameters identification and temperature monitoring in permanent magnet synchronous machines. IEEE Trans Ind Inform 11(5):1220–1230

    Article  Google Scholar 

  49. de Oliveira FB, Enayatifar R, Sadaei HJ, Guimarães FG, Potvin J-Y (2016) A cooperative coevolutionary algorithm for the multi-depot vehicle routing problem. Expert Syst Appl 43:117–130

    Article  Google Scholar 

  50. Lü R, Guan X, Li X, Hwang I (2016) A large-scale flight multi-objective assignment approach based on multi-island parallel evolution algorithm with cooperative coevolutionary. Sci China Inform Sci 59(7):1–17

    Article  Google Scholar 

  51. Jia Y-H, Chen W-N, Gu T, Zhang H, Yuan H-Q, Kwong S, Zhang J (2018) Distributed cooperative co-evolution with adaptive computing resource allocation for large scale optimization. IEEE Trans Evolut Comput 23(2):188–202

    Article  Google Scholar 

  52. Jarray R, Al-Dhaifallah M, Rezk H, Bouallègue S (2022) Parallel cooperative coevolutionary grey wolf optimizer for path planning problem of unmanned aerial vehicles. Sensors 22(5):1826

    Article  Google Scholar 

  53. Chen W-N, Jia Y-H, Zhao F, Luo X-N, Jia X-D, Zhang J (2019) A cooperative co-evolutionary approach to large-scale multisource water distribution network optimization. IEEE Trans Evolut Comput 23(5):842–857

    Article  Google Scholar 

  54. Gong Y-J, Chen W-N, Zhan Z-H, Zhang J, Li Y, Zhang Q, Li J-J (2015) Distributed evolutionary algorithms and their models: a survey of the state-of-the-art. Appl Soft Comput 34:286–300

    Article  Google Scholar 

  55. Dubreuil M, Gagné C, Parizeau M (2006) Analysis of a master-slave architecture for distributed evolutionary computations. IEEE Trans Syst Man Cybern Part B (Cybern) 36(1):229–235

    Article  MATH  Google Scholar 

  56. Gong Y, Fukunaga A (2011) Distributed island-model genetic algorithms using heterogeneous parameter settings. In: 2011 IEEE congress of evolutionary computation (CEC), pp. 820–827. IEEE

  57. Giacobini M, Tomassini M, Tettamanzi AG, Alba E (2005) Selection intensity in cellular evolutionary algorithms for regular lattices. IEEE Trans Evolut Comput 9(5):489–505

    Article  Google Scholar 

  58. Tan KC, Yang Y, Goh CK (2006) A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Trans Evolut Comput 10(5):527–549

    Article  Google Scholar 

  59. Lobel I, Ozdaglar A, Feijer D (2011) Distributed multi-agent optimization with state-dependent communication. Math Program 129(2):255–284

    Article  MATH  Google Scholar 

  60. Chen Q, Sun J, Palade V (2019) Distributed contribution-based quantum-behaved particle swarm optimization with controlled diversity for large-scale global optimization problems. IEEE Access 7:150093–150104

    Article  Google Scholar 

  61. Li L, Fang W, Mei Y, Wang Q (2021) Cooperative coevolution for large-scale global optimization based on fuzzy decomposition. Soft Comput 25(5):3593–3608

    Article  Google Scholar 

  62. Yang Z, Tang K, Yao X (2007) Differential evolution for high-dimensional function optimization. In: 2007 IEEE congress on evolutionary computation, pp. 3523–3530. IEEE

  63. Lastra M, Molina D, Benítez JM (2015) A high performance memetic algorithm for extremely high-dimensional problems. Inform Sci 293:35–58

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, College of Engineering and Petroleum, Kuwait University, Kuwait City, Kuwait

    Ali Kelkawi & Imtiaz Ahmad

  2. College of Engineering and Applied Sciences, American University of Kuwait, Salmiya, Kuwait

    Mohammed El-Abd

Authors
  1. Ali Kelkawi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed El-Abd
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Imtiaz Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ali Kelkawi.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kelkawi, A., El-Abd, M. & Ahmad, I. GPU-based cooperative coevolution for large-scale global optimization. Neural Comput & Applic 35, 4621–4642 (2023). https://doi.org/10.1007/s00521-022-07931-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07931-w

Keywords

Search

Navigation