Skip to main content

Advertisement

Springer Nature Link
Log in

A dynamic multi-swarm cooperation particle swarm optimization with dimension mutation for complex optimization problem

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Particle swarm optimization (PSO) has been used to solve numerous real-world problems because of its strong optimization ability. However, PSO still has some shortcomings in solving complex optimization problems, such as premature convergence and poor balance between exploration and exploitation. To overcome these drawbacks of PSO, a dynamic multi-swarm cooperation PSO with dimension mutation (MSCPSO) is proposed in this paper. There are two contributions in MSCPSO, which are the adaptive sample selection strategy (ASS) and the adaptive dimension mutation strategy (ADM). Firstly, in ASS, particles in each sub-swarm are sorted into three states (elite, ordinary and inferior) according to their fitness. Three samples pool are used to save elite, ordinary and inferior particles. Particles in each sub-swarm can select their learning samples in their sample pools adaptively according to their fitness. Therefore, ASS can facilitate information interaction among the sub-swarms and increase the diversity of the population. Secondly, ADM generates the mutation positions for the whole population according to the information and knowledge acquired by particles during the evolution. In this case, ADM is used to enhance the exploitation ability of DMS-PSO without losing population diversity. Finally, two test suites (CEC2013 and CEC2017) and four practical engineering problems are used to verify the performance of MSCPSO. Experimental results verify that MSCPSO has a remarkable performance compared with 7 recent state-of-the-art PSO variants in most complex and multimodal conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Data Availability

The experimental data comes from the open test suite CEC2013 and CEC2017.

References

  1. Feng Z-K, Niu W-J, Zhang R, Wang S, Cheng C-T (2019) Operation rule derivation of hydropower reservoir by k-means clustering method and extreme learning machine based on particle swarm optimization. J Hydrol 576:229–238

    Google Scholar 

  2. Rana S, Jasola S, Kumar R (2012) A boundary restricted adaptive particle swarm optimization for data clustering. Int J Mach Learn Cybern 4(4):391–400

    Google Scholar 

  3. Baghban A, Jalali A, Shafiee M, Ahmadi MH, Chau K-W (2018) Developing an ANFIS-based swarm concept model for estimating the relative viscosity of nanofluids. Eng Appl Comput Fluid Mech 13(1):26–39

    Google Scholar 

  4. Ehteram M, Salih SQ, Yaseen ZM (2020) Efficiency evaluation of reverse osmosis desalination plant using hybridized multilayer perceptron with particle swarm optimization. Environ Sci Pollut Res Int 27(13):15278–15291

    Google Scholar 

  5. Ali Ghorbani M, Kazempour R, Chau K-W, Shamshirband S, Taherei Ghazvinei P (2018) Forecasting pan evaporation with an integrated artificial neural network quantum-behaved particle swarm optimization model: a case study in Talesh, Northern Iran. Eng Appl Comput Fluid Mech 12(1):724–737

    Google Scholar 

  6. Kennedy J, Eberhart R (1995) Particle swarm optimization. In Proceedings of ICNN'95 - International Conference on Neural Networks.

  7. Javidi MM (2020) Feature selection schema based on game theory and biology migration algorithm for regression problems. Int J Mach Learn Cybern 12(2):303–342

    MathSciNet  Google Scholar 

  8. Sánchez D, Melin P, Castillo O (2020) Comparison of particle swarm optimization variants with fuzzy dynamic parameter adaptation for modular granular neural networks for human recognition. J Intell Fuzzy Syst 38(3):3229–3252

    Google Scholar 

  9. Cheng C-T, Niu W-J, Feng Z-K, Shen J-J, Chau K-W (2015) Daily reservoir runoff forecasting method using artificial neural network based on quantum-behaved particle swarm optimization. Water 7(12):4232–4246

    Google Scholar 

  10. Taormina R, Chau K-W (2015) ANN-based interval forecasting of streamflow discharges using the LUBE method and MOFIPS. Eng Appl Artif Intell 45:429–440

    Google Scholar 

  11. Tanweer MR, Suresh S, Sundararajan N (2015) Self regulating particle swarm optimization algorithm. Inf Sci 294:182–202

    MathSciNet  MATH  Google Scholar 

  12. Liu W, Wang Z, Zeng N, Yuan Y, Alsaadi FE, Liu X (2020) A novel randomised particle swarm optimizer. Int J Mach Learn Cybern 12(2):529–540

    Google Scholar 

  13. Liu H, Zhang X-W, Tu L-P (2020) A modified particle swarm optimization using adaptive strategy. Expert Syst Appl 152:113353

    Google Scholar 

  14. Chen K, Zhou F, Yin L, Wang S, Wang Y, Wan F (2018) A hybrid particle swarm optimizer with sine cosine acceleration coefficients. Inf Sci 422:218–241

    MathSciNet  Google Scholar 

  15. Xia X, Xing Y, Wei B, Zhang Y, Li X, Deng X, Gui L (2019) A fitness-based multi-role particle swarm optimization. Swarm Evol Comput 44:349–364

    Google Scholar 

  16. Olivas F, Valdez F, Castillo O, Melin P (2014) Dynamic parameter adaptation in particle swarm optimization using interval type-2 fuzzy logic. Soft Comput 20(3):1057–1070

    Google Scholar 

  17. Garg H (2016) A hybrid PSO-GA algorithm for constrained optimization problems. Appl Math Comput 274:292–305

    MathSciNet  MATH  Google Scholar 

  18. Cheng T, Chen M, Fleming PJ, Yang Z, Gan S (2017) A novel hybrid teaching learning based multi-objective particle swarm optimization. Neurocomputing 222:11–25

    Google Scholar 

  19. Pan X, Xue L, Lu Y, Sun N (2018) Hybrid particle swarm optimization with simulated annealing. Multimed Tools Appl 78(21):29921–29936

    Google Scholar 

  20. Lagunes ML, Castillo O, Valdez F, Soria J (2019) Multi-metaheuristic competitive model for optimization of fuzzy controllers. Algorithms 12:5

    MathSciNet  Google Scholar 

  21. Valdez F, Vazquez JC, Melin P, Castillo O (2017) Comparative study of the use of fuzzy logic in improving particle swarm optimization variants for mathematical functions using co-evolution. Appl Soft Comput 52:1070–1083

    Google Scholar 

  22. Garg H (2019) A hybrid GSA-GA algorithm for constrained optimization problems. Inf Sci 478:499–523

    Google Scholar 

  23. Patwal RS, Narang N, Garg H (2018) A novel TVAC-PSO based mutation strategies algorithm for generation scheduling of pumped storage hydrothermal system incorporating solar units. Energy 142:822–837

    Google Scholar 

  24. Garg H (2015) A hybrid GA-GSA algorithm for optimizing the performance of an industrial system by utilizing uncertain data. In: Handbook of research on artificial intelligence techniques and algorithms, pp: 620–654

  25. Liang JJ, Suganthan PN (2006) Dynamic multi-swarm particle swarm optimizer with a novel constraint-handling mechanism. In Proceedings 2005 IEEE Swarm Intelligence Symposium.

  26. Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24

    Google Scholar 

  27. Wei B, Xia X, Yu F, Zhang Y, Xu X, Wu H, Gui L, He G (2020) Multiple adaptive strategies based particle swarm optimization algorithm. Swarm Evolut Comput 57:100731

    Google Scholar 

  28. Xia X, Gui L, Zhan Z-H (2018) A multi-swarm particle swarm optimization algorithm based on dynamical topology and purposeful detecting. Appl Soft Comput 67:126–140

    Google Scholar 

  29. Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210

    Google Scholar 

  30. Lin A, Sun W, Yu H, Wu G, Tang H (2019) Global genetic learning particle swarm optimization with diversity enhancement by ring topology. Swarm Evol Comput 44:571–583

    Google Scholar 

  31. Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548

    Google Scholar 

  32. Gong YJ, Li JJ, Zhou Y, Li Y, Chung HS, Shi YH, Zhang J (2016) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290

    Google Scholar 

  33. Liang JJ, Definitions P, Criteria E (2013) For the CEC, Special Session on Realparameter Optimization Technical report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou, China, 2013. Nanyang Technological University, Singapore

    Google Scholar 

  34. Awad NH, Ali MZ, Suganthan PN, Liang JJ, Qu BY (2017) Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective real-parameter numerical optimization, pp. 1–34.

  35. Abderazek H, Yildiz AR, Sait SM (2019) Mechanical engineering design optimisation using novel adaptive differential evolution algorithm. Int J Vehicle Design 80:285–329

    Google Scholar 

  36. Yıldız AR, Özkaya H, Yıldız M, Bureerat S, Yıldız BS, Sait SM (2020) The equilibrium optimization algorithm and the response surface-based metamodel for optimal structural design of vehicle components. Mater Test 62(5):492–496

    Google Scholar 

  37. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Google Scholar 

  38. Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47

    Google Scholar 

  39. Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248

    MATH  Google Scholar 

  40. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61

    Google Scholar 

  41. Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191

    Google Scholar 

  42. Yildiz B, Pholdee N, Bureerat S, Yildiz AR, Sait SM (2021) Enhanced grasshopper optimization algorithm using elite opposition-based learning for solving real-world engineering problems. Eng Comput. https://doi.org/10.1007/s00366-021-01368-w

    Article  Google Scholar 

  43. Yildiz BS, Pholdee N, Pholdee N, Bureerat S, Yildiz AR, Sait SM (2021) A novel chaotic Henry gas solubility optimization algorithm for solving real-world engineering problems. Eng Comput. https://doi.org/10.1007/s00366-020-01268-5

    Article  Google Scholar 

  44. D’Angelo G, Palmieri F (2021) GGA: A modified genetic algorithm with gradient-based local search for solving constrained optimization problems. Inf Sci 547:136–162

    MathSciNet  MATH  Google Scholar 

  45. Xue Y, Jiang J, Zhao B, Ma T (2017) A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft Comput 22(9):2935–2952

    Google Scholar 

  46. Gandomi AH, Yang X-S, Alavi AH (2011) Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng Comput 29(1):17–35

    Google Scholar 

  47. Yildiz BS, Pholdee N, Bureerat S, Yildiz AR, Sait SM (2021) Robust design of a robot gripper mechanism using new hybrid grasshopper optimization algorithm. Expert Syst 38:3

    Google Scholar 

  48. Yıldız AR, Erdaş MU (2021) A new Hybrid Taguchi-salp swarm optimization algorithm for the robust design of real-world engineering problems. Mater Test 63(2):157–162

    Google Scholar 

  49. Karen İ, Yildiz AR, Kaya N, Öztürk N, Öztürk F (2006) Hybrid approach for genetic algorithm and Taguchi’s method based design optimization in the automotive industry. Int J Prod Res 44(22):4897–4914

    MATH  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation of China (61973067, 61903071), and the Fundamental Research Funds for the Central Universities under Grant N2004006.

Author information

Authors and Affiliations

  1. Information Science and Engineering, Northeastern University, No.11 St. 3, Wenhua Road, Heping District, Shenyang, 110819, People’s Republic of China

    Xu Yang, Hongru Li & Xia Yu

Authors
  1. Xu Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Hongru Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Xia Yu
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

XY: Conceptualization, Methodology, Writing-original-draft. HL: Supervision, Writing-review & editing. XY: Writing-review & editing.

Corresponding author

Correspondence to Hongru Li.

Ethics declarations

Conflict of interest

There is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 42 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, X., Li, H. & Yu, X. A dynamic multi-swarm cooperation particle swarm optimization with dimension mutation for complex optimization problem. Int. J. Mach. Learn. & Cyber. 13, 2581–2608 (2022). https://doi.org/10.1007/s13042-022-01545-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01545-3

Keywords