Skip to main content
Log in

Ensemble particle swarm optimization and differential evolution with alternative mutation method

  • Published:
Natural Computing Aims and scope Submit manuscript

Abstract

This paper presents a new ensemble algorithm which combines two well-known algorithms particle swarm optimization (PSO) and differential evolution (DE). To avoid the suboptimal solutions occurring in the previous hybrid algorithms, in this study, an alternative mutation method is developed and embedded in the proposed algorithm. The population of the proposed algorithm consists of two groups which employ two independent updating methods (i.e. velocity updating method from PSO and mutative method from DE). By comparing with the previously generated population at the last generation, two new groups are generated according to the updating methods. Based on the alternative mutation method, the population is updated by the alternative selection according to the evaluation functions. To enhance the diversity of the population, the strategies of re-mutation, crossover, and selection are conducted throughout the optimization process. Each individual conducts the correspondent mutation and crossover strategies according to the parameter values randomly selected, and the parameter values of scaling factor and crossover probability will be updated accordingly throughout the iterations. Numerous simulations on twenty-five benchmark functions have been conducted, which indicates the proposed algorithm outperforms some well-exploited algorithms (i.e. inertia weight PSO, comprehensive learning PSO, and DE) and recently proposed algorithms (i.e. DE with the ensemble of parameters and mutation strategies and ensemble PSO).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Alexandridis A, Chondrodima E, Sarimveis H (2016) Cooperative learning for radial basis function networks using particle swarm optimization. Appl Soft Comput 49:485–497

    Article  Google Scholar 

  • Ali AF, Tawhid MA (2016) A hybrid PSO and DE algorithm for solving engineering optimization problems. Appl Math Inf Sci 10:431–449

    Article  Google Scholar 

  • Arani BO, Mirzabeygi P, Panahi MS (2013) An improved PSO algorithm with a territorial diversity-preserving scheme and enhanced exploration–exploitation balance. Swarm Evolut Comput 11:1–15

    Article  Google Scholar 

  • Chen JJ, Zheng JH, Wu P, Zhang LL, Wu QH (2017) Dynamic particle swarm optimizer with escaping prey for solving constrained non-convex and piecewise optimization problems. Expert Syst Appl 86:208–223

    Article  Google Scholar 

  • Cheng MY, Tran DH, Wu YW (2014) Using a fuzzy clustering chaotic-based differential evolution with serial method to solve resource-constrained project scheduling problems. Autom Constr 37:88–97

    Article  Google Scholar 

  • Guedria NB (2016) Improved accelerated PSO algorithm for mechanical engineering optimization problems. Appl Soft Comput 40:455–467

    Article  Google Scholar 

  • Guo SM, Yang CC, Hsu PH, Tsai SH (2015) Improving differential evolution with a successful-parent-selecting framework. IEEE Trans Evol Comput 19:717–730

    Article  Google Scholar 

  • Ho-Huu V, Nguyen-Thoi T, Nguyen-Thoi MH, Le-Anh L (2015) An improved constrained differential evolution using discrete variables (D-ICDE) for layout optimization of truss structures. Expert Syst Appl 42:7057–7069

    Article  Google Scholar 

  • Iorio AW, Li X (2004) Solving rotated multi-objective optimization problems using differential evolution. Lect Notes Comput Sci Inf Syst 3339:861–872

    Article  MathSciNet  Google Scholar 

  • Jebaraj L, Venkatesan C, Soubache I, Rajan CCA (2017) Application of differential evolution algorithm in static and dynamic economic or emission dispatch problem: a review. Renew Sustain Energy Rev 77:1206–1220

    Article  Google Scholar 

  • Juang CF, Chen YH, Jhan YH (2015) Wall-following control of a hexapod robot using a data-driven fuzzy controller learned through differential evolution. IEEE Trans Ind Electron 62:611–619

    Article  Google Scholar 

  • Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE international conference on neural networks, 1995. Proceedings. pp 1942–1948 vol. 1944

  • Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10:281–295

    Article  Google Scholar 

  • Liao L, Zhou J, Zou Q (2013) Weighted fuzzy kernel-clustering algorithm with adaptive differential evolution and its application on flood classification. Nat Hazards 69:279–293

    Article  Google Scholar 

  • Liu J, Qiao S (2015) A image segmentation algorithm based on differential evolution particle swarm optimization fuzzy c-means clustering. Comput Sci Inf Syst 12:873–893

    Article  Google Scholar 

  • Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548

    Article  Google Scholar 

  • Ma W, Wang M, Zhu X (2015) Hybrid particle swarm optimization and differential evolution algorithm for bi-level programming problem and its application to pricing and lot-sizing decisions. J Intell Manuf 26:471–483

    Article  Google Scholar 

  • Mallipeddi R, Suganthan PN (2010) Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies. In: International conference on swarm, evolutionary, and memetic computing, pp 71–78

  • Mao B, Xie Z, Wang Y, Handroos H, Wu H, Shi S (2017) A hybrid differential evolution and particle swarm optimization algorithm for numerical kinematics solution of remote maintenance manipulators. Fusion Eng Des 124:587–590

    Article  Google Scholar 

  • Mohapatra P, Das KN, Roy S (2017) A modified competitive swarm optimizer for large scale optimization problems. Appl Soft Comput 59:340–362

    Article  Google Scholar 

  • Moharam A, El-Hosseini MA, Ali HA (2016) Design of optimal PID controller using hybrid differential evolution and particle swarm optimization with an aging leader and challengers. Appl Soft Comput 38:727–737

    Article  Google Scholar 

  • Niu B, Zhang F, Li L, Wu L (2014) Particle swarm optimization for yard truck scheduling in container terminal with a cooperative strategy. In: International conference on information science, electronics and electrical engineering, pp 1392–1396

  • Niu B, Huang HL, Tan LJ, Duan QQ (2017) Symbiosis-based alternative learning multi-swarm particle swarm optimization. IEEE/ACM Trans Comput Biol Bioinform 14:4–14

    Article  Google Scholar 

  • Pandit M, Srivastava L, Sharma M (2015) Environmental economic dispatch in multi-area power system employing improved differential evolution with fuzzy selection. Appl Soft Comput 28:498–510

    Article  Google Scholar 

  • Price K, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization (Natural Computing Series). vol 2. Springer, New York, Inc. Secaucus, NJ, USA ©2005

  • Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13:398–417

    Article  Google Scholar 

  • Salman A, Engelbrecht AP, Omran MGH (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183:785–804

    Article  Google Scholar 

  • Shi Y, Eberhart R (1998) A modified particle swarm optimizer. Springer, Berlin, Advances in Natural Computation

  • Storn R (1996) On the usage of differential evolution for function optimization. In: Fuzzy information processing society, 1996. NAFIPS. 1996 Biennial Conference of the North American, pp 519–523

  • Storn R, Price K (1997) Differential evolution: a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359

    Article  MathSciNet  Google Scholar 

  • Suganthan PN, Hansen N, Liang JJ, Deb K, Chen Y-P, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. IEEE congress on evolutionary computation

  • Tang B, Zhu Z, Luo J (2016) Hybridizing particle swarm optimization and differential evolution for the mobile robot global path planning. Int J Adv Rob Syst 13(3):1

    Google Scholar 

  • Tsai JT (2015) Improved differential evolution algorithm for nonlinear programming and engineering design problems. Neurocomputing 148:628–640

    Article  Google Scholar 

  • Tsai HC (2017) Unified particle swarm delivers high efficiency to particle swarm optimization. Appl Soft Comput 55:371–383

    Article  Google Scholar 

  • Vijay Chakaravarthy G, Marimuthu S, Naveen Sait A (2013) Performance evaluation of proposed differential evolution and particle swarm optimization algorithms for scheduling m-machine flow shops with lot streaming. J Intell Manuf 24:175–191

    Article  Google Scholar 

  • Wong JYQ, Sharma S, Rangaiah GP (2016) Design of shell-and-tube heat exchangers for multiple objectives using elitist non-dominated sorting genetic algorithm with termination criteria. Appl Therm Eng 93:888–899

    Article  Google Scholar 

  • Xu J, Tang Y, Liu DY (2016) Research of hybrid differential evolution and particle swarm optimization algorithm using map reduce to schedule tasks. J Chin Comput Syst 37:1479–1481

    Google Scholar 

  • Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9:1126–1138

    Article  Google Scholar 

  • Zheng LM, Zhang SX, Zheng SY, Pan YM (2017) Differential evolution algorithm with two-step subpopulation strategy and its application in microwave circuit designs. IEEE Trans Ind Inf 12:911–923

    Article  Google Scholar 

  • Zuo X, Xiao L (2014) A DE and PSO based hybrid algorithm for dynamic optimization problems. Soft Comput 18:1405–1424

    Article  Google Scholar 

Download references

Acknowledgements

This work is partially supported by The National Natural Science Foundation of China (Grants Nos. 71571120, 71271140, 71471158, 71001072, 61472257), Natural Science Foundation of Guangdong Province (2016A030310074), Shenzhen Science and Technology Plan (CXZZ20140418182638764), and Research Foundation of Shenzhen University (85303/00000155).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to B. Niu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Zuo, L.L., Liu, J. et al. Ensemble particle swarm optimization and differential evolution with alternative mutation method. Nat Comput 19, 699–712 (2020). https://doi.org/10.1007/s11047-018-9712-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11047-018-9712-z

Keywords

Navigation