Abstract
This paper presents a new ensemble algorithm which combines two well-known algorithms particle swarm optimization (PSO) and differential evolution (DE). To avoid the suboptimal solutions occurring in the previous hybrid algorithms, in this study, an alternative mutation method is developed and embedded in the proposed algorithm. The population of the proposed algorithm consists of two groups which employ two independent updating methods (i.e. velocity updating method from PSO and mutative method from DE). By comparing with the previously generated population at the last generation, two new groups are generated according to the updating methods. Based on the alternative mutation method, the population is updated by the alternative selection according to the evaluation functions. To enhance the diversity of the population, the strategies of re-mutation, crossover, and selection are conducted throughout the optimization process. Each individual conducts the correspondent mutation and crossover strategies according to the parameter values randomly selected, and the parameter values of scaling factor and crossover probability will be updated accordingly throughout the iterations. Numerous simulations on twenty-five benchmark functions have been conducted, which indicates the proposed algorithm outperforms some well-exploited algorithms (i.e. inertia weight PSO, comprehensive learning PSO, and DE) and recently proposed algorithms (i.e. DE with the ensemble of parameters and mutation strategies and ensemble PSO).
Similar content being viewed by others
References
Alexandridis A, Chondrodima E, Sarimveis H (2016) Cooperative learning for radial basis function networks using particle swarm optimization. Appl Soft Comput 49:485–497
Ali AF, Tawhid MA (2016) A hybrid PSO and DE algorithm for solving engineering optimization problems. Appl Math Inf Sci 10:431–449
Arani BO, Mirzabeygi P, Panahi MS (2013) An improved PSO algorithm with a territorial diversity-preserving scheme and enhanced exploration–exploitation balance. Swarm Evolut Comput 11:1–15
Chen JJ, Zheng JH, Wu P, Zhang LL, Wu QH (2017) Dynamic particle swarm optimizer with escaping prey for solving constrained non-convex and piecewise optimization problems. Expert Syst Appl 86:208–223
Cheng MY, Tran DH, Wu YW (2014) Using a fuzzy clustering chaotic-based differential evolution with serial method to solve resource-constrained project scheduling problems. Autom Constr 37:88–97
Guedria NB (2016) Improved accelerated PSO algorithm for mechanical engineering optimization problems. Appl Soft Comput 40:455–467
Guo SM, Yang CC, Hsu PH, Tsai SH (2015) Improving differential evolution with a successful-parent-selecting framework. IEEE Trans Evol Comput 19:717–730
Ho-Huu V, Nguyen-Thoi T, Nguyen-Thoi MH, Le-Anh L (2015) An improved constrained differential evolution using discrete variables (D-ICDE) for layout optimization of truss structures. Expert Syst Appl 42:7057–7069
Iorio AW, Li X (2004) Solving rotated multi-objective optimization problems using differential evolution. Lect Notes Comput Sci Inf Syst 3339:861–872
Jebaraj L, Venkatesan C, Soubache I, Rajan CCA (2017) Application of differential evolution algorithm in static and dynamic economic or emission dispatch problem: a review. Renew Sustain Energy Rev 77:1206–1220
Juang CF, Chen YH, Jhan YH (2015) Wall-following control of a hexapod robot using a data-driven fuzzy controller learned through differential evolution. IEEE Trans Ind Electron 62:611–619
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: IEEE international conference on neural networks, 1995. Proceedings. pp 1942–1948 vol. 1944
Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10:281–295
Liao L, Zhou J, Zou Q (2013) Weighted fuzzy kernel-clustering algorithm with adaptive differential evolution and its application on flood classification. Nat Hazards 69:279–293
Liu J, Qiao S (2015) A image segmentation algorithm based on differential evolution particle swarm optimization fuzzy c-means clustering. Comput Sci Inf Syst 12:873–893
Lynn N, Suganthan PN (2017) Ensemble particle swarm optimizer. Appl Soft Comput 55:533–548
Ma W, Wang M, Zhu X (2015) Hybrid particle swarm optimization and differential evolution algorithm for bi-level programming problem and its application to pricing and lot-sizing decisions. J Intell Manuf 26:471–483
Mallipeddi R, Suganthan PN (2010) Differential evolution algorithm with ensemble of parameters and mutation and crossover strategies. In: International conference on swarm, evolutionary, and memetic computing, pp 71–78
Mao B, Xie Z, Wang Y, Handroos H, Wu H, Shi S (2017) A hybrid differential evolution and particle swarm optimization algorithm for numerical kinematics solution of remote maintenance manipulators. Fusion Eng Des 124:587–590
Mohapatra P, Das KN, Roy S (2017) A modified competitive swarm optimizer for large scale optimization problems. Appl Soft Comput 59:340–362
Moharam A, El-Hosseini MA, Ali HA (2016) Design of optimal PID controller using hybrid differential evolution and particle swarm optimization with an aging leader and challengers. Appl Soft Comput 38:727–737
Niu B, Zhang F, Li L, Wu L (2014) Particle swarm optimization for yard truck scheduling in container terminal with a cooperative strategy. In: International conference on information science, electronics and electrical engineering, pp 1392–1396
Niu B, Huang HL, Tan LJ, Duan QQ (2017) Symbiosis-based alternative learning multi-swarm particle swarm optimization. IEEE/ACM Trans Comput Biol Bioinform 14:4–14
Pandit M, Srivastava L, Sharma M (2015) Environmental economic dispatch in multi-area power system employing improved differential evolution with fuzzy selection. Appl Soft Comput 28:498–510
Price K, Storn RM, Lampinen JA (2005) Differential evolution: a practical approach to global optimization (Natural Computing Series). vol 2. Springer, New York, Inc. Secaucus, NJ, USA ©2005
Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13:398–417
Salman A, Engelbrecht AP, Omran MGH (2007) Empirical analysis of self-adaptive differential evolution. Eur J Oper Res 183:785–804
Shi Y, Eberhart R (1998) A modified particle swarm optimizer. Springer, Berlin, Advances in Natural Computation
Storn R (1996) On the usage of differential evolution for function optimization. In: Fuzzy information processing society, 1996. NAFIPS. 1996 Biennial Conference of the North American, pp 519–523
Storn R, Price K (1997) Differential evolution: a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359
Suganthan PN, Hansen N, Liang JJ, Deb K, Chen Y-P, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. IEEE congress on evolutionary computation
Tang B, Zhu Z, Luo J (2016) Hybridizing particle swarm optimization and differential evolution for the mobile robot global path planning. Int J Adv Rob Syst 13(3):1
Tsai JT (2015) Improved differential evolution algorithm for nonlinear programming and engineering design problems. Neurocomputing 148:628–640
Tsai HC (2017) Unified particle swarm delivers high efficiency to particle swarm optimization. Appl Soft Comput 55:371–383
Vijay Chakaravarthy G, Marimuthu S, Naveen Sait A (2013) Performance evaluation of proposed differential evolution and particle swarm optimization algorithms for scheduling m-machine flow shops with lot streaming. J Intell Manuf 24:175–191
Wong JYQ, Sharma S, Rangaiah GP (2016) Design of shell-and-tube heat exchangers for multiple objectives using elitist non-dominated sorting genetic algorithm with termination criteria. Appl Therm Eng 93:888–899
Xu J, Tang Y, Liu DY (2016) Research of hybrid differential evolution and particle swarm optimization algorithm using map reduce to schedule tasks. J Chin Comput Syst 37:1479–1481
Zaharie D (2009) Influence of crossover on the behavior of differential evolution algorithms. Appl Soft Comput 9:1126–1138
Zheng LM, Zhang SX, Zheng SY, Pan YM (2017) Differential evolution algorithm with two-step subpopulation strategy and its application in microwave circuit designs. IEEE Trans Ind Inf 12:911–923
Zuo X, Xiao L (2014) A DE and PSO based hybrid algorithm for dynamic optimization problems. Soft Comput 18:1405–1424
Acknowledgements
This work is partially supported by The National Natural Science Foundation of China (Grants Nos. 71571120, 71271140, 71471158, 71001072, 61472257), Natural Science Foundation of Guangdong Province (2016A030310074), Shenzhen Science and Technology Plan (CXZZ20140418182638764), and Research Foundation of Shenzhen University (85303/00000155).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, H., Zuo, L.L., Liu, J. et al. Ensemble particle swarm optimization and differential evolution with alternative mutation method. Nat Comput 19, 699–712 (2020). https://doi.org/10.1007/s11047-018-9712-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11047-018-9712-z