Abstract
Most real-world applications can be formulated as optimization problems, which commonly suffer from being trapped into the local optima. In this paper, we make full use of the global search capability of particle swarm optimization (PSO) and local search ability of extremal optimization (EO), and propose a gradient-based adaptive PSO with improved EO (called GAPSO-IEO) to overcome the issue of local optima deficiency of optimization in high-dimensional search and reduce the time complexity of the algorithm. In the proposed algorithm, the improved EO (IEO) is adaptively incorporated into PSO to avoid the particles being trapped into the local optima according to the evolutional states of the swarm, which are estimated based on the gradients of the fitness functions of the particles. We also improve the mutation strategy of EO by performing polynomial mutation (PLM) on each particle, instead of on each component of the particle, therefore, the algorithm is not sensitive to the dimension of the swarm. The proposed algorithm is tested on several unimodal/multimodal benchmark functions and Berkeley Segmentation Dataset and Benchmark (BSDS300). The results of experiments have shown the superiority and efficiency of the proposed approach compared with those of the state-of-the-art algorithms, and can achieve better performance in high-dimensional tasks.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Tang PH, Tseng MH (2013) Adaptive directed mutation for real-coded genetic algorithms. Appl Soft Comput 13(1):600
Ma K, Liu W, Zhang K, Duanmu Z, Wang Z, Zuo W (2018) End-to-end blind image quality assessment using deep neural networks. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 27(3):1202
Sun W, Su F, Wang L (2017) Improving deep neural networks with multi-layer maxout networks and a novel initialization method. Neurocomputing
Kennedy J (2010) Particle swarm optimization. In: Encyclopedia of machine learning, Springer, pp 760–766
Lin Q, Liu S, Zhu Q, Tang C, Song R, Chen J, Coello CAC, Wong KC, Zhang J (2016) Particle swarm optimization with a balanceable fitness estimation for many-objective optimization problems. IEEE Trans Evol Comput 22(1):23
Cheng R, Jin Y (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291(6):43
Zhao X, Turk M, Li W, Lien KC, Wang G (2016) A multilevel image thresholding segmentation algorithm based on two-dimensional k–l divergence and modified particle swarm optimization. Appl Soft Comput 48:151
Hatamlou A (2017) A hybrid bio-inspired algorithm and its application. Appl Intell (8):1–9
Hu M, Wu TF, Weir JD (2013) An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans Evol Comput 17(5):705
Boettcher S, Percus AG (1999) Extremal optimization: methods derived from co-evolution. In: Genetic and evolutionary computation conference, pp 825–832
Zeng GQ, Chen J, Li LM, Chen MR, Wu L, Dai YX, Zheng CW (2016) An improved multi-objective population-based extremal optimization algorithm with polynomial mutation. Inf Sci 330(C):49
Chen MR, Li X, Zhang X, Lu YZ (2010) A novel particle swarm optimizer hybridized with extremal optimization. Appl Soft Comput 10(2):367
Chen MR, Lu YZ, Yang G (2008) Multiobjective optimization using population-based extremal optimization. Neural Comput Applic 17(2):101
Zeng GQ, Lu KD, Chen J, Zhang ZJ, Dai YX, Peng WW, Zheng CW (2014) An improved real-coded population-based extremal optimization method for continuous unconstrained optimization problems. Math Probl Eng 2014(1):1
Zeng GQ, Chen J, Chen MR, Dai YX, Li LM, Lu KD, Zheng CW (2015) Design of multivariable pid controllers using real-coded population-based extremal optimization. Neurocomputing 151:1343
Chen MR, Weng J, Li X, Zhang X (2014) Handling multiple objectives with integration of particle swarm optimization and extremal optimization
Khakmardan P, Akbarzadeh T (2011) Solving traveling salesman problem by a hybrid combination of pso and extremal optimization pp 1501–1507
Wang W (2012) Research on particle swarm optimization and its application
Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213(23):68
Balaji S, Revathi N (2016) A new approach for solving set covering problem using jumping particle swarm optimization method. Nat Comput (3):1–15
Gong M, Cai Q, Chen X, Ma L (2014) Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Trans Evol Comput 18(1):82
Wang W, Duan L, Yang B, Wang H, Shao H, Zhong S (2016) A triangle mesh standardization method based on particle swarm optimization. Plos One 11(8):e0160657
Lu Y, Liang M, Ye Z, Cao L (2015) Improved particle swarm optimization algorithm and its application in text feature selection. Appl Soft Comput 35(C):629
Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24
Liu Y, Niu B, Luo Y (2015) Hybrid learning particle swarm optimizer with genetic disturbance. Neurocomputing 151:1237
Juang YT, Tung SL, Chiu HC (2011) Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions. Inf Sci 181(20):4539
Ghamisi P, Benediktsson JA (2015) Feature selection based on hybridization of genetic algorithm and particle swarm optimization. IEEE Geosci Remote Sens Lett 12(2):309
Akay B (2013) A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding. Appl Soft Comput 13(6):3066
Chen J, Xie Y, Chen H (2014) A Population-Based extremal optimization algorithm with Knowledge-Based mutation. Springer international publishing, Berlin
Randall M, Lewis A (2010) intensification strategies for extremal optimisation. Springer, Berlin
Zeng GQ, Chen J, Li LM, Chen MR, Wu L, Dai YX, Zheng CW (2015) An improved multi-objective population-based extremal optimization algorithm with polynomial mutation. Information Sciences An International Journal 330(C):49
Hati AN, Darbar R, Jana ND, Sil J (2013) Modified artificial bee colony algorithm using differential evolution and polynomial mutation for real-parameter optimization.. In: International conference on advances in computing, communications and informatics, pp 534–539
Li LM, Lu KD, Zeng GQ, Wu L, Chen MR (2016) A novel real-coded population-based extremal optimization algorithm with polynomial mutation: a non-parametric statistical study on continuous optimization problems. Neurocomputing 174:577
Fehr S, Berens S (2014) On the conditional Rényi entropy. IEEE Trans Inf Theory 60(11):6801
Deep K (2007) A new mutation operator for real coded genetic algrithms. Appl Math Comput 193(1):211
Yang AY, Wright J, Ma Y, Sastry SS (2008) Unsupervised segmentation of natural images via lossy data compression. Comput Vis Image Underst 110(2):212
Acknowledgments
The authors would like to thank the anonymous referees for their useful comments. This work is supported by the National Nature Science Foundation of China (No.61461021) and Shanghai Science and Technology Committee (No. 15590501300).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhao, X., Hwang, JN., Fang, Z. et al. Gradient-based adaptive particle swarm optimizer with improved extremal optimization. Appl Intell 48, 4646–4659 (2018). https://doi.org/10.1007/s10489-018-1228-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-018-1228-9