Skip to main content
Log in

Gradient-based adaptive particle swarm optimizer with improved extremal optimization

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Most real-world applications can be formulated as optimization problems, which commonly suffer from being trapped into the local optima. In this paper, we make full use of the global search capability of particle swarm optimization (PSO) and local search ability of extremal optimization (EO), and propose a gradient-based adaptive PSO with improved EO (called GAPSO-IEO) to overcome the issue of local optima deficiency of optimization in high-dimensional search and reduce the time complexity of the algorithm. In the proposed algorithm, the improved EO (IEO) is adaptively incorporated into PSO to avoid the particles being trapped into the local optima according to the evolutional states of the swarm, which are estimated based on the gradients of the fitness functions of the particles. We also improve the mutation strategy of EO by performing polynomial mutation (PLM) on each particle, instead of on each component of the particle, therefore, the algorithm is not sensitive to the dimension of the swarm. The proposed algorithm is tested on several unimodal/multimodal benchmark functions and Berkeley Segmentation Dataset and Benchmark (BSDS300). The results of experiments have shown the superiority and efficiency of the proposed approach compared with those of the state-of-the-art algorithms, and can achieve better performance in high-dimensional tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Tang PH, Tseng MH (2013) Adaptive directed mutation for real-coded genetic algorithms. Appl Soft Comput 13(1):600

    Article  Google Scholar 

  2. Ma K, Liu W, Zhang K, Duanmu Z, Wang Z, Zuo W (2018) End-to-end blind image quality assessment using deep neural networks. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 27(3):1202

    Article  MathSciNet  Google Scholar 

  3. Sun W, Su F, Wang L (2017) Improving deep neural networks with multi-layer maxout networks and a novel initialization method. Neurocomputing

  4. Kennedy J (2010) Particle swarm optimization. In: Encyclopedia of machine learning, Springer, pp 760–766

  5. Lin Q, Liu S, Zhu Q, Tang C, Song R, Chen J, Coello CAC, Wong KC, Zhang J (2016) Particle swarm optimization with a balanceable fitness estimation for many-objective optimization problems. IEEE Trans Evol Comput 22(1):23

    Google Scholar 

  6. Cheng R, Jin Y (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291(6):43

    Article  MathSciNet  Google Scholar 

  7. Zhao X, Turk M, Li W, Lien KC, Wang G (2016) A multilevel image thresholding segmentation algorithm based on two-dimensional k–l divergence and modified particle swarm optimization. Appl Soft Comput 48:151

    Article  Google Scholar 

  8. Hatamlou A (2017) A hybrid bio-inspired algorithm and its application. Appl Intell (8):1–9

  9. Hu M, Wu TF, Weir JD (2013) An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans Evol Comput 17(5):705

    Article  Google Scholar 

  10. Boettcher S, Percus AG (1999) Extremal optimization: methods derived from co-evolution. In: Genetic and evolutionary computation conference, pp 825–832

  11. Zeng GQ, Chen J, Li LM, Chen MR, Wu L, Dai YX, Zheng CW (2016) An improved multi-objective population-based extremal optimization algorithm with polynomial mutation. Inf Sci 330(C):49

    Article  Google Scholar 

  12. Chen MR, Li X, Zhang X, Lu YZ (2010) A novel particle swarm optimizer hybridized with extremal optimization. Appl Soft Comput 10(2):367

    Article  Google Scholar 

  13. Chen MR, Lu YZ, Yang G (2008) Multiobjective optimization using population-based extremal optimization. Neural Comput Applic 17(2):101

    Article  Google Scholar 

  14. Zeng GQ, Lu KD, Chen J, Zhang ZJ, Dai YX, Peng WW, Zheng CW (2014) An improved real-coded population-based extremal optimization method for continuous unconstrained optimization problems. Math Probl Eng 2014(1):1

    MathSciNet  Google Scholar 

  15. Zeng GQ, Chen J, Chen MR, Dai YX, Li LM, Lu KD, Zheng CW (2015) Design of multivariable pid controllers using real-coded population-based extremal optimization. Neurocomputing 151:1343

    Article  Google Scholar 

  16. Chen MR, Weng J, Li X, Zhang X (2014) Handling multiple objectives with integration of particle swarm optimization and extremal optimization

  17. Khakmardan P, Akbarzadeh T (2011) Solving traveling salesman problem by a hybrid combination of pso and extremal optimization pp 1501–1507

  18. Wang W (2012) Research on particle swarm optimization and its application

  19. Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213(23):68

    Article  Google Scholar 

  20. Balaji S, Revathi N (2016) A new approach for solving set covering problem using jumping particle swarm optimization method. Nat Comput (3):1–15

    Article  MathSciNet  Google Scholar 

  21. Gong M, Cai Q, Chen X, Ma L (2014) Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE Trans Evol Comput 18(1):82

    Article  Google Scholar 

  22. Wang W, Duan L, Yang B, Wang H, Shao H, Zhong S (2016) A triangle mesh standardization method based on particle swarm optimization. Plos One 11(8):e0160657

    Article  Google Scholar 

  23. Lu Y, Liang M, Ye Z, Cao L (2015) Improved particle swarm optimization algorithm and its application in text feature selection. Appl Soft Comput 35(C):629

    Article  Google Scholar 

  24. Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24

    Article  Google Scholar 

  25. Liu Y, Niu B, Luo Y (2015) Hybrid learning particle swarm optimizer with genetic disturbance. Neurocomputing 151:1237

    Article  Google Scholar 

  26. Juang YT, Tung SL, Chiu HC (2011) Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions. Inf Sci 181(20):4539

    Article  MathSciNet  Google Scholar 

  27. Ghamisi P, Benediktsson JA (2015) Feature selection based on hybridization of genetic algorithm and particle swarm optimization. IEEE Geosci Remote Sens Lett 12(2):309

    Article  Google Scholar 

  28. Akay B (2013) A study on particle swarm optimization and artificial bee colony algorithms for multilevel thresholding. Appl Soft Comput 13(6):3066

    Article  Google Scholar 

  29. Chen J, Xie Y, Chen H (2014) A Population-Based extremal optimization algorithm with Knowledge-Based mutation. Springer international publishing, Berlin

    Book  Google Scholar 

  30. Randall M, Lewis A (2010) intensification strategies for extremal optimisation. Springer, Berlin

    Book  Google Scholar 

  31. Zeng GQ, Chen J, Li LM, Chen MR, Wu L, Dai YX, Zheng CW (2015) An improved multi-objective population-based extremal optimization algorithm with polynomial mutation. Information Sciences An International Journal 330(C):49

    Google Scholar 

  32. Hati AN, Darbar R, Jana ND, Sil J (2013) Modified artificial bee colony algorithm using differential evolution and polynomial mutation for real-parameter optimization.. In: International conference on advances in computing, communications and informatics, pp 534–539

  33. Li LM, Lu KD, Zeng GQ, Wu L, Chen MR (2016) A novel real-coded population-based extremal optimization algorithm with polynomial mutation: a non-parametric statistical study on continuous optimization problems. Neurocomputing 174:577

    Article  Google Scholar 

  34. Fehr S, Berens S (2014) On the conditional Rényi entropy. IEEE Trans Inf Theory 60(11):6801

    Article  Google Scholar 

  35. Deep K (2007) A new mutation operator for real coded genetic algrithms. Appl Math Comput 193(1):211

    MathSciNet  MATH  Google Scholar 

  36. Yang AY, Wright J, Ma Y, Sastry SS (2008) Unsupervised segmentation of natural images via lossy data compression. Comput Vis Image Underst 110(2):212

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the anonymous referees for their useful comments. This work is supported by the National Nature Science Foundation of China (No.61461021) and Shanghai Science and Technology Committee (No. 15590501300).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaoli Zhao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, X., Hwang, JN., Fang, Z. et al. Gradient-based adaptive particle swarm optimizer with improved extremal optimization. Appl Intell 48, 4646–4659 (2018). https://doi.org/10.1007/s10489-018-1228-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-018-1228-9

Keywords

Navigation