Skip to main content
SpringerLink
Log in

Particle swarm optimization with convergence speed controller for large-scale numerical optimization

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Particle swarm optimization (PSO) has high convergence speed yet with its major drawback of premature convergence when solving large-scale optimization problems. We argue that it can be empowered by adaptively adjusting its convergence speed for the problems. In this paper, a convergence speed controller is proposed to improve the performance of PSO for large-scale optimization. As an additional operator of PSO, the controller is applied periodically and independently. It has two conditions and rules for adjusting the convergence speed of PSO, one for premature convergence and the other for slow convergence. The effectiveness of the PSO with convergence speed controller is evaluated by calculating the benchmark functions of CEC’2010. The numerical results indicate that the proposed controller helps PSO to keep a balance between convergence speed and swarm diversity during the optimization process. The results also support our argument that PSO can on average outperform other PSOs and cooperative coevolution methods for large-scale optimization when working with the convergence speed controller.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Afshar M (2012) Large scale reservoir operation by constrained particle swarm optimization algorithms. J Hydro Environ Res 6(1):75–87

    Article  MathSciNet  Google Scholar 

  • Akay B, Karaboga D (2012) Artificial bee colony algorithm for large-scale problems and engineering design optimization. J Intell Manuf 23(4):1001–1014

    Article  Google Scholar 

  • Atashpaz-Gargari E, Lucas C (2007) Imperialist competitive algorithm: an algorithm for optimization inspired by imperialistic competition. In: IEEE congress on evolutionary computation, 2007. CEC 2007. IEEE, pp 4661–4667

  • Basturk B, Karaboga D (2006) An artificial bee colony (abc) algorithm for numeric function optimization. In: IEEE swarm intelligence symposium, pp 12–14

  • Bratton D, Kennedy J (2007) Defining a standard for particle swarm optimization. In: Swarm Intelligence Symposium, 2007. SIS 2007. IEEE, pp 120–127

  • Brest J, Boskovic B, Zamuda A, Fister I, Maucec MS (2012) Self-adaptive differential evolution algorithm with a small and varying population size. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Brest J, Zamuda A, Fister I, Maucec MS (2010) Large scale global optimization using self-adaptive differential evolution algorithm. In: 2010 IEEE congress on evolutionary computation (CEC), pp 1–8. IEEE

  • Cai Z, Lv L, Huang H, Hu H, Liang Y (2017) Improving sampling-based image matting with cooperative coevolution differential evolution algorithm. Soft Comput 21(15):4417–4430

  • Chen WN, Zhang J, Lin Y, Chen N, Zhan ZH, Chung HSH, Li Y, Shi Yh (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evolut Comput 17(2):241–258

    Article  Google Scholar 

  • Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204

    Article  Google Scholar 

  • Cheng S, Shi Y, Qin Q (2012) Dynamical exploitation space reduction in particle swarm optimization for solving large scale problems. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Clerc M, Kennedy J (2002) The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evolut Comput 6(1):58–73

    Article  Google Scholar 

  • de Oca Montes MA, Aydın D, Stützle T (2011) An incremental particle swarm for large-scale continuous optimization problems: an example of tuning-in-the-loop (re) design of optimization algorithms. Soft Comput 15(11):2233–2255

    Article  Google Scholar 

  • Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, vol. 1, pp. 39–43. New York, NY

  • García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics 15(6):617–644

    Article  MATH  Google Scholar 

  • Ghodrati A, Malakooti MV, Soleimani M (2012) A hybrid ICA/PSO algorithm by adding independent countries for large scale global optimization. In: Intelligent information and database systems. Springer, pp 99–108

  • Gu S, Cheng R, Jin Y (2016) Feature selection for high-dimensional classification using a competitive swarm optimizer. Soft Comput 22(3): 811–822

  • Huang H, Qin H, Hao Z, Lim A (2012) Example-based learning particle swarm optimization for continuous optimization. Inf Sci 182(1):125–138

    Article  MathSciNet  MATH  Google Scholar 

  • Li X, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Trans Evolut Comput 16(2):210–224

    Article  Google Scholar 

  • Li X, Tang K, Omidvar MN, Yang Z, Qin K, China H (2013) Benchmark functions for the CEC 2013 special session and competition on large-scale global optimization. Gene 7:33

    Article  Google Scholar 

  • Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evolut Comput 10(3):281–295

    Article  Google Scholar 

  • Mahdavi S, Shiri ME, Rahnamayan S (2015) Metaheuristics in large-scale global continues optimization: a survey. Inf Sci 295:407–428

    Article  MathSciNet  Google Scholar 

  • Mei Y, Li X, Yao X (2014) Cooperative coevolution with route distance grouping for large-scale capacitated arc routing problems. IEEE Trans Evolut Comput 18(3):435–449

    Article  Google Scholar 

  • Molina D, Lozano M, Herrera F (2010) Ma-sw-chains: Memetic algorithm based on local search chains for large scale continuous global optimization. In: 2010 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: 2010 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Omidvar MN, Li X, Mei Y, Yao X (2014) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evolut Comput 18(3):378–393

    Article  Google Scholar 

  • Omidvar MN, Li X, Tang K (2015) Designing benchmark problems for large-scale continuous optimization. Inf Sci 316:419–436

    Article  Google Scholar 

  • Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: Parallel problem solving from nature PPSN III. Springer, pp 249–257

  • Ren Y, Wu Y (2013) An efficient algorithm for high-dimensional function optimization. Soft Comput 17(6):995–1004

    Article  Google Scholar 

  • Schmitt BI (2015) Convergence analysis for particle swarm optimization. FAU University Press, Boca Raton

    Google Scholar 

  • Schmitt M, Wanka R (2015) Particle swarm optimization almost surely finds local optima. Theor Comput Sci 561:57–72

    Article  MathSciNet  MATH  Google Scholar 

  • Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings, 1998. IEEE World Congress on Computational Intelligence, pp 69–73. IEEE

  • Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359

    Article  MathSciNet  MATH  Google Scholar 

  • Takahama T, Sakai S (2012) Large scale optimization by differential evolution with landscape modality detection and a diversity archive. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Tang K, Li X, Suganthan NP, Yang Z, Weise T (2009) Benchmark functions for the CEC 2010 special session and competition on large-scale global optimization. Technical report, University of Science and Technology of China

  • Tang K, Yáo X, Suganthan PN, MacNish C, Chen YP, Chen CM, Yang Z (2007) Benchmark functions for the CEC 2008 special session and competition on large scale global optimization. In: Nature Inspired Computation and Applications Laboratory, USTC, China

  • Tseng LY, Chen C (2008) Multiple trajectory search for large scale global optimization. In: IEEE congress on evolutionary computation, 2008. CEC 2008 (IEEE World Congress on Computational Intelligence). IEEE, pp 3052–3059

  • Van den Bergh F, Engelbrecht AP (2010) A convergence proof for the particle swarm optimiser. Fundam Inform 105(4):341–374

    MathSciNet  MATH  Google Scholar 

  • Van Den Bergh F (2006) An analysis of particle swarm optimizers. Ph.D. thesis, University of Pretoria

  • Vicini A, Quagliarella D (1999) Airfoil and wing design through hybrid optimization strategies. AIAA J 37(5):634–641

    Article  Google Scholar 

  • Wang H, Rahnamayan S, Wu Z (2011) Adaptive differential evolution with variable population size for solving high-dimensional problems. In: 2011 IEEE congress on evolutionary computation (CEC). IEEE, pp 2626–2632

  • Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999

    Article  MathSciNet  MATH  Google Scholar 

  • Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: IEEE congress on evolutionary computation, 2008. CEC 2008 (IEEE World Congress on Computational Intelligence). IEEE, pp 1663–1670

  • Zhang K, Li B (2012) Cooperative coevolution with global search for large scale global optimization. In: 2012 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–7

  • Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. In: IEEE congress on evolutionary computation, 2008. CEC 2008 (IEEE World Congress on Computational Intelligence). IEEE, pp 3845–3852

  • Zhao SZ, Suganthan PN, Das S (2010) Dynamic multi-swarm particle swarm optimizer with sub-regional harmony search. In: 2010 IEEE congress on evolutionary computation (CEC). IEEE, pp 1–8

  • Zhou A, Zhang Q (2016) Are all the subproblems equally important? resource allocation in decomposition-based multiobjective evolutionary algorithms. IEEE Trans Evol Comput 20(1):52–64

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by National Natural Science Foundation of China (61370102), Guangdong Natural Science Funds for Distinguished Young Scholar (2014A 030306050), the Ministry of Education—China Mobile Research Funds (MCM20160206) and Guangdong High-level personnel of special support program(2014TQ01X664).

Author information

Authors and Affiliations

  1. School of Software Engineering, South China University of Technology, Guangzhou, 510006, China

    Han Huang & Liang Lv

  2. Hong Kong Baptist University, Kowloon Tong, Hong Kong, China

    Shujin Ye

  3. Foshan University, Foshan, 528000, China

    Zhifeng Hao

Authors
  1. Han Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liang Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shujin Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhifeng Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shujin Ye.

Ethics declarations

Conflict of interest

All authors of this paper declare that we have no conflict of interest.

Human and animal rights

This paper does not contain any studies with human participants or animals. This paper has not been submitted to more than one journal and it has not been published previously.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, H., Lv, L., Ye, S. et al. Particle swarm optimization with convergence speed controller for large-scale numerical optimization. Soft Comput 23, 4421–4437 (2019). https://doi.org/10.1007/s00500-018-3098-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-018-3098-9

Keywords

Search

Navigation