Skip to main content
Log in

Novel inertia weight strategies for particle swarm optimization

  • Regular research paper
  • Published:
Memetic Computing Aims and scope Submit manuscript

Abstract

The performance of PSO algorithm depends greatly on the appropriate parameter selection strategies for fine tuning its parameters. This paper proposes three new nonlinear strategies for selecting inertia weight which plays a significant role in particle’s foraging behaviour. The PSO variants implying these strategies are named as: fine grained inertia weight PSO (FGIWPSO); Double Exponential Self Adaptive IWPSO (DESIWPSO) and Double Exponential Dynamic IWPSO (DEDIWPSO). In FGIWPSO, inertia weight is obtained adaptively, depending on particle’s iteration wise performance and decreases exponentially. DESIWPSO and DEDIWPSO employ Gompertz function, a double exponential function for selecting inertia weight. In DESIWPSO the particles’ iteration wise performance is fed as input to the Gompertz function. On the other hand DEDIWPSO evaluates the inertia weight for whole swarm iteratively using Gompertz function where relative iteration is fed as input. The efficacy and efficiency of proposed approaches is validated on a suite of benchmark functions. The proposed variants are compared with non linear inertia weight and exponential inertia weight strategies. Experimental results assert that the proposed modifications help in improving PSO performance in terms of solution quality as well as convergence rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Alireza A (2011) PSO with adaptive mutation and inertia weight and its application in parameter estimation of dynamic systems. Acta Automatica Sinica 37:541–549

    MATH  Google Scholar 

  2. Arumugam MS, Rao, MCV (2006) On the performance of the particle swarm optimization algorithm with various inertia weight variants for computing optimal control of a class of hybrid systems. Int J Discrete Dyn Nat Soc pp 1–17

  3. Bansal JC, Singh PK, Saraswat M, Verma A, Jadon SS, Abraham A (2011) Inertia weight strategies in particle swarm optimization. In: Proceedings of third world congress on nature and biologically inspired computing (NaBIC-2011), pp 633–640

  4. Chatterjee A, Siarry P (2006) Nonlinear Inertia weight variation for dynamic adaption in Particle swarm optimization. In: Computers and operation research, vol 33, Elsevier, Amsterdam, pp 859–871

  5. Chen G, Huang X, Jia J, Min Z (2006) Natural exponential Inertia weight strategy in particle swarm optimization. In: Proceedings of 6th world congress on intelligent control, pp 3672–3675

  6. Chen JY, Shen JJ (2012) Structure learning of Bayesian Network using a Chaos-based PSO. Adv Mater Res pp 2292–2295

  7. Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. Proc IEEE Congr Evol Comput 3:1951–1957

    Google Scholar 

  8. Clerc M (2001) Think locally, act locally: the way of life of cheap-PSO. An Adaptive PSO, Technical report, http://clerc.maurice.free.fr/pso/

  9. Dash PK, Mallick RK (2011) Accurate tracking of harmonic signals in VSC-HVDC systems using PSO based unscented transformation. Int J Elec Power Energy Syst 33(7):1315–1325

    Article  Google Scholar 

  10. Deep K, Arya M, Bansal JC (2011) A non-deterministic adaptive inertia weight in PSO. In: Proceedings of 13th annual conference on genetic and evolutionary computation (GECCO-2011). ACM, New York, pp 1155–1162

  11. Demsar J (2006) Statiscally comparisons of classifier over multiple date set. J Mach Learn Res 7:1–30

    MathSciNet  MATH  Google Scholar 

  12. Derrac J, García SR, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Article  Google Scholar 

  13. Dong C, Wang G, Chen Z (2008a) The inertia weight self-adapting in PSO. In: Proceedings of 7th world congress on intelligent control and automation (WCICA-2008), pp 5313–5316

  14. Dong C, Wang G, Chen Z, Yu Z (2008b) A method of self-adaptive inertia weight for PSO. CSSE 1:1195–1198

    Google Scholar 

  15. Eberhart RC, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. Proc IEEE Congr Evol Comput 1:84–88

    Google Scholar 

  16. Ememipour J, Nejad MMS, Ebadzadeh MM, Rezanejad J (2009) Introduce a new inertia weight for particle swarm optimization. In: Proceedings of fourth international conference on computer sciences and convergence information technology (ICCIT-2009). pp 1650–1653

  17. Fei C, Ding F, Zhao X (2012) Network partition of switched industrial ethernet by using novel particle swarm optimization. Physics Procedia Part B 24:1493–1499

    Article  Google Scholar 

  18. Feng CS, Cong S, Feng XY (2007a) A new adaptive inertia weight strategy in particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, (CEC-2007). pp 4186–4190

  19. Feng Y, Teng G, Wang A, Yao YM (2007b) Chaotic inertia weight in particle swarm optimization. In: Proceedings of second international conference on innovative computing, information and control (ICICIC-2007), pp 475–478

  20. Feng Y, Yao YM, Wang A (2007c) Comparing with chaotic inertia weights in particle swarm optimization. In: Proceedings of international conference on machine learning and cybernetics, pp 329–333

  21. Ghali I, El-Dessouki N, Mervat AN, Bakrawi L (2009) Exponential particle swarm optimization approach for improving data clustering. Int J Electr Electron Eng 3–4:208–212

    Google Scholar 

  22. Hashim SZM, Permana KE (2009) Fitting membership function with PSO inertia weight for truck backer-upper problem. In: Proceedings Third Asia international conference on modelling and simulation. pp 25–28

  23. Hu JZ, Xu J, Wang JQ, Xu T (2009) Research on particle swarm optimization with dynamic inertia weight. In: Proceedings Iiternational conference on management and service science, China, pp 1–4

  24. JianXin W, WenZHi L, WeiGuo Z, Qiang L (2008) Exponential type adaptive inertia weighted particle swarm optimization algorithm. In: Proceedings of 2nd international conference on genetic and evolutionary computing, (WGEC-2008). IEEE Computer Society, pp 79–82

  25. Jiao B, Lian Z, Gu X (2008) A dynamic inertia weight particle swarm optimization algorithm. Chaos Solitons Fractals 37:698–705

    Article  MATH  Google Scholar 

  26. Kennedy J, Mendes R (2002) Population structure and particle performance. In: Proceedings IEEE congress on evolutionary computation, pp 1671–1676

  27. Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. Proc IEEE Congr Evol Comput 3:1931–1938

    Google Scholar 

  28. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings IEEE international joint conference on neural networks, pp 1942–1948

  29. Kumar P, Pant M (2012) Enhanced mutation strategy for differential evolution. In: IEEE Congress on Evolutionary Computation (CEC), pp 1–6, 10–15

  30. Li R, Gao YL (2009) Particle swarm optimization algorithm with exponent decreasing inertia weight and stochastic mutation. In: Proceedings of second international conference on information and computing science, vol 1, pp 66–69

  31. Liu C, Ouyang C, Zhu P, Tang W, (2010) An adaptive fuzzy weight PSO algorithm. In: Proceedings of fourth international conference on genetic and evolutionary computing, pp 8–10

  32. Miaomiao W, Yuelin G (2010) A new particle swarm optimization with dynamically adaptive inertia weight and hybrid mutation. Comput Appl Softw 27(6):70–72

    Google Scholar 

  33. Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization with adaptive inertia weight. Appl Soft Comput 11:3658–3670

    Article  Google Scholar 

  34. Pant M, Thangraj R, Singh VP (2007) Particle swarm optimization using Gaussian inertia weight. In: Proceedings of international conference on computational intelligence and multimedia applications, vol 1, pp 97–102

  35. Peer ES, Van den Bergh F, Engelbrecht AP (2003) Using neighborhoods with the guaranteed convergence PSO. In: Proceedings of IEEE swarm intelligence symposium, pp 235–242

  36. Peram T, Veeramachaneni K, Mohan CK (2003) Fitness-distance-ratio based particle swarm optimization. In: Proceedings of IEEE swarm intelligence symposium, pp 174–181

  37. Ratnaweera A, Halgamuge S, Watson H (2003) Particle swarm optimization with self-adaptive acceleration coefficients. In: Proceedings of first international conference on fuzzy systems and knowledge discovery, pp 264–268

  38. Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of the congress on evolutionary computation (CEC-1999), vol 3, pp 1945–1950

  39. Shi Y, Eberhart RC (2001) Fuzzy adaptive particle swarm optimization. Proc IEEE Congr Evol Comput 1:101–106

    Google Scholar 

  40. Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: Proceedings of seventh annual conference on evolutionary programming, pp 591–600

  41. Suganthan PN (1999) Particle swarm optimiser with neighborhood operator. In: Proceedings of IEEE congress on evolutionary computation, pp 1958–1962

  42. Sun X, Zhou DW, Zhang XW (2010) Convergence analysis and parameter selection of PSO model with inertia weight. Comput Eng Design 31:4068–4071

    Google Scholar 

  43. Suresh K, Ghosh S, Kundu D, Sen A, Das S, Abraham A (2008) Inertia-adaptive particle swarm optimizer for improved global search. In: Proceedings of eighth international conference on intelligent systems design and applications (ISDA-2008), vol 2, pp 253–258

  44. Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325

    Article  MathSciNet  MATH  Google Scholar 

  45. Uma SM, Gandhi RK, Kirubakaran E (2012) A hybrid PSO with dynamic inertia weight and GA approach for discovering classification rule in data mining. Int J Comput Appl 40(17):32–37

    Google Scholar 

  46. Umapathy P, Venkataseshaiah C, Arumugam MS (2010) Particle swarm optimization with various inertia weight variants for optimal power flow solution. Discrete Dyn Nat Soc pp 1–15

  47. Venter G, Sobieszczanski-Sobieski J (2003) Particle swarm optimization. J Am Inst Aeronaut Astronaut 41(8):1583–1589

    Google Scholar 

  48. Wang W, Qiu L (2010) Optimal reservoir operation using PSO with adaptive random inertia weight. In: Proceedings of international conference on artificial intelligence and computational intelligence, vol 3, pp 377–381. doi:10.1109/AICI.2010.316

  49. Wang XLQ, Liu H, Li L (2009) Particle swarm optimization with dynamic inertia weight and mutation. In: Proceedings of third international conference on genetic and evolutionary computing, China, pp 620–623

  50. Wang XL, Yang Y, Zeng Q, Wang JQ (2010) Particle swarm optimization with adaptive inertia weight and its application in optimization design. Adv Mater Res 97–101:3484–3488

    Article  Google Scholar 

  51. Xin WJ, Zhi LW, Guo ZW, Qiang L (2008) Exponential type adaptive inertia weighted particle swarm optimization algorithm. In: Proceedings of second international conference on genetic and evolutionary computing, pp 79–82

  52. Yang H, Cheng YH, Chuang LY (2010) A novel chaotic inertia weight particle swarm optimization for PCR primer design. In: Proceedings of international conference on technologies and applications of artificial intelligence, pp 373–378

  53. Yang X, Yuan J, Mao H (2007) A modified particle swarm optimizer with dynamic adaption. Appl MathComput 189:1205–1213

    MathSciNet  MATH  Google Scholar 

  54. Yoshida H, Fukuyama Y, Takayama S, Nakanishi Y (1999) A particle swarm optimization for reactive power and voltage control in electric power systems considering voltage security assessment. In: Proceedings of IEEE international conference on systems, man, and cybernetics, vol 6, pp 497–502

  55. Zheng Q, Fan Y, Zhewen S, Yu W (2006) Adaptive inertia weight particle swarm optimization, Artificial Intelligence and Soft Computing (ICAISC-2006). In: Lecture notes in computer science, vol 4029. Springer, Berlin, pp 450–459

  56. Zhou Z, Shi Y (2011) Inertia weight adaption in particle swarm optimization algorithm. Advances in swarm intelligence. In: Lecture notes in computer science, vol 6728, pp 71–79

  57. Zhu H, Zheng C, Hu X, Li X (2008) Adaptive PSO using random inertia weight and its application in UAV path planning. In: Proceedings of seventh international symposium on instrumentation and control technology: measurement theory and systems and aeronautical equipment (SPIE), vol 7128, pp 1–5

Download references

Acknowledgments

This work was financially supported by Ministry of Human Resources, New Delhi, India

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pinkey Chauhan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chauhan, P., Deep, K. & Pant, M. Novel inertia weight strategies for particle swarm optimization. Memetic Comp. 5, 229–251 (2013). https://doi.org/10.1007/s12293-013-0111-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12293-013-0111-9

Keywords

Navigation