Abstract
The performance of PSO algorithm depends greatly on the appropriate parameter selection strategies for fine tuning its parameters. This paper proposes three new nonlinear strategies for selecting inertia weight which plays a significant role in particle’s foraging behaviour. The PSO variants implying these strategies are named as: fine grained inertia weight PSO (FGIWPSO); Double Exponential Self Adaptive IWPSO (DESIWPSO) and Double Exponential Dynamic IWPSO (DEDIWPSO). In FGIWPSO, inertia weight is obtained adaptively, depending on particle’s iteration wise performance and decreases exponentially. DESIWPSO and DEDIWPSO employ Gompertz function, a double exponential function for selecting inertia weight. In DESIWPSO the particles’ iteration wise performance is fed as input to the Gompertz function. On the other hand DEDIWPSO evaluates the inertia weight for whole swarm iteratively using Gompertz function where relative iteration is fed as input. The efficacy and efficiency of proposed approaches is validated on a suite of benchmark functions. The proposed variants are compared with non linear inertia weight and exponential inertia weight strategies. Experimental results assert that the proposed modifications help in improving PSO performance in terms of solution quality as well as convergence rate.













Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Alireza A (2011) PSO with adaptive mutation and inertia weight and its application in parameter estimation of dynamic systems. Acta Automatica Sinica 37:541–549
Arumugam MS, Rao, MCV (2006) On the performance of the particle swarm optimization algorithm with various inertia weight variants for computing optimal control of a class of hybrid systems. Int J Discrete Dyn Nat Soc pp 1–17
Bansal JC, Singh PK, Saraswat M, Verma A, Jadon SS, Abraham A (2011) Inertia weight strategies in particle swarm optimization. In: Proceedings of third world congress on nature and biologically inspired computing (NaBIC-2011), pp 633–640
Chatterjee A, Siarry P (2006) Nonlinear Inertia weight variation for dynamic adaption in Particle swarm optimization. In: Computers and operation research, vol 33, Elsevier, Amsterdam, pp 859–871
Chen G, Huang X, Jia J, Min Z (2006) Natural exponential Inertia weight strategy in particle swarm optimization. In: Proceedings of 6th world congress on intelligent control, pp 3672–3675
Chen JY, Shen JJ (2012) Structure learning of Bayesian Network using a Chaos-based PSO. Adv Mater Res pp 2292–2295
Clerc M (1999) The swarm and the queen: towards a deterministic and adaptive particle swarm optimization. Proc IEEE Congr Evol Comput 3:1951–1957
Clerc M (2001) Think locally, act locally: the way of life of cheap-PSO. An Adaptive PSO, Technical report, http://clerc.maurice.free.fr/pso/
Dash PK, Mallick RK (2011) Accurate tracking of harmonic signals in VSC-HVDC systems using PSO based unscented transformation. Int J Elec Power Energy Syst 33(7):1315–1325
Deep K, Arya M, Bansal JC (2011) A non-deterministic adaptive inertia weight in PSO. In: Proceedings of 13th annual conference on genetic and evolutionary computation (GECCO-2011). ACM, New York, pp 1155–1162
Demsar J (2006) Statiscally comparisons of classifier over multiple date set. J Mach Learn Res 7:1–30
Derrac J, García SR, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18
Dong C, Wang G, Chen Z (2008a) The inertia weight self-adapting in PSO. In: Proceedings of 7th world congress on intelligent control and automation (WCICA-2008), pp 5313–5316
Dong C, Wang G, Chen Z, Yu Z (2008b) A method of self-adaptive inertia weight for PSO. CSSE 1:1195–1198
Eberhart RC, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. Proc IEEE Congr Evol Comput 1:84–88
Ememipour J, Nejad MMS, Ebadzadeh MM, Rezanejad J (2009) Introduce a new inertia weight for particle swarm optimization. In: Proceedings of fourth international conference on computer sciences and convergence information technology (ICCIT-2009). pp 1650–1653
Fei C, Ding F, Zhao X (2012) Network partition of switched industrial ethernet by using novel particle swarm optimization. Physics Procedia Part B 24:1493–1499
Feng CS, Cong S, Feng XY (2007a) A new adaptive inertia weight strategy in particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, (CEC-2007). pp 4186–4190
Feng Y, Teng G, Wang A, Yao YM (2007b) Chaotic inertia weight in particle swarm optimization. In: Proceedings of second international conference on innovative computing, information and control (ICICIC-2007), pp 475–478
Feng Y, Yao YM, Wang A (2007c) Comparing with chaotic inertia weights in particle swarm optimization. In: Proceedings of international conference on machine learning and cybernetics, pp 329–333
Ghali I, El-Dessouki N, Mervat AN, Bakrawi L (2009) Exponential particle swarm optimization approach for improving data clustering. Int J Electr Electron Eng 3–4:208–212
Hashim SZM, Permana KE (2009) Fitting membership function with PSO inertia weight for truck backer-upper problem. In: Proceedings Third Asia international conference on modelling and simulation. pp 25–28
Hu JZ, Xu J, Wang JQ, Xu T (2009) Research on particle swarm optimization with dynamic inertia weight. In: Proceedings Iiternational conference on management and service science, China, pp 1–4
JianXin W, WenZHi L, WeiGuo Z, Qiang L (2008) Exponential type adaptive inertia weighted particle swarm optimization algorithm. In: Proceedings of 2nd international conference on genetic and evolutionary computing, (WGEC-2008). IEEE Computer Society, pp 79–82
Jiao B, Lian Z, Gu X (2008) A dynamic inertia weight particle swarm optimization algorithm. Chaos Solitons Fractals 37:698–705
Kennedy J, Mendes R (2002) Population structure and particle performance. In: Proceedings IEEE congress on evolutionary computation, pp 1671–1676
Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. Proc IEEE Congr Evol Comput 3:1931–1938
Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings IEEE international joint conference on neural networks, pp 1942–1948
Kumar P, Pant M (2012) Enhanced mutation strategy for differential evolution. In: IEEE Congress on Evolutionary Computation (CEC), pp 1–6, 10–15
Li R, Gao YL (2009) Particle swarm optimization algorithm with exponent decreasing inertia weight and stochastic mutation. In: Proceedings of second international conference on information and computing science, vol 1, pp 66–69
Liu C, Ouyang C, Zhu P, Tang W, (2010) An adaptive fuzzy weight PSO algorithm. In: Proceedings of fourth international conference on genetic and evolutionary computing, pp 8–10
Miaomiao W, Yuelin G (2010) A new particle swarm optimization with dynamically adaptive inertia weight and hybrid mutation. Comput Appl Softw 27(6):70–72
Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization with adaptive inertia weight. Appl Soft Comput 11:3658–3670
Pant M, Thangraj R, Singh VP (2007) Particle swarm optimization using Gaussian inertia weight. In: Proceedings of international conference on computational intelligence and multimedia applications, vol 1, pp 97–102
Peer ES, Van den Bergh F, Engelbrecht AP (2003) Using neighborhoods with the guaranteed convergence PSO. In: Proceedings of IEEE swarm intelligence symposium, pp 235–242
Peram T, Veeramachaneni K, Mohan CK (2003) Fitness-distance-ratio based particle swarm optimization. In: Proceedings of IEEE swarm intelligence symposium, pp 174–181
Ratnaweera A, Halgamuge S, Watson H (2003) Particle swarm optimization with self-adaptive acceleration coefficients. In: Proceedings of first international conference on fuzzy systems and knowledge discovery, pp 264–268
Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of the congress on evolutionary computation (CEC-1999), vol 3, pp 1945–1950
Shi Y, Eberhart RC (2001) Fuzzy adaptive particle swarm optimization. Proc IEEE Congr Evol Comput 1:101–106
Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: Proceedings of seventh annual conference on evolutionary programming, pp 591–600
Suganthan PN (1999) Particle swarm optimiser with neighborhood operator. In: Proceedings of IEEE congress on evolutionary computation, pp 1958–1962
Sun X, Zhou DW, Zhang XW (2010) Convergence analysis and parameter selection of PSO model with inertia weight. Comput Eng Design 31:4068–4071
Suresh K, Ghosh S, Kundu D, Sen A, Das S, Abraham A (2008) Inertia-adaptive particle swarm optimizer for improved global search. In: Proceedings of eighth international conference on intelligent systems design and applications (ISDA-2008), vol 2, pp 253–258
Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf Process Lett 85(6):317–325
Uma SM, Gandhi RK, Kirubakaran E (2012) A hybrid PSO with dynamic inertia weight and GA approach for discovering classification rule in data mining. Int J Comput Appl 40(17):32–37
Umapathy P, Venkataseshaiah C, Arumugam MS (2010) Particle swarm optimization with various inertia weight variants for optimal power flow solution. Discrete Dyn Nat Soc pp 1–15
Venter G, Sobieszczanski-Sobieski J (2003) Particle swarm optimization. J Am Inst Aeronaut Astronaut 41(8):1583–1589
Wang W, Qiu L (2010) Optimal reservoir operation using PSO with adaptive random inertia weight. In: Proceedings of international conference on artificial intelligence and computational intelligence, vol 3, pp 377–381. doi:10.1109/AICI.2010.316
Wang XLQ, Liu H, Li L (2009) Particle swarm optimization with dynamic inertia weight and mutation. In: Proceedings of third international conference on genetic and evolutionary computing, China, pp 620–623
Wang XL, Yang Y, Zeng Q, Wang JQ (2010) Particle swarm optimization with adaptive inertia weight and its application in optimization design. Adv Mater Res 97–101:3484–3488
Xin WJ, Zhi LW, Guo ZW, Qiang L (2008) Exponential type adaptive inertia weighted particle swarm optimization algorithm. In: Proceedings of second international conference on genetic and evolutionary computing, pp 79–82
Yang H, Cheng YH, Chuang LY (2010) A novel chaotic inertia weight particle swarm optimization for PCR primer design. In: Proceedings of international conference on technologies and applications of artificial intelligence, pp 373–378
Yang X, Yuan J, Mao H (2007) A modified particle swarm optimizer with dynamic adaption. Appl MathComput 189:1205–1213
Yoshida H, Fukuyama Y, Takayama S, Nakanishi Y (1999) A particle swarm optimization for reactive power and voltage control in electric power systems considering voltage security assessment. In: Proceedings of IEEE international conference on systems, man, and cybernetics, vol 6, pp 497–502
Zheng Q, Fan Y, Zhewen S, Yu W (2006) Adaptive inertia weight particle swarm optimization, Artificial Intelligence and Soft Computing (ICAISC-2006). In: Lecture notes in computer science, vol 4029. Springer, Berlin, pp 450–459
Zhou Z, Shi Y (2011) Inertia weight adaption in particle swarm optimization algorithm. Advances in swarm intelligence. In: Lecture notes in computer science, vol 6728, pp 71–79
Zhu H, Zheng C, Hu X, Li X (2008) Adaptive PSO using random inertia weight and its application in UAV path planning. In: Proceedings of seventh international symposium on instrumentation and control technology: measurement theory and systems and aeronautical equipment (SPIE), vol 7128, pp 1–5
Acknowledgments
This work was financially supported by Ministry of Human Resources, New Delhi, India
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chauhan, P., Deep, K. & Pant, M. Novel inertia weight strategies for particle swarm optimization. Memetic Comp. 5, 229–251 (2013). https://doi.org/10.1007/s12293-013-0111-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12293-013-0111-9