Abstract
Particle swarm optimisation is a metaheuristic algorithm which finds reasonable solutions in a wide range of applied problems if suitable parameters are used. We study the properties of the algorithm in the framework of random dynamical systems (RDS) which, due to the quasi-linear swarm dynamics, yields exact analytical results for the stability properties in the single particle case. The calculated stability region in the parameter space extends beyond the region determined by earlier approximations. This is also evidenced by simulations which indicate that the algorithm performs best in the asymptotic case if parameterised near the margin of instability predicted by the RDS approach.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bonyadi, M.R., Michalewicz, Z.: Particle swarm optimization for single objective continuous space problems: a review. Evol. Comput (2016). doi:10.1162/EVCO_r_00180
Cleghorn, C.W., Engelbrecht, A.P.: A generalized theoretical deterministic particle swarm model. Swarm Intell. 8(1), 35–59 (2014)
Cleghorn, C.W., Engelbrecht, A.P.: Particle swarm convergence: an empirical investigation. In: IEEE Congress on Evolutionary Computation, pp. 2524–2530 (2014)
Clerc, M., Kennedy, J.: The particle swarm-explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)
Erskine, A., Herrmann, J.M.: Cell-division behavior in a heterogeneous swarm environment. Artif. Life 21(4), 481–500 (2015)
Erskine, A., Herrmann, J.M.: CriPS: Critical particle swarm optimisation. In: Andrews, P., Caves, L., Doursat, R., Hickinbotham, S., Polack, F., Stepney, S., Taylor, T., Timmis, J. (eds.) Proceedings of European Conference Artificial Life, pp. 207–214 (2015)
Furstenberg, H., Kesten, H.: Products of random matrices. Ann. Math. Stat. 31(2), 457–469 (1960)
Gazi, V.: Stochastic stability analysis of the particle dynamics in the PSO algorithm. In: IEEE International Symposium on Intelligent Control (2012)
Hu, M., Wu, T.F., Weir, J.D.: An adaptive particle swarm optimization with multiple adaptive methods. IEEE Trans. Evol. Comput. 17(5), 705–720 (2013)
Jiang, M., Luo, Y., Yang, S.: Stagnation analysis in particle swarm optimization. In: IEEE Swarm Intelligence Symposium, pp. 92–99 (2007)
Kadirkamanathan, V., Selvarajah, K., Fleming, P.J.: Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Trans. Evol. Comput. 10(3), 245–255 (2006)
Kennedy, J.: The behavior of particles. In: Porto, V.W., Saravanan, N., Waagen, D., Eiben, A.E. (eds.) Evolutionary Programming VII. LNCS, vol. 1447, pp. 579–589. Springer, Heidelberg (1998)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948 (1995)
Khas’minskii, R.Z.: Necessary and sufficient conditions for the asymptotic stability of linear stochastic systems. Theory Prob. Appl. 12(1), 144–147 (1967)
Liang, J.J., Qu, B.Y., Suganthan, P.N., Hernández-DÃaz, A.G.: Problem definitions and evaluation criteria for the CEC 2013 special session on real-parameter optimization. Technical report, 201212, Comput. Intelligence Lab., Zhengzhou Univ. (2013)
Liu, Q.: Order-2 stability analysis of particle swarm optimization. Evol. Comput. 23(2), 187–216 (2014)
Poli, R.: Mean and variance of the sampling distribution of particle swarm optimizers during stagnation. IEEE Trans. Evol. Comput. 13(4), 712–721 (2009)
Poli, R., Broomhead, D.: Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation. In: Proceedings of the 9th Annual Conference Genetic and Evolutionary Computation, pp. 134–141. ACM (2007)
Trelea, I.C.: The particle swarm optimization algorithm: convergence analysis and parameter selection. Inf. Process. Lett. 85(6), 317–325 (2003)
Zhan, Z.H., Zhang, J., Li, Y., Chung, H.S.H.: Adaptive particle swarm optimization. IEEE Trans. Syst. Man Cybern. B 39(6), 1362–1381 (2009)
Acknowledgments
This work was supported by the Engineering and Physical Sciences Research Council (EPSRC), grant number EP/K503034/1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Erskine, A., Joyce, T., Herrmann, J.M. (2016). Parameter Selection in Particle Swarm Optimisation from Stochastic Stability Analysis. In: Dorigo, M., et al. Swarm Intelligence. ANTS 2016. Lecture Notes in Computer Science(), vol 9882. Springer, Cham. https://doi.org/10.1007/978-3-319-44427-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-44427-7_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44426-0
Online ISBN: 978-3-319-44427-7
eBook Packages: Computer ScienceComputer Science (R0)