ABSTRACT
The theory of swarm intelligence has made rapid progress in the last 5 years. Following a very successful line of research in evolutionary computation, various results on the computational complexity of swarm intelligence algorithms have appeared. These results shed light on the working principles of swarm intelligence algorithms, help to identify the impact of parameters and other design choices on performance, and contribute to a solid theoretical foundation of swarm intelligence.
This tutorial will give a comprehensive overview of theoretical results on swarm intelligence algorithms, with an emphasis on their computational complexity. In particular, it will be shown how techniques for the analysis of evolutionary algorithms can be used to analyze swarm intelligence algorithms and how the performance of swarm intelligence algorithms compares to that of evolutionary algorithms. The tutorial will be divided into a first, larger part on ant colony optimization (ACO) and a second, smaller part on particle swarm optimization (PSO).
For ACO we will consider simple variants of the MAX-MIN ant system. Investigations of example functions in pseudo-Boolean optimization demonstrate that the choice of the pheromone update strategy and the evaporation rate has a drastic impact on the running time, even for very simple functions like ONEMAX. We will also elaborate on the effect of using local search within the ACO framework. In terms of combinatorial optimization problems, we will look at the performance of ACO for minimum spanning trees, shortest path problems, and the TSP.
For particle swarm optimization, the tutorial will cover results on PSO for pseudo-Boolean optimization as well as a discussion of theoretical results in continuous spaces.
- N. Attiratanasunthron and J. Fakcharoenphol. A running time analysis of an ant colony optimization algorithm for shortest paths in directed acyclic graphs. Information Processing Letters, 105(3):88--92, 2008. Google ScholarDigital Library
- B. Doerr and D. Johannsen. Refined runtime analysis of a basic ant colony optimization algorithm. In Proceedings of the Congress of Evolutionary Computation (CEC '07), pages 501--507. IEEE Press, 2007.Google ScholarCross Ref
- B. Doerr, D. Johannsen, and C. H. Tang. How single ant ACO systems optimize pseudo-Boolean functions. In Parallel Problem Solving from Nature (PPSN X), pages 378--388. Springer, 2008. Google Scholar
- B. Doerr, F. Neumann, D. Sudholt, and C. Witt. Runtime analysis of the 1-ANT ant colony optimizer. Theoretical Computer Science, 412(17):1629--1644, 2011. Google ScholarDigital Library
- M. Dorigo and C. Blum. Ant colony optimization theory: A survey. Theoretical Computer Science, 344:243--278, 2005. Google ScholarDigital Library
- M. Dorigo and T. Stützle. Ant Colony Optimization. MIT Press, 2004. Google ScholarDigital Library
- %M. Englert, H. Röglin, and B. Vöcking. Worst case and probabilistic analysis of the 2-Opt algorithm for the TSP. In Proceedings of the 18th ACM-SIAM Symposium on Discrete Algorithms (SODA), pages 1295--1304, 2007. Google ScholarDigital Library
- W. J. Gutjahr. On the finite-time dynamics of ant colony optimization. Methodology and Computing in Applied Probability, 8:105--133, 2006.Google ScholarDigital Library
- W. J. Gutjahr. Mathematical runtime analysis of ACO algorithms: Survey on an emerging issue. Swarm Intelligence, 1:59--79, 2007.Google ScholarCross Ref
- W. J. Gutjahr. First steps to the runtime complexity analysis of ant colony optimization. Computers and Operations Research, 35(9):2711--2727, 2008. Google ScholarDigital Library
- W. J. Gutjahr. Ant colony optimization: recent developments in theoretical analysis. In Theory of Randomized Search Heuristics--Foundations and Recent Developments. World Scientific Publishing, 2011.Google Scholar
- W. J. Gutjahr and G. Sebastiani. Runtime analysis of ant colony optimization with best-so-far reinforcement. Methodology and Computing in Applied Probability, 10:409--433, 2008.Google ScholarDigital Library
- C. Horoba and D. Sudholt. Running time analysis of ACO systems for shortest path problems. In Proceedings of Engineering Stochastic Local Search Algorithms (SLS '09), volume 5752 of LNCS, pages 76--91. Springer, 2009. Google Scholar
- C. Horoba and D. Sudholt. Ant colony optimization for stochastic shortest path problems. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2010), pages 1465--1472, 2010. Google ScholarDigital Library
- J. Kennedy and R. C. Eberhart. Particle swarm optimization. In Proceedings of the IEEE International Conference on Neural Networks, pages 1942--1948. IEEE Press, 1995.Google ScholarCross Ref
- J. Kennedy and R. C. Eberhart. A discrete binary version of the particle swarm algorithm. In Proceedings of the World Multiconference on Systemics, Cybernetics and Informatics (WMSCI), pages 4104--4109, 1997.Google ScholarCross Ref
- J. Kennedy, R. C. Eberhart, and Y. Shi. Swarm Intelligence. Morgan Kaufmann, 2001. Google ScholarDigital Library
- T. Kötzing, P. K. Lehre, P. S. Oliveto, and F. Neumann. Ant colony optimization and the minimum cut problem. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '10), pages 1393--1400. ACM, 2010. Google ScholarDigital Library
- T. Kötzing, F. Neumann, H. Röglin, and C. Witt. Theoretical properties of two ACO approaches for the traveling salesman problem. In Seventh International Conference on Ant Colony Optimization and Swarm Intelligence (ANTS 2010), volume 6234 of LNCS, pages 324--335. Springer, 2010. Google ScholarDigital Library
- T. Kötzing, F. Neumann, D. Sudholt, and M. Wagner. Simple Max-Min ant systems and the optimization of linear pseudo-Boolean functions. In Proceedings of the eleventh workshop on Foundations of Genetic Algorithms (FOGA 2011). ACM Press, 2011, to appear. Google ScholarDigital Library
- F. Neumann, D. Sudholt, and C. Witt. Rigorous analyses for the combination of ant colony optimization and local search. In Proceedings of the Sixth International Conference on Ant Colony Optimization and Swarm Intelligence (ANTS '08), volume 5217 of LNCS, pages 132--143. Springer, 2008. Google ScholarDigital Library
- F. Neumann, D. Sudholt, and C. Witt. Analysis of different MMAS ACO algorithms on unimodal functions and plateaus. Swarm Intelligence, 3(1):35--68, 2009.Google ScholarCross Ref
- F. Neumann, D. Sudholt, and C. Witt. Computational complexity of ant colony optimization and its hybridization with local search. In C. P. Lim, L. C. Jain, and S. Dehuri, editors, Innovations in Swarm Intelligence, number 248 in SGI. Springer, 2009.Google Scholar
- F. Neumann, D. Sudholt, and C. Witt. A few ants are enough: ACO with iteration-best update. In Genetic and Evolutionary Computation Conference (GECCO '10), pages 63--70, 2010. Google ScholarDigital Library
- F. Neumann and C. Witt.% Runtime analysis of a simple ant colony optimization algorithm. In Proceedings of the 17th International Symposium on Algorithms and Computation (ISAAC '06), volume 4288 of LNCS, pages 618--627. Springer, 2006. Google ScholarDigital Library
- F. Neumann and C. Witt. Ant Colony Optimization and the minimum spanning tree problem. In Proceedings of Learning and Intelligent Optimization (LION '07), volume 5313 of LNCS, pages 153--166. Springer, 2008. Google Scholar
- F. Neumann and C. Witt. Runtime analysis of a simple ant colony optimization algorithm. Algorithmica, 54(2):243--255, 2009. Google ScholarDigital Library
- T. Stützle and H. H. Hoos. MAX-MIN ant system. Journal of Future Generation Computer Systems, 16:889--914, 2000. Google ScholarDigital Library
- D. Sudholt and C. Witt. Runtime analysis of Binary PSO. In Proceedings of the Genetic and Evolutionary Computation% Conference (GECCO '08), pages 135--142. ACM Press, 2008. Google ScholarDigital Library
- D. Sudholt. Using Markov-chain mixing time estimates for the analysis of ant colony optimization. In Proceedings of the eleventh workshop on Foundations of Genetic Algorithms (FOGA 2011). ACM Press, 2011, to appear. Google ScholarDigital Library
- D. Sudholt and C. Witt. Runtime analysis of a binary particle swarm optimizer. Theoretical Computer Science, 411(21):2084--2100, 2010. Google ScholarDigital Library
- C. Witt. Rigorous runtime analysis of swarm intelligence algorithms - an overview. In Swarm Intelligence for Multi-objective Problems in Data Mining, number 242 in Studies in Computational Intelligence (SCI), pages 157--177. Springer, 2009.Google Scholar
- C. Witt. Why standard particle swarm optimisers elude a theoretical runtime analysis. In Foundations of Genetic Algorithms 10 (FOGA '09), pages 13--20. ACM Press, 2009. Google Scholar
- C. Witt. Theory of particle swarm optimization. In Theory of Randomized Search Heuristics--Foundations and Recent Developments. World Scientific Publishing, 2011.Google Scholar
- Y. Zhou. Runtime analysis of an ant colony optimization algorithm for TSP instances. IEEE Transactions on Evolutionary Computation, 13(5):1083--1092, 2009. Google ScholarDigital Library
Index Terms
- Theory of swarm intelligence
Recommendations
Theory of swarm intelligence
GECCO Comp '14: Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary ComputationSocial animals as found in fish schools, bird flocks, bee hives, and ant colonies are able to solve highly complex problems in nature. This includes foraging for food, constructing astonishingly complex nests, and evading or defending against predators. ...
Theory of Swarm Intelligence
GECCO Companion '15: Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary ComputationSocial animals as found in fish schools, bird flocks, bee hives, and ant colonies are able to solve highly complex problems in nature. This includes foraging for food, constructing astonishingly complex nests, and evading or defending against predators. ...
Theory of Swarm Intelligence
GECCO '16 Companion: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference CompanionSocial animals as found in fish schools, bird flocks, bee hives, and ant colonies are able to solve highly complex problems in nature. This includes foraging for food, constructing astonishingly complex nests, and evading or defending against predators. ...
Comments