ABSTRACT
This paper presents an evolutionary computing based approach to automatically synthesise swarm behavioural rules from their atomic components, thus making a step forward in trying to mitigate human bias from the rule generation process, and leverage the full potential of swarm systems in the real world by modelling more complex behaviours. We identify four components that make-up the structure of a rule: control structures, parameters, logical/relational connectives and preliminary actions, which form the rule space for the proposed approach. A boids simulation system is employed to evaluate the approach with grammatical evolution and genetic programming techniques using the rule space determined. While statistical analysis of the results demonstrates that both methods successfully evolve desired complex behaviours from their atomic components, the grammatical evolution model shows more potential in generating complex behaviours in a modularised approach. Furthermore, an analysis of the structure of the evolved rules implies that the genetic programming approach only derives non-reusable rules composed of a group of actions that is combined to result in emergent behaviour. In contrast, the grammatical evolution approach synthesises sound and stable behavioural rules which can be extracted and reused, hence making it applicable in complex application domains where manual design is infeasible.
Supplemental Material
Available for Download
Supplemental files.
- Adrian Agogino and Kagan Turner. 2005. Reinforcement learning in large multi-agent systems. In AAMAS-05 Workshop on Coordination of Large Scale Multi-Agent Systems. Utrecht, Netherlands.Google Scholar
- Yen-Wei Chen, Kanami Kobayashi, Hitoshi Kawabayashi, and Xinyin Huang. 2008. Application of Interactive Genetic Algorithms to Boid Model Based Artificial Fish Schools. In Knowledge-Based Intelligent Information and Engineering Systems. Springer Berlin Heidelberg, Berlin, Heidelberg, 141--148. Google ScholarDigital Library
- A.E. Eiben and J.E. Smith. 2015. Introduction to Evolutionary Computing. Springer Berlin Heidelberg, Berlin, Heidelberg. Google ScholarDigital Library
- Eliseo Ferrante, Edgar Duéñez-Guzmán, Ali Emre Turgut, and Tom Wenseleers. 2013. GESwarm: Grammatical evolution for the automatic synthesis of collective behaviors in swarm robotics. In Proceedings of the 15th annual conference on Genetic and evolutionary computation. ACM, 17--24. Google ScholarDigital Library
- John H. Holland. 1975. Adaptation in natural and artificial systems: an introductory analysis with applications to biology control, and artificial intelligence. University of Michigan Press. 183 pages. Google ScholarDigital Library
- Yaqing Hou, Yew-Soon Ong, Liang Feng, and Jacek M Zurada. 2017. An Evolutionary Transfer Reinforcement Learning Framework for Multiagent Systems. IEEE Transactions on Evolutionary Computation 21, 4 (2017), 601--615.Google ScholarDigital Library
- Leslie Pack Kaelbling, Michael L Liftman, and Andrew W Moore. 1996. Reinforcement learning: A survey. Journal of artificial intelligence research 4 (1996), 237--285. Google ScholarDigital Library
- John R. Koza. 1992. Genetic programming : on the programming of computers by means of natural selection. MIT Press. 819 pages. Google ScholarDigital Library
- John R Koza. 1994. Evolution of Emergent Cooperative Behavior using Genetic Programming. Computing with Biological Metaphors (1994), 280--297.Google Scholar
- Erandi Lakshika, Michael Barlow, and Adam Easton. 2013. Co-evolving semi-competitive interactions of sheepdog herding behaviors utilizing a simple rule-based multi agent framework. In 2013 IEEE Symposium on Artificial Life (ALife). IEEE, 82--89.Google ScholarCross Ref
- M J Mataric. 1993. Designing Emergent Behaviors: From Local Interactions to Collective Intelligence. In Proceedings Simulation of Adaptive Behavior. MIT Press, 432--441. Google ScholarDigital Library
- Nicholas A. Mecholsky, Edward Ott, Thomas M. Antonsen, and Parvez Guzdar. 2012. Continuum modeling of the equilibrium and stability of animal flocks. Physica D: Nonlinear Phenomena 241, 5 (mar 2012), 472--480.Google ScholarCross Ref
- James E. Murphy, Michael O'Neill, and Hamish Carr. 2009. Exploring Grammatical Evolution for Horse Gait Optimisation. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 5481 LNCS (2009), 183--194. Google ScholarDigital Library
- M. O'Neill and C. Ryan. 2001. Grammatical evolution. IEEE Transactions on Evolutionary Computation 5, 4 (2001), 349--358. Google ScholarDigital Library
- Liviu Panait and Sean Luke. 2005. Cooperative multi-agent learning: The state of the art. Autonomous agents and multi-agent systems 11, 3 (2005), 387--434. Google ScholarDigital Library
- Diego Perez, Miguel Nicolau, Michael O'Neill, and Anthony Brabazon. 2011. Evolving Behaviour Trees for the Mario AI Competition Using Grammatical Evolution. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6624 LNCS, PART 1 (2011), 123--132. Google ScholarDigital Library
- Vicenc Quera, Francesc S Beltran, and Ruth Dolado. 2010. Flocking behaviour: agent-based simulation and hierarchical leadership. Journal of Artificial Societies and Social Simulation 13, 2 (2010), 8.Google ScholarCross Ref
- Craig W. Reynolds. 1987. Flocks, herds and schools: A distributed behavioral model. ACM SIGGRAPH Computer Graphics 21, 4 (aug 1987), 25--34. Google ScholarDigital Library
- Craig W Reynolds. 1992. An Evolved, Vision-Based Behavioral Model of Coordinated Group Motion. In Proceedings of the Second International Conference on Simulation of Adaptive Behaviour (SAB92). MIT Press, 384--392. Google ScholarDigital Library
- Craig W Reynolds. 1999. Steering Behaviors For Autonomous Characters. In Game Developers Conference. 763--782.Google Scholar
- Terry Lima Ruas, Maria das Graças Bruno Marietta, Andre Filipe de Moraes Batista, Robson dos Santos FrancÌğa, Alexandre Heideker, Emerson Aguiar Noronha, and Fabio Aragao da Silva. 2011. Modeling artificial life through multi-agent based simulation. In Multi-Agent Systems-Modeling, Control, Programming, Simulations and Applications. InTech.Google Scholar
- Tamas Vicsek, András Czirók, Eshel Ben-Jacob, Inon Cohen, and Ofer Shochet. 1995. Novel Type of Phase Transition in a System of Self-Driven Particles. Physical Review Letters 75, 6 (aug 1995), 1226--1229. arXiv:cond-mat/0611743Google ScholarCross Ref
- Christopher R Ward, Fernand Gobet, and Graham Kendall. 2001. Evolving Collective Behavior in an Artificial Ecology. Artificial Life (2001). Google ScholarDigital Library
- Byoung-Tak Zhang and Dong-Yeon Cho. 1998. Evolving Complex Group Behaviors Using Genetic Programming with Fitness Switching. Artificial Life and Robotics 4, 2 (1998), 431--439.Google Scholar
Index Terms
- Automatic synthesis of swarm behavioural rules from their atomic components
Recommendations
Franken-swarm: grammatical evolution for the automatic generation of swarm-like meta-heuristics
GECCO '19: Proceedings of the Genetic and Evolutionary Computation Conference CompanionIn the last 20 years, literally dozens of optimization algorithms based on swarm intelligence have been proposed. Particle Swarm Optimization, Artificial Bee Colony, Cuckoo Search, Firefly Optimization, and Cat Swarm Optimization are just a small sample ...
Grammatical Swarm: The generation of programs by social programming
This study examines Social Programming, that is, the construction of programs using a Social Swarm algorithm based on Particle Swarm Optimization. Each individual particle represents choices of program construction rules, where these rules are specified ...
Co-evolving robocode tanks
GECCO '11: Proceedings of the 13th annual conference on Genetic and evolutionary computationRobocode is a Java based programming platform where robot tanks, controlled by programs written in Java, compete. In this paper Grammatical Evolution is used to evolve Java programs to control a Robocode robot. This paper demonstrates how Grammatical ...
Comments