Abstract
Emergent collective behaviors have long interested researchers . These behaviors often result from complex interactions between many individuals following simple rules. However, knowing what collective behaviors are possible given a limited set of capabilities is difficult. Many emergent behaviors are counter-intuitive and unexpected even if the rules each agent follows are carefully constructed. While much work in swarm robotics has studied the problem of designing sets of rules and capabilities that result in a specific collective behavior, little work has examined the problem of exploring and describing the entire set of collective behaviors that can result from a limited set of capabilities. We take what we believe is the first approach to address this problem by presenting a general framework for discovering collective emergent behaviors that result from a specific capability model. Our approach uses novelty search to explore the space of possible behaviors in an objective-agnostic manner. Given this set of explored behaviors we use dimensionality reduction and clustering techniques to discover a finite set of behaviors that form a taxonomy over the behavior space. We apply our methodology to a single, binary-sensor capability model. Using our approach we are able to re-discover cyclic pursuit and aggregation, as well as discover several behaviors previously unknown to be possible with only a single binary sensor: wall following, dispersal, and a milling behavior often displayed by ants and fish.
Research performed by all authors while at AFRL, Rome NY.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
This formalism also captures homogeneous swarms which can be modeled by letting \(c_i = c, \;\forall i\).
- 2.
Due to the elitism feature of NEAT, the best performing policies (most novel) in one generation are kept in the population for the next generation. Thus, the algorithm explores fewer than 10,000 unique controllers.
- 3.
References
Berger, M., Seversky, L.M., Brown, D.S.: Classifying swarm behavior via compressive subspace learning. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 5328–5335. IEEE (2016)
Brown, D.S., Goodrich, M.A.: Limited bandwidth recognition of collective behaviors in bio-inspired swarms. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, pp. 405–412 (2014)
Brown, D.S., Kerman, S.C., Goodrich, M.A.: Human-swarm interactions based on managing attractors. In: Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction, pp. 90–97. ACM (2014)
Couzin, I.D., Krause, J.: Self-organization and collective behavior in vertebrates. Adv. Study Behav. 32(1), 1–75 (2003)
Couzin, I.D., Krause, J., James, R., Ruxton, G.D., Franks, N.R.: Collective memory and spatial sorting in animal groups. J. Theor. Biol. 218(1), 1–11 (2002)
Doncieux, S., Mouret, J.B.: Behavioral diversity with multiple behavioral distances. In: 2013 IEEE Congress on Evolutionary Computation (CEC), pp. 1427–1434. IEEE (2013)
Gauci, M., Chen, J., Dodd, T.J., Groß, R.: Evolving aggregation behaviors in multi-robot systems with binary sensors. In: Distributed Autonomous Robotic Systems, pp. 355–367. Springer, Berlin (2014)
Gauci, M., Chen, J., Li, W., Dodd, T.J., Groß, R.: Clustering objects with robots that do not compute. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, pp. 421–428 (2014)
Gomes, J., Mariano, P., Christensen, A.L.: Devising effective novelty search algorithms: a comprehensive empirical study. In: Proceedings of the 2015 on Genetic and Evolutionary Computation Conference, pp. 943–950. ACM (2015)
Gomes, J., Urbano, P., Christensen, A.L.: Evolution of swarm robotics systems with novelty search. Swarm Intell. 7(2–3), 115–144 (2013)
Johnson, M., Brown, D.S.: Evolving and controlling perimeter, rendezvous, and foraging behaviors in a computation-free robot swarm. In: International Conference on Bio-inspired Information and Communications Technologies (2015)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Lehman, J., Stanley, K.O.: Abandoning objectives: evolution through the search for novelty alone. Evol. Comput. 19(2), 189–223 (2011)
Luke, S., Cioffi-Revilla, C., Panait, L., Sullivan, K., Balan, G.: Mason: a multiagent simulation environment. Simulation 81(7), 517–527 (2005)
Marshall, J.A., Broucke, M.E., Francis, B.A.: Formations of vehicles in cyclic pursuit. IEEE Trans. Autom. Control 49(11), 1963–1974 (2004)
Mondada, F., Bonani, M., Raemy, X., Pugh, J., Cianci, C., Klaptocz, A., Magnenat, S., Zufferey, J.C., Floreano, D., Martinoli, A.: The e-puck, a robot designed for education in engineering. In: Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions, vol. 1, pp. 59–65. IPCB: Instituto Politécnico de Castelo Branco (2009)
Rubenstein, M., Ahler, C., Nagpal, R.: Kilobot: a low cost scalable robot system for collective behaviors. In: 2012 IEEE International Conference on Robotics and Automation (ICRA), pp. 3293–3298. IEEE (2012)
Schneirla, T.C.: A unique case of circular milling in ants, considered in relation to trail following and the general problem of orientation. Citeseer (1944)
Selous, E.: Thought transference (or what?) in birds (1931)
Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), 99–127 (2002)
Tunstrøm, K., Katz, Y., Ioannou, C.C., Huepe, C., Lutz, M.J., Couzin, I.D.: Collective states, multistability and transitional behavior in schooling fish. PLoS Comput. Biol. 9(2), e1002,915 (2013)
Van der Maaten, L., Hinton, G.: Visualizing data using t-sne. J. Mach. Learn. Res. 9(2579–2605), 85 (2008)
Wolfram, S.: A New Kind of Science, vol. 5. Wolfram Media, Champaign (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Brown, D.S., Turner, R., Hennigh, O., Loscalzo, S. (2018). Discovery and Exploration of Novel Swarm Behaviors Given Limited Robot Capabilities. In: Groß, R., et al. Distributed Autonomous Robotic Systems. Springer Proceedings in Advanced Robotics, vol 6. Springer, Cham. https://doi.org/10.1007/978-3-319-73008-0_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-73008-0_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-73006-6
Online ISBN: 978-3-319-73008-0
eBook Packages: EngineeringEngineering (R0)