skip to main content
10.1145/1830483.1830594acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Neuroevolution of mobile ad hoc networks

Published: 07 July 2010 Publication History

Abstract

This paper describes a study of the evolution of distributed behavior, specifically the control of agents in a mobile ad hoc network, using neuroevolution. In neuroevolution, a population of artificial neural networks (ANNs) are subject to mutation and natural selection. For this study, we compare three different neuroevolutionary systems: a direct encoding, an indirect encoding, and an indirect encoding that supports heterogeneity. Multiple variations of each of these systems were tested on a problem where agents were able to coordinate their collective behavior. Specifically, movement of agents in a simulated physics environment affected which agents were able to communicate with each other. The results of experiments indicate that this is a challenging problem domain for neuroevolution, and although direct and indirect encodings tended to perform similarly in our tests, the strategies employed by indirect encodings tended to favor stable, cohesive groups, while the direct encoding versions appeared more stochastic in nature.

References

[1]
D. H. Owings and E. S. Morton, Animal Vocal Communication: A New Approach. Cambridge University Press, 1998.
[2]
C. M. Waters and B. L. Bassler, "Quorum sensing: Cell-to-cell communication in bacteria," Annual Review of Cell and Developmental Biology, vol. 21, no. 1, 2005.
[3]
B. Holldobler and E. O. Wilson, The Ants. Harvard University Press, 1990.
[4]
S. Camazine, J. Deneubourg, N. Franks, J. Sneyd, G. Theraula, and E. Bonabeau, Self-organization in biological systems. Princeton University Press, 2003.
[5]
G. Weiss, ed., Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. MIT Press, 1999.
[6]
W. Ren and R. W. Beard, Distributed Consensus in Multi-vehicle Cooperative Control: Theory and Applications. Springer, 2007.
[7]
C. Yong and R. Miikkulainen, "Cooperative coevolution of multi-agent systems," Tech. Rep. AI-01-287, University of Texas at Austin, Austin, TX, February 2001.
[8]
M. Waibel, L. Keller, and D. Floreano, "Genetic Team Composition and Level of Selection in the Evolution of Cooperation," IEEE Transactions on Evolutionary Computation, vol. 13, no. 3, 2009.
[9]
W. Wolf, "Cyber-physical systems," IEEE Computer, vol. 42, no. 3, 2009.
[10]
K. O. Stanley and R. Miikkulainen, "Evolving neural networks through augmenting topologies," Evolutionary Computation, vol. 10, no. 2, 2002.
[11]
K. O. Stanley, D. B. D'Ambrosio, and J. Gauci, "A hypercube-based indirect encoding for evolving large-scale neural networks," Artificial Life, vol. 15, no. 2, 2009.
[12]
D. B. D'Ambrosio and K. O. Stanley, "Generative encoding for multiagent learning," in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), 2008.
[13]
L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents and Multi-Agent Systems, vol. 11, no. 3, 2005.
[14]
C. Cassandras and W. Li, "Sensor networks and cooperative control," European Journal of Control, vol. 11, no. 4--5, 2005.
[15]
J. C. Bongard, "The Legion System: A novel approach to evolving hetrogeneity for collective problem solving," in Proceedings of the European Conference on Genetic Programming, pp. 16--28, 2000.
[16]
D. Floreano, S. Mitri, S. Magnenat, and L. Keller, "Evolutionary conditions for the emergence of communication in robots," Current Biology, vol. 17, no. 6, 2007.
[17]
M. Dorigo, V. Trianni, E. Şahin, R. Groß, T. H. Labella, G. Baldassarre, S. Nolfi, J.-L. Deneubourg, F. Mondada, D. Floreano, and L. M. Gambardella, "Evolving self-organizing behaviors for a swarm-bot," Autonomous Robots, vol. 17, no. 2, 2004.
[18]
G. Baldassarre, D. Parisi, and S. Nolfi, "Coordination and behavior integration in cooperating simulated robots," in Proceedings of the Conference on Simulation of Adaptive Behavior, 2004.
[19]
K. Stanley, B. Bryant, and R. Miikkulainen, "Real-time neuroevolution in the NERO video game," IEEE Transactions on Evolutionary Computation, vol. 9, no. 6, 2005.
[20]
B. D. Bryant and R. Miikkulainen, "Neuroevolution for adaptive teams," in Proceedings of the IEEE Congress on Evolutionary Computation, vol. 3, 2003.
[21]
S. Hauert, J.-C. Zufferey, and D. Floreano, "Evolved swarming without positioning information: an application in aerial communication relay," Autonomous Robots, vol. 26, no. 1, 2009.
[22]
D. B. D'Ambrosio, J. Lehman, S. Risi, and K. O. Stanley, "Evolving policy geometry for scalable multiagent learning," in Proceedings of the Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010.
[23]
J. Clune, C. Ofria, and R. Pennock, "How a generative encoding fares as problem-regularity decreases," in Proceedings of the Conference on Parallel Problem Solving From Nature (PPSN), 2008.
[24]
J. Clune, C. Ofria, and R. Pennock, "The sensitivity of HyperNEAT to different geometric representations of a problem," in Proceedings of the Conference on Genetic and Evolutionary Computation (GECCO), 2009.
[25]
D. B. Knoester, H. J. Goldsby, and P. K. McKinley, "Evolution of controllers for mobile ad hoc networks," Tech. Rep. MSU-CSE-10-9, Computer Science and Engineering, Michigan State University, East Lansing, Michigan, April 2010.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
GECCO '10: Proceedings of the 12th annual conference on Genetic and evolutionary computation
July 2010
1520 pages
ISBN:9781450300728
DOI:10.1145/1830483
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. developmental
  2. distributed systems
  3. generative
  4. mobile ad-hoc networks
  5. neural network
  6. neuroevolution

Qualifiers

  • Research-article

Conference

GECCO '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2014)HyperNEAT: The First Five YearsGrowing Adaptive Machines10.1007/978-3-642-55337-0_5(159-185)Online publication date: 5-Jun-2014
  • (2013)Encouraging reactivity to create robust machinesAdaptive Behavior10.1177/105971231348739021:6(484-500)Online publication date: 20-Aug-2013
  • (2013)Genetic Variation and the Evolution of Consensus in Digital OrganismsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2012.220172517:3(403-417)Online publication date: 1-Jun-2013
  • (2013)Scalable multiagent learning through indirect encoding of policy geometryEvolutionary Intelligence10.1007/s12065-012-0086-36:1(1-26)Online publication date: 18-Jan-2013
  • (2011)Comparison of NEAT and HyperNEAT Performance on a Strategic Decision-Making ProblemProceedings of the 2011 Fifth International Conference on Genetic and Evolutionary Computing10.1109/ICGEC.2011.33(102-105)Online publication date: 29-Aug-2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media