Skip to main content
Springer Nature Link
Log in

Layered Learning in Genetic Programming for a Cooperative Robot Soccer Problem

  • Conference paper
  • First Online:
Genetic Programming (EuroGP 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2038))

Included in the following conference series:

Abstract

We present an alternative to standard genetic programming (GP) that applies layered learning techniques to decompose a problem. GP is applied to subproblems sequentially, where the population in the last generation of a subproblem is used as the initial population of the next subproblem. This method is applied to evolve agents to play keep-away soccer, a subproblem of robotic soccer that requires cooperation among multiple agents in a dynnamic environment. The layered learning paradigm allows GP to evolve better solutions faster than standard GP. Results show that the layered learning GP outperforms standard GP by evolving a lower fitness faster and an overall better fitness. Results indicate a wide area of future research with layered learning in GP.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Andre, D., A. Teller. 1998. Evolving Team Darwin United. Lecture Notes in Artificial Intelligence: RoboCup-98: Robot Soccer World Cup II. vol 1604. Springer-Verlag.

    Google Scholar 

  2. Andre, D. et al. 1999. Soccerserver Manual. Ver. 4, Rev. 02. Available through the World-Wide Web at http://www.robocup.org.

  3. Asada, M. et. al. 1999. Overview of RoboCup-98. Lecture Notes in Artificial Intelligence: RoboCup-98: Robot Soccer World Cup II. vol 1604. Springer-Verlag.

    Google Scholar 

  4. Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., Osawa, E. 1995. RoboCup: The Robot World Cup Initiative. In Proceedings of the IJCAI-95 Workshop on Entertainment and AI/ALife.

    Google Scholar 

  5. Kitano, H., et al. 1997. The RoboCup Synthetic Agent Challenge 97. In Proceedings of the IJCAI-97 Conference.

    Google Scholar 

  6. Koza, J.R. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press.

    Google Scholar 

  7. Koza, J.R. 1994. Genetic Programming 2. MIT Press.

    Google Scholar 

  8. Luke, S. 2000. Issues in Scaling Genetic Programming: Breeding Strategies, Tree Generation, and Code Bloat. Ph.D. Dissertation, Department of Computer Science, University of Maryland, College Park, Maryland.

    Google Scholar 

  9. Luke, S. 1998. Genetic Programming Produced Competitive Soccer Softbot Teams for RoboCup97. In Proceedings of the Third Annual Genetic Programming Conference (GP98). J. Koza et al, eds. 204–222. San Fransisco: Morgan Kaufmann.

    Google Scholar 

  10. Luke, S. and L. Spector. 1996. Evolving Teamwork and Coordination with Genetic Programming. In Genetic Programming 1996: Proceedings of the First Annual Conference. J. Koza et al, eds. Cambridge: MIT Press. 141–149.

    Google Scholar 

  11. Matsubara, H., Noda, I., Hiraku, K. 1997. Learning of Coorperative actions in multi-agent systems: a case study of pass play in Soccer. In Adaption, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, pages 63–67, Menlo Park, CA. AAAI Press. AAAI Technical Report SS-96-01.

    Google Scholar 

  12. Rosca, J.P. and Ballard, D.H. 1994. Hierarchical Self-Orgainization in Genetic Programming. Proceedings of the Eleventh International Conference on Machine Learning. pp.251–258. Morgan Kaufmann Publishers, Inc.

    Google Scholar 

  13. Stone, P., Veloso M., Riley, P. 1999. The CMUnited-98_Champion Simulator Team. Lecture Notes in Artificial Intelligence: RoboCup-98: Robot Soccer World Cup II. vol 1604. Springer-Verlag.

    Google Scholar 

  14. Stone, P., Veloso, M. 2000. Layered Learning. Eleventh European Conference on Machine Learning (ECML-2000).

    Google Scholar 

  15. Stone, P., Veloso, M. 1998. A Layered Approch to Learning Client Behaviors in the RoboCup Soccer Server. Applied Artificial Intelligence (AAI), Volume 12.

    Google Scholar 

  16. Stone, P., Veloso, M. 2000. Multiagent Systems: A Survey from a Machine Learning Perspective. Autonomous Robots, volume 8,number 3.

    Google Scholar 

  17. Stone, P., Veloso, M. 1999. Team-Partitioned, Opaque-Transition Reinforcement Learning. Lecture Notes in Artificial Intelligence: RoboCup-98: Robot Soccer World Cup II. vol 1604. Springer-Verlag.

    Google Scholar 

  18. Tambe, M. 1997. Towards Flexible Teamwork. Journal of Artificial Intelligence Research, Volume 7, Pages 83–124.

    Google Scholar 

  19. Tambe, M., Adibi, J., Alonaizon, Y., Erdem, A., Kaminka, G., Marsella, S. and Muslea, I. 1999. Building agent teams using an explicit teamwork model and learning. Artificial Intelligence, volume 110, pages 215–240.

    Article  MATH  Google Scholar 

  20. TeamBots software and documentation. Available through the World-Wide Web at http://www.teambots.org.

Download references

Author information

Authors and Affiliations

  1. ASAP Group, School of Computer Science & IT, University of Nottingham, Jubilee Campus, Nottingham, NG8 1BB, UK

    Steven M. Gustafson

  2. Department of Computing and Information Sciences, Kansas State University, Manhattan, KS, 66502, USA

    William H. Hsu

Authors
  1. Steven M. Gustafson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. William H. Hsu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Science, University of Birmingham, Birmingham

    Julian Miller

  2. Computer Science Institute, University of Lausanne, Lausanne

    Marco Tomassini

  3. Dipartimento di Elettronica e Informazione, Politecnico di Milano, Italy

    Pier Luca Lanzi

  4. Computer Science and Information Systems, University of Limerick, Limerick

    Conor Ryan

  5. Dipartimento di Tecnologie dell’Informazione, Università degli Studi di Milano, Italy

    Andrea G. B. Tettamanzi

  6. Department of Computer Science, University College London, London

    William B. Langdon

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gustafson, S.M., Hsu, W.H. (2001). Layered Learning in Genetic Programming for a Cooperative Robot Soccer Problem. In: Miller, J., Tomassini, M., Lanzi, P.L., Ryan, C., Tettamanzi, A.G.B., Langdon, W.B. (eds) Genetic Programming. EuroGP 2001. Lecture Notes in Computer Science, vol 2038. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45355-5_23

Download citation

  • DOI: https://doi.org/10.1007/3-540-45355-5_23

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41899-3

  • Online ISBN: 978-3-540-45355-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation