Skip to main content

Evaluation of Techniques for a Learning-Driven Modeling Methodology in Multiagent Simulation

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6251))

Abstract

There have been a number of suggestions for methodologies supporting the development of multiagent simulation models. In this contribution we are introducing a learning-driven methodology that exploits learning techniques for generating suggestions for agent behavior models based on a given environmental model. The output must be human-interpretable. We compare different candidates for learning techniques – classifier systems, neural networks and reinforcement learning – concerning their appropriateness for such a modeling methodology.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  2. Nowe, A., Verbeeck, K., Peeters, M.: Learning automata as a basis for multi agent reinforcement learning, pp. 71–85 (2006)

    Google Scholar 

  3. Adami, C.: Introduction to artificial life. Springer, New York (1998)

    Book  MATH  Google Scholar 

  4. Collins, R.J., Jefferson, D.R.: Antfarm: Towards simulated evolution. In: Artificial Life II, pp. 579–601. Addison-Wesley, Reading (1991)

    Google Scholar 

  5. Denzinger, J., Fuchs, M.: Experiments in learning prototypical situations for variants of the pursuit game. In: Proceedings on the International Conference on Multi-Agent Systems (ICMAS-1996), pp. 48–55. MIT Press, Cambridge (1995)

    Google Scholar 

  6. Maeda, Y.: Simulation for behavior learning of multi-agent robot. Journal of Intelligent and Fuzzy Systems, 53–64 (1998)

    Google Scholar 

  7. Mahadevan, S., Connell, J.: Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence 55(2-3), 311–365 (1992)

    Article  Google Scholar 

  8. Lee, M.R., Kang, E.K.: Learning enabled cooperative agent behavior in an evolutionary and competitive environment. Neural Computing & Applications 15, 124–135 (2006)

    Article  Google Scholar 

  9. Neruda, R., Slusny, S., Vidnerova, P.: Performance comparison of relational reinforcement learning and rbf neural networks for small mobile robots. In: Proceedings of FGCNS ’08, Washington, DC, USA, pp. 29–32. IEEE Computer Society, Los Alamitos (2008)

    Google Scholar 

  10. Klügl, F.: Multiagent simulation model design strategies. In: MAS& S Workshop at MALLOW 2009, CEUR Workshop Proceedings, Turin, Italy, vol. 494 (September 2009)

    Google Scholar 

  11. Wilson, S.W.: Classifier fitness based on accuracy. Evolutionary Computation 3(2), 149–175 (1995)

    Article  Google Scholar 

  12. Watkins, C.J.C.H., Dayan, P.: Q-learning. Machine Learning 8(3), 279–292 (1992)

    MATH  Google Scholar 

  13. Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)

    MATH  Google Scholar 

  14. Klügl, F., Hatko, R., Butz, M.V.: Agent learning instead of behavior implementation for simulations - a case study using classifier systems. In: Bergmann, R., Lindemann, G., Kirn, S., Pěchouček, M. (eds.) MATES 2008. LNCS (LNAI), vol. 5244, pp. 111–122. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  15. Butz, M.V.: XCSJava 1.0: An implementation of the XCS classifier system in Java. Illigal report, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Junges, R., Klügl, F. (2010). Evaluation of Techniques for a Learning-Driven Modeling Methodology in Multiagent Simulation. In: Dix, J., Witteveen, C. (eds) Multiagent System Technologies. MATES 2010. Lecture Notes in Computer Science(), vol 6251. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16178-0_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16178-0_18

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16177-3

  • Online ISBN: 978-3-642-16178-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics