Skip to main content

Advertisement

SpringerLink
Log in

Learning enabled cooperative agent behavior in an evolutionary and competitive environment

  • Original Article
  • Published:
Neural Computing & Applications Aims and scope Submit manuscript

Abstract

The proposed method is implemented in three steps: first, when a variation in environment is perceived, agents take appropriate actions. Second, the behaviors are stimulated and controlled through communication with other agents. Finally, the most frequently stimulated behavior is adopted as a group behavior strategy. In this paper, two different reward models, reward model 1 and reward model 2, are applied. Each reward model is designed to consider the reinforcement or constraint of behaviors. In competitive agent environments, the behavior considered to be advantageous is reinforced as adding reward values. On the contrary, the behavior considered to be disadvantageous is constrained by reducing the reward values. The validity of this strategy is verified through simulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Nolfi S, Elman JL, Parisi D (1990) Learning and evolution in neural networks. CRL Technical Report 9019, University of California, San Diego

  2. Gruau F, Whitley D (1993) Adding learning to the cellular development of neural networks: evolution and the Baldwin effect. Evol Comput I(3):213–233

    Google Scholar 

  3. Baldwin JM (1996) A new factor in evolution. In: Belew RK, Mitchell M (eds) Adaptive individuals in evolving populations: models and algorithms. Addison-Wesley, Reading

    Google Scholar 

  4. Collins RJ, Jefferson DR (1991) AntFarm: towards simulated evolution. In: Farmer JD, Langton C, Rasmussen S, Taylor C (eds) Artificial life II. Addison-Wesley, Reading

    Google Scholar 

  5. Collins RJ (1992) Studies in artificial evolution. PhD Thesis, Philosophy in Computer Science, University of California

  6. Nolfi S, Floreano D (1998) Co-evolving predator and prey agents: dDo ‘arm races’ arise in artificial evolution? Artif Life 4(4):311–335

    Article  Google Scholar 

  7. Victor R (1999) Lesser, cooperative multiagent systems: a personal view of the state of the art. IEEE Trans Knowl Data Eng 11(1):133–142

    Article  Google Scholar 

  8. Marco Dorigo, Vittorio Maniezzo, Alberto Colorni (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern B Cybern 26(1):29–41

    Article  Google Scholar 

  9. Georgeff M (1999) A theory of action for multi-agent planning. In: Proceedings of the national conference on artificial intelligence, pp 121–125

  10. David C Parkes, Lyle H Ungar (1997) Learning and adaptation in multiagent systems. In: AAAI workshop on multiagent learning providence

  11. Kreifelt T, von Martial F (1991) A negotiation framework for autonomous agents. In: Demazeau Y, Muller JP (eds) Decentrilazed AI2. Elsevier, Amsterdam

    Google Scholar 

  12. Nwana HS, Lee L, Jennings NR (2001) Co-ordination in multi-agent systems. Software agents and soft computing, towards enhancing machine intelligence, concepts and applications. Springer, Berlin Heidelberg New York

    Google Scholar 

  13. Peter Stone, Manuela Veloso (2000) Multi-agent systems: a survey from a machine learning perspective. IEEE Trans Knowl Data Eng

  14. Bae Han Kuk (2001) Evolution Strategy of agent using artificial life. Korea Inf Sci 27(4):142–162

    Google Scholar 

  15. Yasuo Nagayuki, Shin Ishii (1999) Multi-agent reinforcement learning: an approach based on the other agent’s internal model, from animals to animates. In: Proceedings of the 8th Conference on the simulation of adaptive behavior, MIT Press, Cambridge, pp 478–485

  16. Kam-Chuen Jim, Lee Giles C (2000) Talkin Helps: evolving communicating agents for the predator–prey pursuit problem. Artif Life 6:237–254

    Article  Google Scholar 

  17. Takayuki Kohri, Matsubayashi (2000) An adaptive architecture for modular Q-learning. In: Proceedings of the 10th international conference on simulation of adaptive behavior, MIT Press, Cambridge, pp 1–6

  18. Collins Robert J, David R (1992) An artificial neural network representation for artificial organisms. In: Proceedings of the 1st workshop on parallel problem solving. Lecture Notes in Computer Science, Springer, Berlin Heidelberg New York, pp 496:259–263

Download references

Author information

Authors and Affiliations

  1. School of Electronics & Information Engineering, ChonBuk National University, 664-14, 1Ga, DeokJin-Dong, JeonJu, 561-756, ChonBuk, South Korea

    Mal Rey Lee

  2. Department of Multimedia Engineering, JeonJu University, Hyoja-dong 3ga, Wansan-Gu, 560-759, Jeonju city, Korea

    Eung-Kwan Kang

Authors
  1. Mal Rey Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eung-Kwan Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mal Rey Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, M.R., Kang, EK. Learning enabled cooperative agent behavior in an evolutionary and competitive environment. Neural Comput & Applic 15, 124–135 (2006). https://doi.org/10.1007/s00521-005-0020-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-005-0020-z

Keywords

Search

Navigation