Abstract
A dynamic environment whose behavior may change in time presents a challenge that agents located there will have to solve. Changes in an environment e.g. a market, can be quite drastic: from changing the dependencies of some products to add new actions to build new products. The agents working in this environment would have to be ready to embrace this changes to improve their performance which otherwise would be diminished. Also, they should try to cooperate or compete against others, when appropriated, to reach their goals faster than in an individual fashion, showing an always desirable emergent behavior. In this paper a reinforcement learning method proposal, guided by social interaction between agents, is presented. The proposal aims to show that adaptation is performed independently by the society, without explicitly reporting that changes have occurred by a central authority, and even without trying to recognize those changes.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sutton, R.S., Barto, A.G.: Reinforcement learning i: Introduction (1998)
Vidal, J.: Learning in multiagent systems: An introduction from a game-theoretic perspective. In: Adaptive Agents and Multi-Agent Systems, pp. 562–562
Akchurina, N.: Multiagent reinforcement learning: algorithm converging to nash equilibrium in general-sum discounted stochastic games. In: AAMAS 2009: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems, pp. 725–732 (2009)
Shoham, Y., Powers, R., Grenager, T.: Multi-agent reinforcement learning: a critical survey. In: AAAI Fall Symposium on Artificial Multi-Agent Learning (2004)
López-Paredes, A., Hernández-Iglesias, C., Gutiérrez, J.P.: Towards a new experimental socio-economics: Complex behaviour in bargaining. Journal of Socio-Economics 31(4), 423–429 (2002)
Hu, J., Wellman, M.P.: Nash Q-learning for general-sum stochastic games. The Journal of Machine Learning Research 4, 1039–1069 (2003)
Melo, F.S., Ribeiro, M.I.: Coordinated learning in multiagent MDPs with infinite state-space. In: Autonomous Agents and Multi-Agent Systems, pp. 1–47
Ghosh, D., Sharman, R., Raghav Rao, H., Upadhyaya, S.: Self-healing systems–survey and synthesis. Decision Support Systems 42(4), 2164–2185 (2007)
Helleboogh, A., Vizzari, G., Uhrmacher, A., Michel, F.: Modeling dynamic environments in multi-agent simulation. Auton. Agents Multi-Agent Syst. 14(1), 87–116 (2007)
Dignum, V., Dignum, F., Sonenberg, L.: Towards dynamic reorganization of agent societies. In: Proceedings of Workshop on Coordination in Emergent Agent Societies, pp. 22–27 (2004)
Hu, J., Wellman, M.P.: Multiagent reinforcement learning in stochastic games
Claus, C., Boutilier, C.: The dynamics of reinforcement learning in cooperative multiagent systems. In: Proceedings of the Fifteenth National Conference on Artificial Intelligence, pp. 746–752. AAAI Press, Menlo Park (1998)
Singh, S.P., Jaakkola, T., Jordan, M.I.: Reinforcement learning with soft state aggregation. In: Advances in Neural Information Processing Systems 7, pp. 361–368. MIT Press, Cambridge (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Garcia-Pardo, J.A., Carrascosa, C. (2011). Agent Adaptation through Social Opinion. In: Pérez, J.B., et al. Highlights in Practical Applications of Agents and Multiagent Systems. Advances in Intelligent and Soft Computing, vol 89. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19917-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-19917-2_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19916-5
Online ISBN: 978-3-642-19917-2
eBook Packages: EngineeringEngineering (R0)