Abstract
An architecture is proposed that combines a simple learning method with one of the most natural evaluation systems: imitation controlled by emotions. Using this architecture agents develop behavioral clusters and form a society that improves its ability to reach a given goal over time. Imitation works by observing and applying behavior sequences (episodes). This leads to new and diverse episodes, because the observation introduces small errors. On the other hand, bad episodes are forgotten if they don’t help the agents to satisfy their emotional system that plays the role of an inherent performance measurement. After a while, the agents can be grouped by their typical behavioral patterns. Since these imitated sequences can be seen as “memes” similar to genes in the biological world, this paper explores imitation from the view of memetic proliferation.
We show by simulation that using imitation combined with emotions as evaluation measure tasks can be performed by an agent society without having to specify them in detail. The society’s performance is quantified using an entropy measure to qualitatively evaluate the emerging behavioral clusters.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Gatsoulis, Y., Maistros, G., Marom, Y., Hayes, G.: Learning to forage through imitation. In: Proceedings of the Second IASTED International Conference on Artificial Intelligence and Applications (AIA 2002), pp. 485–491 (2002)
Billard, A.: Learning motor skills by imitation: a biologically inspired robotic model (2000)
Demiris, J., Hayes, G.: Imitation as a dual-route process featuring predictive and learning components: a biologically-plausible computational model. In: Dautenhahn, K., Nehaniv, C. (eds.) Imitation in animals and artifacts, pp. 327–361. MIT Press, Cambridge (2002)
Borenstein, E., Ruppin, E.: Enhancing autonomous agents evolution with learning by imitation. In: Second International Symposium on Imitation in Animals and Artifacts (2003)
Dawkins, R.: The Selfish Gene. Oxford University Press, Oxford (1976)
Plutchik, R.: The Emotions. University Press of America (1991)
Esau, N., Kleinjohann, B., Kleinjohann, L., Stichling, D.: MEXI - machine with emotionally extended intelligence: A software architecture for behavior based handling of emotions and drives. In: Proceedings of the 3rd International Conference on Hybrid and Intelligent Systems (HIS 2003). IEEE Systems, Man and Cybernetics Society, Melbourne, Australia (2003)
Arkin, R.C.: Behaviour-Based Robotics. MIT Press, Cambridge (1998)
Breazeal, C., Scassellati, B.: How to build robots that make friends and influence people (1999)
Blackmore, S.: The Meme Machine. Oxford University Press, Oxford (1999)
Shannon, C.E.: A mathematical theory of communication. Bell System Technical Journal 27, 379–423, 623–656 (1948)
Balch, T.: Behavioral Diversity in Learning Robot Teams. PhD thesis, Georgia Institute of Technology (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Richert, W., Kleinjohann, B., Kleinjohann, L. (2005). Evolving Agent Societies Through Imitation Controlled by Artificial Emotions. In: Huang, DS., Zhang, XP., Huang, GB. (eds) Advances in Intelligent Computing. ICIC 2005. Lecture Notes in Computer Science, vol 3644. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11538059_104
Download citation
DOI: https://doi.org/10.1007/11538059_104
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28226-6
Online ISBN: 978-3-540-31902-3
eBook Packages: Computer ScienceComputer Science (R0)