Abstract
In this paper, we propose a reinforcement learning method using Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation. The proposed method is based on the actor-critic method, and the actor is realized by the Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation. The Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation is based on the self-organizing feature map, and it can realize successive learning and one-to-many associations. Moreover, it has robustness for noisy input and damaged neurons because it is based on the area representation. The proposed method makes use of this property in order to realize the learning during the practice of task. We carried out a series of computer experiments, and confirmed the effectiveness of the proposed method in path-finding problem.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sutton, R.S., Barto, A.G.: Reinforcement Learning, An Introduction. MIT Press, Cambridge (1998)
Witten, I.H.: An adaptive optimal controller for discrete-time Markov environments. Information and Control 34, 286–295 (1977)
Shibata, K., Sugisaka, M., Ito, K.: Fast and stable learning in direct-vision-based reinforcement learning. In: Proceedings of the 6th International Sysmposium on Artificial Life and Robotics, vol. 1, pp. 200–203 (2001)
Ishii, S., Shidara, M., Shibata, K.: A model of emergence of reward expectancy neurons by reinforcement learning. In: Proceedings of the 10th International Sysmposium on Artificial Life and Robotics, vol. GS21-5 (2005)
Imabayashi, T., Osana, Y.: Implementation of association of one-to-many associations and the analog pattern in Kohonen feature map associative emory with area representation. In: Proceedings of IASTED Artificial Intelligence and Applications, Innsbruck (2008)
Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (1994)
Abe, H., Osana, Y.: Kohonen feature map associative memory with area representation. In: Proceedings of IASTED Artificial Intelligence and Applications, Innsbruck (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shimizu, A., Osana, Y. (2009). Reinforcement Learning Using Kohonen Feature Map Associative Memory with Refractoriness Based on Area Representation. In: Köppen, M., Kasabov, N., Coghill, G. (eds) Advances in Neuro-Information Processing. ICONIP 2008. Lecture Notes in Computer Science, vol 5507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03040-6_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-03040-6_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03039-0
Online ISBN: 978-3-642-03040-6
eBook Packages: Computer ScienceComputer Science (R0)