Abstract
In this paper, we present an algorithm to imitate a game player’s play patterns using a real-time neuroevolution (NE); the examples of the patterns can be moving and firing units. Our algorithm to learn and imitate is possible to be executed during gameplay. To test effectiveness of our algorithm, we made an application similar to the StarcraftTM. By using our method, a game player can avoids tediously repeating labors to control units. Moreover, applying this to enemy agents makes it possible to play more difficult and exciting games. From experimental results, we found that agents’ ability to imitate a game player’s unit control patterns could make human-like agents, and also we found that adaptive game AIs, especially the real-time NE, are efficient in such imitation problems.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Laird, J.E., Lent, M.V.: Interactive Computer Games: Human-level AI Killer Application. In: Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, pp. 1171–1178 (2000)
Stanley, K.O., Bryant, B.D., Miikkulainen, R.: Evolving Neural Network Agents in the NERO Video Game. In: Proceedings of the IEEE 2005 Symposium on Computational In-telligence and Games (CIG 2005), Piscataway, NJ. IEEE, Los Alamitos (2005)
Houlette, R.: Player Modeling for Adaptive Games. AI Game Programming Wisdom 2, Charles River Media, Hingham, MA (2003)
Buro, M., Chung, M., Schaeffer, J.: Monte Carlo Planning in RTS Games. In: Proceedings of the IEEE 2005 Symposium on Computational Intelligence and Games (CIG 2005), Colchester, UK (2005)
Curran, D., O’Riordan, C.: Applying Evolutionary Computation to Designing Neural Networks: A Study of the State of the Art. National University of Ireland, Galway (2002)
Ponsen, M.J.V., Munoz-Avila, H., Spronck, P., Aha, D.W.: Automatically Acquiring Adaptive Real-Time Strategy Game Opponents Using Evolutionary Learning. In: Proceedings, The Twentieth National Conference on Artificial Intelligence and the Seventeenth Innovative Applications of Artificial Intelligence Conference, pp. 1535–1540. AAAI Press, Menlo Park (2005)
Spronck, P., Sprinkhuizen-Kuyper, I., Postma, E.: Online Adaptation of Game Opponent AI in Simulation and in Practice. In: Mehdi, Q., Gough, N. (eds.) Proceedings of the 4th International Confer-ence on Intelligent Games and Simulation (GAME-ON 2003), pp. 93–100. EUROSIS, Belgium (2003) ISBN: 90-77381-05-8
Bauckhage, C., Thurau, C., Sagerer, G.: Learning Human-like Opponent Behavior for Interactive Computer Games. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 148–155. Springer, Heidelberg (2003)
Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evolutionary Computation 10(2) (2002)
Stanley, K.O., Bryant, B.D., Miikkulainen, R.: Evolving Adaptive Neural Networks with and Without Adaptive Synapses. In: To appear in Proceedings of the 2003 IEEE Congress on Evolutionary Computation (CEC 2003) (2003)
D’Silva, T., Janik, R., Chrien, M., Stanley, K.O., Miikkulainen, R.: Retaining Learned Behavior During Real-Time Neuroevolution. In: Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE 2005) (2005)
Buckland, M.: A1 techniques for game programming. Premier-Trade, Cincinnati (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ki, Hw., Lyu, Jh., Oh, Ks. (2006). Real-Time Neuroevolution to Imitate a Game Player. In: Pan, Z., Aylett, R., Diener, H., Jin, X., Göbel, S., Li, L. (eds) Technologies for E-Learning and Digital Entertainment. Edutainment 2006. Lecture Notes in Computer Science, vol 3942. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11736639_80
Download citation
DOI: https://doi.org/10.1007/11736639_80
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33423-1
Online ISBN: 978-3-540-33424-8
eBook Packages: Computer ScienceComputer Science (R0)