Abstract
This paper presents an approach based in an evolutionary algorithm, aimed to improve the behavioral parameters which guide the actions of an autonomous agent (bot) inside the real-time strategy game, Planet Wars. The work describes a co-evolutionary implementation of a previously presented method GeneBot, which yielded successful results, but focused in 4vs matches this time. Thus, there have been analyzed the effects of considering several individuals to be evolved (improved) at the same time in the algorithm, along with the use of three different fitness functions measuring the goodness of each bot in the evaluation. They are based in turns and position, and also in mathematical computations of linear regression and area regarding the number of ships belonging to the bot/individual to be evaluated. In addition, the variance of using an evolutionary algorithm with and without previous knowledge in the co-evolution phase is also studied, i.e., respectively using specific rivals to perform the evaluation, or just considering to this end individuals in the population being evolved. The aim of these co-evolutionary approaches are mainly two: first, reduce the computational time; and second find a robust fitness function to be used in the generation of evolutionary bots optimized for 4vs battles.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fernández-Ares, A., Mora, A.M., Merelo, J.J., García-Sánchez, P., Fernandes, C.: Optimizing player behavior in a real-time strategy game using evolutionary algorithms. In: IEEE Congress on Evolutionary Computation (CEC 2011), pp. 2017–2024 (2011)
Mora, A.M., Fernández-Ares, A., Merelo, J.J., García-Sánchez, P., Fernandes, C.M.: Effect of noisy fitness in real-time strategy games player behaviour optimisation using evolutionary algorithms. J. Comput. Sci. Technol. 27(5), 1007–1023 (2012)
Paredis, J.: Coevolutionary computation. Artif. Life 2(4), 355–375 (1995)
Rosin, C.D., Belew, R.K.: New methods for competitive coevolution. Evol. Comput. 5(1), 1–29 (1997)
Potter, M.A., De Jong, K.A.: A cooperative coevolutionary approach to function optimization. In: Davidor, Y., Männer, Reinhard, Schwefel, Hans-Paul (eds.) PPSN 1994. LNCS, vol. 866, pp. 249–257. Springer, Heidelberg (1994)
Ponsen, M., Munoz-Avila, H., Spronck, P., Aha, D.W.: Automatically generating game tactics through evolutionary learning. AI Magazine 27(3), 75–84 (2006)
Jang, S.H., Yoon, J.W., Cho, S.B.: Optimal strategy selection of non-player character on real time strategy game using a speciated evolutionary algorithm. In: Proceedings of the 5th IEEE Symposium on Computational Intelligence and Games (CIG 2009), pp. 75–79. IEEE Press, Piscataway (2009)
Fernández-Ares, A., García-Sánchez, P., Mora, A.M., Merelo, J.J.: Adaptive bots for real-time strategy games via map characterization. In: 2012 IEEE Conference on Computational Intelligence and Games, CIG 2012, pp. 417–721. IEEE (2012)
Pollack, J.B., Blair, A.D.: Co-evolution in the successful learning of backgammon strategy. Mach. Learn. 32, 225–240 (1998)
Runarsson, T.P., Lucas, S.M.: Co-evolution versus self-play temporal difference learning for acquiring position evaluation in smallboard go. IEEE Trans. Evol. Comput. 9(6), 628–640 (2005)
Thompson, T., Levine, J., Wotherspoon, R.: Evolution of counter-strategies: Application of co-evolution to texas hold’em poker. In: IEEE Symposium on Computational Intelligence and Games (CIG 2008), pp. 16–22. IEEE (2008)
Togelius, J., Burrow, P., Lucas, S.M.: Multi-population competitive co-evolution of car racing controllers. In: IEEE Congress on Evolutionary Computation (CEC 2007), pp. 4043–4050 (2007)
Avery, P.M., Michalewicz, Z.: Adapting to human game play. In: IEEE Symposium on Computational Intelligence and Games (CIG 2008), pp. 8–15 (2008)
Cook, M., Colton, S., Gow, J.: Initial Results from Co-operative Co-evolution for Automated Platformer Design. In: Di Chio, C., et al. (eds.) EvoApplications 2012. LNCS, vol. 7248, pp. 194–203. Springer, Heidelberg (2012)
Cardona, A., Togelius, J., Nelson, M.: Competitive coevolution in Ms. Pac-Man. In: IEEE Congress on Evolutionary Computation (CEC 2013), pp. 1403–1410 (2013)
Livingstone, D.: Coevolution in hierarchical ai for strategy games. In: IEEE Symposium on Computational Intelligence and Games (CIG 2005). IEEE (2005)
Smith, G., Avery, P., Houmanfar, R., Louis, S.: Using co-evolved rts opponents to teach spatial tactics. In: IEEE Symposium on Computational Intelligence and Games (CIG 2010), pp. 146–153 (2010)
Avery, P., Louis, S.: Coevolving team tactics for a real-time strategy game. In: IEEE Congress on Evolutionary Computation (CEC 2010), pp. 1–8 (2010)
Nogueira, M., Cotta, C., Fernández-Leiva, A.J.: An Analysis of Hall-of-Fame Strategies in Competitive Coevolutionary Algorithms for Self-Learning in RTS Games. In: Nicosia, G., Pardalos, P. (eds.) LION 7. LNCS, vol. 7997, pp. 174–188. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández-Ares, A., Mora, A.M., García-Arenas, M., Guervós, J.J.M., García-Sánchez, P., Castillo, P.A. (2014). Co-Evolutionary Optimization of Autonomous Agents in a Real-Time Strategy Game. In: Esparcia-Alcázar, A., Mora, A. (eds) Applications of Evolutionary Computation. EvoApplications 2014. Lecture Notes in Computer Science(), vol 8602. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45523-4_31
Download citation
DOI: https://doi.org/10.1007/978-3-662-45523-4_31
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45522-7
Online ISBN: 978-3-662-45523-4
eBook Packages: Computer ScienceComputer Science (R0)