Skip to main content

Combining Neural Networks for Controlling Non-player Characters in Games

  • Conference paper
  • First Online:
Advances in Computational Intelligence (IWANN 2017)

Abstract

Creating the behavior for non-player characters in video games is a complex task that requires the collaboration among programmers and game designers.

Usually game designers are only allowed to change certain parameters of the behavior, while programmers write new code whenever the behavior intended by designers cannot be achieved by just parameter tweaking. This becomes a time-consuming process that requires several iterations of designers testing the solution provided by programmers, followed by additional changes in the requirements that programmers must again re-implement.

In this paper, we present an approach for creating the behavior of non-player characters in video games that gives more power to the game designer by combining program by demonstration and behavior trees. Our approach is able to build some parts of a behavior tree with the observed data in a previous training phase.

Supported by the Spanish Ministry of Science and Education (TIN2014-55006-R).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rasmussen, J.: Are behavior trees a thing of the past (2016). http://www.gamasutra.com/blogs/JakobRasmussen/20160427/271188/Are_Behavior_Trees_a_Thing_of_the_Past.php

  2. Isla, D.: Halo 3 - building a better battle. In: Game Developers Conference (2008)

    Google Scholar 

  3. Isla, D.: Handling complexity in the Halo 2 AI. In: Game Developers Conference (2005)

    Google Scholar 

  4. Sagredo-Olivenza, I., Gómez-Martín, M.A., González-Calero, P.A.: Supporting the collaboration between programmers and designers building game AI. In: Chorianopoulos, K., Divitini, M., Hauge, J.B., Jaccheri, L., Malaka, R. (eds.) ICEC 2015. LNCS, vol. 9353, pp. 496–501. Springer, Cham (2015). doi:10.1007/978-3-319-24589-8_46

    Chapter  Google Scholar 

  5. Ontañón, S., Mishra, K., Sugandh, N., Ram, A.: On-line case-based planning. Comput. Intell. 26(1), 84–119 (2010)

    Article  MathSciNet  Google Scholar 

  6. Floyd, M.W., Esfandiari, B., Lam, K.: A case-based reasoning approach to imitating robocup players. In: Proceedings of the Twenty-First International Florida Artificial Intelligence Research Society Conference, Florida, 15–17 May 2008, pp. 251–256. AAAI Press, Coconut Grove (2008)

    Google Scholar 

  7. Ontanón, S., Ram, A.: Case-based reasoning and user-generated artificial intelligence for real-time strategy games. In: González-Calero, P.A., Gómez-Martín, M.A. (eds.) Artificial Intelligence for Computer Games, pp. 103–124. Springer, New York (2011)

    Chapter  Google Scholar 

  8. Rubin, J., Watson, I.D.: On combining decisions from multiple expert imitators for performance. In: IJCAI-11 (2011)

    Google Scholar 

  9. Jaidee, U., Muñoz-Avila, H., Aha, D.W.: Case-based goal-driven coordination of multiple learning agents. In: Delany, S.J., Ontañón, S. (eds.) ICCBR 2013. LNCS, vol. 7969, pp. 164–178. Springer, Heidelberg (2013). doi:10.1007/978-3-642-39056-2_12

    Chapter  Google Scholar 

  10. Dereszynski, E.W., Hostetler, J., Fern, A., Dietterich, T.G., Hoang, T.T., Udarbe, M.: Learning probabilistic behavior models in real-time strategy games. In: AIIDE (2011)

    Google Scholar 

  11. Fernández-Ares, A., Mora, A., García-Sánchez, P., Castillo, P., Merelo, J.: Analysing the influence of the fitness function on genetically programmed bots for a real-time strategy game. Entertainment Comput. 18, 15–29 (2017)

    Article  Google Scholar 

  12. Ortega, J., Shaker, N., Togelius, J., Yannakakis, G.N.: Imitating human playing styles in super mario bros. Entertainment Comput. 4(2), 93–104 (2013)

    Article  Google Scholar 

  13. Spronck, P., Ponsen, M., Sprinkhuizen-Kuyper, I., Postma, E.: Adaptive game AI with dynamic scripting. Mach. Learn. 63(3), 217–248 (2006)

    Article  Google Scholar 

  14. Floreano, D., Dürr, P., Mattiussi, C.: Neuroevolution: from architectures to learning. Evol. Intel. 1(1), 47–62 (2008)

    Article  Google Scholar 

  15. Robertson, G., Watson, I.: Building behavior trees from observations in real-time strategy games. In: v Innovations in Intelligent SysTems and Applications (INISTA), pp. 1–7. IEEE (2015)

    Google Scholar 

  16. Flórez-Puga, G., Gómez-Martín, M.A., Gómez-Martín, P.P., Díaz-Agudo, B., González-Calero, P.A.: Query enabled behaviour trees. IEEE Trans. Comput. Intell. AI Games 1(4), 298–308 (2009)

    Article  Google Scholar 

  17. Silverman, B.W., Jones, M.C.: E. Fix and J.L. Hodges (1951): an important contribution to nonparametric discriminant analysis and density estimation: commentary on fix and Hodges. Int. Stat. Rev./Revue Internationale de Statistique 57(3), 233–238 (1989)

    MATH  Google Scholar 

  18. Rosenblatt, F.: Principles of neurodynamics. Perceptrons and the theory of brain mechanisms. Technical report, DTIC Document (1961)

    Google Scholar 

  19. Bentley, J.L.: Multidimensional binary search trees used for associative searching. Commun. ACM 18(9), 509–517 (1975)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ismael Sagredo-Olivenza .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Sagredo-Olivenza, I., Gómez-Martín, P.P., Gómez-Martín, M.A., González-Calero, P.A. (2017). Combining Neural Networks for Controlling Non-player Characters in Games. In: Rojas, I., Joya, G., Catala, A. (eds) Advances in Computational Intelligence. IWANN 2017. Lecture Notes in Computer Science(), vol 10306. Springer, Cham. https://doi.org/10.1007/978-3-319-59147-6_59

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59147-6_59

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59146-9

  • Online ISBN: 978-3-319-59147-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics