Skip to main content
Springer Nature Link
Log in

Implementing AI for Non-player Characters in 3D Video Games

  • Conference paper
  • First Online:
Intelligent Information and Database Systems (ACIIDS 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10751))

Included in the following conference series:

  • 4418 Accesses

Abstract

The purpose of this work was to find a solution for implementing intelligent behavior of independent NPC agents (non-player characters) in video games. NPC is a computer operated character - usually an enemy to the human user player. In modern video games NPCs are programmed to mimic human player behaviour to increase realism. Four approaches to NPC AI implementation were compared: decision tree, genetic algorithm, Q-learning, and a hybrid method. Results were aggregated and discussed along with recommending the best approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Fairclough, C., Fagan, M., Mac Namee, B., Cunningham, P.: Research directions for AI in computer games. Technical report, Trinity College Dublin, Department of Computer Science (2001)

    Google Scholar 

  2. Fang, Y.P., Ting, I.H.: Applying reinforcement learning for game AI in a tank-battle game. In: 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC), pp. 1031–1034. IEEE (2009)

    Google Scholar 

  3. Gurney, K.: An Introduction to Neural Networks. CRC Press, Boca Raton (1997)

    Book  Google Scholar 

  4. Hosu, I.A., Rebedea, T.: Playing atari games with deep reinforcement learning and human checkpoint replay (2016). arXiv preprint arXiv:1607.05077

  5. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)

    Article  Google Scholar 

  6. Mora-García, A.M., Merelo-Guervós, J.J.: Evolving bot’s AI in unreal\(^{\rm TM}\). In: Algorithmic and Architectural Gaming Design: Implementation and Development, pp. 134–157. IGI Global (2012)

    Google Scholar 

  7. Safadi, F., Fonteneau, R., Ernst, D.: Artificial intelligence in video games: towards a unified framework. Int. J. Comput. Games Technol. 2015, 5 (2015)

    Article  Google Scholar 

  8. Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)

    Article  Google Scholar 

  9. Simon, H.A.: Artificial intelligence: an empirical science. Artif. Intell. 77(1), 95–127 (1995)

    Article  Google Scholar 

  10. Soni, B., Hingston, P.: Bots trained to play like a human are more fun. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008. (IEEE World Congress on Computational Intelligence), pp. 363–369. IEEE (2008)

    Google Scholar 

  11. Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10(2), 99–127 (2002)

    Article  Google Scholar 

  12. Studios, F.: Garry’s mod (2006)

    Google Scholar 

  13. Wang, H., Gao, Y., Chen, X.: Rl-dot: a reinforcement learning NPC team for playing domination games. IEEE Trans. Comput. Intell. AI Games 2(1), 17–26 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Management, Wroclaw University of Science and Technology, Wybrzeze Wyspiańskiego 27, 50-370, Wroclaw, Poland

    Marek Kopel & Tomasz Hajas

Authors
  1. Marek Kopel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tomasz Hajas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marek Kopel .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wrocław, Poland

    Ngoc Thanh Nguyen

  2. Quang Binh University, Dong Hoi City, Vietnam

    Duong Hung Hoang

  3. National University of Kaohsiung, Kaohsiung, Taiwan

    Tzung-Pei Hong

  4. Rutgers University, Piscataway, New Jersey, USA

    Hoang Pham

  5. Wrocław University of Science and Technology, Wrocław, Poland

    Bogdan Trawiński

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kopel, M., Hajas, T. (2018). Implementing AI for Non-player Characters in 3D Video Games. In: Nguyen, N., Hoang, D., Hong, TP., Pham, H., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2018. Lecture Notes in Computer Science(), vol 10751. Springer, Cham. https://doi.org/10.1007/978-3-319-75417-8_57

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-75417-8_57

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-75416-1

  • Online ISBN: 978-3-319-75417-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation