Skip to main content
SpringerLink
Log in

Towards Imitation of Human Driving Style in Car Racing Games

  • Chapter
  • First Online:
Believable Bots

Abstract

In this chapter we focus on creating believable drivers for car racing games. We describe some racing controllers from the commercial games and the academic researchers, their particular features, what are the main problems they want to deal with and how they approach them. Besides, we identify which are the key properties and behaviours required to consider a racing non-player character (NPC) as believable or not, always from the point of view of an external human player that competes against the NPC. Then, we analyze why the current controllers lack what we understand as a believable behaviour and propose a new approach based on imitation learning to create the racing NPCs. We describe this new approach and analyze its advantages and disadvantages compared with other controllers in order to solve the key problems to achieve the desired believability.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Slides with the results and comments about the competition can be found at: http://cig.ws.dei.polimi.it/?p=166

References

  1. Bates, J.: SCIENCE., C.M.U.P.P.D.O.C.: The role of emotion in believable agents. Commun. ACM 37(7), 122–125 (1994)

    Google Scholar 

  2. Biasillo, G.: Racing AI Logic. AI Game Programming Wisdom, pp. 444–454. Charles River Media, Hingham (2002)

    Google Scholar 

  3. Bishop, C.: Neural networks and their applications. Rev. Sci. Instrum. 65(6), 1803–1832 (2009)

    Google Scholar 

  4. Buckland, M.: Colin McRae Rally 2.0. Interview with Jeff Hannan. http://ai-junkie.com/misc/hannan/hannan.html. Accessed Nov 2010

  5. Cardamone, L., Loiacono, D., Lanzi, P.L.: Learning to drive in theopen racing car simulator using online neuroevolution. Computational Intelligence and AI in Games. IEEE Trans. 2(3), 176–190 (2010). doi:10.1109/TCIAIG.2010.2052102

    Google Scholar 

  6. Chaperot, B., Fyfe, C.: Improving artificial intelligence in a motocross game. In: 2006 IEEE Symposium on Computational Intelligence and Games, pp. 181–186 (2006)

    Google Scholar 

  7. Cutumisu, M., Szafron, D.: An architecture for game behavior AI: behavior multi-queues. In: Artificial Intelligence for Interactive Digital entertainment Conference (2009)

    Google Scholar 

  8. Gallego, F., Llorens, F., Pujol, M., Rizo, R.: Driving-Bots with a Neuroevolved Brain: Screaming Racers. Inteligencia Artificial, Revista Iberoamericana de Inteligencia Artificial 9(28), 9–16 (2005)

    Google Scholar 

  9. Hingston, P.: The 2K BotPrize. In: IEEE Symposium on Computational Intelligence and Games. IEEE (2009). http://www.botprize.org

  10. Ho, D., Garibaldi, J.: A fuzzy approach for the 2007 CIG simulated car racing competition. In: IEEE Symposium On Computational Intelligence and Games, 2008. CIG’08, pp. 127–134. IEEE (2009)

    Google Scholar 

  11. Hunicke, R.: The case for dynamic difficulty adjustment in games. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 429–433. ACM (2005)

    Google Scholar 

  12. Klir, G., Yuan, B.: Fuzzy Sets and Fuzzy Logic: Theory and Applications. Prentice Hall PTR Upper Saddle River (1995)

    Google Scholar 

  13. Koza, J., Poli, R.: Genetic programming. Search Methodologies, pp. 127–164 (2005)

    Google Scholar 

  14. Laird, J., VanLent, M.: Human-level AI’s killer application: interactive computer games. AI Mag. 22(2), 15 (2001)

    Google Scholar 

  15. Li, H., Zhang, Q.: Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II. Evolutionary Computation, IEEE Trans. 13(2), 284–302 (2009)

    Google Scholar 

  16. Loiacono, D., Lanzi, P., Togelius, J., Onieva, E., Pelta, D., Butz, M., Lonneker, T., Cardamone, L., Perez, D., Sáez, Y., et al.: The 2009 simulated car racing championship. IEEE Trans. Comput. Intell. AI in Games 2(2), 131–147 (2010)

    Google Scholar 

  17. Lum, R., Meighan, M., Alfaro, H.: Using NEAT to Train a Player for the Iterated Prisoner Dilemma. Machine Learning (2008)

    Google Scholar 

  18. Mac Namee, B.: Proactive Persistent Agents-Using Situational Intelligence to Create Support Characters in Character-Centric Computer Games. Ph.D. thesis, Department of Computer Science, University of Dublin, Trinity College (2004)

    Google Scholar 

  19. Matthews, J.: Colin McRae Rally 2.0. Interview with Jeff Hannan (2001). http://www.generation5.org/content/2001/hannan.asp. Accessed Nov 2010

  20. Microsoft Corporation: Drivatar. http://research.microsoft.com/en-us/projects/drivatar/forza.aspx. Accessed June 2011

  21. Millington, I., Funge, J.: Artificial Intelligence for Games. Morgan Kaufmann, San Francisco (2009)

    Google Scholar 

  22. Muñoz, J., Gutierrez, G., Sanchis, A.: Controller for TORCS created by imitation. In: Proceedings 2009 IEEE Symposium on Computational Intelligence and Games, pp. 271–278 (2009)

    Google Scholar 

  23. Muñoz, J., Gutierrez, G., Sanchis, A.: A human-like TORCS controller for the Simulated Car Racing Championship. In: Proceedings 2010 IEEE Conference on Computational Intelligence and Games, pp. 473–480 (2010)

    Google Scholar 

  24. Nintendo: Mario Kart. http://www.mariokart.com/. Accessed Nov 2010

  25. Onieva, E., Cardamone, L., Loiacono, D., Lanzi, P.: Overtaking opponents with blocking strategies using fuzzy logic. In: IEEE Symposium on Computational Intelligence and Games, pp. 123–130. IEEE (2010)

    Google Scholar 

  26. Polyphony Digital Inc.: Gran Turismo 5. The real driving simulator. http://www.gran-turismo.com/. Accessed Nov 2010

  27. Rao, R., Shon, A., Meltzoff, A.: A Bayesian Model of Imitation in Infants and Robots. Imitation and social learning in robots, humans, and, animals (2005)

    Google Scholar 

  28. Reeves, C.: Genetic algorithms. Handbook of Metaheuristics, pp.109–139. Springer, New York (2010)

    Google Scholar 

  29. Tencé, F., Buche, C., De Loor, P., Marc, O.: The Challenge of Believability in Video Games: Definitions, Agents Models and Imitation Learning. Arxiv, preprint arXiv:1009.0451 (2010)

    Google Scholar 

  30. Thurau, C., Paczian, T., Bauckhage, C.: Is Bayesian imitation learning the route to believable gamebots, pp. 3–9. Proc. GAME-ON North, America (2005)

    Google Scholar 

  31. Tipping, M., Hatton, M.: Drivatars\(^{{\rm TM}}\) and Forza Motorsport (2006). http://www.vagamelabs.com/drivatars-trade-and-forza-motorsport.htm. Accessed Sept 2010

  32. Tipping, M., Hatton, M.: Drivatars\(^{{\rm TM}}\) theory (2006). http://research.microsoft.com/en-us/projects/drivatar/theory.aspx. Accessed Nov 2010

  33. TORCS (The Open Racing Car Simulator). http://torcs.sourceforge.net/ (2011). Accessed June 2011

  34. Turing, A.: Computing Machinery and Intelligence, pp. 23–65. Epstein et al., Parsing the Turing Test, Springer (2009)

    Google Scholar 

  35. Van Hoorn, N., Togelius, J., Wierstra, D., Schmidhuber, J.: Robust player imitation using multiobjective evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation (2009)

    Google Scholar 

  36. Yang, X., Zheng, J.: Artificial Neural Networks. Handbook of Research on Geoinformatics. p. 122 (2009)

    Google Scholar 

Download references

Acknowledgments

We would like to thank the reviewers and the editor of the book for their constructive comments. We have done our best to include all the comments and to improve the quality of the chapter.

Author information

Authors and Affiliations

  1. University Carlos III of Madrid, Avds. de la Universidad 30, 28911 , Leganes, Madrid, Spain

    Jorge Muñoz, German Gutierrez & Araceli Sanchis

Authors
  1. Jorge Muñoz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. German Gutierrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Araceli Sanchis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jorge Muñoz .

Editor information

Editors and Affiliations

  1. , School of Computer and Security Science, Edith Cowan University, Building 13.148, 2 Bradford Street, Mount Lawley, 6050, West Australia, Australia

    Philip Hingston

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Muñoz, J., Gutierrez, G., Sanchis, A. (2013). Towards Imitation of Human Driving Style in Car Racing Games. In: Hingston, P. (eds) Believable Bots. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32323-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32323-2_12

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32322-5

  • Online ISBN: 978-3-642-32323-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation