Skip to main content
SpringerLink
Log in

Co-evolutionary Learning for Cognitive Computer Generated Entities

  • Conference paper
Modern Advances in Applied Intelligence (IEA/AIE 2014)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8482))

Abstract

In this paper, an approach is advocated to use a hybrid approach towards learning behavior for computer generated entities (CGEs) in a serious gaming setting. Hereby, an agent equipped with cognitive model is used but this agent is enhanced with Machine Learning (ML) capabilities. This facilitates the agent to exhibit human like behavior but avoid an expert having to define all parameters explicitly. More in particular, the ML approach utilizes co-evolution as a learning paradigm. An evaluation in the domain of one-versus-one air combat shows promising results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abt, C.A.: Serious games. Viking Press, New York (1970)

    Google Scholar 

  2. Anderson, J.R.: The architecture of cognition. Harvard University Press, Cambridge (1984)

    Google Scholar 

  3. Gini, M.L., Hoogendoorn, M., van Lambalgen, R.: Learning Belief Connections in a Model for Situation Awareness. In: Kinny, D., Hsu, J.Y.-j., Governatori, G., Ghose, A.K. (eds.) PRIMA 2011. LNCS (LNAI), vol. 7047, pp. 373–384. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  4. Endsley, M.R.: Toward a theory of Situation Awareness in dynamic systems. Human Factors 37(1), 32–64 (1995)

    Article  Google Scholar 

  5. Floreano, D., Nolfi, S.: God Save the Red Queen! Competition in Co-Evolutionary Robotics. In: Koza, J.R., Deb, K., Dorigo, M., et al. (eds.) Proceedings of the Second Annual Conference Genetic Programming 1997, pp. 398–406. Morgan Kaufmann, San Francisco (1997)

    Google Scholar 

  6. Hillis, D.W.: Co-evolving parasites improve simulated evolution as an optimization procedure. In: Langton, C.G., Taylor, C., Farmer, J.D., et al. (eds.) Artificial Life II: SFI Studies in the Sciences of Complexity, vol. 10, pp. 313–324. Addison-Wesley, Redwood City (1991)

    Google Scholar 

  7. Hoogendoorn, M., Lambalgen, R.M., van, T.J.: Modeling Situation Awareness in Human-Like Agents using Mental Models. In: Walsh, T. (ed.) Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, IJCAI 2011, pp. 1697–1704 (2011)

    Google Scholar 

  8. Kassahun, Y., Sommer, G.: Efficient Reinforcement Learning Through Evolutionary Acquisition of Neural Topologies. In: Proceedings of the Thirteenth European Symposium on Artificial Neural Networks, Bruges, Belgium, pp. 259–266. D-Side Publications (2005)

    Google Scholar 

  9. Kieras, D.E., Meyer, D.E.: An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. In: Human-Computer Interaction, pp. 391-438 (1997)

    Google Scholar 

  10. Koopmanschap, R., Hoogendoorn, M., Roessingh, J.J.: Learning Parameters for a Cognitive Model on Situation Awareness. In: Ali, M., Bosse, T., Hindriks, K.V., Hoogendoorn, M., Jonker, C.M., Treur, J. (eds.) IEA/AIE 2013. LNCS, vol. 7906, pp. 22–32. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  11. Laird, J., Rosenbloom, P., Newell, A.: Soar: An Architecture for General Intelligence. Artificial Intelligence 33, 1–64 (1987)

    Article  Google Scholar 

  12. Merk, R.J.: Making Enemies: Cognitive Modeling for Opponent Agents in Fighter Pilot Simulators. Ph.D. thesis, VU University Amsterdam, Amsterdam, the Netherlands (2013)

    Google Scholar 

  13. Michael, D., Chen, S.: Serious games: Games that educate, train and inform. Thomson Course Technology, Boston (2006)

    Google Scholar 

  14. Naveh, I., Sun, R.: A cognitively based simulation of academic science. Computational and Mathematical Organization Theory, 313–337 (2006)

    Google Scholar 

  15. Siebel, N., Bötel, B., Sommer, G.: Efficient Neural Network Pruning during Neuro-Evolution. Neural Networks, 2920–2929 (2009)

    Google Scholar 

  16. Smith, R.E., Dike, B.A., Mehra, R.K., et al.: Classier Systems in Combat: Two-sided Learning of Maneuvers for Advanced Fighter Aircraft. In: Computer Methods in Applied Mechanics and Engineering, vol. 186(2-4), pp. 421–437 (2000)

    Google Scholar 

  17. Stanley, K., Miikkulainen, R.: Evolving Neural Networks through Augmenting Topologies. Evolutionary Computation 10(2), 99–127 (2002)

    Article  Google Scholar 

  18. Yao, X.: Evolving Artificial Neural Networks. IEEE 87(9), 1423–1447 (1999)

    Article  Google Scholar 

  19. Yao, X., Liu, Y.: A New Evolutionary System for Evolving Artificial Neural Networks. IEEE Transactions on Neural Networks 8(3), 694–713 (1997)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Training, Simulations, and Operator Performance, National Aerospace Laboratory, Anthony Fokkerweg 2, 1059 CM, Amsterdam, The Netherlands

    Xander Wilcke & Jan Joris Roessingh

  2. Department of Computer Science, VU University Amsterdam, De Boelelaan 1081, 1081 HV, Amsterdam, The Netherlands

    Xander Wilcke & Mark Hoogendoorn

Authors
  1. Xander Wilcke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Hoogendoorn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan Joris Roessingh
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Texas State University, 78666, San Marcos, TX, USA

    Moonis Ali

  2. Department of Electronic Engineering, National Kaohsiung University of Applied Sciences, No. 415, Chien Kung Road, 80778, Kaohsiung, Taiwan

    Jeng-Shyang Pan

  3. Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan

    Shyi-Ming Chen

  4. Department of Electronics Engineering, National Kaohsiung University of Applied Sciences, Kaohsiung, Taiwan (ROC)

    Mong-Fong Horng

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Wilcke, X., Hoogendoorn, M., Roessingh, J.J. (2014). Co-evolutionary Learning for Cognitive Computer Generated Entities. In: Ali, M., Pan, JS., Chen, SM., Horng, MF. (eds) Modern Advances in Applied Intelligence. IEA/AIE 2014. Lecture Notes in Computer Science(), vol 8482. Springer, Cham. https://doi.org/10.1007/978-3-319-07467-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-07467-2_13

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-07466-5

  • Online ISBN: 978-3-319-07467-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation