Skip to main content
SpringerLink
Log in

Evolving Artificial General Intelligence for Video Game Controllers

  • Chapter
  • First Online:
Book cover Genetic Programming Theory and Practice XIV

Part of the book series: Genetic and Evolutionary Computation ((GEVO))

Abstract

The General Video Game Playing Competition (GVGAI) defines a challenge of creating controllers for general video game playing, a testbed—as it were—for examining the issue of artificial general intelligence. We develop herein a game controller that mimics human learning behavior, focusing on the ability to generalize from experience and diminish learning time as new games present themselves. We use genetic programming to evolve hyper-heuristic-based general players. Our results show the effectiveness of evolution in meeting the generality challenge.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arfaee, S.J., Zilles, S., Holte, R.C.: Bootstrap learning of heuristic functions. In: Proceedings of the 3rd International Symposium on Combinatorial Search (SoCS2010), pp. 52–59 (2010)

    Google Scholar 

  2. Browne, C.B., Powley, E., Whitehouse, D., Lucas, S.M., Cowling, P.I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., Colton, S.: A survey of monte carlo tree search methods. IEEE Trans. Comput. Intell. AI Games 4(1), 1–43 (2012)

    Article  Google Scholar 

  3. Burke, E.K., Kendall, G., Soubeiga, E.: A tabu-search hyperheuristic for timetabling and rostering. J. Heuristics 9(6), 451–470 (2003). https://doi.org/10.1023/B:HEUR.0000012446.94732.b6

    Article  Google Scholar 

  4. Burke, E.K., Hyde, M., Kendall, G., Ochoa, G., Ozcan, E., Woodward, J.R.: A classification of hyper-heuristic approaches. In: Gendreau, M., Potvin, J. (eds.) Handbook of Meta-Heuristics, 2nd edn., pp. 449–468. Springer, Boston (2010)

    Google Scholar 

  5. Burke, E.K., Hyde, M.R., Kendall, G., Woodward, J.: A genetic programming hyper-heuristic approach for evolving 2-D strip packing heuristics. IEEE Trans. Evol. Comput. 14(6), 942–958 (2010). https://doi.org/10.1109/TEVC.2010.2041061

    Article  Google Scholar 

  6. Burke, E.K., Hyde, M.R., Kendall, G., Woodward, J.: Automating the packing heuristic design process with genetic programming. Evol. Comput. 20(1), 63–89 (2012). https://doi.org/10.1162/EVCO_a_00044

    Article  Google Scholar 

  7. Cowling, P.I., Kendall, G., Soubeiga, E.: A hyperheuristic approach to scheduling a sales summit. In: Burke, E.K., Erben, W. (eds.) PATAT 2000: Practice and Theory of Automated Timetabling III. Lecture Notes in Computer Science, vol. 2079, pp. 176–190. Springer, Berlin (2000). https://doi.org/10.1007/3-540-44629-X_11

    Google Scholar 

  8. Elyasaf, A., Zaritsky, Y., Hauptman, A., Sipper, M.: Evolving solvers for FreeCell and the sliding-tile puzzle. In: Borrajo, D., Likhachev, M., López, C.L. (eds.) Proceedings of the Fourth Annual Symposium on Combinatorial Search, SoCS 2011, Castell de Cardona, Barcelona, Spain, July 15–16, 2011. AAAI Press, Palo Alto (2011). http://www.aaai.org/ocs/index.php/SOCS/SOCS11/paper/view/4018

    Google Scholar 

  9. Elyasaf, A., Hauptman, A., Sipper, M.: Evolutionary design of FreeCell solvers. IEEE Trans. Comput. Intell. AI Games 4(4), 270–281 (2012). https://doi.org/10.1109/TCIAIG.2012.2210423. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6249736

    Article  Google Scholar 

  10. Elyasaf, A., Vaks, P., Milo, N., Sipper, M., Ziv-Ukelson, M.: Learning heuristics for mining RNA sequence-structure motifs. In: Genetic Programming Theory and Practice XIII (GPTP 2015). Springer, Cham (2015)

    Google Scholar 

  11. Fawcett, C., Karpas, E., Helmert, M., Roger, G., Hoos, H.: Fd-autotune: domain-specific configuration using fast-downward. In: Proceedings of ICAPS-PAL 2011 (2011)

    Google Scholar 

  12. Hauptman, A., Elyasaf, A., Sipper, M., Karmon, A.: GP-rush: using genetic programming to evolve solvers for the Rush Hour puzzle. In: GECCO’09: Proceedings of 11th Annual Conference on Genetic and Evolutionary Computation Conference, pp. 955–962. ACM, New York (2009). https://doi.org/10.1145/1569901.1570032. http://dl.acm.org/citation.cfm?id=1570032

  13. Jones, J.: Abstract syntax tree implementation idioms. In: Proceedings of the 10th Conference on Pattern Languages of Programs (plop2003), pp. 1–10 (2003)

    Google Scholar 

  14. Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artif. Intell. 101(1), 99–134 (1998)

    Article  MathSciNet  Google Scholar 

  15. Levine, J., Westerberg, H., Galea, M., Humphreys, D.: Evolutionary-based learning of generalised policies for AI planning domains. In: Rothlauf, F. (ed.) Proceedings of the 11th Annual Conference on Genetic and Evolutionary Computation (GECCO 2009), pp. 1195–1202. ACM, New York (2009)

    Google Scholar 

  16. Park, H., Kim, K.J.: MCTS with influence map for general video game playing. In: IEEE Conference on Computational Intelligence and Games (CIG), 2015, pp. 534–535. IEEE, Piscataway (2015)

    Google Scholar 

  17. Perez, D., Samothrakis, S., Lucas, S.: Knowledge-based fast evolutionary MCTS for general video game playing. In: IEEE Conference on Computational Intelligence and Games (CIG), 2014, pp. 1–8. IEEE, Piscataway (2014)

    Google Scholar 

  18. Perez, D., Samothrakis, S., Togelius, J., Schaul, T., Lucas, S., Couëtoux, A., Lee, J., Lim, C.U., Thompson, T.: The 2014 general video game playing competition. IEEE Trans. Comput. Intell. AI Games 8, 229–243 (2015)

    Article  Google Scholar 

  19. Pohl, I.: Heuristic search viewed as path finding in a graph. Artif. Intell. 1(3), 193–204 (1970)

    Article  MathSciNet  Google Scholar 

  20. Samadi, M., Felner, A., Schaeffer, J.: Learning from multiple heuristics. In: Fox, D., Gomes, C.P. (eds.) Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (AAAI 2008), pp. 357–362. AAAI Press, Palo Alto (2008)

    Google Scholar 

  21. Yoon, S.W., Fern, A., Givan, R.: Learning control knowledge for forward search planning. J. Mach. Learn. Res. 9, 683–718 (2008). http://doi.acm.org/10.1145/1390681.1390705

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Ben-Gurion University, Beer-Sheva, Israel

    Itay Azaria, Achiya Elyasaf & Moshe Sipper

Authors
  1. Itay Azaria
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Achiya Elyasaf
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Moshe Sipper
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for the Study of Complex Sys, University of Michigan, Ann Arbor, MI, USA

    Rick Riolo

  2. Evolution Enterprises, Ann Arbor, MI, USA

    Bill Worzel

  3. Colorado State University, Fort Collins, CO, USA

    Brian Goldman

  4. Ann Arbor, MI, USA

    Bill Tozier

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Azaria, I., Elyasaf, A., Sipper, M. (2018). Evolving Artificial General Intelligence for Video Game Controllers. In: Riolo, R., Worzel, B., Goldman, B., Tozier, B. (eds) Genetic Programming Theory and Practice XIV. Genetic and Evolutionary Computation. Springer, Cham. https://doi.org/10.1007/978-3-319-97088-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-97088-2_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-97087-5

  • Online ISBN: 978-3-319-97088-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation