Skip to main content
SpringerLink
Log in

RTS game strategy evaluation using extreme learning machine

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The fundamental game of real-time strategy (RTS) is collecting resources to build an army with military units to kill and destroy enemy units. In this research, an extreme learning machine (ELM) model is proposed for RTS game strategy evaluation. Due to the complicated game rules and numerous playable items, the commonly used tree-based decision models become complex, sometimes even unmanageable. Since complex interactions exist among unit types, the weighted average model usually cannot be well used to compute the combined power of unit groups, which results in misleading unit generation strategy. Fuzzy measures and integrals are often used to handle interactions among attributes, but they cannot handle the predefined unit production sequence which is strictly required in RTS games. In this paper, an ELM model is trained based on real data to obtain the combined power of units in different types. Both the unit interactions and the production sequence can be implicitly and simultaneously handled by this model. Warcraft III battle data from real players are collected and used in our experiments. Experimental results show that ELM is fast and effective in evaluating the unit generation strategies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aha D, Molineaux M, Ponsen M (2005) Learning to win: Case-based plan selection in a real-time strategy game. In: Case-based reasoning research and development, pp 5–20

  • Chacko BP, Vimal Krishnan VR, Raju G, Babu Anto P (2011) Handwritten character recognition using wavelet energy and extreme learning machine. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0049-5

  • Chen C-Y, Zhang J-P, He X-F, Zhou Z-H (2011) Non-parametric kernel learning with robust pairwise constraints. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0048-6

  • Choquet (1953) Theory of capacities. Annales de l’Institut Fourier 5:131–295

    Article  MathSciNet  Google Scholar 

  • Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  • Dodge Y (2003) The Oxford dictionary of statistical terms. Oxford University Press, Oxford. ISBN: 0-19-920613-9

  • Feng G, Huang G-B, Lin Q, Gay R (2009) Error minimized extreme learning machine with growth of hidden nodes and incremental learning. Neural Netw 20:1352–1357

    Article  Google Scholar 

  • Frenay B, Verleysen M (2010) Using svms with randomised feature spaces: an extreme learning approach. In: Proceedings of the 18th European symposium on artificial neural networks (ESANN), (Bruges, Belgium), 28–30 April 2010, pp 315–320

  • Hagelback J, Johansson S (2008) Using multi-agent potential fields in real-time strategy games. In: Proceedings of the 7th international joint conference on autonomous agents and multiagent systems, vol 2, pp 631–638

  • Hagelback J, Johansson S (2008) Demonstration of multi-agent potential fields in real-time strategy games. In: International foundation for autonomous agents and multiagent systems, Richland, SC

  • Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1):55–67

    Article  MathSciNet  MATH  Google Scholar 

  • Hsieh JL, Sun CT (2008) Building a player strategy model by analyzing replays of real-time strategy games. In: Proceedings of IEEE international joint conference on neural networks, Hongkong, China, June 2008, pp 3106–3111

  • Huang G-B, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70:3056–3062

    Article  Google Scholar 

  • Huang G-B, Chen L (2008) Enhanced random search based incremental extreme learning machine. Neurocomputing 71:3460–3468

    Article  Google Scholar 

  • Huang G-B, Zhu QY, Siew CK (2006a) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501

    Article  Google Scholar 

  • Huang G-B, Chen L, Siew C-K (2006b) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17(4):879–892

    Article  Google Scholar 

  • Huang G-B, Li M-B, Chen L, Siew C-K (2008) Incremental extreme learning machine with fully complex hidden nodes. Neurocomputing 71:576–583

    Article  Google Scholar 

  • Huang G-B, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163

    Article  Google Scholar 

  • Huang G-B, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122

    Article  Google Scholar 

  • Ishii K, Sugeno M (1985) A model of human evaluation process using fuzzy measure. Int J Man Mach Stud 22:19–38

    Article  MATH  Google Scholar 

  • Jang S-H, Cho S-B (2008) Evolving neural NPCs with layered influence map in the real-time simulation game ‘Conqueror’. In: IEEE symposium on computational intelligence and games. pp 385–388

  • Jun W, Shitong W, Chung F-l (2011) Positive and negative fuzzy rule system, extreme learning machine and image classification. Int J M Learn Cybern 2(4):261–271

    Article  Google Scholar 

  • Ksantini R, Boufama B (2011) Combining partially global and local characteristics for improved classification. Int J Mach Learn Cybern. doi:10.1007/s13042-011-0045-9

  • Kwon S, Sugeno M (2000) A hierarchical subjective evaluation model using non-monotonic fuzzy measures and the Choquet integral. In: Fuzzy measures and integrals—theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 375–391

  • Li M-B, Huang G-B, Saratchandran P, Sundararajan N (2005) Fully complex extreme learning machine. Neurocomputing 68:306–314

    Article  Google Scholar 

  • Li YJ, Peter H, Ng F, Wang HB, Li Y, Simon C, Shiu K (2010) Applying fuzzy integral for performance evaluation in real time strategy game. In: Proceedings of 2010 2nd international conference on information and multimedia technology (ICIMT 2010), Hong Kong, China, December 28–30, vol 1, pp 168–172

  • Li YJ, Peter H, Ng F, Wang HB, Shiu SCK, Li Y (2011) Apply different fuzzy integrals in unit selection problem of real time strategy game. In: Proceedings of 2011 international conference on fuzzy system, Taiwan, China, June 27–30

  • Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate on-line sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17(6):1411–1423

    Article  Google Scholar 

  • Liu Q, He Q, Shi Z (2008) Extreme support vector machine classifier. Lect Notes Comput Sci 5012:222–233

    Article  Google Scholar 

  • Miller R (1997) Beyond ANOVA: basics of applied statistics. Chapman & Hall/CRC, Boca Raton

  • Murofushi Michio T, Machida M (1994) Non-monotonic fuzzy measures and the Choquet integral. Fuzzy Sets Syst 64(1):73–86

    Article  MATH  Google Scholar 

  • Murofushi T, Sugeno M (2000a) The Choquet integral in multiattribute decision making. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 333–347

  • Murofushi T, Sugeno M (2000b) Fuzzy measures and fuzzy integrals. In: Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 3–41

  • Niu B, Wang H, Peter H, Ng F, Simon C, Shiu K (2009) A neural-evolutionary model of case-based planning in real time strategy games. In: Lecture notes in computer science, vol 5579/2009, pp 291–300. doi:10.1007/978-3-642-02568-6_30

  • Ontanon S, Mishra K, Ram A (2008) Learning from demonstration and case-based planning for real-time strategy games. In: Studies in fuzziness and soft computing, vol 226, pp 293–310. doi:10.1007/978-3-540-77465-5_15

  • Peter H, Ng F, Simon C, Shiu K, Haibo Wang (2009) Learning player behaviors in real time strategy games from real data. In: Twelve rough sets, fuzzy sets, data mining, and granular-soft computing (RSFDGrC), pp 321–327

  • Peters J, Han L, Ramanna S (1999) The Choquet integral in a rough software cost decision system. Fuzzy measures and integrals: theory and applications. Studies in fuzziness and soft computing, Physica, New York, pp 392–414

  • Sharma M, Holmes M, Santamaria J, Irani A, Isbell C, Ram A (2007) Transfer learning in real-time strategy games using hybrid CBR/RL. In: Proceedings of the twentieth international joint conference on artificial intelligence

  • Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567

    Article  Google Scholar 

  • Wang J, Wang Z (1997) Using neural networks to determine Sugeno measures by statistics. Neural Netw 10(1):183–195

    Article  Google Scholar 

  • Wang Z, Leung KS, Wang J (1997) Genetic algorithms used for determining nonadditive set functions in information fusion. Proc IFSA’97 1:518–521

    Google Scholar 

  • Wang ZY, Xu K, Wang J (1999) Using genetic algorithm to determine non-negative monotone set functions for information fusion in environments with random perturbation. Int J Intell Syst 14:949–962

    Article  MATH  Google Scholar 

  • Wang X, Shao Q, Miao Q, Zhai J (2011a) Architecture selection for networks trained with extreme learning machine using localized generalization error model. Neurocomputing (submitted)

  • Wang X-Z, Chen A-X, Feng H-M (2011b) Upper integral network with extreme learning mechanism. Neurocomputing 74(16):2520–2525. http://dx.doi.org/10.1016/j.neucom.2010.12.034

    Google Scholar 

  • Wang X-Z, Dong L-C, Yan J-H (2011c) Maximum ambiguity based sample selection in fuzzy decision tree induction. IEEE Trans Knowl Data Eng. doi:10.1109/TKDE.2011.67

    Google Scholar 

  • Yeung D, Wang X, Tsang E (2004) Handling interaction in fuzzy production rule reasoning. IEEE Trans Syst Man Cybern Part B Cybern 34:1979–1987. doi:10.1109/TSMCB.2004.831460

    Google Scholar 

Download references

Acknowledgments

This research project is supported by the HK Polytechnic University grants 1-ZV5T, A-PJ18 and G-U523, and the NSFC grant no. 60903088.

Author information

Authors and Affiliations

  1. Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong

    Yingjie Li & Simon Shiu

  2. Key Laboratory of Machine Learning and Computational Intelligence, College of Mathematics and Computer Science, Hebei University, Baoding, 071002, Hebei, China

    Yan Li & Junhai Zhai

Authors
  1. Yingjie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junhai Zhai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Simon Shiu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yingjie Li.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Li, Y., Li, Y., Zhai, J. et al. RTS game strategy evaluation using extreme learning machine. Soft Comput 16, 1627–1637 (2012). https://doi.org/10.1007/s00500-012-0831-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-012-0831-7

Keywords

Search

Navigation