Abstract
With the rapid development of machine learning, artificial intelligence (AI) has drawn much more attention. Under this circumstances, abstract strategy games, such as chess, checkers and Go, have been a fascinating problem of AI research. Most of the existing state-of-the-art Go programs used deep neural network technology, like convolutional neural networks (CNNs). However, CNNs require multiple iterations to optimize weights and spend a lot of training time. Therefore, in this paper, in order to solve the above shortcomings, we propose a new learning algorithm ECNN, which integrates CNNs with extreme learning machine (ELM). We remove pooling layers of CNNs and insert ELM layers between convolutional layers. The newly added ELM layers will be updated in back-propagation process, and they accelerate the convergence of weights in CNNs. Therefore, our ECNN can reduce the training time of CNNs. Further, we propose ECNN-Go algorithm, which applies ECNN to Go game. Because of the advantage of ECNN, ECNN-Go algorithm has the fast learning speed to make move prediction in Go game. Finally, the experimental results show the efficiency and accuracy of ECNN algorithm and demonstrate the strength of ECNN-Go.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91
Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185
Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870
Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167
Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305
Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595
Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58
Enzenberger M (1996) The integration of a priori knowledge into a go playing neural network. http://www.markus-enzenbergerde/neurogohtml
Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113
Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680
He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360
Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144
Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990
Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501
Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052
Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345
Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555
Müller M (2002) Computer Go. Artif Intell 134(1–2):145–179
Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651
Rafique MA, Pedrycz W, Jeon M (2017) Vehicle license plate detection using region-based convolutional neural networks. Soft Comput. https://doi.org/10.1007/s00500-017-2696-2
Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266
Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7
Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10
Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484
Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806
Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880
Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110
Tian Y, Zhu Y (2015) Better computer go player with neural network and long-term prediction. Comput Sci. arXiv preprint arXiv:1511.06410v3
Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1
Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10
Wang Z, Wang X (2017) A deep stochastic weight assignment network and its application to chess playing. J Parallel Distrib Comput. https://doi.org/10.1016/j.jpdc.2017.08.013
Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297
Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017
Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1
Acknowledgements
This research is partially supported by National Natural Science Foundation of China under Grant Nos. 61672145, 61572121, 61602323, 61702086 and U1401256, and the China Postdoctoral Science Foundation under Grant No. 2016M591455.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no potential conflict of interest.
Human participants and animals
This article does not contain any studies involving human participants and/or animals by any of the authors.
Informed consent
Informed consent was obtained from all individual participants.
Additional information
Communicated by X. Wang, A. K. Sangaiah, M. Pelillo.
Rights and permissions
About this article
Cite this article
Zhao, X., Ma, Z., Li, B. et al. ELM-based convolutional neural networks making move prediction in Go. Soft Comput 22, 3591–3601 (2018). https://doi.org/10.1007/s00500-018-3158-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-018-3158-1