Abstract
In the article the actual problem of increasing the efficiency of solving the pattern recognition problem is considered. It is described a promising approach to solve this problem by the use of artificial neural networks. It is proposed the model of a neural network as the Boltzmann machine. As a neural network learning algorithm the authors propose to use a simulated annealing algorithm. The deep learning methods of neural networks are considered. The algorithm of neural network functioning based on the Boltzmann machine model is suggested. The authors describe possibilities of using multi-layer neural network models, such as the deep Boltzmann machines. Advantages and disadvantages of the proposed approaches were found out. To estimate the proposed method the authors carried out the comparison of the known test set of sample images (MNIST). The results confirm the effectiveness of the proposed approaches.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Nazarov, A.V., Loscutov, A.I.: Neural network algorithms for prediction and optimization. Science and Technology (2003)
Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science, 313(5786), 504–507 (2006)
Ackley, D.H., Hinton, G.E., Sejnowski, T.J.: A learning algorithm for Boltzmann machines. Cogn. Sci. 9(1), 147–169 (1985)
Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Comput. NECO, 14(8), 1771–1800 (2002)
Teh, Y.W., Hinton, G.E.: Rate-coded restricted Boltzmann machines for face recognition. In: Leen, T.K., Dietterich, T.G., Tresp, V. (eds.) Advances in Neural Information Processing Systems, 13, pp. 908–914. MIT Press, Cambridge, MA (2001)
Salakhutdinov, R., Hinton, G.E.: Deep Boltzmann machines.In: Proceedings of the International Conference on Artificial Intelligence and Statistics, vol. 5, pp. 448–455 (2009)
Montavon, G., M¨uller, K.R.: Learning feature hierarchies with centered deep Boltzmann machines. CoRR (2012). arXiv:1203.4416
Le Roux, N., Bengio, Y.: Representational power of restricted Boltzmann machines and deep belief networks. Neural Comput. 20(6), 1631–1649 (2008)
Hinton, G., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)
Kelly, J.D., Davis, L.A: Hybrid genetic algorithm for classification. In: Proceedings of 12th International Joint Conference on Artificial Intelligence. Sydney, Morgan Kaufmann. pp. 645–650 (1991)
Chen, M., Yao, Z.: Classification techniques of neural networks using improved genetic algorithms. In: Proceedings of 2nd International Conference on Genetic and Evolutionary Computing. Washington. pp. 115–119 (2008)
Vivekanandan, P., Nedunchezhian, R.: A new incremental genetic algorithm based classification model to mine data with concept drift. J. Inf. Technol. Theory Appl. 21, 36–42 (2010)
Rodriguez, M.A., Escalante, D.M., Peregrin, A.: Efficient distributed genetic algorithm for rule extraction. Appl. Soft Comput. 11, 733–743 (2011)
Acknowledgment
This research is supported by grants of the Ministry of Education and Science of the Russian Federation, the project # 8.823.2014.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Babynin, A., Gladkov, L., Gladkova, N. (2016). Pattern Recognition on the Basis of Boltzmann Machine Model. In: Silhavy, R., Senkerik, R., Oplatkova, Z., Silhavy, P., Prokopova, Z. (eds) Artificial Intelligence Perspectives in Intelligent Systems. Advances in Intelligent Systems and Computing, vol 464. Springer, Cham. https://doi.org/10.1007/978-3-319-33625-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-33625-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-33623-7
Online ISBN: 978-3-319-33625-1
eBook Packages: EngineeringEngineering (R0)