Abstract
In this paper we address the problem of capturing, processing and analyzing images from the video stream of the Hearthstone game in order to obtain relevant information on the conduct of parties in this game. Since the information needs to be presented to the user in real-time, we needed to find the most suitable methods of extracting this information. Therefore, techniques such as background subtraction, histograms comparisons, key points matching, optical character recognition were investigated. Driven by the required processing speed, we ended up using optical character recognition on limited areas of interest from the captured image. After developing the application, we tested it in real-world context, while real games were played and presented the obtained results. In the end, we also provided two examples where the application would prove useful for better decision making during the game.
References
Capturing an Image (Windows Dev Center). http://msdn.microsoft.com/en-us/library/windows/desktop/dd183402(v=vs.85).aspx
Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings of Computer Vision and Pattern Recognition, vol. 2 (1999)
Simek, K.: Image comparison - fast algorithm. http://stackoverflow.com/questions/843972/image-comparison-fast-algorithm
Sutton, E.: Zone System & Histograms. http://www.illustratedphotography.net/basic-photography/zone-system-histograms
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). J. Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Muja, M., Lowe, D.G.: Fast aproximate nearest neighbours with automatic algorithm configuration. J. Pattern Recogn. Lett. 31(8), 651–666 (2010)
Lepetit, V., Fua, P.: Keypoint recognition using randomized trees. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1465–1479 (2006)
Perceptual hash. http://phash.org/
Özuysal, M., Calonder, M., Lepetit, V., Fua, P.: Fast Keypoint recognition using random ferns. IEEE Trans. Pattern Analy. Mach. Intell. 32, 448–461 (2010)
Muda, N., Ismail, N.K.N., Abu Bakar, S.A., Zain, J.M.: Optical Character Recognition by using Template Matching (Alphabet). http://www.academia.edu/714194/Optical_Character_Recognition_By_Using_Template_Matching_Alphabet_
Due Trier, O., Jain, A.K., Taxt, T.: Feature extraction methods for character recognition - a survey. Pattern Recogn. 29(4), 641–662 (1996)
Tesseract-OCR. https://code.google.com/p/tesseract-ocr/
Acknowledgement
The research presented in this paper was partially supported by the UPB-EX internal research grant provided by the University Politehnica of Bucharest.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Chiru, CG., Oprea, F. (2016). Hearthstone Helper - Using Optical Character Recognition Techniques for Cards Detection. In: Dichev, C., Agre, G. (eds) Artificial Intelligence: Methodology, Systems, and Applications. AIMSA 2016. Lecture Notes in Computer Science(), vol 9883. Springer, Cham. https://doi.org/10.1007/978-3-319-44748-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-44748-3_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44747-6
Online ISBN: 978-3-319-44748-3
eBook Packages: Computer ScienceComputer Science (R0)