Skip to main content

Hearthstone Helper - Using Optical Character Recognition Techniques for Cards Detection

  • Conference paper
  • First Online:
Artificial Intelligence: Methodology, Systems, and Applications (AIMSA 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9883))

  • 1411 Accesses

Abstract

In this paper we address the problem of capturing, processing and analyzing images from the video stream of the Hearthstone game in order to obtain relevant information on the conduct of parties in this game. Since the information needs to be presented to the user in real-time, we needed to find the most suitable methods of extracting this information. Therefore, techniques such as background subtraction, histograms comparisons, key points matching, optical character recognition were investigated. Driven by the required processing speed, we ended up using optical character recognition on limited areas of interest from the captured image. After developing the application, we tested it in real-world context, while real games were played and presented the obtained results. In the end, we also provided two examples where the application would prove useful for better decision making during the game.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  1. Capturing an Image (Windows Dev Center). http://msdn.microsoft.com/en-us/library/windows/desktop/dd183402(v=vs.85).aspx

  2. Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings of Computer Vision and Pattern Recognition, vol. 2 (1999)

    Google Scholar 

  3. Simek, K.: Image comparison - fast algorithm. http://stackoverflow.com/questions/843972/image-comparison-fast-algorithm

  4. Sutton, E.: Zone System & Histograms. http://www.illustratedphotography.net/basic-photography/zone-system-histograms

  5. Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). J. Comput. Vis. Image Underst. 110(3), 346–359 (2008)

    Article  Google Scholar 

  6. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  7. Muja, M., Lowe, D.G.: Fast aproximate nearest neighbours with automatic algorithm configuration. J. Pattern Recogn. Lett. 31(8), 651–666 (2010)

    Article  Google Scholar 

  8. Lepetit, V., Fua, P.: Keypoint recognition using randomized trees. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1465–1479 (2006)

    Article  Google Scholar 

  9. Perceptual hash. http://phash.org/

  10. Özuysal, M., Calonder, M., Lepetit, V., Fua, P.: Fast Keypoint recognition using random ferns. IEEE Trans. Pattern Analy. Mach. Intell. 32, 448–461 (2010)

    Article  Google Scholar 

  11. Muda, N., Ismail, N.K.N., Abu Bakar, S.A., Zain, J.M.: Optical Character Recognition by using Template Matching (Alphabet). http://www.academia.edu/714194/Optical_Character_Recognition_By_Using_Template_Matching_Alphabet_

  12. Due Trier, O., Jain, A.K., Taxt, T.: Feature extraction methods for character recognition - a survey. Pattern Recogn. 29(4), 641–662 (1996)

    Article  Google Scholar 

  13. Tesseract-OCR. https://code.google.com/p/tesseract-ocr/

Download references

Acknowledgement

The research presented in this paper was partially supported by the UPB-EX internal research grant provided by the University Politehnica of Bucharest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Costin-Gabriel Chiru .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Chiru, CG., Oprea, F. (2016). Hearthstone Helper - Using Optical Character Recognition Techniques for Cards Detection. In: Dichev, C., Agre, G. (eds) Artificial Intelligence: Methodology, Systems, and Applications. AIMSA 2016. Lecture Notes in Computer Science(), vol 9883. Springer, Cham. https://doi.org/10.1007/978-3-319-44748-3_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-44748-3_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-44747-6

  • Online ISBN: 978-3-319-44748-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics