Abstract
Recognition of touching characters in mathematical expressions is a challenging problem in the field of document image analysis. Various approaches for recognizing touching maths symbols have been reported in literature, but they mainly dealt with printed expressions and handwritten numeral strings. In this work, a new segmentation-free approach is proposed which matches convex shape portions of symbols occurring in various layout such as subscript, superscript, fraction etc. and is able to perform spotting of symbols present in a handwritten expression. Our contribution lies in the design of a novel feature which can handle touching symbols effectively in the presence of handwriting variations. This recognition-based approach helps in spotting symbols in an expression even in the presence of clutter created by the presence of other symbols.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Belongie, S., Malik, J., Puzicha, J.: Shape context: a new descriptor for shape matching and object recognition. In: NIPS (2000)
Chatbri, H., Kameyama, K., Kwan, P.: Towards a segmentation and recognition-free approach for content-based document image retrieval of handwritten queries. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 146–150. IEEE (2015)
Garain, U., Chaudhuri, B.: Segmentation of touching symbols for OCR of printed mathematical expressions: an approach based on multifactorial analysis. In: ICDAR, pp. 177–181. IEEE (2005)
Ma, R., Zhao, Y., Xia, Y., Yan, Y.: A touching pattern-oriented strategy for handwritten digits segmentation. In: Computational Intelligence and Security 2008, CIS 2008. vol. 1, pp. 174–179. IEEE (2008)
Nomura, A., Michishita, K., Uchida, S., Suzuki, M.: Detection and segmentation of touching characters in mathematical expressions. In: ICDAR, pp. 126–130. IEEE (2003)
Pal, U., Belaıd, A., Choisy, C.: Touching numeral segmentation using water reservoir concept. Pattern Recogn. Lett. 24(1), 261–272 (2003)
Pal, U., Belaïd, A., Choisy, C.: Water reservoir based approach for touching numeral segmentation. In: ICDAR, pp. 892–896. IEEE (2001)
Sadri, J., Suen, C.Y., Bui, T.D.: Automatic segmentation of unconstrained handwritten numeral strings. In: IWFHR, pp. 317–322. IEEE (2004)
Shrivastava, D., Sinha, R., Saraswat, S., Gupta, H.P., Dutta, T.: A mathematical equation solving system using accelerometer sensor. In: 10th International Conference on Communication Systems & Networks (COMSNETS) 2018, pp. 388–391. IEEE (2018)
Srikantan, J.F.G., Srihari, S.: Handprinted character/digit recognition using a multiple feature/resolution philosophy. In: ICFHR, pp. 57–66 (1994)
Suwa, M.: Segmentation of connected handwritten numerals by graph representation. In: ICDAR, pp. 750–754. IEEE (2005)
Tian, X., Zhang, Y.: Segmentation of touching characters in mathematical expressions using contour feature technique. In: Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing 2007, SNPD 2007. Eighth ACIS. vol. 1, pp. 206–209. IEEE (2007)
Vellasques, E., Oliveira, L.S., Britto, A.d.S., Koerich, A.L., Sabourin, R.: Filtering segmentation cuts for digit string recognition. Pattern Recogn. 41(10), 3044–3053 (2008)
Wang, Y., Liu, X., Jia, Y.: Statistical modeling and learning for recognition-based handwritten numeral string segmentation. In: ICDAR, pp. 421–425. IEEE (2009)
Yoo, Y.H., Kim, J.H.: Mathematical formula recognition based on modified recursive projection profile cutting and labeling with double linked list. In: Kim, J.H., Matson, E., Myung, H., Xu, P. (eds.) Robot Intelligence Technology and Applications 2012. Advances in Intelligent Systems and Computing, pp. 983–992. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37374-9_95
Zanibbi, R., Yu, L.: Math spotting: retrieving math in technical documents using handwritten query images. In: 2011 International Conference on Document Analysis and Recognition (ICDAR), pp. 446–451. IEEE (2011)
Zhu, Q., Wang, L., Wu, Y., Shi, J.: Contour context selection for object detection: a set-to-set contour matching approach. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 774–787. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88688-4_57
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Aggarwal, R., Harit, G., Tiwari, A.K. (2019). Symbol Spotting in Offline Handwritten Mathematical Expressions. In: Sundaram, S., Harit, G. (eds) Document Analysis and Recognition. DAR 2018. Communications in Computer and Information Science, vol 1020. Springer, Singapore. https://doi.org/10.1007/978-981-13-9361-7_5
Download citation
DOI: https://doi.org/10.1007/978-981-13-9361-7_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9360-0
Online ISBN: 978-981-13-9361-7
eBook Packages: Computer ScienceComputer Science (R0)