ABSTRACT
Here, we present our recent attempt to develop a lightweight handwriting recognizer suitable for resource constrained handheld devices. Such an application requires real-time recognition of handwritten characters produced on their touchscreens. The proposed approach is well suited for minimal user-lag on devices having only limited computing power in sharp contrast to standard laptops or desktop computers. Moreover, the approach is user-adaptive in the sense that it can adapt through user corrections to wrong predictions. With an increasing number of interactive corrections by the user, the recognition accuracy improves significantly. An input stroke is first re-sampled generating a fixed small number of sample points such that at most two critical points (points corresponding to high curvature) are preserved. We use their x- and y-coordinates as the feature vector and do not compute any other high-level feature vector. The squared Mahalanobis distance is used to identify each stroke of the input sample as one of several stroke categories pre-determined based on a large pool of training samples. The inverted covariance matrix and mean vector for a stroke class that are required for computing the Mahalanobis distance are pre-calculated and stored as Serialized Objects on the SD card of the device. A Look-Up Table (LUT) of stroke combinations as keys and corresponding character class as values is used for the final Unicode character output. In case of an incorrect character output, user corrections are used to automatically update the LUT adapting to the user's particular handwriting style.
- R. Plamondon, S. N. Srihari, "On-line and off-line handwriting recognition: A comprehensive survey", IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 1, pp. 63--84, 2000. Google ScholarDigital Library
- M. J. Castro-Bleda S. España J. Gorbe F. Zamora, D. Llorens A. Marzal F. Prat J. M. Vilar, Improving a DTW-based Recognition Engine for On-line Handwritten Characters by Using MLPs, Proc. of 10th International Conference on Document Analysis and Recognition, pp. 1260--1264, 2009. Google ScholarDigital Library
- R. A. Abdul, M. Khalia, C. Viard-Gaudin, E. Poisson, Online Handwriting Recognition Using Support Vector Machine, Proc. IEEE Region 10 Conference TENCON 2004, Vol. 1, pp. 311--314.Google Scholar
- M. Nakai, N. Akira, H. Himodaira and S. Sagayama, Substroke Approach to HMM-based On-line Kanji Handwriting Recognition, 6th Int. Conf. on Doc. Anal. & Recog. (ICDAR 2001), pp. 491--495, 2001. Google ScholarDigital Library
- W. Jiang, Z. Sun. HMM-based On-line Multi-stroke Sketch Recognition. Proc. of the Fourth International Conference on Machine Learning and Cybernetics, Guangzhou, 2005.Google ScholarCross Ref
- Chandan Biswas, Ujjwal Bhattacharya, Swapan Kumar Parui, "HMM Based Online Handwritten Bangla Character Recognition using Dirichlet Distributions", Proc. of 13th ICFHR, pp. 598--603, 2012. Google ScholarDigital Library
- N. Arica, F. Yarman-Vural, "An overview of character recognition focused on off-line handwriting," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 31, pp. 216--233, 2001. Google ScholarDigital Library
- H. Bunke, "Recognition of cursive Roman handwriting past, present and future", Proc. 7th Int. Conf. Document Analysis and Recognition, pp. 448--459, 2003. Google ScholarDigital Library
- S. Jaeger, C. L. Liu, and M. Nakagawa, The state of art in Japanese online handwriting recognition compared to techniques in Western handwriting recognition, International Journal on Document Analysis and Recognition, vol. 6, pp. 75--88, 2003.Google ScholarDigital Library
- C. L. Liu, S. Jaeger, M. Nakagawa, "Online Recognition of Chinese Characters: The State-of-the-Art", IEEE Trans. on Pattern Analyis and Machine Intelligence, vol. 26, pp. 198--213, 2004. Google ScholarDigital Library
- K. C. Jung, S. M. Yoon, H. J. Kim, "Continuous HMM applied to quantization of on-line Korean character spaces", Pattern Recognition Letters, vol. 21, pp. 303--310, 2000. Google ScholarDigital Library
- J. Morwing, J. Andersson and C. Friberg, "On-line Arabic handwriting recognition with templates", Pattern Recognition, vol. 42, pp. 3278--3286, 2009. Google ScholarDigital Library
- S. D. Connell, R. M. K. Sinha, A. K. Jain, Recognition of unconstrained on-line Devanagari characters, Proc. of the 15th Int. Conf. on Pattern Recognition, vol. 2, pp. 368--371, 2000.Google Scholar
- N. Joshi, G. Sita, A. G. Ramakrishnan, V. Deepu, and S. Madhvanath, Machine recognition of online handwritten Devanagari characters, Proc. of 7th Int. Conf. on Document Analysis and Recognition, vol. 2, pp. 1156--1160, 2005. Google ScholarDigital Library
- N. Joshi, G. Sita, A. G. Ramakrishnan, and M. Sriganesh, Comparison of elastic matching algorithms for online Tamil handwritten character recognition, Proc. of 9th Int. Workshop on Frontiers in Handwriting Recognition, pp. 444--449, 2004. Google ScholarDigital Library
- H. Swethalakshmi, A. Jayaraman, V. S. Chakravarthy and C. C. Sekhar, Online handwritten character recognition of Devanagari and Telugu Characters using support vector machines, Proc. of the 10th Int. Workshop on Frontiers in Handwriting Recognition, 2006.Google Scholar
- S. K. Parui, K. Guin, U. Bhattacharya and B. B. Cha udhuri, "Online Handwritten Bangla Character Recognition Using HMM", Proc. of 19th ICPR, 2008.Google Scholar
- T. Mondal, U. Bhattacharya, S. K. Parui, K. Das and D. Mandalapu. On-line handwriting recognition of Indian scripts - the first benchmark. Proc. of 12th Int. Conf. on Frontiers in Handwriting Recognition, pp. 200--205, 2010. Google ScholarDigital Library
- U. Bhattacharya, A. Nigam, Y. S. Rawat and S. K. Parui. An analytic scheme for online handwritten Bangla cursive word recognition. Proc. of the 11th Int. Conf. on Frontiers in Handwriting Recog. (ICFHR), pp. 320--325, 2008.Google Scholar
- D. Dutta, A. Roy Chowdhury, Ujjwal Bhattacharya, Swapan Kumar Parui, "Building a Personal Handwriting Recognizer on an Android Device", Proc. of 13th ICFHR, pp. 682--687, 2012. Google ScholarDigital Library
- V. Vuori, J. Laaksonen, E. Oja & J. Kangas. On-line adaptation in recognition of handwritten alphanumeric characters. Proc. of 5th Int. Conf. on Document Analysis and Recognition, pp. 792--795, 1999. Google ScholarDigital Library
- S. Connell and A. Jain, Writer adaptation for online handwriting recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 329--346, 2002. Google ScholarDigital Library
Index Terms
- Lightweight user-adaptive handwriting recognizer for resource constrained handheld devices
Recommendations
Indic script family and its offline handwriting recognition for characters/digits and words: a comprehensive survey
AbstractHandwriting recognition has become an active area of research in pattern recognition and machine learning in recent years. Handwriting recognition systems have a variety of applications ranging from digital character conversion to signboard ...
Immediate user performances with touch Chinese text entry solutions on handheld devices
MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services"Immediate usability" is more important for mobile text entry solutions [7]. We compared immediate user performance of four touch Chinese text entry solutions on mobile devices including two Chinese handwriting recognition (HWR: full screen and 3-box) ...
Numeral characters and capital letters segmentation recognition in mixed handwriting context
ICDAR '95: Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 2) - Volume 2For the analytic on-line recognition of handwriting, the range of pattern recognition problems can be described by the severity of letter segmentation required. More difficult problems require an interaction of letter segmentation and recognition. These ...
Comments