Skip to main content
Springer Nature Link
Log in

On-line Sample Generation for In-air Written Chinese Character Recognition Based on Leap Motion Controller

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing -- PCM 2015 (PCM 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9314))

Included in the following conference series:

Abstract

As intelligent devices and human-computer interaction ways become diverse, the in-air writing is becoming popular as a very natural interaction way. Compared with online handwritten Chinese character recognition (OHCCR) based on touch screen or writing board, the research of in-air handwritten Chinese character recognition (IAHCCR) is still in the start-up phase. In this paper, we present an on-line sample generation method to enlarge the number of training instances in an automatic synthesis way. In our system, the in-air writing trajectory of fingertip is first captured by a Leap Motion Controller. Then corner points are detected. Finally, the corner points as well as the sampling points between corner points are distorted to generate artificial patterns. Compared with the previous sample generation methods, the proposed method focuses on distorting the inner structure of character patterns. We evaluate the proposed method on our in-air handwritten Chinese character dataset IAHCC-UCAS2014 which covers 3755 classes of Chinese characters. The experimental results demonstrate that proposed approach achieves higher recognition accuracies and lower computational cost.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Liu, C., Jaeger, S., Nakagawa, M.: Online recognition of Chinese characters: the state-of-the-art. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 198–213 (2004)

    Article  Google Scholar 

  2. Jin, L., Gao, Y., Liu, G., Li, Y., Ding, K.: SCUT–COUCH2009–a comprehensive online unconstrained Chinese handwriting database and benchmark evaluation. Int. J. Doc. Anal. Recogn. (IJDAR) 14(1), 53–64 (2011)

    Article  Google Scholar 

  3. Liu, C., Yin, F., Wang, D., Wang, Q.: Online and offline handwritten Chinese character recognition: benchmarking on new databases. Pattern Recogn. 46(1), 155–162 (2013)

    Article  Google Scholar 

  4. Feng, Z., Xu, S., Jin, L., Ye, Z., Yang, W.: Real-time fingertip tracking and detection using Kinect depth sensor for a new writing-in-the air system. In: Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, pp. 70–74 (2012)

    Google Scholar 

  5. Jin, X., Wang, Q., Liu, C.: Visual gesture character string recognition by classification-based segmentation with stroke deletion. In: Proceedings of the 2nd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 120–124 (2013)

    Google Scholar 

  6. Leung, K.C., Leung, C.H.: Recognition of handwritten Chinese characters by combining regularization, fisher’s discriminant and distorted sample generation. In: Proceedings of the 10th International Conference on Document Analysis and Recognition, pp. 1026–1030 (2009)

    Google Scholar 

  7. Chen, B., Zhu, B., Nakagawa, M.: Training of an on-line handwritten Japanese character recognizer by artificial patterns. Pattern Recogn. Lett. 35, 178–185 (2014)

    Article  Google Scholar 

  8. Wu, W.Y.: Dominant point detection using adaptive bending value. Image Vis. Comput. 21(6), 517–525 (2003)

    Article  Google Scholar 

  9. Vikram, S., Li, L., Russell, S.J.: Writing and sketching in the air, recognizing and controlling on the fly. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, pp. 1179–1184 (2013)

    Google Scholar 

  10. Hodson, H.: Leap motion hacks show potential of new gesture tech. New Sci. 218(2911), 21 (2013)

    Article  Google Scholar 

  11. Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)

    Article  Google Scholar 

  12. Sutton, J.: Air painting with corel painter freestyle and the leap motion controller: a revolutionary new way to paint. In: ACM SIGGRAPH 2013 Studio Talks, no. 21 (2013)

    Google Scholar 

  13. Hantrakul, L., Kaczmarek, K.: Implementations of the leap motion device in sound synthesis and interactive live performance. In: Proceedings of the 2014 International Workshop on Movement and Computing, pp. 142 (2014)

    Google Scholar 

  14. Khademi, M., Hondori, H.M., McKenzie, A.: Free-hand interaction with leap motion controller for stroke rehabilitation. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 1663–1668 (2014)

    Google Scholar 

  15. Freeman, H.: On the encoding of arbitrary geometric configurations. IRE Trans. Electron. Comput. EC-10(2), 260–268 (1961)

    Article  MathSciNet  Google Scholar 

  16. Bai, Z.-L., Huo, Q.: A study on the use of 8-directional features for online handwritten Chinese character recognition. In: Proceedings of 8th International Conference on Document Analysis and Recognition, pp. 262–266 (2005)

    Google Scholar 

  17. Kimura, F., Takashina, K., Tsuruoka, S., Miyake, Y.: Modified quadratic discriminant functions and the application to Chinese character recognition. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-9(1), 149–153 (1987)

    Article  Google Scholar 

  18. Long, T., Jin, L.: Building compact MQDF classifier for large character set recognition by subspace distribution sharing. Pattern Recogn. 41(9), 2916–2925 (2008)

    Article  MATH  Google Scholar 

  19. Bai, Z.L., Huo, Q.: A study of nonlinear shape normalization for online handwritten chinese character recognition: dot density vs. line density equalization. In: The 18th International Conference on Pattern Recognition, vol. 2, pp. 921–924 (2006)

    Google Scholar 

  20. Shao, Y., Wang, C., Xiao, B.: Fast self-generation voting for handwritten Chinese character recognition. Int. J. Doc. Anal. Recogn. (IJDAR) 16(4), 413–424 (2013)

    Article  Google Scholar 

  21. Xu, N., Wang, W., Qu, X.: Recognition of in-air handwritten Chinese character based on leap motion controller. In: Proceedings of the 8th International Conference on Image and Graphics, 13–16 August 2015

    Google Scholar 

Download references

Acknowledgments

This work is supported by the National Science Foundation of China (NSFC) under Grant No. 61232013, No. 61271434 and No. 61175115.

Author information

Authors and Affiliations

  1. School of Computer and Control Engineering, University of Chinese Academy of Sciences, Beijing, China

    Ning Xu, Weiqiang Wang & Xiwen Qu

Authors
  1. Ning Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weiqiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiwen Qu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ning Xu .

Editor information

Editors and Affiliations

  1. Gwangju Institute of Science and Technology, Gwangju, Korea (Republic of)

    Yo-Sung Ho

  2. Chinese Academy of Sciences, Institute of Automation, Beijing, China

    Jitao Sang

  3. ICU, IVY Lab, KAIST, Daejeon, Korea (Republic of)

    Yong Man Ro

  4. KAIST, Daejeon, Korea (Republic of)

    Junmo Kim

  5. College of Computer Science, Zhejiang University, Hangzhou, China

    Fei Wu

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Xu, N., Wang, W., Qu, X. (2015). On-line Sample Generation for In-air Written Chinese Character Recognition Based on Leap Motion Controller. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9314. Springer, Cham. https://doi.org/10.1007/978-3-319-24075-6_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24075-6_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24074-9

  • Online ISBN: 978-3-319-24075-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics