Skip to main content
SpringerLink
Log in

Multi-touch Gesture Recognition of Braille Input Based on RBF Net

  • Conference paper
  • First Online:
Multimedia Technology and Enhanced Learning (ICMTEL 2020)

  • 540 Accesses

Abstract

One challenging task for the blind is to input Braille while by no way could they sense the location information on touch screens. The existing Braille input methods are suffering from problems including inaccurate positioning and lack of interactive prompts. In this paper, touch gestures are recognized by trained RBF network while combined gestures are modelled. By doing so, the Braille input concerning multi-touch gesture recognition is then implemented. The experimental results show that the method is effective and blind people can friendly input Braille with almost real-time interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhang, J.X., Zeng, X.Q., Meng, C.H.H.: Design and implementation of multi-touch input method for blind usage. Comput. Appl. Software 10, 231–235 (2015)

    Google Scholar 

  2. Liu, F., Wang, Y.H., Tang, B.Z.H., et al.: Intelligent Chinese input method based on android. Comput. Eng. 37(07), 225–227 (2011)

    Google Scholar 

  3. Yu,T.Z.H.: The Design and Implementation of Cross-Platform Stroke Input Method Engine. Harbin Institute of Technology (2013)

    Google Scholar 

  4. Zheng, Y.D., Chen, Z.H.S., Xiao, L.S.H.: Research and implementation of a voice control audio system based on Android speech recognition. Mod. Electron. Tech. 42, 93–96 (2019)

    Google Scholar 

  5. Yan, X.L., Wang, L.M.: Handwritten Chinese character recognition system based on neural network convolution depth. Comput. Eng. Appl. 53(10), 246–250 (2017)

    Google Scholar 

  6. Chen, H.F., Xu, S.H., Wang, J.L.: A Braille Input Method Based on Gesture Recognition: JiangSu, CN102929394A, 13 February 2013

    Google Scholar 

  7. Hu, Y.P.: A Method and Device for Output and Input of Braille Characters on Touch Screen. BeiJing: CN103870008A, 18 June 2014

    Google Scholar 

  8. Fukatsu, Y., Shizuki, B., Tanaka, J.: No-look flick: single-handed and eyes-free japanese text input system on touch screens of mobile devices. human computer interaction with mobile devices and services, pp. 161–170 (2013)

    Google Scholar 

  9. Mascetti, S., Bernareggi, C., Belotti, M., et al.: TypeInBraille: a braille-based typing application for touchscreen devices. In: Conference on Computers and Accessibility (ASSETS 2011), pp. 295–296 (2011)

    Google Scholar 

  10. Frey, B., Southern, C., Romero, M., et al.: Brailletouch: mobile texting for the visually impaired. In: International Conference on Universal Access in Human Computer Interaction, pp. 19–25 (2011)

    Google Scholar 

  11. Fukatsu, Y., Shizuki, B., Tanaka, J., et al.: No-look flick: single-handed and eyes-free japanese text input system on touch screens of mobile devices. In: Human Computer Interaction with Mobile Devices and Services, pp. 161–170 (2013)

    Google Scholar 

  12. Nicolau, H., Guerreiro, T.J., Jorge, J.A., et al.: Proficient blind users and mobile text-entry. In: Proceedings of the 28th Annual European Conference on Cognitive Ergonomics. New York USA, pp. 19–22 (2010)

    Google Scholar 

  13. Ji, H.Y.: Human-Computer Interaction Research Based on Multi-touch Technology. Diss. East China Normal Unversity (2011)

    Google Scholar 

  14. Wang, X.Q., Chen, G., Wang, D., Wang, C.H.: Research on multi-touch gesture analysis and recognition algorithm. Comput. Sci. 39(S1), 522–525 (2012)

    MathSciNet  Google Scholar 

  15. Li, W.S.H., Deng, C.H.J., Lv, Y.: Interaction gesture analysis based on touch screen. Chin. J. Liquid Crystals Displ. 26(2), 194–199 (2011)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by The Major Programs of Natural Science Foundation of the Jiangsu Higher Education Institutions of China (No. 19KJA310002.) and The Natural Science Foundation of the Jiangsu Higher Education Institutions of China (No. 17KJD520006).

Author information

Authors and Affiliations

  1. College of Information and Mathematics Science, Nanjing Normal University of Special Education, Nanjing, 210038, Jiangsu, China

    Zhang Juxiao & Zhu Zhaosong

  2. College of Computer and Information, Hohai University, Nanjing, 210038, Jiangsu, China

    Zhang Juxiao & Zeng Xiaoqin

Authors
  1. Zhang Juxiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zeng Xiaoqin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhu Zhaosong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhu Zhaosong .

Editor information

Editors and Affiliations

  1. School of Informatics, University of Leicester, Leicestershire, UK

    Yu-Dong Zhang

  2. University of Leicester, Leicestershire, UK

    Shui-Hua Wang

  3. Human Normal University, Changsha, China

    Shuai Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Juxiao, Z., Xiaoqin, Z., Zhaosong, Z. (2020). Multi-touch Gesture Recognition of Braille Input Based on RBF Net. In: Zhang, YD., Wang, SH., Liu, S. (eds) Multimedia Technology and Enhanced Learning. ICMTEL 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 327. Springer, Cham. https://doi.org/10.1007/978-3-030-51103-6_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-51103-6_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-51102-9

  • Online ISBN: 978-3-030-51103-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation