Skip to main content
SpringerLink
Log in

Data Glove for the Recognition of the Letters of the Polish Sign Language Alphabet

  • Conference paper
  • First Online:
The Latest Developments and Challenges in Biomedical Engineering (PCBEE 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 746))

Included in the following conference series:

  • 85 Accesses

Abstract

This article presents the results of a study on the classification of 36 letters of the Polish Sign Alphabet (PSL) using a data glove. The data glove includes a Raspberry Pi, a PCB with four 16-bit ADS1115 ADCs, and ten piezoresistive sensors. The sensors function as potentiometers that respond to finger bending. A neural network consisting of LSTM and convolutional layers was used for classification, achieving an efficiency of 99% on data from a single subject, which underwent prior augmentation. The study suggests that the device could potentially be calibrated solely from the target user. This is the first study of its kind on PSL.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. U. Nations, “International Day of Sign Languages | United Nations,” Nations, United. 2021. [Online]. Available: https://www.un.org/en/observances/sign-languages-day

  2. “What are the different types of sign language?,” Sign Solutions. 2021. [Online]. Available: https://www.signsolutions.uk.com/what-are-the-different-types-of-sign-language/

  3. Geers, A.E., Mitchell, C.M., Warner-Czyz, A., Wang, N.-Y., Eisenberg, L.S. (2017) Early sign language exposure and cochlear implantation benefits. Pediatrics 140(1). doi: https://doi.org/10.1542/peds.2016-3489

  4. NCDHHS (2021) Assistive Technology for the Deaf and Hard of Hearing

    Google Scholar 

  5. What Is American Sign Language (ASL)? | NIDCD (2023) Mar. 2019. https://www.nidcd.nih.gov/health/american-sign-language (accessed Feb. 21, 2023)

  6. Do, N. T., Kim, S. H., Yang, H. J., Lee, G. S.: Robust hand shape features for dynamic hand gesture recognition using multi-level feature LSTM. Appl. Sci. 10(18). doi: https://doi.org/10.3390/APP10186293

  7. Hill, J.: Do deaf communities actually want sign language gloves? Nat. Electron. 3(9), 512–513 (2020). https://doi.org/10.1038/s41928-020-0451-7

    Article  Google Scholar 

  8. Saeed, Z. R., Zainol, Z. B., Zaidan, B. B., Alamoodi, A. H.: A systematic review on systems-based sensory gloves for sign language pattern recognition: an update from 2017 to 2022. IEEE Access 1–1, 2022, doi: https://doi.org/10.1109/ACCESS.2022.3219430

  9. Lee, M., Bae, J.: Deep learning based real-time recognition of dynamic finger gestures using a data glove. IEEE Access 8, 219923–219933 (2020). https://doi.org/10.1109/ACCESS.2020.3039401

    Article  Google Scholar 

  10. Lee, M., Bae, J.: real-time gesture recognition in the view of repeating characteristics of sign languages. IEEE Trans. Ind. Informatics 18(12), 8818–8828 (2022). https://doi.org/10.1109/TII.2022.3152214

    Article  Google Scholar 

  11. Piskozub, J.: Rozpoznawanie gestów statycznych ręki za pomocą rękawicy sensorowej. PRZEGLĄD ELEKTROTECHNICZNY 1(9), 144–147 (2019). https://doi.org/10.15199/48.2019.09.29

    Article  Google Scholar 

  12. Wen, T., Keyes, R.: Time series anomaly detection using convolutional neural networks and transfer learning. Accessed: Mar. 06, 2023. [Online]. Available: https://www.fast.ai

  13. Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. IEEE Trans. Neural Networks 5(2), 157–166 (1994). https://doi.org/10.1109/72.279181

    Article  Google Scholar 

  14. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997). https://doi.org/10.1162/neco.1997.9.8.1735

    Article  Google Scholar 

  15. Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling (2014). doi: https://doi.org/10.48550/arXiv.1412.3555

Download references

Author information

Authors and Affiliations

  1. Lodz University of Technology, Lodz, Poland

    Jakub Piskozub & Paweł Strumiłło

Authors
  1. Jakub Piskozub
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paweł Strumiłło
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jakub Piskozub .

Editor information

Editors and Affiliations

  1. Institute of Electronics, Lodz University of Technology, Lodz, Poland

    Paweł Strumiłło

  2. Institute of Electronics, Lodz University of Technology, Lodz, Poland

    Artur Klepaczko

  3. Institute of Electronics, Lodz University of Technology, Lodz, Poland

    Michał Strzelecki

  4. Institute of Materials Science, Lodz University of Technology, Lodz, Poland

    Dorota Bociąga

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Piskozub, J., Strumiłło, P. (2024). Data Glove for the Recognition of the Letters of the Polish Sign Language Alphabet. In: Strumiłło, P., Klepaczko, A., Strzelecki, M., Bociąga, D. (eds) The Latest Developments and Challenges in Biomedical Engineering. PCBEE 2023. Lecture Notes in Networks and Systems, vol 746. Springer, Cham. https://doi.org/10.1007/978-3-031-38430-1_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-38430-1_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-38429-5

  • Online ISBN: 978-3-031-38430-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation