Skip to main content

Advertisement

Springer Nature Link
Log in

An Intelligent Kurdish Sign Language Recognition System Based on Tuned CNN

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Hearing-impaired individuals have both hearing and speech disabilities. Therefore, they use a special language that involves visual gestures—known as “sign language”—for communicating ideas and emotions. Recognizing the gestures contained in sign language enables deaf people communicate more effectively with their interlocutor. It also helps people without such disabilities understand and identify those signs, thereby enriching the communication. However, designing a system that can automatically identify the signs of Kurdish sign language is a challenging task, especially for Kurdish sign language. This is attributable to the unavailability of a dataset and lack of standardized sign language. In this study, we investigate the problem by collecting a dataset of seven static signs and designing a model for sign recognition. The dataset consists of 3690 high-resolution images taken mostly from college students. To develop the classifier, a four-layer convolutional neural network model with a filter size of 5 × 5 was designed. To compare the model performance, two other pre-trained networks, namely MobileNetV2 and VGG16, were trained and fine-tuned using the same dataset. After a variety of hyperparameter fine-tuning, the proposed approach achieved the same outcome as the two pre-trained networks, with an accuracy of 99.75%. That is, the model identified 396 of the 397 images in the test set. In addition, we performed an external test using 58 images of various signs, and the model approximately classified all the images correctly. This demonstrates that our approach achieved an outstanding result, which can be considered a first in the field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Elatawy SM, Hawa DM, Ewees AA, Saad AM. Recognition system for alphabet Arabic sign language using neutrosophic and fuzzy c-means. Educ Inf Technol. 2020;25(6):5601–16. https://doi.org/10.1007/s10639-020-10184-6.

    Article  Google Scholar 

  2. Rastgoo R, Kiani K, Escalera S. Sign language recognition: a deep survey. Expert Syst Appl. 2021;164(July 20200):113794. https://doi.org/10.1016/j.eswa.2020.113794.

    Article  Google Scholar 

  3. Aloysius N, Geetha M. Understanding vision-based continuous sign language recognition. Multimed Tools Appl. 2020;79(31–32):22177–209. https://doi.org/10.1007/s11042-020-08961-z.

    Article  Google Scholar 

  4. Nurena-Jara R, Ramos-Carrion C, Shiguihara-Juarez R. Data collection of 3D spatial features of gestures from static Peruvian sign language alphabet for sign language recognition. In: Proceedings of the 2020 IEEE Engineering International Research Conference, EIRCON 2020, 2020; pp. 3–6. https://doi.org/10.1109/EIRCON51178.2020.9254019.

  5. Hasan MM, Srizon AY, Sayeed A, Hasan MAM. Classification of Sign language characters by applying a deep convolutional neural network. In: ICCIT 2020 - 23rd International Conference on Computer and Information Technology, Proceedings, no. November, 2020; pp. 28–29. doi: https://doi.org/10.1109/ICCIT51783.2020.9392703.

  6. Hisham B, Hamouda A. Arabic sign language recognition using Ada-Boosting based on a leap motion controller. Int J Inf Technol (Singapore). 2021;13(3):1221–34. https://doi.org/10.1007/s41870-020-00518-5.

    Article  Google Scholar 

  7. Wadhawan A, Kumar P. Deep learning-based sign language recognition system for static signs. Neural Comput Appl. 2020;32(12):7957–68. https://doi.org/10.1007/s00521-019-04691-y.

    Article  Google Scholar 

  8. Abbas Muhammad Zakariya RJ. Arabic sign language recognition system on smartphone. 2019. https://doi.org/10.1109/ICCCNT45670.2019.8944518.

  9. Jepsen JB, De Clerck G, Lutalo-Kiingi S, McGregor WB. Sign languages of the world: a comparative handbook. Ishara Press; 2015. https://doi.org/10.1515/9781614518174.

    Book  Google Scholar 

  10. Halvardsson G, Peterson J, Soto-Valero C, Baudry B. Interpretation of Swedish sign language using convolutional neural networks and transfer learning. SN Comput Sci. 2021;2(3):1–15. https://doi.org/10.1007/s42979-021-00612-w.

    Article  Google Scholar 

  11. Bencherif MA, et al. Arabic sign language recognition system using 2D hands and body skeleton data. IEEE Access. 2021;9:59612–27. https://doi.org/10.1109/ACCESS.2021.3069714.

    Article  Google Scholar 

  12. Venugopalan A, Reghunadhan R. Applying deep neural networks for the automatic recognition of sign language words: a communication aid to deaf agriculturists. Expert Syst Appl. 2021;185(September 2020):1601. https://doi.org/10.1016/j.eswa.2021.115601.

    Article  Google Scholar 

  13. Krejsa J, Vechet S. Czech sign language single hand alphabet letters classification. In: Proceedings of the 2020 19th International Conference on Mechatronics—Mechatronika, ME 2020, 2020, https://doi.org/10.1109/ME49197.2020.9286667.

  14. Teja Mangamuri LS, Jain L, Sharmay A. Two hand Indian sign language dataset for benchmarking classification models of machine learning. In: IEEE International Conference on issues and challenges in intelligent computing techniques, ICICT 2019, 2019, https://doi.org/10.1109/ICICT46931.2019.8977713.

  15. Joy J, Balakrishnan K, Madhavankutty S. A novel web based dictionary framework for Indian sign language. SN Comput Sci. 2021;2(3):1–7. https://doi.org/10.1007/s42979-021-00533-8.

    Article  Google Scholar 

  16. Gupta R, Rajan S. comparative analysis of convolution neural network models for continuous Indian sign language classification. Proc Comput Sci. 2020;171(2019):1542–50. https://doi.org/10.1016/j.procs.2020.04.165.

    Article  Google Scholar 

  17. Deriche M, Aliyu S, Mohandes M. An intelligent Arabic sign language recognition system using a pair of LMCs with GMM based classification. IEEE Sens J. 2019;19(18):1–12. https://doi.org/10.1109/JSEN.2019.2917525.

    Article  Google Scholar 

  18. Sharma P, Anand RS. A comprehensive evaluation of deep models and optimizers for Indian sign language recognition. Graph Vis Comput. 2021. https://doi.org/10.1016/j.gvc.2021.200032.

    Article  Google Scholar 

  19. Zhang S, Zhang Q. Sign language recognition based on global-local attention. J Vis Commun Image Represent. 2021;80(December 2019):103280. https://doi.org/10.1016/j.jvcir.2021.103280.

    Article  Google Scholar 

  20. Breland DS, Skriubakken SB, Dayal A, Jha A, Yalavarthy PK, Cenkeramaddi LR. Deep learning-based sign language digits recognition from thermal images with edge computing system. IEEE Sens J. 2021;21(9):10445–53. https://doi.org/10.1109/JSEN.2021.3061608.

    Article  Google Scholar 

  21. Roy PP, Kumar P, Kim B-G. An efficient sign language recognition (SLR) system using Camshift tracker and Hidden Markov Model (HMM). SN Comput Sci. 2021. https://doi.org/10.1007/s42979-021-00485-z.

    Article  Google Scholar 

  22. Lee WY, Park SM, Sim KB. Optimal hyperparameter tuning of convolutional neural networks based on the parameter-setting-free harmony search algorithm. Optik. 2018;172(May):359–67. https://doi.org/10.1016/j.ijleo.2018.07.044.

    Article  Google Scholar 

  23. Zhu W, Braun B, Chiang LH, Romagnoli JA. Investigation of transfer learning for image classification and impact on training sample size. Chemomet Intell Lab Syst. 2021;211(January):104269. https://doi.org/10.1016/j.chemolab.2021.104269.

    Article  Google Scholar 

  24. Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE Computer Society Conference on computer vision and pattern recognition, 2018; pp. 4510–4520, doi: https://doi.org/10.1109/CVPR.2018.00474.

  25. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015—Conference Track Proceedings, 2015; pp. 1–14. https://doi.org/10.48550/arXiv.1409.1556

Download references

Acknowledgements

The author of this work wishes to express his gratitude and appreciation to the students of the College of Basic Education\University of Raparin for helping us capture the images and collect the data. The author also thanks those who assisted us in the process of investigating and identifying signs in Kurdish sign language.

Author information

Authors and Affiliations

  1. University of Raparin, Raniyah, Iraq

    Hunar Abubakir Ahmed, Sazgar Yassin Mustafa, Sumaya Zrar Braim & Razawa Mohammed Rasull

Authors
  1. Hunar Abubakir Ahmed
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Sazgar Yassin Mustafa
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Sumaya Zrar Braim
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Razawa Mohammed Rasull
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Hunar Abubakir Ahmed.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ahmed, H.A., Mustafa, S.Y., Braim, S.Z. et al. An Intelligent Kurdish Sign Language Recognition System Based on Tuned CNN. SN COMPUT. SCI. 3, 481 (2022). https://doi.org/10.1007/s42979-022-01394-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-022-01394-5

Keywords