Abstract
Deaf and deaf-blind individuals face many challenges in communicating with others and understanding the world surrounding them. To overcome their isolation, deaf persons use sign language to converse with others. On the other hand, deaf-blind persons are unable to see so they rely on tactile sign language by touching other persons’ hands while they perform the gestures in order to read sign language. Deaf and deaf-blind people experience more difficulties connecting with their local community when other individuals are not familiar with sign language or are not comfortable with the tactile sign language. Moreover, learning sign language is fundamental to deaf people and those who live with deaf people, as this will be a mean for them to communicate with their environment. Teaching sign language with 2D tools such as videos and pictures are not as effective as teaching it with 3D tools, which offer full demonstration of the sign language gestures. In this paper, we present the design and construction of a robotic hand that translates written Arabic texts into Arabic sign language alphabet. The aim of this robotic hand is to serve as an assistive technology device that acts as a mean of communication between the deaf or deaf-blind person and the world. In addition, it can be used as a tool to aid in teaching sign language for deaf people and those who want to learn sign language. The robotic hand was tested through three experimental studies on three different types of volunteers, which include non-deaf/non-deaf-blind, deaf and deaf-blind individuals. The results were very promising; the success ratios for gestures recognition were 86%, 81%, and 67%, respectively.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Deafness and hearing loss, World Health Organization (2016). http://www.who.int/mediacentre/factsheets/fs300/en/. Accessed 14 Oct 2018
Tolba, M.F., Elons, A.S.: Recent developments in sign language recognition systems. In: 8th International Conference on Computer Engineering and Systems (ICCES), Cairo (2013)
Sadek, M.I., Mikhael, M.N., Mansour, H.A.: A new approach for designing a smart glove for Arabic Sign Language Recognition system based on the statistical analysis of the Sign Language. In: 2017 34th National Radio Science Conference (NRSC), Alexandria, pp. 380–388 (2017)
Abdel-Fattah, M.: Arabic sign language: a perspective. J. Deaf Stud. Deaf Educ. 10, 212–221 (2005)
Laenger, C., Peel, H.: Further development and tests of an artificial hand for communication with deaf-blind people (1978)
Meade, A.: Dexter–a finger-spelling hand for the deaf-blind. In: IEEE International Conference on Robotics and Automation Proceedings, vol. 4, pp. 1192–1195, March 1987
Jaffe, D.: Dexter II: the next generation mechanical fingerspelling hand for deaf-blind persons. In: 12th Annual RESNA Conference, New Orleans, LA (1989)
Jaffe, D.L.: RALPH: a fourth generation fingerspelling hand. Rehabilitation Research and Development Center, Stanford University (1994)
Bulgarelli, A., Toscana, G., Russo, L., Farulla, G., Indaco, M., Bona, B.: A low-cost open source 3D-printable dexterous anthropomorphic robotic hand with a parallel spherical joint wrist for sign languages reproduction. Int. J. Adv. Robot. Syst. 13(3) (2016)
Fierens, G., Huys, S., Slaets, J.: Humanoid robot for sign language. University of Antwerp (2015)
Maliki, R., Alhaidar, D., Attallah, K., Alsalem, S., Morris, M., Tosunoglu, S.: Robotic hands to teach sign language. In: 30th Florida Conference on Recent Advances in Robotics, Florida (2017)
InMoov open-source 3D printed life-size robot. http://inmoov.fr. Accessed 17 Nov 2017
Uluer, P., Akalın, N., Köse, H.: A new robotic platform for sign language tutoring. Int. J. Soc. Robot. 7(5), 571–585 (2015)
Vstone Co., Ltd. https://www.vstone.co.jp/english/index.html. Accessed 17 Nov 2017
Russo, L., Farulla, G., Pianu, D., Salgarella, A., Controzzi, M., Cipriani, C., Oddo, C., Geraci, C., Rosa, S., Indaco, M.: PARLOMA – a novel human-robot interaction system for deaf-blind remote communication. Int. J. Adv. Rob. Syst. 12(5), 57 (2015)
Carrozza, M., Cappiello, G., Micera, S., Edin, B., Beccai, L., Cipriani, C.: Design of a cybernetic hand for perception and action. Biol. Cybern. 95(6), 629–644 (2006)
Al-Qahtani, S.: The Arabic Dictionary of Gestures for the Deaf, 1st edn. King Fahd National Library, Riyadh (2006)
Hodge, S., Hubbard, J.: Anatomy for Litigators. ALI ABA, Philadelphia (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Alrabiah, M., AlMuneef, H., AlMarri, S., AlShammari, E., Alsunaid, F. (2020). A Robotic Hand for Arabic Sign Language Teaching and Translation. In: Bi, Y., Bhatia, R., Kapoor, S. (eds) Intelligent Systems and Applications. IntelliSys 2019. Advances in Intelligent Systems and Computing, vol 1038. Springer, Cham. https://doi.org/10.1007/978-3-030-29513-4_63
Download citation
DOI: https://doi.org/10.1007/978-3-030-29513-4_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29512-7
Online ISBN: 978-3-030-29513-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)