skip to main content
10.1145/3411170.3411252acmotherconferencesArticle/Chapter ViewAbstractPublication PagesgoodtechsConference Proceedingsconference-collections
research-article

Learning Sign Language from a Sanbot Robot

Published: 14 September 2020 Publication History

Abstract

People with communication impairments, e.g., those with hearing loss or non-verbal autistic people, are a non-irrelevant number in modern society, so their inclusion is a very important issue. Different approaches can be used to achieve this, and in this paper we consider the use of sign language as a bridge to connect them with the rest of the world. To this aim, we propose an enjoyable and playful approach based on the use of an Elf Sanbot robot. We thus introduce two new applications that we have developed to interface with the robot. They can be installed in a smartphone or in a tablet, and can be used to remotely control the robot via Bluetooth or WiFI connection. The first application, called Sanbot Manager, is used to regulate the movements of the robot in the space and of the head. The second one, called Sanbot Server application, allows for interfacing the robot with a human, that proposes vocal or textual words or sentences, and the robot reacts by showing the corresponding video in sign languages on the robot's screen. We think that these two applications, and in particular the Sanbot Server application, could be used to stimulate a person with a communication impairment, therapists, relatives, friends, to learn a sign language in an enjoyable way.

References

[1]
2011. All-New ASIMO Humanoid Robot-Sign Language. https://www.newscientist.com/article/dn25915-worlds-fastest-humanoid-robot-learns-sign-language/.
[2]
2014. Pyramid Educational Consultants, Inc. http://www.pecs-canada.com/.
[3]
2017. SignBot, Sign-Language Performing Robot, Based on Sequential Motion of Servo Motor Arrays. In International Conference on Robot Intelligence Technology and Applications. Daejeon, Korea, 239--249.
[4]
2018. Project Aslan. https://www.dailymail.co.uk/sciencetech/article-5517971/ASLAN-robot- arm-translates-words-sign-language-deaf-people.html.
[5]
2020. CDC estimate on autism prevalence. https://www.autismspeaks.org/press-release/cdc-estimate-autism-prevalence-increases-nearly-10-percent-1-54-children-us.
[6]
Cardinaletti A. 2016. Il progetto Spread The Sign. Book chapter of: Blityri, Studi di storia delle idee sui segni e le lingue. Vol. 1--2. ETS, Pisa. 175--181 pages.
[7]
American Psychiatric Association (Ed.). 2013. The Diagnostic and Statistical Manual of Mental Disorders: DSM 5. BookpointUS.
[8]
T. Baxter, A.J.and Brugha, H.E. Erskine, R.W. Sheurer, T. Vos, and J.G. Scott. 2014. The epidemiology and global burden of autism spectrum disorders. Psychological Medicine 45, 3 (2014), 1601--613.
[9]
A.S. Bondy and L.A. Frost. 1993. Mands across the water: A report on the application of the picture-exchange communication system in Peru. The Behavior Analyst 16 (1993), 123--128.
[10]
Cardinaletti A. Branchini C. 2017. La lingua dei segni nelle disabilità comunicative. Franco Angeli, Milano.
[11]
ClearValue. 2017. The "Speech Banana" and the Sounds of Human Speech. www.clearvaluehearing.com.
[12]
Cochlear. 2017. Livelli di perdita uditiva. www.cochlear.com.
[13]
Thomas Lydell Founder & Coordinator. 2006. Spread the Sign. https://www.spreadthesign.com/ [accessed: 2020-04-24].
[14]
A. Dattolo and F.L. Luccio. 2015. Modelling Volo, an Augmentative and Alternative Communication application. In ACHI 2015: The 8th International Conference on Advances in Computer-Human Interactions. Lisbon, Portugal.
[15]
A. Dattolo and F.L. Luccio. 2017. Accessible and Usable Websites and Mobile Applications for People with Autism Spectrum Disorders: a Comparative Study. EAI Endorsed Transactions on Ambient Systems 4, 13 (2017).
[16]
J.J. Gago, J.G. Victores, and C. Balaguer. 2019. Sign Language Representation by TEO Humanoid Robot: End-User Interest, Comprehension and Satisfaction. Electronics 8, 1 (2019).
[17]
H. Kose, N. Akalin, R. Yorganci, B.S. Ertugrul, H. Kivrak, S. Kavak, A. Ozkul, C. Gurpinar, P. Uluer, and G. Ince. 2015. iSign: An Architecture for Humanoid Assisted Sign Language Tutoring. Book chapter of: Intelligent Assistive Robots. Vol. 106. Springer, Cham. 157--184 pages.
[18]
F.L. Luccio and L. Beltrame. 2018. Accessible Tourism for Users with Hearing Loss. In Proceedings of the 4th EAI International Conference on Smart Objects and Technologies for Social Good (Goodtechs '18). Association for Computing Machinery, New York, NY, USA, 243--248.
[19]
Ali Meghdari, Minoo Alemi, Mohammad Zakipour, and Seyed Amir Kashanian. 2019. Design and Realization of a Sign Language Educational Humanoid Robot. J. Intell. Robotic Syst. 95, 1 (2019), 3--17.
[20]
A.I.R.S. Onlus. Accessed September 6, 2018. Associazione Italiana per la Ricerca sulla Sordità. www.associazioneairs.it.
[21]
World Health Organization. 2001. International classification of functioning, disability and health (IFC). http://www.who.int/classifications/icf/en/.
[22]
N. Tazhigaliyeva, Y. Nurgabylov, G.I Parisi, and Sandygulova A. 2016. SLIRS: Sign language interpreting system for human-robot interaction. In 2016 AAAI Fall Symposium, Vol. FS-16-01 - FS-16-05. AI Access Foundation, United States, 94--99. 2016 AAAI Fall Symposium; Conference date: 17-11-2016 Through 19-11-2016.
[23]
Matera V. 2008. Comunicazione e cultura. Carocci editore, Roma.
[24]
C. Weitz, M. Dexter, and J. Moore. 1997. AAC and children with developmental disabilities. Vol. Chapter 11. San Diego: Singular Publishing Group.

Cited By

View all
  • (2024)Interactive system based on artificial intelligence and robotic arm to enhance arabic sign language learning in deaf childrenEducation and Information Technologies10.1007/s10639-024-12826-529:18(24563-24580)Online publication date: 1-Dec-2024
  • (2022)A survey on the design and evolution of social robots — Past, present and futureRobotics and Autonomous Systems10.1016/j.robot.2022.104193156:COnline publication date: 1-Oct-2022
  • (2022)Handshape Recognition in an Educational Game for Finger Alphabet PracticingIntelligent Tutoring Systems10.1007/978-3-031-09680-8_7(75-87)Online publication date: 24-Jun-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
GoodTechs '20: Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good
September 2020
286 pages
ISBN:9781450375597
DOI:10.1145/3411170
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • EAI: The European Alliance for Innovation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Accessible technologies
  2. Robot
  3. Sign Language

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

GoodTechs '20

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)7
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Interactive system based on artificial intelligence and robotic arm to enhance arabic sign language learning in deaf childrenEducation and Information Technologies10.1007/s10639-024-12826-529:18(24563-24580)Online publication date: 1-Dec-2024
  • (2022)A survey on the design and evolution of social robots — Past, present and futureRobotics and Autonomous Systems10.1016/j.robot.2022.104193156:COnline publication date: 1-Oct-2022
  • (2022)Handshape Recognition in an Educational Game for Finger Alphabet PracticingIntelligent Tutoring Systems10.1007/978-3-031-09680-8_7(75-87)Online publication date: 24-Jun-2022
  • (2021)Artificial Intelligence Technologies for Sign LanguageSensors10.3390/s2117584321:17(5843)Online publication date: 30-Aug-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media