skip to main content
10.1145/3702038.3702041acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

Challenges and Lessons Learned to Improve the Deaf User Experience: Compliance with ABNT NBR 17060 Standard in Mobile Applications

Published: 18 December 2024 Publication History

Abstract

The VLibras Mobile Application is a translation tool from Brazilian Portuguese to Libras (Brazilian Sign Language) using an Avatar in 3D animation. The tool provides deaf people a means of accessing textual content based on animation in Libras. Furthermore, VLibras can be used as a communication tool between deaf people, Libras interpreters, and people in general (interested in learning Libras, for example). In this context, having access is not the same as being accessible. Thus, it is essential to improve the deaf user experience through the compliance of VLibras Mobile with ABNT NBR 17060 Standard. The assessment was conducted for all VLibras Mobile screens and features, covering the totality of criteria of the standard. Analogous to the WCAG standard, the NBR 17060 Standard also considers three accessibility levels (A: mandatory, AA: minimally accessible, and AAA: optional), as well as the four principles (Perceptible, Operable, Understandable, and Robust). It also included the standard categories: Perception and Comprehension, Control and Interaction, Media, and Coding. The goal was to compile a general overview of VLibras Mobile compliance with the standard to know this quality regarding accessibility. Also, the analysis allowed identifying an ensemble of non-compliance criteria, both located on a specific screen or across the application. These were transcribed as 12 issues with their respective severity level and reported to developers to improve VLibras Mobile accessibility. Also, the specific audience of VLibras, deaf people, led to classify a group of criteria as non-applicable. The results revealed that the most important features of VLibras, Traduction and Home, demonstrated higher compliance rates. However, the screen Customization showed significant non-compliance. Overall, the issues reported are of low severity, and their correction has a transversal impact on the application. This text is an experience report of the assessment conducted, its challenges, results, and lessons learned.

References

[2]
ABNT NBR 17060:2022 2022. Normas de Acessibilidade ABNT NBR 17060:2022.
[3]
Bruno Costa, Amarildo Melo, Tamila Nascimento, Sônia França, and Catarina Costa. 2023. Avaliação de aplicativos de apoio a comunicação das pessoas surdas na perspectiva de um surdo. In Anais do VIII Workshop sobre Aspectos Sociais, Humanos e Econômicos de Software (João Pessoa/PB). SBC, Porto Alegre, RS, Brasil, 81–90.
[4]
Erik Henrique Da Costa Nunes and Ingrid Teixeira Monteiro. 2024. Exploring the Accessibility Legal Landscape: Accessibility requirements in mobile applications according to ABNT NBR 17060. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems (, Maceió, Brazil,) (IHC ’23). Association for Computing Machinery, New York, NY, USA, Article 18, 11 pages.
[5]
Igor Farias De Oliveira, João Lucas Torres De Sousa, Larissa Cabral de Carvalho, Maria Durciane Oliveira Brito, Kátia Maria de Aguiar Freire, and Ana Christina de Sousa Damasceno. 2020. A Utilização do Aplicativo VLIBRAS Como Forma de Ensino e Aprendizagem para Alunos Surdos. Revista Psicologia &amp Saberes 9, 16 (mar. 2020), 22–30. https://revistas.cesmac.edu.br/psicologia/article/view/1169
[6]
eMAG 2014. eMAG - Modelo de Acessibilidade em Governo Eletrônico. Retrieved Jun 05, 2024 from https://emag.governoeletronico.gov.br/
[7]
Lavínia Matoso Freitas, Thiago Hellen O. da Silva, and Marília Soares Mendes. 2016. Evaluation of Spotify: an evaluation textual experience using the Maltu methodology. In Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems (São Paulo, Brazil) (IHC ’16). Association for Computing Machinery, New York, NY, USA, Article 50, 4 pages.
[8]
GDAMA 2015. Guia para o Desenvolvimento de Aplicações Móveis Acessíveis. Retrieved Jun 05, 2024 from www.sidi.org.br/guiadeacessibilidade/
[9]
Marília Soares Mendes. 2015. MALTU - um modelo para avaliação da interação em sistemas sociais a partir da linguagem textual do usuário. https://api.semanticscholar.org/CorpusID:51874337
[10]
G.J. Myers, C. Sandler, and T. Badgett. 2011. The Art of Software Testing. Wiley. https://books.google.com.br/books?id=GjyEFPkMCwcC
[11]
Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann.
[12]
Erik Da Costa Nunes, Guilherme Ribeiro, Ingrid Monteiro, and Enyo Gonçalves. 2023. Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature Review. In Anais do XXII Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Maceió/AL). SBC, Porto Alegre, RS, Brasil. https://sol.sbc.org.br/index.php/ihc/article/view/27600
[13]
Francisco Aulísio dos Santos Paiva, José Mario De Martino, Plínio Almeida Barbosa, Ângelo Benetti, and Ivani Rodrigues Silva. 2016. UM SISTEMA DE TRANSCRIÇÃO PARA LÍNGUA DE SINAIS BRASILEIRA: O CASO DE UM AVATAR. Revista do GEL 13, 3 (dez. 2016), 12–48.
[14]
Luana Reis, Tiago Araujo, Yuska Aguiar, and Manuella Aschoff. 2020. A Methodology for Assessing Translation Quality Generated by Sign Language Machine Translators: A Case Study with VLibras. 132–146.
[15]
Luana Silva Reis, Tiago Maritan Ugulino de Araújo, Yuska Paola Costa Aguiar, and Manuella Aschoff Cavalcanti Brandão Lima. 2020. Evaluating machine translation systems for Brazilian sign language in the treatment of critical grammatical aspects. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC ’20). Association for Computing Machinery, New York, NY, USA, Article 46, 6 pages.
[16]
Luana Silva Reis, Tiago Maritan U. de Araújo, Maria Dayane F. Cirino Lima, Angelina S. da Silva Sales, and Yuska Paola Costa Aguiar. 2017. Avaliação de Usabilidade do Aplicativo VLibras-Móvel com Usuários Surdos. In Anais Estendidos do XXIII Simpósio Brasileiro de Sistemas Multimídia e Web (Gramado). SBC, Porto Alegre, RS, Brasil, 123–126. https://sol.sbc.org.br/index.php/webmedia_estendido/article/view/4848
[17]
Luana Silva Reis, Tiago Maritan Ugulino De Araujo, Yuska Paola Costa Aguiar, and Manuella Aschoff Cavalcanti Brandao Lima. 2024. A Multilevel Methodology to Assess the Quality of Machine Translators to Brazilian Sign Languages. In Proceedings of the XI Latin American Conference on Human Computer Interaction (Puebla, Mexico) (CLIHC ’23). Association for Computing Machinery, New York, NY, USA, Article 9, 8 pages.
[18]
Ana Carolina Rodrigues Lima De Aguiar, Lucas Eduardo Melo Alves, Felipe Melo Feliciano De Sá, and Yuska Paola Costa Aguiar. 2024. What do Portuguese-Libras automatic translation application users care about? An analysis of user comments to improve application accessibility by the quality assurance team. In Proceedings of the XI Latin American Conference on Human Computer Interaction (Puebla, Mexico) (CLIHC ’23). Association for Computing Machinery, New York, NY, USA, Article 26, 4 pages.
[19]
André Silva, Tatiane de Sá, Ruan Diniz, Simone Ferreira, Sean Siqueira, and Saulo Bourguignon. 2021. Quando só Ok, não é Ok - Um Estudo Experimental por meio de Recortes Cronológicos Sequenciais, com Análises Prescritiva e Semântica na Tradução Dinâmica pelo Avatar VLibras. In Anais do XX Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Online). SBC, Porto Alegre, RS, Brasil. https://sol.sbc.org.br/index.php/ihc/article/view/19388
[20]
Clemer Silva, Lucas Oliveira, Matheus Silva, and Tiago Nogueira. 2023. Acessibilidade para Pessoas Cegas: Avaliação de Compatibilidade do TalkBack com a ABNT NBR 17060. In Anais do VIII Workshop sobre Aspectos Sociais, Humanos e Econômicos de Software (João Pessoa/PB). SBC, Porto Alegre, RS, Brasil, 61–70.
[21]
W3C-UAAG 2002. User Agent Accessibility Guidelines 1.0. Retrieved Jun 05, 2024 from https://www.w3.org/TR/WAI-USERAGENT/cover.html
[22]
WCAG 2.1 2018. Diretrizes de Acessibilidade para Conteúdo Web (WCAG) 2.1. Retrieved Jun 05, 2024 from https://www.w3c.br/traducoes/wcag/wcag21-pt-BR/
[23]
Sherman Wilcox and Phyllis Perrin Wilcox. 1997. Learning To See: American Sign Language as a Second Language. Gallaudet University Press. http://www.jstor.org/stable/j.ctv2rr3f9n

Index Terms

  1. Challenges and Lessons Learned to Improve the Deaf User Experience: Compliance with ABNT NBR 17060 Standard in Mobile Applications

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      IHC '24: Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems
      October 2024
      1070 pages
      ISBN:9798400712241
      DOI:10.1145/3702038
      Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only. Request permissions from owner/author(s).

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 18 December 2024

      Check for updates

      Author Tags

      1. Deaf Users
      2. Brazilian Sign Language
      3. VLibras Mobile
      4. ABNT NBR 17060 Standard
      5. Quality Assurance

      Qualifiers

      • Research-article

      Conference

      IHC 2024

      Acceptance Rates

      Overall Acceptance Rate 331 of 973 submissions, 34%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 11
        Total Downloads
      • Downloads (Last 12 months)11
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 27 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media