skip to main content
10.1145/3554364.3559133acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

Where is the description?: investigating accessibility issues in portuguese versions of smart home apps

Published: 19 October 2022 Publication History

Abstract

Smart Home devices (e.g. Alexa Echo dot, Smart TVs) are unique technologies to improve everyday lives, especially for people with disabilities. However, despite the advances provided by these technologies, people who are blind reported accessibility issues in the use of mobile applications that mediate interaction with smart devices. Our study aims to understand these applications' current state of accessibility by analysing their Portuguese versions. First, we surveyed 20 Brazilians who are blind to map the uses and main accessibility challenges of Smart Home devices. Next, we evaluated the accessibility of five mobile applications used in this context: LG ThinQ, Amazon Alexa, openHAB, Google Home, and RSmart. We found a total of 1148 accessibility issues in their Portuguese versions. The most frequent issues were missing or incorrect labels and incorrect context (e.g., content descriptions in English). The tasks that presented the most accessibility problems were the devices' search and configuration. These issues could limit the initial use of intelligent devices by users with disabilities and compel them to rely on someone else to perform essential tasks in these apps, even those created by tech giants.

References

[1]
Ali Abdolrahmani, Ravi Kuber, and Stacy M Branham. 2018. "Siri Talks at You" An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. 249--258.
[2]
Abdulaziz Alshayban, Iftekhar Ahmed, and Sam Malek. 2020. Accessibility Issues in Android Apps: State of Affairs, Sentiments, and Ways Forward. In 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE). 1323--1334.
[3]
Mars Ballantyne, Archit Jha, Anna Jacobsen, J Scott Hawker, and Yasmine N El-Glaly. 2018. Study of accessibility guidelines of mobile applications. In Proceedings of the 17th international conference on mobile and ubiquitous multimedia. 305--315.
[4]
Laurence Bardin. 2011. Content analysis. São Paulo: Edições 70, 279 (2011), 978--8562938047.
[5]
Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu. 2021. Accessible or Not An Empirical Investigation of Android App Accessibility. IEEE Transactions on Software Engineering (2021), 1--1.
[6]
Gabriela AA de Oliveira, Otávio de Faria Oliveira, Stenio de Abreu, Raphael W de Bettio, and André P Freire. 2022. Opportunities and accessibility challenges for open-source general-purpose home automation mobile applications for visually disabled users. Multimedia Tools and Applications (2022), 1--28.
[7]
Gabriela Amaral Araújo de Oliveira, Raphael Winckler de Bettio, and André Pimenta Freire. 2016. Accessibility of the smart home for users with visual disabilities: an evaluation of open source mobile applications for home automation. In Proceedings of the 15th Brazilian symposium on human factors in computing systems. 1--10.
[8]
Mari Carmen Domingo. 2012. An overview of the Internet of Things for people with disabilities. journal of Network and Computer Applications 35, 2 (2012), 584--596.
[9]
Paulo AS Duarte, Felipe M Barreto, Paulo AC Aguilar, Jérôme Boudy, Rossana MC Andrade, and Windson Viana. 2018. AAL platforms challenges in IOT era: a tertiary study. In 2018 13th Annual Conference on System of Systems Engineering (SoSE). IEEE, 106--113.
[10]
Otávio de Faria Oliveira, Mateus Carvalho Gonçalves, Raphael Winckler de Bettio, and André Pimenta Freire. 2022. A qualitative study on the needs of visually impaired users in Brazil for smart home interactive technologies. Behaviour & Information Technology (2022), 1--29.
[11]
Abraham T Glasser, Kesavan R Kushalnagar, and Raja S Kushalnagar. 2017. Feasibility of using automatic speech recognition with voices of deaf and hard-of-hearing individuals. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. 373--374.
[12]
Barbara Leporini and Marina Buzzi. 2018. Home Automation for an Independent Living: Investigating the Needs of Visually Impaired People. In Proceedings of the 15th International Web for All Conference (Lyon, France) (W4A '18). Association for Computing Machinery, New York, NY, USA, Article 15, 9 pages.
[13]
Barbara Leporini, Michele Rosellini, and Nicola Forgione. 2019. Is the light on or off? a simple auditory-based tool to help visually-impaired people check the light device status. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 152--155.
[14]
Davit Marikyan, Savvas Papagiannidis, and Eleftherios Alamanos. 2019. A systematic review of the smart home literature: A user perspective. Technological Forecasting and Social Change 138 (2019), 139--154.
[15]
Fabio Masina, Valeria Orso, Patrik Pluchino, Giulia Dainese, Stefania Volpato, Cristian Nelini, Daniela Mapelli, Anna Spagnolli, and Luciano Gamberini. 2020. Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study. J Med Internet Res 22, 9 (25 Sep 2020), e18431.
[16]
Delvani Antônio Mateus, Carlos Alberto Silva, Arthur FBA de Oliveira, Heitor Costa, and André Pimenta Freire. 2021. A Systematic Mapping of Accessibility Problems Encountered on Websites and Mobile Apps: A Comparison Between Automated Tests, Manual Inspections and User Evaluations. Journal on Interactive Systems 12, 1 (2021), 145--171.
[17]
Delvani Antônio Mateus, Carlos Alberto Silva, Marcelo Medeiros Eler, and André Pimenta Freire. 2020. Accessibility of mobile applications: evaluation by users with visual impairment and by automated tools. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1--10.
[18]
Thomas P Novak and Donna L Hoffman. 2019. Relationship journeys in the internet of things: a new framework for understanding interactions between consumers and smart objects. Journal of the Academy of Marketing Science 47, 2 (2019), 216--237.
[19]
François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1 (2013), 127--144.
[20]
Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility Came by Accident" Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on human factors in computing systems. 1--13.
[21]
Clauirton A Siebra, Tatiana B Gouveia, Anderson Filho, Walter Correia, Marcelo Penha, Marcelo Anjos, Fabiana Florentin, Fabio QB Silva, and Andre LM Santos. 2015. Usability for accessibility: A consolidation of requirements for mobile applications. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 321--322.
[22]
Kevin M Storer, Tejinder K Judge, and Stacy M Branham. 2020. "All in the Same Boat": Tradeoffs of Voice Assistant Ownership for Mixed-Visual-Ability Families. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.
[23]
Christopher Vendome, Diana Solano, Santiago Liñán, and Mario Linares-Vásquez. 2019. Can everyone use my app? an empirical study on accessibility in android apps. In 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME). IEEE, 41--52.
[24]
Alexandra Vtyurina, Adam Fourney, Meredith Ringel Morris, Leah Findlater, and Ryen W White. 2019. Bridging screen readers and voice assistants for enhanced eyes-free web search. In The world wide web conference. 3590--3594.
[25]
Linda Wulf, Markus Garschall, Julia Himmelsbach, and Manfred Tscheligi. 2014. Hands free-care free: elderly people taking advantage of speech-only interaction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. 203--206.
[26]
Randall Ziman and Greg Walsh. 2018. Factors affecting seniors' perceptions of voice-enabled user interfaces. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1--6.

Cited By

View all
  • (2024)Investigating Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC)Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702098(1-18)Online publication date: 7-Oct-2024
  • (2024)Assessing Accessibility Levels in Mobile Applications Developed from Figma TemplatesProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652075(316-321)Online publication date: 26-Jun-2024
  • (2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023

Index Terms

  1. Where is the description?: investigating accessibility issues in portuguese versions of smart home apps

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      IHC '22: Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems
      October 2022
      482 pages
      ISBN:9781450395069
      DOI:10.1145/3554364
      © 2022 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 19 October 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. accessibility
      2. mobile apps
      3. smart home

      Qualifiers

      • Research-article

      Funding Sources

      • National Council for Scientific and Technological Development (CNPq)

      Conference

      IHC '22

      Acceptance Rates

      Overall Acceptance Rate 331 of 973 submissions, 34%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)8
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 20 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Investigating Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC)Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702098(1-18)Online publication date: 7-Oct-2024
      • (2024)Assessing Accessibility Levels in Mobile Applications Developed from Figma TemplatesProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652075(316-321)Online publication date: 26-Jun-2024
      • (2023)Digital Accessibility at the Brazilian Symposium on Human Factors in Computing Systems (IHC): An Updated Systematic Literature ReviewProceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638075(1-15)Online publication date: 16-Oct-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media