skip to main content
10.1145/3411763.3451592acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
poster

Deaf Users’ Preferences Among Wake-Up Approaches during Sign-Language Interaction with Personal Assistant Devices

Published: 08 May 2021 Publication History

Abstract

Personal-assistant devices like Amazon Alexa and Google Assistant are increasingly popular among consumers. Users activate these systems through some type of wake-up approach, e.g. using a wake-word “Alexa” or “Ok, Google.” Voice-based interaction poses accessibility barriers for Deaf and Hard of Hearing (DHH) users, and technologies for sign-language recognition are improving. We therefore explore wake-up interactions for DHH users for potential personal assistant devices that understand sign language commands. Interviews with DHH users (N=21) motivated the design of six wake-up approaches, and we produced video prototypes demonstrating each using a Wizard-of-Oz approach. These prototypes were evaluated in a follow-up study in which DHH users (N=12) identified factors that influenced their preference among approaches. This study contributes empirical knowledge about DHH ASL signers’ preferences and concerns with wake-up interaction, thereby providing guidance for future designers of these systems.

References

[1]
Ali Abdolrahmani, Ravi Kuber, and Stacy M. Branham. 2018. ”Siri Talks at You”: An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (Galway, Ireland) (ASSETS ’18). Association for Computing Machinery, New York, NY, USA, 249–258. https://doi.org/10.1145/3234695.3236344
[2]
Shashank Ahire and Michael Rohs. 2020. Tired of Wake Words? Moving Towards Seamless Conversations with Intelligent Personal Assistants. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI ’20). Association for Computing Machinery, New York, NY, USA, Article 20, 3 pages. https://doi.org/10.1145/3405755.3406141
[3]
Amazon. 2020. Accessibility Features for Alexa. https://www.amazon.com/gp/help/customer/display.html?nodeId=202158280
[4]
Amazon. 2020. Alexa Accessibility. https://www.amazon.com/b?ie=UTF8&node=21101808011
[5]
Amazon. 2020. Invoking Alexa. https://developer.amazon.com/en-US/docs/alexa/alexa-auto/invoking-alexa.html#
[6]
D. Balfanz, G. Durfee, D. K. Smetters, and R. E. Grinter. 2004. In search of usable security: five lessons from the field. IEEE Security Privacy 2, 5 (2004), 19–24. https://doi.org/10.1109/MSP.2004.71
[7]
BBC. 2018. Sign-language hack lets Amazon Alexa respond to gestures. https://www.bbc.com/news/technology-44891054
[8]
Danielle Bragg, Oscar Koller, Mary Bellard, Larwan Berke, Patrick Boudreault, Annelies Braffort, Naomi Caselli, Matt Huenerfauth, Hernisa Kacorri, Tessa Verhoef, Christian Vogler, and Meredith Ringel Morris. 2019. Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 16–31. https://doi.org/10.1145/3308561.3353774
[9]
Fabio Catania, Micol Spitale, Giulia Cosentino, and Franca Garzotto. 2020. What is the Best Action for Children to ”Wake Up” and ”Put to Sleep” a Conversational Agent? A Multi-Criteria Decision Analysis Approach. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI ’20). Association for Computing Machinery, New York, NY, USA, Article 4, 10 pages. https://doi.org/10.1145/3405755.3406129
[10]
Benjamin R. Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017. ”What Can i Help You with?”: Infrequent Users’ Experiences of Intelligent Personal Assistants. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI ’17). Association for Computing Machinery, New York, NY, USA, Article 43, 12 pages. https://doi.org/10.1145/3098279.3098539
[11]
Abraham Glasser. 2019. Automatic Speech Recognition Services: Deaf and Hard-of-Hearing Usability. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3308461
[12]
Abraham Glasser, Vaishnavi Mande, and Matt Huenerfauth. 2020. Accessibility for Deaf and Hard of Hearing Users: Sign Language Conversational User Interfaces. In Proceedings of the 2nd Conference on Conversational User Interfaces (Bilbao, Spain) (CUI ’20). Association for Computing Machinery, New York, NY, USA, Article 55, 3 pages. https://doi.org/10.1145/3405755.3406158
[13]
Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174214
[14]
Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. ”Accessibility Came by Accident”: Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174033
[15]
Jason Rodolitz, Evan Gambill, Brittany Willis, Christian Vogler, and Raja Kushalnagar. 2019. Accessibility of Voice-Activated Agents for People who are Deaf or Hard of Hearing. Journal on Technology and Persons with Disabilities 7 (2019), 144–156. http://hdl.handle.net/10211.3/210397
[16]
SignGenius. 2020. Do’s & Don’ts - Getting Attention in the Deaf Community. https://www.signgenius.com/info-do’s&don’ts.shtml

Cited By

View all
  • (2024)You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarificationFrontiers in Dementia10.3389/frdem.2024.13430523Online publication date: 12-Mar-2024
  • (2024)Voice Assistant Utilization among the Disability Community for Independent Living: A Rapid Review of Recent EvidenceHuman Behavior and Emerging Technologies10.1155/2024/64949442024(1-39)Online publication date: 12-Apr-2024
  • (2024)Sign Language-Based versus Touch-Based Input for Deaf Users with Interactive Personal Assistants in Simulated Kitchen EnvironmentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651075(1-9)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
May 2021
2965 pages
ISBN:9781450380959
DOI:10.1145/3411763
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Accessibility
  2. Deaf and Hard of Hearing
  3. Personal Assistants
  4. Sign Language

Qualifiers

  • Poster
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)47
  • Downloads (Last 6 weeks)1
Reflects downloads up to 30 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarificationFrontiers in Dementia10.3389/frdem.2024.13430523Online publication date: 12-Mar-2024
  • (2024)Voice Assistant Utilization among the Disability Community for Independent Living: A Rapid Review of Recent EvidenceHuman Behavior and Emerging Technologies10.1155/2024/64949442024(1-39)Online publication date: 12-Apr-2024
  • (2024)Sign Language-Based versus Touch-Based Input for Deaf Users with Interactive Personal Assistants in Simulated Kitchen EnvironmentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651075(1-9)Online publication date: 11-May-2024
  • (2024)Assessment of Sign Language-Based versus Touch-Based Input for Deaf Users Interacting with Intelligent Personal AssistantsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642094(1-15)Online publication date: 11-May-2024
  • (2024)Deaf and Hard of Hearing People’s Perspectives on Augmented Reality Interfaces for Improving the Accessibility of Smart SpeakersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_21(334-357)Online publication date: 29-Jun-2024
  • (2023)"I... caught a person casing my house... and scared him off:" The Use of Security-Focused Smart Home Devices by People with DisabilitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581007(1-16)Online publication date: 19-Apr-2023
  • (2022)Analyzing Deaf and Hard-of-Hearing Users’ Behavior, Usage, and Interaction with a Personal Assistant Device that Understands Sign-Language InputProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501987(1-12)Online publication date: 29-Apr-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media