poster

On How Deaf People Might Use Speech to Control Devices

Authors:

Jeffrey P. Bigham,

Raja Kushalnagar,

Ting-Hao Kenneth Huang,

Juan Pablo Flores,

Saiph SavageAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 383 - 384

https://doi.org/10.1145/3132525.3134821

Published: 19 October 2017 Publication History

Get Access

Abstract

Smart devices connected to the Internet are proliferating.To reduce costs of devices that havetraditionally been inexpensive(toasters, microwaves, printers, etc), manyof these devices have chosen to use a speech interface rather than a visual one. This transition has been hastened by the increasing capabilities of speech interfaces,exemplifiedbyproducts likeAmazon Echo and Apple'sSiri.A consequence of these products moving to voice control is that people who are deaf and hard of hearing (DHH) may be unable to use them. In this paper, we briefly introduce two technical approaches we are pursuingfor enabling DHH people to provide input to these devices: (i) human computationworkflows for understanding "deaf speech," and (ii) mobile interfaces that can be instructed to speak on the user's behalf.

References

[1]

Sadaoki Furui. 2000.Digital speech processing: synthesis,and recognition. CRC Press.{2} Linda G Gottermeier, Carol L De Filippo, R AjaKushalnagar, and Bonnie L Bastian. 2016. User EvaluationOf Automatic Speech Recognition Systems For Deaf-hearingInteractions At School And Work.Audiology Today28, 2(2016), 20-34.

Google Scholar

[2]

Greg Little, Lydia B Chilton, Max Goldman, and Robert CMiller. 2009. Turkit: tools for iterative tasks on mechanicalturk. InProceedings of the ACM SIGKDD workshop onhuman computation. ACM, 29-30.

Digital Library

Google Scholar

[3]

Taylor Martin and David Priest. 2017. The complete list ofAlexa commands so far. (April 2017).https://www.cnet.com/how-to/amazon-echo-the-complete-list-of-alexa-commands/

Google Scholar

[4]

Nancy S. McGarr. 1983. The Intelligibility of Deaf Speechto Experienced and Inexperienced Listeners.Journal ofSpeech, Language, and Hearing Research26, 3 (1983),451-458.

Google Scholar

[5]

John Shinal. 2017. Making sense of Google CEO SundarPichai's plan to move every direction at once. (May 2017).http://www.cnbc.com/2017/05/18/google-ceo-sundar-pichai-machine-learning-big-data.html

Google Scholar

Cited By

View all

Araiza-Illan GMeyer LTruong KBaşkent D(2024)Automated Speech Audiometry: Can It Work Using Open-Source Pre-Trained Kaldi-NL Automatic Speech Recognition?Trends in Hearing10.1177/2331216524122905728Online publication date: 14-Mar-2024
https://doi.org/10.1177/23312165241229057
Mathew RTigwell GPeiris R(2024)Deaf and Hard of Hearing People’s Perspectives on Augmented Reality Interfaces for Improving the Accessibility of Smart SpeakersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_21(334-357)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60881-0_21
Wang PVan hamme H(2023)Benefits of pre-trained mono- and cross-lingual speech representations for spoken language understanding of Dutch dysarthric speechEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-023-00280-z2023:1Online publication date: 7-Apr-2023
https://doi.org/10.1186/s13636-023-00280-z
Show More Cited By

Index Terms

On How Deaf People Might Use Speech to Control Devices
1. Human-centered computing
  1. Accessibility

Recommendations

Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Mobile, wearable, and other ubiquitous computing devices are increasingly creating a context in which conventional keyboard and screen-based inputs are being replaced in favor of more natural speech-based interactions. Digital personal assistants use ...
Luminous device for the deaf and hard of hearing people
HAI '14: Proceedings of the second international conference on Human-agent interaction

People with hard of hearing and the deaf often face difficulties to recognize things happening in their surroundings. Imagine you cannot hear the sound, because you are with hard of hearing or using iPod with earphones, you would not able to recognize ...
How people who are deaf, Deaf, and hard of hearing use technology in creative sound activities
ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility

Creative sound activities, such as music playing and audio engineering, are said to have been democratized with the development of technology. Yet, the use of technology in creative sound activities by people who are deaf, Deaf, and hard of hearing (DHH)...

Comments

Information & Contributors

Information

Published In

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Check for updates

Author Tag

accessibility

Qualifiers

Poster

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
507
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Araiza-Illan GMeyer LTruong KBaşkent D(2024)Automated Speech Audiometry: Can It Work Using Open-Source Pre-Trained Kaldi-NL Automatic Speech Recognition?Trends in Hearing10.1177/2331216524122905728Online publication date: 14-Mar-2024
https://doi.org/10.1177/23312165241229057
Mathew RTigwell GPeiris R(2024)Deaf and Hard of Hearing People’s Perspectives on Augmented Reality Interfaces for Improving the Accessibility of Smart SpeakersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_21(334-357)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60881-0_21
Wang PVan hamme H(2023)Benefits of pre-trained mono- and cross-lingual speech representations for spoken language understanding of Dutch dysarthric speechEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-023-00280-z2023:1Online publication date: 7-Apr-2023
https://doi.org/10.1186/s13636-023-00280-z
Mendu SDoyle Fosco SLanza SAbdullah S(2023)Designing voice interfaces to support mindfulness-based pain managementDIGITAL HEALTH10.1177/205520762312044189Online publication date: 19-Oct-2023
https://doi.org/10.1177/20552076231204418
Harrington CDesai ALewis AMoharana SRoss AMankoff J(2023)Working at the Intersection of Race, Disability and AccessibilityProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608389(1-18)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608389
Otoom MAlzubaidi MAl-Raziq L(2022)A Novel Social Interaction Assistive Device for Arab Deaf PeopleACM Transactions on Asian and Low-Resource Language Information Processing10.1145/350837421:5(1-19)Online publication date: 25-Aug-2022
https://dl.acm.org/doi/10.1145/3508374
Jeon YKim BXiong ALEE DHan K(2021)ChamberBreaker: Mitigating the Echo Chamber Effect and Supporting Information Hygiene through a Gamified Inoculation SystemProceedings of the ACM on Human-Computer Interaction10.1145/34798595:CSCW2(1-26)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479859
Sun KZou YRadesky JBrooks CSchaub F(2021)Child Safety in the Smart Home: Parents' Perceptions, Needs, and Mitigation StrategiesProceedings of the ACM on Human-Computer Interaction10.1145/34798585:CSCW2(1-41)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479858
Poretski LLanir JMargalit RArazy O(2021)Physicality As an Anchor for Coordination: Examining Collocated Collaboration in Physical and Mobile Augmented Reality SettingsProceedings of the ACM on Human-Computer Interaction10.1145/34798575:CSCW2(1-29)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479857
Feuston JBrubaker J(2021)Putting Tools in Their Place: The Role of Time and Perspective in Human-AI Collaboration for Qualitative AnalysisProceedings of the ACM on Human-Computer Interaction10.1145/34798565:CSCW2(1-25)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479856
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users

Luminous device for the deaf and hard of hearing people

How people who are deaf, Deaf, and hard of hearing use technology in creative sound activities