abstract

The Effects of Automatic Speech Recognition Quality on Human Transcription Latency

Author:

Yashesh GaurAuthors Info & Claims

ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

Pages 367 - 368

https://doi.org/10.1145/2700648.2811331

Published: 26 October 2015 Publication History

Get Access

Abstract

Converting speech to text quickly is the fundamental task for making aural content accessible to deaf and hard of hearing. Despite high cost, this is done by human captionists, as automatic speech recognition (ASR) does not give satisfactory performance in real world settings. Offering ASR output to captionists as a starting point seems more facile and economical, yet the effectiveness of this approach is clearly dependent on the quality of ASR because fixing inaccurate ASR output may take longer than producing the transcriptions without ASR support. In this paper, we empirically study how the time required by captionists to produce transcriptions from partially correct ASR output varies based on the accuracy of the ASR output. Our studies with 160 participants recruited on Amazon's Mechanical Turk indicate that starting with the ASR output is worse unless it is sufficiently accurate (Word Error Rate (WER) is under 30%).

References

[1]

Y. C. Beatrice Liem, Haoqi Zhang. An iterative dual pathway structure for speech-to-text transcription. In Proceedings of the 3rd Workshop on Human Computation (HCOMP '11), HCOMP '11, 2011.

Digital Library

Google Scholar

[2]

G. Hinton, L. Deng, D. Yu, G. E. Dahl, A.-r. Mohamed, N. Jaitly, A. Senior, V. Vanhoucke, P. Nguyen, T. N. Sainath, et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Processing Magazine, IEEE, 29(6):82--97, 2012.

Crossref

Google Scholar

[3]

W. Lasecki, C. Miller, A. Sadilek, A. Abumoussa, D. Borrello, R. Kushalnagar, and J. Bigham. Real-time captioning by groups of non-experts. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, pages 23--34, New York, NY, USA, 2012. ACM.

Digital Library

Google Scholar

[4]

D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlıček, Y. Qian, P. Schwarz, et al. The kaldi speech recognition toolkit. 2011.

Google Scholar

[5]

A. Rousseau, P. Deléglise, and Y. Estève. Ted-lium: an automatic speech recognition dedicated corpus. In LREC, pages 125--129, 2012.

Google Scholar

[6]

M. Wald. Crowdsourcing correction of speech recognition captioning errors. 2011.

Digital Library

Google Scholar

Cited By

View all

Pieper MGleasure R(2025) How AI Helps to Compile Human Intelligence: An Empirical Study of Emerging Augmented Intelligence for Medical Image Scanning Information Systems Journal10.1111/isj.12585Online publication date: 21-Jan-2025
https://doi.org/10.1111/isj.12585
Mattos AOliveira D(2018)Multi-view Mouth Renderization for Assisting Lip-readingProceedings of the 15th International Web for All Conference10.1145/3192714.3192824(1-10)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3192824
Culbertson GShen SJung MAndersen EMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Facilitating Development of Pragmatic Competence through a Voice-driven Video Learning InterfaceProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025805(1431-1440)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025805
Show More Cited By

Index Terms

The Effects of Automatic Speech Recognition Quality on Human Transcription Latency
1. Information systems
  1. Information systems applications
    1. Process control systems

Recommendations

The effects of automatic speech recognition quality on human transcription latency
W4A '16: Proceedings of the 13th International Web for All Conference

Transcription makes speech accessible to deaf and hard of hearing people. This conversion of speech to text is still done manually by humans, despite high cost, because the quality of automated speech recognition (ASR) is still too low in real-world ...
Psycho-acoustics inspired automatic speech recognition
Abstract
Understanding the human spoken language recognition process is still a far scientific goal. Nowadays, commercial automatic speech recognisers (ASRs) achieve high performance at recognising clean speech, but their approaches are poorly ...
Highlights
- We propose a novel Automatic Speech Recognizer inspired by psycho-acoustic studies.
Measuring the intelligibility of dysarthric speech through automatic speech recognition in a pluricentric language
Highlights
- Adding dysarthric speech resources from the dominant variety for training improves automatic recognition of dysarthric speech of the non-dominant variety.
Abstract
Speech intelligibility is an essential though complex construct for evaluating dysarthric speech. Various procedures can be used to measure speech intelligibility, most of which are based on subjective ratings assigned by experts. ...

Comments

Information & Contributors

Information

Published In

ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

October 2015

466 pages

ISBN:9781450334006

DOI:10.1145/2700648

General Chair:
Yeliz Yesilada
Middle East Technical University Northern Cyprus Campus
,
Program Chair:
Jeffrey P. Bigham
Carnegie Mellon University, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2015

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Science Foundation

Conference

ASSETS '15

Sponsor:

SIGACCESS

ASSETS '15: The 17th International ACM SIGACCESS Conference on Computers and Accessibility

October 26 - 28, 2015

Lisbon, Portugal

Acceptance Rates

ASSETS '15 Paper Acceptance Rate 30 of 127 submissions, 24%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pieper MGleasure R(2025) How AI Helps to Compile Human Intelligence: An Empirical Study of Emerging Augmented Intelligence for Medical Image Scanning Information Systems Journal10.1111/isj.12585Online publication date: 21-Jan-2025
https://doi.org/10.1111/isj.12585
Mattos AOliveira D(2018)Multi-view Mouth Renderization for Assisting Lip-readingProceedings of the 15th International Web for All Conference10.1145/3192714.3192824(1-10)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3192714.3192824
Culbertson GShen SJung MAndersen EMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Facilitating Development of Pragmatic Competence through a Voice-driven Video Learning InterfaceProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025805(1431-1440)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025805
Culbertson GShen SAndersen EJung MLee CPoltrock SBarkhuus LBorges MKellogg W(2017)Have your Cake and Eat it TooProceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998268(286-296)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998268
Shin HLi WDurand FRekimoto JIgarashi TWobbrock JAvrahami D(2016)Dynamic Authoring of Audio with Linked ScriptsProceedings of the 29th Annual Symposium on User Interface Software and Technology10.1145/2984511.2984561(509-516)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2984511.2984561
Kawas SKaralis GWen TLadner RFeng JHuenerfauth M(2016)Improving Real-Time Captioning Experiences for Deaf and Hard of Hearing StudentsProceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/2982142.2982164(15-23)Online publication date: 23-Oct-2016
https://dl.acm.org/doi/10.1145/2982142.2982164
Mansikkaniemi AKurimo MLindén K(2016)In-Document Adaptation for a Human Guided Automatic Transcription ServiceSpeech and Computer10.1007/978-3-319-43958-7_47(395-402)Online publication date: 13-Aug-2016
https://doi.org/10.1007/978-3-319-43958-7_47

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations