Skip to main content

Workload Evaluations for Closed Captioners

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13341))

Abstract

Live captioning in broadcasting involves the translation from spoken words in broadcasted programming to text equivalents, speaker identification and some non-speech audio information in real-time where there is little or no opportunity for editing, or correction. Some of this live content can be too fast to type, and/or read, which then can translate into difficulties and barriers for viewers. Recently, paraphrasing has been permitted in order to attempt to mitigate some of these difficulties, but different cognitive elements must be recruited compared with verbatim translation. This research presents preliminary results of live captioner’s subjective mental workload (SMW) using the NASA TLX, and their experiences with paraphrasing. We hypothesize that the cognitive processes of paraphrasing increase SMW. Results indicate that live captioners experience high SMW particularly for fast-paced sports. Paraphrasing may contribute to higher perceived SMW for live captioning fast-paced sports, talk shows and weather.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Fresno, N., Sepielak, K., Krawczyk, M.: Football for all: the quality of the live closed captioning in the Super Bowl LII. Univ. Access Inf. Soc. 20(4), 729–740 (2020). https://doi.org/10.1007/s10209-020-00734-7

    Article  Google Scholar 

  2. Psutka, J.V., Pražák, A., Psutka, J., Radová, V.: Captioning of live TV commentaries from the olympic games in Sochi: some interesting insights. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2014. LNCS (LNAI), vol. 8655, pp. 515–522. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10816-2_62

    Chapter  Google Scholar 

  3. Fresno, N.: Of bad hombres and nasty women; the quality of the live closed captioning in the 2016 US final presidential debate. Perspectives 27, 350–366 (2019). https://doi.org/10.1080/0907676X.2018.1526960

    Article  Google Scholar 

  4. Burnham, D., et al.: Parameters in television captioning for deaf and hard-of-hearing adults: effects of caption rate versus text reduction on comprehension. J. Deaf Stud. Deaf Educ. 13, 391–404 (2008)

    Article  Google Scholar 

  5. Alaimo, A., Esposito, A., Orlando, C., Simoncini, A.: Aircraft pilots workload analysis: heart rate variability objective measures and NASA-task load index subjective evaluation. Aerospace 7, 137 (2020). https://doi.org/10.3390/aerospace7090137

    Article  Google Scholar 

  6. Vasel, L.A.: Exploring the Invisible Work of Nursing: A Case Study of Simulated Increases in Intensity of Care on Nurses’ Cognitive Load, Clinical Judgment, Stress, and Errors (2020)

    Google Scholar 

  7. Jones, T., Kalbfeld, J.R., Hancock, R., Clark, R.: Testifying while black: an experimental study of court reporter accuracy in transcription of African American English. Language 95, e216–e252 (2019). https://doi.org/10.1353/lan.2019.0042

    Article  Google Scholar 

  8. Chen, S.: The construct of cognitive load in interpreting and its measurement. Perspectives 25, 640–657 (2017). https://doi.org/10.1080/0907676X.2016.1278026

    Article  Google Scholar 

  9. Seeber, K.G.: Cognitive load in simultaneous interpreting: existing theories — new models. Interpreting 13, 176–204 (2011). https://doi.org/10.1075/intp.13.2.02see

    Article  Google Scholar 

  10. Christoffels, I.K., Groot, A.M.B.D.: Components of simultaneous interpreting: comparing interpreting with shadowing and paraphrasing. Bilingualism Lang. Cognit. 7, 227–240 (2004). https://doi.org/10.1017/S1366728904001609

  11. Downey, G.: Constructing “computer-compatible” stenographers: the transition to real-time transcription in courtroom reporting. Technol. Cult. 47, 1–26 (2006)

    Article  MathSciNet  Google Scholar 

  12. 47 CFR 79.1 – Closed captioning of televised video programming. https://www.ecfr.gov/current/title-47/chapter-I/subchapter-C/part-79/subpart-A/section-79.1

  13. Canadian Association of Broadcasters: Closed captioning standards and protocol for Canadian English language television programming services (2008)

    Google Scholar 

  14. Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock, P.A., Meshkat, N. (eds.) Human Mental Workload, pp. 139–183 (1988)

    Google Scholar 

  15. Grier, R.A.: How high is high? A meta-analysis of NASA-TLX global workload scores. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 1727–1731. SAGE Publications, Los Angeles (2015)

    Google Scholar 

  16. Lowndes, B.R., et al.: NASA-TLX assessment of surgeon workload variation across specialties. Ann. Surg. 271, 686–692 (2020)

    Article  Google Scholar 

  17. Szarkowska, A., Krejtz, K., Dutka, Ł., Pilipczuk, O.: Cognitive load in intralingual and interlingual respeaking – a preliminary study. Poznan Stud. Contemp. Linguist. 52 (2016). https://doi.org/10.1515/psicl-2016-0008

Download references

Acknowledgements

Funding was generously provided by Accessibility Standards Canada. We also thank Quoc Viet Andy Nguyen for preparing the survey, and all of the respondents who persisted in completing it.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Deborah I. Fels .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Karam, M. et al. (2022). Workload Evaluations for Closed Captioners. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_62

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08648-9_62

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08647-2

  • Online ISBN: 978-3-031-08648-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics