Skip to main content

Tactile Captions: Augmenting Visual Captions

  • Conference paper
Computers Helping People with Special Needs (ICCHP 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8547))

Included in the following conference series:

  • 3239 Accesses

Abstract

We explore the efficacy of tactile captions as a supplement to online captioned video. Closed captions are not fully accessible, because many auditory signals are not easily represented by words, e.g., the sound of the ball being hit by a bat, or to describe a ring tone. The goal is to explore whether audiovisual information can be effectively represented through an equivalent tactile-visual interface. We compare viewers preferences between viewing video with captions alone, and captions plus tactile captions. Our study showed that viewers significantly preferred tactile captions to captions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Apostolopoulos, I., Fallah, N., Folmer, E., Bekris, K.E.: Integrated online localization and navigation for people with visual impairments using smart phones. ACM Transactions on Interactive Intelligent Systems 3(4), 1–28 (2014), http://dl.acm.org/citation.cfm?doid=2567808.2499669

    Article  Google Scholar 

  2. Baijal, A., Kim, J., Branje, C., Russo, F., Fels, D.I.: Composing vibrotactile music: A multi-sensory experience with the emoti-chair. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 509–515. IEEE (March 2012), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6183839

  3. Branje, C., Karam, M., Fels, D., Russo, F.: Enhancing entertainment through a multimodal chair interface. In: 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH), pp. 636–641. IEEE (September 2009), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5444421

  4. Jensema, C.: Viewer reaction to different television captioning speeds. American Annals of the Deaf 143(4), 318–324 (1998), http://www.ncbi.nlm.nih.gov/pubmed/9842059

    Article  Google Scholar 

  5. Khoo, W.L., Seidel, E.L., Zhu, Z.: Designing a virtual environment to evaluate multimodal sensors for assisting the visually impaired. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 573–580. Springer, Heidelberg (2012), http://link.springer.com/10.1007/978-3-642-31534-3

    Chapter  Google Scholar 

  6. Kushalnagar, R.S., Lasecki, W.S., Bigham, J.P.: Captions Versus Transcripts for Online Video Content. In: 10th International Cross-Disclipinary Conference on Web Accessibility (W4A), pp. 32:1–32:4. ACM Press, Rio De Janerio (2013), http://dl.acm.org/citation.cfm?id=2461142

  7. Kushalnagar, R.S., Lasecki, W.S., Bigham, J.P.: Accessibility Evaluation of Classroom Captions. ACM Transactions on Accessible Computing 5(3), 1–24 (2014), http://dl.acm.org/citation.cfm?doid=2568367.2543578

    Article  Google Scholar 

  8. Sundaram, S., Narayanan, S.: Classification of sound clips by two schemes: Using onomatopoeia and semantic labels. In: 2008 IEEE International Conference on Multimedia and Expo, pp. 1341–1344. IEEE (June 2008), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4607691

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Kushalnagar, R., Ramachandran, V., Oh, T. (2014). Tactile Captions: Augmenting Visual Captions. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham. https://doi.org/10.1007/978-3-319-08596-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08596-8_5

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08595-1

  • Online ISBN: 978-3-319-08596-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics