Abstract
Audio-tactile charts have the potential to improve data analysis with tactile charts for blind people. Enhancing tactile charts with audio feedback can replace Braille labels and provide more structured information than pure tactile graphics. Current approaches lack especially in support of gestural interaction to develop useful interaction concepts for audio-tactile charts. Many approaches make use of non-standard hardware or are less mobile. That is why we investigated digital pens and their capability to increase data analysis with tactile charts. We compared two digital pens, in particular, the TipToi\(^{\textregistered }\) pen and the Neo SmartPen M1. First, we evaluated the implementation and feasibility of five basic gestures. While the TipToi\(^{\textregistered }\) is not suitable to support rich touch gestures, the Neo SmartPen showed in a pilot study good support of single-tap, double-tap as well as hold and line gestures. On that basis, we implemented the first prototype to demonstrate the potential of digital pens to support data analysis tasks with audio-tactile scatterplots. Afterwards, we evaluated the prototype in a pilot study with one participant. The study shows high indications for the usefulness of the presented system. The usage of the digital pen can improve the readability of a tactile chart. Our system provides audio-feedback for given tactile scatterplots in an accessible and automatic way. As a result, blind users were able to produce and use audio-tactile charts on their own by using an Android application and the Neo SmartPen.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://www.metec-ag.de/en/produkte-graphik-display.php, Retrieved on 04 April, 2020.
- 2.
https://github.com/entropia/tip-toi-reveng/wiki. Retrieved on 04 April, 2020.
References
Baker, C.M., Milne, L.R., Scofield, J., Bennett, C.L., Ladner, R.E.: Tactile graphics with a voice: using QR codes to access text in tactile graphics. In: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 75–82 (2014)
Brock, A., Jouffrais, C.: Interactive audio-tactile maps for visually impaired people. ACM SIGACCESS Access. Comput. 113, 3–12 (2015)
Engel, C., Weber, G.: User study: a detailed view on the effectiveness and design of tactile charts. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11746, pp. 63–82. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29381-9_5
Fusco, G., Morash, V.S.: The tactile graphics helper: providing audio clarification for tactile graphics using machine vision. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 97–106 (2015)
Gardner, J.A., Bulatov, V.: Scientific diagrams made easy with IVEOTM. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2006. LNCS, vol. 4061, pp. 1243–1250. Springer, Heidelberg (2006). https://doi.org/10.1007/11788713_179
Goncu, C., Marriott, K.: GraVVITAS: generic multi-touch presentation of accessible graphics. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6946, pp. 30–48. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23774-4_5
Götzelmann, T.: LucentMaps: 3D printed audiovisual tactile maps for blind and visually impaired people. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 81–90 (2016)
Kane, S.K., Morris, M.R., Wobbrock, J.O.: Touchplates: low-cost tactile overlays for visually impaired touch screen users. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–8 (2013)
Landau, S., Bourquin, G., Miele, J., Van Schaack, A.: Demonstration of a universally accessible audio-haptic transit map built on a digital pen-based platform. In: Proceedings of the 3rd International Workshop on Haptic and Audio Interaction Design, pp. 23–24. Citeseer (2008)
Landau, S., Wells, L.: Merging tactile sensory input and audio data by means of the talking tactile tablet. Proc. EuroHaptics 3, 414–418 (2003)
Melfi, G., Müller, K., Schwarz, T., Jaworek, G., Stiefelhagen, R.: Understanding what you feel: A mobile audio-tactile system for graphics used at schools with students with visual impairment. In: Proceedings of the CHI Conference 2020 (to be published) (2020)
Miele, J.A., Landau, S., Gilden, D.: Talking TMAP: automated generation of audio-tactile maps using smith-kettlewell’s TMAP software. Br. J. Vis. Impairment 24(2), 93–100 (2006)
Ramloll, R., Yu, W., Brewster, S., Riedel, B., Burton, M., Dimigen, G.: Constructing sonified haptic line graphs for the blind student: first steps. In: Proceedings of the Fourth International ACM Conference on Assistive Technologies, pp. 17–25 (2000)
Wall, S.A., Brewster, S.A.: Tac-tiles: multimodal pie charts for visually impaired users. In: Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles, pp. 9–18 (2006)
Yu, W., Ramloll, R., Brewster, S.: Haptic graphs for blind computer users. In: Brewster, S., Murray-Smith, R. (eds.) Haptic HCI 2000. LNCS, vol. 2058, pp. 41–51. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-44589-7_5
Zeng, L., Weber, G.: Audio-haptic browser for a geographical information system. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010. LNCS, vol. 6180, pp. 466–473. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14100-3_70
Zeng, L., Weber, G.: Exploration of location-aware you-are-here maps on a pin-matrix display. IEEE Trans. Hum. Mach. Syst. 46(1), 88–100 (2015)
Zhao, H., Plaisant, C., Shneiderman, B., Duraiswami, R.: Sonification of geo-referenced data for auditory information seeking: design principle and pilot study. In: ICAD (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Engel, C., Konrad, N., Weber, G. (2020). TouchPen: Rich Interaction Technique for Audio-Tactile Charts by Means of Digital Pens. In: Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M., Peňáz, P. (eds) Computers Helping People with Special Needs. ICCHP 2020. Lecture Notes in Computer Science(), vol 12376. Springer, Cham. https://doi.org/10.1007/978-3-030-58796-3_52
Download citation
DOI: https://doi.org/10.1007/978-3-030-58796-3_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58795-6
Online ISBN: 978-3-030-58796-3
eBook Packages: Computer ScienceComputer Science (R0)