skip to main content
10.1145/1056808.1057028acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Tangible newspaper for the visually impaired users

Published: 02 April 2005 Publication History

Abstract

This paper outlines a novel interaction technique allowing the visually impaired users to examine the layout of complex paper documents (e.g. a newspaper page). The document is placed on a desk in the view of a camera placed above it. The tip of user's index finger is tracked by means of algorithms of computer vision. As the user moves the finger over the document, the layout of its logical units (articles) is revealed by means of a simple sonification of their boundaries and the speech synthesis. In the paper, implementation of the test application is described and evaluated. The main advantage of our system is the direct mapping of the kinaesthetic experience to the layout of the physical document, enabling the user to employ any strategy to traverse the document. The prototype has been implemented using the ARToolKit library.

References

[1]
H. Ishii, B. Ullmer: Tangible bits: towards seamless interfaces between people, bits, and atoms. In: Proceedings of the CHI'97 conference on human factors in computing systems, Atlanta, Georgia, March 1997, pp 234--241.
[2]
K. P. Fishkin: A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing, ISSN 1617-4909, Springer-Verlag London Ltd, 2004.
[3]
W. W. Gaver: Sythesizing Auditory Icons. ACM INTERCHI'93 Conference on Human Factors in Computing Systems: 228--235, ACM Press, 1993.
[4]
ARToolKit homepage, on-line resource, URL: http://www.hitl.washington.edu/artoolkit (retrieved 12/12/2004.)
[5]
M. Fernström, L. Bannon, E. Brazil: An investigation of soft-button widgets using sound. In: Le Journées de Design Sonore 2004. URL: http://richie.idc.ul.ie/eoin/research/fernstrom_et_al_jds04.pdf(retrieved 02/01/2005.)
[6]
V. N ě mec, A. J. Sporka, P. Slavík: Haptic and Spatial Audio Based Navigation of Visually Impaired Users in Virtual Environment. 8th ERCIM International Workshop "User Interfaces For All", LCNS 3196, pp. 452--459, Springer-Verlag Berlin Heidelberg, Vienna, June 2004.
[7]
Z. Míkovec, P. Slavík: Tool for Pictorial Data Transformations. In: Intelligent Multimedia, Computing and Communications, Technologies and Applications of the Future. New York: John Wiley & Sons, 2001, p. 10--19.

Cited By

View all
  • (2020)FingerTalkie: Designing a Low-Cost Finger-Worn Device for Interactive Audio Labeling of Tactile DiagramsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_32(475-496)Online publication date: 10-Jul-2020
  • (2018)Towards a Multisensory Augmented Reality Map for Blind and Low Vision PeopleProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174203(1-14)Online publication date: 21-Apr-2018
  • (2011)Sharing Multilingual Resources to Support Hospital ReceptionsThe Language Grid10.1007/978-3-642-21178-2_8(119-132)Online publication date: 16-Jul-2011
  • Show More Cited By

Index Terms

  1. Tangible newspaper for the visually impaired users

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems
    April 2005
    1358 pages
    ISBN:1595930027
    DOI:10.1145/1056808
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 April 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. auditory feedback
    2. tangible user interfaces
    3. visually impaired users

    Qualifiers

    • Article

    Conference

    CHI05
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)FingerTalkie: Designing a Low-Cost Finger-Worn Device for Interactive Audio Labeling of Tactile DiagramsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_32(475-496)Online publication date: 10-Jul-2020
    • (2018)Towards a Multisensory Augmented Reality Map for Blind and Low Vision PeopleProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174203(1-14)Online publication date: 21-Apr-2018
    • (2011)Sharing Multilingual Resources to Support Hospital ReceptionsThe Language Grid10.1007/978-3-642-21178-2_8(119-132)Online publication date: 16-Jul-2011
    • (2009)Design of Face-to-Face Multilingual Communication Environment for Illiterate PeopleProceedings of the 3rd International Conference on Internationalization, Design and Global Development: Held as Part of HCI International 200910.1007/978-3-642-02767-3_32(283-292)Online publication date: 15-Jul-2009
    • (2008)The Human Modes of Being in Investigating User ExperienceFuture Interaction Design II10.1007/978-1-84800-385-9_10(191-207)Online publication date: 20-Oct-2008
    • (2007)Accessibility research at the Czech Technical UniversityACM SIGACCESS Accessibility and Computing10.1145/1278234.1278239(29-35)Online publication date: 1-Jun-2007
    • (2007)Tangible User Interface for the Exploration of Auditory City MapsHaptic and Audio Interaction Design10.1007/978-3-540-76702-2_10(86-97)Online publication date: 2007
    • (2005)Speech based user interface for users with special needsProceedings of the 8th international conference on Text, Speech and Dialogue10.1007/11551874_6(45-55)Online publication date: 12-Sep-2005

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media