skip to main content
10.1145/2513383.2513423acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users

Published: 21 October 2013 Publication History

Abstract

CamIO (short for "Camera Input-Output") is a novel camera system designed to make physical objects (such as documents, maps, devices and 3D models) fully accessible to blind and visually impaired persons, by providing real-time audio feedback in response to the location on an object that the user is pointing to. The project will have wide ranging impact on access to graphics, tactile literacy, STEM education, independent travel and wayfinding, access to devices, and other applications to increase the independent functioning of blind, low vision and deaf-blind individuals. We describe our preliminary results with a prototype CamIO system consisting of the Microsoft Kinect camera connected to a laptop computer. An experiment with a blind user demonstrates the feasibility of the system, which issues Text-to-Speech (TTS) annotations whenever the user's fingers approach any pre-defined "hotspot" regions on the object.

References

[1]
Kane, S. K., Frey, B. and Wobbrock, J. O. "Access lens: a gesture-based screen reader for real-world documents." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2013.
[2]
King, A. "Screenreaders, Magnifiers, and Other Ways of Using Computers." In Assistive Technology for Blindness and Low Vision. Manduchi, R. and Kurniawan, S. (eds.). CRC Press, a Taylor & Francis Group. Boca Raton, FL, 2012.
[3]
Krueger, M. W. and Gilden, D. "Going Places with 'KnowWare': Virtual Reality Maps for Blind People." In: International Conference on Computers Helping People with Special Needs (ICCHP). 2002: 565--567.
[4]
Miele, J. A. and Landau, S. "Audio-Tactile Interactive Computing with the Livescribe Pulse Pen 2." CSUN 25th Annual International Conference on Technology and Persons with Disabilities, San Diego, CA. 2010.
[5]
Szeliski, R. Computer Vision: Algorithms and Applications. Springer, New York, 2010.
[6]
Touch Graphics Research. Retrieved Jun. 20, 2013 from: http://touchgraphics.com/research.html

Cited By

View all
  • (2024)MyWay: a 3D and audio-enhanced transportation learning kit for the visually impaired teenagersCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-024-00163-yOnline publication date: 23-Jul-2024
  • (2024)Accessible Point-and-Tap Interaction for Acquiring Detailed Information About Tactile Graphics and 3D ModelsComputers Helping People with Special Needs10.1007/978-3-031-62846-7_30(252-259)Online publication date: 5-Jul-2024
  • (2023)TouchPilot: Designing a Guidance System that Assists Blind People in Learning Complex 3D StructuresProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608426(1-18)Online publication date: 22-Oct-2023
  • Show More Cited By

Index Terms

  1. CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
    October 2013
    343 pages
    ISBN:9781450324052
    DOI:10.1145/2513383
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 October 2013

    Check for updates

    Author Tags

    1. access
    2. blindness
    3. low vision

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    ASSETS '13
    Sponsor:

    Acceptance Rates

    ASSETS '13 Paper Acceptance Rate 28 of 98 submissions, 29%;
    Overall Acceptance Rate 436 of 1,556 submissions, 28%

    Upcoming Conference

    ASSETS '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)28
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)MyWay: a 3D and audio-enhanced transportation learning kit for the visually impaired teenagersCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-024-00163-yOnline publication date: 23-Jul-2024
    • (2024)Accessible Point-and-Tap Interaction for Acquiring Detailed Information About Tactile Graphics and 3D ModelsComputers Helping People with Special Needs10.1007/978-3-031-62846-7_30(252-259)Online publication date: 5-Jul-2024
    • (2023)TouchPilot: Designing a Guidance System that Assists Blind People in Learning Complex 3D StructuresProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608426(1-18)Online publication date: 22-Oct-2023
    • (2022)ClipWidgets: 3D-printed Modular Tangible UI Extensions for SmartphonesProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501314(1-11)Online publication date: 13-Feb-2022
    • (2022)Tactile Audio Responsive Intelligent SystemIEEE Access10.1109/ACCESS.2022.322309910(122074-122091)Online publication date: 2022
    • (2021)A Study of Multi-Sensory Experience and Color Recognition in Visual Arts Appreciation of People with Visual ImpairmentElectronics10.3390/electronics1004047010:4(470)Online publication date: 15-Feb-2021
    • (2021)Accessible Visual Artworks for Blind and Visually Impaired People: Comparing a Multimodal Approach with Tactile GraphicsElectronics10.3390/electronics1003029710:3(297)Online publication date: 26-Jan-2021
    • (2021)Haptic Guidance to Support Design Education and Collaboration for Blind and Visually Impaired PeopleDesign Thinking Research10.1007/978-3-030-76324-4_9(167-180)Online publication date: 12-Aug-2021
    • (2020)What is the point of fairness?ACM SIGACCESS Accessibility and Computing10.1145/3386296.3386301(1-1)Online publication date: 2-Mar-2020
    • (2020)PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics ExplorationProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3418023(1-4)Online publication date: 26-Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media