skip to main content
10.1145/2982142.2982200acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
poster

VizMap: Accessible Visual Information Through Crowdsourced Map Reconstruction

Published: 23 October 2016 Publication History

Abstract

When navigating indoors, blind people are often unaware of key visual information, such as posters, signs, and exit doors. Our VizMap system uses computer vision and crowdsourcing to collect this information and make it available non-visually. VizMap starts with videos taken by on-site sighted volunteers and uses these to create a 3D spatial model. These video frames are semantically labeled by remote crowd workers with key visual information. These semantic labels are located within and embedded into the reconstructed 3D model, forming a query-able spatial representation of the environment. VizMap can then localize the user with a photo from their smartphone, and enable them to explore the visual elements that are nearby. We explore a range of example applications enabled by our reconstructed spatial representation. With VizMap, we move towards integrating the strengths of the end user, on-site crowd, online crowd, and computer vision to solve a long-standing challenge in indoor blind exploration.

References

[1]
J. P. Bigham, C. Jayant, H. Ji, G. Little, A. Miller, R. C. Miller, R. Miller, A. Tatarowicz, B. White, S. White, et al. Vizwiz: nearly real-time answers to visual questions. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 2010.
[2]
N. Fallah, I. Apostolopoulos, K. Bekris, and E. Folmer. The user as a sensor: navigating users with visual impairments in indoor spaces using tactile landmarks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2012.
[3]
A. Irschara, C. Zach, J.-M. Frahm, and H. Bischof. From structure-from-motion point clouds to fast location recognition. In IEEE Comference on Computer Vision and Pattern Recognition. IEEE, 2009.
[4]
R. Yang, S. Park, S. R. Mishra, Z. Hong, C. Newsom, H. Joo, E. Hofer, and M. W. Newman. Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility. ACM, 2011.
[5]
Y. Zhong, W. S. Lasecki, E. Brady, and J. P. Bigham. Regionspeak: Quick comprehensive spatial descriptions of complex images for blind users. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015.

Cited By

View all
  • (2023)A Lightweight Approach to Localization for Blind and Visually Impaired TravelersSensors10.3390/s2305270123:5(2701)Online publication date: 1-Mar-2023
  • (2023)Assistive technology for people with visual disability: Future prospects through a technology foresight exerciseTechnology and Disability10.3233/TAD-23001035:3(183-194)Online publication date: 28-Sep-2023
  • (2023)Understanding Curators' Practices and Challenge of Making Exhibitions More Accessible for People with Visual ImpairmentsProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608384(1-18)Online publication date: 22-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility
October 2016
362 pages
ISBN:9781450341240
DOI:10.1145/2982142
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2016

Check for updates

Author Tags

  1. accessibility
  2. blind users
  3. crowdsourcing
  4. indoor navigation

Qualifiers

  • Poster

Conference

ASSETS '16
Sponsor:

Acceptance Rates

ASSETS '16 Paper Acceptance Rate 24 of 95 submissions, 25%;
Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)27
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)A Lightweight Approach to Localization for Blind and Visually Impaired TravelersSensors10.3390/s2305270123:5(2701)Online publication date: 1-Mar-2023
  • (2023)Assistive technology for people with visual disability: Future prospects through a technology foresight exerciseTechnology and Disability10.3233/TAD-23001035:3(183-194)Online publication date: 28-Sep-2023
  • (2023)Understanding Curators' Practices and Challenge of Making Exhibitions More Accessible for People with Visual ImpairmentsProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608384(1-18)Online publication date: 22-Oct-2023
  • (2022)“I Shake The Package To Check If It’s Mine”Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502063(1-15)Online publication date: 29-Apr-2022
  • (2022)Opportunities for Human-AI Collaboration in Remote Sighted AssistanceProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511113(63-78)Online publication date: 22-Mar-2022
  • (2022)Smartphone Based Tactile Feedback System Providing Navigation and Obstacle Avoidance to the Blind and Visually Impaired2022 5th International Conference on Advances in Science and Technology (ICAST)10.1109/ICAST55766.2022.10039535(236-242)Online publication date: 2-Dec-2022
  • (2021)An automated AR-based annotation tool for indoor navigation for visually impaired peopleProceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3441852.3476561(1-4)Online publication date: 17-Oct-2021
  • (2021)Accessible wayfinding and navigation: a systematic mapping studyUniversal Access in the Information Society10.1007/s10209-021-00843-x22:1(185-212)Online publication date: 8-Sep-2021
  • (2020)Aggregating Life Tags for Opportunistic Crowdsensing with Mobile and Smartglasses UsersProceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good10.1145/3411170.3411237(66-71)Online publication date: 14-Sep-2020
  • (2020)Indoor localization for visually impaired travelers using computer vision on a smartphoneProceedings of the 17th International Web for All Conference10.1145/3371300.3383345(1-11)Online publication date: 20-Apr-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media