skip to main content
10.1145/3544549.3583909acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

Enable Blind Users’ Experience in 3D Virtual Environments: The Scene Weaver Prototype

Published: 19 April 2023 Publication History

Abstract

Three-dimensional virtual environments are currently inaccessible to people who are blind, as current screen-reading solutions for 2D content are not fully extensible to achieve the needed embodied spatial presence. Forefronting perceptual agency as key to any access approach for users who are blind, we offer Scene Weaving as an interactional metaphor that allows users to choose how and when they perceive the environment and the people in it. We illustrate how this metaphor can be implemented in an example prototype system. In this interactivity, users can control how and when they perceive a virtual museum environment and people within it through a range of interaction mechanisms.

Supplementary Material

VTT File (3544549.3583909-preview.vtt)
VTT File (3544549.3583909-walkthrough.vtt)
MP4 File (3544549.3583909-walkthrough.mp4)
Walkthrough Video
MP4 File (3544549.3583909-preview.mp4)
Video Preview

References

[1]
Ronny Andrade, Steven Baker, Jenny Waycott, and Frank Vetere. 2018. Echo-house: Exploring a virtual environment by using echolocation. In OzCHI ’18: Proceedings of the 30th Australian Conference on Computer-Human Interaction, ACM, 278–289.
[2]
Cecily Morrison, Edward Cutrell, Martin Grayson, Anja Thieme, Alex S. Taylor, Geert Roumen, Camilla Longden, Rita Marques, Abigail Sellen, and Sebastian Tschiatschek. 2021. Social Sensemaking with AI: Designing an Open-ended AI experience with a Blind Child. In The 2021 CHI Proceedings on Human Factors in Computing Systems, 1–12.
[3]
Eelke Folmer, Bei Yuan, Dave Carr, and Manjari Sapre. 2009. TextSL: A command-based virtual world interface for the visually impaired. In ASSETS’09 - Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, ACM, 59–66.
[4]
José Luis González-Mora, A. Rodriguez-Hernandez, Enrique Burunat, Martin F., and Miguel A. Castellano. 2006. Seeing the world by hearing: Virtual Acoustic Space (VAS) a new space perception system for blind people. In 2006 2nd International Conference on Information & Communication Technologies, IEEE, 837–842.
[5]
Hanne de Jaegher and Ezequiel di Paolo. 2007. Participatory sense-making: An inactive approach to social cognition. Phenomenol Cogn Sci 6, 4 (December 2007), 485–507.
[6]
Orly Lahav and David Mioduser. 2001. Multisensory virtual environment for supporting blind persons’ acquisition of spatial cognitive mapping–a case study. In EdMedia+ Innovate Learning, Association for the Advancement of Computing in Education (AACE), Norfolk, VA, USA, 1046–1051.
[7]
Martez Mott, Edward Cutrell, Mar Gonzalez Franco, Christian Holz, Eyal Ofek, Richard Stoakley, and Meredith Ringel Morris. 2019. Accessible by design: An opportunity for virtual reality. In Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019, Institute of Electrical and Electronics Engineers Inc., 451–454.
[8]
Darren J. Reed. 2019. Dancing with Data: Introducing a Creative Interactional Metaphor. Sociol Res Online 25, 4 (2019), 533–548.
[9]
Yvonne Rogers, Helen Sharp, and Jennifer Preece. 2011. Interaction design: Beyond human-computer interaction (3rd edition ed.). John Wiley & Sons.
[10]
Jaime Sánchez and Mauricio Lumbreras. 2009. Virtual Environment Interaction Through 3D Audio by Blind Children. Cyber Psychology & Behavior 2, 2 (January 2009), 101–111.
[11]
Anastasia Schaadhardt, Alexis Hiniker, and Jacob O. Wobbrock. 2021. Understanding Blind Screen-Reader Users’ Experiences of Digital Artboards. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, 1–19.
[12]
S. K. Semwal. 2001. MoVE: Mobiltiy training in haptic virtual environment. piglet.uccs.edu/∼ semwal/NSF2001PS.pdf.
[13]
Alexa F Siu, Mike Sinclair, Robert Kovacs, Eyal Ofek, Christian Holz, and Edward Cutrell. 2020. Virtual Reality Without Vision: A Haptic and Auditory White Cane to Navigate Complex Virtual Worlds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20), Association for Computing Machinery, New York, NY, USA, 1–13.
[14]
Anja Thieme, Cynthia L Bennett, Cecily Morrison, Edward Cutrell, and Alex S Taylor. 2018. “I Can Do Everything but See!” – How People with Vision Impairments Negotiate Their Abilities in Social Contexts. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), Association for Computing Machinery, New York, NY, USA, 1–14.
[15]
M.A Torres-Gil, O. Casanova-Gonzalez, and José Luis González-Mora. 2010. Applications of virtual reality for visually impaired people. WSEAS transactions on computers 9, 2 (2010), 184–193.
[16]
Dimitrios Tzovaras, Georgios Nikolakis, George Fergadis, Stratos Malasiotis, and Modestos Stavrakis. 2002. Design and implementation of virtual environments training of the visually impaired. Proceedings of the fifth international ACM conference on Assistive technologies - Assets ’02 (2002), 48.
[17]
Rosa van der Veen, Jeroen Peeters, and Ambra Trotto. 2018. Charged utopia VR: exploring embodied sense-making in the virtual space. In TEI ’18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction, Association for Computing Machinery, Inc, 292–298.
[18]
Herman Wahidin, Jenny Waycott, and Steven Baker. 2018. The challenges in adopting assistive technologies in the workplace for people with visual impairments. In Proceedings of the 30th Australian Conference on Computer-Human Interaction, ACM Press, 432–442.
[19]
Ryan Wedoff, Lindsay Ball, Amelia Wang, Yi Xuan Khoo, Lauren Lieberman, and Kyle Rector. 2019. Virtual Showdown: An accessible virtual reality game with scaffolds for youth with visual impairments. In CHI ’19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery.
[20]
World Health Organization. 2021. Global strategy on digital health 2020-2025.

Cited By

View all
  • (2024)SocialCueSwitch: Towards Customizable Accessibility by Representing Social Cues in Multiple SensesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651109(1-7)Online publication date: 11-May-2024
  • (2024)Investigating Virtual Reality Locomotion Techniques with Blind PeopleProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642088(1-17)Online publication date: 11-May-2024
  • (2023)“The Guide Has Your Back”: Exploring How Sighted Guides Can Enhance Accessibility in Social Virtual Reality for Blind and Low Vision PeopleProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608386(1-14)Online publication date: 22-Oct-2023

Index Terms

  1. Enable Blind Users’ Experience in 3D Virtual Environments: The Scene Weaver Prototype

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
      April 2023
      3914 pages
      ISBN:9781450394222
      DOI:10.1145/3544549
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 19 April 2023

      Check for updates

      Author Tags

      1. Accessibility
      2. Interaction Metaphor
      3. Perceptual Agency
      4. Virtual Environments
      5. Virtual Reality

      Qualifiers

      • Demonstration
      • Research
      • Refereed limited

      Conference

      CHI '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)259
      • Downloads (Last 6 weeks)25
      Reflects downloads up to 15 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)SocialCueSwitch: Towards Customizable Accessibility by Representing Social Cues in Multiple SensesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651109(1-7)Online publication date: 11-May-2024
      • (2024)Investigating Virtual Reality Locomotion Techniques with Blind PeopleProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642088(1-17)Online publication date: 11-May-2024
      • (2023)“The Guide Has Your Back”: Exploring How Sighted Guides Can Enhance Accessibility in Social Virtual Reality for Blind and Low Vision PeopleProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608386(1-14)Online publication date: 22-Oct-2023

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media