skip to main content
10.1145/3490149.3505580acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
Work in Progress

Tangible Construction Kit for Blind and Partially Sighted Drawers: Co-Designing a cross-sensory 3D interface with blind and partially sighted drawers during Covid-19

Published:13 February 2022Publication History

ABSTRACT

Drawing as an activity aids problem solving, collaboration, and presentation in design, science, and engineering and artistic creativity as well as expression in the arts. Unfortunately, blind, and partially sighted learners still lack an inclusive and effective drawing tool, even in the digital age. In response, this research aims to explore what an effective drawing tool for blind and partially sighted individuals (BPSI) would be. Raised-line drawing kits aim to provide this, but in prior work, our usability tests of raised line graphics with blind and partially sighted participants rated the raised line graphics that we tested as barely comprehensible relative to 3D models, which they rated as highly comprehensible. Semi-structured interviews with our participants afterward suggest that they found 3D models to be more comprehensible because these are consistent with haptic principles of perception whereas conventions of raised line graphics, such as a line representing a surface edge, replicate visual cues of source images and thereby violate haptic principles of perception. Therefore, we hypothesize that a drawing tool for blind and partially sighted drawers could be effective by recruiting affordances of 3D models. Through co-design sessions conducted during the Covid-19 pandemic with blind and partially sighted drawers (BPSD), we prototyped a tangible 3D model construction kit for non-visual haptic drawing with a digital interface to a 3D virtual environment. Our current investigation of user needs is informing us of our ongoing iterative development of an accessible 3D scanning application that is enabling blind and partially sighted individuals to build and scan in 3D models constructed from a more flexible range of materials beyond what was possible with our previous prototype.

References

  1. Bornschein, J., & Weber, G. (2017). Digital Drawing Tools for Blind Users: A State-of-of the art and Requirement Analysis. Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Blindness Statistics | National Federation of the Blind. (2019, January). National Federation of Blind. https://nfb.org/resources/blindness-statisticsGoogle ScholarGoogle Scholar
  3. Claudia Daudén Roquet, Jeeeun Kim, and Tom Yeh. 2016. 3D Folded PrintGami: Transforming Passive 3D Printed Objects to Interactive by Inserted Paper Origami Circuits. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). Association for Computing Machinery, New York, NY, USA, 187–191. DOI:https://doi.org/10.1145/2901790.2901891Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Han, R., Wnuczko, W. & Coppin, P. (2020, Jul 6-Aug 28) Translating Scientific Content into Accessible Formats with Visually Impaired Learners: Recommendations and a Decision Aid Based on Haptic Rules of Perception. [printed-poster]. 81st Canadian Psychological Association Annual National Convention, Montréal, Quebec, Canada.Google ScholarGoogle Scholar
  5. Hao-Chiang Koong Lin, Mei-Chi Chen & Chih-Kai Chang (2015) Assessing the effectiveness of learning solid geometry by using an augmented reality-assisted learning system, Interactive Learning Environments, 23:6,799-810, DOI:10.1080/10494820.2013.8177435Google ScholarGoogle ScholarCross RefCross Ref
  6. Heller, M. A., McCarthy, M., Schultz, J., Greene, J., Shanley, M., Clark, A., Skoczylas, S., & Prociuk, J. (2005). The Influence of Exploration Mode, Orientation, and Configuration on the Haptic Müller-Lyer Illusion. Perception, 34(12), 1475–1500.https://doi.org/10.1068/p5269Google ScholarGoogle ScholarCross RefCross Ref
  7. Jafri, Rabia & Aljuhani, Asmaa & Ali, Syed. (2016). A tangible user interface-based application utilizing 3D-printed manipulatives for teaching tactual shape perception and spatial awareness sub-concepts to visually impaired children. International Journal of Child-Computer Interaction. 11. 10.1016/j.ijcci.2016.12.001.Google ScholarGoogle Scholar
  8. Kamel, H. M., & Landay, J. A. (2000). A study of blind drawing practice. Proceedings of the Fourth International ACM Conference on Assistive Technologies - Assets ’00.https://doi. org/10.1145/354324.354334Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Kurze, M.(1996) TDraw: A Computer-Based Tactile Drawing Tool for Blind People. InProceedings of Second Annual ACM Conference on Assistive Technologies: Assets ’96. pp.131–138Google ScholarGoogle Scholar
  10. Rawson, P. (2016). Drawing. Philadelphia: University of Pennsylvania Press. https://doi.org/10.9783/9781512805567Google ScholarGoogle ScholarCross RefCross Ref
  11. R.D. Jacobson. 1998. Navigating maps with little or no sight: An audio-tactile approach. In Proceedings of Content Visualization and Intermedia Representations, 95–102.Google ScholarGoogle Scholar
  12. Lauren Thévin, Christophe Jouffrais, Nicolas Rodier, Nicolas Palard, Martin Hachet, . Creating Accessible Interactive Audio-Tactile Drawings Using Spatial Augmented Reality. ISS 2019, ACM International Conference on Interactive Surfaces and Spaces, Nov 2019, Daejeon, South Korea.ff10.1145/3343055.3359711ff. ffhal-02296003fGoogle ScholarGoogle Scholar
  13. Lei Shi, Holly Lawson, Zhuohao Zhang, and Shiri Azenkot. 2019. Designing Interactive 3D Printed Models with Teachers of the Visually Impaired. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–14. https://doi.org/10.1145/3290605.3300427Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Siu, A. F. (2019). Advancing Accessible 3D Design for the Blind and Visually-Impaired via Tactile Shape Displays. The Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software and Technology, 146–149.https://doi.org/10.1145/3332167.335687Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Stéphanie Giraud and Christophe Jouffrais. 2016. Empowering Low-Vision Rehabilitation Professionals with “Do-It-Yourself” Methods. . Springer, Cham, 61–68. https://doi.org/10.1007/978-3-319-41267-2_9Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Tangible Construction Kit for Blind and Partially Sighted Drawers: Co-Designing a cross-sensory 3D interface with blind and partially sighted drawers during Covid-19
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction
        February 2022
        758 pages
        ISBN:9781450391474
        DOI:10.1145/3490149

        Copyright © 2022 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 13 February 2022

        Check for updates

        Qualifiers

        • Work in Progress
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate393of1,367submissions,29%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format