skip to main content
10.1145/3529190.3534785acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
poster

Sensing Visual Art by Relatable Music and Haptic Feedback for Individuals with Visual Impairments

Published:11 July 2022Publication History

ABSTRACT

In recent years, advances in accessible technology have shown their potential to support and assist people with vision impairment. Current State of the Art Research is focused on Sensory Substitution Designs or Devices (SSDs) for assisting people with visual impairments. Moreover, research focuses on accommodating the individuals’ perceptions, sensations, and emotions by incorporating multisensory integration, relatable music, and Ultrasonic Haptic Feedback. This paper discusses the current State of the Art and identifies the gaps in assistive technologies for people with visual impairment. Moreover, this paper proposes a framework that will provide multi-sensory feedback to enhance the person’s experience in a museum and their perception of art paintings.

References

  1. Alexy Bhowmick and Shyamanta M Hazarika. 2017. An insight into assistive technology for the visually impaired and blind people: state-of-the-art and future trends. Journal on Multimodal User Interfaces 11, 2 (2017), 149–172.Google ScholarGoogle ScholarCross RefCross Ref
  2. Jun Dong Cho, Jaeho Jeong, Ji Hye Kim, and Hoonsuk Lee. 2020. Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments. Electronics 2020, Vol. 9, Page 1981 9 (11 2020), 1981. Issue 11. https://doi.org/10.3390/ELECTRONICS9111981Google ScholarGoogle ScholarCross RefCross Ref
  3. Michael Curran. 2020. audioScreen.md. https://www.nvaccess.org/audioScreen/Google ScholarGoogle Scholar
  4. Cédrick-Chappaz. 2040. Hap2U - Haptic Technology Everywhere For a World of Tactile Emotions. https://www.hap2u.net/Google ScholarGoogle Scholar
  5. everydaysight. 2022. 8 Best Watches for People who are Blind or Visually Impaired - Everyday Sight. https://www.everydaysight.com/best-watches-for-blind-people/Google ScholarGoogle Scholar
  6. huffpost. 2011. New Study Shows That Looking At Art Gives Same Pleasure As Being In Love (VIDEO) | HuffPost Entertainment. https://www.huffpost.com/entry/falling-in-love-with-art-_n_861812Google ScholarGoogle Scholar
  7. Karthik Kannan. 2019. Challenges blind people face when living life. https://www.letsenvision.com/blog/challenges-blind-people-face-when-living-lifeGoogle ScholarGoogle Scholar
  8. Karthik Kannan. 2020. Envision - Hear what you want to see.https://www.letsenvision.com/Google ScholarGoogle Scholar
  9. Hendra Kusuma, Muhammad Attamimi, and Hasby Fahrudin. 2020. Deep learning based facial expressions recognition system for assisting visually impaired persons. Bulletin of Electrical Engineering and Informatics 9 (6 2020), 1208–1219. Issue 3. https://doi.org/10.11591/EEI.V9I3.2030Google ScholarGoogle Scholar
  10. Michael-J.-Proulx. 2014. vOICe: the soundscape headsets that allow blind people to ‘see’ the world | Blindness and visual impairment | The Guardian. https://www.theguardian.com/society/2014/dec/07/voice-soundscape-headsets-allow-blind-seeGoogle ScholarGoogle Scholar
  11. Amy C. Nau, Matthew C. Murphy, and Kevin C. Chan. 2015. Use of sensory substitution devices as a model system for investigating cross-modal neuroplasticity in humans. Neural Regeneration Research 10 (11 2015), 1717. Issue 11. https://doi.org/10.4103/1673-5374.169612Google ScholarGoogle Scholar
  12. James Sell. 2020. 5 Electronic Glasses for the Blind and Visually Impaired | IrisVision. https://irisvision.com/electronic-glasses-for-the-blind-and-visually-impaired/Google ScholarGoogle Scholar
  13. Kristina Ter-kazarian. 2021. Influence of an Art Museum Visit on Individuals’ Psychological and Physiological Indicators of Stress | Museology Master of Arts Program. https://www.washington.edu/museology/2021/04/06/influence-of-an-art-museum-visit-on-individuals-psychological-and-physiological-indicators-of-stress/Google ScholarGoogle Scholar
  14. Ruxandra I. Tivadar, Cédrick Chappaz, Fatima Anaflous, Jean Roche, and Micah M. Murray. 2020. Mental Rotation of Digitally-Rendered Haptic Objects by the Visually-Impaired. Frontiers in Neuroscience 14 (3 2020), 197. https://doi.org/10.3389/FNINS.2020.00197/BIBTEXGoogle ScholarGoogle Scholar
  15. Francesco Walker, Berno Bucker, Nicola C. Anderson, Daniel Schreij, and Jan Theeuwes. 2017. Looking at paintings in the Vincent Van Gogh Museum: Eye movement patterns of children and adults. PLoS ONE 12 (6 2017). Issue 6. https://doi.org/10.1371/JOURNAL.PONE.0178912Google ScholarGoogle Scholar
  16. Eric Wargo. 2006. How Many Seconds to a First Impression? – Association for Psychological Science – APS. https://www.psychologicalscience.org/observer/how-many-seconds-to-a-first-impressionGoogle ScholarGoogle Scholar
  17. WeWalk. 2020. WeWALK | Smart Cane for Visually Impaired and Blind People - WeWALK Smart Cane. https://wewalk.io/en/Google ScholarGoogle Scholar

Index Terms

  1. Sensing Visual Art by Relatable Music and Haptic Feedback for Individuals with Visual Impairments
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Other conferences
          PETRA '22: Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments
          June 2022
          704 pages
          ISBN:9781450396318
          DOI:10.1145/3529190

          Copyright © 2022 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 11 July 2022

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • poster
          • Research
          • Refereed limited

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format