Skip to main content
Springer Nature Link
Log in

Cooking in the Dark: Exploring Spatial Audio as MR Assistive Technology for the Visually Impaired

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12936))

Included in the following conference series:

  • 2861 Accesses

Abstract

In the context of raising awareness to assistive technologies, we propose a gaming experience that allows users to embody having a visual impairment. By occluding the user’s vision and providing spatialized audio and passive haptic feedback, allied with a speech recognition digital assistant, our goal is to present a multi-sensory experience that offers the user a sense of embodiment inside a mixed reality blindness simulation. Inside the game environment, the player is required to cook a meal completely in the dark. Being aided solely by their remaining senses and a digital assistant with spatialized audio capabilities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Branham, S.M., Kane, S.K.: Collaborative accessibility: how blind and sighted companions co-create accessible home spaces. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. CHI 2015 (2015)

    Google Scholar 

  2. Ferrand, S., Alouges, F., Aussal, M.: Binaural Spatialization methods for indoor navigation. In: Audio Engineering Society Convention 142 (2017)

    Google Scholar 

  3. Ferrand, S., Alouges, F., Aussal, M.: An augmented reality audio device helping blind people navigation. In: Computers Helping People with Special Needs (2018)

    Google Scholar 

  4. Grayson, M., Thieme, A., Marques, R., Massiceti, D., Cutrell, E., Morrison, C.: A dynamic ai system for extending the capabilities of blind people. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. CHI EA 2020 (2020)

    Google Scholar 

  5. Insko, B.E.: Passive Haptics Significantly Enhances Virtual Environments. Ph.D. thesis (2001)

    Google Scholar 

  6. Iravantchi, Y., Goel, M., Harrison, C.: Digital ventriloquism: giving voice to everyday objects. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI 2020 (2020)

    Google Scholar 

  7. Khot, R.A., Mueller, F.: Human-food interaction. Found. Trends Hum.-Comput. Interact. 12(4), 238–415 (2019)

    Google Scholar 

  8. Navarro-Tuch, S.A., et al.: Emotional domotics: inhabitable space variable control for the emotions modulation. In: Proceedings of SAI Intelligent Systems Conference 2016 (2018)

    Google Scholar 

  9. de Oliveira, G.A.A., de Bettio, R.W., Freire, A.P.: Accessibility of the smart home for users with visual disabilities: an evaluation of open source mobile applications for home automation. In: Proceedings of the 15th Brazilian Symposium on Human Factors in Computing Systems. IHC 2016 (2016)

    Google Scholar 

  10. Storer, K.M., Judge, T.K., Branham, S.M.: “All in the same boat”: tradeoffs of voice assistant ownership for mixed-visual-ability families (2020)

    Google Scholar 

  11. Thieme, A., Bennett, C.L., Morrison, C., Cutrell, E., Taylor, A.S.: “I can do everything but see!” - how people with vision impairments negotiate their abilities in social contexts (2018)

    Google Scholar 

  12. Vona, F., Torelli, E., Beccaluva, E., Garzotto, F.: Exploring the potential of speech-based virtual assistants in mixed reality applications for people with cognitive disabilities (2020)

    Google Scholar 

  13. Zöllner, M., Huber, S., Jetter, H.C., Reiterer, H.: Navi - a proof-of-concept of a mobile navigational aid for visually impaired based on the Microsoft Kinect. In: Human-Computer Interaction - INTERACT 2011 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Royal Melbourne Institute of Technology, Melbourne, VIC, Australia

    Renan Guarese, Fabio Zambetta & Ron van Schyndel

  2. Federal University of Rio Grande do Sul, Porto Alegre, RS, Brazil

    Franklin Bastidas, João Becker, Mariane Giambastiani, Yhonatan Iquiapaza, Lennon Macedo, Luciana Nedel & Anderson Maciel

Authors
  1. Renan Guarese
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Franklin Bastidas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. João Becker
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mariane Giambastiani
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yhonatan Iquiapaza
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lennon Macedo
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Luciana Nedel
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Anderson Maciel
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Fabio Zambetta
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Ron van Schyndel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Renan Guarese .

Editor information

Editors and Affiliations

  1. Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy

    Carmelo Ardito

  2. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Rosa Lanzilotti

  3. Computer Science Department, University of Pisa, Pisa, Italy

    Alessio Malizia

  4. Department of Computer Science, University of York, York, UK

    Helen Petrie

  5. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  6. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Giuseppe Desolda

  7. Microsoft Research, Redmond, WA, USA

    Kori Inkpen

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 24382 KB)

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guarese, R. et al. (2021). Cooking in the Dark: Exploring Spatial Audio as MR Assistive Technology for the Visually Impaired. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12936. Springer, Cham. https://doi.org/10.1007/978-3-030-85607-6_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85607-6_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85606-9

  • Online ISBN: 978-3-030-85607-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships