Skip to main content

Listening First: Egocentric Textual Descriptions of Indoor Spaces for People with Blindness

  • Conference paper
  • First Online:
Computers Helping People with Special Needs (ICCHP-AAATE 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13341))

Abstract

Orientation in unknown environments is challenging for people with. Especially in indoor environments, there are very few systems that support navigation but almost none for orientation. Thus, we propose a grammar for generating German textual descriptions of indoor environments for users with blindness. We utilize an egocentric approach taking into account the user’s location and orientation in the building. To investigate what word order is preferred, we compare descriptions generated by three different grammars. We also examine what strategies people with blindness pursue to orient themselves in buildings. We test our concept in an online user study with people with blindness. Our study shows that egocentric information should be brief, always following the same structure and allow for customization.

A. Constantinescu, E.-M. Neumann—Equal contribution.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    OpenStreetMap. https://www.openstreetmap.org, Retrieved February 01, 2022.

  2. 2.

    Blindsquare. https://www.blindsquare.com/, Retrieved 3 February 2022.

  3. 3.

    BFW Smartinfo. http://smartinfo.bfw-wuerzburg.de/, Retrieved 3 February 2022.

  4. 4.

    RightHear. https://www.right-hear.com/, Retrieved 3 February 2022.

References

  1. Constantinescu, A., Petrausch, V., Müller, K., Stiefelhagen, R.: Towards a standardized grammar for navigation systems for persons with visual impairments. In: ASSETS 2019, pp. 539–541. ACM, New York, NY, USA (2019)

    Google Scholar 

  2. Engel, C., et al.: Travelling more independently: a requirements analysis for accessible journeys to unknown buildings for people with visual impairments. In: ASSETS 2020, pp. 1–11. ACM, New York, NY, USA (2020)

    Google Scholar 

  3. Goyal, S., Bhavsar, S., Patel, S., Chattopadhyay, C., Bhatnagar, G.: SUGAMAN: describing floor plans for visually impaired by annotation learning and proximity-based grammar. IET Image Process. 13(13), 2623–2635 (2019)

    Article  Google Scholar 

  4. Jain, D.: Path-guided indoor navigation for the visually impaired using minimal building retrofitting. In: ASSETS 2014, pp. 225–232. ACM, New York, NY, USA (2014)

    Google Scholar 

  5. Kamikubo, R., Kato, N., Higuchi, K., Yonetani, R., Sato, Y.: Support strategies for remote guides in assisting people with visual impairments for effective indoor navigation. In: CHI 2020, pp. 1–12. ACM, New York, NY, USA (2020)

    Google Scholar 

  6. Kandalan, R.N., Namuduri, K.: Techniques for constructing indoor navigation systems for the visually impaired: a review. IEEE Trans. Hum.-Mach. Syst. 50(18) (2020)

    Google Scholar 

  7. Kuriakose, B., Shrestha, R., Sandnes, F.E.: Tools and technologies for blind and visually impaired navigation support: a review. IETE Tech. Rev. 39(1), 1–16 (2020)

    Google Scholar 

  8. Madugalla, A., Marriott, K., Marinai, S., Capobianco, S., Goncu, C.: Creating accessible online floor plans for visually impaired readers. TACCESS 13(4), 1–37 (2020)

    Article  Google Scholar 

  9. May, K.R., Tomlinson, B.J., Ma, X., Roberts, P., Walker, B.N.: Spotlights and soundscapes: on the design of mixed reality auditory environments for persons with visual impairment. ACM Trans. Access. Comput. 13(2), 1–47 (2020)

    Article  Google Scholar 

  10. Müller, K., Engel, C., Loitsch, C., Stiefelhagen, R., Weber, G.: Traveling more independently: a study on the diverse needs and challenges of people with visual or mobility impairments in unfamiliar indoor environments. ACM Trans. Access. Comput. 15(2), 1–44 (2022). just accepted

    Article  Google Scholar 

  11. Nicolau, H., Jorge, J., Guerreiro, T.: Blobby: how to guide a blind person. In: CHI EA 2009, pp. 3601–3606. ACM, New York, NY, USA (2009)

    Google Scholar 

  12. Paladugu, D.A., Maguluri, H.B., Tian, Q., Li, B.: Automated description generation for indoor floor maps. In: ASSETS 2012, pp. 211–212. ACM, New York, NY, USA (2012)

    Google Scholar 

  13. Plikynas, D., Zvironas, A., Budrionis, A., Gudauskis, M.: Indoor navigation systems for visually impaired persons: mapping the features of existing technologies to user needs. Sensors 20(3) (2020)

    Google Scholar 

  14. Sato, D., et al.: Navcog3 in the wild: large-scale blind indoor navigation assistant with semantic features. TACCESS 12(3), 1–30 (2019)

    Article  Google Scholar 

  15. Simões, W.C.S.S., Machado, G.S., Sales, A.M.A., De Lucena, M.M., Jazdi, N., De Lucena, V.F.: A review of technologies and techniques for indoor navigation systems for the visually impaired. Sensors 20(14) (2020)

    Google Scholar 

  16. Yang, R., et al.: Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments. In: ASSETS 2011, pp. 27–34. ACM, New York, NY, USA (2011)

    Google Scholar 

Download references

Acknowledgements

This work was funded by the German Federal Ministry of Labour and Social Affairs (BMAS) under the grant number 01KM151112.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Angela Constantinescu , Karin Müller or Rainer Stiefelhagen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Constantinescu, A., Neumann, EM., Müller, K., Jaworek, G., Stiefelhagen, R. (2022). Listening First: Egocentric Textual Descriptions of Indoor Spaces for People with Blindness. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08648-9_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08647-2

  • Online ISBN: 978-3-031-08648-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics