Abstract
Individuals with sight impairments rely heavily on various types of travel-aid when navigating their ways across their neighborhoods. Recently, there have been many breakthrough technologies that focus on the visually impaired by providing solutions such as wearable bands and optical wearable devices. However, such technologies are costly and not suited for the general market. Others have started investigating smartphone applications as a much more widely available solution but with limited applicability on outdoor barriers and obstacles that these groups of people face in their day to day journeys. In this work, we propose GeoNotify, a smartphone application which is tailored to detect unexpected temporary obstacles that could cause injury to visually impaired people. We present how advances in Convolutional Neural Networks merged with crowd-sourcing methodologies could be used to build more accurate models capable of recognizing wide representations of the real-world obstacles.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
https://www.perkins.org/access/inclusive-design/blindways, last accessed June 5, 2020.
- 2.
Last accessed June 5, 2020 https://eye-d.in/.
- 3.
https://www.microsoft.com/en-us/ai/seeing-ai, last accessed June 5, 2020.
- 4.
https://www.blindsquare.com/, last accessed June 5, 2020.
- 5.
https://aws.amazon.com/lambda/, last accessed June 5, 2020.
- 6.
https://aws.amazon.com/api-gateway/, last accessed June 5, 2020.
References
The royal institute for blind people (2016). https://www.rnib.org.uk/sites/default/files/who
Antunes, A.C., Silva, C.: Designing for blind users: guidelines for developing mobile apps for supporting navigation of blind people on public transports. In: User-Centered Software Development for the Blind and Visually Impaired: Emerging Research and Opportunities, pp. 1–25. IGI Global (2020)
Banovic, N., Franz, R.L., Truong, K.N., Mankoff, J., Dey, A.K.: Uncovering information needs for independent spatial learning for users who are visually impaired. In: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–8 (2013)
Blum, J.R., Bouchard, M., Cooperstock, J.R.: What’s around Me? Spatialized audio augmented reality for blind users with a smartphone. In: Puiatti, A., Gu, T. (eds.) MobiQuitous 2011. LNICST, vol. 104, pp. 49–62. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-30973-1_5
Brock, A.M., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Interactivity improves usability of geographic maps for visually impaired people. Hum. Comput. Interact. 30(2), 156–194 (2015)
Chen, Q., Wu, L., Chen, Z., Lin, P., Cheng, S., Wu, Z.: Smartphone based outdoor navigation and obstacle avoidance system for the visually impaired. In: Chamchong, R., Wong, K.W. (eds.) MIWAI 2019. LNCS (LNAI), vol. 11909, pp. 26–37. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33709-4_3
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Dutta, S., Barik, M.S., Chowdhury, C., Gupta, D.: Divya-Dristi: a smartphone based campus navigation system for the visually impaired. In: 2018 Fifth International Conference on Emerging Applications of Information Technology (EAIT), pp. 1–3. IEEE (2018)
Haklay, M., Weber, P.: Openstreetmap: user-generated street maps. IEEE Pervasive Comput. 7(4), 12–18 (2008)
Hara, K., Azenkot, S., Campbell, M., Bennett, C.L., Le, V., Pannella, S., Moore, R., Minckler, K., Ng, R.H., Froehlich, J.E.: Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with google street view: An extended analysis. ACM Trans. Accessible Comput. (TACCESS) 6(2), 1–23 (2015)
Hersh, M.: Mobility technologies for blind, partially sighted and deafblind people: design issues. In: Mobility of Visually Impaired People, pp. 377–409. Springer (2018)
Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications (2017). arXiv:1704.04861
Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: Squeezenet: Alexnet-level accuracy with 50x fewer parameters and<0.5 mb model size (2016). arXiv:1602.07360
Mascetti, S., Ahmetovic, D., Gerino, A., Bernareggi, C.: Zebrarecognizer: pedestrian crossing recognition for people with visual impairment or blindness. Pattern Recogn. 60, 405–419 (2016)
McMahan, H.B., Moore, E., Ramage, D., y Arcas, B.A.: Federated learning of deep networks using model averaging. corr abs/1602.05629 (2016). arXiv:1602.05629
Panëels, S.A., Olmos, A., Blum, J.R., Cooperstock, J.R.: Listen to it yourself! evaluating usability of what’s around me? for the blind. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2107–2116 (2013)
Shangguan, L., Yang, Z., Zhou, Z., Zheng, X., Wu, C., Liu, Y.: Crossnavi: enabling real-time crossroad navigation for the blind with commodity phones. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 787–798 (2014)
Sierra, J.S., Togores, J.: Designing mobile apps for visually impaired and blind users. In: The Fifth International Conference on Advances in Computer-Human Interactions, pp. 47–52. Citeseer (2012)
Velazquez, R., Pissaloux, E., Rodrigo, P., Carrasco, M., Giannoccaro, N.I., Lay-Ekuakille, A.: An outdoor navigation system for blind pedestrians using GPS and tactile-foot feedback. Appl. Sci. 8(4), 578 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Kim, E., Sterner, J., Mashhadi, A. (2021). A Crowd-Sourced Obstacle Detection and Navigation App for Visually Impaired. In: Paiva, S., Lopes, S.I., Zitouni, R., Gupta, N., Lopes, S.F., Yonezawa, T. (eds) Science and Technologies for Smart Cities. SmartCity360° 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 372. Springer, Cham. https://doi.org/10.1007/978-3-030-76063-2_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-76063-2_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-76062-5
Online ISBN: 978-3-030-76063-2
eBook Packages: Computer ScienceComputer Science (R0)