research-article

Indoor Sign Recognition for the Blind

Authors:

Dumisani Kunene,

Hima Vadapalli,

Jaco CronjeAuthors Info & Claims

SAICSIT '16: Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists

Article No.: 19, Pages 1 - 9

https://doi.org/10.1145/2987491.2987530

Published: 26 September 2016 Publication History

Abstract

Blind people face difficulties when navigating unfamiliar environments. The information displayed on indoor signs and notice boards is of no use to them. In order to assist them with this challenge, we propose a real time system that can recognise a selection of indoor navigational signs placed over clear backgrounds. The selection of signs will consist of common samples from several different types of indoor signs. Given a captured image, the approach is to use image processing techniques to find the region of interest(ROI) that contains the sign and then extract this region for classification. Using sliding windows for searching the ROI can be time consuming and can lead to many false classifications, hence we used a more explicit approach that is faster and more reliable. We first segment the signs by colour, and then by shape recognition. The sign-type classification is done using a tree search structure that enables the use of iterative contour descriptors like the speeded-up-robust-features(SURF). Once a sign has been detected, this information is communicated to the user via stereo headsets. To evaluate the system's performance, several random pictures with and without signs were used to determine the system's detection rate. The user-feedback performance was evaluated by testing the system's usability score with volunteers.

References

[1]

Samsung Exynos 7420 aces Geekbench 3.0, GSM Arena, 2015. http://www.gsmarena.com/samsung_exynos_7420_aces_geekbench_30-news-10921.php. {accessed 03-Feb-2015}.

[2]

Visual impairment and blindness, World Health Organization, 2014. http://www.who.int/mediacentre/factsheets/fs282/en/. {accessed 29-May-2014}.

[3]

H. Bay, A. Ess, T. Tuytelaars, and L. van Gool. Speeded-up robust features (surf). Computer vision and image understanding, 110(3):346--359, 2008.

Digital Library

[4]

R. Chincha and Y. Tian. Finding objects for blind people based on surf features. In Bioinformatics and Biomedicine Workshops (BIBMW), 2011 IEEE International Conference on, pages 526--527. IEEE, 2011.

Digital Library

[5]

R. Cuingnet, C. Rosso, M. Chupin, S. LehÃl'ricy, D. Dormont, H. Benali, Y. Samson, and O. Colliot. Spatial regularization of {SVM} for the detection of diffusion alterations associated with stroke outcome. Medical Image Analysis, 15(5):729--737, 2011. Special Issue on the 2010 Conference on Medical Image Computing and Computer-Assisted Intervention.

Digital Library

[6]

M. David. An Example Inference Task: Clustering.

[7]

G. S. en Foo. Grocery shopping assistant for the blind/visually impaired, 2009. http://grozi.calit2.net/files/TIESGroZiSu09.pdf.

[8]

F. Fanga, C. Fuhb, P. Yena, S. Cherngc, and S. Chend. An automatic road sign recognition system based on a computational model of human recognition processing. volume 96-2. Computer Vision and Image Understanding, 2011.

Digital Library

[9]

M. A. Garcia-Garrido, M. A. Sotelo, and E. Martin-Gorostiza. Fast traffic sign detection and recognition under changing lighting conditions. In 2006 IEEE Intelligent Transportation Systems Conference, pages 811--816. IEEE, 2006.

[10]

P. Hewlett. Mobile speak pocket, 2006. http://www.hp.com/hpinfo/abouthp/accessibility/partnerships/mobilespeak.pdf.

[11]

J. Jean and M.-J. Hsieh. Object recognition in household environment using fusion of shape and haar-like features. 10.9, 2011.

[12]

K. Juang, Li-Hong, M.-N. Wu, and Z.-Z. Weng. Object identification using mobile devices. Measurement, 51, 2014.

[13]

A. Kirillov. Detecting some simple shapes in images. "http://www.aforgenet.com/articles/shape_checker/, {accessed 16-April-2014}.

[14]

A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097--1105, 2012.

Digital Library

[15]

C. Rahman, W. Badawyand, and A. Radmanesh. A real time vehicle's license plate recognition system. 2001.

[16]

M. Roberto, S. Kurniawan, and H. Bagherinia. Blind guidance using mobile computer vision: a usability study. 2010.

[17]

P. Sermanet and Y. LeCun. Traffic sign recognition with multi-scale convolutional networks. In Neural Networks (IJCNN), The 2011 International Joint Conference on, pages 2809--2813. IEEE, 2011.

[18]

J. Stallkamp, M. Schlipsing, J. Salmen, and C. Igel. The german traffic sign recognition benchmark: a multi-class classification competition. In Neural Networks (IJCNN), The 2011 International Joint Conference on, pages 1453--1460. IEEE, 2011.

[19]

L. Tischler. Intel's read-aloud reader: Breakthrough for dyslexics, vision for the blind, 2010. http://www.fastcompany.com/1520074/intels-read-aloud-reader-breakthrough-dyslexics-vision-blind.

[20]

T. Ubukata, M. Shibata, K. Terabayashi, A. Mora, T. Kawashita, G. Masuyama, and K. Umeda. Fast human detection combining range image segmentation and local feature based detection. In Pattern Recognition (ICPR), 2014 22nd International Conference on, pages 4281--4286. IEEE, 2014.

Digital Library

[21]

X. Yang, T. Tian, C. Yi, and A. Arditi. Context-based indoor object detection as an aid to blind persons accessing unfamiliar environments. Proc. International conference on Multimedia Understanding. ACM, 2010.

Digital Library

Cited By

Zaman QKhusro STjoa A(2023)Improved Detection and Interpretation of Multilingual Signboards in Natural Scene for Visually Impaired People2023 IEEE International Conference on Data and Software Engineering (ICoDSE)10.1109/ICoDSE59534.2023.10291385(126-131)Online publication date: 7-Sep-2023
https://doi.org/10.1109/ICoDSE59534.2023.10291385
Müller KEngel CLoitsch CStiefelhagen RWeber G(2022)Traveling More Independently: A Study on the Diverse Needs and Challenges of People with Visual or Mobility Impairments in Unfamiliar Indoor EnvironmentsACM Transactions on Accessible Computing10.1145/351425515:2(1-44)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3514255
González YMillán ASánchez YOrtiz CAlemán MHernández C(2020)Sistema de Reconocimiento de Señalamientos en Entornos Abiertos para la Orientación de Personas con Discapacidad VisualMemoria Investigaciones en Ingeniería10.36561/NG.19.4(43-62)Online publication date: 16-Dec-2020
https://doi.org/10.36561/NG.19.4
Show More Cited By

Recommendations

Indoor Blind Navigator: A Use Case for Self-Guided Tours in Museums
PETRA '17: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments

Notably valuable efforts have focused in helping people with special needs. In this work, we build upon the experience from the BlindHelper smartphone outdoor pedestrian navigation app and present Blind-Nav, a system for indoor interactive autonomous ...
A proposed indoor navigation system for blind individuals
iiWAS '11: Proceedings of the 13th International Conference on Information Integration and Web-based Applications and Services

Visual impairment is one of the disabilities that could injure people congenitally or adventitiously. The number of individuals who suffer from visual impairment is increasing rapidly. Therefore, there is an urgent need to develop assistive technologies ...
Accessible Online Indoor Maps for Blind and Visually Impaired Users
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

This paper proposes alternatives for the development and improvement of maps to aid accessibility. Based on our analysis, we present an accessible online indoor map prototype that complies with WCAG 2.0. For the case study, the prototype displays an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SAICSIT '16: Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists

September 2016

422 pages

ISBN:9781450348058

DOI:10.1145/2987491

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

AWS: Amazon Web Services
IBM: IBM

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Council for Scientific and Industrial Research
University of the Witwatersrand

Conference

SAICSIT '16

SAICSIT '16: Annual Conference of the South African Institute of Computer Scientists and Information Technologists

September 26 - 28, 2016

Johannesburg, South Africa

Acceptance Rates

Overall Acceptance Rate 187 of 439 submissions, 43%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
137
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zaman QKhusro STjoa A(2023)Improved Detection and Interpretation of Multilingual Signboards in Natural Scene for Visually Impaired People2023 IEEE International Conference on Data and Software Engineering (ICoDSE)10.1109/ICoDSE59534.2023.10291385(126-131)Online publication date: 7-Sep-2023
https://doi.org/10.1109/ICoDSE59534.2023.10291385
Müller KEngel CLoitsch CStiefelhagen RWeber G(2022)Traveling More Independently: A Study on the Diverse Needs and Challenges of People with Visual or Mobility Impairments in Unfamiliar Indoor EnvironmentsACM Transactions on Accessible Computing10.1145/351425515:2(1-44)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3514255
González YMillán ASánchez YOrtiz CAlemán MHernández C(2020)Sistema de Reconocimiento de Señalamientos en Entornos Abiertos para la Orientación de Personas con Discapacidad VisualMemoria Investigaciones en Ingeniería10.36561/NG.19.4(43-62)Online publication date: 16-Dec-2020
https://doi.org/10.36561/NG.19.4
Engel CMüller KConstantinescu ALoitsch CPetrausch VWeber GStiefelhagen R(2020)Travelling more independently: A Requirements Analysis for Accessible Journeys to Unknown Buildings for People with Visual ImpairmentsProceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3373625.3417022(1-11)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3373625.3417022

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten