Abstract
Smart phone technology and mobile applications have become an indispensable part of our daily life. The primary use however, is targeted towards social media and photography. While some camera-based approaches provided partial solutions for the visually impaired, they still constitute a cumbersome process for the user. iSee is an Android based application that benefits from the commercially available technology to help the visually impaired people improve their day-to-day activities. A single screen tap in iSee is able to serve as a virtual eye by providing a sense of seeing to the blind person by audibly communicating the object(s) names and description. iSee employs efficient object recognition algorithms based on FAST and BRIEF. Implementation results are promising and allow iSee to constitute a basis for more advanced applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aaron, S.: Smartphone Ownership. Pew Research Center’s Internet & American Life Project (2013), http://pewinternet.org/Reports/2013/Smartphone-Ownership-2013.aspx (accessed June 2014)
EyeNote App, Apple Appstore (2010), http://www.eyenote.gov/
Sudol, J., et al.: LookTel- A comprehensive platform for computer aided visual assistance. Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition (2010)
Apple Siri (2011), https://www.apple.com/ios/siri/
S Voice (2011), http://www.samsung.com/global/galaxys3/svoice.html
Blind Navigator App, Google Play (2013), https://play.google.com/store/apps/details?id=com.Blindnavigator
Georgie App, Google Play (2012), http://www.georgiephone.com/
Yi, C., et al.: Finding objects for assisting blind people. Network Modeling Analysis in Health Informatics and Bioinformatics 2(2), 71–79 (2013), doi:10.1007/s13721-013-0026-x
Linderberg, T.: Feature detection with automatic scale selection. Computer Vision 30(2), 79–116 (1998)
Lowe, D.: Distinctive image features from scale-invariant keypoints, cascade filtering approach. Computer Vision 2(60), 91–110 (2004)
Mikolajczyk, K., Schmid, C.: An affine invariant interest point detector. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 128–142. Springer, Heidelberg (2002)
Ke, Y., Sukthankar, R.: PCA-SIFT: A more distinctive representation for local image descriptors. Paper presented at CVPR Computer Vision and Pattern Recognition (2004)
Tuytelaars, T., Van Gool, L.: Wide baseline stereo based on local, affinely invariant regions. Paper presented at the British Machine Vision Conference (2000)
Matas, J., Chum, O., Pajdla, T.: Robust wide baseline stereo from maximally stable external regions. Paper presented at the British Machine Vision Conference (2002)
Hebert, B., et al.: Speed-up Robust Features (SURF). Computer Vision and Image Understanding 110(3), 346–359 (2008)
Rublee, E., et al.: ORB: an efficient alternative to SIFT or SURF. Paper presented at the IEEE International Conference on Computer Vision (2011)
Qin, L., et al.: Multi- Probe LSH: Efficient Indexing for High-Dimensional Similarity Search. In: Proceedings of Very Large Database Conference, Vienna (2007)
Har-Peled, S., Indyk, P., Motwani, R.: Approximate Nearest Neighbors: Towards Removing the Curse of Dimensionality. Theory of Computing 8(1), 321–350 (2012)
Lopez-de-la-Calleja, M., et al.: Superpixel-Based Object Detection Using Local Feature Matching. In: Proceedings of the 29th Conference of the Robotics Society of Japan, Toyosu (2011)
Mikolajczyk, K., Schmid, C.: Indexing based on scale invariant interest points. Paper presented at the International Conference on Computer Vision (2001)
Rosten, E., Drummond, T.: Machine learning for highspeed corner detection. Paper presented in European Conference on Computer Vision (2006)
Calonder, M., Lepetit, V., Strecha, C., Fua, P.: Brief: Binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010)
openCV (2014), http://opencv.org/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ghantous, M., Nahas, M., Ghamloush, M., Rida, M. (2014). iSee: An Android Application for the Assistance of the Visually Impaired. In: Hassanien, A.E., Tolba, M.F., Taher Azar, A. (eds) Advanced Machine Learning Technologies and Applications. AMLTA 2014. Communications in Computer and Information Science, vol 488. Springer, Cham. https://doi.org/10.1007/978-3-319-13461-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-13461-1_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13460-4
Online ISBN: 978-3-319-13461-1
eBook Packages: Computer ScienceComputer Science (R0)