Abstract
See ColOr is a mobility aid for visually impaired people that uses the auditory channel to represent portions of captured images in real time. A distinctive feature of the See ColOr interface is the simultaneous coding of colour and depth. Four main modules were developed, in order to replicate a number of mechanisms present in the human visual systems. In this work, we first present the main experiments carried out in the first years of the project; among them : the avoidance of obstacles, the recognition and localization of objects, the detection of edges and the identification of coloured targets. Finally, we introduce new undergoing experiments in Colombia with blind persons, whose purpose is (1) to determine and to touch a target; (2) to navigate and to find a person; and (3) to find particular objects. Preliminary results illustrate encouraging results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bologna, G., Deville, B., Vinckenbosch, M., Pun, T.: A perceptual interface for vision Ssubstitution in a color matching experiment. In: Proc. Int. Joint Conf. Neural Networks, Part of IEEE World Congress on Computational Intelligence, Hong Kong, June 1-6, pp. 1621–1628 (2008)
Bologna, G., Deville, B., Pun, T.: Blind navigation along a sinuous path by means of the See ColOr interface. In: Mira, J., Ferrández, J.M., Álvarez, J.R., de la Paz, F., Toledo, F.J. (eds.) IWINAC 2009, Part II. LNCS, vol. 5602, pp. 235–243. Springer, Heidelberg (2009)
Bologna, G., Deville, B., Gomez, J.D., Pun, T.: Toward local and global perception modules for vision substitution. Neurocomputing 74(8), 1182–1190 (2011)
Gomez, J.D., Bologna, G., Deville, B., Pun, T.: Multisource sonification for visual substitution in an auditory memory game: one or two fingers? In: Proc. of the 17th International Conference on Auditory Display, Budapest, Hungary, June 20-23, pp. 1529–1534 (2011)
Gomez, J.D., Mohammed, S., Bologna, G., Pun, T.: 3D Scene accesibility for the blind via auditory-multitouch interfaces. In: Proc. of the AEGIS Workshop and International Conference (Accessibility Reaching Everywhere), Brussells, Belgium, November 28-30 (2011)
Gomez, J.D., Bologna, G., Pun, T.: Spatial awareness and intelligibility for the blind: audio-touch interfaces. In: Proc. of CHI 2012 (International Conference on Human-Computer Interaction), Austin, Texas, US, May 5-10, pp. 1529–1534 (2012)
Gomez, J.D., Bologna, G., Pun, T.: Non-visual-cueing-based sensing and understanding. In: Proc. of the 14th International ACM SIGACCESS Conference on Computers Accessibility (ASSETS 2012), Boulder Colorado, U.S, October 22-24, pp. 213–214 (2012)
Kalal, Z., Matas, J., Mikolajczyk, K.: P-N Learning: Bootstrapping Binary Classifiers by Structural Constraints. In: Proc. of CVPR 2010, International Conference on Computer Vision and Pattern Recognition, San Francisco, CA, US, June 13-18, pp. 49–56 (2010)
Kay, L.: A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. The Radio and Electronic Engineer 44, 605–627 (1974)
Levy-Tzekdek, S., Hanassy, S., Abboud, S., Maidenbaum, S., Amedi, A.: Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. Restroative Neurology and Neuroscience 31, 1–11 (2012)
Meijer, P.B.L.: An experimental system for auditory image representations. IEEE Trans. Bio. Eng. 39(2), 112–121 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bologna, G., Gomez, J.D., Pun, T. (2013). Vision Substitution Experiments with See ColOr. In: Ferrández Vicente, J.M., Álvarez Sánchez, J.R., de la Paz López, F., Toledo Moreo, F.J. (eds) Natural and Artificial Models in Computation and Biology. IWINAC 2013. Lecture Notes in Computer Science, vol 7930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38637-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-38637-4_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38636-7
Online ISBN: 978-3-642-38637-4
eBook Packages: Computer ScienceComputer Science (R0)