Abstract
A color image presentation system with sound via touch-panel interface was developed and some perceptual characteristics with the system were studied in this paper. Each subject actively operates his/her fingertip on the touch panel interface, and the system returns syllable sounds corresponding to the colors nearby the fingertip position. Without sight, he/she perceives images through the sound information together with the fingertip positional sense. The authors carried out some preliminary psychophysical experiments on the human perceptual characteristics in converting speech sounds into image patterns and on the fingertip positional sense. Based on the results of the preliminary experiments, the authors developed a color image presentation system. It was confirmed through experiments using the system that the subjects were able to perceive the shapes of simple closed polygonal figures within 2 or 3 minutes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M. P. Beddoes, C. Y. Suen, “Evaluation and a Method of Presentation of the Sound Output From the Lexiphone-A Reading Machine for the Blind”, IEEE TRANSACTIONS ON BIOMEDICAL, Vol. BME-18, No. 2, pp. 85–91 (1971)
Simizu, Saida, Shimura, “Tactile pattern recognition by graphic display: Importance of 3-D information for haptic perception of familiar objects”, Perception & Psychophysics, 53, pp. 43–48, (1993)
Hui Tang, David J. Beebe, “A Microfabricated Electrostatic Haptic Display for Persons with Visual Impairments,” IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, Vol. 6, No. 3, pp. 241–248, (1998)
H. Minagawa, N. Ohnishi, and N. Sugie, “A Diagram Acquisition and Generation System for Blind Person Using Tactile and Auditory Senses,” Trans. Inst. Electronics, Information and communication Engineers, Vol. J77-D-II, No. 3, pp. 616–624(1994, in Japanese)
P. Blenkhorn, D. G. Evans, “Using speech and touch to enable blind people to access schematic diagrams”, Journal of Network and Computer Applications, (1998) 21, pp. 17–29
Hm. H. Dobelle, “Artificial Vision for the Blind by Connecting a Television Camera to the Visual Cortex,” ASAIO Journal 2000, 46, pp. 3–9
S. Kotake, A. Shibata, K. Nagazumi, Y. Yasuyuki, M. Senoo and I. Fujishiro, “Figure Recognition of Image by Sound Touch Sensor — Recognition of Alphabet,” Res. Rep. Fac. Eng. Mie Univ., Vol. 22, pp. 119–124, (1997)
Y. Nomura, S. Nishihama, M. Ozaki1, and T. Sugiura, “Image Pattern Perception by Interactive Sound Presentation,” Proceedings of 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, CD-ROM Paper#369 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nomura, Y., Nishihama, S., Sugiura, T., Matsui, H., Kato, N. (2002). Auditory Sensation Aided Image Perception: Integration of Somesthetic Sense of Fingertip Position. In: Miesenberger, K., Klaus, J., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2002. Lecture Notes in Computer Science, vol 2398. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45491-8_86
Download citation
DOI: https://doi.org/10.1007/3-540-45491-8_86
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43904-2
Online ISBN: 978-3-540-45491-5
eBook Packages: Springer Book Archive