Hiroyuki Kajimoto
ABSTRACT
We developed a novel tactile vision substitution system (TVSS) for the people with visual impairments. The system is composed of an electro-tactile display with 512 electrodes, the same number of optical sensors beneath each electrode, and a smartphone with a camera and an LCD. The smartphone acquires the surrounding view, conducts image processing and displays the image on the LCD. The image is captured by the optical sensors and converted to a tactile image by the electro-tactile display. While the concept of the TVSS is classic, combining the commonly available mobile device and electro-tactile display enables a low cost yet powerful and compact system. Furthermore, optical communication architecture enables an open development environment, and it can be independently used as a paper-reading tool without the smartphone.
- Bach-y Rita, P., Collins, C. C., Saunders, F., White, B., Scadden, L. Vision substitution by tactile image projection. Nature (1969), 221: 963--964.Google Scholar
- Bach-y-Rita, P., Kaczmarek, K. A., Tyler, M. E., Garcia-Lara, J. Form perception with a 49-point electrotactile stimulus array on the tongue. J. Rehabil. Res. Dev. (1998), 35: 427--430.Google Scholar
- Kajimoto, H., Kanno, Y., Tachi, S. Forehead electro-tactile display for vision substitution. In Proc. EuroHaptics (2006).Google Scholar
- Arnoldussen, A., & Fletcher, D. C. Visual perception for the blind: The BrainPort vision device. Retinal Physician (2012), 9(1): 32--34.Google Scholar
- Akhter, S., Mirsalahuddin, J., Marquina, F. B., Islam, S. A smartphone-based haptic vision substitution system for the blind. In Proc. Annual Northeast Bioengineering Conf. (2011), 1--2.Google ScholarCross Ref
- Vera, P., Zenteno, D., Salas. J. A smartphone-based virtual white cane, Pattern Anal. Applic. (2013).Google Scholar
- Sugimoto, M., Kodama, K., Nakamura, A., Kojima M., Inami, M. A display-based tracking system: display-based computing for measurement systems. In Proc. 17th Int. Conf. Artificial Reality and Telexistence (2007), 31--38. Google ScholarDigital Library
- Nojima, T., Ooide, Y., Kawaguchi, H. Hairlytop interface: an interactive surface display comprised of hair-like soft actuators. In Proc. World Haptics Conference (2013), 431--435.Google ScholarCross Ref
- Linvill, G., Bliss, J. C. A direct translation reading aid for the blind. In Proc. IEEE, (1966), 54(1): 40--51.Google Scholar
- Kajimoto, H., Inami, M., Kawakami, N., Tachi, S. SmartTouch: electric skin to touch the untouchable. IEEE Computer Graphics & Applications Magazine (2004), 36--43. Google ScholarDigital Library
- Johansson, R. S., Vallbo, A. B. Tactile sensory coding in the glabrous skin of the human hand, Trends in Neurosciences (1983), 6: 27--32.Google Scholar
- OpenCV4Android SDK http://docs.opencv.org/doc/tutorials/introduction/android_binary_package/O4A_SDK.html.Google Scholar
Index Terms
- HamsaTouch: feel the world through your palm
Recommendations
Tactile Presentation to the Back of a Smartphone with Simultaneous Screen Operation
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsThe most common method of presenting tactile stimuli to touch screens has been to directly attach a tactile display to the screens. This requires a transparent tactile display so that the view is not obstructed. In contrast, transparency is not required ...
HamsaTouch: tactile vision substitution with smartphone and electro-tactile display
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsThis paper documents the development and evaluation of a novel tactile vision substitution system (TVSS) for the people with visual impairments. The system is composed of an electro-tactile display with 512 electrodes, the same number of optical sensors ...
Palm touch panel: providing touch sensation through the device
ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesWe present a novel touch sensitive handheld device, called Palm Touch Panel, which provides electro-tactile feedback on the back of the device thus simulating the sensation of being able to touch the user's palm directly through the device. Users hold ...
Comments