poster

HamsaTouch: tactile vision substitution with smartphone and electro-tactile display

Authors:

Hiroyuki Kajimoto,

Yonezo KannoAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 1273 - 1278

https://doi.org/10.1145/2559206.2581164

Published: 26 April 2014 Publication History

Abstract

This paper documents the development and evaluation of a novel tactile vision substitution system (TVSS) for the people with visual impairments. The system is composed of an electro-tactile display with 512 electrodes, the same number of optical sensors beneath each electrode, and a smartphone with a camera and an LCD. The smartphone acquires the surrounding view, conducts image processing and displays the image on the LCD. The image is captured by the optical sensors and converted to a tactile image by the electro-tactile display. While the concept of the TVSS is classic, combining the commonly available mobile device and electro-tactile display enables a low cost yet powerful and compact system. Furthermore, optical communication architecture enables an open development environment.

Supplementary Material

ZIP File (wip0177-file3.zip)

Zip file containing a PDF of the Accompanying Poster

Download
626.66 KB

References

[1]

WHO, Visual impairment and blindness http://www.who.int/mediacentre/factsheets/fs282/en/

[2]

Bach-y Rita, P., Collins, C. C., Saunders, F., White, B., Scadden, L. Vision substitution by tactile image projection. Nature (1969), 221: 963--964.

[3]

Akhter, S., Mirsalahuddin, J., Marquina, F.B., Islam, S. A smartphone-based haptic vision substitution system for the blind. In Proc. Annual Northeast Bioengineering Conf. (2011), 1--2.

[4]

Vera, P., Zenteno, D., Salas. J. A smartphonebased virtual white cane, Pattern Anal. Applic. (2013)

[5]

Kajimoto, H., Kanno, Y., Tachi, S. Forehead electro-tactile display for vision substitution. In Proc. EuroHaptics (2006).

[6]

Collins, C. C. Tactile television - mechanical and electrical image projection. IEEE Trans. Man-Machine Systems (1970), MMS-11(1): 65--71.

[7]

Kaczmarek, K. A. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Trans. Biomed. Eng. (1991), 38:1--16.

[8]

Kaczmarek, K. A., Webster, J. G., Radwin, R. G. Maximal dynamic range electrotactile stimulation waveforms. IEEE Trans. Biomed. Eng. (1992), 39(7): 701--715.

[9]

Tachi, S., Tanie, K., Komiyama, K., Abe, M. Electrocutaneous communication in a guide dog robot (MELDOG). IEEE Trans. Biomed. Eng. (1985), 32: 461469.

[10]

Kajimoto, H. Electro-tactile display with real-time impedance feedback using pulse width modulation. IEEE Trans. Haptics (2012), 5(2): 184--188.

Digital Library

[11]

Kajimoto, H. Skeletouch: Transparent electrotactile display for mobile surfaces. In Proc. SIGGRAPH ASIA Emerging Technologies (2012).

Digital Library

[12]

Sugimoto, M., Kodama, K., Nakamura, A., Kojima M., Inami, M. A display-based tracking system: displaybased computing for measurement systems. In Proc. 17th Int. Conf. Artificial Reality and Telexistence (2007), 31--38.

Digital Library

[13]

Nojima, T., Ooide, Y., Kawaguchi, H. Hairlytop interface: an interactive surface display comprised of hair-like soft actuators. In Proc. World Haptics Conference (2013), 431--435.

[14]

Linvill, G., Bliss, J. C. A direct translation reading aid for the blind. In Proc. IEEE, (1966), 54(1): 40--51.

[15]

Kajimoto, H., Inami, M., Kawakami, N., Tachi, S. SmartTouch: electric skin to touch the untouchable. IEEE Computer Graphics & Applications Magazine (2004), 36--43.

Digital Library

[16]

Johansson, R. S., Vallbo, A. B. Tactile sensory coding in the glabrous skin of the human hand, Trends in Neurosciences (1983), 6: 27--32.

[17]

OpenCV4Android SDK http://docs.opencv.org/doc/tutorials/introduction/andro id_binary_package/O4A_SDK.html

Cited By

Jiang CKuang EFan M(2025)How Can Haptic Feedback Assist People with Blind and Low Vision (BLV): A Systematic Literature ReviewACM Transactions on Accessible Computing10.1145/371193118:1(1-57)Online publication date: 13-Jan-2025
https://dl.acm.org/doi/10.1145/3711931
Perera PMarasinghe HTakami TKajimoto HWithana AKostakos VKay JHoang T(2024)Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic InterfacesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676612(48-54)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676612
Wang NWang XZhou ZSheng YLiu HZhang H(2024)Perception and Electrophysiological Properties of Calf under Electrotactile Stimulation2024 International Conference on Advanced Robotics and Mechatronics (ICARM)10.1109/ICARM62033.2024.10715812(1015-1020)Online publication date: 8-Jul-2024
https://doi.org/10.1109/ICARM62033.2024.10715812
Show More Cited By

Index Terms

HamsaTouch: tactile vision substitution with smartphone and electro-tactile display
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Tactile Presentation to the Back of a Smartphone with Simultaneous Screen Operation
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

The most common method of presenting tactile stimuli to touch screens has been to directly attach a tactile display to the screens. This requires a transparent tactile display so that the view is not obstructed. In contrast, transparency is not required ...
HamsaTouch: feel the world through your palm
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

We developed a novel tactile vision substitution system (TVSS) for the people with visual impairments. The system is composed of an electro-tactile display with 512 electrodes, the same number of optical sensors beneath each electrode, and a smartphone ...
Tactile Presentation to the Back of a Smartphone with Simultaneous Screen Operation
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

In most common methods of tactile presentation on touch screen, the tactile display was directly attached or contacted onto the screens. Therefore, the tactile display must be transparent so that it does not obstruct the view of the screen. On the other ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
822
Total Downloads

Downloads (Last 12 months)86
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jiang CKuang EFan M(2025)How Can Haptic Feedback Assist People with Blind and Low Vision (BLV): A Systematic Literature ReviewACM Transactions on Accessible Computing10.1145/371193118:1(1-57)Online publication date: 13-Jan-2025
https://dl.acm.org/doi/10.1145/3711931
Perera PMarasinghe HTakami TKajimoto HWithana AKostakos VKay JHoang T(2024)Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic InterfacesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676612(48-54)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676612
Wang NWang XZhou ZSheng YLiu HZhang H(2024)Perception and Electrophysiological Properties of Calf under Electrotactile Stimulation2024 International Conference on Advanced Robotics and Mechatronics (ICARM)10.1109/ICARM62033.2024.10715812(1015-1020)Online publication date: 8-Jul-2024
https://doi.org/10.1109/ICARM62033.2024.10715812
Islam MJahangir RMohim NWasif-Ul-Islam MAshraf AKhan NMahjabin MMiah AShin J(2024)A Multilingual Handwriting Learning System for Visually Impaired PeopleIEEE Access10.1109/ACCESS.2024.335378112(10521-10534)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3353781
Wieland MSedlmair MMachulla T(2023)VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual RealityExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585726(1-6)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585726
Zhou ZWang XYang YZeng JLiu H(2023)Mathematical Model of Fingertip Skin Under Constant-Current Electrotactile StimulationIEEE Transactions on Haptics10.1109/TOH.2022.322708416:1(3-12)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TOH.2022.3227084
Manjari KVerma MSingal GChamola V(2023)Catalysing assistive solutions by deploying light-weight deep learning model on edge devicesJournal of Experimental & Theoretical Artificial Intelligence10.1080/0952813X.2023.2219286(1-22)Online publication date: 22-Jun-2023
https://doi.org/10.1080/0952813X.2023.2219286
Alotaibi YWilliamson JBrewster S(2022)First Steps Towards Designing Electrotactons: Investigating Intensity and Pulse Frequency as Parameters for Electrotactile CuesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501863(1-11)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501863
Zhou ZYang YLiu JZeng JWang XLiu H(2022)Electrotactile Perception Properties and Its Applications: A ReviewIEEE Transactions on Haptics10.1109/TOH.2022.317072315:3(464-478)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TOH.2022.3170723
Jahangir RWasif-Ul-Islam MMohim NAshraf AKhan NIslam M(2022)Towards Developing a Voice-Over-Guided System for Visually Impaired People to Learn Writing the Alphabets2022 25th International Conference on Computer and Information Technology (ICCIT)10.1109/ICCIT57492.2022.10055542(1015-1020)Online publication date: 17-Dec-2022
https://doi.org/10.1109/ICCIT57492.2022.10055542
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten