Abstract
This paper presents a method to transform a surface texture sample sensed with a force-torque sensor into a vibrotactile stimulus in real time, as a technique to let a hand amputee feel the surface of objects. We built a convolution neural network with the contact force for real-time texture classification and haptic rendering. The neural network was constructed from the contact force between the force-torque sensor and sliding physical texture samples with three wavelengths. Once the classifier is constructed and if the force-torque sensor moves over a texture, the classified texture is mapped to a sinusoidal source signal generated with a DAQ board. We mapped the textures with the wavelengths of 3.14, 6.28, and 9.42 mm into sinusoids with the frequency of 150, 100 and 50 Hz. Then, the source signal is amplified and drives a piezoelectric actuator installed on a user’s forearm, to provide a vibrotactile stimulus corresponding to the sensed texture.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wright, T.W., Hagen, A.D., Wood, M.B.: Prosthetic usage in major upper extremity amputations. J. Hand Surg. 20(4), 619–622 (1995)
Lundborg, G., Rosen, B.: Sensory substitution in prosthesis. Hand Clin. 17(3), 481–488 (2001)
Schofield, J.S., Evans, K.R., Carey, J.P., Herbert, J.S.: Applications of sensory feedback in motorized upper extremity prosthesis: a review. Expert Rev. Med. Devices 11(5), 499–511 (2014)
Kim, K., Colgate, J.E., Santos-Munne, J.J., Makhlin, A., Peshkin, M.A.: On the design of miniature haptic devices for upper extremity prosthetics. IEEE Trans. Mechatron. 15(1), 27–39 (2010)
Kim, K., Colgate, J.E.: Haptic feedback enhances grip force control of sEMG-controlled prosthetic hands in targeted reinnervation amputees. IEEE Trans. Neural Syst. Rehabil. Eng. 20(6), 798–805 (2012)
Antfolk, C., D’Alonzo, M., Rosén, B., Lundborg, G., Sebelius, F., Cipriani, C.: Sensory feedback in upper limb prosthetics. Expert Rev. Med. Devices 10(1), 45–54 (2013)
Fishel, J.A., Loeb, G.E.: Bayesian exploration for intelligent identification of textures. Front. Neurorobotics 6, 1–4 (2012)
Acknowledgment
This material is based upon work supported by the convergence technology development program for bionic arm through the National Research Foundation of Korea (NRF) funded by the Korean Ministry of Science and ICT (2014M3C1B2048419) and the KIST Institutional Program (2E28250).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Park, J., Choi, Ws., Kim, K. (2019). Real-Time Mapping of Sensed Textures into Vibrotactile Signals for Sensory Substitution. In: Kajimoto, H., Lee, D., Kim, SY., Konyo, M., Kyung, KU. (eds) Haptic Interaction. AsiaHaptics 2018. Lecture Notes in Electrical Engineering, vol 535. Springer, Singapore. https://doi.org/10.1007/978-981-13-3194-7_27
Download citation
DOI: https://doi.org/10.1007/978-981-13-3194-7_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3193-0
Online ISBN: 978-981-13-3194-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)