Abstract
Tactile signing and touch-based alphabets are among the primary communication systems for people who suffer from sensory or multisensory conditions, such as, blindness or deaf-blindness, respectively. In the last decade, several research projects based on sensory substitution focused on developing novel interfaces. However, people who are sensory-impaired still lack reliable technology for interacting with the world. To this end, wearable devices could have a significant role in providing individuals with support for daily activities, communication, and social inclusion. In this paper, we introduce a categorization based on technology for sensing and representing the main components of touch- and gesture-based communication systems (i.e., movement, gesture, pressure, and touch) to provide an understanding of the technical and human factors which affect or foster the development of new assistive technology.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chang, A., O’Modhrain, S., Jacob, R., Gunther, E., Ishii, H.: ComTouch: design of a vibrotactile communication device. In: 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (2002). doi:10.1145/778712.778755
Bieling, T., Gollner, U., Joost, G.: Mobile lorm glove – introducing a communication device for deaf-blind people. In: Tangible, embedded and embodied interaction. Kingston, ON, Canada (2012)
Kramer, J., Leifer, L.: The talking glove. SIGCAPH Comput. Phys. Handicap 39, 12–16 (1988). doi:10.1145/47937.47938
Caporusso, N.: A wearable Malossi alphabet interface for deafblind people. In: Conference on Advanced Visual Interfaces, pp. 445–448 (2008). doi:10.1145/1385569.1385655
Frieman, B.B.: State braille standards for teachers of students who are blind or visually impaired: a national survey. Braille Monit. 47(1), 12–16 (2004)
Pederson, T., Janlert, L., Surie, D.: Towards a model for egocentric interaction with physical and virtual objects. In: 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 755–758 (2010). doi:10.1145/1868914.1869022
Bevilacqua, V., Biasi, L., Pepe, A., Caporusso, N.: A computer vision method for recognizing finger spelling. In: International Conference on Intelligent Computing. ISBN 978-3-319-22052-9
Halim, Z., Abbas, G.: A kinect-based sign language hand gesture recognition system for hearing- and speech-impaired: a pilot study of Pakistani sign language. Assistive Technol. (2015). doi:10.1080/10400435.2014.952845
Brouet, R., Blanch, R., Cani, M.P.: Understanding hand degrees of freedom and natural gestures for 3D interaction on tabletop. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) Human-Computer Interaction. Springer, Heidelberg (2013)
Li, Y., Chen, X., Zhang, X., Wang, K., Yang, J.: Interpreting sign components from accelerometer and sEMG data for automatic sign language recognition. In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3358–3361 (2011). doi:10.1109/IEMBS.2011.6090910
Hernandez-Rebollar, J.: ASL Glove with 3-Axis Accelerometers. Patent application (2010). https://www.google.com/patents/US20100023314
Yang, H.-D.: Sign language recognition with the kinect sensor based on conditional random fields. Sensors 15(1), 135–147 (2014)
Elmahgiubi, M., Ennajar, M., Drawil, N., Elbuni, M.S.: Sign language translator and gesture recognition. In: Global Summit on Computer & Information Technology, pp. 1–6 (2015). doi:10.1109/GSCIT.2015.7353332
Abhishek, K.S., Qubeley, L.C.F., Ho, D.: Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In: IEEE International Conference on Electron Devices and Solid-State Circuits, pp. 334–337 (2016). doi:10.1109/EDSSC.2016.7785276
Bandodkar, M., Chourasia, V.: Low cost real-time communication braille hand-glove for visually impaired using slot sensors and vibration motors. Int. J. Electr. Comput. Energ. Electron. Commun. Eng. (2014). http://waset.org/publications/9999162
Russo, L.O., Farulla, G.A., Pianu, D., Salgarella, A.R., Controzzi, M., Cipriani, C., Oddo, C.M., Geraci, C., Rosa, S., Indaco, M.: PARLOMA – a novel human-robot interaction system for deaf-blind remote communication. Int. J. Adv. Robot. Syst. 12(5) (2015). doi:10.5772/60416
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Caporusso, N., Biasi, L., Cinquepalmi, G., Trotta, G.F., Brunetti, A., Bevilacqua, V. (2018). Enabling Touch-Based Communication in Wearable Devices for People with Sensory and Multisensory Impairments. In: Ahram, T., Falcão, C. (eds) Advances in Human Factors in Wearable Technologies and Game Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 608. Springer, Cham. https://doi.org/10.1007/978-3-319-60639-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-60639-2_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60638-5
Online ISBN: 978-3-319-60639-2
eBook Packages: EngineeringEngineering (R0)