Abstract
HANDY[1] is a project for the synthesis of articulatory sign-language as used by the deaf. This paper describes a sub-project named HANDYCap, which is used as a prior stage to the actual sign-language synthesis. HANDYCap is a low-cost hand-motion capture and data-processing system which we use to enable semi-automatic construction of the sign database. Additionally, the paper gives a broad survey of the technical and linguistic issues relating to the signing task. The optical tracking system used for motion-capture is described, together with related issues. In performing the database-construction task it is necessary to pay attention to the linguistic background, as well as to the problems of loading and storing the data efficiently and correctly.
This work is supported under contract no. TST-00014/2003 from the Hungarian Ministry of Education.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Havasi, L., Szabó, H.: HANDY: Sign Language Synthesis from Sublexical Elements Based on an XML Data Representation. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2004. LNCS (LNAI), vol. 3206, pp. 73–80. Springer, Heidelberg (2004)
Moeslund, T.B.: Interacting With a Virtual World Through Motion Capture. In: Virtual interaction: interaction in virtual inhabited 3D worlds, pp. 221–234. Springer, Heidelberg
Tyrone, M.E.: Overview of Capture Techniques for Studying Sign Language Phonetics. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 101–104. Springer, Heidelberg (2002)
Kennaway, R.: Synthetic Animation of Deaf Signing Gestures. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 146–157. Springer, Heidelberg (2002)
Verlinden, M., Tijsseling, C., Frowein, H.: A Signing Avatar on the WWW. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 169–172. Springer, Heidelberg (2002)
Bangham, J.A., Cox, S.J., Lincoln, M., Marshall, I., Tutt, M., Wells, M.: Signing for the Deaf Using Virtual Humans. In: IEE Seminar on Speech and language processing for disabled people, London (2000)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)
Kopp, S., Waschsmuth, I.: A Knowledge-based Approach for Lifelike Gesture Animation. In: European Conference on Artificial Intelligence, pp. 663–667 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Havasi, L., Szabó, H.M. (2005). A Motion Capture System for Sign Language Synthesis: Overview and Related Issues. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds) Advances in Visual Computing. ISVC 2005. Lecture Notes in Computer Science, vol 3804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595755_78
Download citation
DOI: https://doi.org/10.1007/11595755_78
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30750-1
Online ISBN: 978-3-540-32284-9
eBook Packages: Computer ScienceComputer Science (R0)