Yuta Yasugahira
ABSTRACT
To achieve the greater accessibility for deaf people, sign language recognition systems and sign language animation systems must be developed. In Japanese sign language (JSL), previous studies have suggested that emphasis and emotion cause changes in hand movements. However, the relationship between emphasis and emotion and the signing speed has not been researched enough. In this study, we analyzed the hand movement variation in relation to the signing speed. First, we recorded 20 signed sentences at three speeds (fast, normal, and slow) using a digital video recorder and a 3D position sensor. Second, we segmented sentences into three types of components (sign words, transitions, and pauses). In our previous study, we analyzed hand movement variations of sign words in relation to the signing speed. In this study, we analyzed transitions between adjacent sign words by a method similar to that in the previous study. As a result, sign words and transitions showed a similar tendency, and we found that the variation in signing speed mainly caused changes in the distance hands moved. Furthermore, we compared transitions with sign words and found that transitions were slower than sign words.
- C. Oz and M. C, Leu. 2005. Recognition of Finger Spelling of American Sign Language with Artificial Neural Network Using Position / Orientation Sensors and Data Glove, Lecture Notes in Computer Science, Advances in Neural Networks, Vol. 3497, 157--164. Google Scholar
Digital Library
- P. Dreuw, D. Rybach, T. Deselaers, M. Zahedi, and H. Ney. 2007. Speech recognition techniques for a sign language recognition system. PROC. INTERSPEECH, 2513--2516.Google Scholar
- R. Debuchi, R. Yagi, Y. Himeno, and Y. Nagashima. 2007. Development of the Animation Library of Sign Language Words and the Editor to Synthesize Sign Language Words. Technical Report of IEICE, WIT, Vol. 107, No. 61, (May. 2007), 69--74. {In Japanese}Google Scholar
- A. Heloir and S. Gibet. 2009. A Qualitative and Quantitative Characterisation of Style in Sign Language Gestures. Lecture Notes in Computer Science, Gesture-Based Human-Computer Interaction and Simulation, Vol. 5085, 122--133. Google ScholarDigital Library
- S. Mori. 2003. Phonological and Morphophonemic analysis of Features of Intensive Form in JSL. Proceedings of 29th Japanese Association of Sign Language, (Oct. 2003), 12--15. {In Japanese}Google Scholar
- K. Kamata, G. Wakamatsu, M. Adachi, and S. Ogura. 1994. Emotional Expression and Manual Behavior in Japanese Sign Language. Technical Report of IEICE, HC, Vol. 93, No. 439, (Jan. 1994), 75--82. {In Japanese}Google Scholar
- K. Kamata, T. Sato, H. Yamamoto, and S. D. Fischer. 2002. Effect of Signing Rate on Temporal Structures in Japanese Sign Language Sentences. Journal of ITE, Vol. 56, No. 5, (Mar. 2002), 872--876. {In Japanese}Google Scholar
- Y. Yasugahira, Y. Horiuchi, M. Nishida, and S. Kuroiwa. 2008. Analysis of Hand Movement Variation in Relationship to Signing Speed with Japanese Sign Language. Japanese Journal of Sign Linguistics, Volume 16, 57--68. {In Japanese}Google Scholar
- T. Matsuo and Y. Shirai. 2007. Sign Language Recognition based on Estimation of Transition Structure. Technical report of IEICE, TL, Vol. 106, No. 486, (Jan. 2007), 85--89. {In Japanese}Google Scholar
Index Terms
- Analysis of hand movement variation related to speed in Japanese sign language
Recommendations
A Method for Recognizing a Sequence of Sign Language Words Represented in a Japanese Sign Language Sentence
FG '00: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000A JSL (Japanese Sign Language) sentence is represented by connecting several signed words continuously. And there are transitions between the signed words that have no meaning in the signed sentence. Therefore, to translate JSL into Japanese, first, it ...
Analysis of variability in sign language hand trajectories: development of generative model
MOCO '22: Proceedings of the 8th International Conference on Movement and ComputingThe analysis of human movement poses a well-known challenge that has already been addressed in various ways and needs to be adapted to the type of movement being considered. The focus here is on the analysis of hand movement in sign language. This study ...
Sign language animation using TVML
VRCAI '10: Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in IndustryThe deaf communities in Japan use a visual language called Japanese Sign Language (JSL) as their first language. Learning to read Japanese can be difficult for some deaf people, because JSL has a totally different grammar from Japanese. NHK broadcasts ...
Comments