Abstract
Our lab has conducted experimental evaluations of ASL animations, which can increase accessibility of information for signers with lower literacy in written languages. Participants watch animations and answer carefully engineered questions about the information content. Because of the labor-intensive nature of our current evaluation approach, we seek techniques for measuring user’s reactions to animations via eye-tracking technology. In this paper, we analyze the relationship between various metrics of eye movement behavior of native ASL signers as they watch various types of stimuli: videos of human signers, high-quality animations of ASL, and lower-quality animations of ASL. We found significant relationships between the quality of the stimulus and the proportional fixation time on the upper and lower portions of the signers face, the transitions between these portions of the face and the rest of the signer’s body, and the total length of the eye fixation path. Our work provides guidance to researchers who wish to evaluate the quality of sign language animations: to enable more efficient evaluation of animation quality to support the development of technologies to synthesize high-quality ASL animations for deaf users.
Chapter PDF
Similar content being viewed by others
Keywords
References
Adamo-Villani, N., Doublestein, J., Martin, Z.: Sign language for K-8 mathematics by 3D interactive animation. Journal of Educational Technology Systems 33(3), 241–257 (2005)
Adamo-Villani, N., Popescu, V., Lestina, J.: A non-expert-user interface for posing signing avatars. Disability and Rehabilitation: Assistive Technology 8(3), 238–248 (2013)
Ardis, S.: ASL Animations supporting literacy development for learners who are deaf. Closing the Gap 24(5), 1–4 (2006)
Cavender, A., Rice, E.A., Wilamowska, K.M.: SignWave: Human Perception of Sign Language Video Quality as Constrained by Mobile Phone Technology. Emergency 7(12), 16–20
Cooke, L., Cuddihy, E.: Using eye tracking to address limitations in think-aloud protocol. In: Proceedings of the International Professional Communication Conference (IPCC 2005), pp. 653–658. IEEE (2005)
Duchowski, A.: A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers 34(4), 455–470 (2002)
Emmorey, K., Thompson, R., Colvin, R.: Eye gaze during comprehension of American Sign Language by native and beginning signers. J. Deaf Stud. Deaf Educ. 14(2), 237–243 (2009)
Huenerfauth, M.: Evaluation of a psycholinguistically motivated timing model for animations of American Sign Language. In: Proc. of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 129–136. ACM (2008)
Huenerfauth, M.: Spatial and planning models of ASL classifier predicates for machine translation. In: 10th International Conference on Theoretical and Methodological Issues in Machine Translation, TMI (2004)
Huenerfauth, M., Lu, P., Rosenberg, A.: Evaluating importance of facial expression in American Sign Language and pidgin signed English animations. In: Proc. of the 13th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 99–106. ACM (2011)
Huenerfauth, M., Zhao, L., Gu, E., Allbeck, J.: Evaluating American Sign Language generation through the participation of native ASL signers. In: Proc. of the 9th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 211–218. ACM (2007)
Jacob, R.J.K., Karn, K.S.: Eye Tracking in Human- Computer Interaction and Usability Research: Ready to Deliver the Promises. The Mind’s Eye (First Edition). In: Hyönä, J., Radach, R., Deubel, H. (eds.) Amsterdam, pp. 573–605 (2003)
Kacorri, H., Harper, A., Huenerfauth, M.: Comparing native signers’ perception of American Sign Language animations and videos via eye tracking. In: Proc. of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, p. 9. ACM (2013)
Kacorri, H., Lu, P., Huenerfauth, M.: Evaluating facial expressions in American Sign Language animations for accessible online information. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 510–519. Springer, Heidelberg (2013)
Karpouzis, K., Caridakis, G., Fotinea, S.E., Efthimiou, E.: Educational resources and implementation of a Greek sign language synthesis architecture. Computers & Education 49(1), 54–74 (2007)
Lu, P., Huenerfauth, M.: Accessible motion-capture glove calibration protocol for recording sign language data from deaf subjects. In: Proc. of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 83–90. ACM (2009)
Mitchell, R., Young, T., Bachleda, B., Karchmer, M.: How many people use ASL in the United States? Why estimates need updating. Sign. Lang. Studies 6(3), 306–335 (2006)
Muir, L.J., Richardson, I.E.: Perception of sign language and its application to visual communications for deaf people. J. Deaf Stud. Deaf Educ. 10(4), 390–401 (2005)
Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372–422 (1998)
Traxler, C.: The Stanford achievement test, 9th edition: national norming and performance standards for deaf & hard-of-hearing students. J. Deaf Stud. & Deaf Educ. 5(4), 337–348 (2000)
Wagner, M., Marder, C., Blackorby, J., Cameto, R., Newman, L., Levine, P., et al.: The achievements of 100 youth with disabilities during secondary school: A report from 101 the National Longitudinal Transition Study-2 (NLTS2). SRI International, Menlo 102 Park (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kacorri, H., Harper, A., Huenerfauth, M. (2014). Measuring the Perception of Facial Expressions in American Sign Language Animations with Eye Tracking. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Design for All and Accessibility Practice. UAHCI 2014. Lecture Notes in Computer Science, vol 8516. Springer, Cham. https://doi.org/10.1007/978-3-319-07509-9_52
Download citation
DOI: https://doi.org/10.1007/978-3-319-07509-9_52
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07508-2
Online ISBN: 978-3-319-07509-9
eBook Packages: Computer ScienceComputer Science (R0)