Abstract
In this paper, we present two major parts of an interface for American Sign Language (ASL) to computer applications currently under work; a hand tracker and an ASL-parser. The hand tracker extracts information about handshape, position and motion from image sequences. As an aid in this process, the signer wears a pair of gloves with colour-coded markers on joints and finger tips. We also present a computational model of American Sign Language. This model is realized in an ASL-parser which consists of a DCG-grammar and a non-lexical component that records non-manual and spatial information over an ASL-discourse.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Charayphan, C. & Marble A. E. (1992). Image Processing System for Interpreting Motion in ASL.Journal of Biomedical Engineering 14(5): 419–425.
Darell, T. & Pentland, A. P. (1993). Space-time Gestures. In‘Looking at People: Recognition and Interpretation of Human Action’, Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.
Davis, J. & Shah, M. (1993).Gesture Recognition. Technical Report CS-TR-93-11, University of Central Florida.
Dorner, B. (1993). Hand Shape Identification and Tracking for Sign Language Interpretation. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.
Dorner, B. (1994).Chasing the Colour Glove: Visual Hand Tracking. Master's Thesis, School of Computing Science, Simon Fraser University, Burnaby, Canada.
Fels, S. S. (1990).Building Adaptive Interfaces with Neural Networks: The Glove-talk Pilot Study. Technical Report CRG-TR-90-1, University of Toronto, Toronto, Canada.
Fisher, S. (1975). Influences on Word Order Change in American Sign Language. In Li, C. N. (ed.)Word Order and Word Order Change, 1–25. University of Texas Press.
Friedman, L. A. (1975). Space, Time, and Person Reference in American Sign Language.Language 51(4): 940–961.
Friedman, L. A. (1976). The Manifestation of Subject, Object, and Topic in the American Sign Language. In Li, C. N. (ed.)Subject and Topic, 125–148. Academic Press.
Hagen, E. & Dahl, V. (1994). On Multiple-Valued Deductive Databases. In Proceedings ofThe 10th Canadian Conference on Artificial Intelligence (AI94), 31–38.
Hagen, E. (1993).A Flexible American Sign Language Interface to Deductive Databases. Master's thesis, School of Computer Science, Simon Fraser University, Burnaby, Canada.
Isenhath, J. O. (1990).The Linguistics of American Sign Language. McFarland & Company, Inc., Publishers: Jefferson, N.C.
Klima, E. S. & Bellugi, U. (1979).The Signs of Language. Harvard University Press: Cambridge, Mass.
Lucas, C. (ed.) (1990).Sign Language Research: Theoretical Issues. Gallaudet Press: Washington, D.C.
Pentland, A., Starner, T., Etcoff, N., Masiou, A., Oliyide, O. & Turk, M. (1993). Experiments with eigenfaces. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.
Ralescu, A. & Iwamoto, H. (1993). Reading Faces: A Fuzzy Logic Approach to Representation, Recognition and Description of Facial Expressions. In ‘Looking at People: Recognition and Interpretation of Human Action’,Workshop WS26 at the International Joint Conference on Artificial Intelligence (IJCAI-93), Chambery: France.
Tamura, S. & Kawasaki, S. (1988). Recognition of Sign Language Motion Images.Pattern Recognition 21(4): 343–353.
Wilbur, R. B. (1987).American Sign Language: Linguistic and Applied dimensions. College Hill Press, A division of Little, Brown and company (Inc.): Boston, second edition.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Dorner, B., Hagen, E. Towards an American Sign Language interface. Artif Intell Rev 8, 235–253 (1994). https://doi.org/10.1007/BF00849076
Issue Date:
DOI: https://doi.org/10.1007/BF00849076