skip to main content
10.1145/1878803.1878861acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
poster

Gesture recognition for fingerspelling applications: an approach based on sign language cheremes

Published:25 October 2010Publication History

ABSTRACT

This paper presents an approach for carrying out gesture recognition for the Brazilian Sign Language Manual Alphabet. The gestural patterns are treated as a combination of three primitives, or cheremes - hand configuration, hand orientation and hand movement. The recognizer is built in a modular architecture composed by inductive reasoning modules, which use the artificial neural network Fuzzy Learning Vector Quantization; and rule-based modules. This architecture has been tested and results are presented here. Some strengths of such approach are: robustness of recognition, portability to similar contexts, extensibility of the dataset to be recognize and reduction of the vocabulary recognition problem to the recognition of its primitives.

References

  1. D. B. Dias, R. C. B. Madeo, T. Rocha, H. H. Bíscaro, and S. M. Peres. Hand movement recognition for brazilian sign language: A study using distance-based neural networks. In International Joint Conference on Neural Networks, pages 697--704. IEEE, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. C. B. Madeo, S. M. Peres, H. H. Bíscaro, D. B. Dias, and C. Boscarioli. A committee machine implementing the pattern recognition module for fingerspelling applications. In Proceedings of the 25th Annual ACM Symposium on Applied Computing 2010, pages 954--958. ACM Press, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. S. Mitra and T. Acharya. Gesture recognition: A survey. IEEE Trans. on Systems, Man, and Cybernetics - Part C, 37(3), May 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. D. J. Sturman and D. Zelter. A survey of glove-based input. IEEE Computer Graphics and Applications, 14:30--39, January 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. C. Vogler and D. N. Metaxas. Toward scalability in ASL recognition: Breaking down signs into phonemes. In GW'99: Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction, pages 211--224, London, UK, 1999. Springer-Verlag. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Gesture recognition for fingerspelling applications: an approach based on sign language cheremes

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Conferences
                ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
                October 2010
                346 pages
                ISBN:9781605588810
                DOI:10.1145/1878803

                Copyright © 2010 Copyright is held by the author/owner(s)

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 25 October 2010

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • poster

                Acceptance Rates

                Overall Acceptance Rate436of1,556submissions,28%

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader