Abstract
To overcome the limitation of hand shape recognition, the paper presented a recognition method of hand shape fusion based on the fuzzy neural network of BP. By means of fuzzy neural network of BP, the method analyzed the fusion computing for the collected hand gesture and lip shape image, viewed respectively the fusion image as the fuzzy set of hand gesture and lip shape, made the operation of fuzzy arithmetic operators for fuzzy set, matched the operation results and the sign of hand gesture and lip shape in database, carried on the fuzzy set operation for the gotten two sets of hand gesture and lip shape, finally got the recognition result. The simulation experiments show that the presented method is better in sign Language recognition, and it maybe has wide realistic application foreground in the education of deaf-and-dumb people.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ong, S.C.W., Ranganath, S.: Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Transaction on Pattern Analysis Machine Intelligence 27(6), 873–891 (2005)
Chen, F.-S., Fu, C.-M., Huang, C.-L.: Hand Gesture Recognition Using a Read-Time Tracking Method and Hidden Mmarkov Models. Image and Vision Computing 21(8), 745–758 (2003)
Bauer, B., Hienz, H.: Relevant features for video-based continuous sign language recognition. In: Proceedings of the International Conference on Automatic Face and Gesture Recognition, Grenoble, France, pp. 440–445 (2000)
Rao, C., Gritai, A., Shah, M., Syeda-Mahmood, T.: View invariant alignment and matching of video sequences. In: Proceedings of the IEEE International Conference on Computer Vision, Nice, France, pp. 939–945 (2003)
Ma, M., Zhang, L.-b., Xu, X.-l.: Fuzzy Neural Network Optimization by a Multi-Objective Differential Evolution Algorithm. Fuzzy Information and Engineering 1, 38–43 (2009)
Zheng, Y., Zhou, C.-G., Huang, Y.-X.: Taste Identification of Tea Through a Fuzzy Neural Network Based on Fuzzy C-means Clustering. Mini-Micro Systems 25(7), 1290–1294 (2004)
En, Z., Li, X., Liu, O., Zhang, T.: Optimization design for parameters of FNN: Learning algorithm of chaos simulated annealing. Journal of Central South University 35(3), 443–447 (2004)
Hall, D.L., Llinas, J.: Handbook of multisensor data fusion. CRC Press, New York (2001)
Zhang, L., Gao, W., Chen, X., Chen, Y., Wang, C.: A medium vocabulary visual recognition system for chinese sign language. Journal of Computer Research and Development 43(3), 476–482 (2006)
Li, Y., Gao, W., Yao, H.: Chinese sign language finger alphabet recognition based on color gloves. Computer Engineering and Applications 38(17), 55–58 (2002)
Wang, Q., Chen, X., Zhang, L., Wang, C., Gao, W.: Viewpoint invariant sign language recognition. Computer Vision and Image Understanding 108(1-2), 87–97 (2007)
Yang, X., Guo, B.: Study on Image Segmentation Algorithm Based on Fuzzy Mathematical Morphology. Fuzzy Information and Engineering 1, 488–495 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, X. (2010). Study on Sign Language Recognition Fusion Algorithm Using FNN. In: Cao, By., Wang, Gj., Guo, Sz., Chen, Sl. (eds) Fuzzy Information and Engineering 2010. Advances in Intelligent and Soft Computing, vol 78. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14880-4_68
Download citation
DOI: https://doi.org/10.1007/978-3-642-14880-4_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14879-8
Online ISBN: 978-3-642-14880-4
eBook Packages: EngineeringEngineering (R0)