Abstract
Sign language recognition is a promising application that breaks the barrier between deaf and normal people. However most researchers in different sign language recognition systems employ a single type of sensors to capture signs. In this paper, hybrid heterogeneous types of sensors are integrated to capture all sign features. Leap motion which is recently available, is customized to capture hands and fingers movements. Two digital cameras are used to capture facial expressions and body movement. The system accomplished 95% recognition accuracy for a dataset consists of 20 dynamic signs due to the additional modules for facial expressions recognition and body movement recognition.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Grobel, K., Assam, M.: Isolated sign language recognition using hidden Markov models. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Orlando, FL, pp. 162–167 (1997)
Brand, M., Oliver, N., Pentland, A.: Coupled hidden Markov models for complex action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (1997)
Lichtenauer, J.F., ten Holt, G.A., Reinders, M.J.T., Hendriks, E.A.: Person-independent 3d sign language recognition. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds.) GW 2007. LNCS (LNAI), vol. 5085, pp. 69–80. Springer, Heidelberg (2009)
Waldron, M.B., Kim, S.: Isolated ASL sign recognition system for deaf persons. IEEE Trans. Rehabilitation Eng. 3(3), 261–271 (1995)
Chen, F.-S., Fu, C.-M., Huang, C.-L.: Hand gesture recognition ussing a real-time tracking method and hidden Markov models. Image and Vision Computing 21, 745–758 (2003)
Forster, J., Schmidt, C., Hoyoux, T., Koller, O., Zelle, U., Piater, J., Ney, H.: Rwthphoenix-weather: A large vocabulary sign language recognition and translation corpus. In: LREC (May 2012)
Gweth, Y., Plahl, C., Ney, H.: Enhanced continuous sign language recognition using PCA and neural network features. In: CVPR 2012 Workshop on Gesture Recognition (June 2012)
Hoffmeister, B., Schlüter, R., Ney, H.: Icnc and Irover: The limits of improving system combination with classification? In: Interspeech, pp. 232–235 (September 2008)
Koller, O., Ney, H., Bowden, R.: May the force be with you: Force-aligned SignWriting for automatic subunit annotation of corpora. In: IEEE International Conference on Automatic Face and Gesture Recognition, Shanghai, PRC (April 2013)
Geetha, M., Manjusha, U.C.: A Vision Based Recognition of Indian Sign Language Alphabets and Numerals Using B-Spline Approximation. International Journal of Computer Science and Engineering (IJCSE) (2013)
Sultana, A., Rajapushpa, T.: Vision Based Gesture Recognition for Alphabetical Hand gestures Using the SVM Classifier. International Journal of Computer Science and Engineering Technology 3(7) (2012)
Yuce, B.: Neural Network Design and Feature Selection using Principal Component Analysis and Taguchi Method for Identifying Wood Veneer Defects
Mastrocinque, E., Packianather, M.S., Pham, D.T., Lambiase, A., Fruggiero, F.: Production & Manufacturing Research (2014)
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Communications of the ACM 56(1), 116–124 (2013)
Fujimura, K., Liu, X.: Sign recognition using depth image streams. In: Procs. of FGR, Southampton, UK, pp. 381–386 (2006)
Combettes, P.L., Pesquet, J.-C.: Proximal splitting methods in signal processing. In: Fixed-Point Algorithms for Inverse Problems in Science and Engineering, pp. 185–212. Springer, New York (2011)
Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences 2(1), 183–202 (2009)
Wang, Z., Hu, K., Xu, K., Yin, B., Dong, X.: Structural Analysis of Network Traffic Matrix via Relaxed Principal Component Pursuit. Computer Networks 56(7), 2049–2067 (2012)
Saishanmuga, V.R., Rajagopalan, S.P.: A neuro-genetic system for face recognition. Int. J. Comput. Sci. 9, 264–267 (2012)
Shen, L.L., Wang, Y.X., Duan, L.: Application of artificial neural networks on the Prediction of surface ozone concentrations. Huan. Jing Ke Xue 32, 2231-5PMID: 22619942 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
ElBadawy, M., Elons, A.S., Sheded, H., Tolba, M.F. (2015). A Proposed Hybrid Sensor Architecture for Arabic Sign Language Recognition. In: Filev, D., et al. Intelligent Systems'2014. Advances in Intelligent Systems and Computing, vol 323. Springer, Cham. https://doi.org/10.1007/978-3-319-11310-4_63
Download citation
DOI: https://doi.org/10.1007/978-3-319-11310-4_63
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11309-8
Online ISBN: 978-3-319-11310-4
eBook Packages: EngineeringEngineering (R0)