Abstract
The lips movements are important in speech recognition and the Lip image segmentation has a significant role in image analysis. In this paper we present a novel technique to recognize Persian Vowels. The method is based on face detection and pupil location. First we perform the lip localization, then the color space CIE L*U*V* and CIE L*a*b* is used in order to improve the contrast between the lip and the other face regions. After that, the lip segmentation by using the Haar wavelet has done and the feature vectors has been extracted from the Haar wavelet result. Finally, the extracted feature vector has been used as neural network inputs and the vowels recognized. The proposed method has been applied on 100 tested images and the accuracy is about 79%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zhang, X., Mersereau, R.M.: Lip Feature Extraction Towards an Automatic Speechreading System. In: ICIP, Vancouver, BC, Canada (2000)
Eveno, N., Caplier, A., Coulon, P.Y.: A Parametric Model for Realistic Lip Segmentation. In: International Conference on Control, Automation, Robotics and Vision, ICARCV (2002)
Cootes, T.F.: Statistical Models of Appearance for Computer Vision. Technical report (2004) free to download on, http://www.isbe.man.ac.uk/bim/refs.html
Wang, S.L., Lau, W.H., Leung, S.H.: Automatic Lip contour extraction from color image. Pattern Recognition, 2375–2387 (2004)
Liew, A.W.C., Leung, S.H., Lau, W.H.: Lip contour extraction from color images using a deformable model. Pattern Recognition, Oxford, 2949–2962 (2002)
Shinchi, T., et al.: Vowel recognition according to lip shapes using neural networks. Proc. of IEEE, Tottori, 1772–1777 (1998)
Matthews, L.: Extraction of Visual Feature For Lipreading. IEEE Transaction on Pattern Analysis and Machine Intelligence 24(2), 198–213 (2002)
David Stork., G., et al.: Neural Network Lipreading System for Improved Speech Recognition. In: Pro. IJCNN, pp. 285–295 (1992)
Bayesteh, A., Faez, K.: Boosted Bayesian kernel classifier method for face detection. In: Proceeding of Third international conference on natural computation (ICNC), pp. 533–537 (2007)
Werblin, F.s.: Control of retinal sensitivity: lll. Lateral interactions at the inner plexiform layer. J.Gen. Physiol., Copenhagen 88–110 (1974)
Hosseini, M.M., Ghofrani, S.: Automatic Lip Extraction Based On Wavelet Transform. In: IEEE GCIS, China, pp. 393–396 (2009)
Yuhas, B.P., et al.: Neural network models of sensory integration for improved vowel recognition. Proc. IEEE, 1658–1668 (1988)
Hosseini, M.M.: Vowel Recognition on lip image. Msc.project, University of Islamic azad Iran, pp. 101–105 (2009)
Sadeghi, V.S., Yaghmaie, K.: Vowel Recognition using Neural Networks. IJCSNS International Journal of Computer Science and Network Security 6(12), 154–158 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hosseini, M.M., Gharahbagh, A.A., Ghofrani, S. (2010). Vowel Recognition by Using the Combination of Haar Wavelet and Neural Network. In: Setchi, R., Jordanov, I., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2010. Lecture Notes in Computer Science(), vol 6276. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15387-7_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-15387-7_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15386-0
Online ISBN: 978-3-642-15387-7
eBook Packages: Computer ScienceComputer Science (R0)