Abstract
We propose and evaluate methods for enhancing performances of lip contours localization and tracking, which are based on the concepts of Statistical Shape Models (e.g. Active Shape Models, Hybrid Active Shape Models) and optimization of multi features. A single feature-based ASM gets good performance only in particular conditions but gets stuck in local minimum or gives bad performance in noisy conditions. In this paper, we propose to use 3 features: Normal Profile, Grey Level Patches and Gabor Wavelets and combine them by using a voting approach to derive a robust method (MF-ASM) on lip contours detection. Since the original ASM does not take into account the temporal information from previous frames, the lip contours are tracked by replacing the standard ASM with our hybrid ASM which is capable to take advantage of temporal information. Initial experimental results using popular audio-visual database show that our methods are more robust to the local minimum problem and give higher accuracy than traditional single feature-based ASM in lip contours detection and tracking.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hulbert, A., Poggio, T.: Synthesizing a color algorithm from examples. Sciences 239, 482–485 (1998)
Bolme, D.S.: Elastic bunch graph matching. Technical report, Colorado State University (March 2003)
Sanderson, C.: Biometric Person Recognition: Face, Speech and Fusion. VDM-Verlag (2008) ISBN 978-3-639-02769-3
Cootes, T., Taylor, C.J.: Statistical models of appearance for computer vision. Technical report, Imaging Science and Biomedical Engineering,University of Manchester, Manchester M13 9PT, U.K, Mars (2004)
Daubias, P.: Modeles a posteriori de la forme et de l’apparence des levres pour la reconnaissance automatique de la parole audiovisuelle. These de Doctorat, Universite du Maine (September 2002)
Cristiacce, D., Cootes, T.F.: Facial feature detection and tracking with automatic template selection. In: International Conference on Automatic Face and Gesture Recognition (October 2006)
Eveno, N.: Segmentation des levres par un modele deformable analytique. These de Doctorat, Institut National Polytechnique de grenoble (November 2003)
Beumer, G.M., Tao, Q., BAzen, A.M., Veldhuis, R.N.J.: Lanmark paper in face recognition. In: International Conference on Automatic Face and Gesture Recognition (January 2006)
Hamarneh, G.: Modeling shape variations and gray level information and an application to image search and classification. The Imaging and Image Analysis Group (January 1998)
Li, Y., Lai, J.H., Yuen, P.C.: Multi template asm method for feature points detection of facial image with diverse expression. In: International Conference on Automatic Face and Gesture Recognition (January 2006)
Yuille, A.L., Cohen, D.S., Hallian, P.W.: Feature extraction from faces using deformable templates. In: Proc. IEEE Comput. Vision and Pattern Recognition, pp. 104–109 (October 1989)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. International Journal of Computer Vision, 321–331 (October 1987)
Romdhani, S.: Face image analysis using a multiple features fitting strategy. PhD thesis (September 2005)
Feris, R.S., Krueger, V., Cesar Jr., R.M.: A wavelet subspace method for real time face tracking. Real time imaging (October 2004)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: European Conference on Computer Vision, pp. 321–331 (October 1987)
Cootes, T.F., Taylor, C., Cooper, D.: Active shape models - their trainning and application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Zhang, B., Gao, W., Shan, S., Wang, W.: Constraint shape model using edge constraint and gabor wavelet based search. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 52–61. Springer, Heidelberg (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, Q.D., Milgram, M. (2008). Robust Lip Contours Localization and Tracking Using Multi Features – Statistical Shape Models. In: Blanc-Talon, J., Bourennane, S., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2008. Lecture Notes in Computer Science, vol 5259. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88458-3_94
Download citation
DOI: https://doi.org/10.1007/978-3-540-88458-3_94
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88457-6
Online ISBN: 978-3-540-88458-3
eBook Packages: Computer ScienceComputer Science (R0)