Abstract
We present a multimodal approach to face verification which draws on two distinct knowledge sources of biometric information concerning the subject. A B-spline lip tracker provides the control information regarding the state of the lip shape which is used by a conventional eigenface based face verification system to confirm or reject a claimed personal identity. The performance of the system tested on the M2VTS database shows a promising improvement over the unimodal approach. This improvement derives from the achieved reduction in the population entropy of the models, thus minimising the probability of imposter acceptance.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
J. Kittler, J. Matas, M. Bober, and L. Nguyen. Image interpretation: using multiple cues. In Proceedings of the International Conference on Image Processing and Applications, 1995.
R. Brunelli and D. Falavigna. Person identification using multiple cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(10):955–966, Oct 1995.
R. Brunelli, D. Falavigna, T. Poggio, and L. Stringa. Automatic person recognition by using acoustic and geometric features. Machine Vision and Applications, 8:317–325, 1995.
R. Brunelli and T. Poggio. Face recognition: Features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(10):1042–1052, Oct 1993.
M.P. Acheroy, C. Beumier, J. Bigün, G. Chollet, B. Duc, S. Fischer, D. Genoud, P. Lockwood, G. Maitre, S. Pigeon, I. Pitas, K. Sobottka, and L. Vandendorpe. Multi-modal person verification tools using speech and images. In Proceedings of the European Conference on Multimedia Applications, Services and Techniques (ECMAST '96), Louvain-La-Neuve, May 20–30, pages 747–761, 1996.
G. Maitre, B. Duc, S. Fischer, D. Genoud, J. Bigün, and G. Chollet. Multi-modal personal identification. Technical report, IDIAP, 1996.
M. A. Turk and A. P. Pentland. Face recognition using eigenfaces. In Proceedings of the 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Maui, HI, 03–06 Jun 1991, (Conf. code 16244), pages 586–591. IEEE, IEEE Service Center, Piscataway, NJ, USA, 1991.
B. Moghaddam and A. Pentland. Face recognition using view-based and modular eigenspaces. In Automatic Systems for the Identification and Inspection of Humans (San Diego, California, July 28–29, 1994), volume 2277, pages 13–21, 1994.
C. Bregler and Y. Konig.’ Eigenlips’ for robust speech recognition. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing — Proceedings, volume 2, pages 669–672. IEEE, Piscataway, NJ, USA, 1994.
R. Kaucic, B. Dalton, and A. Blake. Real-time lip tracking for audio-visual speech recognition applications. In Fourth European Conference on Computer Vision (Cambridge, UK, 1996), volume 2, pages 376–386. Cambridge, 1996.
J. Luettin, N. A. Thacker, and W. Beet. Active shape models for visual speech feature extraction. Technical report, University of Sheffield, Sheffield, UK, 1995.
U. Ramos Sanchez. Multimodal personal verification. Technical report, University of Surrey, 1996.
R. Bartels, J. Beatty, and B. Barsky. An Introduction to Splines for Use in Computer Graphics and Geometry Modeling. Morgan Kaufmann, 1987.
G. Farm. Curves and Surfaces for Computer Aided Geometric Design. Academic Press Ltd., 1993.
A. Blake and M. Isard. 3d position, attitude and shape input using video tracking of hands and lips. In SIGGRAPH '94 Conference Proceedings (Orlando, Florida, July 24–29, 1994), pages 185–192, 1515 Broadway, 17th floor, New York, NY 10036, USA, 1994.
J. Matas and J. Kittler. Spatial and feature based clustering: Applications in image analysis. In 6th International Conference on Computer Analysis and Patterns, Prague, Czech Republic, September 6–8 1995, 1995.
K. Fukunaga. Introduction to Statististical Pattern Recognition. Academic Press, 1990.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kittler, J., Li, Y.P., Matas, J., Sánchez, M.U.R. (1997). Lip-shape dependent face verification. In: Bigün, J., Chollet, G., Borgefors, G. (eds) Audio- and Video-based Biometric Person Authentication. AVBPA 1997. Lecture Notes in Computer Science, vol 1206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0015980
Download citation
DOI: https://doi.org/10.1007/BFb0015980
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62660-2
Online ISBN: 978-3-540-68425-1
eBook Packages: Springer Book Archive