Abstract
We develop a common theoretical framework for combining evidence in multimodal personal identity recognition systems. It is shown that many existing schemes can be considered as special cases of compound classification where all the biometric data available is used jointly to make a decision. A sensitivity analysis of the various schemes to estimation errors is carried out to show that the integration scheme developed under the most restrictive assumptions — the sum rule — and its derivatives are least affected by estimation errors. The combination strategies developed are used as a basis of a multimodal face recognition system and experimentally evaluated on the M2VTS database [1].
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
S. Pigeon. The M2VTS database. Technical report, UCL — Laboratoire de Télécommunications et Télédétection, Place du Levant, 2-B-1348 Louvain-La-Neuve, Belgium, http://www.tele.ucl.ac.be/M2VTS, 1996.
R. Brunelli and D. Falavigna. Person identification using multiple cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(10):955–966, Oct 1995.
R. Brunelli, D. Falavigna, T. Poggio, and L. Stringa. Automatic person recognition by using acoustic and geometric features. Machine Vision and Applications, 8:317–325, 1995.
R. Brunelli and T. Poggio. Face recognition: Features versus templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(10):1042–1052, Oct 1993.
M.P. Acheroy, C. Beumier, J. Bigün, G. Chollet, B. Duc, S. Fischer, D. Genoud, P. Lockwood, G. Maitre, S. Pigeon, I. Pitas, K. Sobottka, and L. Vandendorpe. Multi-modal person verification tools using speech and images. In Proceedings of the European Conference on Multimedia Applications, Services and Techniques (ECMAST '96), Louvain-La-Neuve, May 20–30, pages 747–761, 1996.
G. Maitre, B. Duc, S. Fischer, D. Genoud, J. Bigün, and G. Chollet. Multi-modal personal identification. Technical report, IDIAP, 1996.
J Kittler, Y P Li, J Matas, and M U Ramos Sánchez. Lip-shape dependent face verification. In submitted to AVBPA 97, Crans-Montana, Switzerland, 1997.
M U Ramos Sánchez, J Matas, and J Kittler. Statistical chromaticity models for lip tracking with b-splines. In submitted to AVBPA 97, Crans-Montana, Switzerland, 1997.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kittler, J., Li, Y.P., Matas, J., Sánchez, M.U.R. (1997). Combining evidence in multimodal personal identity recognition systems. In: Bigün, J., Chollet, G., Borgefors, G. (eds) Audio- and Video-based Biometric Person Authentication. AVBPA 1997. Lecture Notes in Computer Science, vol 1206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0016012
Download citation
DOI: https://doi.org/10.1007/BFb0016012
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-62660-2
Online ISBN: 978-3-540-68425-1
eBook Packages: Springer Book Archive