Abstract
Information fusion refers to the reconciliation of evidence presented by multiple sources of information in order to generate a decision. In the context of biometrics, evidence reconciliation plays a pivotal role in enhancing the recognition accuracy of human authentication systems and is referred to as multibiometrics. Multibiometric systems combine the information presented by multiple biometric sensors, algorithms, samples, units, or traits in order to establish the identity of an individual. Besides enhancing matching performance, these systems are expected to improve population coverage, deter spoofing, facilitate continuous monitoring, and impart fault tolerance to biometric applications. This chapter introduces the topic of multibiometrics and enumerates the various sources of biometric information that can be consolidated as well as the different levels of fusion that are possible in a biometric system. The role of using ancillary information such as biometric data quality and soft biometric traits (e.g., height) to enhance the performance of these systems is discussed. Three case studies demonstrating the benefits of a multibiometric system and the factors impacting its architecture are also presented. Finally, some of the open challenges in multibiometric system design and implementation are enumerated.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
F. Alonso-Fernandez, J. Fierrez, D. Ramos, and J. Ortega-Garcia. Dealing with sensor interoperability in multi-biometrics: The upm experience at the biosecure multimodal evaluation 2007. In Proc. of SPIE Defense and Security Symposium, Workshop on Biometric Technology for Human Identification, 2008.
R. Auckenthaler, M. Carey, and H. Lloyd-Thomas. Score normalization for text-independent speaker verification systems. Digital Signal Processing (DSP) Journal, 10:42–54, 2000.
S. Bengio, C. Marcel, S. Marcel, and J. Marithoz. Confidence measures for multimodal identity verification. Information Fusion, 3(4):267–276, 2002.
E. S. Bigun, J. Bigun, B. Duc, and S. Fischer. Expert Conciliation for multimodal Person authentication systems using Bayesian statistics. In First International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), pages 291–300, Crans-Montana, Switzerland, March 1997.
J. Bigun, J. Fierrez-Aguilar, J. Ortega-Garcia, and J. Gonzalez-Rodriguez. Multimodal Biometric authentication using quality signals in mobile Communications. In 12th Int’l Conf. on Image Analysis and Processing, pages 2–13, Mantova, 2003.
R. Brunelli and D. Falavigna. Person identification using multiple Cues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(10):955–966, October 1995.
K. I. Chang, K. W. Bowyer, and P. J. Flynn. An evaluation of multimodal 2D+3D face biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(4):619–624, April 2005.
X. Chen, P. J. Flynn, and K. W. Bowyer. IR and visible light face recognition. Computer Vision and Image Understanding, 99(3):332–358, September 2005.
Y. Chen, S. Dass, and A. Jain. Localized iris image quality using 2-d wavelets. In Proc. Int’l Conf. on Biometrics (ICB), pages 373–381, Hong Kong, 2006.
Y. Chen, S.C. Dass, and A.K. Jain. Fingerprint quality indices for Predicting authentication Performance. In LNCS 3546, 5th Int’l. Conf. Audio- and Video-Based Biometric Person Authentication (AVBPA 2005), pages 160–170, New York, 2005.
C. C. Chibelushi, J. S. D. Mason, and F. Deravi. Feature-level data fusion for bimodal person recognition. In Eds poo Proceedings of the Sixth International Conference on Image Processing and Its Applications, 1: 399–403, Dublin, Ireland, July 1997.
S. C. Dass, K. Nandakumar, and A. K. Jain. A Principled approach to score level fusion in multimodal biometric systems. In Eds poo Proceedings of Fifth International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA), pages 1049–1058, rye Brook, USA, July 2005.
J. Daugman. Combining Multiple Biometrics. Available at http://www.cl.cam.ac.uk/users/jgd1000, 2000.
G. Doddington, W. Liggett, A. Martin, M. Przybocki, and D. Reynolds. Sheep, goats, lambs and wolves: a statistical analysis of speaker performance in the NIST 1998 speaker recognition evaluation. InInt’l Conf. Spoken Language Processing (ICSLP), Sydney, 1998.
A. Eriksson and P. Wretling. How flexible is the human voice? a case study of mimicry. In Proceedings of the European Conference on Speech Technology, pages 1043–1046, Rhodes, 1997.
E. Erzin, Y. Yemez, and A. M. Tekalp. Multimodal speaker identification using an adaptive classifier cascade based on modality reliability. IEEE Transactions on Multimedia, 7(5):840–852, October 2005.
O. Fatukasi, J. Kittler, and N. Poh. Quality Controlled multimodal fusion of Biometric experts. In Eds poo 12th Iberoamerican Congress on Pattern Recognition CIARP, pages 881–890, Via del Mar-Valparaiso, Chile, 2007.
J. Fierrez-Aguilar, J. Ortega-Garcia, J. Gonzalez-Rodriguez, and J. Bigun. Kernel-Based multimodal Biometric verification using quality signals. In Proc. of SPIE Defense and Security Symposium, Workshop on Biometric Technology for Human Identification, 5404: 544–554, 2004.
H. Fronthaler, K. Kollreider, J. Bigun, J. Fierrez, F. Alonso-Fernandez, J. Ortega-Garcia, and J. Gonzalez-Rodriguez. Fingerprint image-quality estimation and its application to multialgorithm verification. IEEE Trans. on Information Forensics and Security, 3:331–338, 2008.
X. Gao, R. Liu, S. Z. Li, and P. Zhang. Standardization of face image sample quality. In LNCS 4642, Proc. Int’l Conf. Biometrics (ICB’07), pages 242–251, Seoul, 2007.
W. R. Harrison. Suspect Documents, Their Scientific Examination. Nelson-Hall Publishers, 1981.
H. Hill, P. G. Schyns, and S. Akamatsu. Information and viewpoint dependence in face recognition. Cognition, 62(2):201–222, February 1997.
T. K. Ho, J. J. Hull, and S. N. Srihari. Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(1):66–75, January 1994.
Y. S. Huang and C. Y. Suen. Method of Combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(1):90–94, January 1995.
A. K. Jain, K. Nandakumar, X. Lu, and U. Park. Integrating faces, fingerprints and soft biometric traits for user recognition. In Proceedings of ECCV International Workshop on Biometric Authentication (BioAW), LNCS 3087: 259–269, Prague, Czech Republic, May 2004. Springer.
A. K. Jain, K. Nandakumar, and A. Ross. Score normalization in multimodal biometric systems. Pattern Recognition, 38(12):2270–2285, December 2005.
A. K. Jain and A. Ross. Multibiometric systems. Communications of the ACM, Special Issue on Multimodal Interfaces, 47(1):34–40,January 2004.
A. K. Jain, A. Ross, and S. Prabhakar. An introduction to biometric recognition. IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Image- and Video-Based Biometrics, 14(1):4–20, January 2004.
J. Jang, K. R. Park, J. Son, and Y. Lee. Multi-unit Iris Recognition System by Image Check Algorithm. In Proceedings of International Conference on Biometric Authentication (ICBA), pages 450–457, Hong Kong, July 2004.
J. Kittler, N. Poh, O. Fatukasi, K. Messer, K. Kryszczuk, J. Richiardi, and A. Drygajlo. Quality dependent fusion of intramodal and multimodal Biometric experts. In Proc. of SPIE Defense and Security Symposium, Workshop on Biometric Technology for Human Identification, volume 6539, 2007.
A. Kong, J. Heo, B. Abidi, J. Paik, and M. Abidi. Recent advances in visual and infrared face recognition – a review. Computer Vision and Image Understanding, 97(1):103–135, January 2005.
K. Kryszczuk and A. Drygajlo. Credence estimation and error prediction in biometric identity verification. Signal Processing, 88:916–925, 2008.
K. Kryszczuk, J. Richiardi, P. Prodanov, and A. Drygajlo. Reliability-based decision fusion in multimodal biometric verification systems. EURASIP Journal of Advances in Signal Processing, 2007.
L. I. Kuncheva. Combining Pattern Classifiers – methods and algorithms. Wiley, New York 2004.
L. I. Kuncheva, C. J. Whitaker, C. A. Shipp, and R. P. W. Duin. Is Independence Good for Combining Classifiers? In Eds poo Proceedings of International Conference on Pattern Recognition (ICPR), 2: 168–171, Barcelona, Spain, 2000.
L. Lam and C. Y. Suen. Application of majority voting to pattern recognition: An analysis of its behavior and performance. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 27(5):553–568, 1997.
J. Lee, B. Moghaddam, H. Pfister, and R. Machiraju. Fining Optimal Views for 3D Face Shape Modeling. In Eds poo Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FG), pages 31–36, Seoul, Korea, May 2004.
W. Li, X. Gao, and T.E. Boult. Predicting biometric system failure. Proceedings of the IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety, pages 57–64, 31 2005-April 1 2005.
X. Lu, Y. Wang, and A. K. Jain. Combining Classifiers for face recognition. In Eds poo IEEE International Conference on Multimedia and Expo (ICME), 3: 13–16, Baltimore, USA, July 2003.
G. L. Marcialis and F. Roli. Fingerprint verification by fusion of optical and Capacitive sensors. Pattern Recognition Letters, 25(11):1315–1322, August 2004.
T. Matsumoto, H. Matsumoto, K. Yamada, and S. Hoshino. Impact of artificial gummy fingers on fingerprint systems. In Eds poo Optical Security and Counterfeit Deterrence Techniques IV, Proceedings of SPIE, 4677: 275–289, San Jose, USA, January 2002.
D. E. Maurer and J. P. Baker. Fusing multimodal biometrics with quality estimates via a Bayesian belief network. Pattern Recognition, 41(3):821–832, 2007.
K Messer, J Matas, J Kittler, J Luettin, and G Maitre. Xm2vtsdb: The extended m2vts database. In Second International Conference on Audio and Video-based Biometric Person Authentication, 1999.
S. Muller and O. Henniger. Evaluating the biometric sample quality of handwritten signatures. In LNCS 3832, Proc. Int’l Conf. Biometrics (ICB’07), pages 407–414, 2007.
K. Nandakumar, Y. Chen, S. C. Dass, and A. K. Jain. Likelihood ratio based biometric score fusion. IEEE Trans. on Pattern Analysis and Machine Intelligence, 30:342–347, 2008.
National Institute of Standards and Technology. Nist Speech Quality Assurance Package 2.3 Documentation.
A. O’Toole, H. Bulthoff, N. Troje, and T. Vetter. Face recognition across large viewpoint changes. In Eds poo Proceedings of the International Workshop on Automatic Face - and Gesture-Recognition (IWAFGR), pages 326–331, Zurich, Switzerland, June 1995.
Z. Pan, G. Healey, M. Prasad, and B. Tromberg. Face recognition in hyperspectral images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(12):1552–1560, December 2003.
N. Poh and S. Bengio. Towards Predicting optimal subsets of Base-experts in Biometric authentication task. In LNCS 3361, 1st Joint AMI/PASCAL/IM2/M4 Workshop on Multimodal Interaction and Related Machine Learning Algorithms MLMI, pages 159–172, Martigny, 2004.
N. Poh and S. Bengio. Improving fusion with margin-derived Confidence in Biometric authentication tasks. In LNCS 3546, 5th Int’l. Conf. Audio- and Video-Based Biometric Person Authentication (AVBPA 2005), pages 474–483, New York, 2005.
N. Poh, T. Bourlai, and J. Kittler. Improving Biometric device interoperability by likelihood ratio-based quality dependent score normalization. In IEEE Conf. on Biometrics: Theory, Applications and Systems, pages 1–5, Washington, D.C., 2007.
N. Poh, G. Heusch, and J. Kittler. On Combination of face authentication experts by a mixture of quality dependent fusion Classifiers. In LNCS 4472, Multiple Classifiers System (MCS), pages 344–356, Prague, 2007.
N. Poh and J. Kittler. On using error Bounds to optimize Cost-sensitive multimodal Biometric authentication. In Proc. 19th Int’l Conf. Pattern Recognition (ICPR), 2008.
S. Prabhakar and A. K. Jain. Decision-level fusion in fingerprint verification. Technical Report MSU-CSE-00-24, Michigan State University, October 2000.
T. Putte and J. Keuning. Biometrical fingerprint recognition: Don’t get your fingers burned. In Proceedings of IFIP TC8/WG8.8 Fourth Working Conference on Smart Card Research and Advanced Applications, pages 289–303, 2000.
N. K. Ratha, J. H. Connell, and R. M. Bolle. An analysis of minutiae matching strength. In Edspoo Proceedings of Third International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), pages 223–228, Halmstad, Sweden, June 2001.
T. P. Riopka and T. E. Boult. Classification enhancement via biometric pattern perturbation. In Proc. of Audio- and Video-Based Biometric Person Authentication (AVBPA), pages 850–859, 2005.
A. Ross and R. Govindarajan. Feature level fusion using hand and face Biometrics. In Proceedings of SPIE Conference on Biometric Technology for Human Identification II, 5779: 196–204, Orlando, USA, March 2005.
A. Ross, A. K. Jain, and J. Reisman. A hybrid fingerprint matcher. Pattern Recognition, 36(7):1661–1673, July 2003.
A. Ross, K. Nandakumar, and A. K. Jain. Handbook of Multibiometrics. Springer, New York, USA, 1st edition, 2006.
A. Ross, S. Shah, and J. Shah. Image versus feature mosaicing: A case study in fingerprints. In Proceedings of SPIE Conference on Biometric Technology for Human Identification III, pages 620208–1 – 620208–12, Orlando, USA, April 2006.
R. K. Rowe and K. A. Nixon. Fingerprint enhancement using a multispectral sensor. In Proceedings of SPIE Conference on Biometric Technology for Human Identification II, 5779: 81–93, March 2005.
U.R. Sanchez and J. Kittler. Fusion of talking face biometric modalities for personal identity verification. In IEEE Int’l Conf. Acoustics, Speech, and Signal Processing, 5: V–V, 2006.
C. Sanderson and K. K. Paliwal. Information fusion and person verification using speech and face information. Research Paper IDIAP-RR 02-33, IDIAP, September 2002.
R. Singh, M. Vatsa, A. Ross, and A. Noore. Performance enhancement of 2D face recognition via mosaicing. In Eds poo Proceedings of the 4th IEEE Workshop on Automatic Identification Advanced Technologies (AuotID), pages 63–68, Buffalo, USA, October 2005.
A. J. Smola and P. J. Bartlett, editors. Advances in Large Margin Classifiers. MIT Press, Cambridge, MA, 2000.
D. A. Socolinsky, A. Selinger, and J. D. Neuheisel. Face recognition with visible and thermal infrared imagery. Computer Vision and Image Understanding, 91(1-2):72–114, July-August 2003.
B. Son and Y. Lee. Biometric authentication system using reduced joint feature vector of Iris and Face. In Eds poo Proceedings of Fifth International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), pages 513–522, Rye Brook, USA, July 2005.
K-A. Toh, W-Y. Yau, E. Lim, L. Chen, and C-H. Ng. Fusion of auxiliary information for multimodal Biometric authentication. In LNCS 3072, Int’l Conf. on Biometric Authentication (ICBA), pages 678–685, Hong Kong, 2004.
B. Ulery, A. Hicklin, C. Watson, W. Fellner, and P. Hallinan. Studies of biometric fusion. Technical Report NISTIR 7346, NIST, September 2006
U. Uludag, A. Ross, and A. K. Jain. Biometric template selection and update: A case study in fingerprints. Pattern Recognition, 37(7):1533–1542, July 2004.
P. Verlinde and G. Cholet. Comparing decision fusion paradigms using k-NN based classifiers, decision trees and logistic regression in a multi-modal identity verification application. In Proceedings of Second International Conference on Audio- and Video-Based Biometric Person Authentication (AVBPA), pages 188–193, Washington D.C., USA, March 1999.
B. Xie, T. Boult, V. Ramesh, and Y. Zhu. Multi-camera face recognition by reliability-based selection. Proceedings of the IEEE International Conference on Computational Intelligence for Homeland Security and Personal Safety, pages 18–23, Oct. 2006.
L. Xu, A. Krzyzak, and C. Y. Suen. Methods for combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man, and Cybernetics, 22(3):418–435, 1992.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag London Limited
About this chapter
Cite this chapter
Ross, A., Poh, N. (2009). Multibiometric Systems: Overview, Case Studies, and Open Issues. In: Tistarelli, M., Li, S.Z., Chellappa, R. (eds) Handbook of Remote Biometrics. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-84882-385-3_11
Download citation
DOI: https://doi.org/10.1007/978-1-84882-385-3_11
Publisher Name: Springer, London
Print ISBN: 978-1-84882-384-6
Online ISBN: 978-1-84882-385-3
eBook Packages: Computer ScienceComputer Science (R0)