Abstract
Multimodal biometric fusion is gaining more attention among researchers in recent days. As multimodal biometric system consolidates the information from multiple biometric sources, the effective fusion of information obtained at score level is a challenging task. In this paper, we propose a framework for optimal fusion of match scores based on Gaussian Mixture Model (GMM) and Monte Carlo sampling based hypothesis testing. The proposed fusion approach has the ability to handle: 1) small size of match scores as is more commonly encountered in biometric fusion, and 2) arbitrary distribution of match scores which is more pronounced when discrete scores and multimodal features are present. The proposed fusion scheme is compared with well established schemes such as Likelihood Ratio (LR) method and weighted SUM rule. Extensive experiments carried out on five different multimodal biometric databases indicate that the proposed fusion scheme achieves higher performance as compared with other contemporary state of art fusion techniques.
Similar content being viewed by others
References
Ross A, Nandakumar K, Jain A K. Handbook of Multibiometrics. Springer-Verlag, 2006.
Nandakumar K, Chen Y, Dass S C, Jain A K. Likelihood ratio-based biometric score fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2): 342-347.
Kittler J, Hatef M, Duin R P W, Matas J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(3): 226-239.
Jain A K, Hong L, Kulkarni Y. A multimodal biometric system using finger-print, face, and speech. In Proc. International Conference on Audio and Video Based Biometric Person Authentication, Washington DC., USA, 1999, pp.182-187.
Snelick R, Uludag, U, Mink A, Indovina M, Jain A K. Largescale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(3): 450-455.
Ross A, Jain A K. Information fusion in biometrics. Pattern Recognition Letters, 2003, 24(13): 2115-2125.
Chu R, Liao S, Han Y, Sun Z, Li S Z, Tan T. Fusion of face and palmprint for personal identification based on ordinal features. In Proc. IEEE Conference on Computer vision and Pattern Recognition, Minneapolis, USA, June 18-23, 2007, pp.1-2.
Dass S C, Nandakumar K, Jain A K. A principled approach to score level fusion in multimodal biometric systems. In Proc. Audio and Video based Biometric Person Authentication (AVBPA-2005), New York, USA, July 20-22, 2005, pp.1049-1055.
Fierrez-Aguilar J, Ortega-Garcia J, Gonzalez-Rodriguez J. Fusion strategies in multimodal biometric verification. In Proc. ICME 2003, Baltimore, USA, July 6-9, 2003, pp.5-8.
Sobel I M. A Primer for the Monte Carlo Methods. CRC Press, 2000.
Kalos M H, Whitlock P A. Monte Carlo Methods. Wiley, 1986.
Li J Q, Barron A. Mixture Density Estimation. Advances in Neural Information Pressing System, 12, MIT Press, 1999.
Rakhlin A, Penchanko D, Mukerjee S. Risk bounds for mixture density estimation. ESAIM: Probability and Statistics, 2005, 9: 220-229.
Ulery B, Hicklin A R, Watson C, Fellener W. Studies of biometric fusion. Technical Report IR 7346, NIST, 2006.
Figueiredo M, Jain A K. Unsupervised learning of finite mixtures modesl. PAMI, 2002, 24(3): 381-396.
McLachlan G J, Peel D. Finite Mixture Models. Wiley Series in Probability and Statistics, 2000.
Bishop C. Pattern Recognition and Machine Learning. Springer, 2006.
Raghavendra R, Rao A, Hemantha Kumar G. Subjective performance of texture based algorithm for face vereification: The role of databases. In Proc. the 6th Indian Conference on Computer Vision, Graphics & Image Processing (ICVGIP 2008), Hyderabad, India, Jan. 11-13, 2000, pp.421-428.
Ross S M. Introduction to Probability and Statistics for Engineers and Scientists. Third Edition, Elsvier Academic Press, 2004.
Mooney C Z. Monte Carlo Simulation. Sage Publications, 1997.
NIST biometric score sets-release 1. Nat. Inst. Standards and Technology, 2004, http//:www.itl.nist.gov/iad/894.03/biometricscores.
The AR Face Database. www.rvl1.ecn.purdue.edu.aleix faceDB.html/.
polyU palmprint database. www.comp.polyu.edu.hk/biometrics.
TIMIT speech database. www.ldc.upenn.edu.
Xiao Z, Guo C, Yu M, Li Q. Research on log Gabor wavelet and its application in image edge detection. In Proc. the 6th International Conference on Signal Processing (ICSP-2002), Beijing, China, Aug. 26-30, 2002, pp.592-595.
Zhang D. Palmprint Authentication. Springer-Verlag, 2004.
Ben-Yacoub, S, Abdeljaoued Y, Mayoraz E. Fusion of face and speech data for person identity verification. IEEE Transactions on Neural Networks, 1999, 10: 1065-1074.
Bimbot F, Magrin I, Mathan L. Second order statistical measure for text independent speaker identification. Speech Communication, 1995, 17(1/2): 177-192.
Raghavendra R, Rao A, G Hemantha Kumar. Qualitative weight assignment for multimodal biometric fusion. In Proc. the 7th International Conference on Advances in Pattern Recognition (ICAPR 2009), Kolkata, India, Feb. 4-6, 2009, pp.193-196.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Raghavendra, R., Ashok, R. & Hemantha Kumar, G. Multimodal Biometric Score Fusion Using Gaussian Mixture Model and Monte Carlo Method. J. Comput. Sci. Technol. 25, 771–782 (2010). https://doi.org/10.1007/s11390-010-9364-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-010-9364-7