Abstract
With growing concerns about security, the world over, biometric-based person verification is gaining more and more attention. Recently, multimodal biometric has attracted increasing focus among researchers as this overwhelms many limitations of unimodal biometric systems and hence more reliable. In this paper, we propose four different feature extraction techniques namely Principle Component Analysis Mixture Model (PCA MM), Singular Value Decomposition Mixture Model (SVD MM), Independent Component Analysis I Mixture Model (ICA I MM), and Independent Component Analysis II Mixture Model (ICA II MM) to design a multimodal biometric system at feature level. The proposed methods begin with modeling the multimodal biometrics data using Gaussian Mixture Model followed by a subspace methods like PCA, SVD, ICA I, and ICA II. Extensive experiments are carried out to observe the verification performance of the proposed methods at feature and match score level on large dataset of 150 users. We compare the results of the combined biometric with the results of individual biometric and also results of the proposed schemes against conventional (without mixture model) subspace approaches. The experimental results demonstrate the effectiveness of the proposed methods in designing a robust multimodal biometric system for accurate person verification.
Similar content being viewed by others
References
Ross A., Nandakumar K., Jain A.K.: Handbook of Multibiometrics. Springer, New York (2006)
Jain A.K., Ross A., Prabhakar S.: An introduction to biometric recognition. In: IEEE Trans. Circuits Syst. Video Technol. 14, 4–20 (2004)
Hong, L., Jain, A.K., Prabhakar, S.: Can multibiometrics improve performance. In: Proceedings AutoID’99, Summit(NJ), pp. 59–64. USA (1999)
Brunelli R., Falavigna D.: Person identification using multiple cues. In: IEEE Trans. Pattern Anal. Mach. Intell. 10, 955–965 (1995)
Kittler J., Hatef M., Duin R.P.W., Matas J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20, 226–239 (1998)
Ben-Yacoub S., Abdeljaoued Y., Mayoraz E.: Fusion of face and speech data for person identity verification. IEEE Trans. Neural Netw. 10, 1065–1074 (1999)
Ross A., Jain A.K.: Information fusion in biometrics. Pattern Recognit. Lett. 24(13), 2115–2125 (2003)
Jain, A.K., Hong, L., Kulkarni, Y.: A multimodal biometric system using fingerprint, face, and speech. In: International Conference on Audio and Video based Biometric Person Authentication, pp. 182–187. Washington D.C., USA (1999)
Li, Q., Qiu, Z., Sun, D., Zhang, Y.: Subspace framework for feature-level fusion with its application to handmetric verification. In: The 8th International Conference on Signal Processing, pp. 16–20 (2006)
Feng, G., Dong, K., Hu, D., Zhang, D.: When faces are combined with palmprints:a novel biometric fusion strategy. In: First International Conference on Biometric Authentication (ICBA), pp. 701–707 (2004)
Jing X.Y., Yao Y.F., Yang J.Y., Li M., Zhang D.: Face and palmprint pixel level fusion and kernel DCV-RBF classifier for small sample biometric recognition. Pattern Recognit. 40(3), 3209–3224 (2007)
Nandakumar K., Chen Y., Dass S.C., Jain A.K.: Likelihood ratio-based biometric score fusion. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 342–347 (2008)
Raghavendra R., Rao A., Hemantha Kumar G.: Multimodal biometric score fusion using gaussian mixture model and monte carlo method. J. Comput. Sci. Technol. 25(4), 771–782 (2010)
Raghavendra R., Dorizzi B., Rao A., Hemantha Kumar G.: Designing efficient fusion schemes for multimodal biometric system using face and palmprint. Pattern Recognit. 44(5), 1076–1088 (2011)
Raghavendra R., Rao A., Hemantha Kumar G.: Multisensor biometric evidence fusion of face and palmprint for person authentication using particle swarm optimisation (pso). Int. J. Biometr. 2(1), 19–33 (2010)
Bishop C.: Pattern Recognition and Machine Learning. Springer, New York (2006)
McLachlan G.J., Peel D.: Finite Mixture Models. Wiley series in probability and statistics i edition, London (2000)
Kim H.C., Kim D., Bang S.Y.: Face recognition using the mixture-of-eigenfaces method. Pattern Recognit. Lett. 23, 1549–1558 (2002)
Jain A.K., Figueiredo M.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)
Stork D., Duda R., Hart P.: Pattern Classification, 2nd edn. Wiley, London (2001)
Moon H., Phillips P.J.: Computational and performance aspects of PCA-based face recognition algorithms. Perception 30, 303–321 (2001)
Lay D.C.: Linear Algebra and its Application. 3rd edn. Pearson Education, New Jersey (2006)
Bartlett M.S., Movrllan J.R., Sejnowski T.J.: Face recognition by independent component analysis. IEEE Trans. Neural Netw. 13(06), 1450–1464 (2002)
Yuen P., Lai J.H.: Face representation using independent component analysis. Pattern Recognit. 35, 1247–1257 (2002)
Bimbot F., Magrin I., Mathan L.: Second order statistical measure for text independent speaker identification. Speech Commun. 17(1-2), 177–192 (1995)
Rabimer L., Jumg B.H.: Fundamentals of Speech Recognition. Pearson Education, New Jersey (2006)
Jain, A.K., Ross, A.: Learning user-specific parameters in a multibiometric system. In: International Conference on Image processing (ICIP), pp. 22–25. Rochester, New York (2002)
Raghavendra, R., Rao, Ashok, Hemantha Kumar, G.: Qualitative weight assignment for multimodal biometric fusion. In: 7th International Conference on Advances in Pattern Recognition (ICAPR 2009), pp. 193–196. Kolkata, India (2009)
Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In Proceedings of Computer Vision and Pattern Recognition (CVPR-2005), pp. 947–954. San Diego, USA (2005)
polyU palmprint Database. www.comp.polyu.edu.hk/~biometrics/
TIMIT Speech Database. www.ldc.upenn.edu
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Raghavendra, R. Novel mixture model–based approaches for person verification using multimodal biometrics. SIViP 7, 1015–1028 (2013). https://doi.org/10.1007/s11760-012-0294-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-012-0294-4