Skip to main content
Log in

Novel mixture model–based approaches for person verification using multimodal biometrics

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

With growing concerns about security, the world over, biometric-based person verification is gaining more and more attention. Recently, multimodal biometric has attracted increasing focus among researchers as this overwhelms many limitations of unimodal biometric systems and hence more reliable. In this paper, we propose four different feature extraction techniques namely Principle Component Analysis Mixture Model (PCA MM), Singular Value Decomposition Mixture Model (SVD MM), Independent Component Analysis I Mixture Model (ICA I MM), and Independent Component Analysis II Mixture Model (ICA II MM) to design a multimodal biometric system at feature level. The proposed methods begin with modeling the multimodal biometrics data using Gaussian Mixture Model followed by a subspace methods like PCA, SVD, ICA I, and ICA II. Extensive experiments are carried out to observe the verification performance of the proposed methods at feature and match score level on large dataset of 150 users. We compare the results of the combined biometric with the results of individual biometric and also results of the proposed schemes against conventional (without mixture model) subspace approaches. The experimental results demonstrate the effectiveness of the proposed methods in designing a robust multimodal biometric system for accurate person verification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ross A., Nandakumar K., Jain A.K.: Handbook of Multibiometrics. Springer, New York (2006)

    Google Scholar 

  2. Jain A.K., Ross A., Prabhakar S.: An introduction to biometric recognition. In: IEEE Trans. Circuits Syst. Video Technol. 14, 4–20 (2004)

    Article  Google Scholar 

  3. Hong, L., Jain, A.K., Prabhakar, S.: Can multibiometrics improve performance. In: Proceedings AutoID’99, Summit(NJ), pp. 59–64. USA (1999)

  4. Brunelli R., Falavigna D.: Person identification using multiple cues. In: IEEE Trans. Pattern Anal. Mach. Intell. 10, 955–965 (1995)

    Article  Google Scholar 

  5. Kittler J., Hatef M., Duin R.P.W., Matas J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20, 226–239 (1998)

    Article  Google Scholar 

  6. Ben-Yacoub S., Abdeljaoued Y., Mayoraz E.: Fusion of face and speech data for person identity verification. IEEE Trans. Neural Netw. 10, 1065–1074 (1999)

    Article  Google Scholar 

  7. Ross A., Jain A.K.: Information fusion in biometrics. Pattern Recognit. Lett. 24(13), 2115–2125 (2003)

    Article  Google Scholar 

  8. Jain, A.K., Hong, L., Kulkarni, Y.: A multimodal biometric system using fingerprint, face, and speech. In: International Conference on Audio and Video based Biometric Person Authentication, pp. 182–187. Washington D.C., USA (1999)

  9. Li, Q., Qiu, Z., Sun, D., Zhang, Y.: Subspace framework for feature-level fusion with its application to handmetric verification. In: The 8th International Conference on Signal Processing, pp. 16–20 (2006)

  10. Feng, G., Dong, K., Hu, D., Zhang, D.: When faces are combined with palmprints:a novel biometric fusion strategy. In: First International Conference on Biometric Authentication (ICBA), pp. 701–707 (2004)

  11. Jing X.Y., Yao Y.F., Yang J.Y., Li M., Zhang D.: Face and palmprint pixel level fusion and kernel DCV-RBF classifier for small sample biometric recognition. Pattern Recognit. 40(3), 3209–3224 (2007)

    Article  MATH  Google Scholar 

  12. Nandakumar K., Chen Y., Dass S.C., Jain A.K.: Likelihood ratio-based biometric score fusion. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 342–347 (2008)

    Article  Google Scholar 

  13. Raghavendra R., Rao A., Hemantha Kumar G.: Multimodal biometric score fusion using gaussian mixture model and monte carlo method. J. Comput. Sci. Technol. 25(4), 771–782 (2010)

    Article  Google Scholar 

  14. Raghavendra R., Dorizzi B., Rao A., Hemantha Kumar G.: Designing efficient fusion schemes for multimodal biometric system using face and palmprint. Pattern Recognit. 44(5), 1076–1088 (2011)

    Article  MATH  Google Scholar 

  15. Raghavendra R., Rao A., Hemantha Kumar G.: Multisensor biometric evidence fusion of face and palmprint for person authentication using particle swarm optimisation (pso). Int. J. Biometr. 2(1), 19–33 (2010)

    Article  Google Scholar 

  16. Bishop C.: Pattern Recognition and Machine Learning. Springer, New York (2006)

    MATH  Google Scholar 

  17. McLachlan G.J., Peel D.: Finite Mixture Models. Wiley series in probability and statistics i edition, London (2000)

    Book  MATH  Google Scholar 

  18. Kim H.C., Kim D., Bang S.Y.: Face recognition using the mixture-of-eigenfaces method. Pattern Recognit. Lett. 23, 1549–1558 (2002)

    Article  MATH  Google Scholar 

  19. Jain A.K., Figueiredo M.: Unsupervised learning of finite mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 381–396 (2002)

    Article  Google Scholar 

  20. Stork D., Duda R., Hart P.: Pattern Classification, 2nd edn. Wiley, London (2001)

    MATH  Google Scholar 

  21. Moon H., Phillips P.J.: Computational and performance aspects of PCA-based face recognition algorithms. Perception 30, 303–321 (2001)

    Article  Google Scholar 

  22. Lay D.C.: Linear Algebra and its Application. 3rd edn. Pearson Education, New Jersey (2006)

    Google Scholar 

  23. Bartlett M.S., Movrllan J.R., Sejnowski T.J.: Face recognition by independent component analysis. IEEE Trans. Neural Netw. 13(06), 1450–1464 (2002)

    Article  Google Scholar 

  24. Yuen P., Lai J.H.: Face representation using independent component analysis. Pattern Recognit. 35, 1247–1257 (2002)

    Article  MATH  Google Scholar 

  25. Bimbot F., Magrin I., Mathan L.: Second order statistical measure for text independent speaker identification. Speech Commun. 17(1-2), 177–192 (1995)

    Article  Google Scholar 

  26. Rabimer L., Jumg B.H.: Fundamentals of Speech Recognition. Pearson Education, New Jersey (2006)

    Google Scholar 

  27. Jain, A.K., Ross, A.: Learning user-specific parameters in a multibiometric system. In: International Conference on Image processing (ICIP), pp. 22–25. Rochester, New York (2002)

  28. Raghavendra, R., Rao, Ashok, Hemantha Kumar, G.: Qualitative weight assignment for multimodal biometric fusion. In: 7th International Conference on Advances in Pattern Recognition (ICAPR 2009), pp. 193–196. Kolkata, India (2009)

  29. Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In Proceedings of Computer Vision and Pattern Recognition (CVPR-2005), pp. 947–954. San Diego, USA (2005)

  30. polyU palmprint Database. www.comp.polyu.edu.hk/~biometrics/

  31. TIMIT Speech Database. www.ldc.upenn.edu

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Raghavendra.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Raghavendra, R. Novel mixture model–based approaches for person verification using multimodal biometrics. SIViP 7, 1015–1028 (2013). https://doi.org/10.1007/s11760-012-0294-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0294-4

Keywords

Navigation