Abstract
In this paper, we will introduce three frameworks for multimodal biometric using sparse representation based classification (SRC), which has been successfully used in many classification tasks recently. The first framework is multimodal SRC at match score level (MSRC_s), in which feature of each modality is sparsely coded independently, and then their representation fidelities are used as match scores for multimodal classification. The other two frameworks are multimodal SRC at feature level (MSRC_f1, MSRC_f2), where features of all modalities are first fused and then classified by using SRC. The difference between them is that MSRC_f1 fuses the features to form a unique multimodal feature vector, while MSRC_f2 implicitly combines the features in an iterative joint sparse coding process. As a typical application, the fusion of face and ear for human identification is investigated by using the three frameworks. In our experiments, Principal Component Analysis (PCA) based feature extraction is applied. Many results demonstrate that the proposed multimodal methods are significantly better than the multimodal recognition using common classifiers. Among the SRC based methods, MSRC_s gets the top recognition accuracy in almost all the test items, which might benefit from allowing sparse coding independence for different modalities.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Candes, E.: Compressive sampling. Proc. Int’l Congress of Mathematicians (2006)
Wright, J., Yang, A., Ganesh, A., Sastry, S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)
Li, S., Lu, J.: Face recognition using the nearest feature line method. IEEE Trans. Neural Netw. 10(2), 439–443 (1999)
Watanabe, S., Lambert, P., Kulikowski, C., et al.: Evaluation and selection of variables in pattern recognition. In: Computer and Information Science II. Academic, New York (1967)
Liu, Y., Ge, S., Li, C., You, Z.: k-NS: a classifier by the distance to the nearest subspace. IEEE Trans. Neural Netw. 22(8), 1256–1268 (2011)
Yang, M., Zhang, L., Yang, J., Zhang, D.: Regularized robust coding for face recognition. arXiv: 1202.4207v2 [cs.CV] (2012)
Yuan, X., Yan, S.: Visual classification with multi-task joint sparse representation. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 3493–3500 (2010)
Zhang, H., Nasrabadi, N., Zhang, Y., Huang, T.: Joint dynamic sparse representation for multi-view face recognition. Pattern Recognition 45(4), 1290–1298 (2012)
Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)
Abate, A., Nappi, M., Riccio, D.: RBS: a robust bimodal system for face recognition. International Journal of Software Engineering and Knowledge Engineering 17(4), 497–513 (2007)
Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Analysis and Machine Intelligence 23(6), 643–660 (2001)
Martinez, A., Benavente, R.: The AR face database, CVC Technical Report, No. 24 (1998)
University of Science & Technology Beijing (USTB), http://www1.ustb.edu.cn/resb/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Huang, Z., Liu, Y., Huang, R., Yang, M. (2013). Frameworks for Multimodal Biometric Using Sparse Coding. In: Yang, J., Fang, F., Sun, C. (eds) Intelligent Science and Intelligent Data Engineering. IScIDE 2012. Lecture Notes in Computer Science, vol 7751. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36669-7_53
Download citation
DOI: https://doi.org/10.1007/978-3-642-36669-7_53
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36668-0
Online ISBN: 978-3-642-36669-7
eBook Packages: Computer ScienceComputer Science (R0)