Abstract
A novel nonlinear discriminant analysis method, Kernelized Decision Boundary Analysis (KDBA), is proposed in our paper, whose Decision Boundary feature vectors are the normal vector of the optimal Decision Boundary in terms of the Structure Risk Minimization principle. We also use a simple method to prove a property of Support Vector Machine (SVM) algorithm, which is combined with the optimal Decision Boundary Feature matrix to make our method consistent with the Kernel Fisher method(KFD). Moreover, KDBA is easily used in its applications, and the traditional Decision Boundary Analysis implementations are computationally expensive and sensitive to the size of the problem. Text classification problem is first used to testify the effectiveness of KDBA. Then experiments on the large-scale face database, the CAS-PEAL database, have illustrated its excellent performance compared with some popular face recognition methods such as Eigenface, Fisherface, and KFD.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Scholkopf, B., Smola, A., Muller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10, 1299–1319 (1998)
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., Muller, K.R.: Fisher discriminant analysis with kernels. In: IEEE International Workshop on Neural Networks for Signal Processing, pp. 41–48 (1999)
Baudat, G., Anouar, F.: Generalized discriminant analysis using a kernel approach. Neural Computation 12(10), 2385–2404 (2000)
Alejandro, J. y.: A new Kernel fisher discriminant algorithm with application to face recognition. Letters of Neurocomputinting (2003)
Hong, Z., Yang, J.: Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern recognition 24(4), 317–324 (1991)
Fukunaga, K., Mantock, J.M.: nonparametric Discriminant Analysis. PAMI 5(6), 671–678 (1983)
Fransens, R., Prins, J.D.: SVM-based Nonparametric Discriminant Analysis, An application to Face Detection. In: ICCV 2003 (2003)
Lee, C., Langrebe, D.D.: Feature Extraction Based on Decision Boundaries. PAMI 15(4), 388–400 (1993)
Liu, Q., Huang, R.: Face Recognition Using Kernel Based Fisher Discriminant Analysis. In: The 5th International Conference on Automatic Face and Gesture Recognition, pp. 187–191 (2002)
Liu, W., Wang, Y.: Null space based Kernel Fisher Discriminant analysis for face recognition. In: The 6th International Conference on Automatic Face and Gesture Recognition (2004)
Burges, C.J.C.: “A tutorial on support vector machines for pattern recognition. Knowledge Discovery and Data Mining 2, 121–167 (1998)
Guo, G., Li, S.Z., Kapluk, C.: Face recognition by support vector machines. Image and Vision Computing 19, 631–638 (2001)
Tefas, A., Kotropoulos, C., Pitas, L.: Using Support Vector Machines to Enhance the Perfornance of Elastic Graph Matching for Frontal Face Authentication. IEEE Trans. on PAMI 23(7), 735–746 (2001)
Gao, W., Cao, B., Shan, S.: The CAS-PEAL Large-Scale Face Database and Evaluation Protocols, Technical Report No. JDL_TR_04_FR_001, JDL, CAS (2004)
Liu, C., Wechsler, H.: Enhanced Fisher Linear Discriminant Models for face Recognition. In: 14th International Conference on Pattern Recognition, vol. 2, pp. 1368–1372 (1998)
Liu, C., Wechsler, H.: Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition. IEEE Trans. Image Processing 11(4), 467–476 (2002)
Zhang, B., Gao, W., Shan, S., Peng, Y.: Discriminant Gaborfaces and Support Vector Machines Classifier for Face Recognition. In: Asian Conference on Computer Vision, pp. 37–42 (2004)
Li, S.Z., Jain, A.K. (eds.): Handbook of Face Recognition. Springer, Heidelberg (2004) (to be published)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, B., Chen, X., Gao, W. (2005). Discriminant Analysis Based on Kernelized Decision Boundary for Face Recognition. In: Kanade, T., Jain, A., Ratha, N.K. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2005. Lecture Notes in Computer Science, vol 3546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527923_101
Download citation
DOI: https://doi.org/10.1007/11527923_101
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27887-0
Online ISBN: 978-3-540-31638-1
eBook Packages: Computer ScienceComputer Science (R0)