Abstract
In existing Linear Discriminant Analysis (LDA) models, the class population mean is always estimated by the class sample average. In small sample size problems, such as face and palm recognition, however, the class sample average does not suffice to provide an accurate estimate of the class population mean based on a few of the given samples, particularly when there are outliers in the training set. To overcome this weakness, the class median vector is used to estimate the class population mean in LDA modeling. The class median vector has two advantages over the class sample average: (1) the class median (image) vector preserves useful details in the sample images, and (2) the class median vector is robust to outliers that exist in the training sample set. In addition, a weighting mechanism is adopted to refine the characterization of the within-class scatter so as to further improve the robustness of the proposed model. The proposed Median Fisher Discriminator (MFD) method was evaluated using the Yale and the AR face image databases and the PolyU (Polytechnic University) palmprint database. The experimental results demonstrated the robustness and effectiveness of the proposed method.
Similar content being viewed by others
References
Webb A. Statistical Pattern Recognition. London: Hodder Arnold, 1999
Turk M, Pentland A. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 1991, 3(1): 71–86
Lu G, Zhang D, Wang K. Palmprint recognition using eigenpalms features. Pattern Recognition Letters, 2003, 24(9–10): 1463–1467
Liu K, Cheng Y-Q, Yang J-Y, et al. An efficient algorithm for Foley-Sammon optimal set of discriminant vectors by algebraic method. International Journal of Pattern Recognition and Artificial Intelligence, 1992, 6(5): 817–829
Swets D L, Weng J. Using discriminant eigenfeatures for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(8): 831–836
Belhumeur P N, Hespanha J P, Kriengman D J. Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711–720
Chen L F, Liao H-YM, Lin J C, et al. A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition, 2000, 33(10): 1713–1726
Jin Z, Yang J Y, Hu Z S, et al. Face recognition based on uncorrelated discriminant transformation. Pattern Recognition, 2001, 34(7): 1405–1416
Yu H, Yang J. A direct LDA algorithm for high-dimensional data—with application to face recognition. Pattern Recognition, 2001, 34(10): 2067–2070
Yang J, Yang J Y, Why can LDA be performed in PCA transformed space? Pattern Recognition, 2003, 36(2): 563–566
Liu C J, Wechsler H. Robust coding schemes for indexing and retrieval from large face databases. IEEE Transactions on Image Processing, 2000, 9(1): 132–137
Kim T-K, Kittler J. Locally linear discriminant analysis technique for multi-modally distributed classes for face recognition with a single model image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(3): 318–327
Wu X, Zhang D, Wang K. Fisherpalms based palmprint recognition. Pattern Recognition Letters, 2003, 24(15): 2829–2838
Yang M H. Kernel eigenfaces vs. kernel fisherfaces: face recognition using kernel methods. In: Proceed-ings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition. Washington D. C., 2002: 215–220
Lu J, Plataniotis K N, Venetsanopoulos A N. Face recognition using kernel direct discriminant analysis algorithms. IEEE Transactions on Neural Networks, 2003, 14(1): 117–126
Yang J, Frangi A, Yang J Y, et al. KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(2): 230–244
Loog M, Duin R P W, Haeb-Umbach R. Multiclass linear dimension reduction by weighted pairwise Fisher criteria. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(7): 762–766
Koren Y, Carmel L. Robust linear dimensionality reduction, IEEE Transactions on Visualization and Computer Graphics, 2004, 10(4): 459–470
He X, Yan S, Hu Y, et al. Face recognition using Laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(3): 328–340
Kwak K-C, Pedrycz W. Face recognition using a fuzzy fisherface classifier. Pattern Recognition, 2005, 38(10): 1717–1732
Fidler S, Skocaj D, Leonardis A. Combining reconstructive and discriminative subspace methods for robust classification and regression by subsampling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(3): 328–340
Chen S C, Liu J, Zhou Z-H, Making FLDA applicable to face recognition with one sample per person. Pattern Recognition, 2004, 37(7): 1553–1555
Huang J, Yuen P C, Chen W S, et al. Component-based LDA method for face recognition with one training sample. AMFG (Analysis and Modeling of Faces and Gestures), 2003, 120–126
Hawkins D M, McLachlan G J. High-Breakdown linear discriminant analysis. Journal of the American Statistical Association, 1997, 92: 136–143
He X, Fung W K. High breakdown estimation for multiple populations with applications to discriminant analysis. Journal of Multivariate Analysis, 2000, 72(2): 151–162
Hubert M, Driessen K V. Fast and robust discriminant analysis. Computational Statistics and Data Analysis, 2003, 45: 301–320
Croux C, Dehon C. Robust linear discriminant analysis using S-estimators. Canadian Journal of Statistics, 2001, 29: 473–493
Croux C, Dehon C, Rousseeuw P J, et al. Robust estimation of the conditional median function at elliptical models. Statistics & Probability Letters, 2001, 51: 361–368
Rousseeuw P S, Driessen K V. A fast algorithm for the minimum covariance determinant estimator. Technometrics, 1999 (41): 212–223
Grimmett G R, Stirzaker D R. Probability and Random Processes. 2nd ed. Oxford: Clarendon Press, 1992
Wikipedia. The free encyclopedia. http://en.wikipedia.org/wiki/Median
Marion A. An Introduction to Image Processing. London: Chapman and Hall, 1991
Yale face database. http://cvc.yale.edu/projects/yalefaces/yalefaces.html
Martinez A M, Benavente R. The AR face database. http://rvl1.ecn.purdue.edu/,aleix/aleix_face_DB.html
Martinez A M, Benavente R. The AR face database. Computer Vision Center Technical Report #24, 1998
Zhang D D. Palmprint Authentication. Berlin: Springer, 2004
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, J., Yang, J. & Zhang, D. Median Fisher Discriminator: a robust feature extraction method with applications to biometrics. Front. Comput. Sci. China 2, 295–305 (2008). https://doi.org/10.1007/s11704-008-0029-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11704-008-0029-4