Abstract
Existing supervised and semi-supervised dimensionality reduction methods utilize training data only with class labels being associated to the data samples for classification. In this paper, we present a new algorithm called locality preserving and global discriminant projection with prior information (LPGDP) for dimensionality reduction and classification, by considering both the manifold structure and the prior information, where the prior information includes not only the class label but also the misclassification of marginal samples. In the LPGDP algorithm, the overlap among the class-specific manifolds is discriminated by a global class graph, and a locality preserving criterion is employed to obtain the projections that best preserve the within-class local structures. The feasibility of the LPGDP algorithm has been evaluated in face recognition, object categorization and handwritten Chinese character recognition experiments. Experiment results show the superior performance of data modeling and classification to other techniques, such as linear discriminant analysis, locality preserving projection, discriminant locality preserving projection and marginal Fisher analysis.
Similar content being viewed by others
References
Belhumeour P., Hespanha J., Kriegman D.: Eigenfaces vs fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)
Belkin, M., Niyogi, P.: Laplacian eigenmaps and spectral tech- niques for embedding and clustering. In: Proceedings of NIPS’ 0115 (2001)
Cai D., He X., Hu Y., Han J., Zhang H.: Orthogonal laplacianfaces for face recognition. IEEE Trans. Image Processing 15(11), 3608–3614 (2006)
Chen, H.T., Chang, H.W., Liu, T.L.: Local discriminant embedding and its variants. In: Proceedings of CVPR’05 (2005)
Deng W., Hu J., Guo J., Zhang H.G.: Comments on\globally maximizing, locally minimizing: unsupervised discriminant projection with application to face and palm biometrics. IEEE Trans Pattern Anal. Mach. Intell. 30(8), 1503–1504 (2008)
Fukunaga K., Mantock J.M.: Nonparametric discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 5(6), 671–678 (1983)
Geng X., Zhan D., Zhou Z.H.: Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Trans Syst. Man Cybernet. 35(6), 1098–1107 (2005)
He X., Yan S., Hu Y., Niyogi P., Zhang H.J.: Face recognition using laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)
He X., Cai D., Han J.W.: Learning a maximum margin subspace for image retrieval. IEEE Trans. Knowl. Data Eng. 20(2), 189–201 (2008)
Hu, J., Deng, W., Guo, J., Xu, W.: Locality discriminant indexing for document classification. In: Proceedings of ACM SIGIR’07, pp. 689–690 (2007)
Roth D., Yang M.H., Ahuja N.: Learning to recognize three-dimensional objects. Neural Comput. 14, 1071–1103 (2002)
Roweis S., Saul L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(22), 2323–2326 (2000)
Sim T., Baker S., Bsat M.: The cmu pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2003)
Tenenbaum J., de Silva V., Langford J.: A global geometric framework for nonlinear dimensionality reduction. Science 290(22), 2319–2323 (2000)
Vasconcelos, N., Ho, P., Moreno, P.: The Kullback–Leibler kernel as a framework for discriminant and localized representations for visual recognition. In: Proceedings of Eighth European Conference on Computer Vision, vol. III, pp. 430–441(2004)
Vlassis N., Motomura Y., Krose B.: Supervised dimension reduction of intrinsically low dimensional data. Neural Comput. 14(1), 191–215 (2002)
Yan S.C., Xu D., Zhang B.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40–51 (2007)
Yang J., Zhang D., Yang J.Y., Niu B.: Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 650–664 (2007)
Yu W.W., Teng X., Liu C.Q.: Face recognition using discriminant locality preserving projections. Image Vis. Comput. 24, 239–248 (2006)
Zhang, H.-G., Yang, J., Deng, W.H., Guo, J.: Handwritten Chinese character recognition using local discriminant projection with prior information. In: Proceedings of IEEE International Conference on Pattern Recognition (ICPR’08), Florida (2008)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, H., Deng, W., Guo, J. et al. Locality preserving and global discriminant projection with prior information. Machine Vision and Applications 21, 577–585 (2010). https://doi.org/10.1007/s00138-009-0213-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-009-0213-z