Abstract
A large family of algorithms named graph embedding is widely accepted as an effective technique designed to provide better solutions to the problem of dimensionality reduction. Existing graph embedding algorithms mainly consider obtaining projection directions through preserving local geometrical structure of data. In this paper, a regulation formulation known as Least-Squares Reconstruction Errors, to unify various graph embedding methods within a common regulation framework for preserving both local and global structures, is proposed. With its properties of Least-Squares regulation, orthogonality constraint to data distributions and tensor extensions of supervised or semi-supervised scenarios, this common regulation framework makes a tradeoff between intrinsic geometrical structure and the global structure. Our experiments demonstrated that, our proposed method have better performances in keeping lower dimensional subspaces and higher classification results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 4–37 (2000)
Yang, J., Zhang, D., Yang, J.Y.: Constructing PCA baseline algorithms to reevaluate ICA-based face-recognition performance. IEEE Trans. Syst. Man Cybern. Part B (Cybernatics) 37(4), 1015–1021 (2007)
Zuo, W., Zhang, D., Yang, J., Wang, K.: BDPCA plus LDA: a novel fast feature extraction technique for face recognition. IEEE Trans. Syst. Man Cybern. Part B (Cybernatics) 36(4), 946–953 (2006)
Cai, D., He, X., Zhou, K., Han, J., Bao, H.: Locality sensitive discriminant analysis. IJCAI 2007, 1713–1726 (2007)
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.J.: Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)
Lu, J., Tan, Y.P.: Regularized locality preserving projections and its extensions for face recognition. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 40(3), 958–963 (2010)
He, X., Cai, D., Yan, S., Zhang, H.: Neighborhood preserving embedding. In: ICCV, pp. 1208–1213 (2005)
Qiao, L., Chen, S., Tan, X.: Sparsity preserving projections with applications to face recognition. Pattern Recogn. 43(1), 331–341 (2010)
Luo, B., Wilson, R.C., Hancock, E.R.: Spectral embedding of graphs. Pattern Recogn. 36(10), 2213–2230 (2003)
Tao, L., Ip, H.H., Wang, Y., Shu, X.: Low rank approximation with sparse integration of multiple manifolds for data representation. Appl. Intell. 42(3), 430–446 (2015)
Zhang, T., Tao, D., Li, X., Yang, J.: Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 21(9), 1299–1313 (2009)
la Torre, F.D.: A least-squares framework for component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 34(6), 1041–1055 (2012)
Schölkopf, B., Burges, C.J.: Advances in Kernel Methods: Support Vector Learning. MIT press, Cambridge (1999)
Li, J.B., Gao, H.: Sparse data-dependent kernel principal component analysis based on least squares support vector machine for feature extraction and recognition. Neural Comput. Appl. 21(8), 1971–1980 (2012)
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., Mullers, K.R.: Fisher discriminant analysis with kernels. In: Neural Networks for Signal Processing IX, pp. 41–48 (1999)
Zhang, B., Qiao, Y.: Face recognition based on gradient gabor feature and efficient kernel fisher analysis. Neural Comput. Appl. 19(4), 617–623 (2010)
Li, J.B., Pan, J.S., Chu, S.C.: Kernel class-wise locality preserving projection. Inf. Sci. 178(7), 1825–1835 (2008)
Wang, Z., Sun, X.: Face recognition using kernel-based NPE. In: 2008 International Conference on Computer Science and Software Engineering, pp. 802–805 (2008)
Bengio, Y., Paiement, J.F., Vincent, P., Delalleau, O., Roux, N.L., Ouimet, M.: Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and spectral clustering. Adv. Neural Inf. Process. Syst. 16, 177–184 (2004)
Acknowledgments
This work was funded in part by the National Natural Science Foundation of China (No. 61572240), and the Open Project Program of the National Laboratory of Pattern Recognition (NLPR) (No. 201600005).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Liu, SX., Abeo, T.A., Shen, XJ. (2018). Least-Squares Regulation Based Graph Embedding. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_50
Download citation
DOI: https://doi.org/10.1007/978-3-319-77380-3_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77379-7
Online ISBN: 978-3-319-77380-3
eBook Packages: Computer ScienceComputer Science (R0)