Skip to main content

Least-Squares Regulation Based Graph Embedding

  • Conference paper
  • First Online:
  • 2729 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10735))

Abstract

A large family of algorithms named graph embedding is widely accepted as an effective technique designed to provide better solutions to the problem of dimensionality reduction. Existing graph embedding algorithms mainly consider obtaining projection directions through preserving local geometrical structure of data. In this paper, a regulation formulation known as Least-Squares Reconstruction Errors, to unify various graph embedding methods within a common regulation framework for preserving both local and global structures, is proposed. With its properties of Least-Squares regulation, orthogonality constraint to data distributions and tensor extensions of supervised or semi-supervised scenarios, this common regulation framework makes a tradeoff between intrinsic geometrical structure and the global structure. Our experiments demonstrated that, our proposed method have better performances in keeping lower dimensional subspaces and higher classification results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   155.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.cad.zju.edu.cn/home/dengcai/Data/MLData.html.

  2. 2.

    http://www.cs.nyu.edu/~roweis/data.html.

References

  1. Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: a review. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 4–37 (2000)

    Article  Google Scholar 

  2. Yang, J., Zhang, D., Yang, J.Y.: Constructing PCA baseline algorithms to reevaluate ICA-based face-recognition performance. IEEE Trans. Syst. Man Cybern. Part B (Cybernatics) 37(4), 1015–1021 (2007)

    Article  Google Scholar 

  3. Zuo, W., Zhang, D., Yang, J., Wang, K.: BDPCA plus LDA: a novel fast feature extraction technique for face recognition. IEEE Trans. Syst. Man Cybern. Part B (Cybernatics) 36(4), 946–953 (2006)

    Article  Google Scholar 

  4. Cai, D., He, X., Zhou, K., Han, J., Bao, H.: Locality sensitive discriminant analysis. IJCAI 2007, 1713–1726 (2007)

    Google Scholar 

  5. He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.J.: Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)

    Article  Google Scholar 

  6. Lu, J., Tan, Y.P.: Regularized locality preserving projections and its extensions for face recognition. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 40(3), 958–963 (2010)

    Article  MathSciNet  Google Scholar 

  7. He, X., Cai, D., Yan, S., Zhang, H.: Neighborhood preserving embedding. In: ICCV, pp. 1208–1213 (2005)

    Google Scholar 

  8. Qiao, L., Chen, S., Tan, X.: Sparsity preserving projections with applications to face recognition. Pattern Recogn. 43(1), 331–341 (2010)

    Article  Google Scholar 

  9. Luo, B., Wilson, R.C., Hancock, E.R.: Spectral embedding of graphs. Pattern Recogn. 36(10), 2213–2230 (2003)

    Article  Google Scholar 

  10. Tao, L., Ip, H.H., Wang, Y., Shu, X.: Low rank approximation with sparse integration of multiple manifolds for data representation. Appl. Intell. 42(3), 430–446 (2015)

    Article  Google Scholar 

  11. Zhang, T., Tao, D., Li, X., Yang, J.: Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 21(9), 1299–1313 (2009)

    Article  Google Scholar 

  12. la Torre, F.D.: A least-squares framework for component analysis. IEEE Trans. Pattern Anal. Mach. Intell. 34(6), 1041–1055 (2012)

    Article  Google Scholar 

  13. Schölkopf, B., Burges, C.J.: Advances in Kernel Methods: Support Vector Learning. MIT press, Cambridge (1999)

    MATH  Google Scholar 

  14. Li, J.B., Gao, H.: Sparse data-dependent kernel principal component analysis based on least squares support vector machine for feature extraction and recognition. Neural Comput. Appl. 21(8), 1971–1980 (2012)

    Article  Google Scholar 

  15. Mika, S., Ratsch, G., Weston, J., Scholkopf, B., Mullers, K.R.: Fisher discriminant analysis with kernels. In: Neural Networks for Signal Processing IX, pp. 41–48 (1999)

    Google Scholar 

  16. Zhang, B., Qiao, Y.: Face recognition based on gradient gabor feature and efficient kernel fisher analysis. Neural Comput. Appl. 19(4), 617–623 (2010)

    Article  Google Scholar 

  17. Li, J.B., Pan, J.S., Chu, S.C.: Kernel class-wise locality preserving projection. Inf. Sci. 178(7), 1825–1835 (2008)

    Article  Google Scholar 

  18. Wang, Z., Sun, X.: Face recognition using kernel-based NPE. In: 2008 International Conference on Computer Science and Software Engineering, pp. 802–805 (2008)

    Google Scholar 

  19. Bengio, Y., Paiement, J.F., Vincent, P., Delalleau, O., Roux, N.L., Ouimet, M.: Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and spectral clustering. Adv. Neural Inf. Process. Syst. 16, 177–184 (2004)

    Google Scholar 

Download references

Acknowledgments

This work was funded in part by the National Natural Science Foundation of China (No. 61572240), and the Open Project Program of the National Laboratory of Pattern Recognition (NLPR) (No. 201600005).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Si-Xing Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, SX., Abeo, T.A., Shen, XJ. (2018). Least-Squares Regulation Based Graph Embedding. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_50

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77380-3_50

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77379-7

  • Online ISBN: 978-3-319-77380-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics