Skip to main content
SpringerLink
Log in

Error Graph Regularized Nonnegative Matrix Factorization for Data Representation

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Nonnegative matrix factorization (NMF) has been received much attention and widely applied to data mining by various researchers. It is believed that the non-negativity constraint makes NMF to learn a parts-based representation. Nevertheless, NMF fails to exploit the intrinsic manifold structure of the data. Therefore, many graph-based NMF methods have been proposed by incorporating a similarity graph. However, graph regularized NMF and its extensions do not consider the geometric structure of the given data is well preserved. In this paper, we propose an error graph regularized nonnegative matrix factorization (EGNMF) to perform the manifold learning. Our contribution is twofold: first, we introduce an error graph regularization term to maintain the geometric structures of the original data for each iterative update; second, we adopt a weight coefficient matrix to strengthen the important and weaken the non-important structures of the low-dimensional data. Experimental results on different benchmark datasets show that EGNMF is superior to competing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. https://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php.

  2. https://murphylab.web.cmu.edu/.

References

  1. Wright J, Ma Y (2022) High-dimensional data analysis with low-dimensional models: principles, computation, and applications. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  2. Bach F (2017) Breaking the curse of dimensionality with convex neural networks. J Mach Learn Res 18(1):629–681

    MATH  Google Scholar 

  3. Ayesha S, Hanif MK, Talib R (2020) Overview and comparative study of dimensionality reduction techniques for high dimensional data. Inf Fus 59:44–58

    Article  Google Scholar 

  4. Cunningham JP, Ghahramani Z (2015) Linear dimensionality reduction: survey, insights, and generalizations. J Mach Learn Res 16(1):2859–2900

    MathSciNet  MATH  Google Scholar 

  5. Tasoulis S, Pavlidis NG, Roos T (2020) Nonlinear dimensionality reduction for clustering. Pattern Recognit 107:107508

    Article  Google Scholar 

  6. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791

    Article  MATH  Google Scholar 

  7. Fu X, Huang K, Sidiropoulos ND, Ma W-K (2019) Nonnegative matrix factorization for signal and data analytics: identifiability, algorithms, and applications. IEEE Signal Process Mag 36(2):59–80

    Article  Google Scholar 

  8. Luo M, Nie F, Chang X, Yang Y, Hauptmann AG, Zheng Q (2017) Probabilistic non-negative matrix factorization and its robust extensions for topic modeling. In: AAAI conference on artificial intelligence 2017, pp 2308–2314

  9. Shi T, Kang K, Choo J, Reddy CK (2018) Short-text topic modeling via non-negative matrix factorization enriched with local word-context correlations. In: Proceedings of the 2018 world wide web conference, pp 1105–1114

  10. Ma X, Sun P, Wang Y (2018) Graph regularized nonnegative matrix factorization for temporal link prediction in dynamic networks. Physica A-Stat Mech Appl 496:121–136

    Article  MATH  Google Scholar 

  11. Ma X, Dong D, Wang Q (2019) Community detection in multi-layer networks using joint nonnegative matrix factorization. IEEE Trans Knowl Data Eng 31(2):273–286

    Article  Google Scholar 

  12. Luo X, Liu Z, Shang M, Lou J, Zhou M (2020) Highly-accurate community detection via pointwise mutual information-incorporated symmetric non-negative matrix factorization. IEEE Trans Netw Sci Eng 8(1):463–476

    Article  MathSciNet  Google Scholar 

  13. Ailem M, Salah A, Nadif M (2017) Non-negative matrix factorization meets word embedding. In: Proceedings of the 40th international ACM Sigir conference on research and development in information retrieval, pp 1081–1084

  14. Stein-O’Brien GL, Arora R, Culhane AC, Favorov AV, Garmire LX, Greene CS, Goff LA, Li Y, Ngom A, Ochs MF, Xu Y, Fertig EJ (2018) Enter the matrix: factorization uncovers knowledge from omics. Trends Genet 34(10):790–805

    Article  Google Scholar 

  15. Xiao Q, Luo J, Liang C, Cai J, Ding P (2018) A graph regularized non-negative matrix factorization method for identifying microrna-disease associations. Bioinformatics 34(2):239–248

    Article  Google Scholar 

  16. Cai D, He X, Han J, Huang TS (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560

    Article  Google Scholar 

  17. De Handschutter P, Gillis N, Siebert X (2021) A survey on deep matrix factorizations. Comput Sci Rev 42:100423

    Article  MathSciNet  MATH  Google Scholar 

  18. Wang JJ-Y, Bensmail H, Gao X (2013) Multiple graph regularized nonnegative matrix factorization. Pattern Recogn 46(10):2840–2847

    Article  MATH  Google Scholar 

  19. Nie F, Li J, Li X (2016) Parameter-free auto-weighted multiple graph learning: a framework for multiview clustering and semi-supervised classification. In: IJCAI’16 proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 1881–1887

  20. Shu Z, Wu X, Fan H, Huang P, Wu D, Hu C, Ye F (2017) Parameter-less auto-weighted multiple graph regularized nonnegative matrix factorization for data representation. Knowl Based Syst 131:105–112

    Article  Google Scholar 

  21. Huang S, Xu Z, Kang Z, Ren Y (2020) Regularized nonnegative matrix factorization with adaptive local structure learning. Neurocomputing 382:196–209

    Article  Google Scholar 

  22. Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. In: Advances in neural information processing systems 13, vol 13, pp 556–562

  23. Wu J, Feng L, Liu S, Sun M (2017) Image retrieval framework based on texton uniform descriptor and modified manifold ranking. J Vis Commun Image Represent 49:78–88

    Article  Google Scholar 

  24. Zhao H, Zheng J, Deng W, Song Y (2020) Semi-supervised broad learning system based on manifold regularization and broad network. IEEE Trans Circuits Syst I Regul Pap 67(3):983–994

    Article  MathSciNet  MATH  Google Scholar 

  25. Cai H, Zheng VW, Chang KC-C (2018) A comprehensive survey of graph embedding: problems, techniques, and applications. IEEE Trans Knowl Data Eng 30(9):1616–1637

    Article  Google Scholar 

  26. Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in neural information processing systems 14, vol 14, pp 585–591

  27. Schiffer L, Azhar R, Shepherd L, Ramos M, Geistlinger L, Huttenhower C, Dowd JB, Segata N, Waldron L (2019) Hmp16sdata: efficient access to the human microbiome project through bioconductor. Am J Epidemiol 188(6):1023–1026

    Article  Google Scholar 

  28. Xu W, Liu X, Gong, Y (2003) Document clustering based on non-negative matrix factorization. In: Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval, pp 267–273

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China(Grant No. 62102291), the Team plan of scientific and technological innovation of outstanding youth in universities of Hubei province (Grant No. T201807), the project of department of education of Hubei province (No.B2021099).

Author information

Authors and Affiliations

  1. Hubei Provincial Engineering Research Center for Intelligent Textile and Fashion, School of Computer Science and Artificial Intelligence, Wuhan Textile University, Wuhan, China

    Qiang Zhu & Junping Liu

  2. China Mobile Limited, Beijing, China

    Meijun Zhou

Authors
  1. Qiang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Meijun Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Junping Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiang Zhu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, Q., Zhou, M. & Liu, J. Error Graph Regularized Nonnegative Matrix Factorization for Data Representation. Neural Process Lett 55, 7321–7335 (2023). https://doi.org/10.1007/s11063-023-11262-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-023-11262-9

Keywords

Search

Navigation