Abstract
Non-negative matrix factorization (NMF) is an important method of latent data representation learning. Most of the existing NMF methods focus only on one single factorization and obtain one clustering solution. However, real data are usually complex and can be described from multiple attributes or sub-features. For example, face image consists of genders attribute and expressions attribute. And, the various attributes provide complementary information of data. Failing to explore multi-attribute representation and exploit the complementary information, it may be difficult to learn discriminative representation. In order to solve the above issue and obtain richer low-dimensional representations, we propose the Attributed Non-negative Matrix Multi-Factorization for Data Representation (ANMMF) model which simultaneously learns multiple low-dimensional representations from original data. By utilizing Hilbert Schmidt Independence Criterion (HSIC) to constrain the pairwise attributes, ANMMF enforces that each low-dimensional attribute representation is independent, which effectively mines complementary multi-attribute information embed in the original data. Further, graph Laplacian regularization is constrained to maintain the local geometrical structure. The low dimensional multi-attribute representation information embedded in the original data is fused to improve the clustering results. Finally, we develop the iterative updating schemes for the ANMMF model optimization, and extensive experiments on real-world databases demonstrate that our method has the most advanced performance compared with other related algorithms.
The first author is a student.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdi, H., Williams, L.J.: Principal component analysis. Wiley Interdisc. Rev. Comput. Stats 2(4), 433–459 (2010)
Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 338, 1548–1560 (2011)
Cai, X., Nie, F., Huang, H.: Multi-view k-means clustering on big data. In: IJCAI (2013)
Dai, X., Zhang, K., Jiang, X., Zhang, X., Tu, Z., Zhang, N.: Weighted non-negative matrix factorization for image recovery and representation. In: 2020 10th ICIST, pp. 288–293. IEEE (2020)
Ding, C.H.Q., Li, T., Peng, W., Park, H.: Orthogonal nonnegative matrix tri-factorizations for clustering. In: KDD 2006, pp. 20–23 (2006)
Eggert, J., Korner, E.: Sparse coding and NMF. In: IEEE IJCNN, vol. 4, pp. 2529–2533 (2004)
Ge, S., Luo, L., Li, H.: Orthogonal incremental non-negative matrix factorization algorithm and its application in image classification. Comput. Appl. Math. 39(2), 1–16 (2020). https://doi.org/10.1007/s40314-020-1091-2
Georghiades, A.S., Belhumeur, P., Kriegman, D.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23, 643–660 (2001)
Gretton, A., Bousquet, O., Smola, A., Schölkopf, B.: Measuring statistical dependence with Hilbert-Schmidt norms. In: Jain, S., Simon, H.U., Tomita, E. (eds.) ALT 2005. LNCS (LNAI), vol. 3734, pp. 63–77. Springer, Heidelberg (2005). https://doi.org/10.1007/11564089_7
He, X., Niyogi, P.: Locality preserving projections. In: NIPS, vol. 16, no. 1, pp. 186–197 (2003)
Jia, Y., Kwong, S., Hou, J., Wu, W.: Semi-supervised non-negative matrix factorization with dissimilarity and similarity regularization. IEEE Trans. Neural Netw. Learn. Syst. 31(7), 2510–2521 (2020)
Lee, D.D., Seung, H.S.: Learning the parts of objects by nonnegative matrix factorization. Nature 401(7), 788–791 (1999)
Riffenburgh, R.H., Clunies-Ross, C.W.: Linear discriminant analysis. Pac. Sci. 3(6), 27–33 (2013)
Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000)
Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1615–1618 (2004)
Sun, J., Wang, Z., Sun, F., Li, H.: Sparse dual graph-regularized NMF for image co-clustering. Neurocomputing 316(17), 156–165 (2018)
Wang, J., Tian, F., Wang, X., Yu, H., Liu, C.H., Yang, L.: Multi-component nonnegative matrix factorization. In: IJCAI (2017)
Yang, Z., Zhang, Y., Xiang, Y., Yan, W., Xie, S.: Non-negative matrix factorization with dual constraints for image clustering. IEEE Trans. Syst. Man Cybern. Syst. 50, 2524–2533 (2020)
Acknowledgements
This research was supported by National Natural Science Foundation of China under Grant No. 61772048, U19B2039, U1811463 and 61876012. It also was supported in part by Beijing Talents Project (2017A24).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, J., Sun, Y., Guo, J., Hu, Y., Yin, B. (2021). Attributed Non-negative Matrix Multi-factorization for Data Representation. In: Ma, H., et al. Pattern Recognition and Computer Vision. PRCV 2021. Lecture Notes in Computer Science(), vol 13022. Springer, Cham. https://doi.org/10.1007/978-3-030-88013-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-88013-2_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88012-5
Online ISBN: 978-3-030-88013-2
eBook Packages: Computer ScienceComputer Science (R0)