Abstract
Deep matrix factorization methods can automatically learn the hidden representation of high dimensional data. However, they neglect the intrinsic geometric structure information of data. In this paper, we propose a Deep Semi-Nonnegative Matrix Factorization with Elastic Preserving (Deep Semi-NMF-EP) method by adding two graph regularizers in each layer. Therefore, the proposed Deep Semi-NMF-EP method effectively preserves the elasticity of data and thus can learn a better representation of high-dimensional data. In addition, we present an effective algorithm to optimize the proposed model and then provide its complexity analysis. The experimental results on the benchmark datasets show the excellent performance of our proposed method compared with other state-of-the-art methods.
Similar content being viewed by others
References
Cai W, Wei Z (2020) PiiGAN: generative adversarial networks for pluralistic image Inpainting. IEEE Access 8:48451–48463
Cai D, He X, Han J, Huang TS (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560
Carreira-Perpinán MA (2010) The elastic embedding algorithm for dimensionality reduction. Proc Int Conf Mach Learn (ICML-2010) 10:167–174
Ding CHQ, Li T, Jordan MI (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55
Gu Q, Zhou J (2009) Local learning regularized nonnegative matrix factorization. In Proc. of the 21st International Joint Conference on Artificial Intelligence (IJCAI), Pasadena, California, USA
Guo W, Hu W, Boulgouris NV et al (2013) Semi-supervised visual recognition with constrained graph regularized non negative matrix factorization. IEEE Int Conf Image Process 2743–2747.
Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791
Leng L, Zhang J (2012) Palmhash Code for palmprint verification and protection. 25th IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1–4
Leng L, Zhang J, Khan M et al (2010) Dynamic weighted discrimination power analysis: a novel approach for face and palmprint recognition in DOT domain. Int J Phys Sci 5(17):2543–2554
Leng L, Zhang S, Bi X et al (2012) Two-dimensional cancelable biometric scheme. IEEE Int Conf Wavelet Anal Pattern Recog
Leng L, Li M, Kim C, Bi X (2017) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimed Tools Appl 76(1):333–354
Li Z, Liu J, Lu H (2013) Structure preserving non-negative matrix factorization for dimensionality reduction. Comput Vis Image Underst 117:1175–1189
Li G, Zhang X, Zheng S et al (2016) Semi-supervised convex nonnegative matrix factorizations with graph regularized for image representation. Neurocomputing 237(C):1–11
Liu H, Wu Z, Cai D et al (2012) Constrained connegative matrix factorization for image representation. IEEE Trans Pattern Anal Mach Intell 34(7):1299–1311
Liu H, Yang G, Wu Z, Cai D (2014) Constrained concept factorization for image representation. IEEE Trans Cybern 44:1214–1224
Liu Y, Liao Y, Tang L, Tang F, Liu W (2016) General subspace constrained non-negative matrix factorization for data representation. Neurocomputing 173(P2):224–232
Shu Z, Zhao C, Huang P (2015) Local regularization concept factorization and its semi-supervised extension for image representation. Neurocomputing 158:1–12
Shu Z, Zhou J, Huang P et al (2016) Local and global regularized sparse coding for data representation. Neurocomputing 198(29):188–197
Shu Z, Fan H, Huang P, Wu D, Ye F, Wu X (2017) Multiple Laplacian graph regularized low rank representation with application to image representation. IET Image Process 11(6):370–378
Trigeorgis G, Bousmalis K, Zafeiriou S, Schuller B (2017) A deep matrix factorization method for learning attribute representations. IEEE Trans Pattern Anal Mach Intell 39(3):417–429
Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86
Wang X, Zhang Y (2013) Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng 25:1336–1353
Wang Z, Zou C, Cai W (2020) Small sample classification of Hyperspectral remote sensing images based on sequential joint Deeping learning model. IEEE Access 8:71353–71363
You H, Tian S, Yu L, Lv Y (2020) Pixel-level remote sensing image recognition based on bidirectional word vectors. IEEE Trans Geosci Remote Sens 58(2):1281–1293
Zhao H, Ding Z, Fu Y (2017) Multi-view clustering via deep matrix factorization. The Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-2017), 2921–2927
Acknowledgments
This work was supported by the National Natural Science Foundation of China [Grant No. 61603159, 61672265], Natural Science Foundation of Jiangsu Province [Grant No. BK20160293], China Postdoctoral Science Foundation [Grant No. 2017 M611695] and Jiangsu Province Postdoctoral Science Foundation [Grant No. 1701094B].
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Shu, Zq., Wu, Xj., Hu, C. et al. Deep semi-nonnegative matrix factorization with elastic preserving for data representation. Multimed Tools Appl 80, 1707–1724 (2021). https://doi.org/10.1007/s11042-020-09766-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09766-w