Abstract
Nonnegative matrix factorization (NMF) is a powerful method of data dimension reduction and has been widely used in face recognition. However, existing NMF algorithms have two main drawbacks. One is that the speed is too slow for large matrix factorization. The other is that it must conduct repetitive learning when the training samples or classes are incremental. In order to overcome these two limitations and improve the sparseness of the data after factorization, this paper presents a novel algorithm, which is called incremental nonnegative matrix factorization with sparseness constraint. By using the results of previous factorization involved in iterative computation with sparseness constraint, the cost of computation is reduced and the sparseness of data after factorization is greatly improved. Compared with NMF and INMF, the experimental results on some face databases have shown that the proposed method achieves superior results.
Supported by the National Natural Science Foundation of China (NSFC) under Grants 61572244, 61472059 and 61772108.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Hong, R.C., Hu, Z., Wang, R., Wang, M., Tao, D.: Multi-view object retrieval via multi-scale topic models. IEEE Trans. Image Process. 12(25), 5814–5827 (2016)
Liu, C.Y., He, L., Li, Z.T., Li, J.: Feature-driven active learning for hyperspectral image classification. IEEE Trans. Geosc. Remote Sens. 1(56), 341–354 (2018)
Hong, R.C., Zhang, L., Zhang, C., Zimmermann, R.: Flickr circles: aesthetic tendency discovery by multi-view regularized topic modeling. IEEE Trans. Multimedia 8(18), 1555–1567 (2016)
Li, Z.T., Jiao, Y.F., Yang, X.S., Zhang, T.Z., Huang, S.C.: 3D attention-based deep ranking model for video highlight detection. IEEE Trans. Multimedia PP(99), 1–13 (2018)
Liu, J.W., Zha, Z.J., Chen, X.J., Wang, Z.L., Zhang, Y.D.: Dense 3D-convolutional neural network for person re-identification in videos. ACM Trans. Multimedia Comput. Commun. Appl. 4s(14) (2018)
Tang, J.H., Shu, X., Qi, G.J., Wang, M., Yan, S., Jain, R.: Tri-clustered tensor completion for social-aware image tag refinement. IEEE Trans. Pattern Anal. Mach. Intell. 8(39), 1662–1674 (2017)
Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: 14th Neural Information Processing Systems, Vancouver, Canada, pp. 556–562. Advances in Neural Information Processing Systems (2001)
Liu, F., Liu, M., Zhou, T., Qiao, Y., Yang, J.: Incremental robust nonnegative matrix factorization for object tracking. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds.) ICONIP 2016. LNCS, vol. 9948, pp. 611–619. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46672-9_68
Zhang, X., Chen, D., Wu, K.: Incremental nonnegative matrix factorization based on correlation and graph regularization for matrix completion. Int. J. Mach. Learn. Cybern. 15(36), 1–10 (2018)
Sun, J., Cai, X.B., Sun, F.M., Hong, R.C.: Dual graph-regularized constrained nonnegative matrix factorization for image clustering. KSII Trans. Internet Inf. Syst. 5(11), 2607–2627 (2017)
Jian, M., Lam, K.M., Dong, J.: A novel face-hallucination scheme based on singular value decomposition. Pattern Recogn. 11(46), 3091–3102 (2013)
Jian, M., Lam, K.M.: Simultaneous hallucination and recognition of low-resolution faces based on singular value decomposition. IEEE Trans. Circ. Syst. Video Technol. 11(25), 1761–1772 (2015)
Liu, J.W., et al.: Multi-scale triplet CNN for person re-identification. In: 2016 ACM Conference on Multimedia, Amsterdam, Netherlands, pp. 192–196. ACM Digital Library (2016)
Hoyer, P.O.: Non-negative matrix factorization with sparseness constrains. J. Mach. Learn. Res. 5(9), 1457–1469 (2004)
Liu, H.F., Wu, Z.H., Li, X.L.: Constrained non-negative matrix factorization for image representation. IEEE Trans. Pattern Anal. Mach. Intell. 7(34), 1299–1311 (2012)
Cai, D., He, X.F., Han, J.W.: Graph regularized non-negative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 8(33), 1548–1560 (2011)
Ding, C., Li, T., Jordan, M.: Convex and semi-nonnegative matrix factorizations. IEEE Trans. Syst. Man Cybern. Part B Cybern. 1(32), 45–55 (2010)
Jiang, W., Li, H., Yu, X.G., Yang, B.R.: Graph regularized non-negative matrix factorization with sparseness constraints. Comput. Sci. 1(40), 218–256 (2013)
Pan, B.B., Chen, W.S., Xu, C.: Incremental learning of face recognition based on block non-negative matrix factorization. Appl. Res. Comput. 1(26), 117–120 (2009)
Bucak, S.S., Gunsel, B.: Incremental subspace learning via non-negative matrix factorization. Pattern Recogn. 7(34), 788–797 (2009)
Kong, D.G., Ding, C., Huang, H.: Robust nonnegative matrix factorization using \(L_{21}\)-norm. In: 20th ACM Conference on Information and Knowledge Management, Glasgow, UK, pp. 673–682. ACM, New York (2011)
Dai, L.Y., Feng, C.M., Liu, J.X., Zheng, C.H.: Robust nonnegative matrix factorization via joint graph Laplacian and discriminative information for identifying differentially expressed genes. Complexity 40(2017), 1–11 (2017)
Chen, W.S., Li, Y.G., Pan, B.B., Chen, B.: Incremental learning based on block sparse kernel nonnegative matrix factorization. In: 10th International Conference on Wavelet Analysis and Pattern Recognition, Jeju, South Korea, pp. 219–224. IEEE (2016)
Zheng, J.W., Chen, Y., Jin, Y.T., Wang, W.L.: Incremental locality preserving nonnegative matrix factorization. In: 6th International Conference on Advanced Computational Intelligence, Hangzhou, China, pp. 135–139. IEEE (2013)
Yu, Z.Z., Liu, Y.H., Li, B., Pang, S.C., Jia, C.C.: Incremental graph regulated nonnegative matrix factorization for face recognition. J. Appl. Math. 1(2014), 1–10 (2014)
Zeng, S.N., Gou, J.P., Deng, L.M.: An Antinoise Sparse Representation Method for Robust Face Recognition via joint \(l_1\) and \(l_2\) Regularization, 1st edn. Pergamon Press, Oxford (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Sun, J., Wang, Z., Li, H., Sun, F. (2018). Incremental Nonnegative Matrix Factorization with Sparseness Constraint for Image Representation. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11165. Springer, Cham. https://doi.org/10.1007/978-3-030-00767-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-00767-6_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00766-9
Online ISBN: 978-3-030-00767-6
eBook Packages: Computer ScienceComputer Science (R0)