Abstract
In recent years, nonnegative matrix factorization (NMF) has attracted significant amount of attentions in image processing, text mining, speech processing and related fields. Although NMF has been applied in several application successfully, its simple application on image processing has a few caveats. For example, NMF costs considerable computational resources when performing on large databases. In this paper, we propose two enhanced NMF algorithms for image processing to save the computational costs. One is modified rank-one residue iteration (MRRI) algorithm , the other is element-wisely residue iteration (ERI) algorithm. Here we combine CAPG (a NMF algorithm proposed by Lin), MRRI and ERI with two-dimensional nonnegative matrix factorization (2DNMF) for image processing. The main difference between NMF and 2DNMF is that the former first aligns images into one-dimensional (1D) vectors and then represents them with a set of 1D bases, while the latter regards images as 2D matrices and represents them with a set of 2D bases. The three combined algorithms are named CAPG-2DNMF, MRRI-2DNMF and ERI-2DNMF. The computational complexity and convergence analyses of proposed algorithms are also presented in this paper. Three public databases are used to test the three NMF algorithms and the three combinations, the results of which show the enhancement performance of our proposed algorithms (MRRI and ERI algorithms) over the CAPG algorithm. MRRI and ERI have similar performance. The three combined algorithms have better image reconstruction quality and less running time than their corresponding 1DNMF algorithms under the same compression ratio. We also do some experiments on a real-captured image database and get similar conclusions.
Similar content being viewed by others
References
AT&T Laboratories Cambridge ORL Database of Faces. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html
Berry M, Browne M, Langville A, Pauca P, Plemmons R (2007) Algorithms and applications for approximate nonnegative matrix factorization. Comput Stat Data Anal 52:155–173
Brunet J, Tamayo P, Golub T, Mesirov J (2004) Metagenes and molecular pattern discovery using matrix factorization. Proc Natl Acad Sci U S A 101(12):4164–4169
Center for Biometrics and Security Research iris Databases CASIA-IrisV3. http://www.cbsr.ia.ac.cn/english/IrisDatabases.asp
Chu M, Plemmons RJ (2005) Nonnegative matrix factorizationand applications. Bulletin of the International Linear Algebra Society 34:2–7
Eches O, Guillaume M (2014) A bilinear-bilinear nonnegative matrix factorization method for hyperspectral unmixing. IEEE Geosci Remote Sens Lett 11(4):778–782
Gao Y, Ghurch G (2005) Improving molecular cancer class discovery through sparse non-negative matrix factorization. Bioinformatics 21:3970–3975
Guillamet D, Vitrià J (2002) Non-negative matrix factorization for face recognition. Topics in artificial intelligence, pp 336–344
Ho ND, Dooren PV, Blondel V (2008) Non-negative matrix factorization–algorithms and applications. Louvain-la-Neuve: Université catholique de Louvain
Kim H, Park H (2007) Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis. Bioinformatics 23:1495–1502
Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791
Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE computer society conference on computer vision and pattern recognition, pp 207–212
Lin L (2010) Alternative gradient algorithms with applications to nonnegative matrix factorizations. Appl Math Comput 216:1763–1770
Lin L, Liu ZY (2011) An alternationg projected gradient algorithm for nonnegative matrix factorization. Appl Math Comput 217:9997–10002
McCann MT, Mixon DG, Fickus MC, Castro CA, Ozolek JA, Kovacevic J (2014) Images as occlusions of textures: a framework for segmentation. IEEE Trans Image Process 23(5):2033–2046
MIT Center for Biological and Computation Learning CBCL Face Database. http://cbcl.mit.edu/software-datasets/FaceData2.html
Nikitidis S, Tefas A, Nikolaidis N, Pitas I (2012) Subclass discriminant Nonnegative Matrix Factorization for facial image analysis. Pattern Recogn 45:4080–4091
Sajda P, Du S, Brown T, Stoyanova R, Shungu D, Mao X et al (2004) Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain. IEEE Trans Med Imaging 23(12):1453–1465
Saul LK, Sha F, Lee DD (2003) Statistical signal processing with nonnegativity constraints. In: Proceedings of EuroSpeech 2, pp 1001–1004
Shahnaz F, Berry MW, Pauca VP, Plemmons R (2006) Document clusting using nonnegative matrix factorization. Inf Process Manag 42(2):373–386
Smaragdis P, Brown JC (2003) Non-negative matrix factorization for polyphonic music transcription. In: Proceedings of IEEE workshop on applications of signal processing to audio and acoustics , pp 177–180
Tang ZJ, Zhang XQ, Zhang SC (2014) Robust perceptual image hashing based on ring partition and NMF. IEEE Trans Knowl Data Eng 26(3):711–724
Pauca VP, Piper J, Plemmons RJ (2006) Nonnegative matrix factorization for spectral data analysis. Linear Algebra Appl 416:29–47
Pauca P, Shahnaz F, Berry M, Plemmons R (2004) Text mining using nonnegative(non-negative) matrix factorizations. In: Proceedings of the 4th SIAM international conference on data mining , pp 452–456
Ptucha R, Savakis A (2013) Manifold based sparse representation for facial understanding in natural images. Image Vis Comput 31(5):365–378
Vijay Kumar BG, Kotsia I, Patras I (2012) Max-margin non-negative matrix factorization. Image Vis Comput 30(4–5):279–291
Wang Y, Jia Y (2005) Non-negative matrix factorization framework for face recognition. Int J Pattern Recognit Artif Intell 19(4):495–511
Zhang DQ, Chen SC, Zhou ZH (2005) Two-dimensional non-negative matrix factorization for face representation and recognition. In: Proceedings of the ICCV’05 Workshop on Analysis and Modeling of Faces and Gestures(AMFG’05), Beijing, China, LNCS, vol 3723 , pp 350–363
Zheng WS, Lai JH, Liao SC, He R (2012) Extracting non-negative basis images using pixel dispersion penalty. Pattern Recogn 45:2912–2926
Acknowledgments
We would like to thank the anonymous editors and reviewers for their helpful suggestions and comments. This work is supported by National Natural Science Foundation of China (Grant No.61175123).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hu, L., Guo, G. & Ma, C. Combined new nonnegative matrix factorization algorithms with two-dimensional nonnegative matrix factorization for image processing. Multimed Tools Appl 75, 11127–11155 (2016). https://doi.org/10.1007/s11042-015-2837-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2837-5