Skip to main content
Log in

Combined new nonnegative matrix factorization algorithms with two-dimensional nonnegative matrix factorization for image processing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, nonnegative matrix factorization (NMF) has attracted significant amount of attentions in image processing, text mining, speech processing and related fields. Although NMF has been applied in several application successfully, its simple application on image processing has a few caveats. For example, NMF costs considerable computational resources when performing on large databases. In this paper, we propose two enhanced NMF algorithms for image processing to save the computational costs. One is modified rank-one residue iteration (MRRI) algorithm , the other is element-wisely residue iteration (ERI) algorithm. Here we combine CAPG (a NMF algorithm proposed by Lin), MRRI and ERI with two-dimensional nonnegative matrix factorization (2DNMF) for image processing. The main difference between NMF and 2DNMF is that the former first aligns images into one-dimensional (1D) vectors and then represents them with a set of 1D bases, while the latter regards images as 2D matrices and represents them with a set of 2D bases. The three combined algorithms are named CAPG-2DNMF, MRRI-2DNMF and ERI-2DNMF. The computational complexity and convergence analyses of proposed algorithms are also presented in this paper. Three public databases are used to test the three NMF algorithms and the three combinations, the results of which show the enhancement performance of our proposed algorithms (MRRI and ERI algorithms) over the CAPG algorithm. MRRI and ERI have similar performance. The three combined algorithms have better image reconstruction quality and less running time than their corresponding 1DNMF algorithms under the same compression ratio. We also do some experiments on a real-captured image database and get similar conclusions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. AT&T Laboratories Cambridge ORL Database of Faces. http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

  2. Berry M, Browne M, Langville A, Pauca P, Plemmons R (2007) Algorithms and applications for approximate nonnegative matrix factorization. Comput Stat Data Anal 52:155–173

    Article  MathSciNet  MATH  Google Scholar 

  3. Brunet J, Tamayo P, Golub T, Mesirov J (2004) Metagenes and molecular pattern discovery using matrix factorization. Proc Natl Acad Sci U S A 101(12):4164–4169

    Article  Google Scholar 

  4. Center for Biometrics and Security Research iris Databases CASIA-IrisV3. http://www.cbsr.ia.ac.cn/english/IrisDatabases.asp

  5. Chu M, Plemmons RJ (2005) Nonnegative matrix factorizationand applications. Bulletin of the International Linear Algebra Society 34:2–7

    Google Scholar 

  6. Eches O, Guillaume M (2014) A bilinear-bilinear nonnegative matrix factorization method for hyperspectral unmixing. IEEE Geosci Remote Sens Lett 11(4):778–782

    Article  Google Scholar 

  7. Gao Y, Ghurch G (2005) Improving molecular cancer class discovery through sparse non-negative matrix factorization. Bioinformatics 21:3970–3975

    Article  Google Scholar 

  8. Guillamet D, Vitrià J (2002) Non-negative matrix factorization for face recognition. Topics in artificial intelligence, pp 336–344

  9. Ho ND, Dooren PV, Blondel V (2008) Non-negative matrix factorization–algorithms and applications. Louvain-la-Neuve: Université catholique de Louvain

  10. Kim H, Park H (2007) Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis. Bioinformatics 23:1495–1502

    Article  Google Scholar 

  11. Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791

    Article  Google Scholar 

  12. Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE computer society conference on computer vision and pattern recognition, pp 207–212

  13. Lin L (2010) Alternative gradient algorithms with applications to nonnegative matrix factorizations. Appl Math Comput 216:1763–1770

    Article  MathSciNet  MATH  Google Scholar 

  14. Lin L, Liu ZY (2011) An alternationg projected gradient algorithm for nonnegative matrix factorization. Appl Math Comput 217:9997–10002

    Article  MathSciNet  MATH  Google Scholar 

  15. McCann MT, Mixon DG, Fickus MC, Castro CA, Ozolek JA, Kovacevic J (2014) Images as occlusions of textures: a framework for segmentation. IEEE Trans Image Process 23(5):2033–2046

    Article  MathSciNet  Google Scholar 

  16. MIT Center for Biological and Computation Learning CBCL Face Database. http://cbcl.mit.edu/software-datasets/FaceData2.html

  17. Nikitidis S, Tefas A, Nikolaidis N, Pitas I (2012) Subclass discriminant Nonnegative Matrix Factorization for facial image analysis. Pattern Recogn 45:4080–4091

    Article  MATH  Google Scholar 

  18. Sajda P, Du S, Brown T, Stoyanova R, Shungu D, Mao X et al (2004) Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain. IEEE Trans Med Imaging 23(12):1453–1465

    Article  Google Scholar 

  19. Saul LK, Sha F, Lee DD (2003) Statistical signal processing with nonnegativity constraints. In: Proceedings of EuroSpeech 2, pp 1001–1004

  20. Shahnaz F, Berry MW, Pauca VP, Plemmons R (2006) Document clusting using nonnegative matrix factorization. Inf Process Manag 42(2):373–386

    Article  MATH  Google Scholar 

  21. Smaragdis P, Brown JC (2003) Non-negative matrix factorization for polyphonic music transcription. In: Proceedings of IEEE workshop on applications of signal processing to audio and acoustics , pp 177–180

  22. Tang ZJ, Zhang XQ, Zhang SC (2014) Robust perceptual image hashing based on ring partition and NMF. IEEE Trans Knowl Data Eng 26(3):711–724

    Article  Google Scholar 

  23. Pauca VP, Piper J, Plemmons RJ (2006) Nonnegative matrix factorization for spectral data analysis. Linear Algebra Appl 416:29–47

    Article  MathSciNet  MATH  Google Scholar 

  24. Pauca P, Shahnaz F, Berry M, Plemmons R (2004) Text mining using nonnegative(non-negative) matrix factorizations. In: Proceedings of the 4th SIAM international conference on data mining , pp 452–456

  25. Ptucha R, Savakis A (2013) Manifold based sparse representation for facial understanding in natural images. Image Vis Comput 31(5):365–378

    Article  Google Scholar 

  26. Vijay Kumar BG, Kotsia I, Patras I (2012) Max-margin non-negative matrix factorization. Image Vis Comput 30(4–5):279–291

    Article  Google Scholar 

  27. Wang Y, Jia Y (2005) Non-negative matrix factorization framework for face recognition. Int J Pattern Recognit Artif Intell 19(4):495–511

    Article  MathSciNet  Google Scholar 

  28. Zhang DQ, Chen SC, Zhou ZH (2005) Two-dimensional non-negative matrix factorization for face representation and recognition. In: Proceedings of the ICCV’05 Workshop on Analysis and Modeling of Faces and Gestures(AMFG’05), Beijing, China, LNCS, vol 3723 , pp 350–363

  29. Zheng WS, Lai JH, Liao SC, He R (2012) Extracting non-negative basis images using pixel dispersion penalty. Pattern Recogn 45:2912–2926

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank the anonymous editors and reviewers for their helpful suggestions and comments. This work is supported by National Natural Science Foundation of China (Grant No.61175123).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liying Hu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, L., Guo, G. & Ma, C. Combined new nonnegative matrix factorization algorithms with two-dimensional nonnegative matrix factorization for image processing. Multimed Tools Appl 75, 11127–11155 (2016). https://doi.org/10.1007/s11042-015-2837-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2837-5

Keywords

Navigation