Skip to main content

Graph-Regularized NMF with Prior Knowledge for Image Inpainting

  • Conference paper
  • First Online:
Book cover Genetic and Evolutionary Computing (ICGEC 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 834))

Included in the following conference series:

  • 841 Accesses

Abstract

The image inpainting problem can be converted to the matrix completion. A classical matrix completion method is based on matrix factorization. The product of two low-rank matrices fills in the missing regions. In this paper, we propose a novel matrix factorization framework to recover the images. Before decomposing the original matrix, approximation matrix as the prior knowledge is constructed to estimate the values of missing pixels. The estimation of the missing pixels can be obtained through resampling from the surface fitting the 3D projection points of the available pixels. To keep the latent geometrical structure between adjacent pixels, we modify the graph-regularized which allows the edge weights negative to decompose the approximation matrix. Experimental results of image inpainting demonstrate the effectiveness of the proposed method compared with the representative methods in quantities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lu, N., Miao, H.: Structure constrained nonnegative matrix factorization for pattern clustering and classification. Neurocomputing 171(C), 400–411 (2016)

    Article  Google Scholar 

  2. Yang, Z., Oja, E.: Quadratic nonnegative matrix factorization. Pattern Recogn. 45(4), 1500–1510 (2012)

    Article  Google Scholar 

  3. Witten, D.M., Tibshirani, R., Hastie, T.: A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics 10(3), 5–15 (2009)

    Article  Google Scholar 

  4. Li, S.Z., Hou, X., Zhang, H., Cheng, Q.: Learning spatially localized parts-based representation. Comput. Vis. Pattern Recogn. 1, 1–207 (2001)

    Google Scholar 

  5. Shen, B., Si, L., Ji, R., Liu, B.: Robust nonnegative matrix factorization via l1 norm regularization. In: IEEE International Conference on Image Processing, pp. 1204–2311 (2012)

    Google Scholar 

  6. Yuan, Z., Oja, E.: Projective nonnegative matrix factorization for image compression and feature extraction. In: Proceedings of 14th Scandinavian Conference on Image Analysis (SCIA), Springer, pp. 333–342 (2005)

    Google Scholar 

  7. Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)

    Article  MathSciNet  Google Scholar 

  8. Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)

    Article  Google Scholar 

  9. Luo, P., Peng, J.Y., Guan, Z.Y., Fan, J.P.: Dual regularized multi-view non-negative matrix factorization for clustering. Neurocomputing 294(24), 1–11 (2017)

    Google Scholar 

  10. Wang, J.Y., Bensmail, H., Gao, X.: Multiple graph regularized nonnegative matrix factorization. Pattern Recogn. 46(10), 2840–2847 (2013)

    Article  Google Scholar 

  11. Guan, N., Tao, D., Luo, Z., Yuan, B.: Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans. Image Process. 20(7), 2030–2048 (2011)

    Article  MathSciNet  Google Scholar 

  12. Wu, W.H., Kwong, S., Zhou, Y., Jia, Y.H., Gao, W.: Nonnegative matrix factorization with mixed hypergraph regularization for community detection. Inf. Sci. 435, 263–281 (2018)

    Article  MathSciNet  Google Scholar 

  13. Huang, S., Wang, H.X.: Improved hypergraph regularized Nonnegative Matrix Factorization with sparse representation. Pattern Recogn. Lett. 102, 8–14 (2018)

    Article  Google Scholar 

  14. Mashallah, M.F., Pourabd, M.: Moving least square for systems of integral equations. Appl. Math. Comput. 270, 879–889 (2015)

    MathSciNet  MATH  Google Scholar 

  15. Mehrabi, H., Voosoghi, B.: Recursive moving least squares. Eng. Anal. Bound. Elem. 58, 119–128 (2015)

    Article  MathSciNet  Google Scholar 

  16. Telea, A.: An image inpainting technique based on the fast marching method. J. Gr. Tools. 9(1), 23–34 (2004)

    Article  Google Scholar 

  17. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Image Press. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  18. Guillemot, C., Meur, O.: Image inpainting: overview and recent advances. Signal Process. Mag. 31(1), 127–144 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (61702310 and 61772322).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Li Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, L., Shang, F., Chen, S., Wang, Y., Wang, X. (2019). Graph-Regularized NMF with Prior Knowledge for Image Inpainting. In: Pan, JS., Lin, JW., Sui, B., Tseng, SP. (eds) Genetic and Evolutionary Computing. ICGEC 2018. Advances in Intelligent Systems and Computing, vol 834. Springer, Singapore. https://doi.org/10.1007/978-981-13-5841-8_22

Download citation

Publish with us

Policies and ethics