Skip to main content
SpringerLink
Log in

Nonlocal low-rank matrix completion for image interpolation using edge detection and neural network

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, we propose a nonlocal low-rank matrix completion method using edge detection and neural network to effectively exploit the nonlocal inter-pixel correlation for image interpolation and other possible applications. We first interpolate the images using some basic techniques, such as bilinear and edge-directed methods. Then, each image patch is categorized as smooth regions, edge regions, or texture regions and adaptive interpolating mechanisms are applied to each specific type of regions. Finally, for each specific type of regions, neural networks and low-rank matrix completion are employed to accurately update the results. An iteratively re-weighted minimization algorithm is used to solve the low-rank energy minimization function. Our experiments on benchmark images clearly indicate that the proposed method produces much better results than some existing algorithms using a variety of image quality metric in terms of both objective image quality assessment and subjective quality assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Processing 14(10), 1647–1659 (2005)

    Article  MathSciNet  Google Scholar 

  2. Bayer, B.E.: Eastman Kodak Company, Color Imaging Array, US patent 3 971 065 (1975)

  3. Bouzari, Hamed: An improved regularization method for artifact rejection in image super-resolution. Signal Image Video Processing 6(1), 125–140 (2012)

    Article  Google Scholar 

  4. Buades, B.C., Morel, J.-M.: A non-local algorithm for image denoising. In: Proceedings of the IEEE Conference on CVPR, pp. 60–65 (2005)

  5. Buades, A., Coll, B., Morel, J.-M., Sbert, C.: Self-similarity driven color demosaicking. IEEE Trans. Image Processing 18(6), 1192–1202 (2009)

    Article  MathSciNet  Google Scholar 

  6. Cai, J.-F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2008)

    Article  Google Scholar 

  7. Candès, E.J., Recht, B.: Exact matrix completion via convex optimization. Found. Comput. Math. 717–772 (2009)

  8. Candès, E.J., Tao, T.: The power of convex relaxation: Near-optimal matrix completion. IEEE Trans. Inform. Theory 56(5), 2053–2080 (2008)

    Article  Google Scholar 

  9. Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Processing 16(8), 2080–2095 (2007)

    Article  MathSciNet  Google Scholar 

  10. Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Processing 20(17), 1838–1857 (2011)

    Article  MathSciNet  Google Scholar 

  11. Feng-zhi, Pan, Li-ming, Zhang: Super-resolution of images based on restoration of residual errors by neural networks. Acta Electronica Sinica 32(1), 161–165 (2004)

    Google Scholar 

  12. Hou, H.S., Andrews, H.C.: Cubic splines for image interpolation and digital filtering. IEEE Trans. Acoust. Speech Signal Process. ASSP–26(6), 508–517 (1978)

    Google Scholar 

  13. Huang, Y.Z., Long, Y.J.: Super-resolution using neural networks based on the optimal recovery theory. J. Comput. Electron. 5(4), 275–281 (2006)

    Article  Google Scholar 

  14. Ji, Hui, Liu, Chaoqiang, Shen, Zuowei, Xu, Yuhong: Robust Video Denoising Using Low Rank Matrix Completion. In: Proceedings of the IEEE Conference on CVPR, pp. 1791–1798. San Francisco, CA (2010)

  15. Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. ASSP–29(6), 1153–1160 (1981)

    Article  MathSciNet  Google Scholar 

  16. Kindermann, S., Osher, S., Jones, P.W.: Deblurring and denoising of images by nonlocal functionals. Multiscale Model. Simul. 4(4), 1091–1115 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  17. Lei, Zhang, Wu, X.: Color demosaicking via directional linear minimum mean square error estimation. IEEE Trans. Image Processing 14(12), 2167–2178 (2009)

    Google Scholar 

  18. Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Processing 10(10), 1521–1527 (2001)

    Article  Google Scholar 

  19. Li, Xin: Demosaicing by successive approximation. IEEE Trans. Image Processing 14(3), 370–379 (2005)

    Article  Google Scholar 

  20. Long, Y.J., Huang, Y.Z.: Image based source camera identification using demosaicking. In: Proceedings of the 8th International Conference on Workshop Multimedia, Signal Processing, pp. 419–424 (2006)

  21. Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans Image Processing 19(11), 2889–2900 (2010)

    Google Scholar 

  22. Mathieu, B., Melchior, P., Oustaloup, A., Ceyral, Ch.: Fractional dierentiation for edge detection. Signal Processing 83, 2421–2432 (2003)

    Google Scholar 

  23. Schaeffer, H., Osher, S.: A Low Patch-rank Interpretation of Texture. CAM Report (2011)

  24. Tian, Jing, Ma, Kai-Kuang: A state-space super-resolution approach for video reconstruction. Signal Image Video Processing 3(3), 217–240 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  25. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Processing 13(4), 600–612 (2004)

    Article  Google Scholar 

  26. Wang, Q., Ward, R.K.: A new orientation–adaptive interpolation method. IEEE Trans. Image Processing 16(4), 889–900 (2007)

    Article  MathSciNet  Google Scholar 

  27. Xin, L., Gunturk, B., Zhang, L.: Image demosaicking: A systematic survey, visual communications and image processing 2008. In: Proceedings of the SPIE, Vol. 6822, pp. 68221J–68221J-15. San Jose. CA, USA (2008)

  28. Yi-Fei, Pu, Zhou, Ji-Liu, Yuan, Xiao: Fractional differential mask: A fractional differential-based approach for multiscale texture enhancement. IEEE Trans. Image Processing 19(2), 491–511 (2010)

    Article  Google Scholar 

  29. Zhang, L., Wu, X., Buades, A., Li, X.: Color demosaicking by local directional interpolation and non-local adaptive thresholding. J. Electron. Imaging 20(2) (June 2011)

  30. Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Processing 15(8), 2226 (2006)

    Article  Google Scholar 

  31. Zhang, X., Wu, X.: Image interpolation by adaptive 2-d autoregressive modeling and soft-decision estimation. IEEE Trans. Image Processing 17(6), 887–896 (2008)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Grant No. 51104157), the Ph.D. Programs Foundation of Ministry of Education of China (Grant No. 20110095120008), the General and Special Funded Project of the Postdoctoral Science Foundation of China (Grant Nos. 2013T60574, 20100481181), the Fundamental Research Funds for the Central Universities (Grant No. 2011QNA30), and Jiangsu Overseas Research & Training Program for University Prominent Young & Middle-aged Teachers and Presidents.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, 221116, Jiangsu, People’s Republic of China

    Wei Chen, Qichong Tian, Jin Liu & Qianping Wang

  2. Department of Electronics and Information Engineering, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, People’s Republic of China

    Qichong Tian

Authors
  1. Wei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qichong Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Qianping Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Chen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, W., Tian, Q., Liu, J. et al. Nonlocal low-rank matrix completion for image interpolation using edge detection and neural network. SIViP 8, 657–663 (2014). https://doi.org/10.1007/s11760-013-0575-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0575-6

Keywords

Search

Navigation