Abstract
In this paper, we propose a nonlocal low-rank matrix completion method using edge detection and neural network to effectively exploit the nonlocal inter-pixel correlation for image interpolation and other possible applications. We first interpolate the images using some basic techniques, such as bilinear and edge-directed methods. Then, each image patch is categorized as smooth regions, edge regions, or texture regions and adaptive interpolating mechanisms are applied to each specific type of regions. Finally, for each specific type of regions, neural networks and low-rank matrix completion are employed to accurately update the results. An iteratively re-weighted minimization algorithm is used to solve the low-rank energy minimization function. Our experiments on benchmark images clearly indicate that the proposed method produces much better results than some existing algorithms using a variety of image quality metric in terms of both objective image quality assessment and subjective quality assessment.
Similar content being viewed by others
References
Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. IEEE Trans. Image Processing 14(10), 1647–1659 (2005)
Bayer, B.E.: Eastman Kodak Company, Color Imaging Array, US patent 3 971 065 (1975)
Bouzari, Hamed: An improved regularization method for artifact rejection in image super-resolution. Signal Image Video Processing 6(1), 125–140 (2012)
Buades, B.C., Morel, J.-M.: A non-local algorithm for image denoising. In: Proceedings of the IEEE Conference on CVPR, pp. 60–65 (2005)
Buades, A., Coll, B., Morel, J.-M., Sbert, C.: Self-similarity driven color demosaicking. IEEE Trans. Image Processing 18(6), 1192–1202 (2009)
Cai, J.-F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2008)
Candès, E.J., Recht, B.: Exact matrix completion via convex optimization. Found. Comput. Math. 717–772 (2009)
Candès, E.J., Tao, T.: The power of convex relaxation: Near-optimal matrix completion. IEEE Trans. Inform. Theory 56(5), 2053–2080 (2008)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Processing 16(8), 2080–2095 (2007)
Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Processing 20(17), 1838–1857 (2011)
Feng-zhi, Pan, Li-ming, Zhang: Super-resolution of images based on restoration of residual errors by neural networks. Acta Electronica Sinica 32(1), 161–165 (2004)
Hou, H.S., Andrews, H.C.: Cubic splines for image interpolation and digital filtering. IEEE Trans. Acoust. Speech Signal Process. ASSP–26(6), 508–517 (1978)
Huang, Y.Z., Long, Y.J.: Super-resolution using neural networks based on the optimal recovery theory. J. Comput. Electron. 5(4), 275–281 (2006)
Ji, Hui, Liu, Chaoqiang, Shen, Zuowei, Xu, Yuhong: Robust Video Denoising Using Low Rank Matrix Completion. In: Proceedings of the IEEE Conference on CVPR, pp. 1791–1798. San Francisco, CA (2010)
Keys, R.G.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. ASSP–29(6), 1153–1160 (1981)
Kindermann, S., Osher, S., Jones, P.W.: Deblurring and denoising of images by nonlocal functionals. Multiscale Model. Simul. 4(4), 1091–1115 (2005)
Lei, Zhang, Wu, X.: Color demosaicking via directional linear minimum mean square error estimation. IEEE Trans. Image Processing 14(12), 2167–2178 (2009)
Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Processing 10(10), 1521–1527 (2001)
Li, Xin: Demosaicing by successive approximation. IEEE Trans. Image Processing 14(3), 370–379 (2005)
Long, Y.J., Huang, Y.Z.: Image based source camera identification using demosaicking. In: Proceedings of the 8th International Conference on Workshop Multimedia, Signal Processing, pp. 419–424 (2006)
Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans Image Processing 19(11), 2889–2900 (2010)
Mathieu, B., Melchior, P., Oustaloup, A., Ceyral, Ch.: Fractional dierentiation for edge detection. Signal Processing 83, 2421–2432 (2003)
Schaeffer, H., Osher, S.: A Low Patch-rank Interpretation of Texture. CAM Report (2011)
Tian, Jing, Ma, Kai-Kuang: A state-space super-resolution approach for video reconstruction. Signal Image Video Processing 3(3), 217–240 (2009)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Processing 13(4), 600–612 (2004)
Wang, Q., Ward, R.K.: A new orientation–adaptive interpolation method. IEEE Trans. Image Processing 16(4), 889–900 (2007)
Xin, L., Gunturk, B., Zhang, L.: Image demosaicking: A systematic survey, visual communications and image processing 2008. In: Proceedings of the SPIE, Vol. 6822, pp. 68221J–68221J-15. San Jose. CA, USA (2008)
Yi-Fei, Pu, Zhou, Ji-Liu, Yuan, Xiao: Fractional differential mask: A fractional differential-based approach for multiscale texture enhancement. IEEE Trans. Image Processing 19(2), 491–511 (2010)
Zhang, L., Wu, X., Buades, A., Li, X.: Color demosaicking by local directional interpolation and non-local adaptive thresholding. J. Electron. Imaging 20(2) (June 2011)
Zhang, L., Wu, X.: An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans. Image Processing 15(8), 2226 (2006)
Zhang, X., Wu, X.: Image interpolation by adaptive 2-d autoregressive modeling and soft-decision estimation. IEEE Trans. Image Processing 17(6), 887–896 (2008)
Acknowledgments
This work was supported by the National Natural Science Foundation of China (Grant No. 51104157), the Ph.D. Programs Foundation of Ministry of Education of China (Grant No. 20110095120008), the General and Special Funded Project of the Postdoctoral Science Foundation of China (Grant Nos. 2013T60574, 20100481181), the Fundamental Research Funds for the Central Universities (Grant No. 2011QNA30), and Jiangsu Overseas Research & Training Program for University Prominent Young & Middle-aged Teachers and Presidents.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, W., Tian, Q., Liu, J. et al. Nonlocal low-rank matrix completion for image interpolation using edge detection and neural network. SIViP 8, 657–663 (2014). https://doi.org/10.1007/s11760-013-0575-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-013-0575-6