Skip to main content
SpringerLink
Log in

An improved anchor neighborhood regression SR method based on low-rank constraint

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

At present, the image super-resolution (SR) method based on sparse representation has the problem that the reconstruction speed and quality are difficult to be achieved simultaneously. Therefore, this paper proposes an improved anchor neighborhood regression SR algorithm based on low-rank constraint. Firstly, considering the critical role of locality in nonlinear data learning, the locally weighted regularization weight is introduced in the calculation of the projection matrix, which can constrain the projection process according to the correlation between the anchor point and the atoms in the corresponding neighborhood. Then, in the reconstruction phase, based on the assumption of low-rank between similar blocks, further constraints are made on the reconstruction blocks to obtain better reconstruction image quality. Experiments show that our method can not only reconstruct more image details but also achieve better reconstruction speed. Compared with some state-of-the-art sparse representation method, it achieves better reconstruction results in objective evaluation criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Tsai, R.: Multiframe image restoration and registration. Adv. Comput. Visual Image Process. 1, 317–339 (1984)

    Google Scholar 

  2. Li, X., Orchard, M.T.: New edge-directed interpolation. IEEE Trans. Image Process. 10(10), 1521–1527 (2001)

    Article  Google Scholar 

  3. Yang, X., et al.: An improved iterative back projection algorithm based on ringing artifacts suppression. Neurocomputing 162, 171–179 (2015)

    Article  Google Scholar 

  4. Schultz, R.R., Stevenson, R.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. Image Process. 5(6), 996–1011 (1996)

    Article  Google Scholar 

  5. Yang, X., Liu, T., Zhou, D.: A multi-frame adaptive super-resolution method using double channel and regional pixel information. Optik 126(24), 5850–5858 (2015)

    Article  Google Scholar 

  6. Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)

  7. Zhu, J.-Y., et al.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)

  8. Zeng, K., Ding, S., Jia, W.: Single image super-resolution using a polymorphic parallel CNN. Appl. Intell. 49(1), 292–300 (2019)

    Article  Google Scholar 

  9. Rubinstein, R., Bruckstein, A.M., Elad, M.: Dictionaries for sparse representation modeling. Proc. IEEE 98(6), 1045–1057 (2010)

    Article  Google Scholar 

  10. Bruckstein, A.M., Donoho, D.L., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51(1), 34–81 (2009)

    Article  MathSciNet  Google Scholar 

  11. Yang, J., et al.: Image super-resolution as sparse representation of raw image patches. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2008)

  12. Yang, J., et al.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)

    Article  MathSciNet  Google Scholar 

  13. Dong, W., et al.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22(4), 1620–1630 (2012)

    Article  MathSciNet  Google Scholar 

  14. Mandal, S., Arnav, B., Sao, A.K.: Noise adaptive super-resolution from single image via non-local mean and sparse representation. Signal Process. 132, 134–149 (2017)

    Article  Google Scholar 

  15. Timofte, R., De Smet, V., Van Gool, L.: Anchored neighborhood regression for fast example-based super-resolution. In: Proceedings of the IEEE International Conference on Computer Vision (2013)

  16. Timofte, R., De Smet, V., Van Gool, L.: A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Asian Conference on Computer Vision, pp. 111–126. Springer, Cham (2014)

  17. Jiang, J., et al.: Single image super-resolution via locally regularized anchored neighborhood regression and nonlocal means. IEEE Trans. Multimed. 19(1), 15–26 (2016)

    Article  Google Scholar 

  18. Zhao, J., Heping, H., Cao, F.: Image super-resolution via adaptive sparse representation. Knowl. Based Syst. 124, 23–33 (2017)

    Article  Google Scholar 

  19. Moustafa, M.S., et al.: Acceleration of super-resolution for multispectral images using self-example learning and sparse representation. Comput. Electr. Eng. 62, 249–265 (2017)

    Article  Google Scholar 

  20. Fang, L., Zhuo, H., Li, S.: Super-resolution of hyperspectral image via superpixel-based sparse representation. Neurocomputing 273, 171–177 (2018)

    Article  Google Scholar 

  21. Shang, L., et al.: Modified sparse representation based image super-resolution reconstruction method. Neurocomputing 228, 37–52 (2017)

    Article  Google Scholar 

  22. Huang, S., et al.: Robust single-image super-resolution based on adaptive edge-preserving smoothing regularization. IEEE Trans. Image Process. 27(6), 2650–2663 (2018)

    Article  MathSciNet  Google Scholar 

  23. Lu, W., et al.: Single image super resolution based on sparse domain selection. Neurocomputing 269, 180–187 (2017)

    Article  Google Scholar 

  24. Chang, H., Dit-Yan, Y., Yimin, X.: Super-resolution through neighbor embedding. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2004, vol. 1, pp. 1: I-I. IEEE (2004)

  25. Gu, S., et al.: Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862–2869 (2014)

  26. Shi, J., Chun, Q.: Low-rank sparse representation for single image super-resolution via self-similarity learning. In: IEEE International Conference on Image Processing (ICIP). IEEE (2016)

  27. Chang, K., et al.: Data-adaptive low-rank modeling and external gradient prior for single image super-resolution. Signal Process. 161, 36–49 (2019)

    Article  Google Scholar 

  28. Zhang, M., Desrosiers, C.: High-quality image restoration using low-rank patch regularization and global structure sparsity. IEEE Trans. Image Process. 28(2), 868–879 (2018)

    Article  MathSciNet  Google Scholar 

  29. Li, X., et al.: Single image super-resolution via adaptive sparse representation and low-rank constraint. J. Vis. Commun. Image Represent. 55, 319–330 (2018)

    Article  Google Scholar 

  30. Marroquin, J., Mitter, S., Poggio, T.: Probabilistic solution of ill-posed problems in computational vision. J. Am. Stat. Assoc. 82(397), 76–89 (1987)

    Article  Google Scholar 

  31. Timofte, R., Van Gool, L.: Adaptive and weighted collaborative representations for image classification. Pattern Recognit. Lett. 43, 127–135 (2014)

    Article  Google Scholar 

  32. Yu, K., Zhang, T., Gong, Y.: Nonlinear learning using local coordinate coding. In: Advances in Neural Information Processing Systems, pp. 2223–2231 (2009)

  33. Wang, J., et al.: Locality-constrained linear coding for image classification. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 3360–3367. IEEE, (2010)

  34. Jiang, J., et al.: SRLSP: a face image super-resolution algorithm using smooth regression with local structure prior. IEEE Trans. Multimed. 19(1), 27–40 (2016)

    Article  Google Scholar 

  35. Chang, K., Li, B.: Joint modeling and reconstruction of a compressively-sensed set of correlated images. J. Vis. Commun. Image Represent. 33, 286–300 (2015)

    Article  Google Scholar 

  36. Lin, Z., Chen, M., Ma, Y.: The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv preprint arXiv:1009.5055 (2010)

  37. Yang, J., et al.: Image super-resolution as sparse representation of raw image patches. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. IEEE (2008)

  38. Bevilacqua, M., et al. Low-complexity single-image super-resolution based on nonnegative neighbor embedding, pp. 135-1 (2012)

  39. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: International Conference on Curves and Surfaces, pp. 711–730. Springer, Berlin (2010)

  40. Arbelaez, P., et al.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898–916 (2010)

    Article  Google Scholar 

  41. Zhang, C., et al.: Sparse representation and adaptive mixed samples regression for single image super-resolution. Signal Process. Image Commun. 67, 79–89 (2018)

    Article  Google Scholar 

  42. Liu, N., et al.: Sparse representation based image super-resolution on the KNN based dictionaries. Optics Laser Technol. 110, 135–144 (2019)

    Article  Google Scholar 

  43. Dong, C., et al.: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, pp. 184–199. Springer, Cham (2014)

Download references

Funding

This study was funded by the National Natural Science Foundation of China (61573182), and by the Fundamental Research Funds for the Central Universities (NS2020025).

Author information

Authors and Affiliations

  1. College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China

    Xin Yang, Li Liu, Chen Zhu, Yingqing Guo & Dake Zhou

Authors
  1. Xin Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Li Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chen Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yingqing Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dake Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xin Yang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, X., Liu, L., Zhu, C. et al. An improved anchor neighborhood regression SR method based on low-rank constraint. Vis Comput 38, 405–418 (2022). https://doi.org/10.1007/s00371-020-02022-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-020-02022-0

Keywords

Search

Navigation