Skip to main content
SpringerLink
Log in

Super-resolution from a single image based on local self-similarity

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Super-resolution from a single image plays an important role in many areas. However, it is still a challenging work, especially in the high-resolution image’s quality and the algorithm’s efficiency. To obtain high-resolution images, a new single image super-resolution technique that extends existing learning-based super-resolution frameworks is presented in this paper. We don’t use any external example database or image pyramid to learn the missing details, and propose a single image SR method by learning local self-similarities from the original image itself. To synthesize the missing details, we design new filters which based on principles that model the super-resolution process, and use the new filters to establish the HR-LR patch pairs using the original image and its downsampled version. To obtain the SR image, we adopt a gradual magnification scheme to upscale the original image to the desired size step by step. In addition, to control the iterative error, we use the original image to guide the details added. Experimental results demonstrate that the proposed method is very flexible and give good empirical results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Aly HA, Dubois E (2005) Image up-sampling using total-variation regularizetion with a new observation model. IEEE Trans Image Process 14(10):1647–1659

    Article  MathSciNet  Google Scholar 

  2. Baker S, Kanade T (2000) Limits on super-resolution and how to break them. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 2, pages 372–379, Hilton Head Island, SC,USA, 13–15

  3. Ben-Ezra M, Lin ZC, Wilbum B (2007) Penrose pixels: super-resolution in the detector layout domain. In: ICCV

  4. Chang H, Yeung DY, Xiong Y (2004) Super-resolution through neighbor embedding. In: CVPR, volume 1, pages 275–282

  5. Dai S, Han M, Xu W, Wu Y, Gong Y (2007) Soft edge smoothness prior for alpha channel super resolution. In: CVPR, pp 1–8

  6. Fattal R (2007) Image upsampling via imposed edge statistics. ACM Transactions on Graphics 26(3): 95:1–95:8

  7. Freedman G, Fattal R (2011) Image and video upscaling from local self-examples. ACM Transactions on Graphics, Vol. 30, No. 2, Article 12

  8. Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. IEEE Comput Graph Appl 22(2):56–65

    Article  Google Scholar 

  9. Freeman WT, Pasztor E, Carmichael O (2000) Learning low-level vision. Int J Comput Vis 40(1):25–47

    Article  MATH  Google Scholar 

  10. Gao X, Zhang K, Tao D, Li X (2012) Joint learning for single-image super-resolution via a coupled constraint. IEEE Trans Image Process 21(2):469–480

    Article  MathSciNet  Google Scholar 

  11. Giachetti A, Asuni N (2011) Real-time artifact-free image upscaling. IEEE Trans Image Process 20(10):2760–2768

    Article  MathSciNet  Google Scholar 

  12. Glasner D, Bagon S, Irani M (2009) Super-resolution from a single image. In: ICCV, pp 349–356

  13. Jamed DF, van Dam A, Steven KF, John FH (1990) Computer graphics, principles and practice, Second Edition. Addison-Wesley

  14. Kim K, Kwon Y (2008) Example-based learning for single-image super-resolution. Pattern Recog Lect Notes Comput Sci 5096:456–465

    Article  MathSciNet  Google Scholar 

  15. Kim KI, Kwon Y (2010) Single-image super-resolution using sparse regression and natural image prior. IEEE Int. Conf. Image Graph pp 1127–1133

  16. Lane RO (2010) Non-parametric bayesian super-resolution. IET Radar Sonar Navigat 4(4):629–648

    Google Scholar 

  17. Lin ZC, Shum HY (2004) Fundamental limits of reconstruction-based superresolution algorithms under local reanslation. IEEE Trans PAMI 26(1):83–97

    Article  Google Scholar 

  18. Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2009) Non-local sparse models for image restoration. Proc. Int. Conf. Comput. Vis pp 2272–2279

  19. Morse BS, Schwartzwald D (2001) Image magnification using level set reconstruction. In: CVPR, pp 333–340

  20. Su D, Willis P (2004) Image interpolation by pixel-level data-dependent triangulation. Comput Graph Forum 23(2):189–202

    Article  Google Scholar 

  21. Sun J, Xu Z, Shum H (2008) Image super-resolution using gradient profile prior. In: CVPR, pages 1–8

  22. Sun J, Xu Z, Shum HY (2011) Gradient profile prior and its applications in image super-resolution and enhancement. IEEE Trans Image Process 20(6):1529–1542

    Article  MathSciNet  Google Scholar 

  23. Tai YW, Liu S, Brown MS, Lin S (2010) Super resolution using edge prior and single image detail synthesis. In: CVPR, pp 2400–2407

  24. Tang Y, Yuan Y, Yan P, Li X (2013) Greedy regression in sparse coding space for single-image super-resolution. J Vis Commun Image Represent 24(2):148–159

    Article  Google Scholar 

  25. Tipping ME, Bishop CM (2003) Bayesian image super-resolution. In: Backer S, Thrun S, Obermayer K (eds) Advances in neural information processing systems 15. MIT Press, Cambridge, pp 1279–1286

    Google Scholar 

  26. Wang L, Xiang S, Meng G, Wu H, Pan C (2013) Edge-directed single-image super-resolution via adaptive gradient magnitude self-interpolation. IEEE Trans Circ Syst Video Technol 23(8):1289–1299

    Article  Google Scholar 

  27. Yang J, Wright J, Ma Y, Huang T (2008) Image super-resolution as sparse representation of raw image patches. In: CVPR, pp 1–8

  28. Zhang K, Gao X, Tao D, Li X (2012) Single image super-resolution with sparse neighbor embedding. IEEE Trans Image Process 21(7):3194–3205

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

This work was supported by the National Natural Science Foundation of China(No. 61070233,61201323), and Natural Science Foundation projects of Shaanxi Province(No. 2014JQ5189).

Author information

Authors and Affiliations

  1. School of Science, Northwestern Polytechnical University, Xi’an, 710072, China

    Lulu Pan, Weidong Yan & Hongchan Zheng

Authors
  1. Lulu Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weidong Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hongchan Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lulu Pan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, L., Yan, W. & Zheng, H. Super-resolution from a single image based on local self-similarity. Multimed Tools Appl 75, 11037–11057 (2016). https://doi.org/10.1007/s11042-015-2834-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2834-8

Keywords

Search

Navigation