Skip to main content
Log in

Multiple dictionary pairs learning and sparse representation-based infrared image super-resolution with improved fuzzy clustering

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Exploring sparse representation to enhance the resolution of infrared image has attracted much attention in the last decade. However, conventional sparse representation-based super-resolution aim at learning a universal and efficient dictionary pair for image representation. However, considering that a large number of different structures exist in an image, it is insufficient and unreasonable to present various image structures with only one universal dictionary pair. In this paper, we propose an improved fuzzy clustering and weighted scheme reconstruction framework to solve this problem. Firstly, the training patches are divided into multiple clusters by joint learning multiple dictionary pairs with improved fuzzy clustering method. The goal of joint learning is to learn the multiple dictionary pairs which could collectively represent all the training patches with smallest reconstruction error. So that the learned dictionary pairs are more precise and mutually complementary. Then, high-resolution (HR) patches are estimated according to several most accurate dictionary pairs. Finally, these estimated HR patches are integrated together to generate a final HR patch by a weighted scheme. Numerous experiments demonstrate that this framework outperforms some state-of-art super-resolution methods in both quantitatively and perceptually.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Chang H, Yeung DY, Xiong Y (2004) Super-resolution through neighbor embedding. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004, vol 1, pp I-275–I-282

  • Chen X, Jeon G, Jeong J (2014) Voting-based directional interpolation method and its application to still color image demosaicking. IEEE Trans Circuits Syst Video Technol 24(2):255–262

    Article  Google Scholar 

  • Chen X, He L, Jeon G, Jeong J (2015) Multidirectional weighted interpolation and refinement method for Bayer pattern CFA demosaicking. IEEE Trans Circuits Syst Video Technol 25(8):1271–1282

    Article  Google Scholar 

  • Farsiu S, Dirk Robinson M, Elad M, Milanfar P (2004) Fast and robust multiframe super resolution. IEEE Trans Image Process A Publ IEEE Signal Process Soc 13(10):1327–1344

    Article  Google Scholar 

  • Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. IEEE Comput Graph Appl 22(2):56–65

    Article  Google Scholar 

  • Gu B, Sun X, Sheng VS (2016) Structural minimax probability machine. IEEE Trans Neural Netw Learn Syst PP(99):1–11

    Google Scholar 

  • Jeon G, Anisetti M, Kim D, Bellandi V, Damiani E, Jeong J (2009) Fuzzy rough sets hybrid scheme for motion and scene complexity adaptive deinterlacing. Image Vis Comput 27(4):425–436

    Article  Google Scholar 

  • Jeon G, Anisetti M, Kang SH (2013) A rank-ordered marginal filter for deinterlacing. Sensors 13(3):3056–65

    Article  Google Scholar 

  • Kimmel R (1999) Demosaicing: image reconstruction from color CCD samples. IEEE Trans Image Process A Publ IEEE Signal Process Soc 8(9):1221–1228

    Article  Google Scholar 

  • Li X (2005) Demosaicing by successive approximation. IEEE Trans Image Process A Publ IEEE Signal Process Soc 14(3):370–379

    Google Scholar 

  • Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forens Secur 10(3):507–518

    Article  Google Scholar 

  • Monaci G, Vandergheynst P (2004) Learning structured dictionaries for image representation. In: International conference on image processing, 2004, vol 4. ICIP ’04. IEEE, pp 2351–2354

  • Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176

    Article  Google Scholar 

  • Shen H, Zhang L, Huang B, Li P (2007) A map approach for joint motion estimation, segmentation, and super resolution. IEEE Trans Image Process A Publ IEEE Signal Process Soc 16(2):479–490

    Article  MathSciNet  Google Scholar 

  • Wang X, Tang X (2005) Hallucinating face by eigentransformation. IEEE Trans Syst Man Cybern C 35(3):425–434

    Article  Google Scholar 

  • Wang J, Li T, Shi Y-Q, Lian S, Ye J (2016) Forensics feature analysis in quaternion wavelet domain for distinguishing photographic images and computer graphics. Multimed Tools Appl. doi:10.1007/11042-016-4153-0

  • Wei W, Liu Z, He X (2011) Learning-based super resolution using kernel partial least squares. Image Vis Comput 29(6):394–406

    Article  Google Scholar 

  • Xia Z, Wang X, Zhang L, Qin Z, Sun X, Ren K (2016) A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing. IEEE Trans Inf Forens Secur 11(11):2594–2608

    Article  Google Scholar 

  • Yang J, Wright J, Huang TS, Ma Y (2010) Image super-resolution via sparse representation. IEEE Trans Image Process A Publ IEEE Signal Process Soc 19(11):2861–2873

    Article  MathSciNet  MATH  Google Scholar 

  • Yang S, Liu Z, Wang M, Sun F, Jiao L (2011) Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction. Neurocomputing 74(17):3193–3203

    Article  Google Scholar 

  • Yang X, Liu K, Gan Z, Yan B (2016) Multiscale and multitopic sparse representation for multisensor infrared image superresolution. J Sens 1–14:2015

    Google Scholar 

  • Zhang L, Zhang H, Shen H, Li P (2010) A super-resolution reconstruction algorithm for surveillance images. Signal Process 90(3):848–859

    Article  MATH  Google Scholar 

  • Zhang K, Gao X, Li X, Tao D (2011) Partially supervised neighbor embedding for example-based image super-resolution. 5(2):230–239

  • Zhangjie F, Xinle W, Guan C, Sun X, Ren K (2016) Toward efficient multi-keyword fuzzy search over encrypted outsourced data with accuracy improvement. IEEE Trans Inf Forens Secur 11(12):1–1

  • Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations. Springer, Berlin

    MATH  Google Scholar 

  • Zhou Z, Wang Y, Jonathan Wu QM, Yang CN, Sun X (2016) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forens Secur 12(1):48–63

    Article  Google Scholar 

Download references

Acknowledgements

The research is sponsored by the National Natural Science Foundation of China (Nos. 61701327, 61711540303 and 61473198), also is supported by the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD) Fund, Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology(CICAEET) Fund.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Wu.

Ethics declarations

Conflict of interest

All the authors declare that they have no conflict of interest.

Additional information

Communicated by M. Anisetti.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, X., Wu, W., Liu, K. et al. Multiple dictionary pairs learning and sparse representation-based infrared image super-resolution with improved fuzzy clustering. Soft Comput 22, 1385–1398 (2018). https://doi.org/10.1007/s00500-017-2812-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2812-3

Keywords

Navigation