Abstract
Super-resolution (SR) methods are effective for generating a high-resolution image from a single low-resolution image. However, four problems are observed in existing SR methods. (1) They cannot reconstruct many details from a low-resolution infrared image because infrared images always lack detailed information. (2) They cannot extract the desired information from images because they do not consider that images naturally come at different scales in many cases. (3) They fail to reveal different physical structures of low-resolution patch because they extract features from a single view. (4) They fail to extract all the different patterns because they use only one dictionary to represent all patterns. To overcome these problems, we propose a novel SR method for infrared images. First, we combine the information of high-resolution visible light images and low-resolution infrared images to improve the resolution of infrared images. Second, we use multiscale patches instead of fixed-size patches to represent infrared images more accurately. Third, we use different feature vectors rather than a single feature to represent infrared images. Finally, we divide training patches into several clusters, and multiple dictionaries are learned for each cluster to provide each patch with a more accurate dictionary. In the proposed method, clustering information for low-resolution patches is learnt by using fuzzy clustering theory. Experiments validate that the proposed method yields better results in terms of quantization and visual perception than the state-of-the-art algorithms.
Similar content being viewed by others
References
Aguena MLS, Mascarenhas NDA (2006) Multispectral image data fusion using pocs and super-resolution. Comput Vis Image Underst 102(2):178–187
Ben X, Meng W, Yan R, Wang K (2012) An improved biometrics technique based on metric learning approach. Neurocomputing 97(1):44–51
Ben X, Meng W, Yan R, Wang K (2013) Kernel coupled distance metric learning for gait recognition and face recognition. Neurocomputing 120(10):577–589
Cai W, Chen S, Zhang D (2007) Fast and robust fuzzy c -means clustering algorithms incorporating local information for image segmentation. Pattern Recogn 40 (3):825–838
Chang H, Yeung DY, Xiong Y (2004) Super-resolution through neighbor embedding. IEEE conference on computer vision & pattern recognition, pp 275–282
De AH, Wang YCF (2013) Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: IEEE international conference on computer vision, pp 2496–2503
Dodgson NA (1997) Quadratic interpolation for image resampling. IEEE Trans Image Process 6(9):1322–1326
Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. IEEE Comput Graph Appl 22(2):56–65
Fu Z, Wu X, Guan C, Sun X, Ren K (2016) Towards efficient multi-keyword fuzzy search over encrypted outsourced data with accuracy improvement. IEEE Trans Inf Forensics Secur 11(12):2706–2716
Jeon G, Anisetti M, Kang SH (2013) A rank-ordered marginal filter for deinterlacing. Sens (Basel) 13(3):3056–3065
Jeon G, Anisetti M, Kim D, Bellandi V, Damiani E, Jeong J (2009) Fuzzy rough sets hybrid scheme for motion and scene complexity adaptive deinterlacing. Image Vis Comput 27(4):425–436
Jeon G, Min YJ, Anisetti M, Bellandi V, Damiani E, Jeong J (2010) Specification of the geometric regularity model for fuzzy if-then rule-based deinterlacing. J Display Technol 6(6):235–243
Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensic Secur 10(3):507–518
Li X, Hu Y, Gao X, Tao D, Ning B (2010) A multi-frame image super-resolution method. Signal Process 90(2):405–414
Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10(10):1521–1527
Mairal J, Sapiro G, Elad M, Mairal J, Sapiro G (2008) Learning multiscale sparse representations for image and video restoration (preprint). Siam J Multiscale Model Simul 7(1):214–241
Morris NJW, Avidan S, Matusik W, Pfister H (2007) Statistics of infrared images. In: IEEE conference on computer & pattern recognition, pp 17–22
Pan Z, Zhang Y, Kwong S (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176
Protter M, Elad M, Takeda H, Milanfar P (2009) Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Trans Image Process 18(1):36–51
Qu X, Hou Y, Lam Fan, Di G, Zhong J, Chen Z (2014) Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator. Med Image Anal 18(6):843–856
Qu X, Mayzel M, Cai J-F, Chen Z, Orekhov V (2015) Accelerated nmr spectroscopy with low-rank reconstruction. Angew Chem Int Ed Engl 54(3):852–854
Tsai RY, Huang TS, Tsai RY, Huang TS (1984) Multiframe image restoration and registration. In: Advances in computer vision and image processing
Vrigkas M, Nikou C, Kondi LP (2013) Accurate image registration for map image super-resolution. Signal Process Image Commun 28(5):494–508
Wang S, Zhang L, Liang Y, Pan Q (2012) Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis, In: IEEE conference on computer vision & pattern recognition, pp 2216–2223
Wen X, Shao L, Yu X, Fang W (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295:395–406
Wu W, Liu Z, He X (2011) Learning-based super resolution using kernel partial least squares. Image Vis Comput 29(6):394–406
Wu W, Yang X, Liu K, Liu Y, Yan B, Hua H (2016) A new framework for remote sensing image super-resolution Sparse representation-based method by processing dictionaries with multi-type features. J Syst Archit 64:63–75
Wu W, Yang X, Pang Y, Peng J, Jeon G (2013) A multifocus image fusion method by using hidden Markov model. Opt Commun 287(1):63–72
Yang J, Wright J, Huang TS, Ma Y (2010) Image super-resolution via sparse representation. IEEE Trans Image Process 19(11):2861–2873
Yang X, Wu W, Liu K, Zhou Kx, Yan B (2015) Fast multisensor infrared image super-resolution scheme with multiple regression models. J Syst Archit 64:11–25
Yi T, Yuan Y, Yan P, Li X, Pan X, Li L (2011) Single-image super-resolution based on semi-supervised learning. In: Pattern recognition, pp 52–56
Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse-representations. In: International conference on curves and surfaces, pp 711–730
Zhang L, Wu X (2006) An edge-guided image interpolation algorithm via directional filtering and data fusion. IEEE Trans Image Process 15(8):2226–2238
Zhang K, Gao X, Li X, Tao D (2011) Partially supervised neighbor embedding for example-based image super-resolution. IEEE J Sel Top Signal Process 5(2):230–239
Zhang K, Gao X, Tao D, Li X (2012) Multi-scale dictionary for single image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition, pp 1114–1121
Zheng Y, Byeungwoo J, Xu D, Wu JQM, Hui Z (2015) Image segmentation by generalized hierarchical fuzzy c-means algorithm. J Intell Fuzzy Syst 28(2):961–973
Zhou Z, Wang Y, Wu Q, Yang C, Sun X (2016) Effective and efficient global context verification for image copy detection. IEEE Trans Inf Forensics Secur 12(1):48–63
Acknowledgments
The research is sponsored by the National Natural Science Foundation of China(No. 61271330, No. 61473198), also is supported by the Priority Academic Program Development of Jiangsu Higer Education Institutions(PAPD) Fund, Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology(CICAEET) Fund.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, X., Wu, W., Liu, K. et al. Multi-sensor image super-resolution with fuzzy cluster by using multi-scale and multi-view sparse coding for infrared image. Multimed Tools Appl 76, 24871–24902 (2017). https://doi.org/10.1007/s11042-017-4639-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4639-4