Abstract
This paper attempts to reduce the spectral distortion and enhance the spatial information of fused images. For this purpose, the author presented a novel pansharpening method based on support vector transform (SVT) and semi-nonnegative matrix factorization (semi-NMF). The proposed method involves three steps. In step one, SVT was performed on panchromatic and multispectral images. In step two, the low-frequency components were processed by semi-NMF-based fusion rule, while the high-frequency components were treated by the regional energy-weighted fusion rule. In step three, the fused images were reconstructed by the fused high-frequency and low-frequency components. After that, the proposed method was compared with other related methods through experiments on several datasets collected from QuickBird and GeoEye-1. The comparison shows that the proposed method outperforms the compared approaches. The research findings shed new light on the preservation of spatial and spectral information in image fusion.
Similar content being viewed by others
References
Akula RT, Gupta R, Devi MRV (2012) An efficient pan-sharpening technique by merging two hybrid approaches. Procedia Engineering 30(9):535–541
Alparone L, Baronti S, Garzelli A, Nencini F (2004) A global quality measurement of pan-sharpened multispectral imagery. IEEE Geoscience & Remote Sensing Letters 1(4):313–317
Alparone L, Wald L, Chanussot J, Thomas C, Gamba P, Bruce LM (2007) Comparison of pansharpening algorithms: outcome of the 2006 GRS-S data-fusion contest. IEEE Transactions on Geoscience & Remote Sensing 45(10):3012–3021
Bovolo F, Bruzzone L, Capobianco L, Garzelli A, Marchesi S, Nencini F (2010) Analysis of the effects of pansharpening in change detection on VHR images. IEEE Geoscience & Remote Sensing Letters 7(1):53–57
Ding C, Li T, Jordan MI (2010) Convex and semi-nonnegative matrix factorizations. IEEE Transactions on Pattern Analysis & Machine Intelligence 32(1):45–55
Garzelli A, Nencini F (2006) Pan-sharpening of very high resolution multispectral images using genetic algorithms. Int J Remote Sens 27(15):3273–3292
Ghahremani M, Ghassemian H (2016) A compressed-sensing-based pan-sharpening method for spectral distortion reduction. IEEE Transactions on Geoscience & Remote Sensing 54(4):2194–2206
Guo R, Zhang L, Xing M, Li J (2010) Polarimetric SAR image fusion using nonnegative matrix factorisation and improved-RGB model. Electron Lett 46(20):1399–1401
Hoyer PO (2002) Non-negative sparse coding. Neural Networks for Signal Processing, 2002. Proceedings of the 2002, IEEE Workshop on. IEEE, 2002: 557–565
Jiang C, Zhang H, Shen H, Zhang L (2014) Two-step sparse coding for the pan-sharpening of remote sensing images. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7(5):1792–1805
Johnson BA, Tateishi R, Hoan NT (2013) A hybrid pansharpening approach and multiscale object-based image analysis for mapping diseased pine and oak trees. Int J Remote Sens 34(20):6969–6982
Karathanassi V, Kolokousis P, Ioannidou S (2007) A comparison study on fusion methods using evaluation indicators. Int J Remote Sens 28(10):2309–2341
Laben CA, Brower BV. (2000) Process for enhancing the spatial resolution of multispectral imagery using pan-sharpening. U.S. Patent 6011875, Jan. 4
Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791
Li S, Yang B (2011) A new pan-sharpening method using a compressed sensing technique. IEEE Transactions on Geoscience & Remote Sensing 49(2):738–746
Li SZ, Hou XW, Zhang HJ, Cheng Q (2001) Learning spatially localized, parts-based representation. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on. IEEE, 2001: I-207-I-212 vol.1
Li S, Yin H, Fang L (2013) Remote sensing image fusion via sparse representations over learned dictionaries. IEEE Transactions on Geoscience & Remote Sensing 51(9):4779–4789
Li H, Liu F, Yang S, Zhang K, Su X, Jiao L (2016) Refined pan-sharpening with NSCT and hierarchical sparse autoencoder. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 9(12):5715–5725
Li H, Liu F, Zhang K (2016) Remote sensing image fusion based on sparse non-negative matrix factorization. Journal of Xidian University 43(2):193–198
Liu Y, Liao Y, Tang L, Tang F, Liu W (2016) General subspace constrained non-negative matrix factorization for data representation. Neurocomputing 173(1):224–232
Miao Q, Wang B (2005) A novel algorithm of multi-sensor image fusion using non-negative matrix factorization. Journal of Computer Aided Design & Computer Graphics 17(9):2029–2032
Otazu X, Audicana MG, Fors O, Nunez J (2010) Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods. IEEE Transactions on Geoscience & Remote Sensing 43(10):2376–2385
Psjr C, Sides SC, Anderson JA (1991) Comparison of three different methods to merge multiresolution and multispectral data: landsat TM and SPOT panchromatic. Photogramm Eng Remote Sens 57(3):265–303
Ranchin T, Wald L (2000) Fusion of high spatial and spectral resolution images: the arsis concept and its implementation. Photogramm Eng Remote Sens 66(2):49–61
Rong KX, Jiao LC, Wang S, Liu F (2017) Pansharpening based on low-rank and sparse decomposition. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7(12):4793–4805
Samat A, Gamba P, Liu S, Du P, Abuduwaili J (2016) Jointly informative and manifold structure representative sampling based active learning for remote sensing image classification. IEEE Transactions on Geoscience & Remote Sensing 54(11):6803–6817
Shah VP, Younan NH, King RL (2008) An efficient pan-sharpening method via a combined adaptive PCA approach and contourlets. IEEE Transactions on Geoscience & Remote Sensing 46(5):1323–1335
Shah VP, Younan NH, King R (2008) Pan-sharpening via the contourlet transform. Geoscience and Remote Sensing Symposium, 2007. IGARSS 2007. IEEE International. IEEE, 2008: 310–313
Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300
Thomas C, Ranchin T, Wald L, Chanussot J (2008) Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics. IEEE Transactions on Geoscience & Remote Sensing 46(5):1301–1312
Tu TM, Su SC, Shyu HC, Huang PS (2001) A new look at IHS-like image fusion methods. Information Fusion 2(3):177–186
Tu TM, Huang PS, Hung CL, Chang CP (2004) A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geoscience & Remote Sensing Letters 1(4):309–312
Vivone G, Alparone L, Chanussot J, Mura MD, Garzelli A, Licciardi GA, Restaino R, Wald L (2015) A critical comparison among pansharpening algorithms. IEEE Transactions on Geoscience & Remote Sensing 53(5):2565–2586
Wang Z, Bovik AC (2002) A universal image quality index. IEEE Signal Processing Letters 9(3):81–84
Wang Z, Yu X, Zhang L (2008) A remote sensing image fusion algorithm based on constrained nonnegative matrix factorization. Journal of Beijing Normal University 4(4):672–676
Wang N, Du B, Zhang L (2013) An endmember dissimilarity constrained non-negative matrix factorization method for hyperspectral unmixing. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 6(2):554–569
Wang WQ, Jiao LC, Yang SY, Rong KX (2015) Distributed compressed sensing-based pan-sharpening with hybrid dictionary. Neurocomputing 155(5):320–333
Xu R, Li Y, Xing M (2013) Fusion of multi-aspect radar images via sparse non-negative matrix factorisation. Electron Lett 49(25):1635–1637
Yang XH, Jiao LC (2008) Fusion algorithm for remote sensing images based on nonsubsampled contourlet transform. Acta Automat Sin 34(3):274–281
Yang SY, Wang M, Jiao LC (2012) Contourlet hidden markov tree and clarity-saliency driven PCNN based remote sensing images fusion. Appl Soft Comput 12(1):228–237
Yang SY, Wang M, Jiao LC (2012) Fusion of multispectral and panchromatic images based on support value transform and adaptive principal component analysis. Information Fusion 13(3):177–184
Yang S, Zhang K, Wang M (2017) Learning low-rank decomposition for pan-sharpening with spatial-spectral offsets. IEEE Transactions on Neural Networks & Learning Systems 99:1–11. https://doi.org/10.1109/TNNLS.2017.2736011
Yi Y, Shi Y, Zhang H, Wang J, Kong J (2015) Label propagation based semi-supervised non-negative matrix factorization for feature extraction. Neurocomputing 149(2):1021–1037
Yin H, Li S (2015) Pansharpening with multiscale normalized nonlocal means filter: a two-step approach. IEEE Transactions on Geoscience & Remote Sensing 53(10):5734–5745
Yuhas R, Goetz AFH, Boardman JW (1992) Descrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. Proceedings of Summaries 4th JPL Airborne Earth Science Workshop, 1992
Zhan Y, Chen L, Jia J, Zhao Z (2014) Multi-focus image fusion based on non-negative matrix factorization and difference images. Signal Process 105(12):84–97
Zhang L, Zhang L, Tao D, Huang X (2011) A multifeature tensor for remote-sensing target recognition. IEEE Geoscience & Remote Sensing Letters 8(2):374–378
Zhang K, Wang M, Yang SY, Xing YH, Qu R (2016) Fusion of panchromatic and multispectral images via coupled sparse non-negative matrix factorization. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 9(12):5740–5747
Zhu XX, Bamler R (2013) A sparse image fusion algorithm with application to pan-sharpening. IEEE Transactions on Geoscience & Remote Sensing 51(5):2827–2836
Acknowledgements
The authors would like to thank the anonymous reviewers and the editor for suggesting various changes. And this work was supported by the National Natural Science Foundation of China (No. 81473559), the Natural Science Basic Research Plan in Shaanxi Province of China (No. 2017JM6086), the Science Basic Research Program in Shaanxi Province of China (No. 16JK1823), the Innovation Program in Shaanxi Province of China (No. 2018KRM145), the Science Basic Research Program in Xianyang Normal University of China (No. XSYK18012).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, H., Li, W. & Liu, S. Pansharpening with support vector transform and semi-nonnegative matrix factorization. Multimed Tools Appl 78, 7563–7578 (2019). https://doi.org/10.1007/s11042-018-6499-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6499-y