Abstract
With the advent of WorldView series imageries (WorldView-2/3/4), it is necessary to develop new fusion approaches for remote sensing images with higher spatial and spectral resolutions. Since most existing fusion approaches are not well capable of merging multi-spectral images with eight bands, a new hybrid pan-sharpening approach is proposed in this paper. The hybrid framework integrates the multiplicative model and additive model to improve the quality of multi-spectral images. In the additive procedure, the nonnegative matrix factorization (NMF) algorithm is utilized to synthesize the intensity component for obtaining the mutual information from multi-spectral images. Then the difference information between the panchromatic image and synthetic component is injected into multi-spectral images by the spectral-adjustable weights. In the multiplicative procedure, the smoothing filter-based intensity modulation (SFIM) is used to modulate the preliminary fusion. The nonlinear fitting method is utilized to calculate the optimal parameters of the hybrid model. Visual and quantitative assessments of fused images show that the proposed approach clearly improves the fusion quality compared to the state-of-the-art algorithms.
Supported by the National Nature Science Foundation of China (NO.61402368 and NO.61702419), Aerospace Support Fund (2017-HT-XGD), Aerospace Science and Technology Innovation Foundation (2017 ZD 53047).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Li, S., Kang, X., Fang, L., et al.: Pixel-level image fusion: a survey of the state of the art. Inform. Fusion 33, 100–112 (2017)
Vivone, G., Alparone, L., Chanussot, J., et al.: A critical comparison among pansharpening algorithms. IEEE Trans. Geosci. Remote 53(5), 2565–2586 (2014)
Thomas, C., Ranchin, T., Wald, L., et al.: Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics. IEEE Trans. Geosci. Remote 46(5), 1301–1312 (2008)
Zhang, Q., Liu, Y., Blum, R.S., et al.: Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: a review. Inform. Fusion 40, 57–75 (2018)
Liu, J.G.: Smoothing filter-based intensity modulation: a spectral preserve image fusion technique for improving spatial details. Int. J. Remote Sens. 21(18), 3461–3472 (2000)
Tu, T., Hsu, C., Tu, P., et al.: An adjustable Pan-sharpening approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 imagery. IEEE J.-STARS 5, 125–134 (2012)
Aiazzi, B., Baronti, S., Selva, M.: Improving component substitution pansharpening through multivariate regression of ms +pan data. IEEE Trans. Geosci. Remote 45(10), 3230–3239 (2007)
Choi, J., Yu, K., Kim, Y.: A new adaptive component-substitution-based satellite image fusion by using partial replacement. IEEE Trans. Geosci. Remote 49(1), 295–309 (2011)
Wang, W., Jiao, L., Yang, S.: Novel adaptive component-substitution-based pan-sharpening using particle swarm optimization. IEEE GRSL 12(4), 781–785 (2015)
Garzelli, A., Nencini, F.: Panchromatic sharpening of remote sensing images using a multiscale kalman filter. Pattern Recogn. 40(12), 3568–3577 (2007)
Mahyari, A.G., Yazdi, M.: Panchromatic and multispectral image fusion based on maximization of both spectral and spatial similarities. IEEE Trans. Geosci. Remote 49(6), 1976–1985 (2011)
Shahdoosti, H., Ghassemian, H.: Fusion of MS and PAN images preserving spectral quality. IEEE GRSL 12(3), 611–615 (2015)
Tu, T., Huang, P.S., Hung, C., et al.: A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE GRSL 1(4), 309–312 (2004)
Wang, Z., Ziou, D., Armenakis, C., et al.: A comparative analysis of image fusion methods. IEEE Trans. Geosci. Remote 43(6), 1391–1402 (2005)
Gonzalez-Audicana, M., Saleta, J.L., Catalan, R.G., et al.: Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition. IEEE Trans. Geosci. Remote 42(6), 1291–1299 (2004)
Alparone, L., Aiazzi, B.: MTF-tailored multiscale fusion of high-resolution MS and PAN imagery. Photogramm. Eng. Remote Sens. 72(5), 591–596 (2006)
Guo, Q., Ehlers, M., Wang, Q., et al.: Ehlers pan-sharpening performance enhancement using HCS transform for n-band data sets. Int. J. Remote Sens. 38(17), 4974–5002 (2017)
Aiazzi, B., Baronti, S., Lotti, F., et al.: A comparison between global andcontext-adaptive pansharpening of multispectral images. IEEE GRSL 6(2), 302–306 (2009)
Tu, T., Lee, Y., Huang, P., et al.: Modified smoothing-filter-based technique for IKONOS-quickbird image fusion. Opt. Eng. 45(6), 711–725 (2006)
Xia, Z., Feng, X., Peng, J., et al.: A regularized optimization framework for tag completion and image retrieval. Neurocomputing 147, 500–508 (2015)
Xia, Z., Peng, X., Feng, X., et al.: Scarce face recognition via two-layer collaborative representation. IET Biom. 7(1), 56–62 (2018)
Lin, C.: Projected gradient methods for nonnegative matrix factorization. Neural Comput. 19(10), 2756–2779 (2007)
Chang, H.W., Yang, H., Gan, Y., et al.: Sparse feature fidelity for perceptual image quality assessment. IEEE Trans. Image Process. 22(10), 4007–4018 (2013)
Alparone, L., Wald, L., Chanussot, J., et al.: Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Trans. Geosci. Remote 45(10), 3012–3021 (2007)
Alparone, L., Aiazzi, B., Baronti, S., et al.: Multispectral and panchromatic data fusion assessment without reference. Photogramm. Eng. Remote Sens. 74(2), 193–200 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
He, G., Ji, J., Zhang, Q., Xia, Z. (2019). A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2019. Lecture Notes in Computer Science(), vol 11858. Springer, Cham. https://doi.org/10.1007/978-3-030-31723-2_60
Download citation
DOI: https://doi.org/10.1007/978-3-030-31723-2_60
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-31722-5
Online ISBN: 978-3-030-31723-2
eBook Packages: Computer ScienceComputer Science (R0)