Skip to main content

A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries

  • Conference paper
  • First Online:
Book cover Pattern Recognition and Computer Vision (PRCV 2019)

Abstract

With the advent of WorldView series imageries (WorldView-2/3/4), it is necessary to develop new fusion approaches for remote sensing images with higher spatial and spectral resolutions. Since most existing fusion approaches are not well capable of merging multi-spectral images with eight bands, a new hybrid pan-sharpening approach is proposed in this paper. The hybrid framework integrates the multiplicative model and additive model to improve the quality of multi-spectral images. In the additive procedure, the nonnegative matrix factorization (NMF) algorithm is utilized to synthesize the intensity component for obtaining the mutual information from multi-spectral images. Then the difference information between the panchromatic image and synthetic component is injected into multi-spectral images by the spectral-adjustable weights. In the multiplicative procedure, the smoothing filter-based intensity modulation (SFIM) is used to modulate the preliminary fusion. The nonlinear fitting method is utilized to calculate the optimal parameters of the hybrid model. Visual and quantitative assessments of fused images show that the proposed approach clearly improves the fusion quality compared to the state-of-the-art algorithms.

Supported by the National Nature Science Foundation of China (NO.61402368 and NO.61702419), Aerospace Support Fund (2017-HT-XGD), Aerospace Science and Technology Innovation Foundation (2017 ZD 53047).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, S., Kang, X., Fang, L., et al.: Pixel-level image fusion: a survey of the state of the art. Inform. Fusion 33, 100–112 (2017)

    Article  Google Scholar 

  2. Vivone, G., Alparone, L., Chanussot, J., et al.: A critical comparison among pansharpening algorithms. IEEE Trans. Geosci. Remote 53(5), 2565–2586 (2014)

    Article  Google Scholar 

  3. Thomas, C., Ranchin, T., Wald, L., et al.: Synthesis of multispectral images to high spatial resolution: a critical review of fusion methods based on remote sensing physics. IEEE Trans. Geosci. Remote 46(5), 1301–1312 (2008)

    Article  Google Scholar 

  4. Zhang, Q., Liu, Y., Blum, R.S., et al.: Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: a review. Inform. Fusion 40, 57–75 (2018)

    Article  Google Scholar 

  5. Liu, J.G.: Smoothing filter-based intensity modulation: a spectral preserve image fusion technique for improving spatial details. Int. J. Remote Sens. 21(18), 3461–3472 (2000)

    Article  Google Scholar 

  6. Tu, T., Hsu, C., Tu, P., et al.: An adjustable Pan-sharpening approach for IKONOS/QuickBird/GeoEye-1/WorldView-2 imagery. IEEE J.-STARS 5, 125–134 (2012)

    Google Scholar 

  7. Aiazzi, B., Baronti, S., Selva, M.: Improving component substitution pansharpening through multivariate regression of ms +pan data. IEEE Trans. Geosci. Remote 45(10), 3230–3239 (2007)

    Article  Google Scholar 

  8. Choi, J., Yu, K., Kim, Y.: A new adaptive component-substitution-based satellite image fusion by using partial replacement. IEEE Trans. Geosci. Remote 49(1), 295–309 (2011)

    Article  Google Scholar 

  9. Wang, W., Jiao, L., Yang, S.: Novel adaptive component-substitution-based pan-sharpening using particle swarm optimization. IEEE GRSL 12(4), 781–785 (2015)

    Google Scholar 

  10. Garzelli, A., Nencini, F.: Panchromatic sharpening of remote sensing images using a multiscale kalman filter. Pattern Recogn. 40(12), 3568–3577 (2007)

    Article  Google Scholar 

  11. Mahyari, A.G., Yazdi, M.: Panchromatic and multispectral image fusion based on maximization of both spectral and spatial similarities. IEEE Trans. Geosci. Remote 49(6), 1976–1985 (2011)

    Article  Google Scholar 

  12. Shahdoosti, H., Ghassemian, H.: Fusion of MS and PAN images preserving spectral quality. IEEE GRSL 12(3), 611–615 (2015)

    Google Scholar 

  13. Tu, T., Huang, P.S., Hung, C., et al.: A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE GRSL 1(4), 309–312 (2004)

    Google Scholar 

  14. Wang, Z., Ziou, D., Armenakis, C., et al.: A comparative analysis of image fusion methods. IEEE Trans. Geosci. Remote 43(6), 1391–1402 (2005)

    Article  Google Scholar 

  15. Gonzalez-Audicana, M., Saleta, J.L., Catalan, R.G., et al.: Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition. IEEE Trans. Geosci. Remote 42(6), 1291–1299 (2004)

    Article  Google Scholar 

  16. Alparone, L., Aiazzi, B.: MTF-tailored multiscale fusion of high-resolution MS and PAN imagery. Photogramm. Eng. Remote Sens. 72(5), 591–596 (2006)

    Article  Google Scholar 

  17. Guo, Q., Ehlers, M., Wang, Q., et al.: Ehlers pan-sharpening performance enhancement using HCS transform for n-band data sets. Int. J. Remote Sens. 38(17), 4974–5002 (2017)

    Article  Google Scholar 

  18. Aiazzi, B., Baronti, S., Lotti, F., et al.: A comparison between global andcontext-adaptive pansharpening of multispectral images. IEEE GRSL 6(2), 302–306 (2009)

    Google Scholar 

  19. Tu, T., Lee, Y., Huang, P., et al.: Modified smoothing-filter-based technique for IKONOS-quickbird image fusion. Opt. Eng. 45(6), 711–725 (2006)

    Article  Google Scholar 

  20. Xia, Z., Feng, X., Peng, J., et al.: A regularized optimization framework for tag completion and image retrieval. Neurocomputing 147, 500–508 (2015)

    Article  Google Scholar 

  21. Xia, Z., Peng, X., Feng, X., et al.: Scarce face recognition via two-layer collaborative representation. IET Biom. 7(1), 56–62 (2018)

    Article  Google Scholar 

  22. Lin, C.: Projected gradient methods for nonnegative matrix factorization. Neural Comput. 19(10), 2756–2779 (2007)

    Google Scholar 

  23. Chang, H.W., Yang, H., Gan, Y., et al.: Sparse feature fidelity for perceptual image quality assessment. IEEE Trans. Image Process. 22(10), 4007–4018 (2013)

    Article  MathSciNet  Google Scholar 

  24. Alparone, L., Wald, L., Chanussot, J., et al.: Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Trans. Geosci. Remote 45(10), 3012–3021 (2007)

    Article  Google Scholar 

  25. Alparone, L., Aiazzi, B., Baronti, S., et al.: Multispectral and panchromatic data fusion assessment without reference. Photogramm. Eng. Remote Sens. 74(2), 193–200 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guiqing He .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

He, G., Ji, J., Zhang, Q., Xia, Z. (2019). A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2019. Lecture Notes in Computer Science(), vol 11858. Springer, Cham. https://doi.org/10.1007/978-3-030-31723-2_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31723-2_60

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31722-5

  • Online ISBN: 978-3-030-31723-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics