Skip to main content
SpringerLink
Log in

Image pan-sharpening using enhancement based approaches in remote sensing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes to do image enhancement before pan-sharpening; that is, the image enhancement techniques are used as a pre-processing step. The image enhancement techniques are proposed in two domains, same-domain and cross-domain. In the same-domain methods, the image enhancement techniques (such as Laplacian, Unsharp) are simply applied to multispectral (MS) and panchromatic (PAN) images to sharpen both images in the spatial domain. While in cross-domain, a novel hybrid combination of Laplacian Filter (LF) and Discrete Fourier Transformation (DFT) image sharpening technique is introduced. After image enhancement, the powerful Matting Model (MM) pan-sharpening technique is used to fuse both the enhanced images and produce a resultant image with the high spatial and spectral resolutions. The experimental results of the proposed approach outperform the others as compared to the state-of-art techniques over three datasets. The results are evaluated, considering both Qualitative and Quantitative evaluation metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Abdullah SMU, ur Rehman N, Khan MM, Mandic DP (2015) A multivariate empirical mode decomposition-based approach to pansharpening. IEEE Trans Geosci Remote Sens 53(7):3974–3984

    Article  Google Scholar 

  2. Aiazzi B, Baronti S, Selva M (2007) Improving component substitution pansharpening through multivariate regression of MS $+ $ Pan data. IEEE Trans Geosci Remote Sens 45(10):3230–3239

    Article  Google Scholar 

  3. Beaudoin N, Beauchemin SS (2002) An accurate discrete Fourier transform for image processing. In Object recognition supported by user interaction for service robots (Vol. 3, pp. 935-939). IEEE

  4. Benzenati T, Kessentini Y, Kallel A, Hallabia H (2019) Generalized Laplacian pyramid Pan-sharpening gain injection prediction based on CNN. IEEE Geosci Remote Sens Lett

  5. Bovolo F, Bruzzone L, Capobianco L, Garzelli A, Marchesi S, Nencini F (2009) Analysis of the effects of pansharpening in change detection on VHR images. IEEE Geosci Remote Sens Lett 7(1):53–57

    Article  Google Scholar 

  6. Chen Y, Zhang M, Li W, Du Q (2018) Joint feature extraction for multispectral and panchromatic images based on convolutional neural network. In IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium (pp. 5005-5008). IEEE

  7. Choi J, Yu K, Kim Y (2010) A new adaptive component-substitution-based satellite image fusion by using partial replacement. IEEE Trans Geosci Remote Sens 49(1):295–309

    Article  Google Scholar 

  8. Ehlers M, Klonus S, Johan Åstrand P, Rosso P (2010) Multi-sensor image fusion for pansharpening in remote sensing. Int J Image Data Fusion 1(1):25–45

    Article  Google Scholar 

  9. Gangkofner UG, Pradhan PS, Holcomb DW (2007) Optimizing the high-pass filter addition technique for image fusion. Photogramm Eng Remote Sens 73(9):1107–1118

    Article  Google Scholar 

  10. Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Futur Gener Comput Syst 88:501–511

    Article  Google Scholar 

  11. Ghassemian H (2016) A review of remote sensing image fusion methods. Information Fusion 32:75–89

    Article  Google Scholar 

  12. Hariharan K, Raajan NR (2018) Performance enhanced hyperspectral and multispectral image fusion technique using ripplet type-II transform and deep neural networks for multimedia applications. Multimedia Tools and Applications, 1-10

  13. Ibarrola-Ulzurrun E, Gonzalo-Martin C, Marcello-Ruiz J, Garcia-Pedrero A, Rodriguez-Esparragon D (2017) Fusion of high resolution multispectral imagery in vulnerable coastal and land ecosystems. Sensors 17(2):228

    Article  Google Scholar 

  14. Javed U, Riaz MM, Ghafoor A, Ali SS, Cheema TA (2014) MRI and PET image fusion using fuzzy logic and image local features. Sci World J 2014:1–8

    Google Scholar 

  15. Kahraman S, Ertürk A (2017) A comprehensive review of Pansharpening algorithms for GÖKTÜRK-2 satellite images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 4:263

    Article  Google Scholar 

  16. Kalpoma KA, Kudoh JI (2007) Image fusion processing for IKONOS 1-m color imagery. IEEE Trans Geosci Remote Sens 45(10):3075–3086

    Article  Google Scholar 

  17. Kang X, Li S, Benediktsson JA (2013) Pansharpening with matting model. IEEE Trans Geosci Remote Sens 52(8):5088–5099

    Article  Google Scholar 

  18. Khan SS, Ran Q (2019) Multi-focus color image fusion using Laplacian filter and discrete Fourier transformation with qualitative error image metrics. In Proceedings of the 2nd International Conference on Control and Computer Vision (pp. 41-45). ACM.

  19. Khan SS, Ran Q (2019) Pan-sharpening framework based on Laplacian sharpening with Brovey IEEE international conference on signal, Information and Data Processing

  20. Khan SS, Khan M, Alharbi Y (2020) Multi focus image fusion using image enhancement techniques with wavelet transformation. (IJACSA) International Journal of Advanced Computer Science and Application 11, 5

  21. Laporterie-Déjean F, de Boissezon H, Flouzat G, Lefèvre-Fonollosa MJ (2005) Thematic and statistical evaluations of five panchromatic/multispectral fusion methods on simulated PLEIADES-HR images. Information Fusion 6(3):193–212

    Article  Google Scholar 

  22. Levin A, Lischinski D, Weiss Y (2007) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242

    Article  Google Scholar 

  23. Li H, Li W, Liu S (2019) Pansharpening with support vector transform and semi-nonnegative matrix factorization. Multimed Tools Appl 78(6):7563–7578

    Article  Google Scholar 

  24. Liu J, Ma J, Fei R, Li H, Zhang J (2019) Enhanced Back-projection as Postprocessing for Pansharpening. Remote Sens 11(6):712

    Article  Google Scholar 

  25. Mokrzycki WS, Samko MA (2009) Gradient based method of color edges finding. In book: image processing \& communications challenges; edition: I, chapter: 45, Publisher: EXIT, editors: Choraś et all, pp.429-438

  26. Padwick C, Deskevich M, Pacifici F, Smallwood S (2010) WorldView-2 pan-sharpening. In Proceedings of the ASPRS 2010 Annual Conference, San Diego, CA, USA (Vol. 2630).

  27. Polesel A, Ramponi G, Mathews VJ (2000) Image enhancement via adaptive unsharp masking. IEEE Trans Image Process 9(3):505–510

    Article  Google Scholar 

  28. Siddique A, Xiao B, Li W, Nawaz Q, Hamid I (2018) Multi-focus image fusion using block-wise color-principal component analysis. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 458-462). IEEE

  29. Tan H, Huang X, Tan H, He C (2013) Pixel-level image fusion algorithm based on maximum likelihood and Laplacian pyramid transformation. Journal of Computational Information Systems 9(1):327–334

    Google Scholar 

  30. Tierney, S., Gao, J., & Guo, Y. (2014). Affinity pansharpening and image fusion. In 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA) (pp. 1-8). IEEE.

  31. Trentacoste M, Mantiuk R, Heidrich W, Dufrot F (2012) Unsharp masking, countershading and halos: Enhancements or artifacts?. In Computer Graphics Forum (Vol. 31, No. 2pt3, pp. 555–564). Oxford, UK: Blackwell Publishing Ltd

  32. Wang X, Tao J, Shen Y, Bai S, Song C (2019) A NSST Pansharpening method based on directional neighborhood correlation and tree structure matching. Multimedia Tools and Applications, 1-20

  33. Wu H, Zhao S, Zhang J, Lu C (2019) Remote sensing image sharpening by integrating multispectral image super-resolution and convolutional sparse representation fusion. IEEE Access 7:46562–46574

    Article  Google Scholar 

  34. Xu Y, Smith SE, Grunwald S, Abd-Elrahman A, Wani SP (2018) Effects of image pansharpening on soil total nitrogen prediction models in South India. Geoderma 320:52–66

    Article  Google Scholar 

  35. Yang Y, Wan W, Huang S, Lin P, Que Y (2017) A novel pan-sharpening framework based on matting model and multiscale transform. Remote Sens 9(4):391

    Article  Google Scholar 

  36. Yang C, Zhan Q, Liu H, Ma R (2018) An IHS-based Pan-sharpening method for spectral Fidelity improvement using Ripplet transform and compressed sensing. Sensors 18(11):3624

    Article  Google Scholar 

  37. Zhang Y (1999) A new merging method and its spectral and spatial effects. Int J Remote Sens 20(10):2003–2014

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Information Science and Technology, Beijing University of Chemical Technology, Beijing, 100029, China

    Sarwar Shah Khan & Qiong Ran

  2. Department of Computer &Software Technology, University of Swat, Swat, 19130, Pakistan

    Muzammil Khan

Authors
  1. Sarwar Shah Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qiong Ran
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muzammil Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qiong Ran.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khan, S.S., Ran, Q. & Khan, M. Image pan-sharpening using enhancement based approaches in remote sensing. Multimed Tools Appl 79, 32791–32805 (2020). https://doi.org/10.1007/s11042-020-09682-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09682-z

Keywords

Search

Navigation