Abstract
A fast variational fusion model based on partial differential equations (PDEs) is presented for pansharpening. The functional framework consists of several energy terms. The gradient energy term is created by calculating the gradient vector field of the panchromatic image and the geometry of the pan is injected into the multi-spectral bands. The radiometric reduction energy term and the channel correlation energy term are defined to decrease the radiometric distortion and preserve the correlation of multi-spectral channels while enforcing the inter-bands coherence. Inspired by the shock-filtering model, an inverse diffusion term for image enhancement is put to PDEs which are deduced by minimizing the energy functional. In comparison with the state-of-the-art fusion approaches based on `a trous wavelet and non-sampled contourlet, our model can obtain the fused image with a high spatial or spectral quality by adjusting the weight coefficients of the energy terms. It can also achieve a rather good trade-off between the spatial resolution improvement and the spectral quality preserving. Our model’s computational complexity for one time step is only O(N).
Similar content being viewed by others
References
Gonzles-Audcana M, Saleta J L, Cataln R G, et al. Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition. IEEE Trans Geosci Remote Sens, 2004, 42: 1291–1299
Nez J, Otazu X, Fors O, et al. Multiresolution-based image fusion with additive wavelet decomposition. IEEE Trans Geosci Remote Sens, 1999, 37: 1204–1211
Choi M, Kim R Y, Nam M R, et al. Fusion of multispectral and panchromatic satellite images using the curvelet transform. IEEE Trans Geosci Remote Sens Lett, 2005, 2: 136–140
Nencini F, Garzell A, Baronti S, et al. Remote sensing image fusion using the curvelet transform. Inf Fusion, 2007, 8: 143–156
Do M N, Vetterli M. The contourlet transform: An efficient directional multiresolution image representation. IEEE Trans Image Proc, 2005, 14: 2091–2106
Shah V, Younan N, King R. An efficient Pan-sharpening method via a combined adaptive-PCA approach and contourlets. IEEE Trans Geosci Remote Sens, 2008, 46: 1323–1335
Li S T, Yang B. Hybrid multiresolution method for multisensor multimodal image fusion. IEEE Sens J, 2010, 10: 1519–1526
Alparone L, Wald L, Chanussot J, et al. Comparison of pansharpening algorithms: Outcomes of the 2006 grs-s datafusion contest. IEEE Trans Geosci Remote Sens, 2007, 45: 3012–3021
Amro I, Mateos J, Vega M. Bayesian super-resolution pansharpening using contourlets. In: Proceedings of 2010 IEEE 17th International Conference on Image Processing, Hong Kong, 2010. 809–812
Kong W W, Lei Y J, Lei Y, et al. Technique for image fusion based on non-subsampled contourlet transform domain improved NMF. Sci China Inf Sci, 2010, 53: 2429–2440
Socolinsky D A, Wolff L B. Multispectral image visualization through first-order fusion. IEEE Trans Image Proc, 2002, 11: 923–931
Piella G. Image fusion for enhanced visualization: a variational approach. Int J Comput Vision, 2009, 83: 1–11
Ballester C, Caselles V, Igual L, et al. A variational model for P+XS image fusion. Int J Comput Vision, 2006, 69: 43–58
Moeller M, Wittman T, Bertozzi A L. A variational approach to hyperspectral image fusion. http://www. math.ucla.edu/applied/cam/index.htm/cam09-21.pdf
Osher S, Rudin L. Feature-oriented image enhancement with shock filters. SIAM J Num Analys, 1990, 27: 919–940
Zheng S, Shi W Z, Liu J, et al. Remote sensing image fusion using multiscale mapped LS-SVM. IEEE Trans Geosci Remote Sens, 2008, 46: 1313–1322
Wang Z, Bovik A C. A universal image quality index. IEEE Trans Signal Process Lett, 2002, 9: 81–84
Gang X, Jing Z L, Wang S. Optimal colour image fusion approach based on fuzzy integrals. Image Sci J, 2007, 55: 189–196
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, Z., Li, Y., Shi, H. et al. Pan-sharpening: a fast variational fusion approach. Sci. China Inf. Sci. 55, 615–625 (2012). https://doi.org/10.1007/s11432-011-4544-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-011-4544-9