Abstract
Multispectral and multiresolution image fusion is important for many multimedia and remote sensing applications, such as video surveillance, medical imaging, and satellite imaging. For the commercial satellite “IKONOS,” spatial resolutions of high-resolution panchromatic (PAN) and low-resolution multispectral (MS) satellite images are 1 m and 4 m, respectively. To cope with color distortion and blocking artifacts in fused images, in this study, a multispectral and multiresolution image fusion approach using PSO is proposed. The pixels of fused images in the training set are classified into several categories based on the characteristics of low-resolution MS images. Then, the smooth parameters of spatial and spectral responses between the high-resolution PAN and low-resolution MS images are determined by PSO. All the pixels within each category are normalized by its own smooth parameter so that color distortion and blocking artifacts can be greatly reduced. Based on the experimental results obtained in this study, the overall visual quality of the fused images by the proposed approach is better than that by three comparison approaches, whereas the correlation coefficients, γ PAN , for the fused images by the proposed approach are greater than that by three comparison approaches.



















Similar content being viewed by others
References
Aiazzi B, Alparone L, Baronti S, Garzelli A (2002) Context-driven fusion of high spatial and spectral resolution images based on oversampled multi-resolution analysis. IEEE Trans Geosci Remote Sens 40:2300–2312
Barlas G, El-Fakih K (2008) A GA-based movie-on-demand platform using multiple distributed servers. Multimed Tools Appl 40:361–383
Carper W, Lillesand T, Kiefer R (1990) The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photogramm Eng Remote Sens 56:459–467
Chavez PS (1986) Digital merging of Landsat TM and digitized NHAP data for 1:24.000 scale image mapping. Photogramm. Eng Remote Sens 52:1637–1646
Chavez PS, Bowell J (1988) Comparison of the spectral information content of Landsat thematic mapper and SPOT for three different sites in Phoenix, Arizona region. Photogramm Eng Remote Sens 54:1699–1708
Chavez PS, Kwarteng AY (1989) Extracting spectral contrast in Landsat thematic mapper image data using selective principle component analysis. Photogramm Eng Remote Sens 55:339–348
Chavez P, Sides S, Anderson J (1991) Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic. Photogramm Eng Remote Sens 57:295–303
Davis LD (1991) Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York, NY
Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. Proc. 6th Symp. Micro Mach. Human Sci. 39–43
Eberhart RC, Kennedy J (1995) Particle swarm optimization. Proc. IEEE Int. Conf. Neural Networks IV:1942–1948
Engelbrecht AP (2002) Computational Intelligence: An Introduction. Wiley, New York
Garguet-Duport B, Girel J, Chassery JM, Pautou G (1996) The use of multiresolution analysis and wavelet transform for merging SPOT panchromatic and multispectral image data. Photogramm Eng Remote Sens 62:1057–1066
Gillespie A, Kahle A, Walker R (1987) Color enhancement of highly correlated images. II. channel ratio and ‘chromaticity’ transformation techniques. Remote Sens Environ 22:343–365
Gonzalez-Audicana M, Otazu X, Fors O, Alvarez-Mozos J (2006) A low computational-cost method to fuse IKONOS images using the spectral response function of its sensors. IEEE Trans Geosci Remote Sens 44:1683–1691
http://www.geoeye.com/CorpSite, the Geoeye Company
http://www.itri.org.tw/eng/EEL/, Energy and Environment Research Laboratories, Industrial Technology Research Institute, Taiwan
Ioannidou S, Karathanassi V (2007) Investigation of the dual-tree complex and shift-invariant discrete wavelet transforms on quickbird image fusion. IEEE Geosci Remote Sens Lett 4:166–170
Jian M, Dong J (2010) Capture and fusion of 3 d surface texture. Multimedia Tools and Applications (online first)
Kalpoma KA, Kudoh J (2007) Image fusion processing for IKONOS 1-m color imagery. IEEE Trans Geosci Remote Sens 45:3075–3086
Kang LW, Leou JJ (2006) Two error resilient coding schemes for wavelet-based image transmission based on data embedding and genetic algorithms. J Vis Commun Image Represent 17:1127–1144
Kovačević A, Milosavljević B, Konjović Z, Vidaković M (2010) Adaptive content-based music retrieval system. Multimed Tools Appl 47:525–544
Malpica JA (2007) Hue adjustment to IHS pan-sharpened IKONOS imagery for vegetation enhancement. IEEE Geosci Remote Sens Lett 4:27–31
Nunez J, Otazu X, Fors O, Prades A, Pala V, Arbiol R (1999) Multiresolution-based image fusion with additive wavelet decomposition. IEEE Trans Geosci Remote Sens 37:1204–1211
Park S, Park M, Kang MG (2003) Super-resolution image reconstruction: a technical overview. IEEE Signal Process Mag 20:21–36
Richards JA, Jia X, Ricken DE, Gessner W (1999) Remote Sensing Digital Image Analysis: An Introduction. Springer-Verlag New York, Inc., Secaucus, NJ
Schowengerdt RA (1997) Remote Sensing: Models and Methods for Image Processing. Elsevier Science & Technology Books
Smith AR (1978) Color gamut transform pairs. Comput Graph 12:12–19
Tseng CC, Hsieh JG, Jeng JH (2008) Fractal image compression using visual-based particle swarm optimization. Image Vis Comput 26:1154–1162
Tu TM, Huang PS, Hung CL, Chang CP (2004) A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1:309–312
Tu TM, Cheng WC, Chang CP, Huang PS, Chang JC (2007) Best tradeoff for high-resolution image fusion to preserve spatial details and minimize color distortion. IEEE Geosci Remote Sens Lett 4:302–306
Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43:1391–1402
Zhou J, Civco DL, Silander JA (1998) A wavelet transform method to merge Landsat TM and SPOT panchromatic data. Int J Remote Sens 19:743–757
Acknowledgment
The authors would like to thank the Geoeye Company for providing the IKONOS PAN and MS images used in this study.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported in part by National Science Council, Taiwan, Republic of China under Grants NSC 98-2221-E-194-034-MY3 and NSC 99-2221-E-194-032-MY3.
Rights and permissions
About this article
Cite this article
Chen, HY., Leou, JJ. Multispectral and multiresolution image fusion using particle swarm optimization. Multimed Tools Appl 60, 495–518 (2012). https://doi.org/10.1007/s11042-011-0820-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0820-3