Skip to main content
Log in

Multispectral and multiresolution image fusion using particle swarm optimization

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multispectral and multiresolution image fusion is important for many multimedia and remote sensing applications, such as video surveillance, medical imaging, and satellite imaging. For the commercial satellite “IKONOS,” spatial resolutions of high-resolution panchromatic (PAN) and low-resolution multispectral (MS) satellite images are 1 m and 4 m, respectively. To cope with color distortion and blocking artifacts in fused images, in this study, a multispectral and multiresolution image fusion approach using PSO is proposed. The pixels of fused images in the training set are classified into several categories based on the characteristics of low-resolution MS images. Then, the smooth parameters of spatial and spectral responses between the high-resolution PAN and low-resolution MS images are determined by PSO. All the pixels within each category are normalized by its own smooth parameter so that color distortion and blocking artifacts can be greatly reduced. Based on the experimental results obtained in this study, the overall visual quality of the fused images by the proposed approach is better than that by three comparison approaches, whereas the correlation coefficients, γ PAN , for the fused images by the proposed approach are greater than that by three comparison approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Aiazzi B, Alparone L, Baronti S, Garzelli A (2002) Context-driven fusion of high spatial and spectral resolution images based on oversampled multi-resolution analysis. IEEE Trans Geosci Remote Sens 40:2300–2312

    Article  Google Scholar 

  2. Barlas G, El-Fakih K (2008) A GA-based movie-on-demand platform using multiple distributed servers. Multimed Tools Appl 40:361–383

    Article  Google Scholar 

  3. Carper W, Lillesand T, Kiefer R (1990) The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data. Photogramm Eng Remote Sens 56:459–467

    Google Scholar 

  4. Chavez PS (1986) Digital merging of Landsat TM and digitized NHAP data for 1:24.000 scale image mapping. Photogramm. Eng Remote Sens 52:1637–1646

    Google Scholar 

  5. Chavez PS, Bowell J (1988) Comparison of the spectral information content of Landsat thematic mapper and SPOT for three different sites in Phoenix, Arizona region. Photogramm Eng Remote Sens 54:1699–1708

    Google Scholar 

  6. Chavez PS, Kwarteng AY (1989) Extracting spectral contrast in Landsat thematic mapper image data using selective principle component analysis. Photogramm Eng Remote Sens 55:339–348

    Google Scholar 

  7. Chavez P, Sides S, Anderson J (1991) Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic. Photogramm Eng Remote Sens 57:295–303

    Google Scholar 

  8. Davis LD (1991) Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York, NY

    Google Scholar 

  9. Eberhart RC, Kennedy J (1995) A new optimizer using particle swarm theory. Proc. 6th Symp. Micro Mach. Human Sci. 39–43

  10. Eberhart RC, Kennedy J (1995) Particle swarm optimization. Proc. IEEE Int. Conf. Neural Networks IV:1942–1948

  11. Engelbrecht AP (2002) Computational Intelligence: An Introduction. Wiley, New York

    Google Scholar 

  12. Garguet-Duport B, Girel J, Chassery JM, Pautou G (1996) The use of multiresolution analysis and wavelet transform for merging SPOT panchromatic and multispectral image data. Photogramm Eng Remote Sens 62:1057–1066

    Google Scholar 

  13. Gillespie A, Kahle A, Walker R (1987) Color enhancement of highly correlated images. II. channel ratio and ‘chromaticity’ transformation techniques. Remote Sens Environ 22:343–365

    Article  Google Scholar 

  14. Gonzalez-Audicana M, Otazu X, Fors O, Alvarez-Mozos J (2006) A low computational-cost method to fuse IKONOS images using the spectral response function of its sensors. IEEE Trans Geosci Remote Sens 44:1683–1691

    Article  Google Scholar 

  15. http://www.geoeye.com/CorpSite, the Geoeye Company

  16. http://www.itri.org.tw/eng/EEL/, Energy and Environment Research Laboratories, Industrial Technology Research Institute, Taiwan

  17. Ioannidou S, Karathanassi V (2007) Investigation of the dual-tree complex and shift-invariant discrete wavelet transforms on quickbird image fusion. IEEE Geosci Remote Sens Lett 4:166–170

    Article  Google Scholar 

  18. Jian M, Dong J (2010) Capture and fusion of 3 d surface texture. Multimedia Tools and Applications (online first)

  19. Kalpoma KA, Kudoh J (2007) Image fusion processing for IKONOS 1-m color imagery. IEEE Trans Geosci Remote Sens 45:3075–3086

    Article  Google Scholar 

  20. Kang LW, Leou JJ (2006) Two error resilient coding schemes for wavelet-based image transmission based on data embedding and genetic algorithms. J Vis Commun Image Represent 17:1127–1144

    Article  Google Scholar 

  21. Kovačević A, Milosavljević B, Konjović Z, Vidaković M (2010) Adaptive content-based music retrieval system. Multimed Tools Appl 47:525–544

    Article  Google Scholar 

  22. Malpica JA (2007) Hue adjustment to IHS pan-sharpened IKONOS imagery for vegetation enhancement. IEEE Geosci Remote Sens Lett 4:27–31

    Article  Google Scholar 

  23. Nunez J, Otazu X, Fors O, Prades A, Pala V, Arbiol R (1999) Multiresolution-based image fusion with additive wavelet decomposition. IEEE Trans Geosci Remote Sens 37:1204–1211

    Article  Google Scholar 

  24. Park S, Park M, Kang MG (2003) Super-resolution image reconstruction: a technical overview. IEEE Signal Process Mag 20:21–36

    Article  Google Scholar 

  25. Richards JA, Jia X, Ricken DE, Gessner W (1999) Remote Sensing Digital Image Analysis: An Introduction. Springer-Verlag New York, Inc., Secaucus, NJ

    Google Scholar 

  26. Schowengerdt RA (1997) Remote Sensing: Models and Methods for Image Processing. Elsevier Science & Technology Books

  27. Smith AR (1978) Color gamut transform pairs. Comput Graph 12:12–19

    Article  Google Scholar 

  28. Tseng CC, Hsieh JG, Jeng JH (2008) Fractal image compression using visual-based particle swarm optimization. Image Vis Comput 26:1154–1162

    Article  Google Scholar 

  29. Tu TM, Huang PS, Hung CL, Chang CP (2004) A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery. IEEE Geosci Remote Sens Lett 1:309–312

    Article  Google Scholar 

  30. Tu TM, Cheng WC, Chang CP, Huang PS, Chang JC (2007) Best tradeoff for high-resolution image fusion to preserve spatial details and minimize color distortion. IEEE Geosci Remote Sens Lett 4:302–306

    Article  Google Scholar 

  31. Wang Z, Ziou D, Armenakis C, Li D, Li Q (2005) A comparative analysis of image fusion methods. IEEE Trans Geosci Remote Sens 43:1391–1402

    Article  Google Scholar 

  32. Zhou J, Civco DL, Silander JA (1998) A wavelet transform method to merge Landsat TM and SPOT panchromatic data. Int J Remote Sens 19:743–757

    Article  Google Scholar 

Download references

Acknowledgment

The authors would like to thank the Geoeye Company for providing the IKONOS PAN and MS images used in this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jin-Jang Leou.

Additional information

This work was supported in part by National Science Council, Taiwan, Republic of China under Grants NSC 98-2221-E-194-034-MY3 and NSC 99-2221-E-194-032-MY3.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, HY., Leou, JJ. Multispectral and multiresolution image fusion using particle swarm optimization. Multimed Tools Appl 60, 495–518 (2012). https://doi.org/10.1007/s11042-011-0820-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0820-3

Keywords

Navigation