Skip to main content
SpringerLink
Log in

A classification and fuzzy-based approach for digital multi-focus image fusion

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

This paper presents a new wavelet-based method for fusion of spatially registered multi-focus images. We have formulated the image fusion process as a two-class classification problem: in and out-of-focus classes. First, a 12–dimensional feature vector using dual-tree discrete wavelet transform (DT-DWT) sub-bands of the source images are extracted, and then a trained two-class fisher classifier projects it to the class labels. The classifier output is used as a decision map for fusing high-frequency wavelet coefficients of multi-focus source images in different directions and decomposition levels of the DT-DWT. In addition, there is an uncertainty for selecting high-frequency wavelet coefficients in smooth regions of source images, which causes some misclassified pixels in the classification output or the decision map. In order to solve this uncertainty and integrate as much information as possible from the source images into the fused image, we propose an algorithm based on fuzzy logic, which combines outputs of two different fusion rules based on a dissimilarity measure from the source images: Selection based on the decision map and weighted averaging. An estimation of the decision map is also used for fusing low-frequency wavelet coefficients of the source images instead of simple averaging. After fusing low- and high-frequency wavelet coefficients of the source images, the final fused image is obtained using the inverse DT-DWT. This new method provides improved subjective and objectives results (more than 4.5 dB on average) as compared to previous fusion methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. Image Fusion Toolbox for MATLAB developed by Oliver Rockinger: http://www.metapix.de/toolbox.htm.

  2. The Image Fusion Toolkit for Matlab developed by Eduardo Canga: http://www.imagefusion.org/.

  3. Available at: http://taco.poly.edu/WaveletSoftware/dt2D.html.

References

  1. Saeedi J, Faez K (2009) Fisher classifier and Fuzzy logic based multi-focus image fusion. In: IEEE International Conference on Intelligent computing and intelligent systems, pp 420–425

  2. Yang XH, Zh L, Jing G, Liu L, Hua ZH (2007) Fusion of multi-spectral and panchromatic images using fuzzy rule. Communications in nonlinear science and numerical simulation, vol 12. pp 1334–1350

  3. Garg S, Kiran U, Mohan K, Tiwary R (2006) Multilevel medical image fusion using segmented image by level set evolution with region competition. In: 27th annual international conference of the engineering in Medicine and Biology Society, vol 17–18. pp 7680–7683

  4. Zhang Zh, Blum RS (1999) A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application. Proc IEEE 87(8):1315–1326

    Article  Google Scholar 

  5. Song Y, Li M, Li Q, Sun L (2006) A new wavelet based multi-focus image fusion scheme and its application on optical microscopy. In: Proceedings of the 2006 IEEE international conference on robotics and biomimetics, pp 401–405

  6. Rosenfeld A, Thurston M (1971) Edge and curve detection for visual scene analysis. IEEE Trans Comput C-20:562–569

    Article  Google Scholar 

  7. Burt PJ, Adelson EH (1983) The Laplacian pyramid as a compact image code. IEEE Trans Commun 31(4):532–540

    Article  Google Scholar 

  8. Lindeberg T (1994) Scale–Space theory in computer vision. Kluwer Academic Publisher, Dordrecht

    Book  Google Scholar 

  9. Mueller D, Maeder A, O’Shea1 P (2006) The Generalised image fusion toolkit (GIFT), pp 1–16

  10. Burt PJ (1992) A gradient pyramid basis for pattern selective image fusion. In: Proceedings of the society for information display conference, pp 467–470

  11. Toet A (1989) A morphological pyramidal image decomposition. Pattern Recognit Lett 9(3):255–261

    Article  MATH  Google Scholar 

  12. Li H, Manjunath BS, Mitra SK (1995) Multi-sensor image fusion using the wavelet transform. Graph Models Image Process 57(3):235–245

    Article  Google Scholar 

  13. Pajares G, Cruz JM (2004) A wavelet-based image fusion tutorial. Pattern Recognit 37(9):1855–1872

    Article  Google Scholar 

  14. Rockinger O (1997) Image sequence fusion using a shift invariant wavelet transform. In: IEEE international conference on image process, pp 288–291

  15. Nu′fez J, Otazu X, Fors O, Pala V, Arbiol R (1999) Multiresolution based image fusion with additive wavelet decomposition. IEEE Trans Geosci Remote Sens 37(3):1204–1211

    Article  Google Scholar 

  16. Chibani Y, Houacine A (2003) Redundant versus orthogonal wavelet decomposition for multisensor image fusion. Pattern Recogn 36(4):1785–1794

    Article  Google Scholar 

  17. Hill P, Canagarajah N, Bull D (2002) Image fusion using complex wavelets. In: Proceedings of the British machine vision conference, pp 487–496

  18. Burt PJ, Kolczynski RJ (1993) Enhanced image capture through fusion. In: Proceedings of the 4th international conference on computer vision, pp. 173–182

  19. Kingsbury N (2000) A Dual-tree complex wavelet transform with improved orthogonality and symmetry properties. ICIP 2:375–378

    Google Scholar 

  20. Kingsbury N (1998) The dual-tree complex wavelet transform: A new technique for shift invariance and directional filters. In: Proceedings of 8th IEEE DSP Workshop, Utah, pp 9–12

  21. Selesnick IW, Baraniuk RG, Kingsbury NG (2005) The dual-tree complex wavelet transform. In: IEEE signal processing magazine, pp 124–152

  22. Wei S, Ke W (2007) A multi-focus image fusion algorithm with DT-CWT. In: International conference on computational intelligence and security, pp 147–151

  23. Zheng Y, Li H, Doermann D (2004) Machine printed text and handwriting identification in noisy document images. IEEE Trans Pattern Anal Mach Intell 26(3):337–353

    Article  Google Scholar 

  24. Kumar S, Gupta R, Khanna N, Chaudhury S, Joshi SD (2007) Text extraction and document image segmentation using matched wavelets and MRF model. IEEE Trans Image Process 16(8):2117–2128

    Article  MathSciNet  Google Scholar 

  25. Fukunaga K (1990) Introduction to statistical pattern recognition, 2nd edn. Academic Press, New York

    MATH  Google Scholar 

  26. Kannan K, Perumal SA (2007) Optimal decomposition level of discrete wavelet transform for pixel based fusion of multi-focused images. In: International conference on computational intelligence and multimedia applications, pp 314–318

  27. Petrovic VS, Xydeas CS (2004) Gradient-based multiresolution image fusion. IEEE Trans Image Process 13(2):228–237

    Article  Google Scholar 

  28. Rockinger O, Fechner T (1998) Pixel-level image fusion: the case of image sequences. Proc SPIE 3374:378–388

    Article  Google Scholar 

  29. Li S, James, Kwok T, Wang Y (2001) Combination of Images with diverse focuses using the spatial frequency. Inf Fusion 2(3):169–176

  30. Niu Y, Shen L (2009) A novel approach to image fusion based on multi-objective optimization. In: Proceedings of the 6th World congress on intelligent control, pp 9911–9915

  31. Petrovic V, Xydeas C (2000) On the effects of sensor noise in pixel-level image fusion performance. In: Proceedings of the third international conference on image fusion, vol 2. pp 14–19

  32. http://imagefusion.org

  33. http://www.imgfsr.com

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering Department, Amirkabir University of Technology (Tehran Polytechnic), 424, Hafez Ave., Tehran, Iran

    Jamal Saeedi & Karim Faez

Authors
  1. Jamal Saeedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karim Faez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Karim Faez.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Saeedi, J., Faez, K. A classification and fuzzy-based approach for digital multi-focus image fusion. Pattern Anal Applic 16, 365–379 (2013). https://doi.org/10.1007/s10044-011-0235-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-011-0235-9

Keywords

Search

Navigation