Wang Wei zhou
ABSTRACT
Multi-focus image fusion is a popular research direction of image fusion, however, because of the complexity of the image, it has always been difficult in scientific research to accurately judge the clear area, especially in the clear and fuzzy edge of the complex environment. To better determine the focus area of the source image and obtain a clear image, the improved U2-Net model is used to analyze the focus area, and the multi-scale feature extraction scheme is used to generate the decision map. At the same time, the algorithm uses the NYU-D2 depth image as the training dataset in this paper. To achieve a better training effect, the method of image segmentation, Graph Cut, is combined with manual adjustment to make the training dataset. The experimental results show that compared with several existing latest algorithms, this fusion method can obtain accurate decision diagrams and has better performance in visual perception and objective evaluation.
- Pajares G , Cruz J .A wavelet-based image fusion tutorial[J].Pattern Recognition,2004,37(9):1855-1872.Google Scholar
- Shuping, Wang, Zheng.Multi-focus image fusion with dense SIFT.Google Scholar
- Li S, Kang X, Hu J . Image Fusion With Guided Filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.Google Scholar
- Li H , Yi C , Yin H ,et al.Multifocus image fusion and denoising scheme based on homogeneity similarity[J].Optics Communications,2012,285(2):91-100.Google Scholar
- Hui L, Manjunath BS, Mitra S K . Multi-sensor image fusion using the wavelet transform[J].Graphical Models and Image Processing,2002,57(3):235-245.Google Scholar
- Wang W, F Chang. A Multi-focus Image Fusion Method Based on Laplacian Pyramid[J].Journal of Computers,2011,6(12):2559-2566.Google Scholar
- Bhatnagar G, Wu Q, Zheng L . Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain[J].IEEE Transactions on Multimedia,2014,9(5):1014-1024.Google Scholar
- Yang Y, Tong S, Huang S,et al.Multifocus Image Fusion Based on NSCT and Focused Area Detection[J].IEEE Sensors Journal,2014,15(5):1-1.Google Scholar
- Zhou Z , Li S , Wang B .Multi-scale weighted gradient-based fusion for multi-focus images[J].Information Fusion,2014,20:60-72.Google Scholar
- Kong W, Zhang L, Lei Y . Novel fusion method for visible light and infrared images based on NSST-SF-PCNN[J].Infrared Physics & Technology,2014,65:103-112.Google Scholar
- Gao G , Xu L , D Feng.Multi-focus image fusion based on non-subsampled shearlet transform[J].IET Image Processing,2013,7(6):633-639.Google Scholar
- Li S , Kang X , Hu J ,et al.Image matting for fusion of multi-focus images in dynamic scenes[J].Information Fusion,2013,14(2):147-162.Google Scholar
- Yu Z , Bai X , Tao W .Boundary Finding Based Multi-focus Image Fusion through Multi-scale Morphological Focus-measure[J].Information Fusion,2017,35:81-101.Google Scholar
- Bai X , Zhang Y , Zhou F ,et al.Quadtree-based multi-focus image fusion using a weighted focus-measure[J].Information Fusion,2015,22:105-118.Google Scholar
- Liu Y , Chen X , Peng H ,et al.Multi-focus image fusion with a deep convolutional neural network[J].Information Fusion,2017,36:191-207.Google Scholar
- Ma J, Wei Y, Liang P,et al.FusionGAN: A generative adversarial network for infrared and visible image fusion[J].Information Fusion,2019,48:11-26.Google Scholar
- Jm A, Pl A, Wei Y A,et al.Infrared and visible image fusion via detail preserving adversarial learning[J].Information Fusion,2020,54:85-98.Google Scholar
- Yu Z A, Yu LB , Peng S C,et al.IFCNN: A general image fusion framework based on the convolutional neural network[J].Information Fusion,2020,54:99-118.Google Scholar
- https://cs.nyu.edu/∼silberman/datasets/nyu_depth_v2.htmlGoogle Scholar
- Rother C .GrabCut : Interactive foreground extraction using iterated graph cut[J].Acm Trans Graph,2004,23.Google Scholar
- Luo P, Ren J, Peng Z,et al.Differentiable Learning-to-Normalize via Switchable Normalization[J]. 2018.Google Scholar
- Newell A, Yang K, Jia D . Stacked Hourglass Networks for Human Pose Estimation[C]// European Conference on Computer Vision.Springer International Publishing,2016.Google Scholar
- G.Qu,D.Zhang,and P.Yan,“Information measure for performance of image fusion,” Electronics Letters,vol.38,no.7,pp.313–315,2002.Google ScholarCross Ref
- C.Yang,J.Q.Zhang,X.R.Wang,and X.Liu,“A novel similarity based quality metric for image fusion,” Information Fusion,vol.9,no.2,pp.156–160,2008.Google ScholarCross Ref
- Z.Wang,A.C.Bovik,H.R.Sheikh,E.P.Simoncelli ,“Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing,vol.13,no.4,pp.600–612,2004.Google ScholarDigital Library
- Z.Liu,E.Blasch,Z.Xue,et al.,Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study[J],IEEE Trans.Pattern Anal.Mach.Intell.34 (1) (2011) 94–109.Google ScholarDigital Library
Recommendations
A novel multi-focus image fusion approach based on image decomposition
An image decomposition-based fusion scheme is proposed to get high fused image quality.The decomposition method is presented to accurately obtain the morphological contents.This decomposition algorithm has low time consumption compared with the current ...
Multi-focus image fusion based on optimal defocus estimation
An optimal defocus estimation method is proposed to estimate the blur of multi focus images.An improved and efficient algorithm is presented to fuse the multiple focused images.The method making use of estimated defocus blur of images to detect focused ...
A novel multi-focus image fusion method based on distributed compressed sensing
Highlights- Distributed compressed sensing (DCS) is firstly introduced into multi-focus image fusion and a novel multi-focus image fusion method based on DCS is ...
AbstractMulti-focus image fusion aims to produce an all-in-focus image by merging multiple partially focused images of the same scene. The main work is identifying the focused region and then composing all the focused regions. In this paper, a ...
Comments