A multi-parameter regularization model for image restoration
Introduction
Restoration from noisy, blurry and partial observations is a fundamental task in image processing (IP) ranging from computer sciences, electronic engineering and remote sensing to biology and medical sciences. Mathematically, the observation model is as follows:where y, are observed and target images, respectively, K is a linear corruption operator that maps into , and is the zero-mean white Gaussian noise with variance σ2. Image restoration (IR) is an inverse problem aiming at recovering x from the corrupted observation image y. There are several approaches to tackle this issue, to name just a few, statistics [1], Fourier or wavelet transforms [2], and variational analysis [3], [4].
It is well known that the process to recover x from y is ill-posed in the sense that the restoration results may not be continuously dependent on the observation error [4]. A widely used method to handle this problem is resorting to regularization, where the underlying image x is approximated by the solution ofThe first term in (2) incorporates the measurement y and the second term is the regularization term which contains the prior information of the underlying solution. The regularization parameter controls the tradeoff between these two terms.
Classical Tikhonov regularization [5] using with D to be a local difference operator, however, tends to make images over smooth and fail to preserve sharp edges. The ROF model [6], [7] using total variation (TV) as a regularizer has been shown a great success in preserving the most important features in images such as sharp edges and object boundaries. However, the well known drawback of TV based methods is to create staircasing phenomenon in the flatten zones and small object corners and lead to the loss of image contrasts [8], [9], [10], [11].
There are several higher-order variational regularization based models that can suppress the staircasing effect created by TV-based models. The first type is replacing the TV term with higher-order regularizes directly [12], [13], [14], [15] to keep the smooth parts of the image. The second category uses multi-parameter regularization models based on TV and other regularizer that incorporates the high order TV [16] or curvature information of the level set of the target image [17], [18]. Another kind is treating the underlying image as the sum of cartoon part measured by the TV norm while the flatten part measured by a higher-order norm, such as the inf-convolution TV based model [3], the fourth order based models [10], [11], the total generalized variation model [19], and the two framelet-based models [20]. The models mentioned above can remedy the drawbacks of TV based model to some extent. However, it also needs some efforts to improve them both theoretically and computationally. Mathematically, the first two kinds of approaches assume higher regularities prior of the target image which may exclude the edges unfortunately. Numerically, it is quite challenging to develop fast solvers with theoretical guarantee to minimize the energy functionals involving high order derivatives since the related Euler–Lagrange equations are often fourth order.
Sparse representation is another hot topic in IR and other IP fields [21]. In general, most natural images are usually (approximately) sparse under some dictionaries, e.g., Fourier, wavelet, contourlet, curvelet, and WF. In order to make full use of the sparsity prior information, the redundant dictionaries such as WF are preferred in the process of IP. Due to that different framelets have different orders of vanishing moment, the magnitude of framelet coefficients of the image can adaptively indicate the regularity of the underlying image. Therefore, the framelet-based synthesis, analysis, and balanced variational models can significantly improve IR quality [20], [22], [23], [24], [25], [26], [27], [28], [29], [30]. The authors in [30] proposed a new scheme, which simultaneously maximizes the sparsity of the blur kernel and the sparsity of the clear image, i.e., using the curvelet system for the blur kernel while framelet system for the latter. Recently, it has been shown that several important variational PDE-based image regularization models can be interpreted as a certain kind of framelet regularization with specified WFs [20], [31], [32]. Also, there are many other items that can be used to improve the quality of the IR algorithms, such as the nonlocal information of the image [33], coupled dictionary [34], and multiple images [35].
Inspired by the idea that framelet transforms play a role of multi-scale differential operator adaptively, we propose a multi-parameter regularization IR model based on TV and framelet to preserve sharp edges and to avoid staircasing simultaneously. To be precise, we use TV regularizer to keep sharp edges and choose a proper framelet whose coefficient can adaptively detect higher regularity zones and then can measure the smoothness of the underlying image, which is the first main contribution of this paper. We should point out that our newly proposed model is not only different from the ones aiming at decomposing the original image into two parts and using different regularization term to measure them [3], [10], [11], [19], [20] but also different from the models utilizing multi-parameter regularization combined TV with higher-order regularizer [16], [17], [18]. The authors in [20] give a scheme for restoring image, which simultaneously use total variation and framelets to be the regularization schemes. The difference between our algorithm and this scheme is that during their method, the underlying image is firstly divided into two parts, then enforce two regularization items to the remaining two parts while our algorithm does not need to divide the image, instead of which, total variation and framelets are directly acting on the whole image in TV frame. We also noticed that there are several works that hybrid TV or higher-order TV with certain wavelet regularization to preserve image details and textures [27], [28], [36], [37], [38], [39]. Our newly proposed TV-analysis based model also differs from them since they are developed from different motivations using different wavelets or just use the synthesis model.
Numerically, we adopt the alternative direction method of multiplier (ADMM) to develop a fast and stable algorithm and establish its convergence analysis, which is the second main contribution of this paper. The ADMM is first introduced in [40], [41] and is been shown to have the advantages of notable stability and high rate of convergence, as a result of which, it is now widely used for the minimization of convex functionals under linear-equality constraints. Here, similar to [42], we use the ADMM as a single and efficient tool to derive the explicit reconstruction algorithm for IR. After bringing in two auxiliary variables, we first transform this model into a new constrained problem and then use the variable splitting technique to transform the resulting constrained problem into a different unconstrained problem. The obtained unconstrained problem is then solved by the ADMM efficiently. It is shown in the simulation experiments that the newly proposed algorithm is very effective and efficient in IR.
The rest of this paper is organized as follows. In Section 2, we review the WF system and image representation. The proposed new model based on framelet and TV is introduced in Section 3, along with the corresponding ADMM algorithm in detail. In Section 4, we conduct several numerical experiments to demonstrate that both the new model and the ADMM algorithm are effective and efficient. Concluding remarks and future works are discussed in Section 5 while the proof of the convergence theorem of our newly proposed algorithm is given in Appendix A.
Section snippets
The WF and image representation
In this section, we will briefly review the concept of tight WFs. As for the details about how to construct the WF and the detailed frame theory, please see [22], [23], [24], [26], [43] and the references therein.
A countable set is called a tight frame if where is the inner product of . For a given , the wavelet system is defined by the collection of the dilations and the shifts of Ψ asWhen forms a
The new model for IR and the ADMM algorithm
In this section, we introduce our multi-parameter regularization model for IR, and at the same time, we develop the ADMM algorithm for solving the proposed model.
Experimental settings
In this section, we conduct several numerical experiments to demonstrate the effectiveness and efficiency of the proposed approach, in comparison with several state-of-the-art IR approaches. All experiments are conducted under Windows 7 and Matlab 2013a running on a desktop machine with an Intel Core i3 Duo central processing unit at 3.07 GHz and 4 GB memory.
The methods compared in this paper are as follows: FTVd [48], [49], Balanced method [23], Chan׳s fourth order method [11] and SALSA [56]
Concluding remarks
In this paper, we propose a new multi-parameter regularization model to IR based on WF and TV, meanwhile, we use the ADMM to solve the proposed analysis-based model and provide its convergence analysis. Our experimental results demonstrate that the proposed algorithm for the new model is superior to various state-of-the-art IR methods in terms of the ability to suppress the staircasing phenomenon and to provide sharper image edges and more details, as a result of which, the PSNR and ISNR values
Acknowledgements
This work was supported by the NNSF of China (No. 61179039) and the National Key Basic Research Development Program (973 program) of China (No. 2011CB707100).
References (57)
- et al.
Nonlinear total variation based noise removal algorithms
Physica D: Nonlinear Phenom.
(1992) - et al.
Image decomposition combining staircase reduction and texture extraction
J. Vis. Commun. Image Represent.
(2007) - et al.
Hybrid regularization image deblurring in the presence of impulsive noise
J. Vis. Commun. Image Represent.
(2013) - et al.
A dual algorithm for the solution of nonlinear variational problems via finite element approximation
Comput. Math. Appl.
(1976) - et al.
Affine systems in L2(Rd)the analysis of the analysis operator
J. Func. Anal.
(1997) - et al.
FrameletsMRA-based constructions of wavelet frames
Appl. Comput. Harmon. Anal.
(2003) - et al.
Adaptive total variation image deblurringa majorization–minimization approach
Signal Process.
(2009) - et al.
Convergence analysis of the Bregman method for the variational model of image denoising
Appl. Comput. Harmon. Anal.
(2009) Linear and nonlinear image deblurringa documented study
SIAM J. Numer. Anal.
(1999)- et al.
An efficient algorithm for l0 minimization in wavelet frame based image restoration
J. Sci. Comput.
(2013)
Image recovery via total variation minimization and related problems
Numer. Math.
Recovery of blocky images from noisy and blurred data
SIAM J. Appl. Math.
Local strong homogeneity of a regularized estimator
SIAM J. Appl. Math.
Low-curvature image simplifiersglobal regularity of smooth solutions and Laplacian limiting schemes
Commun. Pure Appl. Math.
Hessian-based norm regularization for image restoration with biomedical applications
IEEE Trans. Image Process.
Higher degree total variation (HDTV) regularization for image recovery
IEEE Trans. Image Process.
Image denoising using mean curvature of image surface
SIAM J. Imag. Sci.
A combined first and second order variational approach for image reconstruction
J. Math. Imaging Vis.
Euler׳s elastica and curvature-based inpainting
SIAM J. Appl. Math.
A fast algorithm for Euler׳s elastica model using augmented Lagrangian method
SIAM J. Imag. Sci.
Total generalized variation
SIAM J. Imag. Sci.
Image restoration: total variation, wavelet frames, and beyond
J. Am. Math. Soc.
Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing
Deconvolutiona wavelet frame approach
Numer. Math.
Cited by (12)
Image denoising based on nonconvex anisotropic total-variation regularization
2021, Signal ProcessingMultiplicative noise removal via using nonconvex regularizers based on total variation and wavelet frame
2020, Journal of Computational and Applied MathematicsMulti-parameter multiplicative regularization: An application to force reconstruction problems
2020, Journal of Sound and VibrationCitation Excerpt :A potential drawback of the above-mentioned strategy is the definition of a single regularization parameter for all the regions considered. A thorough analysis of the existing literature indeed suggests that, when the solution to identify exhibits several distinct features simultaneously, multi-parameter additive regularization may perform better than a single parameter regularization parameter, because each individual feature can be emphasized through the definition of a corresponding regularization parameter [17–24]. Despite these encouraging results, one of the main challenges is the selection of suitable regularization parameters.
Wavelet frame based Poisson noise removal and image deblurring
2017, Signal ProcessingCitation Excerpt :Finally, the conclusions are presented in Section 4. The ADMM algorithm is widely used to solve large scale linearly constrained optimization problems arising from the application fields such as image processing [37], engineering computation and machine learning [38]. In this section, we adopt the ADMM scheme to solve the nonconvex noncontinuous Poisson image denoising and deblurring problem.
A Global Variational Filter for Restoring Noised Images with Gamma Multiplicative Noise
2019, Engineering, Technology and Applied Science Research