Abstract
Image denoising is a widely concerned problem, which has been successfully applied in remote sensing, medicine and other fields. A typical idea of image denoising is to exploit some prior information existing in real-world data, such as low-rank prior and local smoothness prior. Some researchers devote themselves to combining both priors, however, the current methods cannot capture both properties simultaneously and adequately. Motivated by a new regularizer named three-dimensional correlated total variation (3DCTV) for robust principal component analysis problem, in this paper, we propose a new image denoising model via the double-weighted correlated total variation regularization. Specifically, we perform weighting operations on the 3DCTV regularization term and the sparse term separately, which can make fuller use of the low-rank prior, the local smoothness prior and the sparse prior of images. In addition, we add the Frobenius norm term to this model for modeling strong Gaussian noise in some real-world scenarios. Then, we develop an efficient algorithm to solve the resulting optimization problem by using the well-known alternating direction method of multipliers. Finally, we conduct extensive experiments on hyperspectral images, multispectral images and medical images under various noise situations, and the experimental results show that the proposed method outperforms the existing state-of-the-art denoising methods. Especially when the test image is polluted by low-intensity sparse noise, the MPSNR index of our method is about 5 points higher than that of the 3DCTV method.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.
Code availability
Code availability not applicable.
References
Goceri E (2023) Evaluation of denoising techniques to remove speckle and gaussian noise from dermoscopy images. Comput Biol Med 152:106474
Suneetha A, Srinivasa Reddy E (2020) Robust gaussian noise detection and removal in color images using modified fuzzy set filter. J Intell Syst 30(1):240–257
Shah A, Bangash JI, Khan AW, Ahmed I, Khan A, Khan A, Khan A (2022) Comparative analysis of median filter and its variants for removal of impulse noise from gray scale images. J King Saud Univ-Comput Inf Sci 34(3):505–519
Wang Y, Peng J, Zhao Q, Leung Y, Zhao XL, Meng D (2017) Hyperspectral image restoration via total variation regularized low-rank tensor decomposition. IEEE J Sel Top Appl Earth Obs Remote Sens 11(4):1227–1243
Zhou E, Xu X, Xu B, Wu H (2023) An enhancement model based on dense atrous and inception convolution for image semantic segmentation. Applied Intelligence 53(5):5519–5531
Zhang J, Sun J, Wang J, Yue XG (2021) Visual object tracking based on residual network and cascaded correlation filters. Journal of ambient intelligence and humanized computing 12:8427–8440
Padilla R, Netto SL, Da Silva EA (2020) A survey on performance metrics for object-detection algorithms. In: Proc. Int. Conf. Syst., Signals Image Process. (IWSSIP), pp 237–242
Zheng S, Zhang Y, Liu W, Zou Y (2020) Improved image representation and sparse representation for image classification. Applied Intelligence 50:1687–1698
Candès EJ, Li X, Ma Y, Wright J (2011) Robust principal component analysis? J. ACM 58(3):1–37
Wang H, Cen Y, He Z, He Z, Zhao R, Zhang F (2007) Reweighted low-rank matrix analysis with structural smoothness for image denoising. IEEE Trans Image Process 27(4):1777–1792
Peng J, Wang Y, Zhang H, Wang J, Meng D (2022) Exact decomposition of joint low rankness and local smoothness plus sparse matrices. IEEE Trans Pattern Anal Mach Intell
Huang Y, Liao G, Xiang Y, Zhang L, Li J, Nehorai A (2019) Low-rank approximation via generalized reweighted iterative nuclear and frobenius norms. IEEE Trans Image Process 29:2244–2257
Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), pp 2862–2869
Gu S, Xie Q, Meng D, Zuo W, Feng X, Zhang L (2017) Weighted nuclear norm minimization and its applications to low level vision. Int J Comput Vision 121:183–208
Xie Y, Gu S, Liu Y, Zuo W, Zhang W, Zhang L (2016) Weighted schatten \( p \)-norm minimization for image denoising and background subtraction. IEEE Trans Image Process 25(10):4842–4857
Chen L, Jiang X, Liu X, Haardt M (2022) Reweighted low-rank factorization with deep prior for image restoration. IEEE Trans Signal Process 70:3514–3529
Candes EJ, Wakin MB, Boyd SP (2008) Enhancing sparsity by reweighted \(l_1\) minimization. J Fourier Anal Appl 14:877–905
Cao X, Zhao Q, Meng D, Chen Y, Xu Z (2016) Robust low-rank matrix factorization under general mixture noise distributions. IEEE Trans Image Process 25(10):4677–4690
Cao X, Chen Y, Zhao Q, Meng D, Wang Y, Wang D, Xu Z (2015) Low-rank matrix factorization under general mixture noise distributions. In: Proc. IEEE Int Conf Comput Vis (ICCV), pp 1493–1501
Chen Y, Cao X, Zhao Q, Meng D, Xu Z (2017) Denoising hyperspectral image with non-iid noise structure. IEEE Trans Cybern 48(3):1054–1066
Zheng YB, Huang TZ, Zhao XL, Jiang TX, Ma TH, Ji TY (2019) Mixed noise removal in hyperspectral image via low-fibered-rank regularization. IEEE Trans Geosci Remote Sens 58(1):734–749
Yao J, Meng D, Zhao Q, Cao W, Xu Z (2019) Nonconvex-sparsity and nonlocal-smoothness-based blind hyperspectral unmixing. IEEE Trans Image Process 28(6):2991–3006
Xie Q, Zhao Q, Meng D, Xu Z (2017) Kronecker-basis-representation based tensor sparsity and its applications to tensor recovery. IEEE Trans Pattern Anal Mach Intell 40(8):1888–1902
He W, Yao Q, Li C, Yokoya N, Zhao Q (2019) Non-local meets global: An integrated paradigm for hyperspectral denoising. In: Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), pp 6868–6877
Peng J, Xie Q, Zhao Q, Wang Y, Yee L, Meng D (2020) Enhanced 3dtv regularization and its applications on hsi denoising and compressed sensing. IEEE Trans Image Process 29:7889–7903
Peng J, Wang H, Cao X, Liu X, Rui X, Meng D (2022) Fast noise removal in hyperspectral images via representative coefficient total variation. IEEE Trans Geosci Remote Sens 60:1–17
Wang H, Peng J, Qin W, Wang J, Meng D (2023) Guaranteed tensor recovery fused low-rankness and smoothness. IEEE Trans Patt Anal Mach Intell 45(9):10990–11007
Huang K, Kong W, Zhou M, Qin W, Zhang F, Wang J (2024) Enhanced low-rank tensor recovery fusing reweighted tensor correlated total variation regularization for image denoising. J Sci Comput 99(3):69
Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130
Chen G, Wang J, Zhang F, Wang W (2019) Image denoising in impulsive noise via weighted schatten p-norm regularization. J Electron Imaging 28(1):013044–013044
Peng Y, Suo J, Dai Q, Xu W (2014) Reweighted low-rank matrix recovery and its application in image restoration. IEEE Trans Cybern 44(12):2418–2430
Xu Z, Xing H, Fang S, Wu S, Xie S (2021) Double-weighted low-rank matrix recovery based on rank estimation. In: Proc. IEEE Int Conf Comput Vis (ICCV), pp 172–180
Zhang H, He W, Zhang L, Shen H, Yuan Q (2013) Hyperspectral image restoration using low-rank matrix recovery. IEEE Trans Geosci Remote Sens 52(8):4729–4743
Lu C, Feng J, Chen Y, Liu W, Lin Z, Yan S (2019) Tensor robust principal component analysis with a new tensor nuclear norm. IEEE Trans Pattern Anal Mach Intell 42(4):925–938
Wang J, Hou J, Eldar YC (2022) Tensor robust principal component analysis from multilevel quantized observations. IEEE Trans Inf Theory 69(1):383–406
Zhang F, Wang H, Qin W, Zhao X, Wang J (2023) Generalized nonconvex regularization for tensor rpca and its applications in visual inpainting. Appl Intell, 1–23
Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51(3):455–500
Sidiropoulos ND, De Lathauwer L, Fu X, Huang K, Papalexakis EE, Faloutsos C (2017) Tensor decomposition for signal processing and machine learning. IEEE Trans Signal Process 65(13):3551–3582
Oseledets IV (2011) Tensor-train decomposition. SIAM. J Sci Comput 33(5):2295–2317
Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. Proc IEEE Conf Comput Vis Pattern Recognit (CVPR) 2:60–65
Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095
Maggioni M, Katkovnik V, Egiazarian K, Foi A (2012) Nonlocal transform-domain filter for volumetric data denoising and reconstruction. IEEE Trans Image Process 22(1):119–133
Xu J, Zhang L, Zhang D, Feng X (2017) Hyper-laplacian regularized unidirectional low-rank tensor recovery for multispectral image denoising. In: Proc. IEEE Int Conf Comput Vis (ICCV), pp 1096–1104
Huang X, Du B, Liu W (2021) Multichannel color image denoising via weighted schatten p-norm minimization. In: Proc 29th Int Joint Conf Artif Intell, pp 637–644
Su Y, Li Z, Yu H, Wang Z (2020) Multi-band weighted \(l_p\) norm minimization for image denoising. Inf Sci 537:162–183
Yair N, Michaeli T (2018) Multi-scale weighted nuclear norm image restoration. In: Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), pp 3165–3174
Chang Y, Yan L, Zhong S (2017) Hyper-laplacian regularized unidirectional low-rank tensor recovery for multispectral image denoising. In: Proc IEEE Conf Comput Vis Pattern Recognit (CVPR), pp 4260–4268
Iordache MD, Bioucas-Dias JM, Plaza A (20112) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502
Peng C, Liu Y, Kang K, Chen Y, Wu X, Cheng A, Kang Z, Chen C, Cheng Q (2022) Hyperspectral image denoising using nonconvex local low-rank and sparse separation with spatial-spectral total variation regularization. IEEE Trans Geosci Remote Sens 60:1–17
Fan H, Li C, Guo Y, Kuang G, Ma J (2018) Spatial-spectral total variation regularized low-rank tensor decomposition for hyperspectral image denoising. IEEE Trans Geosci Remote Sens 56(10):6196–6213
Zeng H, Xie X, Cui H, Yin H, Ning J (2020) Hyperspectral image restoration via global \({l_{1 - 2}}\) spatial-spectral total variation regularized local low-rank tensor recovery. IEEE Trans Geosci Remote Sens 59(4):3309–3325
Peng J, Zeng D, Ma J, Wang Y, Meng D (2018) Cpct-lrtdtv: cerebral perfusion ct image restoration via a low rank tensor decomposition with total variation regularization. In: Proc Med Imag Phys Med Imag, pp 821–825. SPIE
Li S, Zeng D, Peng J, Bian Z, Zhang H, Xie Q, Wang Y, Liao Y, Zhang S, Huang J et al (2018) An efficient iterative cerebral perfusion ct reconstruction via low-rank tensor decomposition with spatial-temporal total variation regularization. IEEE Trans Med Imaging 38(2):360–370
Lin Z, Chen M, Ma Y (2010) The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices. arXiv preprint arXiv:1009.5055
Boyd S, Parikh N, Chu E, Peleato B, Eckstein J et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122
Krishnan D, Fergus R (2009) Fast image deconvolution using hyper-laplacian priors. in Proc Adv Neural Inf Process 22
Donoho DL (1995) De-noising by soft-thresholding. IEEE Trans Inf Theory 41(3):613–627
Zhou Z, Li X, Wright J, Candes E, Ma Y (2010) Stable principal component pursuit. In: Proc IEEE Int Symp Inf Theory, pp 1518–1522
Plaza A, Benediktsson JA, Boardman JW, Brazile J, Bruzzone L, Camps-Valls G, Chanussot J, Fauvel M, Gamba P, Gualtieri A et al (2009) Recent advances in techniques for hyperspectral image processing. Remote Sens Environ 113:110–122
Datta D, Mallick PK, Bhoi AK, Ijaz MF, Shafi J (2022) Choi J (2022) Hyperspectral image classification: Potentials, challenges, and future directions. Comput Intell Neurosci 1:3854635
Xie Q, Zhou M, Zhao Q, Xu Z, Meng D (2020) Mhf-net: An interpretable deep network for multispectral and hyperspectral image fusion. IEEE Trans Pattern Anal Mach Intell 44(3):1457–1473
Yasuma F, Mitsunaga T, Iso D, Nayar SK (2010) Generalized assorted pixel camera: postcapture control of resolution, dynamic range, and spectrum. IEEE Trans Image Process 19(9):2241–2253
Sagheer SVM, George SN (2020) A review on medical image denoising algorithms. Biomed Signal Process Control 61:102036
Funding
This work was supported in part by the National Natural Science Foundation of China’s Regional Innovation Development Joint Fund under Grant U24A2001; in part by the Natural Science Foundation of Chongqing, China, under Grant CSTB2023NSCQ-LZX0044; in part by the National Natural Science Foundation of China under Grant 12071380, Grant 12301594, Grant 12201505, Grant 12101512; and in part by the Chongqing Talent Project, China, under Grant cstc2021ycjh-bgzxm0015.
Author information
Authors and Affiliations
Contributions
Zhihao Zhang: Conceptualization, Methodology, Software, Writing - Original Draft; Peng Zhang: Data Curation; Xinling Liu: Writing - Reviewing and Editing, Formal analysis; Jingyao Hou: Visualization, Investigation; Qingrong Feng: Software, Validation; Jianjun Wang: Supervision, Project administration.
Corresponding author
Ethics declarations
Conflict of interest/Competing interests
The authors have no competing interests to declare that are relevant to the content of this article.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, Z., Zhang, P., Liu, X. et al. Image denoising via double-weighted correlated total variation regularization. Appl Intell 55, 269 (2025). https://doi.org/10.1007/s10489-024-06024-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-06024-6