Skip to main content
SpringerLink
Log in

Image denoising via structure-constrained low-rank approximation

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Low-rank approximation-based methods have recently achieved impressive results in image restoration. Generally, the low-rank constraint integrated with the nonlocal self-similarity prior is enforced for image recovery. However, it is still unsatisfactory to recover complex image structures due to the lack of joint modeling based on local and global information, especially when the signal-to-noise ratio is low. In this paper, we propose a novel structure-constrained low-rank approximation method using complementary local and global information, as, respectively, modeled by kernel Wiener filtering and low-rank regularization. The proposed method solves the ill-posed inverse problem associated with image denoising by the alternating direction method of multipliers. Experimental results demonstrate that the proposed method not only removes noise effectively, but also is highly competitive against the state-of-the-art methods both qualitatively and quantitatively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Allan Weber, The USC-SIPI Image Database, March 31, 2013, http://sipi.usc.edu/database/.

  2. Member of SoftWays’ Medical Imaging Group, Brain MRI Images, March 31, 2013, https://www.mr-tip.com/serv1.php?type=db.

  3. Alexander Wong, David A. Clausi, Paul Fieguth, Skin Cancer Detection, March 31, 2018, https://uwaterloo.ca/vision-image-processing-lab/research-demos/skin-cancer-detection.

  4. Jun Xu, Hui Li, Zhetong Liang, David Zhang, Lei Zhang, PolyU Real-World Images Dataset, March 31, 2019, https://github.com/csjunxu/PolyU-Real-World-Noisy-Images-Dataset.

  5. Thomas L. Diepgen, Dermatology Information System, March 31, 2013, http://www.dermis.net.

References

  1. Baselice F, Ferraioli G, Pascazio V, Sorriso A (2019) Denoising of MR images using Kolmogorov–Smirnov distance in a non local framework. Magn Reonance Imaging 57:176–193

    Google Scholar 

  2. Ben Abdallah M, Malek J, Azar AT, Belmabrouk H, Monreal JE, Krissian K (2016) Adaptive noise-reducing anisotropic diffusion filter. Neural Comput Appl 27(5):1273–1300

    Google Scholar 

  3. Benou A, Veksler R, Friedman A, Raviv TR (2017) Ensemble of expert deep neural networks for spatio-temporal denoising of contrast-enhanced MRI sequences. Med Image Anal 42:145–159

    Google Scholar 

  4. Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122

    MATH  Google Scholar 

  5. Buades A, Coll B, Morel JM (2005) A review of image denoising algorithms, with a new one. Multiscale Model Simul 4(2):490–530

    MathSciNet  MATH  Google Scholar 

  6. Cai JF, Candes EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982

    MathSciNet  MATH  Google Scholar 

  7. Candes EJ, Recht B (2009) Exact matrix completion via convex optimization. Found Comput Math 9(6):717–772

    MathSciNet  MATH  Google Scholar 

  8. Candes EJ, Li XD, Ma Y, Wright J (2011) Robust principal component analysis? J ACM 58(3):11:1–11:37

    MathSciNet  MATH  Google Scholar 

  9. Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095

    MathSciNet  Google Scholar 

  10. Daubechies I, Defrise M, De Mol C (2004) An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun Pure Appl Math 57(11):1413–1457

    MathSciNet  MATH  Google Scholar 

  11. Divakar N, Babu RV (2017) Image denoising via CNNs: an adversarial approach. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), Honolulu, HI, 21–26 July 2017, pp 1076–1083

  12. Elad M, Aharon M (2006) Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans Image Process 15(12):3736–3745

    MathSciNet  Google Scholar 

  13. Fan F, Ma Y, Li C, Mei X, Huang J, Ma J (2017) Hyperspectral image denoising with superpixel segmentation and low-rank representation. Inf Sci 397:48–68

    Google Scholar 

  14. Fan L, Li X, Guo Q, Zhang C (2018) Nonlocal image denoising using edge-based similarity metric and adaptive parameter selection. Sci China Inf Sci 61(4):049101

    Google Scholar 

  15. Gu SH, Xie Q, Meng DY, Zuo WM, Feng XC, Zhang L (2017) Weighted nuclear norm minimization and its applications to low level vision. Int J Comput Vis 121(2):183–208

    Google Scholar 

  16. Hu Y, Zhang DB, Ye JP, Li XL, He XF (2013) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130

    Google Scholar 

  17. Huang YM, Yan HY, Wen YW, Yang X (2018) Rank minimization with applications to image noise removal. Inf Sci 429:147–163

    MathSciNet  MATH  Google Scholar 

  18. Irshad M, Muhammad N, Sharif M, Yasmeen M (2018) Automatic segmentation of the left ventricle in a cardiac MR short axis image using blind morphological operation. Eur Phys J Plus 133(4):148

    Google Scholar 

  19. Khalid S, Muhammad N, Sharif M (2018) Automatic measurement of the traffic sign with digital segmentation and recognition. IET Intell Transp Syst 13(2):269–279

    Google Scholar 

  20. Khan H, Sharif M, Bibi N, Muhammad N (2019) A novel algorithm for the detection of cerebral aneurysm using sub-band morphological operation. Eur Phys J Plus 134(1):34

    Google Scholar 

  21. Khan MA, Akram T, Sharif M, Javed MY, Muhammad N, Yasmin M (2019) An implementation of optimized framework for action classification using multilayers neural network on selected fused features. Pattern Anal Appl 22(4):1377–1397

    MathSciNet  Google Scholar 

  22. Khan NS, Muhammad N, Farwa S, Saba T, Khattak S, Mahmood Z (2019) Early CU depth decision and reference picture selection for low complexity MV-HEVC. Symmetry 11(4):454

    Google Scholar 

  23. Mahmood Z, Bibi N, Usman M, Khan U, Muhammad N (2019) Mobile cloud based-framework for sports applications. Multidimens Syst Signal Process 30(4):1991–2019

    MATH  Google Scholar 

  24. Mughal B, Muhammad N, Sharif M, Rehman A, Saba T (2018) Removal of pectoral muscle based on topographic map and shape-shifting silhouette. BMC Cancer 18(1):778

    Google Scholar 

  25. Muhammad N, Bibi N, Jahangir A, Mahmood Z (2018) Image denoising with norm weighted fusion estimators. Pattern Anal Appl 21(4):1013–1022

    MathSciNet  Google Scholar 

  26. Muhammad N, Bibi N, Wahab A, Mahmood Z, Akram T, Naqvi SR, Oh HS, Kim DG (2018) Image de-noising with subband replacement and fusion process using bayes estimators. Comput Electr Eng 70:413–427

    Google Scholar 

  27. Li H, He X, Tao D, Tang Y, Wang R (2018) Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning. Pattern Recognit 79:130–146

    Google Scholar 

  28. Liu HF, Xiong RQ, Liu D, Ma SW, Wu F, Gao W (2018) Image denoising via low rank regularization exploiting intra and inter patch correlation. IEEE Trans Circuits Syst Video Technol 28(12):3321–3332

    Google Scholar 

  29. Mairal J, Sapiro G, Elad M (2008) Learning multiscale sparse representations for image and video restoration. Multiscale Model Simul 7(1):214–241

    MathSciNet  MATH  Google Scholar 

  30. Meiniel W, Olivo-Marin JC, Angelini ED (2018) Denoising of microscopy images: a review of the state-of-the-art, and a new sparsity-based method. IEEE Trans Image Process 27(8):3842–3856

    MathSciNet  MATH  Google Scholar 

  31. Osher S, Burger M, Goldfarb D, Xu JJ, Yin WT (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4(2):460–489

    MathSciNet  MATH  Google Scholar 

  32. Ozmen G, Ozsen S (2018) A new denoising method for fMRI based on weighted three-dimensional wavelet transform. Neural Comput Appl 29(8):263–276

    Google Scholar 

  33. Papari G, Idowu N, Varslot T (2017) Fast bilateral filtering for denoising large 3D images. IEEE Trans Image Process 26(1):251–261

    MathSciNet  MATH  Google Scholar 

  34. Portilla J, Strela V, Wainwright MJ, Simoncelli EP (2003) Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Trans Image Process 12(11):1338–1351

    MathSciNet  MATH  Google Scholar 

  35. Ran MS, Hu JR, Chen Y, Chen H, Sun HQ, Zhou JL, Zhang Y (2019) Denoising of 3D magnetic resonance images using a residual encoderdecoder Wasserstein generative adversarial network. Med Image Anal 55:165–180

    Google Scholar 

  36. Spiegelberg J, Idrobo JC, Herklotz A, Ward TZ, Zhou W, Rusz J (2018) Local low rank denoising for enhanced atomic resolution imaging. Ultramicroscopy 187:34–42

    Google Scholar 

  37. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Proceedings of IEEE international conference on computer vision, Santa Barbara, CA, 23–25 June 1998, pp 839–846

  38. Torralba A, Oliva A (2003) Statistics of natural image categories. Netw Comput Neural Syst 14(3):391–412

    Google Scholar 

  39. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Google Scholar 

  40. Wu Y, Fang LY, Li ST (2019) Weighted tensor rank-1 decomposition for nonlocal image denoising. IEEE Trans Image Process 28(6):2719–2730

    MathSciNet  MATH  Google Scholar 

  41. Xiao J, Tian H, Zhang Y, Zhou Y, Lei J (2018) Blind video denoising via texture-aware noise estimation. Comput Vis Image Underst 169:1–13

    Google Scholar 

  42. Xu J, Li H, Liang Z, Zhang D, Zhang L (2018) Real-world noisy image denoising: a new benchmark. arXiv preprint arXiv:1804.02603

  43. Yan Q, Xu Y, Yang X, Nguyen T (2015) Single image superresolution based on gradient profile sharpness. IEEE Trans Image Process 24(10):3187–3202

    MathSciNet  MATH  Google Scholar 

  44. Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G (2018) Low-dose CT image denoising using a generative adversarial network with wasserstein distance and perceptual loss. IEEE Trans Med Imaging 37(6):1348–1357

    Google Scholar 

  45. Zhang CY, Hu WR, Jin TY, Mei ZL (2018) Nonlocal image denoising via adaptive tensor nuclear norm minimization. Neural Comput Appl 29(1):3–19

    Google Scholar 

  46. Zhang HJ, Wang S, Zhao MB, Xu XF, Ye YM (2018) Locality reconstruction models for book representation. IEEE Trans Knowl Data Eng 30(10):1873–1886

    Google Scholar 

  47. Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 26(7):3142–3155

    MathSciNet  MATH  Google Scholar 

  48. Zhang K, Zuo W, Zhang L (2018) FFDNet: toward a fast and flexible solution for CNN-based image denoising. IEEE Trans Image Process 27(9):4608–4622

    MathSciNet  Google Scholar 

  49. Zhang Y, Liu J, Li M, Guo Z (2014) Joint image denoising using adaptive principal component analysis and self-similarity. Inf Sci 259:128–141

    Google Scholar 

  50. Zhang Y, Shi F, Cheng J, Wang L, Yap PT, Shen D (2019) Longitudinally guided super-resolution of neonatal brain magnetic resonance images. IEEE Trans Cybern 49(2):662–674

    Google Scholar 

  51. Zhang Y, Liu J, Yang W, Guo Z (2015) Image super-resolution based on structure-modulated sparse representation. IEEE Trans Image Process 24(9):2797–2810

    MathSciNet  MATH  Google Scholar 

  52. Zhong XW, Xu LL, Li YT, Liu ZY, Chen EH (2015) A nonconvex relaxation approach for rank minimization problems. In: Proceedings of AAAI conference on artificial intelligence, Austin, Texas, USA, 25–30 January 2015, pp 1980–1987

Download references

Author information

Authors and Affiliations

  1. School of Information Science and Technology, Northwest University, Xi’an, 710127, China

    Yongqin Zhang, Ruiwen Kang, Jun Wang & Jinye Peng

  2. CAS Key Laboratory of Spectral Imaging Technology, Xi’an, 710119, China

    Yongqin Zhang

  3. Art School, Northwest University, Xi’an, 710127, China

    Xianlin Peng

  4. School of Software Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    Jihua Zhu

  5. Center for Biomedical Image Computing and Analysis, University of Pennsylvania, Philadelphia, PA, 19104-6116, USA

    Hangfan Liu

Authors
  1. Yongqin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruiwen Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xianlin Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jihua Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jinye Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hangfan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongqin Zhang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported by Natural Science Basic Research Program of Shaanxi (Program No. 2019JM-103), Open Research Fund of CAS Key Laboratory of Spectral Imaging Technology (Grant No. LSIT201920W), Social Science Foundation of Shaanxi Province (Grant No. 2019H010), Program for Changjiang Scholars and Innovative Research Team in University (Grant No. IRT13090), and NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Kang, R., Peng, X. et al. Image denoising via structure-constrained low-rank approximation. Neural Comput & Applic 32, 12575–12590 (2020). https://doi.org/10.1007/s00521-020-04717-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04717-w

Keywords

Search

Navigation