Skip to main content
SpringerLink
Log in

Texture compensation with multi-scale dilated residual blocks for image denoising

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Deep convolutional neural networks have achieved great success for image denoising recently. However, increasing the depth of the neural network cannot significantly boost the performance of the algorithms for image denoising. It is still a challenging research topic to recover structural information and fine details of the images. In this paper, we put forward a convolutional neural network for single image denoising, mainly consisting of a noise mapping block (NMB), a texture compensation block (TCB), and a composition block (CB). The NMB borrows a series of standard residual blocks to learn the noise mapping. Specifically, we employ the TCB to enhance the details via multi-scale dilated residual blocks (MDRBs) that hold the characteristics of fusing multi-scale contexture information with dilated convolution. Finally, the CB does an element-wise addition to composite the output. Besides, we have conducted extensive experiments on gray as well as color image datasets. Both quantitative and qualitative evaluations demonstrate the superior performance of our approach in comparison with the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Malik JM, Perona P (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–39

    Article  Google Scholar 

  2. Chambolle A (2004) An algorithm for total variation minimization and applications. J Math Imaging Vision 20(1):89–97

    MathSciNet  MATH  Google Scholar 

  3. Yicong H, Fei W, Yingsong L, Jing Q, Badong C (2020) Robust matrix completion via maximum correntropy criterion and half-quadratic optimization. IEEE Trans Signal Process 68:181–195

    Article  MathSciNet  Google Scholar 

  4. Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), 2, 60–65. IEEE

  5. Huang X, Du B, Liu W (2020) Multichannel color image denoising via weighted schatten p-norm minimization. In: Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelligence IJCAI-PRICAI-20

  6. Elad M, Aharon M (2006) Image denoising via learned dictionaries and sparse representation. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06),1, 895–900. IEEE

  7. Mosseri I, Zontak M, Irani M (2013) Combining the power of internal and external denoising. In: IEEE international conference on computational photography (ICCP), 1–9. IEEE

  8. Aharon M, Elad M, Bruckstein A (2006) K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322

    Article  Google Scholar 

  9. Dong W, Zhang L, Shi G, Li X (2012) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22(4):1620–1630

    Article  MathSciNet  Google Scholar 

  10. Mairal J, Bach F, Ponce J, Sapiro G, Zisserman A (2009) Non-local sparse models for image restoration. In: 2009 IEEE 12th international conference on computer vision, 2272–2279. IEEE

  11. Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095

    Article  MathSciNet  Google Scholar 

  12. Muhammad N, Khan H, Bibi N, Usman M, Ahmed N, Khan SN, Mahmood Z (2020) Frequency component vectorisation for image dehazing. J Exp Theoretical Artif Intell 4:1–14

    Article  Google Scholar 

  13. Muhammad N, Bibi N, Kamran M, Bashir Y, Kim DG (2020) Image noise reduction based on block matching in wavelet frame domain. Multimed Tools Appl 79(35):26327–44

    Article  Google Scholar 

  14. Muhammad N, Bibi N, Wahab A, Mahmood Z, Kim DG (2017) Image denoising with subband replacement and fusion process using bayes estimators. Comput Electr Eng 70:413–27

    Article  Google Scholar 

  15. Xinjian H, Bo D, Dapeng T, Liangpei Z (2020) Spatial-spectral weighted nuclear norm minimization for hyperspectral image denoising. Neurocomputing 399:271–284

    Article  Google Scholar 

  16. Muhammad N, Bibi N, Jahangir A, Mahmood Z (2017) Image denoising with norm weighted fusion estimators. Pattern Anal Appl 21(4):1013–22

    Article  MathSciNet  Google Scholar 

  17. Zhentao Hu, Zhiqiang Huang, Xinjian Huang, Fulin Luo, Renzhen Ye (2019) An adaptive nonlocal gaussian prior for hyperspectral image denoising. Geoence Remote Sens Lett IEEE 16(9):1487–1491

    Article  Google Scholar 

  18. Muhammad N, Rubab, Bibi N, Song OY, Ali S (2020) Severity recognition of aloe vera diseases using ai in tensor flow domain. Cmc-Tech Science Press, Henderson

    Google Scholar 

  19. Naz I, Muhammad N, Yasmin M, Sharif M, Shah JH, Fernandes SL (2019) Robust discrimination of leukocytes protuberant types for early diagnosis of leukemia. J Mech Med Biol 19(06):1–4

    Article  Google Scholar 

  20. Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: Can plain neural networks compete with bm3d? In: 2012 IEEE conference on computer vision and pattern recognition, 2392–2399. IEEE

  21. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, 1097–1105

  22. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1–9

  23. Zhang K, Zuo W, Chen Y, Meng D, Zhang L (2017) Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Trans Image Process 26(7):3142–3155

    Article  MathSciNet  Google Scholar 

  24. Zhang K, Zuo W, Zhang L (2018) Ffdnet: Toward a fast and flexible solution for cnn-based image denoising. IEEE Trans Image Process 27(9):4608–4622

    Article  MathSciNet  Google Scholar 

  25. Guo S, Yan Z, Zhang K, Zuo W, Zhang L (2019) Toward convolutional blind denoising of real photographs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1712–1722

  26. Mao X, Shen C, Yang YB (2016) Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In: Advances in neural information processing systems, 2802–2810

  27. Li D, Chen H, Jin G, Jin Y, Zhu C, Chen E (2020) A multiscale dilated residual network for image denoising. Multimedia Tools and Applications 1–16

  28. Tian C, Xu Y, Li Z, Zuo W, Fei L, Liu H (2020) Attention-guided cnn for image denoising. Neural Netw 124:117–129

    Article  Google Scholar 

  29. Jain V, Seung S (2009) Natural image denoising with convolutional networks. Adv Neural Inf Process Sys 21:769–776

    Google Scholar 

  30. Chen Y, Pock T (2016) Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration. IEEE Trans Pattern Anal Mach Intell 39(6):1256–1272

    Article  Google Scholar 

  31. Wu Y, Zhao H, Zhang L (2014) Image denoising with rectified linear units. In: International Conference on Neural Information Processing, 142–149. Springer

  32. Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: Advances in neural information processing systems, 341–349

  33. Liu P, Zhang H, Zhang K, Lin L, Zuo W (2018) Multi-level wavelet-cnn for image restoration. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 773–782

  34. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778

  35. Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1646–1654

  36. Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1492–1500

  37. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 7132–7141

  38. Lim B, Son S, Kim H, Nah S, Mu Lee K (2017) Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 136–144

  39. Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2472–2481

  40. Chen C, Xiong Z, Tian X, Wu F (2018) Deep boosting for image denoising. In: Proceedings of the European Conference on Computer Vision (ECCV), 3–18

  41. Yu F, Koltun V (2015) Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122

  42. Dong L, Zhang H, Ji Y, Ding Y (2020) Crowd counting by using multi-level density-based spatial information: A Multi-scale CNN framework. Inf Sci 528:79–91

    Article  MathSciNet  Google Scholar 

  43. Wang T, Sun M, Hu K (2017) Dilated deep residual network for image denoising. In: 2017 IEEE 29th international conference on tools with artificial intelligence (ICTAI), 1272–1279. IEEE

  44. Peng Y, Zhang L, Liu S, Wu X, Zhang Y, Wang X (2019) Dilated residual networks with symmetric skip connection for image denoising. Neurocomputing 345:67–76

    Article  Google Scholar 

  45. Tian C, Xu Y, Zuo W (2020) Image denoising using deep cnn with batch renormalization. Neural Netw 121:461–473

    Article  Google Scholar 

  46. Wang P, Chen P, Yuan Y, Liu D, Huang Z, Hou X (2018) Cottrell G Understanding convolution for semantic segmentation. In: 2018 IEEE winter conference on applications of computer vision (WACV), 1451–1460. IEEE

  47. Kingma DP, Ba J Adam (2014) A method for stochastic optimization. arXiv preprint arXiv:1412.6980

  48. Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, 2, 416–423. IEEE

  49. Ma K, Duanmu Z, Wu Q, Wang Z, Yong H, Li H, Zhang L (2016) Waterloo exploration database: New challenges for image quality assessment models. IEEE Trans Image Process 26(2):1004–1016

    Article  MathSciNet  Google Scholar 

  50. Zoran D, Weiss Y (2011) From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, 479–486. IEEE

  51. Gu S, Zhang L, Zuo W, Feng X (2014) Weighted nuclear norm minimization with application to image denoising. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2862–2869

  52. Ulyanov D, Vedaldi A, Lempitsky V Deep image prior. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition

  53. Papyan V, Romano Y, Sulam J, Elad M (2017) Convolutional dictionary learning via local processing

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China

    Dan Zhang, Pan Li, Lei Zhao, Duanqing Xu & Dongming Lu

Authors
  1. Dan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Duanqing Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dongming Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lei Zhao.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, D., Li, P., Zhao, L. et al. Texture compensation with multi-scale dilated residual blocks for image denoising. Neural Comput & Applic 33, 12957–12971 (2021). https://doi.org/10.1007/s00521-021-05920-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-05920-z

Keywords

Search

Navigation