Skip to main content
SpringerLink
Log in

The classification and denoising of image noise based on deep neural networks

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Currently, image denoising is a challenge in many applications of computer vision. The existing denoising methods depend on the information of noise types or levels, which are generally classified by experts. These methods have not applied computational methods to pre-classify the image noise types. Furthermore, some methods assume that the noise type of the image is a certain one like Gaussian noise, which limits the ability of the denoising in real applications. Different from the existing methods, this paper introduces a new method that can classify and denoise not only a certain type noise but also mixed types of noises for real demand. Our method utilizes two types of deep learning networks. One is used to classify the noise type of the images and the other one performs denoising based on the classification result of the first one. Our framework can automatically denoise single or mixed types of noises with these efforts. Our experimental results show that our classification network achieves higher accuracy, and our denoising network can ensure higher PSNR and SSIM values than the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Buades A, Coll B, Morel JM (2005) A non-local algorithm for image denoising. Comput Vis Pattern Recogn, 60–65

  2. Mohamed AR, Hinton G, Penn G (2012) Understanding how deep belief networks perform acoustic modelling. IEEE Int Conf Acoust, Speech Signal Process, 4273–4276

  3. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst, 1–9

  4. Ulas C, Tetteh G, Kaczmarz S, et al. (2018) DeepASL: kinetic model incorporated loss for denoising arterial spin labeled MRI via deep residual learning. In: International conference on medical image computing and computer-assisted intervention, pp 30–38

  5. Chierchia G, Cozzolino D, Poggi G, et al. (2017) SAR image despeckling through convolutional neural networks. In: IEEE International geoscience and remote sensing symposium (IGARSS), pp 5438–5441

  6. Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process 16:2080–2095

    MathSciNet  Google Scholar 

  7. Xu J, Zhang L, Zuo W, Zhang D, Feng X (2015) Patch group based nonlocal self-similarity prior learning for image denoising. In: International conference on computer vision, pp 244–252

  8. Osher S, Burger M, Goldfarb D, Xu J, Yin W (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4:460–489

    MathSciNet  MATH  Google Scholar 

  9. Weiss Y, Freeman WT (2007) What makes a good model of natural images? In: IEEE Conference on computer vision and pattern recognition, pp 1–8

  10. Elad M, Aharon M (2006) Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans Image Process 15:3736–3745

    MathSciNet  Google Scholar 

  11. Dong W, Zhang L, Shi G, Li X (2013) Nonlocally centralized sparse representation for image restoration. IEEE Trans Image Process 22:1620–1630

    MathSciNet  MATH  Google Scholar 

  12. Xie J, Xu L, Chen E (2012) Image denoising and inpainting with deep neural networks. In: International conference on neural information processing systems, pp 341–349

  13. Agostinelli F, Anderson MR, Lee H (2013) Robust image denoising with multi-column deep neural networks. Advances in Neural Information Processing Systems

  14. Xu L, Ren JSJ, Liu C, et al. (2014) Deep convolutional neural network for image deconvolution. In: International conference on neural information processing systems, pp 1790–1798

  15. Patidar P, Gupta M, Srivastava S, et al. (2010) Image denoising by various filters for different noise. Int J Comput Appl 9:24–28

    Google Scholar 

  16. Gupta P, Bampis CG, Jin Y, et al. (2018) Natural scene statistics for noise estimation. In: IEEE Southwest symposium on image analysis and interpretation (SSIAI)

  17. Zhai G, Wu X (2011) Noise estimation using statistics of natural images. IEEE International Conference on Image Processing

  18. Jain V, Seung S (2009) Natural image denoising with convolutional networks. Adv Neural Inf Proces Syst, 769–776

  19. Vincent P, et al. (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408

    MathSciNet  MATH  Google Scholar 

  20. Burger HC, Schuler CJ, Harmeling S (2012) Image denoising: can plain neural networks compete with BM3D? In: IEEE Conference on computer vision and pattern recognition, pp 2392–2399

  21. Lore KG, Akintayo A, Sarkar S (2017) LLNet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recogn 61:650–662

    Google Scholar 

  22. Chen Y, Pock T (2015) Trainable nonlinear reaction diffusion: a flexible framework for fast and effective image restoration. IEEE Trans Pattern Anal Mach Intell 39(6):1256–1272

    Google Scholar 

  23. Zhang K, Chen Y, Chen Y, et al. (2017) Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans Image Process 99:1–1

    MathSciNet  MATH  Google Scholar 

  24. Lopez-Martlnez C, Fabregas X (2003) Polarimetric SAR speckle noise model. IEEE Trans Geosci Remote Sens 41(10):2232– 2242

    Google Scholar 

  25. Lopez-Martlnez C, Fabregas X, Pottier E (2005) Multidimensional speckle noise model. Eurasip J Adv Signal Process 20:1–13

    MATH  Google Scholar 

  26. Katti SK, Rao AV (1967) Handbook of the poisson distribution. J Oper Res Soc 10(2):412–412

    Google Scholar 

  27. Chandra NK, Roy D, Ghosh T (2013) A generalized poisson distribution. Commun Stat - Theory Methods 42(15):2786–2797

    MathSciNet  MATH  Google Scholar 

  28. Yue H, Zhou S, Yang J, Sun X, Hou C (2018) Deep joint noise estimation and removal for high ISO JPEG images. In: 2018 24th International conference on pattern recognition (ICPR)

  29. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations

  30. Uchida K, Tanaka M, Okutomi M (2018) Coupled convolution layer for convolutional neural network. In: International conference on pattern recognition. IEEE, p 197

  31. Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International conference on international conference on machine learning

  32. Yuan B (2017) Efficient hardware architecture of softmax layer in deep neural network. In: System-on-chip conference. IEEE, pp 323–326

  33. Schmidt U, Roth S (2014) Shrinkage fields for effective image restoration. In: IEEE Conference on computer vision and pattern recognition, pp 2774–2781

  34. Lauer F, Suen CY, Bloch G (2007) A trainable feature extractor for handwritten digit recognition. Pattern Recogn 40(6):1816–1824

    MATH  Google Scholar 

  35. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: International conference on neural information processing systems, pp 1097–1105

  36. Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT, pp 177– 186

  37. Tai Y, Yang J, Liu X, Xu C (2017) MemNet: a persistent memory network for image restoration. In: The IEEE International conference on computer vision (ICCV), pp 4539–4547

Download references

Acknowledgements

This work has been supported by the National Natural Science Foundation of China (Grant No. 61802279, 6180021345, 61702366, 61602342 and 51607122) and Natural Science Foundation of Tianjin (Grant No.16JCYBJC42300, 16JCYBJC41500 and 17JCQNJC00100).

Author information

Authors and Affiliations

  1. Tianjin Polytechnic University, Tianjin, 300387, China

    Fan Liu, Qingzeng Song & Guanghao Jin

Authors
  1. Fan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qingzeng Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guanghao Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guanghao Jin.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, F., Song, Q. & Jin, G. The classification and denoising of image noise based on deep neural networks. Appl Intell 50, 2194–2207 (2020). https://doi.org/10.1007/s10489-019-01623-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-019-01623-0

Keywords

Search

Navigation