Skip to main content

A Compact-Structured Convolutional Neural Network for Single Image Denoising and Super-Resolution

  • Conference paper
  • First Online:
Computer Vision and Image Processing (CVIP 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1776))

Included in the following conference series:

  • 356 Accesses

Abstract

In this work, a simple and compact-structured convolutional neural network (CNN) entitled as Denoising and Super-Resolution (DnSR) network for single image denoising and super resolution (SISR) is presented. Using sparsity property (a smaller number of large intensity values and a larger number of small intensity values), the training of DnSR is made to converge early. We obtain the sparsity by learning residuals of image pixels instead of learning raw image pixels particularly for SR. We use a smaller receptive field of the image patch for faster training. We use gradient clipping to train DnSR net with an extremely large learning rate to overcome gradient inconsistency during training. An end-to-end mapping is done by learning the complex mapping between low-resolution (LR) image patches and the corresponding residual of high resolution (∆HR) image patches using DnSR net. The proposed DnSR net uses a smaller number of parameters (approximately 3 times lesser) than the existing state-of-the-art (SOTA) SRCNN method. The proposed DnSR provides superior reconstruction accuracy with less artifacts when compared to other SOTA methods. The performance of the DnSR is assessed qualitatively and quantitatively using different image quality metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sun, J., Xu, Z., Shum, H.Y.: Image super-resolution using gradient profile prior. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, pp. 1–8 (2008). https://doi.org/10.1109/CVPR.2008.4587659

  2. Baker, S., Kanade, T.: Limits on super-resolution and how to break them. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1167–1183 (2002). https://doi.org/10.1109/TPAMI.2002.1033210

  3. Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11), 2889–2900 (2010). https://doi.org/10.1109/TIP.2010.2049927

    Article  MathSciNet  MATH  Google Scholar 

  4. Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010). https://doi.org/10.1109/TIP.2010.2050625

    Article  MathSciNet  MATH  Google Scholar 

  5. Bevilacqua, M., Roumy, A., Guillemot, C., Alberi-Morel, M.L.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings British Machine Vision Conference pp. 135.1–135.10 (2012). https://doi.org/10.5244/C.26.135

  6. Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 111–126. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16817-3_8

    Chapter  Google Scholar 

  7. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.D., et al. (eds) Curves and Surfaces. Curves and Surfaces 2010. Lecture Notes in Computer Science, vol. 6920, pp. 711–730. Springer, Berlin (2012).https://doi.org/10.1007/978-3-642-27413-8_47

  8. Huang, J., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, pp. 5197–5206 (2015). https://doi.org/10.1109/CVPR.2015.7299156

  9. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2015). https://doi.org/10.1109/TPAMI.2015.2439281

    Article  Google Scholar 

  10. Dong, C., Loy, C.C., Tang, X.: Accelerating the Super-Resolution Convolutional Neural Network. CoRR, abs/1608.00367 (2016).http://arxiv.org/abs/1608.00367

  11. Shreyamsha Kumar, B.K.: Image denoising based on non-local means filter and its method noise thresholding. SIViP 7(6), 1211–1227 (2012). https://doi.org/10.1007/s11760-012-0389-y

    Article  Google Scholar 

  12. Foi, A., Katkovnik, V., Egiazarian, K.: Pointwise shape-adaptive DCT for high-quality denoising and deblocking of grayscale and color images. IEEE Trans. Image Process. 16(5), 1395–1411 (2007). https://doi.org/10.1109/TIP.2007.891788

    Article  MathSciNet  Google Scholar 

  13. Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006). https://doi.org/10.1109/TIP.2006.881969

    Article  MathSciNet  Google Scholar 

  14. Zuo, W., Zhang, L., Song, C., Zhang, D.: Texture enhanced image denoising via gradient histogram preservation. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, pp. 1203–1210 (2013). https://doi.org/10.1109/CVPR.2013.159

  15. Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, Barcelona, pp. 479–486 (2011). https://doi.org/10.1109/ICCV.2011.6126278

  16. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, pp. 248–255 (2009). https://doi.org/10.1109/CVPR.2009.5206848

  17. Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vancouver, BC, Canada, vol. 2, pp. 416–423 (2001). https://doi.org/10.1109/ICCV.2001.937655

  18. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004). https://doi.org/10.1109/TIP.2003.819861

    Article  Google Scholar 

  19. Sheikh, H.R., Bovik, A.C., de Veciana, G.: An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans. Image Process. 14(12), 2117–2128 (2005). https://doi.org/10.1109/TIP.2005.859389

    Article  Google Scholar 

  20. He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 1026–1034 (2015). https://doi.org/10.1109/ICCV.2015.123

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Deivalakshmi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Deivalakshmi, S., Sudaroli Sandana, J. (2023). A Compact-Structured Convolutional Neural Network for Single Image Denoising and Super-Resolution. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1776. Springer, Cham. https://doi.org/10.1007/978-3-031-31407-0_51

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31407-0_51

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31406-3

  • Online ISBN: 978-3-031-31407-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics