Abstract
In this work, a simple and compact-structured convolutional neural network (CNN) entitled as Denoising and Super-Resolution (DnSR) network for single image denoising and super resolution (SISR) is presented. Using sparsity property (a smaller number of large intensity values and a larger number of small intensity values), the training of DnSR is made to converge early. We obtain the sparsity by learning residuals of image pixels instead of learning raw image pixels particularly for SR. We use a smaller receptive field of the image patch for faster training. We use gradient clipping to train DnSR net with an extremely large learning rate to overcome gradient inconsistency during training. An end-to-end mapping is done by learning the complex mapping between low-resolution (LR) image patches and the corresponding residual of high resolution (∆HR) image patches using DnSR net. The proposed DnSR net uses a smaller number of parameters (approximately 3 times lesser) than the existing state-of-the-art (SOTA) SRCNN method. The proposed DnSR provides superior reconstruction accuracy with less artifacts when compared to other SOTA methods. The performance of the DnSR is assessed qualitatively and quantitatively using different image quality metrics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sun, J., Xu, Z., Shum, H.Y.: Image super-resolution using gradient profile prior. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, pp. 1–8 (2008). https://doi.org/10.1109/CVPR.2008.4587659
Baker, S., Kanade, T.: Limits on super-resolution and how to break them. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1167–1183 (2002). https://doi.org/10.1109/TPAMI.2002.1033210
Mallat, S., Yu, G.: Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11), 2889–2900 (2010). https://doi.org/10.1109/TIP.2010.2049927
Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010). https://doi.org/10.1109/TIP.2010.2050625
Bevilacqua, M., Roumy, A., Guillemot, C., Alberi-Morel, M.L.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings British Machine Vision Conference pp. 135.1–135.10 (2012). https://doi.org/10.5244/C.26.135
Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 111–126. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16817-3_8
Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: Boissonnat, J.D., et al. (eds) Curves and Surfaces. Curves and Surfaces 2010. Lecture Notes in Computer Science, vol. 6920, pp. 711–730. Springer, Berlin (2012).https://doi.org/10.1007/978-3-642-27413-8_47
Huang, J., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, pp. 5197–5206 (2015). https://doi.org/10.1109/CVPR.2015.7299156
Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2015). https://doi.org/10.1109/TPAMI.2015.2439281
Dong, C., Loy, C.C., Tang, X.: Accelerating the Super-Resolution Convolutional Neural Network. CoRR, abs/1608.00367 (2016).http://arxiv.org/abs/1608.00367
Shreyamsha Kumar, B.K.: Image denoising based on non-local means filter and its method noise thresholding. SIViP 7(6), 1211–1227 (2012). https://doi.org/10.1007/s11760-012-0389-y
Foi, A., Katkovnik, V., Egiazarian, K.: Pointwise shape-adaptive DCT for high-quality denoising and deblocking of grayscale and color images. IEEE Trans. Image Process. 16(5), 1395–1411 (2007). https://doi.org/10.1109/TIP.2007.891788
Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006). https://doi.org/10.1109/TIP.2006.881969
Zuo, W., Zhang, L., Song, C., Zhang, D.: Texture enhanced image denoising via gradient histogram preservation. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, pp. 1203–1210 (2013). https://doi.org/10.1109/CVPR.2013.159
Zoran, D., Weiss, Y.: From learning models of natural image patches to whole image restoration. In: 2011 International Conference on Computer Vision, Barcelona, pp. 479–486 (2011). https://doi.org/10.1109/ICCV.2011.6126278
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, pp. 248–255 (2009). https://doi.org/10.1109/CVPR.2009.5206848
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vancouver, BC, Canada, vol. 2, pp. 416–423 (2001). https://doi.org/10.1109/ICCV.2001.937655
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004). https://doi.org/10.1109/TIP.2003.819861
Sheikh, H.R., Bovik, A.C., de Veciana, G.: An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Trans. Image Process. 14(12), 2117–2128 (2005). https://doi.org/10.1109/TIP.2005.859389
He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 1026–1034 (2015). https://doi.org/10.1109/ICCV.2015.123
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Deivalakshmi, S., Sudaroli Sandana, J. (2023). A Compact-Structured Convolutional Neural Network for Single Image Denoising and Super-Resolution. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1776. Springer, Cham. https://doi.org/10.1007/978-3-031-31407-0_51
Download citation
DOI: https://doi.org/10.1007/978-3-031-31407-0_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31406-3
Online ISBN: 978-3-031-31407-0
eBook Packages: Computer ScienceComputer Science (R0)