Abstract
Nowadays, deep convolutional neural networks (CNNs) are mostly applied for image Super-Resolution (SR). But still, there are some disadvantages of using CNN as it causes enormous computational complexity as if it is directly applied to SR applications. In this paper, dilated convolution is adopted that expands receptive field without any pixel information losses. The dilated convolution is designed as recursive residual network; therefore, internal parameters are preserved. Therefore, the model is termed as Multilevel Progressive Recursive Dilated Networks with Correlation Filter (MPRDNCF) and adopted progressive approach with different levels of recursive dilated residual network that is interleaved with correlation filter for upscaling of image. This module upscales with different scaling factors and magnifies it using deconvolution layer. MPRDNCF model used progressive recursive dilated residual learning approach which shares the information between the convolution layers for the identity prior during the network training. The architecture of MPRDNCF is 33 layers of CNN. We have presented an ablation study on Set5, Set14, Urban100, and BSD100 datasets, and also presented its superior result with comparison to the existing technique of state-of-art.
Similar content being viewed by others
Data availability
Dataset is available on https://www.kaggle.com/datasets.
References
Choi, J.S., Kim, M.: Single image super-resolution using global regression based on multiple local linear mappings. IEEE Trans. Image Process. 26(3), 1300–1314 (2017)
Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super-resolution. IEEE Trans. Image Process. 21(8), 3467–3478 (2012)
Zhu, X., Wang, X., Wang, J., Jin, P., Liu, L., Mei, D.: Image super-resolution based on sparse representation via direction and edge dictionaries. Math. Probl. Eng. 20, 17 (2017)
Zhang, F.L., Wang, J., Shechtman, E., Zhou, Z.Y., Shi, J.X., Hu, S.M.: PlenoPatch: patch-based plenoptic image manipulation. IEEE Trans. Vis. Comput. Graph. 23(5), 1561–1573 (2017)
Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2014)
Dong, C., Loy, C.C., Tang, X.: Accelerating the super-resolution convolutional neural network. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 9906 LNCS, pp. 391–407 (2016)
Lim, B., Son, S., Kim, H., Nah, S., Lee, K.M.: Enhanced deep residual networks for single image super-resolution. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., pp. 1132–1140 (2017)
Song, T.-A., Chowdhury, S.R., Yang, F., Dutta, J.: Super-resolution PET imaging using convolutional neural networks. IEEE Trans. Comput. Imaging 6, 518–528 (2020)
Sun, Y., Zhang, W., Gu, H., et al.: Convolutional neural network based models for improving super-resolution imaging. IEEE Access, pp. 43042–43051 (2019)
Ma, J., Yu, J., Liu, S., et al.: PathSRGAN: multi-supervised super-resolution for cytopathological images using generative adversarial network. IEEE Trans Med. Imaging 39(9), 2920–2930 (2020)
Yun, J.U., Jo, B., Park, I.K.: Joint face super-resolution and deblurring using generative adversarial network. IEEE Access, pp. 159661–159671 (2020)
Yang, Y., Li, Q., Yang, C., et al.: Deep networks with detail enhancement for infrared image super-resolution. IEEE Access, pp. 158690–158701 (2020)
Mei, S., Jiang, R., Li, X., Du, Q.: Spatial and spectral joint super-resolution using convolutional neural network. IEEE Trans. Geosci. Remote Sens. 58(7), 4590–4603 (2020)
Cao, L., Liu, J., Du, K., Guo, Y., Wang, T.: Guided cascaded super-resolution network for face image. IEEE Access, pp. 173387–173400 (2020)
Hung, K.W., Zhang, Z., Jiang, J.: Real-time image super-resolution using recursive depthwise separable convolution network. IEEE Access, 7, pp. 99804–99816 (2019)
Zhang, Z., Wang, X., Jung, C.: DCSR: dilated convolutions for single image super-resolution. IEEE Trans. Image Process. 28(4), 1625–1635 (2019)
Shi, W., Caballero, J., Huszar, F., et al.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2016-December, pp. 1874–1883 (2016)
Dumoulin, V., Visin, F.: A guide to convolution arithmetic for deep learning. undefined (2016)
Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 9006, pp. 111–126 (2014)
Bevilacqua, M.,Roumy, A., Guillemot, C., Morel, M.L.A.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. BMVC 2012 - Electron. Proc. Br. Mach. Vis. Conf. 2012, (2012)
Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), 6920 LNCS, pp. 711–730 (2010)
Huang, J. Bin, Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 5197–5206 (2015)
Kim, J., Lee, J.K., Lee, K.M.: Accurate image super-resolution using very deep convolutional networks. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 1646–1654 (2016)
Kim, J., Lee, J.K., Lee, K.M.: Deeply-Recursive Convolutional Network for Image Super-Resolution. Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 1637–1645 (2015)
Tai, Y., Yang, J., Liu, X.: Image super-resolution via deep recursive residual network. Proc. - 30th IEEE Conf. Comput. Vis. Pattern Recognition, CVPR 2017, pp. 2790–2798 (2017)
Zhang, Y., Tian, Y., Kong, Y., Zhong, B., Fu, Y.: Residual dense network for image super-resolution. (2018)
Author information
Authors and Affiliations
Contributions
Author - Ajay Sharma Conception or design of the work. Data collection. Data analysis and interpretation. Simulation and Modeling Author - Bhavana P. Shrivastava Drafting the article. Critical revision of the article. Final approval of the version to be published. Author - Aayushi Priya Revision of the Article.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Communicated by C. Yan.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sharma, A., Shrivastava, B.P. & Priya, A. Multilevel progressive recursive dilated networks with correlation filter (MPRDNCF) for image super-resolution. Multimedia Systems 29, 2455–2467 (2023). https://doi.org/10.1007/s00530-023-01126-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-023-01126-6