ABSTRACT
In this paper, we aim at using Deep Belief Networks (DBNs) to solve the problem of image super-resolution (SR). We exploit the hierarchical structure of the DBNs to capture the non-linear mapping from low-resolution (LR) patches to their high-resolution (HR) counterpart. When a query LR image is input, we divide it into a list of patches, then we put each patch into a forward propagation network which is a trained deep belief network. The output is the predicted HR patches. Finally, we combine the HR patches into expected HR images. We evaluate our approach on a popular dataset which is used in other super-resolution literature. Experimental results demonstrate the performance of our method is superior to several state-of-the-art super-resolution methods both quantitatively and perceptually.
- X. Li and M. T. Orchard, "New Edge-Directed Interpolation," IEEE TRANSACTIONS ON IMAGE PROCESSING, vol. 10, pp. 1521, 2001. Google ScholarDigital Library
- R. Schultz and R. Stevenson, "A Bayesian approach to image expansion for improved definition," IEEE Transactions on Image Processing, vol. 3, pp. 233--242, 1994. Google ScholarDigital Library
- W.-S. Tam, C.-W. Kok, and W.-C. Siu, "Modified edge-directed interpolation for images," Journal of Electronic Imaging, vol. 19, pp. 013011-013011-20, 2010.Google ScholarCross Ref
- J. Sun, Z. Xu, and H.-Y. Shum, "Image super-resolution using gradient profile prior," Computer Vision and Pattern Recognition 2008, pp. 1--8, 2008.Google Scholar
- S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 1167--1183, 2002. Google ScholarDigital Library
- M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion, and transparency," Journal of Visual Communication and Image Representation, vol. 4, pp. 324--335, 1993.Google ScholarCross Ref
- K.-W. Hung and W.-C. Siu, "New motion compensation model via frequency classification for fast video super-resolution," Image Processing, pp. 1193--1196, 2009. Google ScholarDigital Library
- B. S. Morse and D. Schwartzwald, "Image magnification using-level-set reconstruction," CVPR 2001, pp. I-333--I-340 vol. 1, 2001.Google Scholar
- Q. Shan, Z. Li, J. Jia, and C.-K. Tang, "Fast image/video upsampling," ACM Transactions on Graphics, pp. 153, 2008. Google ScholarDigital Library
- W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution," Computer Graphics and Applications, IEEE, vol. 22, pp. 56--65, 2002. Google ScholarDigital Library
- H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," CVPR 2004, pp. I-275--I-282 Vol. 1, 2004.Google Scholar
- C. Liu, H.-Y. Shum, and W. T. Freeman, "Face hallucination: Theory and practice," International Journal of Computer Vision, vol. 75, pp. 115--134, 2007. Google ScholarDigital Library
- Q. Wang, X. Tang, and H. Shum, "Patch based blind image super resolution," Computer Vision, pp. 709--716, 2005. Google ScholarDigital Library
- J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," CVPR 2008, pp. 1--8, 2008.Google Scholar
- K. S. Ni and T. Q. Nguyen, "Image super-resolution using support vector regression," IEEE Transactions on Image Processing, vol. 16, pp. 1596--1610, 2007. Google ScholarDigital Library
- H. He and W.-C. Siu, "Single image super-resolution using Gaussian process regression," CVPR 2011, pp. 449--456, 2011. Google ScholarDigital Library
- J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Transactions on Image Processing, vol. 19, pp. 2861--2873, 2010. Google ScholarDigital Library
- K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, pp. 1127--1133, 2010. Google ScholarDigital Library
- G. E. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Computation, vol. 18, pp. 1527--1554, 2006. Google ScholarDigital Library
- V. Nair and G. Hinton, "3-D object recognition with deep belief nets," Advances in Neural Information Processing Systems 22, pp. 1339--1347, 2009.Google Scholar
- D. Ciresan, U. Meier and J. Schmidhuber. "Multi-column Deep Neural Networks for Image Classification." Computer Vision and Pattern Recognition, pp. 3642--3649, 2012. Google ScholarDigital Library
- A. Mohamed, G. Dahl, and G. Hinton, "Acoustic Modeling using Deep Belief Networks," IEEE Trans. on Audio, Speech, and Language Procesing, vol. 20, no. 1, pp. 14--22, 2012. Google ScholarDigital Library
Index Terms
Image Super-Resolution Using Deep Belief Networks
Recommendations
Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
ICDSC 2019: Proceedings of the 13th International Conference on Distributed Smart CamerasSingle Image Super-Resolution (SISR) aims to generate a high-resolution (HR) image of a given low-resolution (LR) image. The most of existing convolutional neural network (CNN) based SISR methods usually take an assumption that a LR image is only ...
Deep Residual Attention Network for Spectral Image Super-Resolution
Computer Vision – ECCV 2018 WorkshopsAbstractSpectral imaging sensors often suffer from low spatial resolution, as there exists an essential tradeoff between the spectral and spatial resolutions that can be simultaneously achieved, especially when the temporal resolution needs to be ...
Hyperspectral image super-resolution using cluster-based deep convolutional networks
AbstractIn recent years, deep convolutional neural networks (CNNs) have been widely exploited for the hyperspectral image (HSI) super-resolution and obtained remarkable performance. However, most of the existing CNN-based methods have two main ...
Highlights- A new super-resolution framework based on clustering is proposed to accurately extract the corresponding spatial-spectral features of HSI.
Comments