ABSTRACT
This paper proposes a new high speed Single Image Super Resolution algorithm and also suggests modifications that can perform super resolution on video sequences. Embarking from recent successful algorithms proposed by Yang et. al.[18] and Elad et. al.[19], it adds a number of enhancements that improve both PSNR of the recovered image and performance of the dictionary training. It also proposes an incremental dictionary update strategy that enhances results on video sequences by improving the dictionary quality at each frame. The algorithm does not necessarily need a training image set, though it can use one to enhance PSNR of the upscaled image. It automatically picks the patches that would benefit from super resolution, ignoring others, thus enhancing speed. It also partially accounts for spatial transformations of patches in the trained dictionary, further enhancing performance.
- S. Baker and T. Kanade. Limits on super-resolution and how to break them. In Proceedings of IEEE conference on Computer Vision and Pattern Recognition, volume 2, pages 372--379 vol. 2, 2000.Google ScholarCross Ref
- H. Chang, D.-Y. Yeung, and Y. Xiong. Super-resolution through neighbor embedding. In Proceedings of IEEE conference on Computer Vision and Pattern Recognition, volume 1, pages I-275--I-282 Vol. 1, june-2 july 2004.Google Scholar
- S. Dai, M. Han, W. Xu, Y. Wu, Y. Gong, and A. Katsaggelos. Softcuts: A soft edge smoothness prior for color image super-resolution. IEEE Transactions on Image Processing, 18(5): 969--981, may 2009. Google ScholarDigital Library
- B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani. Least angle regression. Annals of Statistics, 32: 407--499, 2004.Google ScholarCross Ref
- M. Elad. Software. http://www.cs.technion.ac.il/~elad/software/, May 2012.Google Scholar
- S. Farsiu, M. Robinson, M. Elad, and P. Milanfar. Fast and robust multiframe super resolution. IEEE Transactions on Image Processing, 13(10): 1327--1344, oct. 2004. Google ScholarDigital Library
- X. Gao, K. Zhang, D. Tao, and X. Li. Joint learning for single-image super-resolution via a coupled constraint. IEEE Transactions on Image Processing, 21(2): 469--480, feb. 2012. Google ScholarDigital Library
- T. S. Huang and R. Y. Tsay. Multiple frame image restoration and registration. In Advances in Computer Vision and Image Processing, volume 1, pages 317--339, 1984.Google Scholar
- S. Lertrattanapanich and N. Bose. High resolution image formation from low resolution frames using delaunay triangulation. IEEE Transactions on Image Processing, 11(12): 1427--1441, dec 2002. Google ScholarDigital Library
- Z. Lin and H.-Y. Shum. Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(1): 83--97, Jan. 2004. Google ScholarDigital Library
- J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online dictionary learning for sparse coding. In Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, pages 689--696, New York, NY, USA, 2009. ACM. Google ScholarDigital Library
- J. Mairal, F. Bach, J. Ponce, and G. Sapiro. Online learning for matrix factorization and sparse coding. Journal of Machine Learning Research, 11: 19--60, Mar. 2010. Google ScholarDigital Library
- J. Mairal, F. Bach, J. Ponce, G. Sapiro, R. Jenaton, and G. Obozinski. Sparse modelling software v 2.3. http://spams-devel.gforge.inria.fr/, May 2012.Google Scholar
- U. of Wisconsin Madison. Public-domain test images for homeworks and projects. http://homepages.cae.wisc.edu/~ece533/images/index.html, May 2012.Google Scholar
- J. Sun, N.-N. Zheng, H. Tao, and H.-Y. Shum. Image hallucination with primal sketch priors. In Proceedings of IEEE conference on Computer Vision and Pattern Recognition, volume 2, pages II -- 729--36 vol. 2, june 2003.Google Scholar
- Xiph.org. Derf's test media collection. media.xiph.org/video/derf/, May 2012.Google Scholar
- J. Yang. Resources. http://www.ifp.illinois.edu/~jyang29/resources.html, May 2012.Google Scholar
- J. Yang, J. Wright, T. S. Huang, and Y. Ma. Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 19(11): 2861--2873, Nov. 2010. Google ScholarDigital Library
- R. Zeyde, M. Elad, and M. Protter. On single image scale-up using sparse-representations. In Proceedings of the 7th international conference on Curves and Surfaces, pages 711--730, Berlin, Heidelberg, 2012. Springer-Verlag. Google ScholarDigital Library
Index Terms
- Super resolution via sparse representation in l1 framework
Recommendations
Image super-resolution via sparse representation
This paper presents a new approach to single-image superresolution, based upon sparse signal representation. Research on image statistics suggests that image patches can be well-represented as a sparse linear combination of elements from an ...
Hyperspectral image super-resolution through clustering-based sparse representation
AbstractPromoting the spatial resolution of hyperspectral sensors is expected to improve computer vision tasks. However, due to the physical limitations of imaging sensors, the hyperspectral image is often of low spatial resolution. In this paper, we ...
Super-Resolution via Sparse Representation for Low-dose X-ray Photography
The diagnostic medical imaging has provided enormous benefits in the early detection as well as the potential side effect of radiation induced genetic diseases. The super-resolution analysis is proved to be a critical way to maintain the reduction of ...
Comments