Abstract
We propose a new high-quality up-scaling technique that extends the existing example based super-resolution (SR) framework. Our approach is based on the fundamental idea that a low-resolution (LR) image could be generated from any of the multiple possible high-resolution (HR) images. Therefore it would be more natural to use multiple predictors of HR patch from LR patch instead of single one. In this work we build a generic framework to estimate an HR image from LR one using an adaptive prior (select the predictor locally) based on the local statistics of LR images. We use natural image patch prior as the HR image statistics. We partition the natural images into documents and group them to discover the inherent topics using probabilistic Latent Semantic Analysis (pLSA) and also learn the dual dictionaries of HR and LR image patch pairs for each of the topics using sparse dictionary learning technique. Then for test image we infer locally which topic it corresponds to and then we use the corresponding learned dual dictionary to generate HR image. Experimental results show the effectiveness of our method over existing state-of-art methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Elad, M., Feuer, A.: Restoration of a single super-resolution image from several blurred, noisy and under-sampled measured images. IEEE Trans. Image Process. 6, 1646–1658 (1997)
Elad, M., Datsenko, D.: Example-based regularization deployed to super-resolution reconstruction of a single image. The Comp. J. 52, 15–30 (2009)
Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP: Graph. Models and Image Process. 53, 231–239 (1991)
Purkait, P., Chanda, B.: Super resolution image reconstruction through bregman iteration using morphologic regularization. IEEE Trans. Image Process. 21, 4029–4039 (2012)
Freeman, W.T., Jones, T.R.: Example-based super resolution. IEEE Comp. Graph. and Appl. 22, 56–65 (2002)
Elad, M., Datsenko, D.: Example-based regularization deployed to super-resolution reconstruction of a single image. The Comp. J. 50, 1–16 (2007)
Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: Proceedings of ICCV, pp. 349–356 (2009)
Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19, 2861–2873 (2010)
Kim, K.I., Kwon, Y.: Single-image super-resolution using sparse regression and natural image prior. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1127–1133 (2010)
Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Process. 20, 533–549 (2011)
Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online dictionary learning for sparse coding. In: Int. Conf. on Mach. Learn., ICML (2009)
Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online learning for matrix factorization and sparse coding. J. of Mach. Learn. Resrch (JMLR) 11, 19–60 (2010)
Mairal, J., Elad, M., Sapiro, G.: Sparse representation for color image restoration. IEEE Trans. Image Process. 17, 53–69 (2008)
Le Pennec, E., Mallat, S.: Sparse geometric image representations with bandelets. IEEE Trans. Image Process. 14, 423–438 (2005)
Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. on Acstc., Spch., and Sig. Process. 15, 1013–1027 (2006)
Mairal, J., Sapiro, G., Elad, M.: Learning multi-scale sparse representations for image and video restoration. SIAM J. on Multiscale Model. and Simuln. (2008)
Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super resolution. IEEE Trans. Image Process. 21, 233–233 (2012)
Hofmann, T.: Probabilistic latent semantic indexing. In: Proceedings of ACM SIGIR, pp. 50–57 (1999)
Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., Freeman, W.T.: Discovering objects and their location in images. In: Proceedings of ICCV, pp. 3070–3077 (2005)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Proceedings of CVPR, pp. 2169–2178 (2006)
Walker, J.S.: Wavelet-Based Image Compression. Sub-chapter of CRC Press book: Transform and Data Compression. A Primer on Wavelets and Their Scientific Applications. University of Wisconsin, Eau Claire (1999)
Sun, J., Xu, Z., Shum, H.Y.: Image super-resolution using gradient profile prior. In: Proceedings of CVPR, pp. 1–8 (2008)
Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. ACM Trans. Graph. 28, 1–10 (2010)
Fattal, R.: Image upsampling via imposed edge statistics. ACM Trans. Graph. 26, 56–65 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Purkait, P., Chanda, B. (2013). Image Upscaling Using Multiple Dictionaries of Natural Image Patches. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37431-9_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-37431-9_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37430-2
Online ISBN: 978-3-642-37431-9
eBook Packages: Computer ScienceComputer Science (R0)