Feng Liu
ABSTRACT
Low-quality videos often not only have limited resolution, but also suffer from noise. Directly up-sampling a video without considering noise could deteriorate its visual quality due to magnifying noise. This paper addresses this problem with a unified framework that achieves simultaneous de-noising and super-resolution. This framework formulates noisy video super-resolution as an optimization problem, aiming to maximize the visual quality of the result. We consider a good quality result to be fidelity-preserving, detail-preserving and smooth. Accordingly, we propose measures for these qualities in the scenario of de-noising and super-resolution. The experiments on a variety of noisy videos demonstrate the effectiveness of the presented algorithm.
- M. Ben-Ezra, A. Zomet, and S. Nayar. Jitter camera: High resolution video from a low resolution detector. In IEEE CVPR, pages 135--142, 2004. Google Scholar
Digital Library
- P. Bhat, K. C. Zheng, N. Snavely, A. Agarwala, M. Agrawala, M. F. Cohen, and B. Curless. Piecewise image registration in the presence of multiple large motions. In IEEE CVPR, 2006. Google ScholarDigital Library
- C. M. Bishop, A. Blake, and B. Marthi. Super-resolution enhancement of video. In AISTATS, 2003.Google Scholar
- S. Borman and R. L. Stevenson. Super-resolution from image sequences - a review. In MWSCAS, pages 374--378, 1998. Google ScholarDigital Library
- S. Dai, M. Han, W. Xu, Y. Wu, and Y. Gong. Soft edge smoothness prior for alpha channel super resolution. In IEEE CVPR, 2007.Google ScholarCross Ref
- G. Dedeoglu, T. Kanade, and J. August. High-zoom video hallucination by exploiting spatio-temporal regularities. In IEEE CVPR, pages 151--158, 2004. Google ScholarDigital Library
- S. Farsiu, D. Robinson, M. Elad, and P. Milanfar. Advances and challenges in super-resolution. International Journal of Imaging Systems and Technology, 14(2):47--57, 2004.Google ScholarCross Ref
- W. T. Freeman, E. C. Pasztor, and O. T. Carmichael. Learning low-level vision. IJCV, 40:25--47, 2000. Google ScholarDigital Library
- L. Itti and C. Koch. Computational modeling of visual attention. Nature Reviews Neuroscience, 2(3):194--203, 2001.Google ScholarCross Ref
- K. Jensen and D. Anastassiou. Subpixel edge localization and the interpolation of still images. IEEE Trans. on Image Processing, 4:285--295, Mar. 1995. Google ScholarDigital Library
- S. Karunasekera and N. Kingsbury. A distortion measure for blocking artifacts in images based on human visual sensitivity. IEEE Trans. on Image Proc., 4(6):713--724, 1995. Google ScholarDigital Library
- J. Kopf, M. Uyttendaele, O. Deussen, and M. Cohen. Capturing and viewing gigapixel images. ACM Transactions on Graphics, 26, 2007. Google ScholarDigital Library
- X. Li and M. Orchard. New edge-directed interpolation. IEEE Trans. on Image Processing, 10(10):1521--1527, 2001. Google ScholarDigital Library
- F. Liu, J. Wang, S. Zhu, M. Gleicher, and Y. Gong. Visual-quality optimizing super resolution. Computer Graphis Forum, to appear.Google Scholar
- W. Liu, D. Lin, and X. Tang. Hallucinating faces: Tensor patch super-resolution and coupled residue compensation. In IEEE CVPR, pages 478--484, 2005. Google ScholarDigital Library
- H. Nothdurft. Salience from feature contrast: additivity across dimensions. Vision Research, 40(11-12):1183-1201, 2000.Google ScholarCross Ref
- S. C. Park, M. K. Park, and M. G. Kang. Super-resolution image reconstruction: a technical overview. Signal Processing Magazine, IEEE, 20(3):21--36, May 2003.Google ScholarCross Ref
- R. Rosenholtz. A simple saliency model predicts a number of motion pop out phenomena. Vision Research, 39(19):3157--3163, 1999.Google ScholarCross Ref
- R. Schultz and R. Stevenson. Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing, 5(6):996--1011, June 1996. Google ScholarDigital Library
- H. Stark and P. Oskoui. High-resolution image recovery from image-plane arrays, using convex projections. Journal of the Optical Society of America A, 6:1715--1726, Nov. 1989.Google ScholarCross Ref
- Y.-W. Tai, W.-S. Tong, and C.-K. Tang. Perceptually-inspired and edge-directed color image super-resolution. In IEEE CVPR, pages 1948--1955, 2006. Google ScholarDigital Library
- B. Tom and A. Katsaggelos. Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images. In IEEE ICIP, pages 539--542, 1995. Google ScholarDigital Library
- H. Tong, M. Li, H.-J. Zhang, and C. Zhang. No-reference quality assessment for jpeg2000 compressed images. In IEEE ICIP, pages 24--27, 2004.Google Scholar
- Z. Wang, G. Wu, H. Sheikh, E. Simoncelli, E.-H. Yang, and A. Bovik. Quality-aware images. IEEE Transactions on Image Processing, 15(6):1680--1689, 2006. Google ScholarDigital Library
Index Terms
- Noisy video super-resolution
Recommendations
Patch-based spatio-temporal super-resolution for video with non-rigid motion
This paper presents a novel approach for spatio-temporal video super-resolution. Whereas the task of synthesizing high-frequency information on the spatial domain can be accomplished without introducing arbitrary priors on the image model (beyond the ...
Video super-resolution network using detail component extraction and optical flow enhancement algorithm
AbstractThe video super-resolution (SR) task refers to the use of corresponding low-resolution (LR) frames and multiple neighboring frames to generate high-resolution (HR) frames. Existing deep learning-based approaches usually utilize LR optical flow for ...
Noise-robust video super-resolution using an adaptive spatial-temporal filter
In this paper, we introduce a new interpolation-based super-resolution scheme for super-resolving a low-resolution video that contains large-scale local motions and/or heavy noise. Our scheme leverages an efficient space-time descriptor to adapt the ...
Comments