Abstract
Due to the arbitrary motion patterns in practical video, annoying artifacts cased by the registration error often appears in the super resolution outcome. This paper proposes a spatial-temporal motion compensation based super resolution fusion method (STMC) for video after explicit motion estimation between a few neighboring frames. We first register the neighboring low resolution frames to proper positions in the high resolution frame, and then use the registered low resolution information as non-local redundancy to compensate the surrounding positions which have no or a few registered low resolution pixels. Experimental results indicate the proposed method can effectively reduce the artifacts cased by the motion estimation error with obvious performance improvement in both PSNR and visual effect.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: A technical overview. IEEE Signal Process Magazine 20, 21–36 (2003)
Schultz, R.R., Stevenson, R.L.: Extraction of high resolution frames from video sequences. IEEE Transactions on Signal Processing 5, 996–1011 (1996)
Jiang, Z., Wong, T., Bao, H.: Practical Super-Resolution from Dynamic Video Sequences. In: CVPR 2003, vol. 2, pp. 549–554 (2003)
Simonyan, K., Grishin, S., Vatolin, D., Popov, D.: Fast video super-resolution via classification. In: ICIP 2008, pp. 349–352 (2008)
Liu, F., Wang, J., Zhu, S., Gleicher, M., Gong, Y.: Noisy Video Super-Resolution. In: ACM Multimedia 2008, pp. 713–716 (2008)
Hung, K.W., Siu, W.C.: New Motion Compensation Model Via Frequency Classification For Fast Video Super-Resolution. In: ICIP 2009, pp. 1193–1196 (2009)
Omer, O.A., Tanaka, T.: Region-based weighted-norm approach to video super-resolution with adaptive regularization. In: ICASSP 2009, pp. 833–836 (2009)
Zach, C., Pock, T., Bischof, H.: A duality based approach for realtime TV-L1 optical flow. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 214–223. Springer, Heidelberg (2007)
Wedel, A., Pock, T., Zach, C., Bischof, H., Cremers, D.: An Improved Algorithm for TV-L1 Optical Flow. Statistical and Geometrical Approaches to Visual Motion Analysis, 23–45 (2008)
Mitzel, D., Pock, T., Schoenemann, T., Cremers, D.: Video Super Resolution using Duality Based TV-L1 Optical Flow. In: Denzler, J., Notni, G., Süße, H. (eds.) Pattern Recognition. LNCS, vol. 5748, pp. 432–441. Springer, Heidelberg (2009)
Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: CVPR 2005, vol. 2, pp. 60–65 (2005)
Dong, W., Zhang, L., Shi, G., Wu, X.: Nonlocal Back-Projection For Adaptive Image Enlargement. In: ICIP 2009, pp. 349–352 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
An, Y., Lu, Y., Yan, Z. (2011). Spatial-Temporal Motion Compensation Based Video Super Resolution. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6493. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19309-5_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-19309-5_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19308-8
Online ISBN: 978-3-642-19309-5
eBook Packages: Computer ScienceComputer Science (R0)