Abstract
We propose a novel strategy to obtain a high spatio-temporal resolution video. To this end, we introduce a dual sensor camera that can capture two video sequences with the same field of view simultaneously. These sequences record high resolution with low frame rate and low resolution with high frame rate. This paper presents an algorithm to synthesize a high spatio-temporal resolution video from these two video sequences by using motion compensation and spectral fusion. We confirm that the proposed method improves the resolution and frame rate of the synthesized video.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Altunbasak, Y., Patti, A.J., Mersereau, R.M.: Super-resolution still and video reconstruction from MPEG-coded video. IEEE Trans. Circuits and Systems for Video Technology 12(4), 217–226 (2002)
Bugwadia, K.A., Petajan, E.D., Puri, N.N.: Progressive-scan rate up-conversion of 24/30 source materials for HDTV. IEEE Trans. Consumer Electron. 42(3), 312–321 (1996)
Choi, B.T., Lee, S.H., Ko, S.J.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consumer Electron. 46(3), 603–609 (2000)
Girod, B.: Motion-compensating prediction with fractional-pel accuracy. IEEE Trans. Communications 41(4), 604–612 (1993)
Ha, T., Lee, S., Kim, J.: Motion compensated frame interpolation by new block-based motion estimation algorithm. IEEE Trans. Consumer Electron. 50(2), 752–759 (2004)
Lee, S.H., Kwon, O., Park, R.H.: Weighted-adaptive motion-compensated frame rate up-conversion. IEEE Trans. Consumer Electron. 49(3), 485–492 (2003)
Nagahara, H., Hoshikawa, A., Shigemoto, T., Iwai, Y., Yachida, M., Tanaka, H.: Dual-sensor camera for acquiring image sequences with different spatio-temporal resolution. In: Proc. IEEE Int. Conf. Advanced Video and Signal based Surveillance (September 2005)
Park, S.C., Kang, M.K., Kang, M.G.: Super-resolution image reconstruction: A technical overview. IEEE Signal Processing Mag. 20(3), 21–36 (2003)
Shechtman, E., Caspi, Y., Irani, M.: Space-time super-resolution. IEEE Trans. Pattern Analysis and Machine Intelligence 27(4), 531–545 (2005)
Shekarforoush, H., Chellappa, R.: Data-driven multi-channel super-resolution with application to video sequences. J. Opt. Soc. Am. A 16(3), 481–492 (1999)
Tom, B.C., Katsaggelos, A.K.: Resolution enhancement of monochrome and color video using motion compensation. IEEE Trans. Image Processing 10(2), 278–287 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watanabe, K., Iwai, Y., Nagahara, H., Yachida, M., Suzuki, T. (2006). Video Synthesis with High Spatio-temporal Resolution Using Spectral Fusion. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds) Multimedia Content Representation, Classification and Security. MRCS 2006. Lecture Notes in Computer Science, vol 4105. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11848035_90
Download citation
DOI: https://doi.org/10.1007/11848035_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39392-4
Online ISBN: 978-3-540-39393-1
eBook Packages: Computer ScienceComputer Science (R0)