Abstract
This paper presents a novel algorithm for obtaining a high spatio-temporal resolution video from two video sequences. These sequences are high resolution with low frame rate and low resolution with high frame rate. To this end, we introduce a dual sensor camera that can capture these sequences with the same field of view simultaneously. The proposed method observes motion information through the video with high frame rate. Moreover, the method conducts both motion compensation for the high resolution sequence and image fusion in the wavelet domain. We confirmed that the proposed method improves the resolution and frame rate of the synthesized video.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Park, S.C., Kang, M.K., Kang, M.G.: Super-resolution image reconstruction: A technical overview. IEEE Signal Processing Mag. 20, 21–36 (2003)
Shekarforoush, H., Chellappa, R.: Data-driven multi-channel super-resolution with application to video sequences. J. Opt. Soc. Am. A 16, 481–492 (1999)
Tom, B.C., Katsaggelos, A.K.: Resolution enhancement of monochrome and color video using motion compensation. IEEE Trans. Image Processing 10, 278–287 (2001)
Choi, B.T., Lee, S.H., Ko, S.J.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consumer Electron. 46, 603–609 (2000)
Ha, T., Lee, S., Kim, J.: Motion compensated frame interpolation by new block-based motion estimation algorithm. IEEE Trans. Consumer Electron. 50, 752–759 (2004)
Hoshikawa, A., Shigemoto, T., Nagahara, H., Iwai, Y., Yachida, M., Tanaka, H.: Dual sensor camera system with di_erent spatio-temporal resolution. In: Proc. SICE Annual Conf. (2005)
Nagahara, H., Hoshikawa, A., Shigemoto, T., Iwai, Y., Yachida, M., Tanaka, H.: Dual-sensor camera for acquiring image sequences with different spatio-temporal resolution. In: Proc. IEEE Int. Conf. Advanced Video and Signal based Surveil-lance (2005)
Shechtman, E., Caspi, Y., Irani, M.: Increasing space-time resolution in video. In: Proc. European Conf. Computer Vision, pp. 753–768 (2002)
Shechtman, E., Caspi, Y., Irani, M.: Space-time super-resolution. IEEE Trans. Pattern Analysis and Machine Intelligence 27, 531–545 (2005)
Matsunobu, T., Nagahara, H., Iwai, Y., Yachida, M., Tanaka, H.: Generation of high resolution video using morphing. In: Proc. SICE Annual Conf. (2005)
Watanabe, K., Iwai, Y., Nagahara, H., Yachida, M., Tanaka, H.: Video synthesis with high spatio-temporal resolution using motion compensation and spectral fusion. In: Proc. SICE Annual Conf. (2005)
Shensa, M.J.: The discrete wavelet transform: wedding the àtrous and mallat algorithms. IEEE Trans. Signal Processing 40, 2464–2482 (1992)
Park, H.W., Kim, H.S.: Motion estimation using low-band-shift method for wavelet-based moving-picture coding. IEEE Trans. Image Processing 9, 577–587 (2000)
Girod, B.: Motion-compensating prediction with fractional-pel accuracy. IEEE Trans. Communications 41, 604–612 (1993)
Daubechies, I.: Ten Lectures on Wavelets. Society for Industrial and Applied Mathematics (1992)
Zandi, A., Allen, J.D., Schwartz, E.L., Boliek, M.: CREW: Compression with reversible embedded wavelets. In: Proc. IEEE Data Compression Conf., pp. 212–221 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watanabe, K., Iwai, Y., Nagahara, H., Yachida, M., Suzuki, T. (2006). Video Synthesis with High Spatio-Temporal Resolution Using Motion Compensation and Image Fusion in Wavelet Domain. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3851. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612032_49
Download citation
DOI: https://doi.org/10.1007/11612032_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31219-2
Online ISBN: 978-3-540-32433-1
eBook Packages: Computer ScienceComputer Science (R0)