Abstract
This paper proposes a new video resolution enhancement technique, in which a state-of-the-art illumination compensation procedure is applied to the respective frames before the registration process. After illumination compensation process, the respective frames are registered by using Vandewalle technique. In parallel, the corresponding frame is decomposed into its frequency subbands by using discrete wavelet transform (DWT) and stationary wavelet transform (SWT). Furthermore, the high-frequency subbands (LH, HL, and HH) have been super resolved by using Vandewalle super resolution technique. Afterward, the super resolved high-frequency subbands are being enhanced by the ones obtained through SWT as the latter ones contain more information. The enhanced high-frequency subbands and the output of the registration technique, which is regarded as the low-frequency subband, have been combined by using inverse DWT (IDWT) in order to construct the high-resolution frame. The quantitative (PSNR) results show the superiority of the proposed technique over the conventional and state-of-the-art video resolution enhancement techniques, in which for Akiyo video sequence there are 5.45 dB improvements over the average PSNR compared to Vandewalle registration technique with structure adaptive normalized convolution.



Similar content being viewed by others
References
Borman, S., Stevenson, R.L.: Super-resolution from image sequences: a review. In: Proceedings of the Midwest Symposium on Circuits and Systems, pp. 374–378, 1998
Elad, M., Feuer, A.: Super-resolution reconstruction of image sequences. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 21(9), 817–834 (1999)
Tsai, R.Y., Huang, T.S.: “Multiframe image restoration and registration”. In: Huang, T.S., (ed) Advances in Computer Vision and Image Processing. JAI Press, vol. 1, 1984, pp. 317–339
Keren, D., Peleg, S., Brada, R.: Image sequence enhancement using subpixel displacements. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 742–746 June (1988)
Demirel, H., Anbarjafari, G.: Image resolution enhancement by using discrete and stationary wavelet decomposition. IEEE Trans. Image Process. 20(5), 1458–1460 (2011)
Reddy, B.S., Chatterji, B.N.: An fft-based technique for translation, rotation and scale-invariant image registration. IEEE Trans. Image Process. 5(8), 1266–1271 (1996)
Cortelazzo, L., Lucchese, G.M.: A noise-robust frequency domain technique for estimating planar roto translations. IEEE Trans. Signal Process. 48(6), 1769–1786 (2000)
Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP: Graph. Model. Image Process. 53(13), 231–239 (1991)
Demirel, H., Izadpanahi, S.: Motion-Based Localized Super Resolution Technique for Low Resolution Video Enhancement. 16th European Signal Processing Conference (EUSIPCO-2008), Lausanne, Switzerland (2008)
Marcel, B., Briot, M., Murrieta, R.: Calcul de Translation et Rotation par la Transformation de Fourier. Traitement du Signal 14(2), 135–149 (1997)
Robinson, M.D., Toth, C.A., Lo, J.Y., Farsiu, S.: Efficient fourier-wavelet super-resolution. IEEE Trans. Image Process. 19(10), 2669–2681 (2010)
Nguyen, N., Milanfar, P.: A wavelet-based interpolation-restoration method for superresolution (wavelet superresolution). Circuits Syst. Signal Process 19(4), 321–338 (2000)
Demirel, H., Anbarjafari, G., Izadpanahi, S.: Improved motion-based localized super resolution technique using discrete wavelet transform for low resolution video enhancement. \(\text{17} ^{th}\) European Signal Processing Conference (EUSIPCO-2009), Glasgow, Scotland, Aug. 2009, pp. 1097–1101
Vandewalle, P., Süsstrunk, S., Vetterli, M.: A frequency domain approach to registration of aliased images with application to super-resolution. EURASIP J. Appl. Signal Process. (special issue on Super-resolution) vol. 2006, Article ID 71459
Piao, Y., Shin, l., Park, H. W.: Image resolution enhancement using inter-subband correlation in wavelet domain. Int. Conf. Image Process. (ICIP 2007) vol. 1, pp. I- 445–448
Demirel, H., Ozcinar, C., Anbarjafari, G.: Satellite image contrast enhancement using discrete wavelet transform and singular value decomposition. IEEE Geosci Remote Sens. Lett. 7(2), 334–338 (2010)
Temizel, A., Vlachos, T.: Wavelet domain image resolution enhancement using cycle-spinning. Electron. Lett. 41(3), 119–121 (2005)
Anbarjafari, G., Demirel, H.: Image super resolution based on interpolation of wavelet domain high frequency subbands and the spatial domain input image. ETRI J. 32(3), 390–394 (2010)
Mallat, S.: A Wavelet Tour of Signal Processing. Published by Academic Press, 1999, 2nd edition ISBN 012466606X, 9780124666061
Zomet, A., Rav-Acha, A., Peleg, S.: Robust super-resolution. In: Proceedings on International Conference on Computer Vision and Pattern Recognition (CVPR), 2001, pp. I-645 - I-650
Pham, T.Q., van Vliet, L.J., Schutte, K: Robust fusion of irregularly sampled data using adaptive normalized convolution. EURASIP J. Appl. Signal Process. vol. 2006, Article ID 83268
Ozcinar, C., Izadpanahi, S., Anbarjafari, G., Demirel, H.: Video Resolution Enhancement by Using Complex Wavelet Transform. International Conference on Image Processing, 2011
Demirel, H., Anbarjafari, G.: Data fusion boosted face recognition based on probability distribution functions in different colour channels. EURASIP J. Adv. Signal Process. 2009, Accepted on May 2009
Xiph.org Test Media, Retrieved on October 2010, from the World Wide Web on http://media.xiph.org/video/derf/
Temizel, A.: Image resolution enhancement using wavelet domain hidden Markov tree and coefficient sign estimation. Int Conf. Image Process. (ICIP2007), vol. 5, pp. V-381-384
Acknowledgments
Authors would like to thank Prof. Dr. Ivan Selesnick from Polytechnic University for providing the DWT codes in MATLAB.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Anbarjafari, G., Izadpanahi, S. & Demirel, H. Video resolution enhancement by using discrete and stationary wavelet transforms with illumination compensation. SIViP 9, 87–92 (2015). https://doi.org/10.1007/s11760-012-0422-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-012-0422-1