Abstract
Video denoising is highly desirable in many real world applications. It can enhance the perceived quality of video signals, and can also help improve the performance of subsequent processes such as compression, segmentation, and object recognition. In this paper, we propose a method to enhance existing video denoising algorithms by denoising a video signal from multiple views (front-, top-, and side-views). A fusion scheme is then proposed to optimally combine the denoised videos from multiple views into one. We show that such a conceptually simple and easy-to-use strategy, which we call multiple view fusion (MVF), leads to a computationally efficient algorithm that can significantly improve video denoising results upon state-of-the-art algorithms. The effect is especially strong at high noise levels, where the gain over the best video denoising results reported in the literature, can be as high as 2-3 dB in PSNR. Significant visual quality enhancement is also observed and evidenced by improvement in terms of SSIM evaluations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bovik, A.C.: Handbook of Image and Video Processing (Communications, Networking and Multimedia). Academic Press, Inc., Orlando (2005)
Portilla, J., Strela, V., Wainwright, M.J., Simoncelli, E.P.: Image Denoising Using Scale Mixtures of Gaussians in the Wavelet Domain. IEEE Trans. on Image Processing. 12, 1338–1351 (2003)
Buades, A., Coll, B., Morel, J.M.: Nonlocal Image and Movie Denoising. Int. J. of Computer Vision 76, 123–139 (2008)
Aharon, M., Elad, M., Bruckstein, A.: K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation. IEEE Trans. on Sinal Processing 11, 4311–4322 (2006)
Blu, T., Luisier, F.: The SURE-LET Approach to Image Denoising. IEEE Trans. on Image Processing 16, 2778–2786 (2007)
Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Trans. on Image Processing. 16, 2080–2095 (2007)
Zlokolica, V., Pizurica, A., Philips, W.: Wavelet-Domain Video Denoising Based on Reliability Measures. IEEE Trans. on Cir. and Sys. for Video Tech. 16, 993–1007 (2006)
Varghese, G., Wang, Z.: Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model. IEEE Trans. on Cir. and Sys. for Video Tech. 20, 1032–1040 (2010)
Luisier, F., Blu, T., Unser, M.: SURE-LET for Orthonormal Wavelet-Domain Video Denoising. IEEE Trans. on Cir. and Sys. for Video Tech. 20, 913–919 (2010)
Buades, A., Coll, B., Morel, J.M., Matemàtiques, D.: Denoising Image Sequences does not Require Motion Estimation. In: Proc. of the IEEE Conf. on Advanced Video and Signal Based Surveillance, pp. 70–74 (2005)
Dabov, K., Foi, A., Egiazarian, K.: Video Denoising by Sparse 3D Transform-Domain Collaborative Filtering. In: Proc. of the 15th Euro. Signal Proc. Conf., Poland (September 2007)
Ozkan, M.K., Sezan, M.I., Tekalp, A.M.: Adaptive Motion-compensated Filtering of Noisy Image Sequences. IEEE Trans. on Cir. and Sys. for Video Tech. 3, 277–290 (1993)
Arce, G.R.: Multistage Order Statistic Filters for Image Sequence Processing. IEEE Trans. on Signal Processing 39, 1146–1163 (1991)
Kim, J., Woods, J.W.: Spatiotemporal Adaptive 3-D Kalman Filter for Video. IEEE Trans. on Image Processing 6, 414–424 (1997)
Brailean, J.C., Katsaggelos, A.K.: Recursive Displacement Estimation and Restoration of Noisy-blurred Image Sequences. In: IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 5, pp. 273–276 (April 1993)
Selesnick, W.I., Li, K.Y.: Video Denoising using 2D and 3D Dualtree Complex Wavelet Transforms. In: Proc. SPIE, Wavelets: Applications in Signal and Image Processing X, vol. 5207, pp. 607–618 (November 2003)
Protter, M., Elad, M.: Image Sequence Denoising via Sparse and Redundant Representations. IEEE Trans. on Image Processing 18, 27–35 (2009)
Li, X., Yunfei, Z.: Patch-based video processing: a variational Bayesian approach. IEEE Trans. on Cir. and Sys. for Video Tech. 19, 27–40 (2009)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Trans. on Image Processing 13, 600–612 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zeng, K., Wang, Z. (2011). Enhancing Video Denoising Algorithms by Fusion from Multiple Views. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2011. Lecture Notes in Computer Science, vol 6753. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21593-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-21593-3_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21592-6
Online ISBN: 978-3-642-21593-3
eBook Packages: Computer ScienceComputer Science (R0)