Skip to main content

Enhancing Video Denoising Algorithms by Fusion from Multiple Views

  • Conference paper
  • 1031 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6753))

Abstract

Video denoising is highly desirable in many real world applications. It can enhance the perceived quality of video signals, and can also help improve the performance of subsequent processes such as compression, segmentation, and object recognition. In this paper, we propose a method to enhance existing video denoising algorithms by denoising a video signal from multiple views (front-, top-, and side-views). A fusion scheme is then proposed to optimally combine the denoised videos from multiple views into one. We show that such a conceptually simple and easy-to-use strategy, which we call multiple view fusion (MVF), leads to a computationally efficient algorithm that can significantly improve video denoising results upon state-of-the-art algorithms. The effect is especially strong at high noise levels, where the gain over the best video denoising results reported in the literature, can be as high as 2-3 dB in PSNR. Significant visual quality enhancement is also observed and evidenced by improvement in terms of SSIM evaluations.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bovik, A.C.: Handbook of Image and Video Processing (Communications, Networking and Multimedia). Academic Press, Inc., Orlando (2005)

    Google Scholar 

  2. Portilla, J., Strela, V., Wainwright, M.J., Simoncelli, E.P.: Image Denoising Using Scale Mixtures of Gaussians in the Wavelet Domain. IEEE Trans. on Image Processing. 12, 1338–1351 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  3. Buades, A., Coll, B., Morel, J.M.: Nonlocal Image and Movie Denoising. Int. J. of Computer Vision 76, 123–139 (2008)

    Article  Google Scholar 

  4. Aharon, M., Elad, M., Bruckstein, A.: K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation. IEEE Trans. on Sinal Processing 11, 4311–4322 (2006)

    Article  Google Scholar 

  5. Blu, T., Luisier, F.: The SURE-LET Approach to Image Denoising. IEEE Trans. on Image Processing 16, 2778–2786 (2007)

    Article  MathSciNet  Google Scholar 

  6. Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K.: Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Trans. on Image Processing. 16, 2080–2095 (2007)

    Article  MathSciNet  Google Scholar 

  7. Zlokolica, V., Pizurica, A., Philips, W.: Wavelet-Domain Video Denoising Based on Reliability Measures. IEEE Trans. on Cir. and Sys. for Video Tech. 16, 993–1007 (2006)

    Article  Google Scholar 

  8. Varghese, G., Wang, Z.: Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model. IEEE Trans. on Cir. and Sys. for Video Tech. 20, 1032–1040 (2010)

    Article  Google Scholar 

  9. Luisier, F., Blu, T., Unser, M.: SURE-LET for Orthonormal Wavelet-Domain Video Denoising. IEEE Trans. on Cir. and Sys. for Video Tech. 20, 913–919 (2010)

    Article  Google Scholar 

  10. Buades, A., Coll, B., Morel, J.M., Matemàtiques, D.: Denoising Image Sequences does not Require Motion Estimation. In: Proc. of the IEEE Conf. on Advanced Video and Signal Based Surveillance, pp. 70–74 (2005)

    Google Scholar 

  11. Dabov, K., Foi, A., Egiazarian, K.: Video Denoising by Sparse 3D Transform-Domain Collaborative Filtering. In: Proc. of the 15th Euro. Signal Proc. Conf., Poland (September 2007)

    Google Scholar 

  12. Ozkan, M.K., Sezan, M.I., Tekalp, A.M.: Adaptive Motion-compensated Filtering of Noisy Image Sequences. IEEE Trans. on Cir. and Sys. for Video Tech. 3, 277–290 (1993)

    Article  Google Scholar 

  13. Arce, G.R.: Multistage Order Statistic Filters for Image Sequence Processing. IEEE Trans. on Signal Processing 39, 1146–1163 (1991)

    Article  Google Scholar 

  14. Kim, J., Woods, J.W.: Spatiotemporal Adaptive 3-D Kalman Filter for Video. IEEE Trans. on Image Processing 6, 414–424 (1997)

    Article  Google Scholar 

  15. Brailean, J.C., Katsaggelos, A.K.: Recursive Displacement Estimation and Restoration of Noisy-blurred Image Sequences. In: IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 5, pp. 273–276 (April 1993)

    Google Scholar 

  16. Selesnick, W.I., Li, K.Y.: Video Denoising using 2D and 3D Dualtree Complex Wavelet Transforms. In: Proc. SPIE, Wavelets: Applications in Signal and Image Processing X, vol. 5207, pp. 607–618 (November 2003)

    Google Scholar 

  17. Protter, M., Elad, M.: Image Sequence Denoising via Sparse and Redundant Representations. IEEE Trans. on Image Processing 18, 27–35 (2009)

    Article  MathSciNet  Google Scholar 

  18. Li, X., Yunfei, Z.: Patch-based video processing: a variational Bayesian approach. IEEE Trans. on Cir. and Sys. for Video Tech. 19, 27–40 (2009)

    Article  Google Scholar 

  19. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Trans. on Image Processing 13, 600–612 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zeng, K., Wang, Z. (2011). Enhancing Video Denoising Algorithms by Fusion from Multiple Views. In: Kamel, M., Campilho, A. (eds) Image Analysis and Recognition. ICIAR 2011. Lecture Notes in Computer Science, vol 6753. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21593-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-21593-3_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21592-6

  • Online ISBN: 978-3-642-21593-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics