Abstract
Most of the state of the art video denoising algorithms consider additive noise model, which is often violated in practice. In this paper, two main issues are addressed, namely, segmentation-based block matching and the estimation of noise level. Different with the previous block matching methods, we present an efficient algorithm to perform the block matching in spatially-consistent segmentations of each image frame. To estimate the noise level function (NLF), which describes the noise level as a function of image brightness, we propose a fast bilateral medial filter based method. Under the assumption of short-term coherence, this estimation method is consequently extended from single frame to multi-frames. Coupling these two techniques together, we propose a segmentation-based customized BM3D method to remove colored multiplicative noise for videos. Experimental results on benchmark data sets and real videos show that our method significantly outperforms the state of the art in removing the colored multiplicative noise.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dabov, K., Foi, A., et al.: Image denoising by sparse 3-d transform domain collaborative filtering. IEEE Trans. on Image Processing 16, 2080–2095 (2007)
Sendur, L., Selesnick, I.W.: Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency. IEEE Trans. on Signal Processing 50, 2744–2756 (2002)
Tschumperle, D.: Fast anisotropic smoothing of multi-valued images using curvature-preserving pdes. International Journal of Computer Vision (IJCV) 68, 65–82 (2006)
Buades, A., Coll, B., Morel, J.M.: Nonlocal image and movie denoising. International Journal of Computer Vision (IJCV) 76, 123–139 (2008)
Liu, C., Freeman, W.T.: A High-Quality Video Denoising Algorithm Based on Reliable Motion Estimation. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 706–719. Springer, Heidelberg (2010)
Mairal, J., Bach, F., et al.: Non-local sparse models for image restoration. In: International Conference on Computer Vision, ICCV (2009)
Protter, M., Elad, M.: Image sequence denoising via sparse and redundant representations. IEEE Transactions on Image Processing 18, 27–35 (2009)
Jiy, H., Liuz, C., Sheny, Z., Xuz, Y.: Robust video denoising using low rank matrix completion. In: Computer Vision and Pattern Recognition, CVPR (2006)
Healey, G., Kondepudy, R.: Radiometric ccd camera calibration and noise estimation. IEEE Trans. on Pattern Analysis and Machine Intelligence 16, 267–276 (1994)
Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: Computer Vision and Pattern Recognition(CVPR) (2008)
Mallat, S.: A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. on Pattern Analysis and Machine Intelligence 11, 674–693 (1989)
Field, D.: Relations between the statistics of natural images and the response properties of cortical cells. Journal of the Optical Society of America (JOSAA) 4, 2379–2394 (1987)
Simoncelli, E., Adelson, E.: Noise removal via bayesian wavelet coring. In: IEEE Int. Conf. on Image Processing, ICIP (1996)
Liu, C., Szeliski, R., et al.: Automatic estimation and removal of noise from a single image. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 30, 299–314 (2008)
Wang, M., Hua, X., et al.: Beyond distance measurement: Constructing neighborhood similarity for video annotation. IEEE Trans. on Multimedia 11, 465–476 (2009)
Zitnick, C., Jojic, N., et al.: Consistent segmentation for optical flow estimation. In: International Conference on Computer Vision, ICCV (2005)
Klappstein, J., Vaudrey, T., et al.: Moving object segmentation using optical flow and depth information. In: Advances in Image and Video Technology (2008)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. International Journal of Computer Vision (IJCV) 59, 167–181 (2004)
Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. PhD thesis, Massachusetts Institute of Technology (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, S., Zhang, J., Yuan, Z., Fang, S., Cao, Y. (2013). A Novel Segmentation-Based Video Denoising Method with Noise Level Estimation. In: Li, S., et al. Advances in Multimedia Modeling. MMM 2013. Lecture Notes in Computer Science, vol 7732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35725-1_25
Download citation
DOI: https://doi.org/10.1007/978-3-642-35725-1_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35724-4
Online ISBN: 978-3-642-35725-1
eBook Packages: Computer ScienceComputer Science (R0)