Skip to main content
SpringerLink
Log in

Video denoising via spatially adaptive coefficient shrinkage and threshold adjustment in Surfacelet transform domain

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Many video denoising methods originated from methods designed for processing static two-dimensional images. Videos would be processed frame by frame, a process with a relatively high computational complexity, without taking into account the correlation information between frames. In this paper, a video denoising method using coefficient shrinkage and threshold adjustment based on Surfacelet transform (CSTA-ST) is proposed, which processes multiple frames of a video as an ensemble. Spatial correlation is used to define a weighted spatial energy. Each Surfacelet transform (ST) coefficient has a corresponding estimated energy value, in which the ST coefficients are grouped by. The similarity of the ST coefficients in a group determines the threshold of each ST coefficient. In addition, according to the neighborhood information of ST coefficients, the threshold is adjusted by a threshold adjustment factor. The coefficient shrinkage parameter is determined based on the adjusted threshold, and the ST coefficients are shrunk. Finally, the denoised video is obtained by the inverse ST using the shrunk coefficients. In experiments, video sequences with noise are tested, and the denoised results of the proposed method are compared with that of current denoising methods. The experimental results show that the proposed method significantly improves the peak signal-to- noise ratio (PSNR) and the structural similarity (SSIM) for various levels of noise and motion, and the ideal denoised visual effect is obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Liu, Y.H., Xie, B.L., Guo, H.Y., et al.: Surveillance video denoising based on background modeling. In: The Third International Comference on Communications and Networking, pp. 1127–1131, Hangzhou (2008)

  2. Wu, J., Du, X., Zhu, Y.F., et al.: Adaptive fuzzy filter algorithm for real-time video denoising, circuits and systems. In: The 9th International Conference on Signal Processing, pp. 1287–1291, Beijing (2010)

  3. Varghese G., Wang Z.: Video denoising based on a spatiotemporal Gaussian scale mixture model. In: IEEE Trans. Circuits Syst. Video Technol. 20(7), 1032–1040 (2010)

    Google Scholar 

  4. Mahmoud, R.O., Faheem, M.T., Sarhan A.: Intelligent denoising technique for spatial video denoising for real-time applications. In: International Conference on Computer Engineering & Systems, pp. 407–412, Cairo (2008)

  5. Cheong, H.Y., Tourapis, A., Llach, M., J., et al.: Adaptive spatio-temporal filtering for video-denoising. In: International Conference on Image Processing, vol. 2, pp. 965–968 (2004)

  6. Mahmoudi M., Sapiro G.: Fast image and video denoising via nonlocal means of similar neighborhoods. In: IEEE Sig. Process. Lett. 12(12), 839–842 (2005)

    Google Scholar 

  7. Mujica F.A., Leduc J.P., Murenzi R. et al.: A new motion parameter estimation algorithm based on the continuous wavelet transform. In: IEEE Trans. Image Process. 9(5), 873–888 (2000)

    MATH  Google Scholar 

  8. Jovanov L., Pizurica A., Derre E. et al.: Combined wavelet-domain and motion-compensated video denoising based on video codec motion estimation methods. In: IEEE Trans. Circuits Syst. Video Technol. 19(3), 417–421 (2009)

    Google Scholar 

  9. Yan, J.W., Xiao, H.Z., Qu, X.B.: A novel video denoising method based on surfacelet transform. In: IEEE Congress on Image and Signal Processing, pp. 245–249, Sanya (2008)

  10. Balster E.J., Zheng Y.F., Ewing R.L.: Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising. In: IEEE Trans. Circuits Syst. Video Technol. 16(2), 220–230 (2006)

    Google Scholar 

  11. Bamberger, R.H.: New results on two and three dimensional directional filter banks. In: The Twenty-Seventh Asilomar Conference on Systems and Computers, vol. 2, pp. 1286–1290, Pacific Grove (1993)

  12. Ying, L.X., Demanet, L., Candes, E.: 3D discrete curvelet transform. In: Proceeding of the SPIE, vol. 5914, pp. 351–361 (2005)

  13. Park, S.: New directional filter banks and their applications in image processing. Ph.D. dissertation, Georgia Institute of Technology, Atlanta, USA (1999)

  14. Lu Y.M., Do M.N.: Multidimensional directional filter banks and surfacelets. In: IEEE Trans. Image Process. 16(4), 918–931 (2007)

    MathSciNet  Google Scholar 

  15. Lu Y.M., Do M.N.: A mapping-based design for nonsubsampled hourglass filter banks in arbitrary dimensions. In: IEEE Trans. Sig. Process. 56(4), 1466–1478 (2008)

    MathSciNet  Google Scholar 

  16. Lu, Y.M., Do, M.N.: Multidimensional nonsubsampled hourglass filter banks: geometry of passband support and filter design. In: The Fortieth Asilomar Conference on Signals, Systems and Computers, pp. 406–410, Pacific Grove (2006)

  17. Lu, Y.M.: Multidimensional geometrical signal representation: constructions and applications. Ph.D. dissertation, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA (2007)

  18. Lu, Y.M., Do, M.N.: 3-D directional filter banks and surfacelets. In: Proceeding of SPIE conference on Wavelet Applications in Signal and Image Processing XI, The International Society for Optical Engineering, pp. 591–601, San Diego, USA (2005)

  19. Lu Y.M., Do M.N.: Video Processing Using 3-Dimensional Surfacelet Transform, pp. 883–887. Pacific Grove, San Diego (2007)

    Google Scholar 

  20. Chang S.G., Yu B., Vetterli M.: Spatially adaptive wavelet thresholding with context modeling for image denoising. In: IEEE Trans. Image Process. 9(9), 1522–1531 (2000)

    MATH  MathSciNet  Google Scholar 

  21. Donoho L.D.: De-noising by soft-thresholding. In: IEEE Trans. Inf. Theory 41(3), 613–627 (1995)

    MATH  MathSciNet  Google Scholar 

  22. Yuan, X., Buckles, B.P.: Subband noise estimation for adaptive wavelet shrinkage. In: Proceedings of the 17th International Conference on Pattern Recognition (2004)

  23. Yang J.Y., Wang Y.: Image and video denoising using adaptive dual-tree discrete wavelet packets. In: IEEE Trans. Circuits Syst. Video Technol. 19(5), 642–655 (2009)

    Google Scholar 

  24. Chang S.G., Yu B., Vetterli M.: Spatially adaptive wavelet thresholding with context modeling for image denoising. In: IEEE Trans. Image Process. 9(9), 1522–1531 (2000)

    MATH  MathSciNet  Google Scholar 

  25. Mihcak M.K., Ramchandran K., Kozintsev I., Moulin P.: Low complexity image denoising based on statistical modeling of wavelet coefficients. In: IEEE Sig. Process. Lett. 6(2), 300–303 (1999)

    Google Scholar 

  26. Sendur L., Selesnick I.W.: Bivariate shrinkage with local variance estimation. In: IEEE Sig. Process. Lett. 9(2), 438–441 (2002)

    Google Scholar 

  27. Cho D., Bui T.D.: Multivariate statistical modeling for image denoising using wavelet transforms. Sig. Process. Image Commun. 20(1), 77–89 (2005)

    Article  Google Scholar 

  28. Chang S.G., Yu B., Vetterli M.: Adaptive wavelet thresholding for image denoising and compression. In: IEEE Trans. Image Process. 9(9), 1532–1546 (2000)

    MATH  MathSciNet  Google Scholar 

  29. Mahbubur R.S.M., Omair A.M., Swamy M.N.S.: Video denoising based on inter-frame statistical modeling of wavelet coefficients. In: IEEE Trans. Circuits Syst Video Technol. 17(2), 187–198 (2007)

    Google Scholar 

  30. Video Sequence Database [Online]. Available: http://www.cipr.rpi.edu/resource/sequences

  31. Wang Z., Bovik A.C.: A universal image quality index. In: IEEE Sig. Process. Lett. 9(3), 81–84 (2002)

    Google Scholar 

  32. Wang Z., Bovik A.C., Sheikh H.R., Simoncelli E.P.: Image quality assessment: From error visibility to structural similarity. In: IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Google Scholar 

  33. Wang Z., Lu L., Bovik A.C.: Video quality assessment based on structural distortion measurement. Sig. Process. Image Commun. 9, 121–132 (2004)

    Article  MATH  Google Scholar 

  34. Wang Z., Bovik A.C.: Mean squared error: love it or leave it? A new look at signal fidelity measures. In: IEEE Trans. Sig. Process. 26(1), 98–117 (2009)

    Google Scholar 

  35. Xiao, H.Z., Yank, J.W., Zhang, X.Y.: A wavelet-based 3D surfacelet transform. In: Proceedings of 3rd International Conference on Intelligent System and Knowledge Engineering, pp. 1125–1129, Xiamen (2008)

  36. Rabbani, H., Vafadust, M., Gazor, S.: Video denoising based on a bivariate cauchy distribution in 3-D complex wavelet domain. In: Proceeding of IEEE International Symposium on Signal Processing and its Applications (2007)

  37. Yu S., Ahmad M.O., Swamy M.N.S.: Video denoising using motion compensated 3-D wavelet transform with integrated recursive temporal filtering. In: IEEE Trans. Circuits Syst. Video Technol. 20(6), 780–791 (2010)

    Google Scholar 

  38. Rusanovskyy, D., Dabov, K., Egiazarian, K.: Moving-window varying size 3-D transform-based video denoising. In: Proceeding of the International Workshop Video Processing, pp. 1–4. Quality Metrics, Scottsdale (2006)

  39. Buades, A., Coll, B., Morel, J.M.: Denoising image sequences does not require motion estimation. In: Proceeding of IEEE Conference on Advanced Video and Signal Based Surveillance, pp. 70–74, Como (2005)

  40. Aharon M., Elad M., Bruckstein A.M.: The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. In: IEEE Trans. Sig. Process. 54(11), 4322–4344 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, Institute of Intelligent Information Processing, Xidian University, Xi’an, 710071, China

    Xiaolin Tian, Licheng Jiao, Ying Duan & Xiaohua Zhang

Authors
  1. Xiaolin Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Licheng Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ying Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaohua Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaolin Tian.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tian, X., Jiao, L., Duan, Y. et al. Video denoising via spatially adaptive coefficient shrinkage and threshold adjustment in Surfacelet transform domain. SIViP 8, 901–912 (2014). https://doi.org/10.1007/s11760-012-0338-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0338-9

Keywords

Search

Navigation