Skip to main content
SpringerLink
Log in

Rain streak removal by multi-frame-based anisotropic filtering

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Dynamic weather conditions, such as rain and snow, often produce strong intensity discontinuity among frames, thus seriously degrade their visual or compression performance. How to remove these artifacts is a challenging task and has been intensively studies recently. The state-of-the-art algorithms detect these scratches before removing them from the scene. Visual effect of rain or snow is complex and difficult to be distinguished from the background; hence the precision of its detection and segmentation by hard decision is usually unsatisfactory. As an anisotropic filter performs well in structural noise removal, such as linear, planar as well as isotropic noise, it is utilized in this paper to analyze image content and suppress scratch noise simultaneously. Compared with the state-of-the-art algorithms, the proposed algorithm is better and more robust in dynamic scenes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Aharon M, Elad M, Bruckstein A (2006) svd: an algorithm for designing overcomplete dictionaries for sparse representation. Signal Process, IEEE Trans 54(11):4311–4322

    Article  MATH  Google Scholar 

  2. Bossu J, Hautiμere N, Tarel JP (2011) Rain or snow detection in image sequences through use of a histogram of orientation of streaks. Int J Comput Vis 93(3):348–367

    Article  Google Scholar 

  3. Brewer N, Liu N (2008) Using the shape characteristics of rain to identify and remove rain from video. Struct, Syntact Stat Pattern Recognit 451–458

  4. Buades A, Coll B, Morel JM et al (2005) A review of image denoising algorithms, with a new one,“SIAM. J Multiscale Model Simulat 4(2):490–530

    Article  MATH  Google Scholar 

  5. Chen R, Chang FL, Li Z, Ferraro R, Weng F (2007) Impact of the vertical variation of cloud droplet size on the estimation of cloud liquid water path and rain detection. J Atmos Sci 64(11):3843–3853

    Article  Google Scholar 

  6. Chen DY, Chen CC, Kang LW (2014) Visual depth guided color image rain streaks removal using sparse coding, circuits and systems for video technology. IEEE Trans on 24(8):1430–1454

    Google Scholar 

  7. Dean N, Raftery A (2005) Normal uniform mixture differential gene expression detection for cdna microarrays. BMC Bioinform 6(1):173

    Article  Google Scholar 

  8. Elad M, Aharon M (2006) Image denoising via sparse and redundant representations over learned dictionaries. Imag Process, IEEE Trans 15(12):3736–3745

    Article  MathSciNet  Google Scholar 

  9. Fadili JM, Starck JL, Elad M, Donoho DL (2010) Mcalab: Reproducible research in signal and image decomposition and inpainting. Comput Sci Eng 12(1):44–63

    Article  Google Scholar 

  10. Fernández JJ, Li S (2003) An improved algorithm for anisotropic nonlinear diffusion for denoising cryo-tomograms. J Struct Biol 144(1):152–161

    Article  Google Scholar 

  11. Frangakis AS, Stoschek A, Hegerl R (2001) Wavelet transform filtering and nonlinear anisotropic diffusion assessed for signal reconstruction performance on multidimensional biomedical data. Biomed Eng, IEEE Trans 48(2):213–222

    Article  Google Scholar 

  12. Garg K, Nayar SK (2004) Detection and removal of rain from videos. CVPR, Proc 2004 I.E. Comput Soc Conf IEEE 1:528–535

    Google Scholar 

  13. Garg K, Nayar SK (2005) When does a camera see rain? Proc IEEE Int Conf Comput Vis 2:1067–1074

    Article  Google Scholar 

  14. Garg K, Nayar SK (2006) Photorealistic rendering of rain streaks. ACM Trans Graph (TOG) ACM 25:996–1002

    Article  Google Scholar 

  15. Garg K, Nayar SK (2007) Vision and rain. Int J Comput Vis 75(1):3–27

    Article  Google Scholar 

  16. Hase H, Miyake K, Yoneda M (1999) Real-time snowfall noise elimination. ICIP Proc 1999 Int Conf IEEE 2:406–409

    Google Scholar 

  17. Kang L, Lin C, Fu Y (2011) Automatic single-image-based rain streaks removal via image decomposition. Image Process, IEEE Trans 99:1–1

    MATH  Google Scholar 

  18. Mairal J, Elad M, Sapiro G (2008) Sparse representation for color image restoration. Imag Process IEEE Trans 17(1):53–69

    Article  MathSciNet  MATH  Google Scholar 

  19. Starck JL, Moudden Y, Bobin J et al. (2005) Morphological component analysis in Proceedings of the SPIE conference wavelets. Citeseer 5914

  20. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images,” in Computer Vision, 1998. Sixth International Conference on. IEEE 839–846

  21. Weickert J (1998) Anisotropic diffusion in image processing[M]. Teubner, Stuttgart

    MATH  Google Scholar 

  22. Yao C, Wang C, Hong LJ, Cheng YF (2014) A Bayesian probabilistic framework for rain detection. Entropy 16(6):3302–3314

    Article  Google Scholar 

  23. Zhang M, Gunturk BK (2008) Multiresolution bilateral filtering for image denoising. Imag Process IEEE Trans 17(12):2324–2333

    Article  MathSciNet  MATH  Google Scholar 

  24. Zhang X., Li H., Qi Y et al. (2006) Rain removal in video by combining temporal and chromatic properties, in Multimedia and Expo, 2006 I.E. International Conference on. IEEE 461–464

Download references

Acknowledgments

This work is supported by National Nature Science Foundation of China, No. 61302121, 61201446, Science and Technology Commission of Shanghai Municipality under research grant no. 14DZ2260800, as well as the Opening Project of Shanghai Key Laboratory of Digital Media Processing and Transmission

Author information

Authors and Affiliations

  1. School of Computer Science and Software Engineering, East China Normal University, Shanghai, China

    Ci Wang

  2. School of Software Engineering, South China University of Technology, Guangzhou, China

    Minmin Shen

  3. The Third Research Institute of Ministry of Public Security, Shangahai, China

    Chen Yao

  4. Shanghai Key Laboratory of Digital Media Processing and Transmission, Shangahai, China

    Chen Yao

Authors
  1. Ci Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Minmin Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chen Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chen Yao.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, C., Shen, M. & Yao, C. Rain streak removal by multi-frame-based anisotropic filtering. Multimed Tools Appl 76, 2019–2038 (2017). https://doi.org/10.1007/s11042-015-3195-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-3195-z

Keywords

Search

Navigation