Skip to main content
Log in

Video fog removal using Anisotropic Total Variation de-noising

  • 1204: Multimedia Technology for Security and Surveillance in Degraded Vision
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Contrast and color of the acquired videos by a visual system are degraded under hazy and foggy weather, which will affect the real-world applications like surveillance system, unmanned vehicle and a driver assistance system. The video fog removal framework is the necessity of vision systems for outdoor real-world applications in bad weather to recover visibility. In this paper, a fog removal framework for videos has proposed for vision enhancement. The proposed framework excludes frame-wise procedure of defogging and adopts a collective approach for the estimation of atmospheric light and depth map estimation from all the video frames to minimize computational burden and to accelerate the process. Weighted Least Square (WLS) filtering and Anisotropic Total Variation (ATV) is implemeted for edge preserving and denoising, respectively. Qualitative and quantitative analysis is used for comparative study and observed the capability of sharp edge preserving. The proposed framework consists of limited number of popular quality parameters that are data driven and constants and remain same irrespective of the image under consideration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Anwar MI, Khosla A (2017) Vision enhancement through single image fog removal. Eng Sci Technol 20(3):1075–1083

    Google Scholar 

  2. Carnec M, Le Callet P, Barba D (2008) Objective quality assessment of color images based on a generic perceptual reduced reference. Sig Process Image Commun 23(4):239–256

    Article  Google Scholar 

  3. Chen G, Zhou H, Yan J (2007) A novel method for moving object detection in foggy day. In: Software engineering, artificial intelligence, networking, and parallel/distributed computing, SNPD 2007. Eighth ACIS International Conference on, vol 2, IEEE, pp 53–58

  4. Cho Y, Jeong J, Kim A (2018) Model-assisted multiband fusion for single image enhancement and applications to robot vision. IEEE Robot Autom Lett 3(4):2822–2829

    Google Scholar 

  5. Esedoglu S, Osher SJ (2004) Decomposition of images by the anisotropic rudin-osher-fatemi model. Commun Pure Appl Math 57(12):1609–1626

    Article  MathSciNet  Google Scholar 

  6. Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27(3):72

    Article  Google Scholar 

  7. Hashemi S, Kiani S, Noroozi N, Moghaddam ME (2010) An image contrast enhancement method based on genetic algorithm. Pattern Recognit Lett 31(13):1816–1824

    Article  Google Scholar 

  8. Hauti`ere N, Tarel J-P, Aubert D, Dumont E (2011) Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Anal Stereol 27(2):87–95

    Article  MathSciNet  Google Scholar 

  9. He K, Sun J, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Article  Google Scholar 

  10. ITU-T Recommendation (2016) P.912: Subjective video quality assessment methods for recognition tasks, Recommendations of the ITU, Telecommunication Standardization Sector (2016)

  11. John J, Wilscy M (2008) Enhancement of weather degraded video sequences using wavelet fusion, in: Cybernetic Intelligent Systems, 2008. CIS 2008. 7th IEEE International Conference on, IEEE, pp 1–6

  12. Kim J-H, Jang W-D, Sim J-Y, Kim C-S (2013) Optimized contrast enhancement for real-time image and video dehazing. J Vis Commun Image Represent 24(3):410–425.

  13. Kanti Dhara S, Roy M, Sen D, Kumar Biswas P (2021) Color cast dependent image dehazing via adaptive airlight refinement and non-linear color balancing. IEEE Trans Circuits Syst Video Technol 31(5):2076-2081

  14. Kavanaugh KM, Pinto IM, McGillem MJ, DeBoe SF, Mancini GJ (1990) Effects of video frame averaging, smoothing and edge enhancement on the accuracy and precision of quantitative coronary arteriography. Int J Cardiac Imaging 5(4):233–239

    Article  Google Scholar 

  15. Kumari A, Sahoo SK (2015) Fast single image and video deweathering using look-up-table approach. AEU-Int J Electron Commun 69(12):1773–1782

    Article  Google Scholar 

  16. Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242

    Article  Google Scholar 

  17. Liu H, Huang D, Hou S, Yue R (2017) Large size single image fast defogging and the real time video defogging fpga architecture. Neurocomputing 269:97–107

    Article  Google Scholar 

  18. Ma Z, Wen J, Hao L et al (2014) Video image defogging algorithm for surface ship scenes. Syst Eng Electron 36(9):1860–1867

    Google Scholar 

  19. Narasimhan SG, Nayar SK (2003) Contrast restoration of weather degraded images. IEEE Trans Pattern Anal Mach Intell 25(6):713–724

    Article  Google Scholar 

  20. Rao Y, Chen L (2012) A survey of video enhancement techniques. J Inf Hiding Multimed Signal Process 3(1):71–99

    Google Scholar 

  21. Sheikh HR, Bovik AC, Cormack L (2005) No-reference quality assessment using natural scene statistics: Jpeg2000. IEEE Trans Image Process 14(11):1918–1927

    Article  Google Scholar 

  22. Shi Y, Chang Q (2013) Efficient algorithm for isotropic and anisotropic total variation deblurring and denoising. J Appl Math 2013:ID 797239

  23. Tan RT (2008) Visibility in bad weather from a single image, in: Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, IEEE, pp 1–8

  24. Tang H, Ni R, Zhao Y (2012) Video copy detection based on median of key frames. In: Signal Processing (ICSP), 2012 IEEE 11th International Conference on, vol 2, IEEE, pp 1184–1187

  25. Tarel J-P, Hautiere N (2009) Fast visibility restoration from a single color or gray level image. In: Computer Vision, 2009 IEEE 12th International Conference on, IEEE, pp 2201–2208

  26. Tripathi A, Mukhopadhyay S (2012) Single image fog removal using anisotropic diffusion. IET Image Proc 6(7):966–975

    Article  MathSciNet  Google Scholar 

  27. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  28. Xie B, Guo F, Cai Z (2010) Improved single image dehazing using dark channel prior and multi-scale retinex. In: Intelligent System Design and Engineering Application (ISDEA), 2010 International Conference on, vol 1, IEEE, pp 848–851

  29. Xie B, Guo F, Cai Z (2012) Universal strategy for surveillance video defogging. Opt Eng 51(10):101703

    Article  Google Scholar 

  30. Xu Z, Liu X, Chen X (2009) Fog removal from video sequences using contrast limited adaptive histogram equalization. In: Computational Intelligence and Software Engineering, 2009. CiSE 2009. International Conference on, IEEE, pp 1–4

  31. Yi Z, Liangzhong F (2010) Moving object detection based on running average background and temporal difference. In: Intelligent Systems and Knowledge Engineering (ISKE), 2010 International Conference on, IEEE, pp 270–272

  32. Yoon I, Kim S, Kim D, et al (2012) Adaptive defogging with color correction in the HSV color space for consumer surveillance system. IEEE transactions on consumer electronics 58(1):111–116

  33. Yoshida T (2004) Background differencing technique for image segmentation based on the status of reference pixels. In: Image Processing, 2004. ICIP’04. 2004 International Conference on, vol 5, IEEE, pp 3487–3490

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Md. Imtiyaz Anwar.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Anwar, M.I., Khosla, A. Video fog removal using Anisotropic Total Variation de-noising. Multimed Tools Appl 81, 35431–35444 (2022). https://doi.org/10.1007/s11042-022-12318-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12318-z

Keywords

Navigation