Skip to main content
SpringerLink
Log in

Dense spatially-weighted attentive residual-haze network for image dehazing

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Haze severely affects computer vision algorithms by degrading the quality of captured images and results in image data loss. With several available approaches for dehazing, single image dehazing is most preferred and challenging. We proposed a Dense Spatially-weighted Attentive Residual-haze Network (DSA Net), a novel end-to-end Encoder-decoder architecture to learn the residual haze layer between the hazy and haze-free image. We use encoder-decoder blocks with multiple skip connections to improve feature propagation. Feature Learning block uses a novel Residual Inception fused with Attention (RIA) block to learn the complex non-linearity from features extracted from the encoder part. Learning residual image is more straightforward than the whole haze-free image, and it improves the ability of the network to estimate the haze thickness accurately. DSA Net learns this less complex residual-map from the hazy input image and subtracts it from the input to obtain the dehazed images. Detail ablation study shows the effectiveness of different modules used in our architecture. Experiment results on different haze conditions demonstrate that our method shows significant improvement over other state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Ancuti CO, Ancuti C, Sbert M, Timofte R (2019) Dense-Haze: A benchmark for image dehazing with dense-haze and haze-free images. In: 2019 IEEE international conference on image processing (ICIP), IEEE, pp 1014–1018

  2. Ancuti CO, Ancuti C, Timofte R (2020) NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp 444–445

  3. Ancuti CO, Ancuti C, Timofte R, De Vleeschouwer C (2018) O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 754–762

  4. Ancuti CO, Ancuti C, Timofte R, Vleeschouwer CD (2018) I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images. arXiv:1804.05091v1

  5. Berman D, Avidan S, et al. (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1674–1682

  6. Bianco S, Celona L, Piccoli F, Schettini R (2019) High-resolution single image dehazing using encoder-decoder architecture. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 0–0

  7. Cai B, Xu X, Jia K, Qing C, Tao D (2016) Dehazenet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  Google Scholar 

  8. Chen D, He M, Fan Q, Liao J, Zhang L, Hou D, Yuan L, Hua G (2019) Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE Winter conference on applications of computer vision (WACV), IEEE, pp 1375–1383

  9. Dong H, Pan J, Xiang L, Hu Z, Zhang X, Wang F, Yang MH (2020) Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2157–2167

  10. Engin D, Genċ A., Kemal Ekenel H (2018) Cycle-dehaze: Enhanced cyclegan for single image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 825–833

  11. Feng X, Li J, Hua Z, Zhang F (2021) Low-light image enhancement based on multi-illumination estimation. Appl Intell, pp 1–21

  12. He K, Sun J, Tang X (2010) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Google Scholar 

  13. He K, Sun J, Tang X (2012) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35(6):1397–1409

    Article  Google Scholar 

  14. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  15. Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, Springer, pp 694–711

  16. Li B, Peng X, Wang Z, Xu J, Feng D (2017) Aod-net: All-in-one dehazing network. In: Proceedings of the IEEE international conference on computer vision, pp 4770–4778

  17. Li B, Ren W, Fu D, Tao D, Feng D, Zeng W, Wang Z (2018) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28(1):492–505

    Article  MathSciNet  Google Scholar 

  18. Liu X, Ma Y, Shi Z, Chen J (2019) Griddehazenet: Attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 7314–7323

  19. McCartney EJ (1976) Optics of the Atmosphere: Scattering by Molecules and particles. Wiley, New York, p 421

    Google Scholar 

  20. Morales P, Klinghoffer T, Jae Lee S (2019) Feature forwarding for efficient single image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 0–0

  21. Qin X, Wang Z, Bai Y, Xie X, Jia H (2020) FFA-NEt: Feature fusion attention network for single image dehazing. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 11908–11915

  22. Ren W, Liu S, Zhang H, Pan J, Cao X, Yang MH (2016) Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision, Springer, pp 154–69

  23. Ren W, Ma L, Zhang J, Pan J, Cao X, Liu W, Yang MH (2018) Gated fusion network for single image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3253–3261

  24. Scharstein D, Szeliski R (2003) High-accuracy stereo depth maps using structured light. In: 2003 IEEE Computer society conference on computer vision and pattern recognition, 2003. Proceedings., vol 1, IEEE, pp i–i

  25. Shao Y, Li L, Ren W, Gao C, Sang N (2020) Domain adaptation for image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 2808–2817

  26. Silberman N, Hoiem D, Kohli P, Fergus R (2012) Indoor segmentation and support inference from rgbd images. In: European conference on computer vision, Springer, pp 746–760

  27. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  28. Singh A, Bhave A, Prasad DK (2020) Single image dehazing for a variety of haze scenarios using back projected pyramid network. In: European conference on computer vision, Springer, pp 166–181

  29. Singh D, Kumar V, Kaur M (2019) Single image dehazing using gradient channel prior. Appl Intell 49(12):4276–4293

    Article  Google Scholar 

  30. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  31. Tan RT (2008) Visibility in bad weather from a single image. In: 2008 IEEE Conference on computer vision and pattern recognition, IEEE, pp 1–8

  32. Wang C, Fan W, Zhu H, Su Z (2020) Single image deraining via nonlocal squeeze-and-excitation enhancing network. Appl Intell 50(9):2932–2944

    Article  Google Scholar 

  33. Yin S, Wang Y, Yang YH (2020) A novel image-dehazing network with a parallel attention block. Pattern Recogn 102:107255

    Article  Google Scholar 

  34. Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3194–3203

  35. Zhang H, Sindagi V, Patel VM (2018) Multi-scale single image dehazing using perceptual pyramid deep network. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 902–911

  36. Zhang J, He F, Chen Y (2020) A new haze removal approach for sky/river alike scenes based on external and internal clues. Multimedia Tools and Applications 79(3):2085–2107

    Article  Google Scholar 

  37. Zhang S, He F (2020) DRCDN: Learning deep residual convolutional dehazing networks. Vis Comput 36(9):1797–1808

    Article  Google Scholar 

  38. Zhang S, He F, Ren W (2020) NLDN: Non-local Dehazing network for dense haze removal. Neurocomputing 410:363–373

    Article  Google Scholar 

  39. Zhang S, He F, Ren W, Yao J (2020) Joint learning of image detail and transmission map for single image dehazing. Vis Comput 36(2):305–316

    Article  Google Scholar 

  40. Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2472–2481

  41. Zhu Q, Mai J, Shao L (2015) A fast single image haze removal algorithm using color attenuation prior. IEEE Trans Image Process 24(11):3522–3533

    Article  MathSciNet  Google Scholar 

  42. Zong X, Chen Z, Wang D (2020) Local-CycleGAN: a general end-to-end network for visual enhancement in complex deep-water environment. Appl Intell, pp 1–12

Download references

Author information

Authors and Affiliations

  1. MNIT, Jaipur, India

    Mohit Singh & Vijay Laxmi

  2. AVPTI, Rajkot, India

    Parvez Faruki

Authors
  1. Mohit Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vijay Laxmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Parvez Faruki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohit Singh.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, M., Laxmi, V. & Faruki, P. Dense spatially-weighted attentive residual-haze network for image dehazing. Appl Intell 52, 13855–13869 (2022). https://doi.org/10.1007/s10489-022-03168-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03168-1

Keywords

Search

Navigation