Skip to main content
Log in

FA-GAN: a feature attention GAN with fusion discriminator for non-homogeneous dehazing

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Recently, convolutional neural network has achieved a lot of attention for image dehazing tasks. Many deep learning-based methods can solve the homogeneous dehazing problems well. However, even if a well-designed convolutional neural network (CNN) can perform well on large-scaled dehazing benchmarks, it usually fails in the non-homogeneous dehazing tasks. There are two main reasons for this. First of all, due to its non-homogeneous nature, the haze distribution is too complex to remove the haze in dense areas. Second, real non-homogeneous haze datasets are limited; for example, the NH-Haze 2020 dataset contains only 45 training pairs. Therefore, learning mappings from limited data is extremely difficult. In order to solve these problems, we introduce a simple and effective ensemble-learning non-homogeneous dehazing method. Specifically, we propose a two-branch generative adversarial network to deal with the above problems separately and then map their different features through a learnable fusion tail which consists of several convolutional layers. And in order to make the generator produce a more natural and realistic dehazing image with less color distortion and fewer artifacts, we introduced a fusion discriminator which takes frequency information as additional priors. We present a large number of experimental results to demonstrate the effectiveness of our proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ancuti, Codruta O., et al.: Ntire 2020 challenge on nonhomogeneous dehazing. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. pp. 490-491, (2020)

  2. Ancuti, Codruta O., et al.: NTIRE 2021 nonhomogeneous dehazing challenge report. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 2. (2021)

  3. Ancuti, Codruta O., et al.: O-haze: a dehazing benchmark with real hazy and haze-free outdoor images. In: IEEE conference on computer vision and pattern recognition workshops. pp. 754-762, (2018)

  4. Ancuti, C., et al.: I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images. In: International Conference on Advanced Concepts for Intelligent Vision Systems. Springer. pp. 620-631, (2018)

  5. Berman, D., Treibitz, T., Avidan, S.: Non-local image dehazing. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 1674-1682, (2016)

  6. Cai, B., et al.: Dehazenet: An end-to-end system for single image haze removal. In: IEEE Transactions on Image Processing 25.11 , pp. 5187-5198, (2016)

  7. Chen, D., et al.: Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision (WACV). IEEE. pp. 1375-1383, (2019)

  8. Das, Sourya D., Dutta, S.: Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. pp. 482-483, (2020)

  9. Deng, J., et al.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. Ieee. pp. 248-255, (2009)

  10. Dong, Y., et al.:FD-GAN: Generative adversarial networks with fusion-discriminator for single image dehazing. In: Proceedings of the AAAI Conference on Artificial Intelligence. 34. pp. 10729-10736, (2020)

  11. Gao, S., et al.: Res2net: A new multi-scale backbone architecture. In: IEEE transactions on pattern analysis and machine intelligence (2019)

  12. Haris, M., Shakhnarovich, G., Ukita, N.: Deep back-projection networks for super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018, pp. 1664-1673

  13. He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. In: IEEE transactions on pattern analysis and machine intelligence 33.12 , pp. 2341-2353, (2010)

  14. Hore, A., Ziou, D.: Image quality metrics: PSNR vs. SSIM”. In: 2010 20th international conference on pattern recognition. IEEE. pp. 2366-2369, (2010)

  15. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. nature. In: Google Scholar Google Scholar Cross Ref Cross Ref 521.7553 , pp. 436-44, (2015)

  16. Li, B., et al.: Aod-net: All-in-one dehazing network. In: IEEE international conference on computer vision. pp. 4770-4778, (2017)

  17. Liu, J., et al.: Trident dehazing network. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. pp. 430-431, (2020)

  18. William Edgar Knowles Middleton. Vision through the atmosphere. University of Toronto Press, (2019)

  19. Qin, X., et al.: Ffa-net: Feature fusion attention network for single image dehazing. In: AAAI Conference on Artificial Intelligence. Vol. 34. 07. pp. 11908-11915, (2020)

  20. Qu, Y., et al.: Enhanced pix2pix dehazing network”. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 8160-81, (2019)

  21. Ren, W., et al.: Gated fusion network for single image dehazing. In: IEEE Conference on Computer Vision and Pattern Recognition. pp. 3253-3261, (2018)

  22. Ren, W., et al.: Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision. Springer. pp. 154-16, (2016)

  23. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: arXiv preprint arXiv:1409.1556 (2014)

  24. Wang, Z., Simoncelli, EP., Bovik, AC.: Multiscale structural similarity for image quality assessment. In: The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003. Vol. 2. Ieee. pp. 1398-1402, (2003)

  25. Wu, H., et al.: Knowledge transfer dehazing network for nonhomogeneous dehazing. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. pp. 478-479, (2020)

  26. Zhu, Q., Mai, J., Shao, L.: A fast single image haze removal algorithm using color attenuation prior. In: IEEE transactions on image processing 24.11 , pp. 3522-3533, (2015)

Download references

Acknowledgements

This work has been supported by the Natural Science Foundation of Heilongjiang Province of China (No.LH2021F026).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaoguang Di.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, F., Di, X., Zhao, C. et al. FA-GAN: a feature attention GAN with fusion discriminator for non-homogeneous dehazing. SIViP 16, 1243–1251 (2022). https://doi.org/10.1007/s11760-021-02075-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-021-02075-1

Keywords

Navigation