skip to main content
10.1145/3581783.3612594acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

LHNet: A Low-cost Hybrid Network for Single Image Dehazing

Published: 27 October 2023 Publication History

Abstract

Single image dehazing is a challenging task that requires both local detail and global distribution, and can be applied to various scenarios. However, physics-based dehazing algorithms perform well only in specific settings, while CNN-based algorithms struggle with capturing global information, and ViT-based approaches suffer from inadequate representation of local details. The shortcomings of the above three types of methods lead to issues such as imbalanced colors and incoherent details in the predicted haze-free image. To address these challenges, we propose a new Low-cost Hybrid Network called LHNet. The key insight of LHNet is the effective hybrid of different features, which can achieve better information fusion in the form of feature awareness at the cost of few parameters. This fusion approach narrows the gap between different features and enables LHNet to autonomously choose the fusion granularity to maximize the utilization of prior, local and global information. Extensive experiments are performed on the mainstream dehazing datasets, and the results show that LHNet achieves state-of-the-art performance in single image dehazing. By adopting our fusion approach, a better dehazing effect can be achieved than with other dehazing algorithms with more parameters, even when only CNN and ViT are used. The code is available at https://github.com/SHYuanBest/LHNet.

Supplemental Material

MP4 File
Presentation video

References

[1]
Codruta O Ancuti, Cosmin Ancuti, Mateu Sbert, and Radu Timofte. 2019. Dense-haze: A benchmark for image dehazing with dense-haze and haze-free images. In 2019 IEEE international conference on image processing (ICIP). IEEE, 1014--1018.
[2]
Codruta O Ancuti, Cosmin Ancuti, and Radu Timofte. 2020. NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. 444--445.
[3]
Dana Berman, Shai Avidan, et al. 2016. Non-local image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1674--1682.
[4]
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao. 2016. Dehazenet: An end-to-end system for single image haze removal. IEEE Transactions on Image Processing, Vol. 25, 11 (2016), 5187--5198.
[5]
Zeyuan Chen, Yangchao Wang, Yang Yang, and Dong Liu. 2021. PSD: Principled Synthetic-to-Real Dehazing Guided by Physical Priors. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 7176--7185. https://doi.org/10.1109/CVPR46437.2021.00710
[6]
Xiaofeng Cong, Jie Gui, Kai-Chao Miao, Jun Zhang, Bing Wang, and Peng Chen. 2020. Discrete Haze Level Dehazing Network. In Proceedings of the 28th ACM International Conference on Multimedia (Seattle, WA, USA) (MM '20). Association for Computing Machinery, New York, NY, USA, 1828--1836. https://doi.org/10.1145/3394171.3413876
[7]
Sourya Dipta Das and Saikat Dutta. 2020. Fast Deep Multi-patch Hierarchical Network for Nonhomogeneous Image Dehazing. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 1994--2001. https://doi.org/10.1109/CVPRW50498.2020.00249
[8]
Qili Deng, Ziling Huang, Chung-Chi Tsai, and Chia-Wen Lin. 2020. Hardgan: A haze-aware representation distillation gan for single image dehazing. In Computer Vision-ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part VI 16. Springer, 722--738.
[9]
Hang Dong, Jinshan Pan, Lei Xiang, Zhe Hu, Xinyi Zhang, Fei Wang, and Ming-Hsuan Yang. 2020. Multi-Scale Boosted Dehazing Network With Dense Feature Fusion. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2154--2164. https://doi.org/10.1109/CVPR42600.2020.00223
[10]
Jiangxin Dong and Jinshan Pan. 2020. Physics-based feature dehazing networks. In Computer Vision--ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XXX 16. Springer, 188--204.
[11]
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020).
[12]
Raanan Fattal. 2008. Single image dehazing. ACM transactions on graphics (TOG), Vol. 27, 3 (2008), 1--9.
[13]
Raanan Fattal. 2014. Dehazing using color-lines. ACM transactions on graphics (TOG), Vol. 34, 1 (2014), 1--14.
[14]
Minghan Fu, Huan Liu, Yankun Yu, Jun Chen, and Keyan Wang. 2021. DW-GAN: A Discrete Wavelet Transform GAN for NonHomogeneous Dehazing. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 203--212. https://doi.org/10.1109/CVPRW53098.2021.00029
[15]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM, Vol. 63, 11 (2020), 139--144.
[16]
Chun-Le Guo, Qixin Yan, Saeed Anwar, Runmin Cong, Wenqi Ren, and Chongyi Li. 2022. Image dehazing transformer with transmission-aware 3D position embedding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5812--5820.
[17]
Chunming He, Kai Li, Yachao Zhang, Longxiang Tang, Yulun Zhang, Zhenhua Guo, and Xiu Li. 2023 a. Camouflaged Object Detection With Feature Decomposition and Edge Reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 22046--22055.
[18]
Chunming He, Kai Li, Yachao Zhang, Guoxia Xu, Longxiang Tang, Yulun Zhang, Zhen Hua Guo, and Xiu Li. 2023 b. Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Grouping. ArXiv, Vol. abs/2305.11003 (2023). https://api.semanticscholar.org/CorpusID:258762233
[19]
Chunming He, Kai Li, Yachao Zhang, Yulun Zhang, Zhenhua Guo, Xiu Li, Martin Danelljan, and Fisher Yu. 2023 c. Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objects. arXiv preprint arXiv:2308.03166 (2023).
[20]
Kaiming He, Jian Sun, and Xiaoou Tang. 2010. Single image haze removal using dark channel prior. IEEE transactions on pattern analysis and machine intelligence, Vol. 33, 12 (2010), 2341--2353.
[21]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2017. Imagenet classification with deep convolutional neural networks. Commun. ACM, Vol. 60, 6 (2017), 84--90.
[22]
Sourav Kundu and Samit Ari. 2019. MsCNN: a deep learning framework for P300-based brain-computer interface speller. IEEE Transactions on Medical Robotics and Bionics, Vol. 2, 1 (2019), 86--93.
[23]
Boyi Li, Xiulian Peng, Zhangyang Wang, Jizheng Xu, and Dan Feng. 2017. Aod-net: All-in-one dehazing network. In Proceedings of the IEEE international conference on computer vision. 4770--4778.
[24]
Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. 2018. Benchmarking single-image dehazing and beyond. IEEE Transactions on Image Processing, Vol. 28, 1 (2018), 492--505.
[25]
Hongyu Li, Jia Li, Dong Zhao, and Long Xu. 2021. DehazeFlow: Multi-Scale Conditional Flow Network for Single Image Dehazing (MM '21). Association for Computing Machinery, New York, NY, USA, 2577--2585. https://doi.org/10.1145/3474085.3475432
[26]
Xiao Liang, Runde Li, and Jinhui Tang. 2020. Selective Attention Network for Image Dehazing and Deraining. In Proceedings of the ACM Multimedia Asia (Beijing, China) (MMAsia '19). Association for Computing Machinery, New York, NY, USA, Article 39, 6 pages. https://doi.org/10.1145/3338533.3366688
[27]
Xiaohong Liu, Yongrui Ma, Zhihao Shi, and Jun Chen. 2019. Griddehazenet: Attention-based multi-scale network for image dehazing. In Proceedings of the IEEE/CVF international conference on computer vision. 7314--7323.
[28]
Ye Liu, Lei Zhu, Shunda Pei, Huazhu Fu, Jing Qin, Qing Zhang, Liang Wan, and Wei Feng. 2021b. From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Data. In Proceedings of the 29th ACM International Conference on Multimedia (Virtual Event, China) (MM '21). Association for Computing Machinery, New York, NY, USA, 50--58. https://doi.org/10.1145/3474085.3475331
[29]
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021a. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision. 10012--10022.
[30]
Xudong Mao, Qing Li, Haoran Xie, Raymond YK Lau, Zhen Wang, and Stephen Paul Smolley. 2017. Least squares generative adversarial networks. In Proceedings of the IEEE international conference on computer vision. 2794--2802.
[31]
Earl J McCartney. 1976. Optics of the atmosphere: scattering by molecules and particles. New York (1976).
[32]
Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixé, and Christoph Feichtenhofer. 2022. TrackFormer: Multi-Object Tracking with Transformers. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 8834--8844. https://doi.org/10.1109/CVPR52688.2022.00864
[33]
S.G. Narasimhan and S.K. Nayar. 2000. Chromatic framework for vision in bad weather. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), Vol. 1. 598--605 vol.1. https://doi.org/10.1109/CVPR.2000.855874
[34]
Srinivasa G Narasimhan and Shree K Nayar. 2002. Vision and the atmosphere. International journal of computer vision, Vol. 48, 3 (2002), 233.
[35]
Xu Qin, Zhilin Wang, Yuanchao Bai, Xiaodong Xie, and Huizhu Jia. 2020a. FFA-Net: Feature fusion attention network for single image dehazing. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 11908--11915.
[36]
Xuebin Qin, Zichen Zhang, Chenyang Huang, Masood Dehghan, Osmar R Zaiane, and Martin Jagersand. 2020b. U2-Net: Going deeper with nested U-structure for salient object detection. Pattern recognition, Vol. 106 (2020), 107404.
[37]
Wenqi Ren, Si Liu, Hua Zhang, Jinshan Pan, Xiaochun Cao, and Ming-Hsuan Yang. 2016. Single image dehazing via multi-scale convolutional neural networks. In Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. Springer, 154--169.
[38]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 234--241.
[39]
Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved techniques for training gans. Advances in neural information processing systems, Vol. 29 (2016).
[40]
Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4510--4520.
[41]
Yuda Song, Zhuqing He, Hui Qian, and Xin Du. 2023. Vision transformers for single image dehazing. IEEE Transactions on Image Processing, Vol. 32 (2023), 1927--1941.
[42]
Matan Sulami, Itamar Glatzer, Raanan Fattal, and Mike Werman. 2014. Automatic recovery of the atmospheric light in hazy images. In 2014 IEEE International Conference on Computational Photography (ICCP). IEEE, 1--11.
[43]
Ziyi Sun, Yunfeng Zhang, Fangxun Bao, Ping Wang, Xunxiang Yao, and Caiming Zhang. 2022. Sadnet: Semi-supervised single image dehazing method based on an attention mechanism. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 18, 2 (2022), 1--23.
[44]
Robby T Tan. 2008. Visibility in bad weather from a single image. In 2008 IEEE conference on computer vision and pattern recognition. IEEE, 1--8.
[45]
Jean-Philippe Tarel and Nicolas Hautiere. 2009. Fast visibility restoration from a single color or gray level image. In 2009 IEEE 12th international conference on computer vision. IEEE, 2201--2208.
[46]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, Vol. 30 (2017).
[47]
Chao Wang, Hao-Zhen Shen, Fan Fan, Ming-Wen Shao, Chuan-Sheng Yang, Jian-Cheng Luo, and Liang-Jian Deng. 2021. EAA-Net: A novel edge assisted attention network for single image dehazing. Knowledge-Based Systems, Vol. 228 (2021), 107279.
[48]
Yuan-Kai Wang and Ching-Tang Fan. 2014. Single image defogging by multiscale depth fusion. IEEE Transactions on image processing, Vol. 23, 11 (2014), 4826--4837.
[49]
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, Vol. 13, 4 (2004), 600--612.
[50]
Haiyan Wu, Yanyun Qu, Shaohui Lin, Jian Zhou, Ruizhi Qiao, Zhizhong Zhang, Yuan Xie, and Lizhuang Ma. 2021. Contrastive learning for compact single image dehazing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10551--10560.
[51]
Yankun Yu, Huan Liu, Minghan Fu, Jun Chen, Xiyao Wang, and Keyan Wang. 2021. A Two-Branch Neural Network for Non-Homogeneous Dehazing via Ensemble Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 193--202.
[52]
Shenghai Yuan, Yudong Wang, Tiancai Liang, Wenchao Jiang, Sui Lin, and Zhiming Zhao. 2022. Real-time Recognition and Warning of Mask Wearing Based on Improved YOLOv5 R6.1. Int. J. Intell. Syst., Vol. 37, 11 (aug 2022), 9309--9338. https://doi.org/10.1002/int.22994
[53]
Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Shao. 2022. Learning enriched features for fast image restoration and enhancement. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 45, 2 (2022), 1934--1948.
[54]
Jing Zhang, Yang Cao, Zheng-Jun Zha, and Dacheng Tao. 2020. Nighttime Dehazing with a Synthetic Benchmark. In Proceedings of the 28th ACM International Conference on Multimedia (Seattle, WA, USA) (MM '20). Association for Computing Machinery, New York, NY, USA, 2355--2363. https://doi.org/10.1145/3394171.3413763
[55]
Zhuoran Zheng, Wenqi Ren, Xiaochun Cao, Xiaobin Hu, Tao Wang, Fenglong Song, and Xiuyi Jia. 2021. Ultra-high-definition image dehazing via multi-guided bilateral learning. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 16180--16189.
[56]
Qingsong Zhu, Jiaming Mai, and Ling Shao. 2015. A fast single image haze removal algorithm using color attenuation prior. IEEE transactions on image processing, Vol. 24, 11 (2015), 3522--3533.

Cited By

View all
  • (2024)HazeSpace2M: A Dataset for Haze Aware Single Image DehazingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681382(9155-9164)Online publication date: 28-Oct-2024
  • (2024)Uni-YOLO: Vision-Language Model-Guided YOLO for Robust and Fast Universal Detection in the Open WorldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681212(1991-2000)Online publication date: 28-Oct-2024
  • (2024)Beyond Direct Relationships: Exploring Multi-Order Label Pair Dependencies for Knowledge DistillationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681029(8527-8535)Online publication date: 28-Oct-2024
  • Show More Cited By

Index Terms

  1. LHNet: A Low-cost Hybrid Network for Single Image Dehazing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '23: Proceedings of the 31st ACM International Conference on Multimedia
    October 2023
    9913 pages
    ISBN:9798400701085
    DOI:10.1145/3581783
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. efficient hybrid mechanism
    2. single image dehazing

    Qualifiers

    • Research-article

    Funding Sources

    • Research and Development Projects of National Key fields
    • National Natural Science Foundation of China for Key Program
    • Guangdong Natural Science Fund Project

    Conference

    MM '23
    Sponsor:
    MM '23: The 31st ACM International Conference on Multimedia
    October 29 - November 3, 2023
    Ottawa ON, Canada

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)170
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)HazeSpace2M: A Dataset for Haze Aware Single Image DehazingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681382(9155-9164)Online publication date: 28-Oct-2024
    • (2024)Uni-YOLO: Vision-Language Model-Guided YOLO for Robust and Fast Universal Detection in the Open WorldProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681212(1991-2000)Online publication date: 28-Oct-2024
    • (2024)Beyond Direct Relationships: Exploring Multi-Order Label Pair Dependencies for Knowledge DistillationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681029(8527-8535)Online publication date: 28-Oct-2024
    • (2024)LHNetV2: A Balanced Low-Cost Hybrid Network for Single Image DehazingIEEE Transactions on Multimedia10.1109/TMM.2024.337713326(8197-8209)Online publication date: 18-Mar-2024
    • (2024)Bridging the Gap Between Haze Scenarios: A Unified Image Dehazing ModelIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.341467734:11(11070-11085)Online publication date: Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media