Cited By
View all- Liu YLuo XZhang YZhang YZhang WQu H(2025)Spike-VisNet: A novel framework for visual recognition with FocusLayer-STDP learningNeural Networks10.1016/j.neunet.2024.106918182(106918)Online publication date: Feb-2025
A retina-inspired neural model for single image haze removal
Authors: 
Yun Zhang, Qian Sun, Keyu Du, Hong QuAuthors Info & Claims
Yun Zhang, Qian Sun, Keyu Du, Hong QuAuthors Info & ClaimsPages 170 - 175
Abstract
The mammalian retina, a complex and highly specialized structure, serves a crucial role in transforming light into meaningful visual information. Drawing inspiration from the hierarchical processing of information in the retina’s neurons, we propose a multilayer retina-based convolutional neural model and apply this model to image dehazing. This model simulates the progression of information and functions from photoreceptor cells to bipolar cells in the retina. In the photoreceptor layer, we simulate cone neurons for color sensitivity and rod cells for brightness. Horizontal cells extract features from photoreceptor neurons and inhibit bipolar cells. Bipolar cells include on and off types, responding to increased and decreased light intensity, respectively. The amacrine cell layer excites on-bipolar cells while inhibiting off-bipolar cells. The ganglion cell layer simulates color-opponent mechanisms and disinhibitory effects. Finally, the combination of brightness and color information, along with spikes encoding, produces a haze-free image. This approach effectively reduces haze without estimating atmospheric light sources. The model’s validity is verified on two image de-hazing datasets: SOTS and D-Hazy, which encompass varying degrees of haze. Experimental results demonstrate that our proposed model has a comparable performance by comparing with the classical methods in de-hazing tasks.
References
[1]
Cosmin Ancuti, Codruta O Ancuti, and Christophe De Vleeschouwer. 2016. D-hazy: A dataset to evaluate quantitatively dehazing algorithms. In 2016 IEEE international conference on image processing (ICIP). IEEE, 2226–2230.
[2]
Mark Bear, Barry Connors, and Michael A Paradiso. 2020. Neuroscience: exploring the brain, enhanced edition: exploring the brain. Jones & Bartlett Learning.
[3]
Dana Berman, Shai Avidan, 2016. Non-local image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1674–1682.
[4]
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao. 2016. Dehazenet: An end-to-end system for single image haze removal. IEEE transactions on image processing 25, 11 (2016), 5187–5198.
[5]
Akshay Dudhane, Harshjeet Singh Aulakh, and Subrahmanyam Murala. 2019. Ri-gan: An end-to-end network for single image haze removal. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. 0–0.
[6]
Deniz Engin, Anil Genç, and Hazim Kemal Ekenel. 2018. Cycle-dehaze: Enhanced cyclegan for single image dehazing. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops. 825–833.
[7]
Biswarup Ganguly, Anwesa Bhattacharya, Ananya Srivastava, Debangshu Dey, and Sugata Munshi. 2021. Single image haze removal with haze map optimization for various haze concentrations. IEEE Transactions on Circuits and Systems for Video Technology 32, 1 (2021), 286–301.
[8]
Kaiming He, Jian Sun, and Xiaoou Tang. 2010. Single image haze removal using dark channel prior. IEEE transactions on pattern analysis and machine intelligence 33, 12 (2010), 2341–2353.
[9]
Tong He, Zhi Zhang, Hang Zhang, Zhongyue Zhang, Junyuan Xie, and Mu Li. 2019. Bag of tricks for image classification with convolutional neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 558–567.
[10]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1125–1134.
[11]
Yi-Hsuan Lai, Yi-Lei Chen, Chuan-Ju Chiou, and Chiou-Ting Hsu. 2014. Single-image dehazing via optimal transmission map under scene priors. IEEE Transactions on Circuits and Systems for Video Technology 25, 1 (2014), 1–14.
[12]
Barry B. Lee, Paul R. Martin, and Ulrike Grünert. 2010. Retinal connectivity and primate vision.Progress in Retinal & Eye Research 29, 6 (2010), 622–639.
[13]
Boyi Li, Xiulian Peng, Zhangyang Wang, Jizheng Xu, and Dan Feng. 2017. Aod-net: All-in-one dehazing network. In Proceedings of the IEEE international conference on computer vision. 4770–4778.
[14]
Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. 2018. Benchmarking single-image dehazing and beyond. IEEE Transactions on Image Processing 28, 1 (2018), 492–505.
[15]
C. Y. Li. 1996. Integration Fields Beyond the Classical Receptive Field: Organization and Functional Properties. News in Physiological Sciences 11, 4 (1996), 181–186.
[16]
Richard H Masland. 2012. The neuronal organization of the retina. Neuron 76, 2 (2012), 266–280.
[17]
Gaofeng Meng, Ying Wang, Jiangyong Duan, Shiming Xiang, and Chunhong Pan. 2013. Efficient image dehazing with boundary constraint and contextual regularization. In Proceedings of the IEEE international conference on computer vision. 617–624.
[18]
Shree K Nayar and Srinivasa G Narasimhan. 1999. Vision in bad weather. In Proceedings of the seventh IEEE international conference on computer vision, Vol. 2. IEEE, 820–827.
[19]
Wenqi Ren, Si Liu, Hua Zhang, Jinshan Pan, Xiaochun Cao, and Ming-Hsuan Yang. 2016. Single image dehazing via multi-scale convolutional neural networks. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14. Springer, 154–169.
[20]
Peter H. Schiller. 2011. Inaugural Article: Parallel information processing channels created in retina. (2011).
[21]
Wallace B Thoreson and Stuart C Mangel. 2012. Lateral interactions in the outer retina. Progress in retinal and eye research 31, 5 (2012), 407–441.
[22]
Hayat Ullah, Khan Muhammad, Muhammad Irfan, Saeed Anwar, Muhammad Sajjad, Ali Shariq Imran, and Victor Hugo C de Albuquerque. 2021. Light-DehazeNet: a novel lightweight CNN architecture for single image dehazing. IEEE transactions on image processing 30 (2021), 8968–8982.
[23]
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing 13, 4 (2004), 600–612.
[24]
Haiyan Wu, Yanyun Qu, Shaohui Lin, Jian Zhou, Ruizhi Qiao, Zhizhong Zhang, Yuan Xie, and Lizhuang Ma. 2021. Contrastive learning for compact single image dehazing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10551–10560.
[25]
Xitong Yang, Zheng Xu, and Jiebo Luo. 2018. Towards Perceptual Image Dehazing by Physics-Based Disentanglement and Adversarial Training. In AAAI Conference on Artificial Intelligence. https://api.semanticscholar.org/CorpusID:19148604
[26]
Malu Zhang, Jiadong Wang, Jibin Wu, Ammar Belatreche, Burin Amornpaisannon, Zhixuan Zhang, Venkata Pavan Kumar Miriyala, Hong Qu, Yansong Chua, Trevor E Carlson, 2021. Rectified linear postsynaptic potential function for backpropagation in deep spiking neural networks. IEEE transactions on neural networks and learning systems 33, 5 (2021), 1947–1958.
[27]
Xian-Shi Zhang, Shao-Bing Gao, Ruo-Xuan Li, Xin-Yu Du, Chao-Yi Li, and Yong-Jie Li. 2016. A retinal mechanism inspired color constancy model. IEEE Transactions on Image Processing 25, 3 (2016), 1219–1232.
[28]
Yun Zhang, Yi Chen, Jilun Zhang, Xiaoling Luo, Malu Zhang, Hong Qu, and Zhang Yi. 2022. Minicolumn-Based Episodic Memory Model With Spiking Neurons, Dendrites and Delays. IEEE transactions on neural networks and learning systems99 (2022), 1–15.
[29]
Yun Zhang, Hong Qu, Xiaoling Luo, Yi Chen, Yuchen Wang, Malu Zhang, and Zefang Li. 2021. A new recursive least squares-based learning algorithm for spiking neurons. Neural Networks 138 (2021), 110–125.
[30]
Yun Zhang, Lang Xue, and Hong Qu. [n. d.]. A Bionic Spiking Recurrent Neural Network with Sparse Connections and Dale’s Principle. Available at SSRN 4538536 ([n. d.]).
[31]
Shiyu Zhao, Lin Zhang, Ying Shen, and Yicong Zhou. 2021. RefineDNet: A weakly supervised refinement framework for single image dehazing. IEEE Transactions on Image Processing 30 (2021), 3391–3404.
Index Terms
- A retina-inspired neural model for single image haze removal
Recommendations
Sharpening of directional selectivity from neural output of rabbit retina
The estimation of motion direction from time varying retinal images is a fundamental task of visual systems. Neurons that selectively respond to directional visual motion are found in almost all species. In many of them already in the retina direction ...
Biologically-inspired image processing in computational retina models
AbstractRetinal Prosthesis (RP) is an approach to restore vision, using an implanted device to electrically stimulate the retina. A fundamental problem in RP is to translate the visual scene to retina neural spike patterns, mimicking the ...
Graphical abstractDisplay Omitted
Highlights- Image features inspired by functions of different retinal ganglion cells are introduced and used in retina spiking models.
HazeSpace2M: A Dataset for Haze Aware Single Image Dehazing
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaReducing the atmospheric haze and enhancing image clarity is crucial for computer vision applications. The lack of real-life hazy ground truth images necessitates synthetic datasets, which often lack diverse haze types, impeding effective haze type ...
Comments
Information & Contributors
Information
Published In
December 2023
371 pages
ISBN:9798400709203
DOI:10.1145/3639631
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 February 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
ACAI 2023
ACAI 2023: 2023 6th International Conference on Algorithms, Computing and Artificial Intelligence
December 22 - 24, 2023
Sanya, China
Acceptance Rates
Overall Acceptance Rate 173 of 395 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 16Total Downloads
- Downloads (Last 12 months)15
- Downloads (Last 6 weeks)4
Reflects downloads up to 07 Mar 2025
Other Metrics
Citations
Cited By
View all- Liu YLuo XZhang YZhang YZhang WQu H(2025)Spike-VisNet: A novel framework for visual recognition with FocusLayer-STDP learningNeural Networks10.1016/j.neunet.2024.106918182(106918)Online publication date: Feb-2025
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format