research-article

ChebyLighter: Optimal Curve Estimation for Low-light Image Enhancement

Authors:

Xianming LiuAuthors Info & Claims

MM '22: Proceedings of the 30th ACM International Conference on Multimedia

Pages 1358 - 1366

https://doi.org/10.1145/3503161.3548135

Published: 10 October 2022 Publication History

Abstract

Low-light enhancement aims to recover a high contrast normal light image from a low-light image with bad exposure and low contrast. Inspired by curve adjustment in photo editing software and Chebyshev approximation, this paper presents a novel model for brightening low-light images. The proposed model, ChebyLighter, learns to estimate pixel-wise adjustment curves for a low-light image recurrently to reconstruct an enhanced output. In ChebyLighter, Chebyshev image series are first generated. Then pixel-wise coefficient matrices are estimated with Triple Coefficient Estimation (TCE) modules and the final enhanced image is recurrently reconstructed by Chebyshev Attention Weighted Summation (CAWS). The TCE module is specifically designed based on dual attention mechanism with three necessary inputs. Our method can achieve ideal performance because adjustment curves can be obtained with numerical approximation by our model. With extensive quantitative and qualitative experiments on diverse test images, we demonstrate that the proposed method performs favorably against state-of-the-art low-light image enhancement algorithms.

References

[1]

Turgay Celik and Tardi Tjahjadi. 2011. Contextual and variational contrast enhancement. IEEE Transactions on Image Processing, Vol. 20, 12 (2011), 3431--3441.

Digital Library

[2]

Long Chen, Hanwang Zhang, Jun Xiao, Liqiang Nie, Jian Shao, Wei Liu, and Tat-Seng Chua. 2017. Sca-cnn: Spatial and channel-wise attention in convolutional networks for image captioning. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5659--5667.

[3]

Qifeng Chen and Vladlen Koltun. 2017. Photographic image synthesis with cascaded refinement networks. In Proceedings of the IEEE international conference on computer vision. 1511--1520.

[4]

Minhao Fan, Wenjing Wang, Wenhan Yang, and Jiaying Liu. 2020. Integrating semantic segmentation and retinex model for low-light image enhancement. In Proceedings of the 28th ACM International Conference on Multimedia. 2317--2325.

Digital Library

[5]

Gang Fu, Lian Duan, and Chunxia Xiao. 2019a. A Hybrid L 2- L P Variational Model For Single Low-Light Image Enhancement With Bright Channel Prior. In 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 1925--1929.

[6]

Jun Fu, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019b. Dual attention network for scene segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3146--3154.

[7]

Xueyang Fu, Delu Zeng, Yue Huang, Xiao-Ping Zhang, and Xinghao Ding. 2016. A weighted variational model for simultaneous reflectance and illumination estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2782--2790.

[8]

Chunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy, Junhui Hou, Sam Kwong, and Runmin Cong. 2020. Zero-reference deep curve estimation for low-light image enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1780--1789.

[9]

Xiaojie Guo, Yu Li, and Haibin Ling. 2016. LIME: Low-light image enhancement via illumination map estimation. IEEE Transactions on image processing, Vol. 26, 2 (2016), 982--993.

Digital Library

[10]

Jie Hu, Li Shen, and Gang Sun. 2018. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7132--7141.

[11]

Yifan Jiang, Xinyu Gong, Ding Liu, Yu Cheng, Chen Fang, Xiaohui Shen, Jianchao Yang, Pan Zhou, and Zhangyang Wang. 2021. Enlightengan: Deep light enhancement without paired supervision. IEEE Transactions on Image Processing, Vol. 30 (2021), 2340--2349.

Digital Library

[12]

Daniel J Jobson, Zia-ur Rahman, and Glenn A Woodell. 1997 a. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image processing, Vol. 6, 7 (1997), 965--976.

Digital Library

[13]

Daniel J Jobson, Zia-ur Rahman, and Glenn A Woodell. 1997 b. Properties and performance of a center/surround retinex. IEEE transactions on image processing, Vol. 6, 3 (1997), 451--462.

[14]

Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In European conference on computer vision. Springer, 694--711.

[15]

Guisik Kim, Dokyeong Kwon, and Junseok Kwon. 2019. Low-lightgan: Low-light enhancement via advanced generative adversarial network with task-driven training. In 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 2811--2815.

[16]

Han-Ul Kim, Young Jun Koh, and Chang-Su Kim. 2020. Global and Local Enhancement Networks for Paired and Unpaired Image Enhancement. In European Conference on Computer Vision. Springer, 339--354.

[17]

Yeong-Taeg Kim. 1997. Contrast enhancement using brightness preserving bi-histogram equalization. IEEE transactions on Consumer Electronics, Vol. 43, 1 (1997), 1--8.

[18]

Ron Kimmel, Michael Elad, Doron Shaked, Renato Keshet, and Irwin Sobel. 2003. A variational framework for retinex. International Journal of computer vision, Vol. 52, 1 (2003), 7--23.

[19]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

[20]

Edwin H Land and John J McCann. 1971. Lightness and retinex theory. Josa, Vol. 61, 1 (1971), 1--11.

[21]

Chulwoo Lee, Chul Lee, and Chang-Su Kim. 2013. Contrast enhancement based on layered difference representation of 2D histograms. IEEE transactions on image processing, Vol. 22, 12 (2013), 5372--5384.

Digital Library

[22]

Risheng Liu, Long Ma, Jiaao Zhang, Xin Fan, and Zhongxuan Luo. 2021. Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10561--10570.

[23]

Kin Gwn Lore, Adedotun Akintayo, and Soumik Sarkar. 2017. LLNet: A deep autoencoder approach to natural low-light image enhancement. Pattern Recognition, Vol. 61 (2017), 650--662.

Digital Library

[24]

Feifan Lv, Yu Li, and Feng Lu. 2021. Attention guided low-light image enhancement with a large scale low-light simulation dataset. International Journal of Computer Vision, Vol. 129, 7 (2021), 2175--2193.

Digital Library

[25]

Feifan Lv, Feng Lu, Jianhua Wu, and Chongsoon Lim. 2018. MBLLEN: Low-Light Image/Video Enhancement Using CNNs. In BMVC. 220.

[26]

Anish Mittal, Rajiv Soundararajan, and Alan C Bovik. 2012. Making a "completely blind" image quality analyzer. IEEE Signal processing letters, Vol. 20, 3 (2012), 209--212.

[27]

Seonhee Park, Soohwan Yu, Byeongho Moon, Seungyong Ko, and Joonki Paik. 2017. Low-light image enhancement using variational optimization-based retinex model. IEEE Transactions on Consumer Electronics, Vol. 63, 2 (2017), 178--184.

Digital Library

[28]

Stephen M Pizer, E Philip Amburn, John D Austin, Robert Cromartie, Ari Geselowitz, Trey Greer, Bart ter Haar Romeny, John B Zimmerman, and Karel Zuiderveld. 1987. Adaptive histogram equalization and its variations. Computer vision, graphics, and image processing, Vol. 39, 3 (1987), 355--368.

[29]

Stephen M Pizer, R Eugene Johnston, James P Ericksen, Bonnie C Yankaskas, and Keith E Muller. 1990. Contrast-limited adaptive histogram equalization: speed and effectiveness. In [1990] Proceedings of the First Conference on Visualization in Biomedical Computing. IEEE Computer Society, 337--338.

[30]

Wenqi Ren, Sifei Liu, Lin Ma, Qianqian Xu, Xiangyu Xu, Xiaochun Cao, Junping Du, and Ming-Hsuan Yang. 2019. Low-light image enhancement via a deep hybrid network. IEEE Transactions on Image Processing, Vol. 28, 9 (2019), 4364--4375.

[31]

Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).

[32]

Li Tao, Chuang Zhu, Guoqing Xiang, Yuan Li, Huizhu Jia, and Xiaodong Xie. 2017. LLCNN: A convolutional neural network for low-light image enhancement. In 2017 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.

[33]

Li-Wen Wang, Zhi-Song Liu, Wan-Chi Siu, and Daniel PK Lun. 2020. Lightening network for low-light image enhancement. IEEE Transactions on Image Processing, Vol. 29 (2020), 7984--7996.

[34]

Ruixing Wang, Qing Zhang, Chi-Wing Fu, Xiaoyong Shen, Wei-Shi Zheng, and Jiaya Jia. 2019. Underexposed photo enhancement using deep illumination estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6849--6857.

[35]

Shuhang Wang, Jin Zheng, Hai-Miao Hu, and Bo Li. 2013a. Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Transactions on Image Processing, Vol. 22, 9 (2013), 3538--3548.

Digital Library

[36]

Shuhang Wang, Jin Zheng, Hai-Miao Hu, and Bo Li. 2013b. Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Transactions on Image Processing, Vol. 22, 9 (2013), 3538--3548.

Digital Library

[37]

Wenjing Wang, Chen Wei, Wenhan Yang, and Jiaying Liu. 2018. GLADNet: Low-Light Enhancement Network with Global Awareness. In Automatic Face & Gesture Recognition (FG 2018), 2018 13th IEEE International Conference. IEEE, 751--755.

Digital Library

[38]

Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, Vol. 13, 4 (2004), 600--612.

Digital Library

[39]

Chen Wei, Wenjing Wang, Wenhan Yang, and Jiaying Liu. 2018. Deep Retinex Decomposition for Low-Light Enhancement. In British Machine Vision Conference.

[40]

Sanghyun Woo, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. Cbam: Convolutional block attention module. In Proceedings of the European conference on computer vision (ECCV). 3--19.

Digital Library

[41]

Ke Xu, Xin Yang, Baocai Yin, and Rynson WH Lau. 2020. Learning to restore low-light images via decomposition-and-enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2281--2290.

[42]

Wenhan Yang, Shiqi Wang, Yuming Fang, Yue Wang, and Jiaying Liu. 2020. From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3063--3072.

[43]

Wenhan Yang, Wenjing Wang, Haofeng Huang, Shiqi Wang, and Jiaying Liu. 2021. Sparse gradient regularized deep retinex network for robust low-light image enhancement. IEEE Transactions on Image Processing, Vol. 30 (2021), 2072--2086.

[44]

Lu Yuan and Jian Sun. 2012. Automatic exposure correction of consumer photographs. In European Conference on Computer Vision. Springer, 771--785.

Digital Library

[45]

Yonghua Zhang, Jiawan Zhang, and Xiaojie Guo. 2019. Kindling the darkness: A practical low-light image enhancer. In Proceedings of the 27th ACM International Conference on Multimedia. 1632--1640.

Digital Library

[46]

Minfeng Zhu, Pingbo Pan, Wei Chen, and Yi Yang. 2020. Eemefn: Low-light image enhancement via edge-enhanced multi-exposure fusion network. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 13106--13113.

Cited By

Wu ZSheng ZZhang XCao SZhang RYu BZhang CYang BShen H(2025)STARNet: Low-light video enhancement using spatio-temporal consistency aggregationPattern Recognition10.1016/j.patcog.2024.111180160(111180)Online publication date: Apr-2025
https://doi.org/10.1016/j.patcog.2024.111180
Xie DHu XXiao HZhou YDuan S(2025)Reffusion: Enhancement Conditional Diffusion Framework with Dual Domain Interaction Transformer for image restorationKnowledge-Based Systems10.1016/j.knosys.2025.112998311(112998)Online publication date: Feb-2025
https://doi.org/10.1016/j.knosys.2025.112998
Mahdizadeh MChen SYe P(2025)Illuminating the Night: A Light Source-Aware and Exposure-Balanced Low-Light Enhancement Approach for Real Nighttime ScenesDigital Signal Processing10.1016/j.dsp.2025.104999(104999)Online publication date: Jan-2025
https://doi.org/10.1016/j.dsp.2025.104999
Show More Cited By

Index Terms

ChebyLighter: Optimal Curve Estimation for Low-light Image Enhancement
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        Computational photography

Recommendations

A Low-light Image Enhancement Method Balancing Brightness Boosting and Noise Smoothing
CSAI '22: Proceedings of the 2022 6th International Conference on Computer Science and Artificial Intelligence

Images captured in low-light or uneven lighting environments need to use low-light image enhancement techniques to boost brightness and contrast for high-quality improved results. Some existing low-light image enhancement methods over-enhance the image ...
Low-light image enhancement based on membership function and gamma correction
Abstract
The aim of low-light image enhancement algorithms is to improve the luminance of images. However, existing low-light image enhancement algorithms inevitably cause an enhanced image to be over- or underenhanced and cause color distortion, both of ...
Improved Zero-DCE for pig face image enhancement with low-light and high-noise

To solve the problem that individual visual features could not be accurately extracted from low-light and high-noise pig face images in intensive farming, the optimal fitting curve parameters of image brightness enhancement were defined, and the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '22: Proceedings of the 30th ACM International Conference on Multimedia

October 2022

7537 pages

ISBN:9781450392037

DOI:10.1145/3503161

General Chairs:
João Magalhães
NOVA University of Lisbon, Portugal
,
Alberto del Bimbo
University of Florence, Italy
,
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Nicu Sebe
University of Trento, Italy
,
Program Chairs:
Xavier Alameda-Pineda
Inria, Grenoble, France
,
Qin Jin
Renmin University of China, China
,
Vincent Oria
New Jersey Institute of Technology, USA
,
Laura Toni
University College London, UK

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

MM '22

Sponsor:

SIGMM

MM '22: The 30th ACM International Conference on Multimedia

October 10 - 14, 2022

Lisboa, Portugal

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
491
Total Downloads

Downloads (Last 12 months)116
Downloads (Last 6 weeks)11

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wu ZSheng ZZhang XCao SZhang RYu BZhang CYang BShen H(2025)STARNet: Low-light video enhancement using spatio-temporal consistency aggregationPattern Recognition10.1016/j.patcog.2024.111180160(111180)Online publication date: Apr-2025
https://doi.org/10.1016/j.patcog.2024.111180
Xie DHu XXiao HZhou YDuan S(2025)Reffusion: Enhancement Conditional Diffusion Framework with Dual Domain Interaction Transformer for image restorationKnowledge-Based Systems10.1016/j.knosys.2025.112998311(112998)Online publication date: Feb-2025
https://doi.org/10.1016/j.knosys.2025.112998
Mahdizadeh MChen SYe P(2025)Illuminating the Night: A Light Source-Aware and Exposure-Balanced Low-Light Enhancement Approach for Real Nighttime ScenesDigital Signal Processing10.1016/j.dsp.2025.104999(104999)Online publication date: Jan-2025
https://doi.org/10.1016/j.dsp.2025.104999
Zheng ZWang MZhao XWeng Z(2024)Adltformer Team-Training with Detr: Enhancing Cattle Detection in Non-Ideal Lighting Conditions Through Adaptive Image EnhancementAnimals10.3390/ani1424363514:24(3635)Online publication date: 17-Dec-2024
https://doi.org/10.3390/ani14243635
Pan JLiu XBai YZhai DJiang JZhao D(2024)Illumination-Aware Low-Light Image Enhancement with Transformer and Auto-Knee CurveACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366465320:8(1-23)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1145/3664653
Wang CZhou YHe LLin FChen HDeng LCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Illumination Distribution Prior for Low-light Image EnhancementProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681127(9116-9125)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681127
Tang LDeng YYi XYan QYuan YMa JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)DRMF: Degradation-Robust Multi-Modal Image Fusion via Composable Diffusion PriorProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681064(8546-8555)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681064
Wang ZLi DLi GZhang ZJiang RCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Multimodal Low-light Image Enhancement with Depth InformationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680741(4976-4985)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3680741
Sun GXiong ZYuan Y(2024)Detail-Preserving and Diverse Image Translation for Adverse Visual Object DetectionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.339814534:10(9139-9152)Online publication date: Oct-2024
https://doi.org/10.1109/TCSVT.2024.3398145
Park JVien APham TKim HLee C(2024)Image Enhancement Based on Histogram-Guided Multiple Transformation Function EstimationIEEE Transactions on Consumer Electronics10.1109/TCE.2024.347603370:4(6664-6678)Online publication date: Nov-2024
https://doi.org/10.1109/TCE.2024.3476033
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten