Abstract
The 3D Lookup Table (3DLUT)-based methods are increasing popularity due to their satisfying and stable performance in achieving automatic and adaptive real time image enhancement. In this paper, we present a new solution Dual-statistic white balance guided 3DLUT to compensate for the color deviation of the 3DLUT due to its own structure. The color correction based 3D Lookup Table is achieved on the RGB three color channels attributes to the effective extraction of color features from the design of Dual-statistic white balance Encoder. Specially, we compute the affinity matrix to match color and content features from the design of the Dual affinity matrix Module to achieve more realistic and satisfying enhancements based on the improved fidelity and consistency of color information. Our approach can be applied in image retouching and tone mapping tasks with fairly good generality. The performance in both theoretical analysis and comparative experiments manifests that the solution we proposed is effective and confirmed.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03569-4/MediaObjects/11760_2024_3569_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03569-4/MediaObjects/11760_2024_3569_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03569-4/MediaObjects/11760_2024_3569_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-024-03569-4/MediaObjects/11760_2024_3569_Fig4_HTML.png)
Similar content being viewed by others
Data availability
No datasets were generated or analysed during the current study.
References
Kelby, S.: The Adobe Photoshop Lightroom 5 Book for Digital Photographers. Pearson Education, 2014
Affinity Photo - Professional image editing software., https://affinity.serif.com. Accessed: 2020-04-26
Skylum, https://skylum.com. Accessed: 2020-04-26
Zeng, H., Cai, J., Li, L., Cao, Z., Zhang, L.: Learning image-adaptive 3D lookup tables for high performance photo enhancement in real-time. IEEE Trans. Pattern Anal. Mach. Intel. 44(4), 2058–2073 (2022)
Wang, T., Li, Y., Peng, J., Ma, Y., Wang, X., Song, F., Yan, Y.: “Real-time image enhancer via learnable spatial-aware 3D lookup tables,” In: IEEE/CVF International Conference on Computer Vision, 2021, pp. 2451–2460
Yang, C., Jin, M., Jia, X., Xu, Y., Chen, Y.: “AdaInt: Learning adaptive intervals for 3D lookup tables on real-time image enhancement,” In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17 522–17 531
Yang, C., Jin, M., Xu, Y., Zhang, R., Chen, Y., Liu, H.: “SepLUT: Separable image-adaptive lookup tables for real-time image enhancement,” In: European Conference on Computer Vision, 2022, pp. 201–217
Zhang, X., Lu, C., Yan, D., Dong, W., Yan, Q.: “DualBLN: Dual branch lut-aware network for real-time image retouching,” In: Asian Conference on Computer Vision, 2022, pp. 2139–2155
Liang, J., Zeng, H., Cui, M., Xie, X., Zhang, L.: “PPR10k: A large-scale portrait photo retouching dataset with human-region mask and group-level consistency,” In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 653–661
Gharbi, M., Chen, J., Barron, J.T., Hasinoff, S.W., Durand, F.: Deep bilateral learning for real-time image enhancement. ACM Trans. Grap. 36(4), 1–12 (2017)
Wang, R., Zhang, Q., Fu, C.-W. , Shen, X., Zheng, W.-S., Jia, J.: “Underexposed photo enhancement using deep illumination estimation,” In: IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 6849–6857
Chen, Y.-S., Wang, Y.-C., Kao, M.-H., Chuang, Y.-Y.: “Deep photo enhancer: Unpaired learning for image enhancement from photographs with gans,” In: IEEE conference on computer vision and pattern recognition, 2018, pp. 6306–6314
He, J., Liu, Y., Qiao, Y., Dong, C.: “Conditional sequential modulation for efficient global image retouching,” In: European Conference on Computer Vision, 2020, pp. 679–695
Moran, S., Marza, P., McDonagh, S., Parisot, S., Slabaugh, G.: “Deeplpf: Deep local parametric filters for image enhancement,” In: IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 12 826–12 835
Zhou, R., Wang, R., Wang, Y., Zhou, F., Guo, N.: Research on low-light image enhancement based on mer-retinex algorithm. Signal, Image and Video Process. 18(1), 803–811 (2024)
Zhao, H.-N., Shen, L.-Y., Wang, J.-W.: “Image inpainting via multi-resolution network with fourier convolutions,” Signal, Image and Video Processing, pp. 1–10, 2024
Wang, K., Zheng, Y., Liao, K., Liu, H., Sun, B.: “Attention-based multi-scale recursive residual network for low-light image enhancement,” Signal, Image and Video Processing, pp. 1–11, 2023
Wang, T., Li, Y., Peng, J., Ma, Y., Wang, X., Song, F., Yan, Y.: “Real-time image enhancer via learnable spatial-aware 3D lookup tables,” In: IEEE/CVF International Conference on Computer Vision, 2021, pp. 2471–2480
Gijsenij, A., Gevers, T., Van De Weijer, J.: Improving color constancy by photometric edge weighting. IEEE Trans. Pattern Anal. Mach. Intel. 34(5), 918–929 (2011)
Bianco, S., Schettini, R.: Adaptive color constancy using faces. IEEE Trans. Pattern Anal. Mach. Intel. 36(8), 1505–1518 (2014)
Barron, J. T., Tsai, Y.-T.: “Fast fourier color constancy,” In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 886–894
Hu, Y., Wang, B., Lin, S.: “Fc4: Fully convolutional color constancy with confidence-weighted pooling,” In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 4085–4094
Oh, S.W., Kim, S.J.: Approaching the computational color constancy as a classification problem through deep learning. Pattern Recognition 61, 405–416 (2017)
Barron, J. T.: “Convolutional color constancy,” In: Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 379–387
Afifi, M., Price, B., Cohen, S., Brown, M. S.: “When color constancy goes wrong: Correcting improperly white-balanced images,” In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 1535–1544
Afifi, M., Brown, M. S.: “Deep white-balance editing,” In: Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, 2020, pp. 1397–1406
Bychkovsky, V., Paris, S., Chan, E., Durand, F.: “Learning photographic global tonal adjustment with a database of input/output image pairs,” In: IEEE/CVF conference on computer vision and pattern recognition.IEEE, 2011, pp. 97–104
Park, J., Lee, J.-Y., Yoo, D., Kweon, I. S.: “Distort-and-recover: Color enhancement using deep reinforcement learning,” In: IEEE conference on computer vision and pattern recognition, 2018, pp. 5928–5936
Xu, X., Wang, R., Fu, C.-W., Jia, J.: “Snr-aware low-light image enhancement,” In: IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 17 714–17 724
Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H. “Restormer: Efficient transformer for high-resolution image restoration,” In: IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 5728–5739
Xiao, Z., Han, Y., Rahardja, S., Ma, Y.: “Usln: A statistically guided lightweight network for underwater image enhancement via dual-statistic white balance and multi-color space stretch,” arXiv preprint arXiv:2209.02221, 2022
Hasinoff, S.W., Sharlet, D., Geiss, R., Adams, A., Barron, J.T., Kainz, F., Chen, J., Levoy, M.: Burst photography for high dynamic range and low-light imaging on mobile cameras. ACM Trans. Grap. 35(6), 1–12 (2016)
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al.: “Pytorch: An imperative style, high-performance deep learning library,” Advances in neural information processing systems, vol. 32, 2019
Kingma, D. P., Ba, J.: “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014
Wang, B., Lu, C., Yan, D., Zhao, Y.: “Learning pixel-adaptive weights for portrait photo retouching,” 2021
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Acknowledgements
This work is supported in part by the National Natural Science Foundation of China (62371333), in part by Shanghai Rising Star Project under grant 23QA1408800 and in part by 166 Project under grant 211-CXCY-M115-00-01-01.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Jing Liu conceived the original idea and planned the experiments. More than half of experiments are carried out by Qingying Li and the ?rst draft of the manuscript was written by Zongbing Zhang. Yuting Su commented on model revision. Zhuo He carried out part of experiments, data collection and analysis. All authors commented on previous versions of the manuscript. All authors read and approved the ?nal manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work is supported in part by National Science Foundation of China under Grant 62371330 and 623713333.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Su, Y., Li, Q., Liu, J. et al. Dual-statistic white balance guided 3DLUT for image enhancement. SIViP 19, 147 (2025). https://doi.org/10.1007/s11760-024-03569-4
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11760-024-03569-4