Skip to main content
Log in

Dual-statistic white balance guided 3DLUT for image enhancement

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

The 3D Lookup Table (3DLUT)-based methods are increasing popularity due to their satisfying and stable performance in achieving automatic and adaptive real time image enhancement. In this paper, we present a new solution Dual-statistic white balance guided 3DLUT to compensate for the color deviation of the 3DLUT due to its own structure. The color correction based 3D Lookup Table is achieved on the RGB three color channels attributes to the effective extraction of color features from the design of Dual-statistic white balance Encoder. Specially, we compute the affinity matrix to match color and content features from the design of the Dual affinity matrix Module to achieve more realistic and satisfying enhancements based on the improved fidelity and consistency of color information. Our approach can be applied in image retouching and tone mapping tasks with fairly good generality. The performance in both theoretical analysis and comparative experiments manifests that the solution we proposed is effective and confirmed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

No datasets were generated or analysed during the current study.

References

  1. Kelby, S.: The Adobe Photoshop Lightroom 5 Book for Digital Photographers. Pearson Education, 2014

  2. Affinity Photo - Professional image editing software., https://affinity.serif.com. Accessed: 2020-04-26

  3. Skylum, https://skylum.com. Accessed: 2020-04-26

  4. Zeng, H., Cai, J., Li, L., Cao, Z., Zhang, L.: Learning image-adaptive 3D lookup tables for high performance photo enhancement in real-time. IEEE Trans. Pattern Anal. Mach. Intel. 44(4), 2058–2073 (2022)

    MATH  Google Scholar 

  5. Wang, T., Li, Y., Peng, J., Ma, Y., Wang, X., Song, F., Yan, Y.: “Real-time image enhancer via learnable spatial-aware 3D lookup tables,” In: IEEE/CVF International Conference on Computer Vision, 2021, pp. 2451–2460

  6. Yang, C., Jin, M., Jia, X., Xu, Y., Chen, Y.: “AdaInt: Learning adaptive intervals for 3D lookup tables on real-time image enhancement,” In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 17 522–17 531

  7. Yang, C., Jin, M., Xu, Y., Zhang, R., Chen, Y., Liu, H.: “SepLUT: Separable image-adaptive lookup tables for real-time image enhancement,” In: European Conference on Computer Vision, 2022, pp. 201–217

  8. Zhang, X., Lu, C., Yan, D., Dong, W., Yan, Q.: “DualBLN: Dual branch lut-aware network for real-time image retouching,” In: Asian Conference on Computer Vision, 2022, pp. 2139–2155

  9. Liang, J., Zeng, H., Cui, M., Xie, X., Zhang, L.: “PPR10k: A large-scale portrait photo retouching dataset with human-region mask and group-level consistency,” In: IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 653–661

  10. Gharbi, M., Chen, J., Barron, J.T., Hasinoff, S.W., Durand, F.: Deep bilateral learning for real-time image enhancement. ACM Trans. Grap. 36(4), 1–12 (2017)

    Article  Google Scholar 

  11. Wang, R., Zhang, Q., Fu, C.-W. , Shen, X., Zheng, W.-S., Jia, J.: “Underexposed photo enhancement using deep illumination estimation,” In: IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 6849–6857

  12. Chen, Y.-S., Wang, Y.-C., Kao, M.-H., Chuang, Y.-Y.: “Deep photo enhancer: Unpaired learning for image enhancement from photographs with gans,” In: IEEE conference on computer vision and pattern recognition, 2018, pp. 6306–6314

  13. He, J., Liu, Y., Qiao, Y., Dong, C.: “Conditional sequential modulation for efficient global image retouching,” In: European Conference on Computer Vision, 2020, pp. 679–695

  14. Moran, S., Marza, P., McDonagh, S., Parisot, S., Slabaugh, G.: “Deeplpf: Deep local parametric filters for image enhancement,” In: IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 12 826–12 835

  15. Zhou, R., Wang, R., Wang, Y., Zhou, F., Guo, N.: Research on low-light image enhancement based on mer-retinex algorithm. Signal, Image and Video Process. 18(1), 803–811 (2024)

    Article  MATH  Google Scholar 

  16. Zhao, H.-N., Shen, L.-Y., Wang, J.-W.: “Image inpainting via multi-resolution network with fourier convolutions,” Signal, Image and Video Processing, pp. 1–10, 2024

  17. Wang, K., Zheng, Y., Liao, K., Liu, H., Sun, B.: “Attention-based multi-scale recursive residual network for low-light image enhancement,” Signal, Image and Video Processing, pp. 1–11, 2023

  18. Wang, T., Li, Y., Peng, J., Ma, Y., Wang, X., Song, F., Yan, Y.: “Real-time image enhancer via learnable spatial-aware 3D lookup tables,” In: IEEE/CVF International Conference on Computer Vision, 2021, pp. 2471–2480

  19. Gijsenij, A., Gevers, T., Van De Weijer, J.: Improving color constancy by photometric edge weighting. IEEE Trans. Pattern Anal. Mach. Intel. 34(5), 918–929 (2011)

    Article  MATH  Google Scholar 

  20. Bianco, S., Schettini, R.: Adaptive color constancy using faces. IEEE Trans. Pattern Anal. Mach. Intel. 36(8), 1505–1518 (2014)

    Article  MATH  Google Scholar 

  21. Barron, J. T., Tsai, Y.-T.: “Fast fourier color constancy,” In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 886–894

  22. Hu, Y., Wang, B., Lin, S.: “Fc4: Fully convolutional color constancy with confidence-weighted pooling,” In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 4085–4094

  23. Oh, S.W., Kim, S.J.: Approaching the computational color constancy as a classification problem through deep learning. Pattern Recognition 61, 405–416 (2017)

  24. Barron, J. T.: “Convolutional color constancy,” In: Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 379–387

  25. Afifi, M., Price, B., Cohen, S., Brown, M. S.: “When color constancy goes wrong: Correcting improperly white-balanced images,” In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019, pp. 1535–1544

  26. Afifi, M., Brown, M. S.: “Deep white-balance editing,” In: Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition, 2020, pp. 1397–1406

  27. Bychkovsky, V., Paris, S., Chan, E., Durand, F.: “Learning photographic global tonal adjustment with a database of input/output image pairs,” In: IEEE/CVF conference on computer vision and pattern recognition.IEEE, 2011, pp. 97–104

  28. Park, J., Lee, J.-Y., Yoo, D., Kweon, I. S.: “Distort-and-recover: Color enhancement using deep reinforcement learning,” In: IEEE conference on computer vision and pattern recognition, 2018, pp. 5928–5936

  29. Xu, X., Wang, R., Fu, C.-W., Jia, J.: “Snr-aware low-light image enhancement,” In: IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 17 714–17 724

  30. Zamir, S. W., Arora, A., Khan, S., Hayat, M., Khan, F. S., Yang, M.-H. “Restormer: Efficient transformer for high-resolution image restoration,” In: IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 5728–5739

  31. Xiao, Z., Han, Y., Rahardja, S., Ma, Y.: “Usln: A statistically guided lightweight network for underwater image enhancement via dual-statistic white balance and multi-color space stretch,” arXiv preprint arXiv:2209.02221, 2022

  32. Hasinoff, S.W., Sharlet, D., Geiss, R., Adams, A., Barron, J.T., Kainz, F., Chen, J., Levoy, M.: Burst photography for high dynamic range and low-light imaging on mobile cameras. ACM Trans. Grap. 35(6), 1–12 (2016)

    Article  Google Scholar 

  33. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al.: “Pytorch: An imperative style, high-performance deep learning library,” Advances in neural information processing systems, vol. 32, 2019

  34. Kingma, D. P., Ba, J.: “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014

  35. Wang, B., Lu, C., Yan, D., Zhao, Y.: “Learning pixel-adaptive weights for portrait photo retouching,” 2021

  36. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  MATH  Google Scholar 

Download references

Acknowledgements

This work is supported in part by the National Natural Science Foundation of China (62371333), in part by Shanghai Rising Star Project under grant 23QA1408800 and in part by 166 Project under grant 211-CXCY-M115-00-01-01.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study conception and design. Jing Liu conceived the original idea and planned the experiments. More than half of experiments are carried out by Qingying Li and the ?rst draft of the manuscript was written by Zongbing Zhang. Yuting Su commented on model revision. Zhuo He carried out part of experiments, data collection and analysis. All authors commented on previous versions of the manuscript. All authors read and approved the ?nal manuscript.

Corresponding author

Correspondence to Jing Liu.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work is supported in part by National Science Foundation of China under Grant 62371330 and 623713333.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Su, Y., Li, Q., Liu, J. et al. Dual-statistic white balance guided 3DLUT for image enhancement. SIViP 19, 147 (2025). https://doi.org/10.1007/s11760-024-03569-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03569-4

Keywords

Navigation