Skip to main content

Advertisement

Springer Nature Link
Log in

Image recoloring for Red-Green dichromats with compensation range-based naturalness preservation and refined dichromacy gamut

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

People with color vision deficiency (CVD) have difficulty discriminating colors, which can cause loss of chromatic contrast in the perception of affected individuals. To compensate for contrast loss, image recoloring approaches have been proposed in the existing studies. In state-of-the-art studies, recoloring models were built based on an approximated gamut of CVD in the CIE L*a*b* (Lab) color space, which significantly deviates from the original gamut. In addition, luminance was not considered during recoloring. Moreover, existing methods also present problems, such as high computational costs and insufficient naturalness preservation . In this paper, we propose a novel recoloring method to compensate for CVD that enhances contrast through adopting a luminance channel-considered optimization model while preserving naturalness by imposing hard constraints on the amount of changes to the original colors. To obtain a better compensation effect, we fit a new curved surface for representing the gamut of dichromacy in the Lab color space more accurately. Furthermore, a discrete solver is implemented to solve the optimization problem efficiently. For effective assessment, qualitative, quantitative, and subjective experiments were conducted, and a new metric, called preference, is proposed to evaluate the contrast enhancement and naturalness preservation comprehensively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Brettel, H., Viénot, F., Mollon, J.D.: Computerized simulation of color appearance for dichromats. JOSA A 14(10), 2647–2655 (1997)

    Article  Google Scholar 

  2. Hassan, M.F.: Flexible color contrast enhancement method for red-green deficiency. Multidimension. Syst. Signal Process. 30(4), 1975–1989 (2019)

    Article  Google Scholar 

  3. Hassan, M.F., Kugimiya, T., Tanaka, Y., Tanaka, K., Paramesran, R.: Comparative analysis of the color perception loss for elderly people. In: 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), pp. 1176–1181 (2015)

  4. Hassan, M.F., Paramesran, R.: Naturalness preserving image recoloring method for people with red-green deficiency. Signal Process. Image Commun. 57, 126–133 (2017)

    Article  Google Scholar 

  5. Hu, X., Liu, X., Zhang, Z., Xia, M., Li, C., Wong, T.: Colorblind-shareable videos by synthesizing temporal-coherent polynomial coefficients. ACM TOG 38(6), 1–12 (2019)

    Google Scholar 

  6. Hunt, R.: The Reproduction of Colour. The Wiley-IS &T Series in Imaging Science and Technology, Wiley, London (2005)

    Google Scholar 

  7. Iaccarino, G., Malandrino, D., Del Percio, M., Scarano, V.: Efficient edge-services for colorblind users. In: Proceedings of the 15th international conference on World Wide Web, pp. 919–920 (2006)

  8. Ichikawa, M., Tanaka, K., Kondo, S., Hiroshima, K., Ichikawa, K., Tanabe, S., Fukami, K.: Preliminary study on color modification for still images to realize barrier-free color vision. In: 2004 IEEE International Conference on Systems, Man and Cybernetics, vol. 1, pp. 36–41. IEEE (2004)

  9. Jefferson, L., Harvey, R.: Accommodating color blind computer users. In: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility, pp. 40–47 (2006)

  10. Jefferson, L., Harvey, R.: An interface to support color blind computer users. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1538 (2007)

  11. Judd, D.B.: Fundamental studies of color vision from 1860 to 1960. Proc. Natl. Acad. Sci. USA 55(6), 1313 (1966)

    Article  Google Scholar 

  12. Kuhn, G.R., Oliveira, M.M., Fernandes, L.A.: An efficient naturalness-preserving image-recoloring method for dichromats. IEEE TVCG 14(6), 1747–1754 (2008)

    Google Scholar 

  13. Lau, C., Heidrich, W., Mantiuk, R.: Cluster-based color space optimizations. In: 2011 ICCV, pp. 1172–1179. IEEE (2011)

  14. Machado, G.M., Oliveira, M.M.: Real-time temporal-coherent color contrast enhancement for dichromats. CGF 29(3), 933–942 (2010)

    Google Scholar 

  15. Machado, G.M., Oliveira, M.M., Fernandes, L.A.: A physiologically-based model for simulation of color vision deficiency. IEEE TVCG 15(6), 1291–1298 (2009)

    Google Scholar 

  16. Rasche, K., Geist, R., Westall, J.: Detail preserving reproduction of color images for monochromats and dichromats. IEEE CGA 25(3), 22–30 (2005)

    Google Scholar 

  17. Rasche, K., Geist, R., Westall, J.: Re-coloring images for gamuts of lower dimension. Citeseer (2005)

  18. Rigden, C.: ’the eye of the beholder’-designing for colour-blind users. Br. Telecommun. Eng. 17, 291–295 (1999)

    Google Scholar 

  19. Semary, N.A., Marey, H.M.: An evaluation of computer based color vision deficiency test: Egypt as a study case. In: 2014 ICET, pp. 1–7. IEEE (2014)

  20. Sharpe, L.T., Stockman, A., Jägle, H., Nathans, J.: Opsin genes, cone photopigments, color vision, and color blindness. Color Vis. Genes Percept. 2, 3–51 (1999)

    Google Scholar 

  21. Shen, W., Mao, X., Hu, X.: Seamless visual sharing with color vision deficiencies. ACM TOG 35(4), 1–12 (2016)

    Article  Google Scholar 

  22. Viénot, F., Brettel, H., Ott, L., M’barek, A.B., Mollon, J.D.: What do colour-blind people see? Nature 376(6536), 127–128 (1995)

    Article  Google Scholar 

  23. Wakita, K., Shimamura, K.: Smartcolor: disambiguation framework for the colorblind. In: Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 158–165 (2005)

  24. Wang, X., Zhu, Z., Chen, X., Go, K., Toyoura, M., Mao, X.: Fast contrast and naturalness preserving image recolouring for dichromats. C &G 98, 19–28 (2021)

    Google Scholar 

  25. Zhong, F., Koulieris, G., Drettakis, G., Banks, M., Chambe, M., Durand, F., Mantiuk, R.: Dice: Dichoptic contrast enhancement for vr and stereo displays. ACM TOG 38(6), 1–13 (2019)

    Article  Google Scholar 

  26. Zhu, Z., Mao, X.: Image recoloring for color vision deficiency compensation: a survey. Vis. Comput. 37(12), 2999–3018 (2021)

    Article  Google Scholar 

  27. Zhu, Z., Toyoura, M., Go, K., Fujishiro, I., Kashiwagi, K., Mao, X.: Naturalness-and information-preserving image recoloring for red-green dichromats. Signal Process. Image Commun. 76, 68–80 (2019)

    Article  Google Scholar 

  28. Zhu, Z., Toyoura, M., Go, K., Fujishiro, I., Kashiwagi, K., Mao, X.: Processing images for red-green dichromats compensation via naturalness and information-preservation considered recoloring. Vis. Comput. 35(6–8), 1053–1066 (2019)

    Article  Google Scholar 

  29. Zhu, Z., Toyoura, M., Go, K., Kashiwagi, K., Fujishiro, I., Wong, T.T., Mao, X.: Personalized image recoloring for color vision deficiency compensation. IEEE TMM 24, 1721–1734 (2021)

    Google Scholar 

Download references

Acknowledgements

We thank all the volunteers who helped with the evaluation and for their valuable comments which contributed the improvements of the proposed method. In addition, we are grateful to all reviewers and the editor for their valuable comments.

Funding

The work reported in this paper. This work is supported by JSPS Grants-in-Aid for Scientific Research (Grant Nos. 17H00738, 19H05472, 20J15406, 22H0054) and the National Natural Science Foundation of China (Grant Nos. 61972120).

Author information

Authors and Affiliations

  1. School of Computer Science, Hangzhou Dianzi University, Hangzhou, China

    Wangkang Huang & Xiaodiao Chen

  2. Department of Computer Science and Engineering, University of Yamanashi, Kofu, Japan

    Zhenyang Zhu, Kentaro Go & Xiaoyang Mao

  3. Graduate School of Engineering, University of Yamanashi, Kofu, Japan

    Wangkang Huang & Ligeng Chen

Authors
  1. Wangkang Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Zhenyang Zhu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Ligeng Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Kentaro Go
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Xiaodiao Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Xiaoyang Mao
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding authors

Correspondence to Xiaodiao Chen or Xiaoyang Mao.

Ethics declarations

Conflict of inyterest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, W., Zhu, Z., Chen, L. et al. Image recoloring for Red-Green dichromats with compensation range-based naturalness preservation and refined dichromacy gamut. Vis Comput 38, 3405–3418 (2022). https://doi.org/10.1007/s00371-022-02549-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-022-02549-4

Keywords