skip to main content
10.1145/3517428.3544818acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

Challenging and Improving Current Evaluation Methods for Colour Identification Aids

Published: 22 October 2022 Publication History

Abstract

Identification of and discrimination between colours is an important task in everyday life, but for the 5% of the population who have Colour Vision Deficiency (CVD), correctly identifying or discriminating between colours can be difficult or impossible. Colour Identification (or CVD) Aids have been developed to assist people with CVD, however, the methods used to evaluate them are often limited and many use CVD simulations instead of participants with CVD. To address this, we propose two new CVD Aid evaluation tasks and show that they can assist in providing a more thorough evaluation of potential CVD aids. In addition, we evaluate the effectiveness of CVD simulations used by non-CVD people in providing results similar to those for people with CVD, and found that both the results and participant behaviour often differed. Our results indicate that greater care is needed when evaluating CVD Aids.

References

[1]
Katrin Angerbauer, Nils Rodrigues, Rene Cutura, Seyda Öney, Nelusa Pathmanathan, Cristina Morariu, Daniel Weiskopf, and Michael Sedlmair. 2022. Accessibility for Color Vision Deficiencies: Challenges and Findings of a Large Scale Study on Paper Figures. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 134, 23 pages. https://doi.org/10.1145/3491102.3502133
[2]
Anonymous. 2008. Inkscape - Color Blindness Simulation. https://web.archive.org/web/20111123145815http://kaioa.com/node/75##comment-247. Accessed: 2022-4-14.
[3]
Jibin Bao, Yuanyuan Wang, Yu Ma, and Xiaodong Gu. 2008. Re-coloring images for dichromats based on an improved adaptive mapping algorithm. In 2008 International Conference on Audio, Language and Image Processing. IEEE, 152–156.
[4]
Cynthia L. Bennett and Daniela K. Rosner. 2019. The Promise of Empathy: Design, Disability, and Knowing the ”Other”. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300528
[5]
Jennifer Birch and Jennifer Birch. 2001. Diagnosis of defective colour vision. (2001).
[6]
Hans Brettel, Françoise Viénot, and John D Mollon. 1997. Computerized simulation of color appearance for dichromats. Josa a 14, 10 (1997), 2647–2655.
[7]
Olivier Burggraaf, Sanjana Panchgnula, and Frans Snik. 2021. Citizen science with colour blindness: A case study on the Forel-Ule scale. PLoS ONE 16(4): e0249755.(2021). https://doi.org/10.1371/journal.pone.0249755
[8]
Yu-Chieh Chen and Tai-Shan Liao. 2011. Hardware digital color enhancement for color vision deficiencies. ETRI Journal 33, 1 (2011), 71–77.
[9]
Barry L Cole. 2004. The handicap of abnormal colour vision. Clinical and Experimental Optometry 87, 4-5 (2004), 258–275.
[10]
Bevil R Conway. 2009. Color vision, cones, and color-coding in the cortex. The neuroscientist 15, 3 (2009), 274–290. https://doi.org/10.1177/1073858408331369
[11]
Fabio Crameri, Grace E. Shephard, and Philip J. Heron. 2020. The misuse of colour in science communication. Nature Communications 11, 5444 (2020). https://doi.org/10.1038/s41467-020-19160-7
[12]
Peter B Delahunt, Michael A Webster, Lei Ma, and John S Werner. 2004. Long-term renormalization of chromatic mechanisms following cataract surgery. Visual neuroscience 21, 03 (2004), 301–307.
[13]
Yinhui Deng, Yuanyuan Wang, Yu Ma, Jibin Bao, and Xiaodong Gu. 2007. A fixed transformation of color images for dichromats based on similarity matrices. In International Conference on Intelligent Computing. Springer, 1018–1028.
[14]
F Dick, S Semple, R Chen, and A Seaton. 2000. Neurological deficits in solvent-exposed painters: a syndrome including impaired colour vision, cognitive defects, tremor and loss of vibration sensation. QJM 93, 10 (2000), 655–661.
[15]
Dean Farnsworth. 1943. The Farnsworth-Munsell 100-Hue and Dichotomous Tests for Color Vision*. J. Opt. Soc. Am. 33, 10 (Oct 1943), 568–578. https://doi.org/10.1364/JOSA.33.000568
[16]
David Flatla and Carl Gutwin. 2012. SSMRecolor: Improving Recoloring Tools with Situation-Specific Models of Color Differentiation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2297–2306. https://doi.org/10.1145/2207676.2208388
[17]
David R. Flatla, Alan R. Andrade, Ross D. Teviotdale, Dylan L. Knowles, and Craig Stewart. 2015. ColourID: Improving Colour Identification for People with Impaired Colour Vision. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 3543–3552. https://doi.org/10.1145/2702123.2702578
[18]
David R. Flatla and Carl Gutwin. 2012. ”So That’s What You See”: Building Understanding with Personalized Simulations of Colour Vision Deficiency. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (Boulder, Colorado, USA) (ASSETS ’12). Association for Computing Machinery, New York, NY, USA, 167–174. https://doi.org/10.1145/2384916.2384946
[19]
Donald S Fong, Franca B Barton, George H Bresnick, and Early Treatment Diabetic Retinopathy Study Research Group. 1999. Impaired color vision associated with diabetic retinopathy: early treatment diabetic retinopathy study report no. 15. American journal of ophthalmology 128, 5 (1999), 612–617.
[20]
Connor Geddes, David R. Flatla, Garreth W. Tigwell, and Roshan L Peiris. 2022. Improving Colour Patterns to Assist People with Colour Vision Deficiency. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 479, 17 pages. https://doi.org/10.1145/3491102.3502024
[21]
Google. 2020. Improve vision deficiency color matrices per research paper. https://chromium-review.googlesource.com/c/chromium/src/+/2124500Accessed: 2022-4-14.
[22]
Google. 2020. What’s New In DevTools (Chrome 83). https://developer.chrome.com/blog/new-in-devtools-83/##vision-deficiencies. Accessed: 2022-4-14.
[23]
C. H. Graham and Yun Hsia. 1959. Studies of Color Blindness: A Unilaterally Dichromatic Subject. Proceedings of the National Academy of Sciences 45, 1 (1959), 96–99. https://doi.org/10.1073/pnas.45.1.96 arXiv:https://www.pnas.org/doi/pdf/10.1073/pnas.45.1.96
[24]
Soon Hau Chua, Haimo Zhang, Muhammad Hammad, Shengdong Zhao, Sahil Goyal, and Karan Singh. 2015. ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect. ACM Trans. Comput.-Hum. Interact. 21, 6, Article 32 (Jan. 2015), 20 pages. https://doi.org/10.1145/2687923
[25]
Chun-Rong Huang, Kuo-Chuan Chiu, and Chu-Song Chen. 2010. Key color priority based image recoloring for dichromats. In Pacific-Rim Conference on Multimedia. Springer, 637–647.
[26]
Jia-Bin Huang, Yu-Cheng Tseng, Se-In Wu, and Sheng-Jyh Wang. 2007. Information preserving color transformation for protanopia and deuteranopia. IEEE Signal Processing Letters 14, 10 (2007), 711–714.
[27]
Jia-Bin Huang, Sih-Ying Wu, and Chu-Song Chen. 2008. Enhancing color representation for the color vision impaired. In Workshop on Computer Vision Applications for the Visually Impaired.
[28]
K. Ichikawa, S. Yokoyama, Yoshiki Tanaka, Hideki Nakamura, R. T. Smith, and S. Tanabe. 2020. The Change in Color Vision with Normal Aging Evaluated on Standard Pseudoisochromatic Plates Part-3. Current Eye Research 46(2020), 1038 – 1046.
[29]
Shinobu Ishihara. 1987. Test for colour-blindness. Kanehara Tokyo, Japan.
[30]
Luke Jefferson and Richard Harvey. 2007. An Interface to Support Color Blind Computer Users. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1535–1538. https://doi.org/10.1145/1240624.1240855
[31]
Kenneth Knoblauch, François Vital-Durand, and John L Barbur. 2001. Variation of chromatic sensitivity across the life span. Vision research 41, 1 (2001), 23–36.
[32]
Shoji Kondo. 1990. A computer simulation of anomalous color vision. Color Vision Deficiencies(1990), 145–159.
[33]
Tobias Langlotz, Jonathan Sutton, Stefanie Zollmann, Yuta Itoh, and Holger Regenbrecht. 2018. ChromaGlasses: Computational Glasses for Compensating Colour Blindness. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3173964
[34]
Jinmi Lee and Wellington Pinheiro dos Santos. 2011. An adaptive fuzzy-based system to simulate, quantify and compensate color blindness. Integrated Computer-Aided Engineering 18, 1 (2011), 29–40.
[35]
Huei-Yung Lin, Li-Qi Chen, and Min-Liang Wang. 2019. Improving Discrimination in Color Vision Deficiency by Image Re-Coloring. Sensors 19, 10 (2019). https://doi.org/10.3390/s19102250
[36]
Richard B Lomax, Peter Ridgway, and Maureen Meldrum. 2004. Does occupational exposure to organic solvents affect colour discrimination?Toxicological reviews 23, 2 (2004), 91–121.
[37]
Rhouri MacAlpine and David R. Flatla. 2016. Real-Time Mobile Personalized Simulations of Impaired Colour Vision. In Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility(Reno, Nevada, USA) (ASSETS ’16). Association for Computing Machinery, New York, NY, USA, 181–189. https://doi.org/10.1145/2982142.2982170
[38]
Gustavo M. Machado, Manuel M. Oliveira, and Leandro A. F. Fernandes. 2009. A Physiologically-Based Model for Simulation of Color Vision Deficiency. IEEE Transactions on Visualization and Computer Graphics 15, 6 (nov 2009), 1291–1298. https://doi.org/10.1109/TVCG.2009.113
[39]
MaPePeR. 2015. jsColorblindSimulator. https://github.com/MaPePeR/jsColorblindSimulator. Accessed: 2022-4-14.
[40]
Gary W Meyer and Donald P Greenberg. 1988. Color-defective vision and computer graphics displays. IEEE Computer Graphics and Applications 8, 5 (1988), 28–40.
[41]
Neda Milić, Miklós Hoffmann, Tibor Tómács, Dragoljub Novaković, and Branko Milosavljević. 2015. A content-dependent naturalness-preserving daltonization method for dichromatic and anomalous trichromatic color vision deficiencies. Journal of Imaging Science and Technology 59, 1 (2015), 10504–1.
[42]
Mozilla. 2020. Color vision simulation. https://firefox-source-docs.mozilla.org/devtools-user/accessibility_inspector/simulation/index.html. Accessed: 2022-4-14.
[43]
Shigeki Nakauchi and Tatsuya Onouchi. 2008. Detection and modification of confusing color combinations for red-green dichromats to achieve a color universal design. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur 33, 3 (2008), 203–211.
[44]
nburrus. 2021. Let’s collectively determine the best color blindness simulation method!https://www.reddit.com/r/ColorBlind/comments/qzkl7h/lets_collectively_determine_the_best_color/. Accessed: 2022-4-14.
[45]
M Pacheco-Cutillas, DF Edgar, and A Sahraie. 1999. Acquired colour vision defects in glaucoma – their detection and clinical significance. British Journal of Ophthalmology 83, 12 (1999), 1396–1402. https://doi.org/10.1136/bjo.83.12.1396
[46]
S Poret, RD Dony, and S Gregori. 2009. Image processing for colour blindness correction. In 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH). IEEE, 539–544.
[47]
B.C. Regan, J.P. Reffin, and J.D. Mollon. 1994. Luminance noise and the rapid determination of discrimination ellipses in colour deficiency. Vision Research 34, 10 (1994), 1279–1299. https://doi.org/10.1016/0042-6989(94)90203-8
[48]
Behzad Sajadi, Aditi Majumder, Manuel M. Oliveira, Rosalia G. Schneider, and Ramesh Raskar. 2013. Using Patterns to Encode Color Information for Dichromats. IEEE Transactions on Visualization and Computer Graphics 19, 1 (Jan. 2013), 118–129. https://doi.org/10.1109/TVCG.2012.93
[49]
Andrew Sears and Vicki Hanson. 2011. Representing users in accessibility research. In Proceedings of the SIGCHI conference on Human factors in computing systems. 2235–2238.
[50]
Jonathan Sutton, Tobias Langlotz, and Alexander Plopski. 2022. Seeing Colours: Addressing Colour Vision Deficiency with Vision Augmentations Using Computational Glasses. ACM Trans. Comput.-Hum. Interact. 29, 3, Article 26 (jan 2022), 53 pages. https://doi.org/10.1145/3486899
[51]
Garreth W. Tigwell. 2021. Nuanced Perspectives Toward Disability Simulations from Digital Designers, Blind, Low Vision, and Color Blind People. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 378, 15 pages. https://doi.org/10.1145/3411764.3445620
[52]
Françoise Viénot, Hans Brettel, and John D Mollon. 1999. Digital video colourmaps for checking the legibility of displays by dichromats. Color Research & Application 24, 4 (1999), 243–252.
[53]
Ken Wakita and Kenta Shimamura. 2005. SmartColor: Disambiguation Framework for the Colorblind. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility(Baltimore, MD, USA) (Assets ’05). Association for Computing Machinery, New York, NY, USA, 158–165. https://doi.org/10.1145/1090785.1090815
[54]
Alexander Wong and William Bishop. 2008. Perceptually-adaptive color enhancement of still images for individuals with dichromacy. In 2008 Canadian Conference on Electrical and Computer Engineering. IEEE, 002027–002032.
[55]
Seungji Yang, YongMan Ro, EdwardK Wong, and Jin-Hak Lee. 2008. Quantification and standardized description of color vision deficiency caused by anomalous trichromats—part I: simulation and measurement. EURASIP Journal on Image and Video Processing 2008 (2008), 1–9.
[56]
Semir Zeki. 1990. A century of cerebral achromatopsia. Brain 113, 6 (1990), 1721–1777.
[57]
Zhenyang Zhu and Xiaoyang Mao. 2021. Image recoloring for color vision deficiency compensation: a survey. The Visual Computer 37 (12 2021), 1–20. https://doi.org/10.1007/s00371-021-02240-0
[58]
Zhenyang Zhu, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Issei Fujishiro, Tien-Tsin Wong, and Xiaoyang Mao. 2021. Personalized Image Recoloring for Color Vision Deficiency Compensation. IEEE Transactions on Multimedia PP (03 2021), 1–1. https://doi.org/10.1109/TMM.2021.3070108

Cited By

View all
  • (2023)30 Years of Solving the Wrong Problem: How Recolouring Tool Design Fails those with Colour Vision DeficiencyProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608407(1-13)Online publication date: 22-Oct-2023

Index Terms

  1. Challenging and Improving Current Evaluation Methods for Colour Identification Aids

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility
    October 2022
    902 pages
    ISBN:9781450392587
    DOI:10.1145/3517428
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Colour Vision Deficiency
    2. Colour Vision Deficiency Simulation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ASSETS '22
    Sponsor:

    Acceptance Rates

    ASSETS '22 Paper Acceptance Rate 35 of 132 submissions, 27%;
    Overall Acceptance Rate 436 of 1,556 submissions, 28%

    Upcoming Conference

    ASSETS '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)65
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)30 Years of Solving the Wrong Problem: How Recolouring Tool Design Fails those with Colour Vision DeficiencyProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608407(1-13)Online publication date: 22-Oct-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media