skip to main content
10.1145/3549865.3549893acmotherconferencesArticle/Chapter ViewAbstractPublication PagesinteraccionConference Proceedingsconference-collections
research-article

Validation of a heuristic set to evaluate the accessibility of statistical charts

Authors Info & Claims
Published:09 September 2022Publication History

ABSTRACT

A remote user test was performed with two versions (one accessible and another one non-accessible) of three types of web-based charts (horizontal bar chart, vertical stacked bar chart, and line chart). The objectives of the test were a) to validate a set of heuristic indicators for the evaluation of the accessibility of statistical charts presented in a previous work [7]; b) to identify new barriers and preferences for users with low vision in the access and use of this content not previously contemplated. 12 users were tested, with a variety of conditions associated with low vision: low visual acuity (6 users), reduced central vision (2 users), reduced peripheral vision (2 users), blurry vision (1 user), sensitivity to light (3 users), Nystagmus (2 users) and color vision deficiency (CVD) (4 users). From a quantitative standpoint, accessible versions of charts were more efficient, effective, and satisfactory. From a qualitative point of view, results verify the relevance of heuristics H2, Legend; H3, Axes; H6, Data source (as data table); H10, Safe colors; H11, Contrast; H12, Legibility; H13, Image quality; H14, Resize; H16, Focus visible; H17, Independent navigation; related to the proposed tasks. As new observations, tooltips were highly valued by all users, but their implementation must be improved to avoid covering up significant parts of the charts when displayed. The data table has also been frequently used by all users, especially in the non-accessible versions, allowing them to carry out tasks more efficiently. The position and size of the legend can be a significant barrier if it is too small or appears in an unusual position. Finally, despite the limitations related to color perception, users prefer color graphics to black and white, so, to target all profiles, it is necessary to redundantly encode categories with colors and patterns as well.

References

  1. GBD 2019 Blindness and Vision Impairment Collaborators. 2021. Trends in prevalence of blindness and distance and near vision impairment over 30 years: an analysis for the Global Burden of Disease Study. The lancet global health 9, 2, e130-e143. DOI:https://doi.org/10.1016/S2214-109X(20)30425-3.Google ScholarGoogle Scholar
  2. WebAIM. 2013. Visual disabilities. Page 3. Low vision. https://webaim.org/articles/visual/lowvision.Google ScholarGoogle Scholar
  3. Hyung Nam Kim, 2013. Elicitation of haptic user interface needs of people with low vision. International journal of human-computer interaction 29, 7, 488-500.Google ScholarGoogle Scholar
  4. Lourdes Moreno, Xabier Valencia, J. Eduardo Pérez and Myrriam Arrue. 2020. An exploratory study of web adaptation techniques for people with low vision. Universal access in the information society 20, 223–237. DOI: https://doi.org/10.1007/s10209-020-00727-6Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sarit-Felicia-Anais Szpiro, Shafeka Hashash, Yuhang Zhao and Shiri Azenkot, 2016. How People with low vision access computing devices: understanding challenges and opportunities. In ASSETS '16 Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility, 171-180. DOI:https://doi.org/10.1145/2982142.2982168.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Yevgen Borodin, Jeffrey P. Bigham, Glenn Dausch and I.V. Ramakrishnan. 2010. More than meets the eye: a survey of screen-reader browsing strategies. In W4A '10: Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility. Raleigh, North Carolina, USA, 13. DOI:https://doi.org/10.1145/1805986.1806005.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Rubén Alcaraz-Martínez, Mireia Ribera and Toni Granollers. 2021. Methodology for heuristic evaluation of the accessibility of statistical charts for people with low vision and color vision deficiency. Universal access in the information society. DOI:https://doi.org/10.1007/s10209-021-00816-0.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. W3C. 2018. Web content accessibility guidelines (WCAG) 2.1. https://www.w3.org/TR/WCAG21.Google ScholarGoogle Scholar
  9. Rubén Alcaraz-Martínez, Mireia Ribera, Toni Granollers and Afra Pascual. 2020. Accesibilidad para personas con baja visión de los gráficos estadísticos en la prensa digital: una propuesta metodológica basada en indicadores heurísticos. El profesional de la información 29, 5. DOI:https://doi.org/10.3145/epi.2020.sep.15.Google ScholarGoogle Scholar
  10. Rubén Alcaraz-Martínez and Mireia Ribera. 2020. An evaluation of accessibility of COVID-19 statistical charts of governments and health organisations for people with low vision. El profesional de la información 29, 5. DOI:https://doi.org/10.3145/epi.2020.sep.14.Google ScholarGoogle Scholar
  11. Rubén Alcaraz-Martínez, Mireia Ribera, Jordi Roig, Afra Pascual and Toni Granollers. 2022. Accessible charts are part of the equation of accessible papers: a heuristic evaluation of the highest impact LIS journals. Library hi tech 40, 3, 594-622. DOI:https://doi.org/10.1108/LHT-08-2020-0188.Google ScholarGoogle Scholar
  12. Christopher Power, André Freire, Helen Petrie and David Swallow. 2012. Guidelines are only half of the story: accessibility problems encountered by blind users on the Web. In CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 433-442. DOI:https://doi.org/10.1145/2207676.2207736.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Bettina Lechner, Ann Fruhling, Stacie Petter and Harvey Siy. 2013. The chicken and the pig: user involvement in developing usability heuristics. In 19th Americas Conference on Information Systems, AMCIS 2013 - Hyperconnected World: Anything, Anywhere, Anytime, 3263-3270.Google ScholarGoogle Scholar
  14. Giorgio Brajnik. 2009. Barrier walkthrough. https://users.dimi.uniud.it/∼giorgio.brajnik/projects/bw/bw.html.Google ScholarGoogle Scholar
  15. Shadi Abou Zahra. 2017. How people with disabilities use the Web. In Accessibility fundamentals. W3C. https://www.w3.org/WAI/people-use-web.Google ScholarGoogle Scholar
  16. Rubén Alcaraz-Martínez, Mireia Ribera and Toni Granollers. 2020. Accessible statistical charts guidelines for people with low vision. In 2020 15th Iberian Conference on Information Systems and Technologies (CISTI), 1-6. DOI:https://doi.org/10.23919/CISTI49556.2020.9140814.Google ScholarGoogle ScholarCross RefCross Ref
  17. William Albert and Eleri Dixon (2003). Is this what you expected?: the use of expectation measures in usability testing. In Proceedings of the Usability Professionals Association 2003 Conference.Google ScholarGoogle Scholar
  18. Alita Joyce. 2019. Tooltip Guidelines. NN/g Nielsen Norman Group. Articles. https://www.nngroup.com/articles/tooltip-guidelines.Google ScholarGoogle Scholar
  19. Mallory Van Achterberg. 2019. Designing and coding for low vision. In Technica11y: discussing challenges in technical accessibility. https://www.technica11y.org/designing-and-coding-for-low-vision.Google ScholarGoogle Scholar
  20. Stephanie Evergreen S. 2018. Presenting data effectively: communicating your findings for maximum impact. SAGE, Thousand Oaks, California.Google ScholarGoogle Scholar
  21. Cole Nussbaumer Knaflic. 2015. Storytelling with data: a data visualization guide for business professionals. Wiley, New Jersey.Google ScholarGoogle Scholar
  22. Colin Ware and John C. Beatty. 1985. Using color as a tool in discrete data analysis. Technical Report. CS-85-21, Computer Science Department University. of Waterloo, Waterloo. https://cs.uwaterloo.ca/research/tr/1985/CS-85-21.pdf.Google ScholarGoogle Scholar
  23. W3C. 2000. Accessibility features of SVG. https://www.w3.org/TR/2000/NOTE-SVG-access-20000807.Google ScholarGoogle Scholar
  24. W3C. 2015. SVG Accessibility/ARIA roles for charts. https://www.w3.org/wiki/SVG_Accessibility/ARIA_roles_for_charts.Google ScholarGoogle Scholar
  25. W3C. 2018. WAI-ARIA graphics module. https://www.w3.org/TR/graphics-aria-1.0.Google ScholarGoogle Scholar
  26. S. Harland Gordon, G.E. Legge and A. Luebker. 1998. Psychophysics of reading – XVII Low-vision performance with four types of electronically magnified text. Optometry and vision science 75, 3, 183-190. DOI:https://doi.org/10.1097/00006324-199803000-00023.Google ScholarGoogle Scholar
  27. Guobei Xiao, Guotong Xu and Jianwei Lu. 2010. iBrowse: software for low vision to access Internet. In 2010 3rd International Conference on Biomedical Engineering and Informatics, 2062–2066. DOI:https://doi.org/10.1109/BMEI.2010.5639642.Google ScholarGoogle ScholarCross RefCross Ref
  28. Myriam Arrue, Xabier Valencia, J. Eduardo Pérez, Lourdes Moreno and Julio Abascal. 2019. Inclusive web empirical studies in remote and in situ settings: a user evaluation of the RemoTest platform. International journal of human-computer interaction 35, 7. DOI:https://doi.org/10.1080/10447318.2018.1473941.Google ScholarGoogle Scholar

Index Terms

  1. Validation of a heuristic set to evaluate the accessibility of statistical charts

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      Interacción '22: Proceedings of the XXII International Conference on Human Computer Interaction
      September 2022
      104 pages

      Copyright © 2022 ACM

      Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 September 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate109of163submissions,67%
    • Article Metrics

      • Downloads (Last 12 months)26
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format