ABSTRACT
Large websites are difficult to evaluate for Web Accessibility compliance due to the shear number of pages, the inaccuracy of current Web evaluation engines, and the W3C stated need to include human evaluators within the testing regime. This makes evaluating large websites all-but technically unfeasible. Therefore, sampling of the pages becomes a critical first step in the evaluation process. Current methods rely on drawing random samples, best guess samples, or convenience samples. In all cases the evaluation results cannot be trusted because the underlying structure and nature of the site are not known; they are missing 'website demographics'. By understanding the quantifiable statistics of a given population of pages we are better able to decide on the coverage we need for a full review, as well as the sample we need to draw in order to enact an evaluation. Our solution is to crawl a website comparing, and then clustering, the pages discovered based on Document Object Model block level similarity. This technique can be useful in reducing very large sites to a more manageable size, and allowing an 80% coverage by evaluating between ≈0.1--4% of pages; additionally, by refining our clustering algorithm, we discuss how this could be reduced further.
- G. Brajnik and R. Lomuscio. SAMBA: asemi-automatic method for measuring barriers ofaccessibility. In Proc. of ASSETS' 07. Google ScholarDigital Library
- G. Brajnik, A. Mulas, and C. Pitton. Effects of sampling methods on web accessibility evaluations. In Proc. of ASSETS' 07. Google ScholarDigital Library
- G. A. Di Lucca, M. Di Penta, and A. R. Fasolino. An approach to identify duplicated web pages. In Proc. of COMPSAC '02, pages 481--486. Google ScholarDigital Library
- M. R. Henzinger, A. Heydon, M. Mitzenmacher, and M. Najork. On near-uniform URL sampling. In Proc. of WWW' 00, pages 295--308. Google ScholarDigital Library
- M. King, J. W. Thatcher, P. M. Bronstad, and R. Easton. Managing usability for people with disabilities in a large web presence. IBM Systems Journal, 44(3): 519--535, 2005. Google ScholarDigital Library
- V. I. Levenshtein. Binary codes capable of correctingdeletions, insertions, and reversals. Cybernetics and Control Theory, 10: 707--710, 1966.Google Scholar
- N. Ulltveit-Moe, M. Snaprud, A. Nietzio, M. Goodwin Olsen, and C. Thomsen. Early Results from Automatic Accessibility Benchmarking of Public European Web Sites from the EIAO. eiao.net/publications.Google Scholar
- E. Velleman and S. Abou-Zahra. Website accessibility conformance evaluation methodology (WCAG-EM) 1.0. http://www.w3.org/TR/2014/NOTE-WCAG-EM-20140710/, 2014. W3C Working Group Note.Google Scholar
- E. Velleman and T. Van Der Geest. Page sample size in web accessibility testing: how many pages is enough? In Proc. of ASSETS' 13, page 61. Google ScholarDigital Library
- E. Velleman, C. A. Velasco, M. Snaprud, and D. Burger. D-WAB4 Unified Web Evaluation Methodology (UWEM 1.0). Technical report, WAB Cluster, 2006.Google Scholar
- M. Vigo, M. Arrue, G. Brajnik, R. Lomuscio, and J. Abascal. Quantitative metrics for measuring web accessibility. In Proc. of W4A '07, pages 99--107, 2007. Google ScholarDigital Library
- M. Vigo and G. Brajnik. Automatic web accessibility metrics: where we are and where we can go. Interacting with Computers, 23(2): 137--155, 2011. Google ScholarDigital Library
- W3C/WAI. Conformance evaluation of web sites for accessibility: Determine the scope of the evaluation. www.w3.org/WAI/eval/conformance.html#scope.Google Scholar
Index Terms
- DOM block clustering for enhanced sampling and evaluation
Recommendations
Optimising the website accessibility conformance evaluation methodology
W4A '22: Proceedings of the 19th International Web for All ConferenceThe Website Accessibility Conformance Evaluation Methodology (WCAG-EM) is a methodology that guides an auditor through evaluating a website's conformance to the Web Content Accessibility Guidelines (WCAG). In this paper, we raise some concerns present ...
Web Structure Derived Clustering for Optimised Web Accessibility Evaluation
WWW '23: Proceedings of the ACM Web Conference 2023Web accessibility evaluation is a costly and complex process due to limited time, resources and ambiguity. To optimise the accessibility evaluation process, we aim to reduce the number of pages auditors must review by employing statistically ...
Comparing accessibility evaluation plug-ins
W4A '20: Proceedings of the 17th International Web for All ConferenceThis article reports the results of a study comparing evaluation accessibility plugins extensions for the Chrome web browser. Eight of the most well-known tools among developers were chosen. All tools are free or available under an open-source license, ...
Comments