Skip to main content
SpringerLink
Log in

Collaborative Web Accessibility Evaluation: An EARL-Based Workflow Approach

  • Conference paper
  • First Online:
Web Engineering (ICWE 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13893))

Included in the following conference series:

  • 487 Accesses

Abstract

The Web Accessibility Guidelines are designed to help developers ensure that web content is accessible to all users. These guidelines provide the foundation for evaluation tools that automate inspection processes. However, due to the heterogeneity of these guidelines and the subjectivity involved in their evaluation, humans are still necessary for the process. As a result, evaluating accessibility becomes a collaborative endeavor wherein different human experts and tools interact. Despite quickly being noticed by the W3C, it has largely been overlooked in the existing literature. Tool vendors often focus on providing a thorough evaluation rather than importing, integrating, and combining results from diverse sources. This paper examines an EARL-based document-centric workflow. It introduces a dedicated editor for EARL documents that accounts for the life-cycle of EARL documents where evaluation episodes feedback on each other. Expert evaluations were conducted (n = 5 experts), not so much about the tool itself but its ability to facilitate a collaborative approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    European Union main web page: https://european-union.europa.eu/index_en; Brussels City Hall main web page: https://www.brussels.be/; World Health Organization main web page: https://www.who.int/home; United Nations main web page: https://www.un.org/en/; UNESCO main web page: https://www.unesco.org/en; MIT main web page: https://www.mit.edu/.

  2. 2.

    It’s worth noting that if even a single error is detected, the corresponding success criterion is labeled as Failed.

  3. 3.

    https://github.com/Itusil/TFG.

References

  1. Abascal, J., Arrue, M., Valencia, X.: Tools for web accessibility evaluation. In: Yesilada, Y., Harper, S. (eds.) Web Accessibility. HIS, pp. 479–503. Springer, London (2019). https://doi.org/10.1007/978-1-4471-7440-0_26

    Chapter  Google Scholar 

  2. acessibilidade.gov.pt: Accessmonitor (2023). https://accessmonitor.acessibilidade.gov.pt/. Accessed 03 April 2023

  3. Al Mourad, M., Kamoun, F.: Accessibility evaluation of Dubai e-government websites: findings and implications. J. E-Gov. Stud. Best Practices (2013)

    Google Scholar 

  4. Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Intl. J. Human-Comput. Inter. 24(6), 574–594 (2008)

    Article  Google Scholar 

  5. Bogner, A., Littig, B., Menz, W.: Introduction: expert interviews-an introduction to a new methodological debate. In: ogner, A., Littig, B., Menz, W. (eds.) Interviewing Experts, pp. 1–13. Springer (2009)

    Google Scholar 

  6. Brajnik, G., Yesilada, Y., Harper, S.: The expertise effect on web accessibility evaluation methods. Human-Comput. Interact. 26(3), 246–283 (2011)

    Google Scholar 

  7. Brewer, J.: Using combined expertise to evaluate web accessibility (2022). https://www.w3.org/WAI/test-evaluate/combined-expertise/

  8. Brooke, J., et al.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  9. Davis, F.D.: A technology acceptance model for empirically testing new end-user information systems: theory and results. Ph.D. thesis, Massachusetts Institute of Technology (1985)

    Google Scholar 

  10. Gazzè, D., La Polla, M.N., Marchetti, A., Tesconi, M., Vivaldi, A.: WorkMail: collaborative document workflow management by Email. In: Luo, Y. (ed.) CDVE 2012. LNCS, vol. 7467, pp. 14–23. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-32609-7_2

    Chapter  Google Scholar 

  11. Greg Gay, C.L.: Achecker (2023). https://achecker.achecks.ca/checker/index.php. Accessed 03 April 2023

  12. Kumar, K.L., Owston, R.: Evaluating e-learning accessibility by automated and student-centered methods. Educ. Tech. Res. Dev. 64(2), 263–283 (2016)

    Article  Google Scholar 

  13. Latif, M.H.A., Masrek, M.N.: Accessibility evaluation on Malaysian e-government websites. J. E-Government stud. Best Practices 2010, 11 (2010)

    Google Scholar 

  14. Lewis, J.R., Utesch, B.S., Maher, D.E.: UMUX-LITE: when there’s no time for the SUS. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2099–2102. CHI ’13, Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2470654.2481287

  15. Lewis, J.R., Utesch, B.S., Maher, D.E.: Investigating the correspondence between UMUX-LITE and SUS scores. In: Marcus, A. (ed.) DUXU 2015. LNCS, vol. 9186, pp. 204–211. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20886-2_20

    Chapter  Google Scholar 

  16. MACAKOĞLU, Ş.S., Peker, S.: Web accessibility performance analysis using web content accessibility guidelines and automated tools: a systematic literature review. In: 2022 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), pp. 1–8 (2022). https://doi.org/10.1109/HORA55278.2022.9799981

  17. Manca, M., Palumbo, V., Paternò, F., Santoro, C.: The transparency of automatic web accessibility evaluation tools: design criteria, state of the art, and user perception. ACM Transactions on Accessible Computing (2022)

    Google Scholar 

  18. Thatcher, J., et al.: Constructing accessible web sites. Apress, Berkeley, CA (2002). https://doi.org/10.1007/978-1-4302-1116-7, http://link.springer.com/10.1007/978-1-4302-1116-7

  19. Venkatesh, V., Davis, F.D.: A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage. Sci. 46(2), 186–204 (2000)

    Article  Google Scholar 

  20. Vigo, M., Brown, J., Conway, V.: Benchmarking web accessibility evaluation tools: measuring the harm of sole reliance on automated tests. In: Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, pp. 1–10. W4A ’13, Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2461121.2461124

  21. W3C: Evaluation and report language (earl) overview (2023). https://www.w3.org/WAI/standards-guidelines/earl/. Accessed 03 April 2023

  22. W3C: Prov model primer (2023). https://www.w3.org/TR/2013/NOTE-prov-primer-20130430/. Accessed 03 April 2023

Download references

Acknowledgement

This work is co-supported by MCIN/AEI/10.13039/501100011033 and the “European Union NextGeneration EU/PRTR” under contract PID2021-125438OB-I00.

Author information

Authors and Affiliations

  1. ONEKIN Research Group, University of the Basque Country (UPV/EHU), 20018, Donostia-San Sebastián, Spain

    Juan-Miguel López-Gil, Oscar Díaz & Mikel Iturria

Authors
  1. Juan-Miguel López-Gil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Oscar Díaz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mikel Iturria
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Juan-Miguel López-Gil .

Editor information

Editors and Affiliations

  1. University of Alicante, Alicante, Spain

    Irene Garrigós

  2. University of Extremadura, Cáceres, Spain

    Juan Manuel Murillo Rodríguez

  3. Johannes Kepler University Linz, Linz, Austria

    Manuel Wimmer

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

López-Gil, JM., Díaz, O., Iturria, M. (2023). Collaborative Web Accessibility Evaluation: An EARL-Based Workflow Approach. In: Garrigós, I., Murillo Rodríguez, J.M., Wimmer, M. (eds) Web Engineering. ICWE 2023. Lecture Notes in Computer Science, vol 13893. Springer, Cham. https://doi.org/10.1007/978-3-031-34444-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34444-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34443-5

  • Online ISBN: 978-3-031-34444-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation