Abstract
The Accessibility Requirements Tool for Information and Communication Technologies (FRATIC) was developed within the work of a doctoral project, at the University of Trás-os-Montes and Alto Douro, and may be used at various stages of public procurement processes as well as projects and developments that include ICT products and services. This tool helps to consult, determine and assess the accessibility requirements for ICT products and services in European Standard EN 301 549 that supports the legislation in the field of public procurement for the countries of the European Union – Directive 2014/24/EU. This study focuses on the standardized usability and accessibility features evaluation of the FRATIC prototype, based on ISO 9241-11 metrics, other usability and accessibility evaluation criteria, as well as various standardized measurement tools and methods – such as Single Ease Question (SEQ) and System Usability Scale (SUS) – after conducting usability tests and interviews with 25 experts in the fields of accessibility, assistive technologies, and public procurement.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Designations of the three European standardization organizations: European Committee for Standardization (CEN), European Committee for Electrotechnical Standardization (CENELEC) and European Telecommunications Standards Institute (ETSI).
- 2.
National Qualifications Framework - created in 2007 and regulated in June 2009, became effective in October 2010 (Decree No. 782/2009, July 23), with reference to the principles of the European Qualifications Framework (EQF).
References
Comissão Europeia: People with disabilities have equal rights - TheEuropean Disability Strategy 2010–2020. Comissão Europeia. Comissão Europeia, Bruxelas (2010)
INE: Health and disabilities in Portugal: 2011. Instituto Nacional de Estatística, IP, Lisboa (2012)
Nações Unidas: Convenção sobre os Direitos das Pessoas com Deficiência. Nações Unidas, Nova York (2006)
Nações Unidas: Standard Rules on the Equalization of Opportunities forPersons with Disabilities. Nações Unidas, Nova York (1993)
Nações Unidas: Declaração de Salamanca sobre princípios, políticas e práticas na área das necessidades educativas especiais, Conferência Mund. Educ. Espec. (1994)
Martins, M., Gonçalves, R., Godinho, F., Novais, J.: Benefits of EN 301 549 for each group of People with Special Needs. In: Proceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, pp. 123–128 (2018)
ETSI, CEN, and CENELEC: EN 301 549 V3.1.1 - Accessibility requirements for ICT products and services. European Telecommunications Standards Institute (2019)
Parlamento Europeu: Diretiva (UE) 2014/24 do Parlamento Europeu e do Conselho de 26 de fevereiro de 2014 relativa aos contratos públicos e que revoga a Diretiva 2004/18/CE. Jornal Oficial da União Europeia. Estrasburgo, pp. 65–242 (2014)
McKinney, S., Horspool, A., Willers, R., Safie, O., Richlin, L.: Using Second Life with learning-disabled students in higher education. Innov. J. Online Educ. 5(2) (2008)
Foley, A., Ferri, B.A.: Technology for people, not disabilities: ensuring access and inclusion. J. Res. Spec. Educ. Needs 12(4), 192–200 (2012)
Benfer, E.A.: The ADA Amendments Act: an overview of recent changes to the Americans with Disabilities Act. Advance 4, 53 (2010)
Architectural and Transportation Barriers Compliance Board: Telecommunications act accessibility guidelines (36 CFR Part 1193, RIN 3014-AA19). Federal Register, vol. 63, no. 22, pp. 5607–5641 (1998)
US Access Board: Electronic and information technology accessibility standards. Fed. Regist. 15, 2005 (2000)
US Access Board: Information and Communication Technology (ICT) - Revised 508 Standards and 255 Guidelines. US Federal Register, Washington (2017)
US Access Board: Information and Communication Technology (ICT) Standards and Guidelines, pp. 2912–2916 (2018)
Easton, C.: Website accessibility and the European Union: citizenship, procurement and the proposed Accessibility Act. Int. Rev. Law Comput. Technol. 27(1–2), 187–199 (2013)
ETSI, CEN, and CENELEC: EN 301 549 V1.1.1 - Accessibility requirements suitable for public procurement of ICT products and services in Europe. European Telecommunications Standards Institute. França (2014)
Lecerf, M.: Briefing - EU Legislation in Progress, European Accessibility Act. Parlamento Europeu, Bruxelas (2017)
Parlamento Europeu: Diretiva (UE) 2019/882, relativa aos requisitos de acessibilidade dos produtos e serviços. Jornal Oficial da União Europeia (2019). https://eur-lex.europa.eu/legal-content/PT/TXT/HTML/?uri=CELEX:32019L0882&from=EN. Accessed 30 May 2021
Comissão Europeia: European Commission - Press release - Comissão saúda acordo para tornar mais acessíveis sítios Web e aplicações móveis do setor público. Comissão Europeia (2016)
Astbrink, G., Tibben, W.: ICT accessibility criteria in public procurement in OECD countries - the current situation. In: International Conference on Universal Access in Human-Computer Interaction, pp. 155–164 (2013)
Ahtonen, A., Pardo, R.: The Accessibility Act-Using the single market to promote fundamental rights. Eur. Policy Cent. 12 (2013)
Cohen, L., Manion, L., Morrison, K.: Research Methods in Education, 8th edn. Routledge, London (2017)
ISO 9241-11: ISO 9241-11:2018 - Ergonomics of human-system interaction—Part 11: Usability: Definitions and concepts, Geneva, Switz. Int. Organ. Stand. (2018)
Sauro, J.: If you could only ask one question, use this one. MeasuringU (2010). https://measuringu.com/single-question/. Accessed 22 Apr 2020
Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Burlington (2016)
Padrini-Andrade, L., et al.: Evaluation of usability of a neonatal health information system according to the user’s perception. Rev. Paul. Pediatr. 37(1), 90–96 (2019)
Story, M., Mueller, J.L., Mace, R.L.: The universal design file: designing for people of all ages and abilities, Revised edn. (1998)
ISO 9241-11: ISO 9241-11 - Ergonomic requirements for office work with visual display terminals (VDTs), Geneva, Switz. Int. Organ. Stand., vol. 45, no. 9 (1998)
Sauro, J.: What is a good task-completion rate? MeasuringU (2011). https://measuringu.com/task-completion/. Accessed 09 Apr 2021
Sauro, J.: 10 Benchmarks for user experience metrics. MeasuringU (2012)
Brooke, J.: SUS: a “quick and dirty’usability” usability scale. In: Usability Evaluation in Industry, p. 189 (1996)
Lewis, J.R.: Measuring perceived usability: the CSUQ, SUS, and UMUX. Int. J. Hum. Comput. Interact. 34(12), 1148–1156 (2018)
Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 24(6), 574–594 (2008)
Borsci, S., Federici, S., Lauriola, M.: On the dimensionality of the System Usability Scale: a test of alternative measurement models, no. July (2009)
Borsci, S., Federici, S., Bacci, S., Gnaldi, M., Bartolucci, F.: Assessing user satisfaction in the era of user experience: comparison of the SUS, UMUX and UMUX - LITE as a function of product experience, no. November (2015)
Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02806-9_12
Tenório, J.M., Cohrs, F.M., Sdepanian, V.L., Pisa, I.T., Marin, H.deF.: Desenvolvimento e avaliação de um protocolo eletrônico para atendimento e monitoramento do paciente com doença celíaca. Rev. Informática teórica e Apl. 17(2), 210–220 (2010)
Boucinha, R.M., Tarouco, L.M.R.: Avaliaçao de ambiente virtual de aprendizagem com o uso do sus-system usability scale. RENOTE-Revista Novas Tecnol. na Educ., vol. 11, no. 3 (2013)
Lynch, K.R., Schwerha, D.J., Johanson, G.A.: Development of a weighted heuristic for website evaluation for older adults. Int. J. Hum. Comput. Interact. 29(6), 404–418 (2013)
Acknowledgements
This work is financed by FCT Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology), supported by funding from POPH/FSE.
This article reflects the views only of the author, and FCT cannot be held responsible for any use which may be made of the information contained therein.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Martins, M., Godinho, F., Gonçalves, P., Gonçalves, R. (2022). Usability and Accessibility Evaluation of the ICT Accessibility Requirements Tool Prototype. In: Antona, M., Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Novel Design Approaches and Technologies. HCII 2022. Lecture Notes in Computer Science, vol 13308. Springer, Cham. https://doi.org/10.1007/978-3-031-05028-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-05028-2_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05027-5
Online ISBN: 978-3-031-05028-2
eBook Packages: Computer ScienceComputer Science (R0)