research-article

Fona: Quantitative Metric to Measure Focus Navigation on Rich Internet Applications

Authors:

Willian Massami Watanabe,

Ana Luiza Dias,

Renata Pontin De Mattos FortesAuthors Info & Claims

ACM Transactions on the Web (TWEB), Volume 9, Issue 4

Article No.: 20, Pages 1 - 28

https://doi.org/10.1145/2812812

Published: 24 September 2015 Publication History

Abstract

The Web 2.0 brought new requirements to the architecture of web systems. Web applications’ interfaces are becoming more and more interactive. However, these changes are severely impacting how disabled users interact through assistive technologies with the web. In order to deploy an accessible web application, developers can use WAI-ARIA to design an accessible web application, which manually implements focus and keyboard navigation mechanisms. This article presents a quantitative metric, named Fona, which measures how the Focus Navigation WAI-ARIA requirement has been implemented on the web. Fona counts JavaScript mouse event listeners, HTML elements with role attributes, and TabIndex attributes in the DOM structure of webpages. Fona’s evaluation approach provides a narrow analysis of one single accessibility requirement. But it enables monitoring this accessibility requirement in a large number of webpages. This monitoring activity might be used to give insights about how Focus Navigation and ARIA requirements have been considered by web development teams. Fona is validated comparing the results of a set of WAI-ARIA conformant implementations and a set of webpages formed by Alexa’s 349 top most popular websites. The analysis of Fona’s value for Alexa’s websites highlights that many websites still lack the implementation of Focus Navigation through their JavaScript interactive content.

References

[1]

Christian Bühler, Helmut Heck, Olaf Perlick, Annika Nietzio, and Nils Ulltveit-Moe. 2006. Interpreting results from large scale automatic evaluation of web accessibility. In Proceedings of the 10th International Conference on Computers Helping People with Special Needs (ICCHP’06). Springer-Verlag, Berlin, 184--191.

Digital Library

[2]

Michael Cooper. 2007. Accessibility of emerging rich web technologies: Web 2.0 and the semantic web. In Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A’07). ACM, New York, NY, 93--98.

Digital Library

[3]

Iyad Abu Doush, Faisal Alkhateeb, Eslam Al Maghayreh, and Mohammed Azmi Al-Betar. 2013. The design of RIA accessibility evaluation tool. Ad. Eng. Software 57 (2013), 1--7.

Digital Library

[4]

Nádia Fernandes, Daniel Costa, Sergio Neves, Carlos Duarte, and Luís Carriço. 2012. Evaluating the accessibility of rich internet applications. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A’12). ACM, New York, NY, Article 13, 4 pages.

Digital Library

[5]

Nádia Fernandes, Rui Lopes, and Luís Carriço. 2011. On web accessibility evaluation environments. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A’11). ACM, New York, NY, Article 4, 10 pages.

Digital Library

[6]

Piero Fraternali, Sara Comai, Alessandro Bozzon, and Giovanni Toffetti Carughi. 2010. Engineering rich internet applications with a model-driven approach. ACM Trans. Web 4, 2 (2010), 1--47.

Digital Library

[7]

André P. Freire, Thiago J. Bittar, and Renata P. M. Fortes. 2008a. An approach based on metrics for monitoring web accessibility in Brazilian municipalities web sites. In Proceedings of the 2008 ACM Symposium on Applied Computing (SAC’08). ACM, New York, NY, 2421--2425.

Digital Library

[8]

André P. Freire, Renata P. M. Fortes, Marcelo A. S. Turine, and Debora M. B. Paiva. 2008b. An evaluation of web accessibility metrics based on their attributes. In Proceedings of the 26th Annual ACM International Conference on Design of Communication (SIGDOC’08). ACM, New York, NY, 73--80.

Digital Library

[9]

Andre Pimenta Freire, Rudinei Goularte, and Renata Pontin M. Fortes. 2007. Techniques for developing more accessible web applications: A survey towards a process classification. In Proceedings of the 25th Annual ACM International Conference on Design of Communication (SIGDOC’07). ACM, New York, NY, 162--169.

Digital Library

[10]

Andre P. Freire, Christopher Power, Helen Petrie, Eduardo H. Tanaka, Heloisa V. Rocha, and Renata P. Fortes. 2009. Web accessibility metrics: Effects of different computational approaches. In Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services (UAHCI’09). Springer-Verlag, Berlin, 664--673.

Digital Library

[11]

André Pimenta Freire, Cibele Maria Russo, and Renata Pontin de Mattos Fortes. 2008. The perception of accessibility in web development by academy, industry and government: A survey of the Brazilian scenario. New Rev. Hypermedia Multimedia 14, 2 (December 2008), 149--175.

Digital Library

[12]

Jesse James Garrett. 2005. Ajax: A New Approach to Web Applications. (February 2005). http://adaptivepath.com/ideas/essays/archives/000385.php.

[13]

Becky Gibson. 2007. Enabling an accessible Web 2.0. In Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A’07). ACM, New York, NY, 1--6.

Digital Library

[14]

Becky Gibson and Richard Schwerdtfeger. 2005. DHTML accessibility: Solving the JavaScript accessibility problem. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets’05). ACM, New York, NY, 202--203.

Digital Library

[15]

Tanya Goette, Caroline Collier, and Jennifer Daniels White. 2006. An exploratory study of the accessibility of state government web sites. Univers. Access Inf. Soc. 5, 1 (July 2006), 41--50.

Digital Library

[16]

Vicki L. Hanson and John T. Richards. 2013. Progress on website accessibility? ACM Trans. Web 7, 1, Article 2 (March 2013), 30 pages.

Digital Library

[17]

IEEE. 1990. IEEE Standard Glossary of Software Engineering Terminology. Technical Report. IEEE. 1+ pages.

[18]

Andrew Meneely, Ben Smith, and Laurie Williams. 2013. Validating software metrics: A spectrum of philosophies. ACM Trans. Softw. Eng. Methodol. 21, 4, Article 24 (Feb. 2013), 28 pages.

Digital Library

[19]

Ethan V. Munson and Maria da Graça Pimentel. 2008. Specialized documents. In Web Accessibility (Human-Computer Interaction Series), Vol. 4. Springer, London, 274--285.

[20]

Bambang Parmanto and Xiaoming Zeng. 2005. Metric for web accessibility evaluation. J. Am. Soc. Inf. Sci. Technol. 56, 13 (Nov. 2005), 1394--1404.

Digital Library

[21]

Loretta Guarino Reid and Andi Snow-Weaver. 2008. WCAG 2.0: A web accessibility standard for the evolving web. In Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A’08). ACM, New York, NY, 109--115.

Digital Library

[22]

Terry Sullivan and Rebecca Matson. 2000. Barriers to use: Usability and content accessibility on the web’s most popular sites. In Proceedings on the 2000 Conference on Universal Usability (CUU’00). ACM, New York, NY, 139--144.

Digital Library

[23]

Takaaki Tateishi, Hisashi Miyashita, Tabuchi Naoshi, Shin Saito, and Kouichi Ono. 2007. DHTML accessibility checking based on static javascript analysis. In Universal Access in Human-Computer Interaction. Applications and Services, Constantine Stephanidis (Ed.). Lecture Notes in Computer Science, Vol. 4556. Springer, Berlin, 167--176.

Digital Library

[24]

Peter Thiessen and Stephen Hockema. 2010. WAI-ARIA live regions: Ebuddy IM as a case example. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A’10). ACM, New York, NY, Article 33, 9 pages.

Digital Library

[25]

Carlos A. Velasco, Dimitar Denev, Dirk Stegemann, and Yehya Mohamad. 2008. A web compliance engineering framework to support the development of accessible rich internet applications. In Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A’09). ACM, New York, NY, 45--49.

Digital Library

[26]

Markel Vigo, Myriam Arrue, Giorgio Brajnik, Raffaella Lomuscio, and Julio Abascal. 2007. Quantitative metrics for measuring web accessibility. In Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A’07). ACM, New York, NY, 99--107.

Digital Library

[27]

WAB Cluster. 2006. Unified Web Evaluation Methodology (UWEM 1.0). Retrieved from http://www.wabcluster.org/uwem1/UWEM_1_0.pdf.

[28]

W3C. 1999. Web Content Accessibility Guidelines 1.0. W3C Recommendation. Retrieved from http://www.w3.org/TR/WCAG10/.

[29]

W3C. 2008. Web Content Accessibility Guidelines (WCAG) 2.0. W3C Recommendation. Retrieved from http://www.w3.org/TR/WCAG20/.

[30]

W3C. 2013. WAI-ARIA 1.0 Authoring Practices - An author’s guide to understanding and implementing Accessible Rich Internet Applications. W3C Working Draft. Retrieved from http://www.w3.org/TR/wai-aria-practices/.

[31]

W3C. 2014a. Accessible Rich Internet Applications (WAI-ARIA) 1.0. W3C Recommendation. Retrieved from http://www.w3.org/TR/wai-aria/.

[32]

W3C. 2014b. HTML5 - A vocabulary and associated APIs from HTML and XHTML. W3C Recommendation. Retrieved from http://www.w3.org/TR/html5/.

[33]

Willian Massami Watanabe, Renata P. M. Fortes, and Ana Luiza Dias. 2012. Using acceptance tests to validate accessibility requirements in RIA. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A’12). ACM, New York, NY, Article 15, 10 pages.

Digital Library

[34]

Willian Massami Watanabe, David Fernandes Neto, Thiago Jabur Bittar, and Renata P. M. Fortes. 2010. WCAG conformance approach based on model-driven development and WebML. In Proceedings of the 28th ACM International Conference on Design of Communication (SIGDOC’10). ACM, New York, NY, 167--174.

Digital Library

Cited By

Watanabe Wde Lemos GNascimento R(2024)Accessibility landmarks identification in web applications based on DOM elements classificationUniversal Access in the Information Society10.1007/s10209-022-00959-823:2(765-777)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s10209-022-00959-8
Onay Durdu PSoydemir Ö(2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7848-3.ch004
Teran LSilva AMelo GMota M(2021)Intelligent Approaches in the Software Development Process: a Systematic Literature MappingProceedings of the X Latin American Conference on Human Computer Interaction10.1145/3488392.3488397(1-5)Online publication date: 22-Nov-2021
https://dl.acm.org/doi/10.1145/3488392.3488397
Show More Cited By

Index Terms

Fona: Quantitative Metric to Measure Focus Navigation on Rich Internet Applications
1. Hardware

Recommendations

Keyboard navigation mechanisms in tab widgets: an investigation on ARIA's conformance
SAC '14: Proceedings of the 29th Annual ACM Symposium on Applied Computing

This study presents an investigation on how keyboard accessibility has been delivered in RIA - Rich Internet Applications. We conducted an evaluation on 32 websites which contained Tab Widgets, from the 150 websites of Alexa's top most accessed websites ...
Keyboard navigation mechanisms in widgets: an investigation on aria's implementations

This study presents an investigation on how keyboard accessibility has been delivered in RIA - Rich Internet Applications. We conducted an evaluation on 32 websites which contained Tab Widgets and 74 websites which contained Menu Widgets, from the 150 ...
Acceptance tests for validating ARIA requirements in widgets
Abstract
Accessibility refers to a quality requirement for web applications. However, current accessibility automatic evaluation tools cannot evaluate dynamic generated content that characterizes Ajax applications and RIAs. In this context, this paper ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on the Web

ACM Transactions on the Web Volume 9, Issue 4

October 2015

114 pages

ISSN:1559-1131

EISSN:1559-114X

DOI:10.1145/2830542

Editors:
Brian D. Davison
Lehigh University, USA
,
Marianne Winslett
University of Illinois at Urbana-Champaign

Issue’s Table of Contents

Copyright © 2015 ACM.

© 2015 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 September 2015

Accepted: 01 August 2015

Revised: 01 July 2015

Received: 01 January 2014

Published in TWEB Volume 9, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

ICMC-USP (Instituto de Ciências Matemáticas e de Computação - Universidade de São Paulo)
UTFPR (Universidade Tecnológica Federal do Paraná)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Watanabe Wde Lemos GNascimento R(2024)Accessibility landmarks identification in web applications based on DOM elements classificationUniversal Access in the Information Society10.1007/s10209-022-00959-823:2(765-777)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s10209-022-00959-8
Onay Durdu PSoydemir Ö(2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
https://doi.org/10.4018/978-1-7998-7848-3.ch004
Teran LSilva AMelo GMota M(2021)Intelligent Approaches in the Software Development Process: a Systematic Literature MappingProceedings of the X Latin American Conference on Human Computer Interaction10.1145/3488392.3488397(1-5)Online publication date: 22-Nov-2021
https://dl.acm.org/doi/10.1145/3488392.3488397
Watanabe Wde Lemos GAntonelli Hde Mattos Fortes RSilva GPereira Ada Rocha L(2021)Code Complexity Impact of Widgets Accessibility Implementation in JavaScript Open-Source LibrariesProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3470482.3479613(9-16)Online publication date: 5-Nov-2021
https://dl.acm.org/doi/10.1145/3470482.3479613
Chiou PAlotaibi AHalfond WSpinellis DGousios GChechik MDi Penta M(2021)Detecting and localizing keyboard accessibility failures in web applicationsProceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3468264.3468581(855-867)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3468264.3468581
García-Mireles GMoreno-Soto I(2020)Accessifier: A Plug-in to Verify Accessibility Requirements for Web WidgetsNew Perspectives in Software Engineering10.1007/978-3-030-63329-5_23(337-348)Online publication date: 7-Nov-2020
https://doi.org/10.1007/978-3-030-63329-5_23
de Mattos Fortes RAntonelli HWatanabe W(2019)Dynamic Web ContentWeb Accessibility10.1007/978-1-4471-7440-0_21(373-395)Online publication date: 4-Jun-2019
https://doi.org/10.1007/978-1-4471-7440-0_21
Antonelli HIgawa RFortes RRizo EWatanabe W(2018)Drop-Down Menu Widget Identification Using HTML Structure Changes ClassificationACM Transactions on Accessible Computing10.1145/317885411:2(1-23)Online publication date: 8-Jun-2018
https://dl.acm.org/doi/10.1145/3178854

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents