skip to main content
10.1145/1878803.1878811acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

Towards a tool for keystroke level modeling of skilled screen reading

Published: 25 October 2010 Publication History

Abstract

Designers often have no access to individuals who use screen reading software, and may have little understanding of how their design choices impact these users. We explore here whether cog-nitive models of auditory interaction could provide insight into screen reader usability. By comparing human data with a tool-generated model of a practiced task performed using a screen reader, we identify several requirements for such models and tools. Most important is the need to represent parallel execution of hearing with thinking and acting. Rules for placement of cogni-tive operators that were developed for visual user interfaces may not be applicable in the auditory domain. Other mismatches be-tween the data and the model were attributed to the extremely fast listening rate and differences between the typing patterns of screen reader usage and the model's assumptions. This work in-forms the development of more accurate models of auditory inter-action. Tools incorporating such models could help designers create user interfaces that are well tuned for screen reader users, without the need for modeling expertise.

References

[1]
Anderson, J. R., Bothell, D., Byrne, M. D., Douglass, S., Lebiere, C., Qin, Y. 2004 An Integrated Theory of the Mind. Psychological Review, 111(4) 1036--1060.
[2]
Asakawa, C., Takagi, H., Ino, S., and Ifukube, T. 2003. Maximum listening speeds for the blind. In International Community for Auditory Display 2003, 276--279.
[3]
Bigham, J., Cavender, A., Brudvik, J., Wobbrock, J., Ladner, R. 2007. WebinSitu: A comparative analysis of blind and sighted browsing behavior. In Proceedings of the 9th ACM SIGACCESS Conference on Computers and Accessibility (Tempe, USA, October, 2007). ASSETS '07. ACM, New York, NY, 51--58.
[4]
Biswas, P. and Robinson, P. 2008. Automatic evaluation of assistive interfaces. In Proceedings of Intelligent User Inter-faces (Maspalomas, Spain, January 13--16, 2008). IUI '08. ACM, New York, NY, 247--256.
[5]
Biswas, P. and Robinson, P. 2010. Evaluating the design of inclusive interfaces by simulation. In Proceedings of Intelli-gent User Interfaces (Hong Kong, China). IUI'10. 277--280.
[6]
Borodin, Y., Bigham, J., Dausch, G. and Ramakrishnan, I. 2010. More than meets the eye: A survey of screen-reader browsing strategies. In Proceedings of W4A 2010 (Raleigh, USA, April 26--27, 2010). ACM, New York.
[7]
Card, S. K., Moran, T.P. and Newell, A. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum As-sociates, Hillsdale, NJ, USA.
[8]
Disability Rights Commission. The Web: Access and Inclu-sion for Disabled People. Disability Rights Commission, London, UK, 2004.
[9]
John, B. E. 1994. Toward a deeper comparison of methods: A reaction to Nielsen and Phillips and new data. Proceedings Companion of CHI 1994, ACM Press, 285--286.
[10]
John, B. E. 2003. Information processing and skilled behav-ior. In J. M. Carroll, (Ed.), Toward a multidisciplinary sci-ence of human computer interaction. Morgan Kaufman.
[11]
John, B.E. 17 September 2009. CogTool User Guide (Version 1.1). Retrieved from http://cogtool.hcii.cs.cmu.edu/use-today/download-cogtool-and-its-user-guide
[12]
John, B. E. 2010. Reducing the variability between novice modelers: Results of a tool for human performance modeling produced through Human-Centered Design. Proceedings of the 19th Annual Conference on Behavior Representation in Modeling and Simulation (BRIMS) (Charleston, SC, March 22--25, 2010).
[13]
John, B. E., Blackmon, M. H., Polson, P. G., Fennell, K., and Teo, L. 2009. Rapid theory prototyping: An example of an aviation task. Proceedings of the Human Factors and Ergo-nomics Society 53rd Annual Meeting (San Antonio, Texas, October 19--23, 2009).
[14]
John, B. E., Prevas, K., Salvucci, D. D., Koedinger, K. 2004. Predictive human performance modeling made easy. In Pro-ceedings of the International Conference on Human Factors in Computing Systems, CHI '04, ACM, New York, NY. 455--462.
[15]
John, B. E. & Salvucci, D. D. (2005) Multi-Purpose Prototypes for Assessing User Interfaces in Pervasive Computing Systems. IEEE Pervasive Computing 4(4), 27--34
[16]
Luo, L., John, B. E. 2005. Predicting task execution time on handheld devices using the Keystroke-Level Model. In Proceedings of the International Conference on Human Factors in Computing Systems, CHI'05. ACM, New York, NY. 1605--1608.
[17]
Max-Planck-Institute for Pyscholinguistics, Nijmejgen, The Netherlands. (2009). ELAN Linguistic Annotator (Version 3.8.0) {Software}. Available from http://www.lat-mpi.eu/tools/elan/
[18]
Moos, A. and Trouvain, J. 2007. Comprehension of ultra-fast speech -- blind vs. "normally hearing" persons. In Proceedings of the 16th International Congress of Phonetic Sciences: 677--680.
[19]
Petrie, H., Hamilton, F., King, N. and Pavan, P. 2006. Re-mote usability evaluations with disabled people. In Proceed-ings of the International Conference on Human Factors in Computing Systems, CHI'06. ACM, New York, NY. 1133--1141.
[20]
Richards, J., Bellamy, R., John, B., Swart, C., John Thomas, J. Using CogTool to model programming tasks Psychology of Programming Interest Group: Work in Progress Workshop, Dundee Scotland, January 7--8, 2010.
[21]
Schrepp, M. 2010. GOMS analysis as a tool to investigate the usability of web units for disabled users. Universal Ac-cess in the Information Society 9, 1 (March, 2010), 77--86.
[22]
Takagi, H., Asakawa, C., Fukuda, K. and Maeda, J. 2004. Accessibility designer: visualizing usability for the blind. In Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility. ASSETS '04. ACM, New York, NY, 177--184.
[23]
Takagi, H., Saito, S., Fukada, K. and Asakawa, C. 2007. Analysis of navigability of web applications for improving blind usability. ACM Transactions on Computer-Human In-teraction (14) 3, (Sep. 2007),13.
[24]
Tonn-Eichstädt, H. 2006. Measuring website usability for visually impaired people -- a modified GOMS analysis. In Proceedings of the 8th ACM SIGACCESS Conference on Computers and Accessibility (Portland, OR, USA, Oct 22--25), ASSETS '06, ACM, NY, 55--62.
[25]
Trewin, S., Richards, J., Bellamy, R., John, B. E., Thomas, J., Swart, C., and Brezin, J. 2010. Towards modeling audi-tory information seeking strategies on the Web. In Extended Abstracts of the International Conference on Human Factors in Computing Systems, CHI'10, ACM, NY, 3973--3978.
[26]
Yesilada, Y., Stevens, R., Harper, S. and Goble, C. 2007. Evaluating DANTE: Semantic transcoding for visually disabled users. ACM Transactions on Computer-Human Inter-action (14) 3, (Sep. 2007), 14.

Cited By

View all
  • (2023)A Probabilistic Model and Metrics for Estimating Perceived Accessibility of Desktop Applications in Keystroke-Based Non-Visual InteractionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581400(1-20)Online publication date: 19-Apr-2023
  • (2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
  • (2021)What Do We Mean by “Accessibility Research”?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445412(1-18)Online publication date: 6-May-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
October 2010
346 pages
ISBN:9781605588810
DOI:10.1145/1878803
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. keyboard navigation
  3. klm
  4. screen reader
  5. usability

Qualifiers

  • Research-article

Conference

ASSETS '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

ASSETS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)A Probabilistic Model and Metrics for Estimating Perceived Accessibility of Desktop Applications in Keystroke-Based Non-Visual InteractionsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581400(1-20)Online publication date: 19-Apr-2023
  • (2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
  • (2021)What Do We Mean by “Accessibility Research”?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445412(1-18)Online publication date: 6-May-2021
  • (2019)Find and SeekACM Transactions on Accessible Computing10.1145/334228212:3(1-23)Online publication date: 31-Aug-2019
  • (2018)Comparison Between KLM Estimations and Screen Reader Times in Non-Visual InteractionProceedings of the 7th Mexican Conference on Human-Computer Interaction10.1145/3293578.3293587(1-4)Online publication date: 29-Oct-2018
  • (2018)Content-based Navigation Within Mathematical Formulae On the Web For Blind Users and Its Impact On Expected User EffortProceedings of the 8th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion10.1145/3218585.3218596(23-32)Online publication date: 20-Jun-2018
  • (2017)How Much Effort is Necessary for Blind Users to Read Web-based Mathematical Formulae?Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems10.1145/3160504.3160549(1-10)Online publication date: 23-Oct-2017
  • (2017)Blind FLM: An Enhanced Keystroke-Level Model for Visually Impaired Smartphone InteractionHuman-Computer Interaction - INTERACT 201710.1007/978-3-319-67744-6_10(155-172)Online publication date: 20-Sep-2017
  • (2017)Innovative Accessible InterfacesThe Wiley Handbook of Human Computer Interaction10.1002/9781118976005.ch32(715-730)Online publication date: 28-Dec-2017
  • (2013)Challenging information foraging theoryProceedings of the 24th ACM Conference on Hypertext and Social Media10.1145/2481492.2481499(60-68)Online publication date: 1-May-2013
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media