Syed Masum Billah
Shirin Feiz
ABSTRACT
Filling out printed forms (e.g., checks) independently is currently impossible for blind people, since they cannot pinpoint the locations of the form fields, and quite often, they cannot even figure out what fields (e.g., name) are present in the form. Hence, they always depend on sighted people to write on their behalf, and help them affix their signatures. Extant assistive technologies have exclusively focused on reading, with no support for writing. In this paper, we introduce WiYG, a Write-it-Yourself guide that directs a blind user to the different form fields, so that she can independently fill out these fields without seeking assistance from a sighted person. WiYG uses a pocket-sized custom 3D printed smartphone attachment, and well-established computer vision algorithms to dynamically generate audio instructions that guide the user to the different form fields. A user study with 13 blind participants showed that with WiYG, users could correctly fill out form fields at right locations with an accuracy as high as 89.5%.
- S. Feiz, S. M. Billah, V. Ashok, R. Shilkrot, and I. Ramakrishnan, "Towards Enabling Blind People to Independently Fill out Paper Forms," in The 2019 CHI Conference on Human Factors in Computing Systems, 2019.(to appear) Google Scholar
Digital Library
- NFB. (2018). Statistical Facts about Blindness in the United States. Available: http://www.nfb.org/Google Scholar
- (2018). KURZWEIL 1000 FOR WINDOWS. Available: https://www.kurzweiledu.com/products/kurzweil-1000-v14-windows.htmlGoogle Scholar
- (2018). KNFB Reader. Available: https://knfbreader.comGoogle Scholar
- (2018). Microsoft AI. https://www.microsoft.com/enus/seeing-ai/Google Scholar
- AppleVis. (2018). text detective. https://www.applevis.com/apps/ios/utilities/text-detectiveGoogle Scholar
- R. Shilkrot, J. Huber, W. Meng Ee, P. Maes, and S. C. Nanayakkara, "FingerReader: a wearable device to explore printed text on the go," in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015, pp. 2363--2372: ACM. Google ScholarDigital Library
- Orcam. (2018). Available: www.orcam.com/en/myeye/Google Scholar
- L. Stearns et al., "Evaluating haptic and auditory directional guidance to assist blind people in reading printed text using finger-mounted cameras," ACM Transactions on Accessible Computing (TACCESS), vol. 9, no. 1, p. 1, 2016. Google ScholarDigital Library
- C. Jayant, H. Ji, S. White, and J. P. Bigham, "Supporting blind photography," in The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, 2011, pp. 203--210: ACM. Google ScholarDigital Library
- R. Manduchi and J. M. Coughlan, "The last meter: blind visual guidance to a target," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2014, pp. 3113--3122: ACM. Google ScholarDigital Library
- M. Vázquez and A. Steinfeld, "An assisted photography framework to help visually impaired users properly aim a camera," ACM Transactions on Computer-Human Interaction (TOCHI), vol. 21, no. 5, p. 25, 2014. Google ScholarDigital Library
- S. K. Kane, B. Frey, and J. O. Wobbrock, "Access lens: a gesture-based screen reader for real-world documents," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2013, pp. 347--350: ACM. Google ScholarDigital Library
- Y. Borodin, J. P. Bigham, G. Dausch, and I. Ramakrishnan, "More than meets the eye: a survey of screen-reader browsing strategies," in Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A), 2010, p. 13: ACM. Google ScholarDigital Library
- S. Garrido-Jurado, R. Muñoz-Salinas, F. J. Madrid-Cuevas, and M. J. Marín-Jiménez, "Automatic generation and detection of highly reliable fiducial markers under occlusion," Pattern Recognition, vol. 47, no. 6, pp. 2280--2292, 2014. Google ScholarDigital Library
Index Terms
- Write-it-Yourself: Empowering Blind People to Independently Fill-out Paper Forms
Recommendations
Towards Enabling Blind People to Independently Write on Printed Forms
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsFilling out printed forms (e.g., checks) independently is currently impossible for blind people, since they cannot pinpoint the locations of the form fields, and quite often, they cannot even figure out what fields (e.g., name) are present in the form. ...
Comparison of reading performance on screen and on paper: A meta-analysis
AbstractThis meta-analysis looked at 17 studies which focused on the comparison of reading on screen and reading on paper in terms of reading comprehension and reading speed. The robust variance estimation (RVE)- based meta-analysis models ...
Highlights- Reading on paper is better than reading on screen in terms of reading comprehension.
Survey design for visually impaired and blind people
UAHCI'07: Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversityThis paper presents guidelines for the design of self-administered surveys for visually impaired and blind people within a mixed mode approach. The different needs of the target group are fulfilled by offering different modes of participation (paper-...
Comments