skip to main content
10.1145/2700648.2809865acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision

Published: 26 October 2015 Publication History

Abstract

Most low vision people have functional vision and would likely prefer to use their vision to access information. Recently, there have been advances in head-mounted displays, cameras, and image processing technology that create opportunities to improve the visual experience for low vision people. In this paper, we present ForeSee, a head-mounted vision enhancement system with five enhancement methods: Magnification, Contrast Enhancement, Edge Enhancement, Black/White Reversal, and Text Extraction; in two display modes: Full and Window. ForeSee enables users to customize their visual experience by selecting, adjusting, and combining different enhancement methods and display modes in real time. We evaluated ForeSee by conducting a study with 19 low vision participants who performed near- and far-distance viewing tasks. We found that participants had different preferences for enhancement methods and display modes when performing different tasks. The Magnification Enhancement Method and the Window Display Mode were popular choices, but most participants felt that combining several methods produced the best results. The ability to customize the system was key to enabling people with a variety of different vision abilities to improve their visual experience.

References

[1]
AI Squared, ZoomText, http://www.aisquared.com/zoomtext.
[2]
American Optometric Association. What Causes Low Vision. http://www.aoa.org/patients-and-public/caring-for-your-vision/low-vision/what-causes-low-vision--sso=y. Accessed May 4, 2015.
[3]
Android Accessibility Help: Magnification Gestures, https://support.google.com/accessibility/android/answer/6006949--hl=en. Accessed May 3, 2015.
[4]
Apple, iOS Accessibility, https://www.apple.com/accessibility/ios/
[5]
Apple, OSX Accessibility, https://www.apple.com/accessibility/osx/
[6]
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355--385.
[7]
Burnard, P. (1991). A method of analysing interview transcripts in qualitative research. Nurse education today, 11(6), 461--466.
[8]
Canny, J. (1986). A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, (6), 679--698.
[9]
Center for Disease Control (CDC), Summary Health Statistics for the U.S. Population: National Health Interview Survey, 2004. http://www.cdc.gov/nchs/data/series/sr_10/sr10_229.pdf. Accessed May 3, 2015.
[10]
Cimarolli, V. R., Boerner, K., Brennan-Ing, M., Reinhardt, J. P., & Horowitz, A. (2012). Challenges faced by older adults with vision loss: a qualitative study with implications for rehabilitation. Clinical rehabilitation, 26(8), 748--757.
[11]
Dakopoulos, D., & Bourbakis, N. G. (2010). Wearable obstacle avoidance electronic travel aids for blind: a survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 40(1), 25--35.
[12]
Dougherty, B. E., Kehler, K. B., Jamara, R., Patterson, N., Valenti, D., & Vera-Diaz, F. A. (2011). Abandonment of low vision devices in an outpatient population. Optometry and vision science: official publication of the American Academy of Optometry, 88(11), 1283.
[13]
Epson Moverio Smart Glasses, http://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smart-glasses.do--ref=van_moverio_2014
[14]
eSight, http://www.orcam.com/
[15]
Everingham, M. R., Thomas, B. T., and Troscianko, T. (1999). Head-mounted mobility aid for low vision using scene classification techniques. The International Journal of Virtual Reality, 3(4), 3.
[16]
Findlater, L., & McGrenere, J. (2004, April). A comparison of static, adaptive, and adaptable menus. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 89--96). ACM.
[17]
Freedom Scientific: MAGic Screen Magnification Software, http://www.freedomscientific.com/Products/LowVision/MAGic
[18]
Google Glass, https://support.google.com/glass#topic=4363345
[19]
Harper, R., Culham, L., & Dickinson, C. (1999). Head mounted video magnification devices for low vision rehabilitation: a comparison with existing technology. British journal of ophthalmology, 83(4), 495--500.
[20]
Hicks, S. L., Wilson, I., Muhammed, L., Worsfold, J., Downes, S. M., & Kennard, C. (2013). A depth-based head-mounted visual display to aid navigation in partially sighted individuals. PloS one, 8(7), e67695.
[21]
Hwang, A. D., & Peli, E. (2014). An augmented-reality edge enhancement application for Google Glass. Optometry & Vision Science, 91(8), 1021--1030.
[22]
Jacko, J. A., & Sears, A. (1998, January). Designing interfaces for an overlooked user group: considering the visual profiles of partially sighted users. In Proceedings of the third international ACM conference on Assistive technologies (pp. 75--77). ACM.
[23]
Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008, October). Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (pp. 73--80). ACM.
[24]
Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. (2009, October). Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility (pp. 115--122). ACM.
[25]
Low Vision Center: Closed Circuit Television, http://www.lowvisioninfo.org/hightech.htm
[26]
Luo, G., & Peli, E. (2006). Use of an augmented-vision device for visual search by patients with tunnel vision. Investigative ophthalmology & visual science,47(9), 4152--4159.
[27]
Merino-Gracia, C., Lenc, K., & Mirmehdi, M. (2012). A head-mounted device for recognizing text in natural scenes. In Camera-Based Document Analysis and Recognition (pp. 29--41). Springer Berlin Heidelberg.
[28]
Microsoft HoloLens, https://www.microsoft.com/microsoft-hololens/en-us
[29]
Microsoft, Make Items on the Screen Appear Bigger (Magnifier), http://windows.microsoft.com/enus/windows/make-screen-items-bigger-magnifier#1TC=windows-7
[30]
Moore, J. E., & LeJeune, B. J. (2008). Low vision. International Encyclopedia of Rehabilitation. Retrieved from http://cirrie.buffalo.edu/encyclopedia/article
[31]
National Federation of the Blind: Blindness and Low Vision, https://nfb.org/fact-sheet-blindness-and-low-vision
[32]
Neumann, L., & Matas, J. (2012, June). Real-time scene text localization and recognition. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on (pp. 3538--3545). IEEE.
[33]
Oculus VR, https://www.oculus.com/
[34]
OpenCV, http://opencv.org/
[35]
OrCam, http://www.orcam.com/
[36]
Otsu, N. (1979). A threshold selection method from gray-level histogram. IEEE Trans. Systems Man Cybernet, 9(1979), pp. 62--66.
[37]
Peli, E. (1999). Simple 1-D image enhancement for head-mounted low vision aid. Visual Impairment Research, 1(1), 3--10.
[38]
Peli, E., Luo, G., Bowers, A., & Rensing, N. (2007). Applications of augmented-vision head-mounted systems in vision rehabilitation. Journal of the Society for Information Display, 15(12), 1037--1045.
[39]
Peli, E., Luo, G., Bowers, A., & Rensing, N. (2009). Development and evaluation of vision multiplexing devices for vision impairments. International Journal on Artificial Intelligence Tools, 18(03), 365--378.
[40]
Peli, E., & Woods, R. L. (2009). Image enhancement for impaired vision: the challenge of evaluation. International Journal on Artificial Intelligence Tools,18(03), 415--438.
[41]
Pelli, D. G. (2008). Crowding: A cortical constraint on object recognition. Current opinion in neurobiology, 18(4), 445--45
[42]
Phillips, B. and Zhao, H. (1993). Predictors of assistive technology abandonment. Assistive Technology 5 (1), 36--45.
[43]
Riemer-Reiss, M.L. and Wacker, R.R. (2000). Factors associated with assistive technology discontinuance among individuals with disabilities. Journal of Rehabilitation 66 (3), 44--50.
[44]
Samsung Gear VR, http://www.samsung.com/global/microsite/gearvr/
[45]
Satgunam, P., Woods, R. L., Luo, G., Bronstad, P. M., Reynolds, Z., Ramachandra, C., ... & Peli, E. (2012). Effects of contour enhancement on low-vision preference and visual search. Optometry and vision science: official publication of the American Academy of Optometry, 89(9), E1364.
[46]
Scherer, M. J. (1996). Outcomes of assistive technology use on quality of life.Disability & Rehabilitation, 18(9), 439--448.
[47]
Sony Wearable HDTV, http://store.sony.com/wearable-hdtv-2d-3d-virtual-7.1-surround-sound-zid27-HMZT3W/cat-27-catid-3D-Personal-Viewer
[48]
Stephanidis, C., Akoumianakis, D., & Savidis, A. (1995). Design representations and development support for user interface adaptation. Institute of Computer Science Foundation for Research and Technology.
[49]
Szeliski, R. (2010). Computer vision: algorithms and applications. Springer Science & Business Media.
[50]
Tanuwidjaja, E., Huynh, D., Koa, K., Nguyen, C., Shao, C., Torbett, P., ... & Weibel, N. (2014, September). Chroma: A wearable augmented-reality solution for color blindness. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 799--810). ACM.
[51]
Tesseract-OCR, https://code.google.com/p/tesseract-ocr/
[52]
Vargas-Martin, F., & Peli, E. (2002). Augmented-view for restricted visual field: multiple device implementations. Optometry & Vision Science, 79(11), 715--723
[53]
Wood, M. (2015). Video Feature: Signs That Virtual Reality Is on the Verge of Taking Off. New York Time. http://www.nytimes.com/2015/01/29/technology/personaltech/video-feature-signs-that-virtual-reality-is-on-the-verge-of-taking-off.html Accessed on Jan, 28, 2015
[54]
Yu, W., Kangas, K., & Brewster, S. (2003, March). Web-based haptic applications for blind people to create virtual graphs. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings. 11th Symposium on (pp. 318--325). IEEE.

Cited By

View all
  • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
  • (2024)WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement StimulationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595928:2(1-32)Online publication date: 15-May-2024
  • (2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility
October 2015
466 pages
ISBN:9781450334006
DOI:10.1145/2700648
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. augmented reality glasses
  3. vision customization
  4. visual impairment

Qualifiers

  • Research-article

Conference

ASSETS '15
Sponsor:

Acceptance Rates

ASSETS '15 Paper Acceptance Rate 30 of 127 submissions, 24%;
Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

ASSETS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)180
  • Downloads (Last 6 weeks)19
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Vision-Based Assistive Technologies for People with Cerebral Visual Impairment: A Review and Focus StudyProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675637(1-20)Online publication date: 27-Oct-2024
  • (2024)WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement StimulationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595928:2(1-32)Online publication date: 15-May-2024
  • (2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
  • (2024)Accessible Gesture Typing on Smartphones for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676447(1-11)Online publication date: 13-Oct-2024
  • (2024)WorldScribe: Towards Context-Aware Live Visual DescriptionsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676375(1-18)Online publication date: 13-Oct-2024
  • (2024)AI-Enabled Smart Glasses for People with Severe Vision ImpairmentsACM SIGACCESS Accessibility and Computing10.1145/3654768.3654771(1-1)Online publication date: 1-Jan-2024
  • (2024)Exploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception ModulationAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686642(1-3)Online publication date: 21-Sep-2024
  • (2024)Visual Noise Cancellation: Exploring Visual Discomfort and Opportunities for Vision AugmentationsACM Transactions on Computer-Human Interaction10.1145/363469931:2(1-26)Online publication date: 29-Jan-2024
  • (2024)Broadening Our View: Assistive Technology for Cerebral Visual ImpairmentExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650740(1-9)Online publication date: 11-May-2024
  • (2024)GazePrompt: Enhancing Low Vision People's Reading Experience with Gaze-Aware AugmentationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642878(1-17)Online publication date: 11-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media