Skip to main content

Advertisement

SpringerLink
Log in

A novel multimodal interface for improving visually impaired people’s web accessibility

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

This paper introduces a novel interface designed to help blind and visually impaired people to explore and navigate on the Web. In contrast to traditionally used assistive tools, such as screen readers and magnifiers, the new interface employs a combination of both audio and haptic features to provide spatial and navigational information to users. The haptic features are presented via a low-cost force feedback mouse allowing blind people to interact with the Web, in a similar fashion to their sighted counterparts. The audio provides navigational and textual information through the use of non-speech sounds and synthesised speech. Interacting with the multimodal interface offers a novel experience to target users, especially to those with total blindness. A series of experiments have been conducted to ascertain the usability of the interface and compare its performance to that of a traditional screen reader. Results have shown the advantages that the new multimodal interface offers blind and visually impaired people. This includes the enhanced perception of the spatial layout of Web pages, and navigation towards elements on a page. Certain issues regarding the design of the haptic and audio features raised in the evaluation are discussed and presented in terms of recommendations for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. The Web Access and Inclusion for Disabled People, A Formal Investigation conducted by the Disability Rights Commission. http://www.drc-gb.org/publicationsandreports/report.asp

  2. Hakkinen M, Dewitt J (1996) WebSpeak: user interface design of an accessible web browser. White Paper, The Productivity Works Inc., NJ

  3. Zajicek M, Powell C, Reeves C (1998) A web navigation tool for the blind. In: Proceedings of the 3rd ACM/SIGAPH on assistive technologies, pp 204–206

  4. Donker H, Klante P, Gorny P (2002) The design of auditory user interfaces for blind users. In: Proceedings Nordichi, pp 149–156

  5. Goose S, Moller C (1998) A 3D audio only interactive web browser: using spatialization to convey hypermedia document structure. In: Proceedings of the 7th ACM international conference on multimedia, pp 363–371

  6. Roth P, Petrucci LS, Assimacopoulos A, Pun T (2000) Audio-haptic internet browser and associated tools for blind users and visually impaired computer users. Workshop on friendly exchanging through the net, pp 57–62

  7. Betacom ScreenRover. http://www.elkshelp.org/screenrover.html

  8. Ramstein C, Martial O, Dufresne A, Carignan M, Chassé P, Mabilleau P (1996) Touching and hearing GUI’s: design issues for the PC-Access system. Proc Assist Technol 2–9

  9. Brewster SA (2001) The impact of Haptic ‘Touching’ technology on cultural applications. In: Proceedings of the electronic imaging and the visual arts, pp 1–14

  10. Yu W, Reid D, Brewster SA (2002) Web-based multi-modal graphs for visually impaired people. In: Proceedings of the 1st Cambridge Workshop on Universal Access and Assistive Technology, pp 97–108

  11. Parente P, Bishop G (2003) BATS: The blind audio tactile mapping system. In: Proceedings of the ACMSE, Savannah, GA

  12. IFeelPixel: Haptics & Sonification http://www.ifeelpixel.com/faq/#whatitwill

  13. Caffrey A, McCrindle R (2004) Developing a multimodal web application. In: Proceedings of the 5th international conference disability virtual reality and associated technologies, pp 165–172

  14. Lahav O, Mioduser D (2000) Multisensory virtual environment for supporting blind persons’ acquisition of spatial cognitive mapping, orientation and mobility skills. In: Proceedings of the 3rd international conference disability virtual reality and associated technologies, pp 53–58

  15. Jansson G, Monaci L (2005) Haptic identification of objects with different numbers of fingers. In: Ballesteros S, Heller MA (eds) Touch, blindness and neuroscience. UNED Press, Madrid

    Google Scholar 

  16. Sharmin S, Evreinov G, Raisamo R (2005) Non-visual feedback cues for pen computing. In: Proceedings of the World Haptics, pp 625–628

  17. Internet Explorer. http://www.microsoft.com/windows/ie

  18. Mozilla Firefox. http://www.mozilla.org

  19. Web Content Accessibility Guidelines 1.0. http://www.w3.org/TR/WAI-WEBCONTENT

  20. DOM: Document Object Model. http://www.w3.org/DOM/

  21. Turner D, Oeschger I (2003) Creating XPCom components, Open Source

  22. Maclean K (1999) Application-centered Haptic interface design. In: Srinivasan M, Cutkosky M (eds) Human and machine haptics. MIT Press, MA

    Google Scholar 

  23. Representations of Visual Geo-Spatial Information. http://cnice.utoronto.ca/guidelines/geospatial.php

  24. Microsoft Speech SDK. http://www.microsoft.com/speech/download/sdk51

  25. Stevens RD, Edwards AN (1996) An approach to the evaluation of assistive technology. In: Proceedings of the 2nd annual ACM conference on assistive technologies, pp 64–71

  26. Yu W, Ramloll R, Brewster S, Riedel B (2001) Exploring computer-generated line graphs through virtual touch. In: Proceedings of the 6th international symposium on signal processing and its applications, pp 72–75

  27. Freedom Scientific JAWS 5.0 Software. http://www.freedomscientific.com/fs_products/software_jawsinfo.asp

  28. JAWS commands help guide. Freedom Scientific Software

Download references

Author information

Authors and Affiliations

  1. Queen’s University of Belfast, University Road, BT7 1NN, Belfast, Northern Ireland, UK

    Wai Yu, Ravi Kuber, Emma Murphy, Philip Strain & Graham McAllister

Authors
  1. Wai Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ravi Kuber
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emma Murphy
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Philip Strain
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Graham McAllister
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wai Yu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yu, W., Kuber, R., Murphy, E. et al. A novel multimodal interface for improving visually impaired people’s web accessibility. Virtual Reality 9, 133–148 (2006). https://doi.org/10.1007/s10055-005-0009-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-005-0009-z

Keywords

Search

Navigation