Skip to main content
SpringerLink
Log in

Accessible haptic user interface design approach for users with visual impairments

  • Long paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

With the number of people with visual impairments (e.g., low vision and blind) continuing to increase, vision loss has become one of the most challenging disabilities. Today, haptic technology, using an alternative sense to vision, is deemed an important component for effectively accessing information systems. The most appropriately designed assistive technology is critical for those with visual impairments to adopt assistive technology and to access information, which will facilitate their tasks in personal and professional life. However, most of the existing design approaches are inapplicable and inappropriate to such design contexts as users with visual impairments interacting with non-graphical user interfaces (i.e., haptic technology). To resolve such design challenges, the present study modified a participatory design approach (i.e., PICTIVE, Plastic Interface for Collaborative Technology Initiatives Video Exploration) to be applicable to haptic technologies, by considering the brain plasticity theory. The sense of touch is integrated into the design activity of PICTIVE. Participants with visual impairments were able to effectively engage in designing non-visual interfaces (e.g., haptic interfaces) through non-visual communication methods (e.g., touch modality).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. National Institute of Health. Vision Problems in the U.S.: Prevalence of Adult Vision Impairment and Age-Related Eye Disease in America. 2002 May 15 (2010); Available from: http://www.preventblindness.net/site/DocServer/VPUS_2008_update.pdf?docID=1561

  2. World Health Organization. Visual Impairment and Blindness. 2011 May 15 (2011); Available from: http://www.who.int/mediacentre/factsheets/fs282/en/#

  3. West, S., Sommer, A.: Prevention of blindness and priorities for the future. Bull. World Health Organ. 79(3), 244–248 (2001)

    Google Scholar 

  4. Mroczka, M.A.: Effects of Study Modality and Study Order on Learning Braille and Other Haptic Alphabets used by Blind Persons. Dissertation, North Carolina State University (2005)

  5. American Foundation for the Blind: Statistics and Sources for Professionals, 2008 [cited 2011 May 23]; Available from: http://www.afb.org/Section.asp?SectionID=44

  6. Abascal, J.: Human-computer interaction in assistive technology: from “patchwork” to “universal design”. In: International Conference on Systems, Man and Cybernetics, vol. 3, pp. 1–6 (2002)

  7. Abascal, J., Azevedo, L.: Fundamentals of inclusive HCI design. In: Proceedings of the 4th International Conference on Universal Access in Human Computer Interaction: Coping with Diversity, pp. 3–9 (2007)

  8. Wu, M., Baecker, R., Richards, B.: Participatory design of an orientation aid for amnesics. In: CHI ‘05: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 511–520 (2005)

  9. Mason, P.: The representation of disabled people: a Hampshire centre for independent living discussion paper. Disabil. Soc. 7(1), 79–84 (1992)

    Article  Google Scholar 

  10. Luck, R.: Dialogue in participatory design. Des. Stud. 24(6), 523–535 (2003)

    Article  Google Scholar 

  11. Raisamo, R.: Testing usability of multimodal applications with visually impaired children. In: Arto, H., et al. (eds.), pp. 70–76 (2006)

  12. Raisamo, R., et al.: Design and evaluation of a tactile memory game for visually impaired children. Interact. Comput. 19(2), 196–205 (2007)

    Article  Google Scholar 

  13. Sapp, W.: MySchoolDayOnline: Applying universal design principles to the development of a fully accessible online scheduling tool for students with visual impairments. J. Vis. Impair. Blindness 101(5), 301–307 (2007)

    Google Scholar 

  14. Kerr, N.H.: The role of vision in ‘visual imagery’ experiments: evidence from the congenitally blind. J. Exp. Psychol. Gen. 112(2), 265–277 (1983)

    Article  Google Scholar 

  15. Edwards, A.D.N.: Soundtrack: an auditory interface for blind users. Hum. Comput. Interact. 4(1), 45–66 (1989)

    Article  Google Scholar 

  16. Holman, J., et al.: Developing usable CAPTCHAs for blind users. In: ASSETS ‘07: Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 245–246 (2007)

  17. Plimmer, B., et al.: Multimodal collaborative handwriting training for visually-impaired people. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 393–402 (2008)

  18. Stevens, R.D., Edwards, A.D.N., Harling, P.A.: Access to mathematics for visually disabled students through multimodal interaction. Hum. Comput. Interact. 12(1), 47–92 (1997)

    Article  Google Scholar 

  19. Lindgaard, G., Caple, D.: A case study in iterative keyboard design using participatory design techniques. Appl. Ergon. 32(1), 71–80 (2001)

    Article  Google Scholar 

  20. Buhler, C.: Empowered participation of users with disabilities in R&D projects. Int. J. Hum. Comput. Stud. 55(4), 645–659 (2001)

    Article  Google Scholar 

  21. Coleman, A., Sumner, T.: Digital libraries and user needs: negotiating the future. J. Digit. Inf. 5(3) (2004); Available from: https://journals.tdl.org/jodi/article/viewArticle/119/123

  22. Wattenberg, T.L.: Online focus groups used as an accessible participatory research method. In: ASSETS ‘05: Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 180–181 (2005)

  23. Muller, M.: PICTIVE: democratizing the dynamics of the design session. In: Schuler, D., Namioka, A. (eds.) Participatory Design Principles and Practices, pp. 211–237. Lawrence Erlbaum Associates, Hillsdale, NJ (1993)

    Google Scholar 

  24. Chandrashekar, S., et al.: Using think aloud protocol with blind users: a case for inclusive usability evaluation methods. In: Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 251–252 (2006)

  25. Jones, K.S., et al.: A report on a novice user’s interaction with the Internet through a self-voicing application. J. Vis. Impair. Blind. 99(1), 40–54 (2005)

    Google Scholar 

  26. Gerber, E.: Conducting usability research with computer users who are blind or visually impaired. In: The 17th Annual International Conference of California State University Northridge (CSUN) “Technology and Persons with Disabilities” (2002); Available from: http://www.afb.org/section.aspx?SectionID=57&TopicID=167&DocumentID=1718

  27. Bowman, D.A., Gabbard, J.L., Hix, D.: A survey of usability evaluation in virtual environments: classification and comparison of methods. Presence Teleoperators Virtual Environ. 11(4), 404–424 (2002)

    Article  Google Scholar 

  28. Roberts, V.L., Fels, D.I.: Methods for inclusion: employing think aloud protocols in software usability studies with individuals who are deaf. Int. J. Hum. Comput. Interact. 64(6), 489–501 (2006)

    Google Scholar 

  29. Penfield, W., Boldrey, E.: Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain J. Neurol. 60(4), 389–443 (1937)

    Article  Google Scholar 

  30. Kadosh, R.C., Walsh, V.: Cognitive neuroscience: rewired or crosswired brains? Curr. Biol. 16(22), 962–963 (2006)

    Article  Google Scholar 

  31. Kolb, B., Whishaw, I.Q.: Brain plasticity and behavior. Annu. Rev. Psychol. 49(1), 43–64 (1998)

    Article  Google Scholar 

  32. Jednorog, K., Grabowska, A.: Behavioral manifestations of brain plasticity in blind and low-vision individuals. Acta Neurobiol. Exp. 68, 83–90 (2008)

    Google Scholar 

  33. Minogue, J., Jones, M.G.: Haptics in education: exploring an untapped sensory modality. Rev. Educ. Res. 76(3), 317–348 (2006)

    Article  Google Scholar 

  34. Carneiro, M.M., Velho, L.: Assistive interfaces for the visually impaired using force feedback devices and distance transforms. Inf. Technol. Disabil. E J. 10(2) (2004) Available from: http://easi.cc/itd/volume10/number2/carneiro.html

  35. Parush, A., et al.: The impact of visual layout factors on performance in Web pages: a cross-language study. Hum. Factors 47(1), 141–157 (2005)

    Article  Google Scholar 

  36. Becker, S.A., Tu, C.-J., Kim, H.-R.: Software tools for the effective use of color in web designs. In: Proceedings of the 2004 Annual National Conference on Digital Government Research, pp. 1–2 (2004)

  37. Sjostrom, C., et al.: Phantom-based haptic line graphics for blind persons. Vis. Impair. Res. 5(1), 13–32 (2003)

    Article  Google Scholar 

  38. Kortum, P.: HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces. Morgan Kaufmann, Burlington, MA (2008)

    Google Scholar 

  39. Sallnas, E.-L., Rassmus-Grohn, K., Sjostrom, C.: Supporting presence in collaborative environments by haptic force feedback. ACM Trans. Comput. Hum. Interact. 7(4), 461–476 (2000)

    Article  Google Scholar 

  40. Smith, C.M.: Human factors in haptic interfaces. Crossroads 3(3), 14–16 (1997)

    Article  Google Scholar 

  41. Schiffman, H.R.: Sensation and Perception: An Integrated Approach, vol. 5. Wiley, New York (2000)

    Google Scholar 

  42. McColl, R., et al.: Haptic rendering for laparoscopic surgery simulation & related studies. In: Encyclopedia of Healthcare Information Systems, pp. 636–645. Medical Information Science Reference, USA (2008)

  43. Botturi, D., et al.: Perception-centric force scaling in bilateral teleoperation. Mechatronics 20(7), 802–811 (2010)

    Article  Google Scholar 

  44. Kim, H.N., Nam, C.S., Smith-Jackson, T.: User interface design guidelines of haptic-thermal system for visually impaired students in obtaining scientific information. In: The 4th International Conference on Social and Organizational Informatics and Cybernetics, pp. 1–6 (2008)

  45. Lederman, S.J., Klatzky, R.L.: Hand movements: a window into haptic object recognition. Cogn. Psychol. 19(3), 342–368 (1987)

    Article  Google Scholar 

  46. Hatwell, Y., Streri, A., Gentaz, E.: Touching for Knowing: Cognitive Psychology of Haptic Manual Perception. John Benjamins Publishing Company, Amsterdam (2003)

    Book  Google Scholar 

  47. Millar, S.: Understanding and Representing Space: Theory and Evidence from Studies with Blind and Sighted Children. Oxford Science Publications, NY (1994)

    Google Scholar 

  48. MacLean, K: Designing with haptic feedback. In: Symposium on Haptic Feedback in the Proceedings of IEEE Robotics and Automation, vol. 1, pp. 783–788 (2000)

  49. Sjostrom, C.: Using haptics in computer interfaces for blind people. In: CHI ‘01 Extended Abstracts on Human Factors in Computing Systems, pp. 245–246 (2001)

  50. Keyson, D.K., Parsons, K.C.: Designing the user interface using rapid prototyping. Appl. Ergon. 21(3), 207–213 (1990)

    Article  Google Scholar 

  51. Olson, G.M., et al.: Small group design meetings: an analysis of collaboration. Hum. Comput. Interact. 7, 347–374 (1992)

    Article  Google Scholar 

  52. Olson, J.S., Olson, G.M.: Groupwork close up: a comparison of the group design process with and without a simple group editor. ACM Trans. Inf. Syst. 11(4), 321–348 (1993)

    Article  Google Scholar 

  53. McLeod, P.: An assessment of the experimental literature on electronic support of group work. Hum. Comput. Interact. 7, 257–280 (1992)

    Article  Google Scholar 

  54. Pinsonneault, A., Kraemer, K.L.: The impact of technological support on groups: an assessment of the empirical research. Decis. Support Syst. 5(2), 197–216 (1989)

    Article  Google Scholar 

  55. Bekker, M.M., Olson, J.S., Olson, G.M.: Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design. In: Proceedings of the 1st Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 157–166. Ann Arbor, Michigan (1995)

  56. Sharkey, W.F., Asamoto, P.: Hand gestures of visually impaired and sighted interactants. J. Vis. Impair. Blind. 94(9), 549–563 (2000)

    Google Scholar 

  57. Frame, M.J.: The relationship between visual impairment and gestures. J. Vis. Impair. Blind. 94(3), 155–171 (2000)

    Google Scholar 

  58. Tang, J.C., Leifer, L.J.: A framework for understanding the workspace activity of design teams. In: Proceedings of the 1988 ACM Conference on Computer-Supported Cooperative Work, pp. 244–249 (1988)

  59. Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction. Wadsworth, Belmont, CA (2010)

    Google Scholar 

  60. McNeill, D.: Gesture and Thought. University of Chicago Press, Chicago (2005)

    Book  Google Scholar 

  61. Blass, T., Freedman, N., Steingart, I.: Body movement and verbal encoding in the congenitally blind. Percept. Mot. Skills 39, 279–293 (1974)

    Article  Google Scholar 

  62. Spool, J., Schroeder, W.: Testing web sites: five users is nowhere near enough. In: Proceedings of ACM CHI Conference on Human Factors in Computing Systems, pp. 285–286 (2001)

  63. Virzi, R.A., Sokolov, J.L., Karis, D.: Usability problem identification using both low- and high-fidelity prototypes. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 236–243 (1996)

  64. Nielsen, J.: Cost of User Testing a Website. Jakob Nielsen’s Alertbox for May 3, 1998 [cited 2012 February 28]; Available from: http://www.useit.com/alertbox/980503.html

  65. Kaczmirek, L., Wolff, K.: Survey design for visually impaired and blind people. In: Proceedings of the 4th International Conference on Universal Access in Human Computer Interaction: Coping with Diversity, pp. 374–381 (2007)

  66. Muller, M.: Retrospective on a year of participatory design using the PICTIVE technique. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 455–462 (1992)

  67. Muller, M.: PICTIVE-An exploration in participatory design. In: CHI ‘91: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 225–231 (1991)

  68. Stemler, S.: An overview of content analysis. Pract. Assess. Res. Eval. 7(17) (2001); Available from: http://PAREonline.net/getvn.asp?v=7&n=17

  69. Krippendorff, K.: Content Analysis: An Introduction to its Methodology. Sage, London (1980)

    Google Scholar 

  70. Alasuutari, P.: Beyond the qualitative quantitative distinction: crosstabulation in qualitative research. Int. J. Contemp. Soc. 32(2), 252–268 (1995)

    Google Scholar 

  71. Kaplowitz, M.D.: Statistical analysis of sensitive topics in group and individual interviews. Qual. Quant. 34(4), 419–431 (2000)

    Article  Google Scholar 

  72. Tohidi, M., et al.: Getting the right design and the design right: testing many is better than one. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1243–1252 (2006)

  73. Brajnik, G.: A comparative test of web accessibility evaluation methods. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 113–120 (2008)

  74. Lang, T.: Comparing website accessibility evaluation methods and learnings from usability evaluation methods. Peak Usability, 1–14 (2003). Available from: http://www.peakusability.com.au/__documents/pdf/website_accessibility.pdf

  75. Stanton, N., et al.: Human Factors Methods: A Practical Guide for Engineering and Design. Ashgate Publishing (2005)

  76. Lombard, M., Snyder-Duch, J., Bracken, C.C.: Content analysis in mass communication: assessment and reporting of intercoder reliability. Hum. Commun. Res. 28(4), 587–604 (2002)

    Article  Google Scholar 

  77. Nunnally, J.C.: Psychometric Theory, vol. 2. McGraw-Hill, New York (1978)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL, USA

    Hyung Nam Kim

  2. Department of Industrial and Systems Engineering, North Carolina A&T State University, Greensboro, NC, USA

    Tonya L. Smith-Jackson

  3. The Grado Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, VA, USA

    Brian M. Kleiner

Authors
  1. Hyung Nam Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tonya L. Smith-Jackson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brian M. Kleiner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hyung Nam Kim.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kim, H.N., Smith-Jackson, T.L. & Kleiner, B.M. Accessible haptic user interface design approach for users with visual impairments. Univ Access Inf Soc 13, 415–437 (2014). https://doi.org/10.1007/s10209-013-0325-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-013-0325-0

Keywords

Search

Navigation