ABSTRACT
People with physical impairments can experience significant challenges in using traditional input devices (e.g. a mouse, keyboard, stylus, etc.) to control mainstream creative design software (e.g. Adobe XD, Photoshop, and Illustrator). The use of speech recognition presents new opportunities to make these applications more accessible, although there has been little work exploring this area to date. This doctoral research is addressing this lack of work through investigating how different speech interaction techniques can be used to support people with physical impairments in controlling and manipulating graphical objects. Initial work around examining new techniques for supporting the movement of visual objects around a design canvas is presented, along with details outlining other key areas that require further investigation in this field.
- Chris Creed. 2018. Assistive technology for disabled visual artists: exploring the impact of digital technologies on artistic practice. Disabil. Soc. 33, 7 (2018), 1103–1119. DOI:https://doi.org/10.1080/09687599.2018.1469400Google ScholarCross Ref
- Chris Creed, Ian Williams, and Maite Frutos-Pascual. 2020. Multimodal Gaze Interaction for Creative Design. (2020), 1–13. DOI:https://doi.org/10.1145/3313831.3376196 Google ScholarDigital Library
- Arno Gourdol, Laurence Nigay, Daniel Salber, and Joelle Coutaz. Two Case Studies of Software Architecture for Multimodal Interactive Systems. 1–16.Google Scholar
- Susumu Harada, Jacob O. Wobbrock, and James A. Landay. 2007. VoiceDraw: A hands-free voice-driven drawing application for people with motor impairments. In ASSETS’07: Proceedings of the Ninth International ACM SIGACCESS Conference on Computers and Accessibility, 27–34. DOI:https://doi.org/10.1145/1296843.1296850 Google ScholarDigital Library
- Alexander G Hauptmann. 1989. Speech and gestures for graphic image manipulation. In Conference on Human Factors in Computing Systems - Proceedings, 241–245. DOI:https://doi.org/10.1145/67449.67496 Google ScholarDigital Library
- Mayumi Hiyoshi and Hideo Shimazu. 1994. Drawing pictures with natural language and direct manipulation. 722. DOI:https://doi.org/10.3115/991250.991262Google Scholar
- Jan van der Kamp and Veronica Sundstedt. 2011. Gaze and voice controlled drawing. 1–8. DOI:https://doi.org/10.1145/1983302.1983311Google Scholar
- Yea Seul Kim, Mira Dontcheva, Eytan Adar, and Jessica Hullman. 2019. Vocal shortcuts for creative experts. In Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery. DOI:https://doi.org/10.1145/3290605.3300562 Google ScholarDigital Library
- Gierad Laput, Mira Dontcheva, Gregg Wilensky, Walter Chang, Aseem Agarwala, Jason Linder, and Eytan Adar. 2013. PixelTone: A multimodal interface for image editing. In Conference on Human Factors in Computing Systems - Proceedings, 2185–2194. DOI:https://doi.org/10.1145/2470654.2481301 Google ScholarDigital Library
- Arjun Srinivasan, Mira Dontcheva, Eytan Adar, and Seth Walker. 2019. Discovering natural language commands in multimodal interfaces. In International Conference on Intelligent User Interfaces, Proceedings IUI, Association for Computing Machinery, 661–672. DOI:https://doi.org/10.1145/3301275.3302292 Google ScholarDigital Library
Index Terms
- Inclusive Visual Design to Support People with Physical Impairments
Recommendations
The challenges in adopting assistive technologies in the workplace for people with visual impairments
OzCHI '18: Proceedings of the 30th Australian Conference on Computer-Human InteractionThere are many barriers to employment for people with visual impairments. Assistive technologies (ATs), such as computer screen readers and enlarging software, are commonly used to help overcome employment barriers and enable people with visual ...
Assisting people with visual impairments in aiming at a target on a large wall-mounted display
Large interactive displays have become ubiquitous in our everyday lives, but these displays are designed for the needs of sighted people. In this paper, we specifically address assisting people with visual impairments to aim at a target on a large wall-...
Ability-Based Design: Concept, Principles and Examples
Current approaches to accessible computing share a common goal of making technology accessible to users with disabilities. Perhaps because of this goal, they may also share a tendency to centralize disability rather than ability. We present a refinement ...
Comments