Matthew Ernst
Audrey Girouard
ABSTRACT
This paper explores the novel context of using bend gestures as a primary method of interaction for the blind. Our preliminary study assesses if this more tactile experience could enhance the usability and accessibility of technology for blind users, by comparing bend and touch interactions with simulated blind participants. Both input techniques showed similar results, indicating that bend gestures have potential in this context. We identify results that can help shape future research in this accessibility area, and potentially increase the overall interaction experience for screen reader based smartphones.
- Ahmaniemi, T.T., Kildal, J., and Haveri, M. What is a device bend gesture really good for? Proceedings of the 32nd annual ACM conference on Human factors in computing systems CHI '14, ACM Press (2014), 3503-3512. Google Scholar
Digital Library
- Apple. VoiceOver. 2015. https://www.apple.com/ca/accessibility/osx/voiceo ver/.Google Scholar
- Azenkot, S., Ladner, R.E., and Wobbrock, J.O. Smartphone haptic feedback for nonvisual wayfinding. The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility, (2011), 281-282. Google ScholarDigital Library
- Azenkot, S. and Lee, N.B. Exploring the use of speech input by blind people on mobile devices. Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility, (2013), 1-8. Google ScholarDigital Library
- Bedny, M., Pascual-Leone, A., Dodell-Feder, D., Fedorenko, E., and Saxe, R. Language processing in the occipital cortex of congenitally blind adults. Proceedings of the National Academy of Sciences of the USA of America 108, 11 (2011), 4429-4434.Google ScholarCross Ref
- Buzzi, M.C., Buzzi, M., Donini, F., Leporini, B., and Paratore, M.T. Haptic reference cues to support the exploration of touchscreen mobile devices by blind users. Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI, (2013), 1-8. Google ScholarDigital Library
- Frey, B., Southern, C., and Romero, M. BrailleTouch: Mobile texting for the visually impaired. Lecture Notes in Computer Science 6767 LNCS, PART 3 (2011), 19-25. Google ScholarDigital Library
- Gallant, D.T., Seniuk, A.G., and Vertegaal, R. Towards more paper-like input. Proceedings of the 21st annual ACM symposium on User interface software and technology - UIST '08, (2008), 283. Google ScholarDigital Library
- Girouard, A., Lo, J., Riyadh, M., Daliri, F., Eady, A.K., and Pasquero, J. One-Handed Bend Interactions with Deformable Smartphones. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, (2015), 1509-1518. Google ScholarDigital Library
- Google Inc. TalkBack. https://play.google.com/store/apps/details?id=com.google.android.marvin.talkback&hl=en.Google Scholar
- Gougoux, F., Zatorre, R.J., Lassonde, M., Voss, P., and Lepore, F. A functional neuroimaging study of sound localization: Visual cortex activity predicts performance in early-blind individuals. PLoS Biology 3, 2 (2005), 0324-0333.Google ScholarCross Ref
- Herkenrath, G., Karrer, T., and Borchers, J. Twend: Twisting and Bending as new INteraction Gesture in Mobile Devices. Proceeding of the twenty-sixth annual CHI conference extended abstracts on Human factors in computing systems, (2008), 3819. Google ScholarDigital Library
- Holman, D., Vertegaal, R., Altosaar, M., Troje, N., and Johns, D. Paper windows: Interaction Techniques for Digital Paper. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '05, (2005), 591. Google ScholarDigital Library
- Jayant, C., Acuario, C., Johnson, W., Hollier, J., and Ladner, R. V-braille. Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility - ASSETS '10, September 2015 (2010), 295-296. Google ScholarDigital Library
- Kane, S., Wobbrock, J., and Ladner, R. Usable gestures for blind people: understanding preference and performance. Proceedings of the 2011 Conference on Human factors in computing systems CHI '11, (2011), 413-422. Google ScholarDigital Library
- Kane, S.K., Bigham, J.P., and Wobbrock, J.O. Slide rule. Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility - Assets '08, (2008), 73-81. Google ScholarDigital Library
- Karns, C.M., Dow, M.W., and Neville, H.J. Altered Cross-Modal Processing in the Primary Auditory Cortex of Congenitally Deaf Adults: A Visual Somatosensory fMRI Study with a Double-Flash Illusion. Journal of Neuroscience 32, 28 (2012), 9626-9638.Google ScholarCross Ref
- Kildal, J., Paasovaara, S., and Aaltonen, V. Kinetic device: Designing Interactions with a Deformable Mobile Interface. Proceedings of the ACM SIGCHI conference on Human Factors in Computing Systems Extended Abstracts, (2012), 1871. Google ScholarDigital Library
- Kildal, J. Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture. In Haptic and Audio Interaction Design. 2012, 71-80. Google ScholarDigital Library
- Lahey, B., Girouard, A., Burleson, W., and Vertegaal, R. PaperPhone: Understanding the Use of Bend Gestures in Mobile Devices with Flexible Electronic Paper Displays. Proceedings of the 2011 annual conference on Human factors in computing systems CHI '11, (2011), 1303. Google ScholarDigital Library
- Lee, S., Lim, Y., and Lee, K.-P. Exploring the effects of size on deformable user interfaces. Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion - MobileHCI '12, ACM Press (2012), 89. Google ScholarDigital Library
- Leporini, B., Buzzi, M.C., and Buzzi, M. Interacting with mobile devices via VoiceOver. Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI '12, (2012), 339-348. Google ScholarDigital Library
- Li, K. a., Baudisch, P., and Hinckley, K. Blindsight. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems CHI '08, (2008), 1389.Google Scholar
- Lo, J. and Girouard, A. Fabricating Bendy: Design and Development of Deformable Prototypes. IEEE Pervasive Computing Special Issue on Fabrication and Printing 13, 3 (2014), 40-46.Google Scholar
- MIPSoft. BlindSquare. 2015. http://blindsquare.com/.Google Scholar
- Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., and Gonçalves, D. Human-Computer Interaction -INTERACT 2011: 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5--9, 2011, Proceedings, Part I. In P. Campos, N. Graham, J. Jorge, N. Nunes, P. Palanque and M. Winckler, eds., Springer Berlin Heidelberg, Berlin, Heidelberg, 2011, 100-107. Google ScholarDigital Library
- Qian, H., Kuber, R., and Sears, A. Towards identifying distinguishable tactons for use with mobile devices. Proceeding of the eleventh international ACM SIGACCESS conference on Computers and accessibility ASSETS 09, (2009), 257-258. Google ScholarDigital Library
- Rantala, J., Raisamo, R., Lylykangas, J., et al. Methods for presenting braille characters on a mobile device with a touchscreen and tactile feedback. IEEE Transactions on Haptics 2, 1 (2009), 28-39. Google ScholarDigital Library
- Schwesig, C., Poupyrev, I., and Mori, E. Gummi: A Bendable Computer. Proceedings of the 2004 conference on Human factors in computing systems CHI '04, (2004), 263-270. Google ScholarDigital Library
- Shaik, A.S., Hossain, G., and Yeasin, M. Design, development and performance evaluation of reconfigured mobile Android phone for people who are blind or visually impaired. Proceedings of the 28th ACM International Conference on Design of Communication SIGDOC '10, (2010), 159. Google ScholarDigital Library
- Shiri Azenkot, Jacob O. Wobbrock, Sanjana Prasain, and R.E.L. Input finger detection for nonvisual touch screen text entry in Perkinput. Proceedings of Graphics Interface (GI '12), (2012), 121-129. Google ScholarDigital Library
- Steimle, J., Jordt, A., and Maes, P. Flexpad. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, ACM Press (2013), 237.Google Scholar
- The International Agency for the Prevention of Blindness (IAPB). Blindness and Visual Impairment: Global Facts. 2012. http://www.iapb.org/vision-2020/global-facts.Google Scholar
- Warren, K., Lo, J., Vadgama, V., and Girouard, A. Bending the rules: Bend Gesture Classification for Flexible Displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13, (2013), 607. Google ScholarDigital Library
- Watanabe, J., Mochizuki, A., and Horry, Y. Bookisheet: Bendable Device for Browsing Content Using the Metaphor of Leafing Through the Pages. Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08, (2008), 360. Google ScholarDigital Library
- Yatani, K. and Truong, K.N. SemFeel: A User Interface with Semantic Tactile Feedback for Mobile Touch-screen Devices. Proceedings of the 22nd annual ACM symposium on User interface software and technology - UIST '09, (2009), 111-120. Google ScholarDigital Library
- Zakai, A. speak.js. 2015, https://github.com/kripken/speak.js.Google Scholar
- Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '07, (2007), 1395. Google ScholarDigital Library
Index Terms
- Bending Blindly: Exploring Bend Gestures for the Blind
Recommendations
Exploring Haptics for Learning Bend Gestures for the Blind
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsThis paper explores the use of haptic stimuli as non-visual affordances to assist in learnability of bend gestures. We tested 48 haptic Tactons with simulated blind participants to understand what haptic sensation could intuitively map to bend location ...
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and ServicesThe accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...
Making Real-World Interfaces Accessible Through Crowdsourcing, Computer Vision, and Fabrication
W4A '17: Proceedings of the 14th International Web for All ConferenceThe world is full of physical interfaces that are inaccessible to blind people, from microwaves and information kiosks to thermostats and checkout terminals. Blind people cannot independently use such devices without at least first learning their layout,...
Comments