skip to main content
research-article
Public Access

I Didn't Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision

Published:06 December 2017Publication History
Skip Abstract Section

Abstract

It is important to support independent living for people with visual impairments (PVI). Part of this can be accomplished with individual assistive technologies. However, in this paper we emphasize the social and collaborative needs for PVI to fully integrate into society as equals. The study assesses how PVI collaborate with different types of sighted partners when shopping together. We chose to study grocery shopping because it is a critical and challenging task for PVI. We conducted field observations and in-depth interviews with five PVI and their sighted shopping partners, including spouses, caseworkers, and store-provided courtesy shoppers. We found several factors that modulated these collaborations with varying forms of common ground: 1) knowledge about how to assist PVI; 2) interpersonal knowledge resulting from common experience and interpersonal relationship history; and 3) knowledge of shopping as a practice. We discuss our findings with respect to the implications for designing collaborative interactions.

References

  1. Jeffrey R. Blum, Daniel G. Greencorn, and Jeremy R. Cooperstock. 2012. Smartphone sensor reliability for augmented reality applications. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services, 127--138.Google ScholarGoogle Scholar
  2. Stacy M. Branham and Shaun K. Kane. 2015. Collaborative Accessibility: How blind and sighted companions co-create accessible home spaces. In Proceedings of CHI '15, 2373--2382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Stacy M. Branham and Shaun K. Kane. 2015. The invisible work of accessibility: how blind employees manage accessibility in mixed-ability workplaces. In Proceedings SIGACCESS 2015, pp. 163--171. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. John M. Carroll, Mary Beth Rosson, Gregorio Convertino, and Craig H. Ganoe. 2006. Awareness and teamwork in computer-supported collaborations. Interacting with Computers 18, 1: 21--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. John M. Carroll, Dennis C. Neale, Philip L. Isenhour, Mary Beth Rosson, and D. Scott McCrickard. 2003. Notification and awareness: synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies 58, 5: 605--632. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Centers for Disease Control and Preventions. Blindness and visual impairment. https://www.cdc.gov/healthcommunication/toolstemplates/entertainmented/tips/blindness.htmlGoogle ScholarGoogle Scholar
  7. Herbert H. Clark. 1996. Using language. Cambridge, UK: Cambridge University Press.Google ScholarGoogle Scholar
  8. Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. Perspectives on Socially Shared Cognition, 13: 127--149.Google ScholarGoogle ScholarCross RefCross Ref
  9. Herbert H. Clark and Catherine R. Marshall. 1981. Definite reference and mutual knowledge. In Elements of discourse understanding, A.H. Joshe, B. Webber, and I.A. Sag (eds.). Cambridge University Press, Cambridge: 57 - 63.Google ScholarGoogle Scholar
  10. Gregorio Convertino, Helena M. Mentis, Mary Beth Rosson, Aleksandra Slavkovic, and John M. Carroll. 2009. Supporting content and process common ground in computer-supported teamwork. In Proceedings CHI'09, 2339--2348. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gregorio Convertino, Helena M. Mentis, Mary Beth Rosson, John M. Carroll, Aleksandra Slavkovic, and Craig H. Ganoe. 2008. Articulating common ground in cooperative work: content and process. In Proceedings of CHI'08, 1637--1646. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Gregorio Convertino, Craig H. Ganoe, Wendy A. Schafer, Beth Yost, and John M. Carroll. 2005. A multiple view approach to support common ground in distributed and synchronous geo-collaboration. In Proceedings of CMV '05, 121--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Duckett, P. S., & Pratt, R. (2001). The researched opinions on research: visually impaired people and visual impairment research. Disability & Society, 16, 6: 815--835.Google ScholarGoogle ScholarCross RefCross Ref
  14. Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam DI Kramer. 2004. Gestures over video streams to support remote collaboration on physical tasks. Human-Computer Interaction 19, 3: 273--309. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Susan R. Fussell and Robert M. Krauss. 1992. Coordination of knowledge in communication: Effects of speakers' assumptions about what others know. Journal of Personality and Social Psychology 62, 3: 378--391.Google ScholarGoogle ScholarCross RefCross Ref
  16. Joy Hammel, Susan Magasi, Allen Heinemann, Gale Whiteneck, Jennifer Bogner, and Evelyn Rodriguez. 2008. What does participation mean? An insider perspective from people with disabilities. Disability and Rehabilitation 30, 19: 1445--1460.Google ScholarGoogle ScholarCross RefCross Ref
  17. Andrea B. Hollingshead. 1998. Communication, learning, and retrieval in transactive memory systems. Journal of Experimental Social Psychology 34, 5: 423--442.Google ScholarGoogle ScholarCross RefCross Ref
  18. Andrea B. Hollingshead. 1998. Retrieval processes in transactive memory systems. Journal of Personality and Social Psychology, 74: 659--671.Google ScholarGoogle ScholarCross RefCross Ref
  19. Sabina Kef. 2002. Psychosocial adjustment and the meaning of social support for visually impaired adolescents. Journal of Visual Impairment & Blindness 96, 1.Google ScholarGoogle ScholarCross RefCross Ref
  20. Vinitha Khambadkar and Eelke Folmer. 2013. GIST: a gestural interface for remote nonvisual spatial perception. In Proceedings of UIST 2013, 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Gary Klein, Paul J. Feltovich, Jeffrey M. Bradshaw, and David D. Woods. 2005. Common ground and coordination in joint activity. In Organizational simulation, William B. Rouse and Kenneth R. Boff (eds.).Wiley, New York, 139--184.Google ScholarGoogle Scholar
  22. Robert E. Kraut, Susan R. Fussell, and Jane Siegel. 2003. Visual information as a conversational resource in collaborative physical tasks. Human-Computer Interaction 18, 1: 13--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Antonio Krüger, Johannes Schöning, and Patrick Olivier. 2011. How computing will change the face of retail. Computer 44, 4: 84--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Vladimir Kulyukin, Chaitanya Gharpure, and John Nicholson. 2005. Robocart: Toward robot-assisted navigation of grocery stores by the visually impaired. In Proceedings of IROS'05, 2845--2850.Google ScholarGoogle ScholarCross RefCross Ref
  25. Ecosse L. Lamoureux, Jennifer B. Hassell, and Jill E. Keeffe. 2004. The determinants of participation in activities of daily living in people with impaired vision. American Journal of Ophthalmology 137, 2: 265--270.Google ScholarGoogle ScholarCross RefCross Ref
  26. Patrick E. Lanigan, Aaron M. Paulos, Andrew W. Williams, Dan Rossi, and Priya Narasimhan. 2006. Trinetra: Assistive technologies for grocery shopping for the blind. In ISWC, 147--148.Google ScholarGoogle Scholar
  27. Michele Merler, Carolina Galleguillos, and Serge Belongie. 2007. Recognizing groceries in situ using in vitro training data. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  28. Oussama Metatla, Nick Bryan-Kinns, Tony Stockman, and Fiore Martin. 2012. Cross-modal collaborative interaction between visually-impaired and sighted users in the workplace. In Proceedings of the 18th International Conference on Auditory Display, 164--171.Google ScholarGoogle Scholar
  29. Mala D. Naraine & Peter H. Lindsay. 2011. Social inclusion of employees who are blind or low vision. Disability & Society, 26, 4: 389--403.Google ScholarGoogle ScholarCross RefCross Ref
  30. John Nicholson, Vladimir Kulyukin, and Daniel Coster. 2009. ShopTalk: independent blind shopping through verbal route directions and barcode scans. The Open Rehabilitation Journal 2, 1: 11--23.Google ScholarGoogle ScholarCross RefCross Ref
  31. Na Sun, Chien Wen Yuan, Mary Beth Rosson, Yu Wu, and John M. Carroll. 2017. Critical thinker: Supporting collaborative argumentation with structure and awareness. In Proceedings of ICALT'17.Google ScholarGoogle Scholar
  32. Eva-Lotta Sallnas, Jonas Moll, and Kerstin Severinson-Eklundh. 2007. Group work about geometrical concepts among blind and sighted pupils using haptic interfaces. In IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 330--335. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jaime Sánchez, Nelson Baloian, and Tiago Hassler. 2004. Blind to sighted children interaction through collaborative environments. In International Conference on Collaboration and Technology, 192--205.Google ScholarGoogle ScholarCross RefCross Ref
  34. Lübomira Spassova, Gerrit Kahl, and Antonio Krüger. 2010. User-adaptive advertisement in retail environments. In Proceedings of the 3rd Workshop on Pervasive Advertising and Shopping.Google ScholarGoogle Scholar
  35. Erika Tanhua-Piiroinen, Virpi Pasto, Roope Raisamo, and Eva-Lotta Sallnäs. 2008. Supporting collaboration between visually impaired and sighted children in a multimodal learning environment. In International Workshop on Haptic and Audio Interaction Design, 11--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Daniel M. Wegner, Ralph Erber, and Paula Raymond. 1991. Transactive memory in close relationships. Journal of Personality and Social Psychology, 61: 923--929.Google ScholarGoogle ScholarCross RefCross Ref
  37. Daniel M. Wegner. 1987. Transactive memory: A contemporary analysis of the group mind. In Theories of group behavior, B. Mullen and G. R. Goethals (eds.), Springer-Verlag, New York, 185--208.Google ScholarGoogle Scholar
  38. Fredrik Winberg. 2006. Supporting cross-modal collaboration: Adding a social dimension to accessibility. In International Workshop on Haptic and Audio Interaction Design, 102--110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson, and John M. Carroll. Forthcoming. Constructing a holistic view of shopping with people with visual impairment: A participatory design approach. Universal Access in the Information Society.Google ScholarGoogle Scholar
  40. Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, and John M. Carroll. 2015. Designing equal participation in informal learning for people with visual impairment. Interaction Design & Architectures, 27: 93--106.Google ScholarGoogle Scholar
  41. Peter A. Zientara, Sooyeon Lee, Gus H. Smith, Rorry Brenner, Laurent Itti, Mary Beth Rosson, John M. Carroll, Kevin M. Irick, and Vijaykrishnan Narayanan. 2017. Third Eye: A shopping assistant for the visually impaired. Computer 50, 2: 16--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Diana M. Zuckerman. 2004. Blind adults in America: Their lives and challenges. Washington, DC: National Center for Policy Research for Women & Families.Google ScholarGoogle Scholar

Index Terms

  1. I Didn't Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader