research-article

Public Access

I Didn't Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision

Authors:

Chien Wen Yuan,

Benjamin V. Hanrahan,

Mary Beth Rosson,

John M. CarrollAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 1, Issue CSCW

Article No.: 118, Pages 1 - 18

https://doi.org/10.1145/3134753

Published: 06 December 2017 Publication History

Abstract

It is important to support independent living for people with visual impairments (PVI). Part of this can be accomplished with individual assistive technologies. However, in this paper we emphasize the social and collaborative needs for PVI to fully integrate into society as equals. The study assesses how PVI collaborate with different types of sighted partners when shopping together. We chose to study grocery shopping because it is a critical and challenging task for PVI. We conducted field observations and in-depth interviews with five PVI and their sighted shopping partners, including spouses, caseworkers, and store-provided courtesy shoppers. We found several factors that modulated these collaborations with varying forms of common ground: 1) knowledge about how to assist PVI; 2) interpersonal knowledge resulting from common experience and interpersonal relationship history; and 3) knowledge of shopping as a practice. We discuss our findings with respect to the implications for designing collaborative interactions.

References

[1]

Jeffrey R. Blum, Daniel G. Greencorn, and Jeremy R. Cooperstock. 2012. Smartphone sensor reliability for augmented reality applications. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services, 127--138.

[2]

Stacy M. Branham and Shaun K. Kane. 2015. Collaborative Accessibility: How blind and sighted companions co-create accessible home spaces. In Proceedings of CHI '15, 2373--2382.

Digital Library

[3]

Stacy M. Branham and Shaun K. Kane. 2015. The invisible work of accessibility: how blind employees manage accessibility in mixed-ability workplaces. In Proceedings SIGACCESS 2015, pp. 163--171.

Digital Library

[4]

John M. Carroll, Mary Beth Rosson, Gregorio Convertino, and Craig H. Ganoe. 2006. Awareness and teamwork in computer-supported collaborations. Interacting with Computers 18, 1: 21--46.

Digital Library

[5]

John M. Carroll, Dennis C. Neale, Philip L. Isenhour, Mary Beth Rosson, and D. Scott McCrickard. 2003. Notification and awareness: synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies 58, 5: 605--632.

Digital Library

[6]

Centers for Disease Control and Preventions. Blindness and visual impairment. https://www.cdc.gov/healthcommunication/toolstemplates/entertainmented/tips/blindness.html

[7]

Herbert H. Clark. 1996. Using language. Cambridge, UK: Cambridge University Press.

[8]

Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. Perspectives on Socially Shared Cognition, 13: 127--149.

[9]

Herbert H. Clark and Catherine R. Marshall. 1981. Definite reference and mutual knowledge. In Elements of discourse understanding, A.H. Joshe, B. Webber, and I.A. Sag (eds.). Cambridge University Press, Cambridge: 57 - 63.

[10]

Gregorio Convertino, Helena M. Mentis, Mary Beth Rosson, Aleksandra Slavkovic, and John M. Carroll. 2009. Supporting content and process common ground in computer-supported teamwork. In Proceedings CHI'09, 2339--2348.

Digital Library

[11]

Gregorio Convertino, Helena M. Mentis, Mary Beth Rosson, John M. Carroll, Aleksandra Slavkovic, and Craig H. Ganoe. 2008. Articulating common ground in cooperative work: content and process. In Proceedings of CHI'08, 1637--1646.

Digital Library

[12]

Gregorio Convertino, Craig H. Ganoe, Wendy A. Schafer, Beth Yost, and John M. Carroll. 2005. A multiple view approach to support common ground in distributed and synchronous geo-collaboration. In Proceedings of CMV '05, 121--132.

Digital Library

[13]

Duckett, P. S., & Pratt, R. (2001). The researched opinions on research: visually impaired people and visual impairment research. Disability & Society, 16, 6: 815--835.

[14]

Susan R. Fussell, Leslie D. Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam DI Kramer. 2004. Gestures over video streams to support remote collaboration on physical tasks. Human-Computer Interaction 19, 3: 273--309.

Digital Library

[15]

Susan R. Fussell and Robert M. Krauss. 1992. Coordination of knowledge in communication: Effects of speakers' assumptions about what others know. Journal of Personality and Social Psychology 62, 3: 378--391.

[16]

Joy Hammel, Susan Magasi, Allen Heinemann, Gale Whiteneck, Jennifer Bogner, and Evelyn Rodriguez. 2008. What does participation mean? An insider perspective from people with disabilities. Disability and Rehabilitation 30, 19: 1445--1460.

[17]

Andrea B. Hollingshead. 1998. Communication, learning, and retrieval in transactive memory systems. Journal of Experimental Social Psychology 34, 5: 423--442.

[18]

Andrea B. Hollingshead. 1998. Retrieval processes in transactive memory systems. Journal of Personality and Social Psychology, 74: 659--671.

[19]

Sabina Kef. 2002. Psychosocial adjustment and the meaning of social support for visually impaired adolescents. Journal of Visual Impairment & Blindness 96, 1.

[20]

Vinitha Khambadkar and Eelke Folmer. 2013. GIST: a gestural interface for remote nonvisual spatial perception. In Proceedings of UIST 2013, 301--310.

Digital Library

[21]

Gary Klein, Paul J. Feltovich, Jeffrey M. Bradshaw, and David D. Woods. 2005. Common ground and coordination in joint activity. In Organizational simulation, William B. Rouse and Kenneth R. Boff (eds.).Wiley, New York, 139--184.

[22]

Robert E. Kraut, Susan R. Fussell, and Jane Siegel. 2003. Visual information as a conversational resource in collaborative physical tasks. Human-Computer Interaction 18, 1: 13--49.

Digital Library

[23]

Antonio Krüger, Johannes Schöning, and Patrick Olivier. 2011. How computing will change the face of retail. Computer 44, 4: 84--87.

Digital Library

[24]

Vladimir Kulyukin, Chaitanya Gharpure, and John Nicholson. 2005. Robocart: Toward robot-assisted navigation of grocery stores by the visually impaired. In Proceedings of IROS'05, 2845--2850.

[25]

Ecosse L. Lamoureux, Jennifer B. Hassell, and Jill E. Keeffe. 2004. The determinants of participation in activities of daily living in people with impaired vision. American Journal of Ophthalmology 137, 2: 265--270.

[26]

Patrick E. Lanigan, Aaron M. Paulos, Andrew W. Williams, Dan Rossi, and Priya Narasimhan. 2006. Trinetra: Assistive technologies for grocery shopping for the blind. In ISWC, 147--148.

[27]

Michele Merler, Carolina Galleguillos, and Serge Belongie. 2007. Recognizing groceries in situ using in vitro training data. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR'07), 1--8.

[28]

Oussama Metatla, Nick Bryan-Kinns, Tony Stockman, and Fiore Martin. 2012. Cross-modal collaborative interaction between visually-impaired and sighted users in the workplace. In Proceedings of the 18th International Conference on Auditory Display, 164--171.

[29]

Mala D. Naraine & Peter H. Lindsay. 2011. Social inclusion of employees who are blind or low vision. Disability & Society, 26, 4: 389--403.

[30]

John Nicholson, Vladimir Kulyukin, and Daniel Coster. 2009. ShopTalk: independent blind shopping through verbal route directions and barcode scans. The Open Rehabilitation Journal 2, 1: 11--23.

[31]

Na Sun, Chien Wen Yuan, Mary Beth Rosson, Yu Wu, and John M. Carroll. 2017. Critical thinker: Supporting collaborative argumentation with structure and awareness. In Proceedings of ICALT'17.

[32]

Eva-Lotta Sallnas, Jonas Moll, and Kerstin Severinson-Eklundh. 2007. Group work about geometrical concepts among blind and sighted pupils using haptic interfaces. In IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 330--335.

Digital Library

[33]

Jaime Sánchez, Nelson Baloian, and Tiago Hassler. 2004. Blind to sighted children interaction through collaborative environments. In International Conference on Collaboration and Technology, 192--205.

[34]

Lübomira Spassova, Gerrit Kahl, and Antonio Krüger. 2010. User-adaptive advertisement in retail environments. In Proceedings of the 3rd Workshop on Pervasive Advertising and Shopping.

[35]

Erika Tanhua-Piiroinen, Virpi Pasto, Roope Raisamo, and Eva-Lotta Sallnäs. 2008. Supporting collaboration between visually impaired and sighted children in a multimodal learning environment. In International Workshop on Haptic and Audio Interaction Design, 11--20.

Digital Library

[36]

Daniel M. Wegner, Ralph Erber, and Paula Raymond. 1991. Transactive memory in close relationships. Journal of Personality and Social Psychology, 61: 923--929.

[37]

Daniel M. Wegner. 1987. Transactive memory: A contemporary analysis of the group mind. In Theories of group behavior, B. Mullen and G. R. Goethals (eds.), Springer-Verlag, New York, 185--208.

[38]

Fredrik Winberg. 2006. Supporting cross-modal collaboration: Adding a social dimension to accessibility. In International Workshop on Haptic and Audio Interaction Design, 102--110.

Digital Library

[39]

Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson, and John M. Carroll. Forthcoming. Constructing a holistic view of shopping with people with visual impairment: A participatory design approach. Universal Access in the Information Society.

[40]

Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, and John M. Carroll. 2015. Designing equal participation in informal learning for people with visual impairment. Interaction Design & Architectures, 27: 93--106.

[41]

Peter A. Zientara, Sooyeon Lee, Gus H. Smith, Rorry Brenner, Laurent Itti, Mary Beth Rosson, John M. Carroll, Kevin M. Irick, and Vijaykrishnan Narayanan. 2017. Third Eye: A shopping assistant for the visually impaired. Computer 50, 2: 16--24.

Digital Library

[42]

Diana M. Zuckerman. 2004. Blind adults in America: Their lives and challenges. Washington, DC: National Center for Policy Research for Women & Families.

Cited By

Zhang HFalletta NXie JYu RLee SBillah SCarroll J(2025)Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation SystemCompanion Proceedings of the 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3699636(29-35)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3699636
Kameswaran VRobinson JSambasivan NAggarwal GMorris M(2024)Help and The Social Construction of Access: A Case-Study from IndiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675606(1-12)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675606
Teng YCourtien CRios DTseng YGibson JAziz MReyna AVaish RSmith B(2024)Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted StrangersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642816(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642816
Show More Cited By

Index Terms

I Didn't Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision
1. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

In recent decades, great technological strides have been made toward enabling people who are blind to live independent, successful lives. However, there has been relatively little progress towards understanding the social, collaborative needs of this ...
Non-Visual Cooking: Exploring Practices and Challenges of Meal Preparation by People with Visual Impairments
ASSETS '21: Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility

The reliance on vision for tasks related to cooking and eating healthy can present barriers to cooking for oneself and achieving proper nutrition. There has been little research exploring cooking practices and challenges faced by people with visual ...
“It Feels Like Taking a Gamble”: Exploring Perceptions, Practices, and Challenges of Using Makeup and Cosmetics for People with Visual Impairments
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Makeup and cosmetics offer the potential for self-expression and the reshaping of social roles for visually impaired people. However, there exist barriers to conducting a beauty regime because of the reliance on visual information and color variances in ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 1, Issue CSCW

November 2017

2095 pages

EISSN:2573-0142

DOI:10.1145/3171581

Editors:
Clifford Lampe
University of Michigan
,
Jeff Nichols
Google
,
Karrie Karahalios
University of Illinois Urbana-Champaign
,
Geraldine Fitzpatrick
Vienna University of Technology
,
Uichin Lee
KAIST
,
Andres Monroy-Hernandez
Snap Inc.
,
Wolfgang Stuerzlinger
Simon Fraser University

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2017

Published in PACMHCI Volume 1, Issue CSCW

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
754
Total Downloads

Downloads (Last 12 months)186
Downloads (Last 6 weeks)15

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang HFalletta NXie JYu RLee SBillah SCarroll J(2025)Enhancing the Travel Experience for People with Visual Impairments through Multimodal Interaction: NaviGPT, A Real-Time AI-Driven Mobile Navigation SystemCompanion Proceedings of the 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3699636(29-35)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3699636
Kameswaran VRobinson JSambasivan NAggarwal GMorris M(2024)Help and The Social Construction of Access: A Case-Study from IndiaProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675606(1-12)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675606
Teng YCourtien CRios DTseng YGibson JAziz MReyna AVaish RSmith B(2024)Help Supporters: Exploring the Design Space of Assistive Technologies to Support Face-to-Face Help Between Blind and Sighted StrangersProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642816(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642816
Barbareschi GKumar TKim CChernyshov GKunze K(2024)"Speech is Silver, Silence is Golden " Analyzing Micro-communication Strategies between Visually Impaired Runners and their GuidesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642388(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642388
Xiao LBandukda MAngerbauer KLin WBhatnagar TSedlmair MHolloway C(2024)A Systematic Review of Ability-diverse Collaboration through Ability-based Lens in HCIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641930(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641930
Kaschnig FNeumayr TAugstein M(2024)Remote Collaboration Between Sighted and Non-Sighted People in Mixed-Ability TeamsComputers Helping People with Special Needs10.1007/978-3-031-62846-7_60(505-516)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-62846-7_60
Kameswaran VY VMarathe M(2023)Advocacy as Access Work: How People with Visual Impairments Gain Access to Digital Banking in IndiaProceedings of the ACM on Human-Computer Interaction10.1145/35795967:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579596
Yildiz ZSubasi O(2023)Virtual Collaboration Tools for Mixed-Ability Workspaces: A Cross Disability Solidarity Case from TurkeyProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580937(1-11)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580937
Wu YDing XDai XZhang PLu TGu N(2022)Alignment Work for Urban Accessibility: A Study of How Wheelchair Users Travel in Urban SpacesProceedings of the ACM on Human-Computer Interaction10.1145/35551656:CSCW2(1-22)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555165
Reyes-Cruz GFischer JReeves S(2022)Supporting Awareness of Visual Impairments and Accessibility Reflections through Video Demos and Design CardsNordic Human-Computer Interaction Conference10.1145/3546155.3546697(1-15)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546697
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents