skip to main content
10.1145/3411763.3441347acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

Realizing AI in Healthcare: Challenges Appearing in the Wild

Published: 08 May 2021 Publication History

Abstract

The last several years have shown a strong growth of Artificial Intelligence (AI) technologies with promising results for many areas of healthcare. HCI has contributed to these discussions, mainly with studies on explainability of advanced algorithms. However, there are only few AI-systems based on machine learning algorithms that make it to the real world and everyday care. This challenging move has been named the “last mile” of AI in healthcare, emphasizing the sociotechnical uncertainties and unforeseen learnings from involving users in the design or use of AI-based systems. The aim of this workshop is to set the stage for a new wave of HCI research that accounts for and begins to develop new insights, concepts, and methods, for transitioning from development to implementation and use of AI in healthcare. Participants are invited to collaboratively define an HCI research agenda focused on healthcare AI in the wild, which will require examining end-user engagements and questioning underlying concepts of AI in healthcare.

References

[1]
Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y. Lim, and Mohan Kankanhalli. 2018. Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Paper 582, 1–18.
[2]
Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M. Vardoulakis. 2020. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–12.
[3]
Federico Cabitza, Andrea Campagner, and Clara Balsano. 2020. Bridging the “last mile” gap between AI implementation and operation: “data awareness” that matters. Ann Transl Medicine 8, 7 (2020), 501.
[4]
Carrie J. Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. "Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 104 (November 2019), 24 pages.
[5]
Angèle Christin. 2017. Algorithms in practice: Comparing web journalism and criminal justice. Big Data Soc, 4, 2 (2017)
[6]
Angèle Christin. 2020. The ethnographer and the algorithm: beyond the black box. Theor Soc (2020), 1–22.
[7]
Enrico Coiera. 2019. The Last Mile: Where Artificial Intelligence Meets Reality. J Med Internet Res 21, 11 (2019), e16323.
[8]
Madeleine Clare Elish and Elizabeth Anne Watkins. 2020. Repairing Innovation: A Study of Integrating AI in Clinical Care. Data & Society. Retrieved from https://datasociety.net/wp-content/uploads/2020/09/Repairing-Innovation-DataSociety-20200930-1.pdf
[9]
Kathleen H. Pine, Claus Bossen, Yunan Chen, Gunnar Ellingsen, Miria Grisot, Melissa Mazmanian, and Naja Holten Møller. 2018. Data Work in Healthcare: Challenges for Patients, Clinicians and Administrators. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '18). Association for Computing Machinery, New York, NY, USA, 433–439.
[10]
Sarah E. Fox, Amanda Menking, Jordan Eschler, and Uba Backonja. 2020. Multiples Over Models: Interrogating the Past and Collectively Reimagining the Future of Menstrual Sensemaking. ACM Trans. Comput.-Hum. Interact. 27, 4, Article 22 (September 2020), 24 pages.
[11]
Christine T. Wolf. 2019. Explainability scenarios: towards scenario-based XAI design. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 252–257.
[12]
Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A Survey of Methods for Explaining Black Box Models. ACM Comput. Surv. 51, 5, Article 93 (January 2019), 42 pages.
[13]
Mark Sendak, Madeleine Clare Elish, Michael Gao, Joseph Futoma, William Ratliff, Marshall Nichols, Armando Bedoya, Suresh Balu, and Cara O'Brien. 2020. "The human body is a black box": supporting clinical decision-making with deep learning. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT '20). Association for Computing Machinery, New York, NY, USA, 99–109.
[14]
Elizabeth Kaziunas, Mark S Ackerman, Silvia Lindtner, and Joyce M Lee. 2017. Caring through Data: Attending to the Social and Emotional Experiences of Health Datafication. In (Proceedings of the SIGCHI Conference on Human Factors in Computing Systems), 2260–2272.
[15]
A Baki Kocaballi, Kiran Ijaz, Liliana Laranjo, Juan C Quiroz, Dana Rezazadegan, Huong Ly Tong, Simon Willcock, Shlomo Berkovsky, and Enrico Coiera. 2020. Envisioning an artificial intelligence documentation assistant for future primary care consultations: A co-design study with general practitioners. J Am Med Inform Assn (2020), ocaa131.
[16]
Alice C. Li, Joseph L. Kannry, Andre Kushniruk, Dillon Chrimes, Thomas G. McGinn, Daniel Edonyabo, and Devin M. Mann. 2012. Integrating usability testing and think-aloud protocol analysis with “near-live” clinical simulations in evaluating clinical decision support. Int J Med Inform 81, 11 (2012), 761–772.
[17]
Stine Lomborg, Henriette Langstrup, and Tariq Osman Andersen. 2020. Interpretation as luxury: Heart patients living with data doubt, hope, and anxiety. Big Data Soc 7, 1 (2020), 205395172092443.
[18]
Tim Miller. 2018. Explanation in artificial intelligence: Insights from the social sciences. Artif Intell 267, (2018), 1–38.
[19]
Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and Measuring Model Interpretability. arXiv preprint arXiv:1802.07810 (2018).

Cited By

View all
  • (2025)Open challenges and opportunities in federated foundation models towards biomedical healthcareBioData Mining10.1186/s13040-024-00414-918:1Online publication date: 4-Jan-2025
  • (2024)Integrating artificial intelligence into healthcare systems: opportunities and challengesAcademia Medicine10.20935/AcadMed73821:4Online publication date: 30-Oct-2024
  • (2024)How Can I Signal You To Trust Me: Investigating AI Trust Signalling in Clinical Self-AssessmentsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661612(525-540)Online publication date: 1-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
May 2021
2965 pages
ISBN:9781450380959
DOI:10.1145/3411763
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Check for updates

Author Tags

  1. artificial intelligence
  2. human computer interaction

Qualifiers

  • Extended-abstract
  • Research
  • Refereed limited

Conference

CHI '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)343
  • Downloads (Last 6 weeks)16
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Open challenges and opportunities in federated foundation models towards biomedical healthcareBioData Mining10.1186/s13040-024-00414-918:1Online publication date: 4-Jan-2025
  • (2024)Integrating artificial intelligence into healthcare systems: opportunities and challengesAcademia Medicine10.20935/AcadMed73821:4Online publication date: 30-Oct-2024
  • (2024)How Can I Signal You To Trust Me: Investigating AI Trust Signalling in Clinical Self-AssessmentsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661612(525-540)Online publication date: 1-Jul-2024
  • (2024)"It depends": Configuring AI to Improve Clinical Usefulness Across ContextsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660707(874-889)Online publication date: 1-Jul-2024
  • (2024)Designing (with) AI for WellbeingExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3636282(1-7)Online publication date: 11-May-2024
  • (2024)Socio-technical Imaginaries: Envisioning and Understanding AI Parenting Supports through Design FictionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642619(1-27)Online publication date: 11-May-2024
  • (2024)Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for RadiologyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642013(1-22)Online publication date: 11-May-2024
  • (2024)Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICUProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641982(1-15)Online publication date: 11-May-2024
  • (2024)Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care UnitProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641896(1-18)Online publication date: 11-May-2024
  • (2024)Pathways to democratized healthcareArtificial Intelligence in Medicine10.1016/j.artmed.2024.102850151:COnline publication date: 1-May-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media