skip to main content
10.1145/3173574.3173996acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

More Text Please! Understanding and Supporting the Use of Visualization for Clinical Text Overview

Published: 21 April 2018 Publication History

Abstract

Clinical practice is heavily reliant on the use of unstructured text to document patient stories due to its expressive and flexible nature. However, a physician's capacity to recover information from text for clinical overview is severely affected when records get longer and time pressure increases. Data visualization strategies have been explored to aid in information retrieval by replacing text with graphical summaries, though often at the cost of omitting important text features. This causes physician mistrust and limits real-world adoption. This work presents our investigation into the role and use of text in clinical practice, and reports on efforts to assess the best of both worlds---text and visualization---to facilitate clinical overview. We report on insights garnered from a field study, and the lessons learned from an iterative design process and evaluation of a text-visualization prototype, MedStory, with 14 medical professionals. The results led to a number of grounded design recommendations to guide visualization design to support clinical text overview.

Supplementary Material

suppl.mov (pn3550-file3.mp4)
Supplemental video
suppl.mov (pn3550-file5.mp4)
Supplemental video

References

[1]
Jørgen Bansler, Erling Havn, Troels Mønsted, Kjeld Schmidt, and Jesper Hastrup Svendsen. 2013. Physicians' progress notes. In ECSCW 2013: Proceedings of the 13th European Conference on Computer Supported Cooperative Work, 21--25 September 2013, Paphos, Cyprus. Springer, 123--142.
[2]
Vijayaraghavan Bashyam, William Hsu, Emily Watt, Alex AT Bui, Hooshang Kangarloo, and Ricky K Taira. 2009. Problem-centric Organization and Visualization of Patient Imaging and Clinical Data. Radiographics 29, 2 (2009), 331--343.
[3]
Claus Bossen and Lotte Groth Jensen. 2014. How physicians 'achieve overview': a case-based study in a hospital ward. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 257--268.
[4]
John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.
[5]
PJ Brown, JL Marquard, B Amster, M Romoser, J Friderici, S Goff, and D Fisher. 2014. What do physicians read (and ignore) in electronic progress notes? Applied clinical informatics 5, 2 (2014), 430.
[6]
Alex AT Bui, Denise R Aberle, and Hooshang Kangarloo. 2007. TimeLine: visualizing integrated patient records. IEEE Transactions on Information Technology in Biomedicine 11, 4 (2007), 462--473.
[7]
Tom Christensen and Anders Grimsmo. 2008. Instant availability of patient records, but diminished availability of patient information: a multi-method study of GP's use of electronic patient records. BMC medical informatics and decision making 8, 1 (2008), 12.
[8]
Andy Cockburn, Carl Gutwin, Joey Scarr, and Sylvain Malacria. 2015. Supporting novice to expert transitions in user interfaces. ACM Computing Surveys (CSUR) 47, 2 (2015), 31.
[9]
Joshua C Feblowitz, Adam Wright, Hardeep Singh, Lipika Samal, and Dean F Sittig. 2011. Summarization of clinical information: a conceptual model. Journal of biomedical informatics 44, 4 (2011), 688--699.
[10]
Angus Forbes, Mihai Surdeanu, Peter Jansen, and Jane Carrington. 2013. Transmitting narrative: An interactive shift-summarization tool for improving nurse communication. In Proceedings of the IEEE Workshop on Interactive Visual Text Analytics (TextVis).
[11]
The Apache Software Foundation. 2013. Apache cTAKES. (2013). http://ctakes.apache.org/
[12]
Trisha Greenhalgh and Brian Hurwitz. 1999. Narrative based medicine: Why study narrative? Bmj 318, 7175 (1999), 48--50.
[13]
Trisha Greenhalgh, Katja Stramer, Tanja Bratan, Emma Byrne, Jill Russell, and Henry WW Potts. 2010. Adoption and non-adoption of a shared electronic summary record in England: a mixed-method case study. Bmj 340 (2010), c3111.
[14]
Catalina Hallett. 2008. Multi-modal presentation of medical histories. In Proceedings of the 13th international conference on Intelligent user interfaces. ACM, 80--89.
[15]
Catalina Hallett, Richard Power, and Donia Scott. 2006. Summarisation and visualisation of e-health data repositories. In UK E-Science All-Hands Meeting, 18--21 Sept 2006, Nottingham, UK.
[16]
Kristiina Häyrinen, Kaija Saranto, and Pirkko Nykänen. 2008. Definition, structure, content, use and impacts of electronic health records: a review of the research literature. International journal of medical informatics 77, 5 (2008), 291--304.
[17]
Jamie S Hirsch, Jessica S Tanenbaum, Sharon Lipsky Gorman, Connie Liu, Eric Schmitz, Dritan Hashorva, Artem Ervits, David Vawdrey, Marc Sturm, and Noémie Elhadad. 2014. HARVEST, a longitudinal patient record summarizer. Journal of the American Medical Informatics Association (2014), amiajnl--2014.
[18]
Pamela Hobbs. 2003. The use of evidentiality in physicians' progress notes. Discourse Studies 5, 4 (2003), 451--478.
[19]
Robert R Hoffman, Matthew Johnson, Jeffrey M Bradshaw, and Al Underbrink. 2013. Trust in automation. IEEE Intelligent Systems 28, 1 (2013), 84--88.
[20]
William Hsu, Corey W Arnold, and Ricky K Taira. 2010. A neuro-oncology workstation for structuring, modeling, and visualizing patient records. In Proceedings of the 1st ACM International Health Informatics Symposium. ACM, 837--840.
[21]
William Hsu, Ricky K Taira, Suzie El-Saden, Hooshang Kangarloo, and Alex AT Bui. 2012. Context-based electronic health record: toward patient specific healthcare. IEEE Transactions on information technology in biomedicine 16, 2 (2012), 228--234.
[22]
Kathryn Montgomery Hunter. 1991. Doctors' stories: The narrative structure of medical knowledge. Princeton University Press.
[23]
i2b2 tranSMART Foundation. 2013. Informatics for Integrating Biology & the Bedside. (2013). https://www.i2b2.org/
[24]
SNOMED International. 2002. SNOMED-CT. (2002). http://www.snomed.org/snomed-ct
[25]
Lotte Groth Jensen and Claus Bossen. 2016. Factors affecting physicians' use of a dedicated overview interface in an electronic health record: The importance of standard information and standard documentation. International journal of medical informatics 87 (2016), 44--53.
[26]
Stephen B Johnson, Suzanne Bakken, Daniel Dine, Sookyung Hyun, Eneida Mendonça, Frances Morrison, Tiffani Bright, Tielman Van Vleck, Jesse Wrenn, and Peter Stetson. 2008. An electronic health record based on structured narrative. Journal of the American Medical Informatics Association 15, 1 (2008), 54--64.
[27]
Thai Le, B Reeder, H Thompson, G Demiris, and others. 2013. Health providers' perceptions of novel approaches to visualizing integrated health information. Methods of information in medicine 52, 3 (2013), 250--258.
[28]
Steven Loria. 2013. TextBlob: Simplified Text Processing. (2013). https://textblob.readthedocs.io
[29]
Troels Mønsted. 2015. Keeping Distributed Care Together: Medical Summaries Reconsidered. In ECSCW 2015: Proceedings of the 14th European Conference on Computer Supported Cooperative Work, 19--23 September 2015, Oslo, Norway. Springer, 143--161.
[30]
Troels Mønsted, Madhu C Reddy, and Jørgen P Bansler. 2011. The use of narratives in medical work: a field study of physician-patient consultations. In ECSCW 2011: Proceedings of the 12th European Conference on Computer Supported Cooperative Work, 24--28 September 2011, Aarhus Denmark. Springer, 81--100.
[31]
Glenn Munkvold and Monica Divitini. 2006. From storytelling to reporting-converted narratives. In Proceedings of MCIS'06, the Mediterranean Conference on Information Systems.
[32]
Else Nygren and Peter Henriksson. 1992. Reading the medical record. I. Analysis of physician's ways of reading the medical record. Computer methods and programs in biomedicine 39, 1 (1992), 1--12.
[33]
Julian Oates, W Wayne Weston, and John Jordan. 2000. The impact of patient-centered care on outcomes. Fam Pract 49 (2000), 796--804.
[34]
Heekyong Park and Jinwook Choi. 2012. V-model: a new innovative model to chronologically visualize narrative clinical texts. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 453--462.
[35]
Heekyong Park and Jinwook Choi. 2014. V-Model: a new perspective for EHR-based phenotyping. BMC medical informatics and decision making 14, 1 (2014), 90.
[36]
Rimma Pivovarov and Noémie Elhadad. 2015. Automated methods for the summarization of electronic health records. Journal of the American Medical Informatics Association 22, 5 (2015), 938--947.
[37]
Catherine Plaisant, Brett Milash, Anne Rose, Seth Widoff, and Ben Shneiderman. 1996. LifeLines: visualizing personal histories. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 221--227.
[38]
Catherine Plaisant, Rich Mushlin, Aaron Snyder, Jia Li, Daniel Heller, and Ben Shneiderman. 1998. LifeLines: using visualization to enhance navigation and analysis of patient records. In Proceedings of the AMIA Symposium. American Medical Informatics Association, 76.
[39]
Stephanie E Pollard, Pamela M Neri, Allison R Wilcox, Lynn A Volk, Deborah H Williams, Gordon D Schiff, Harley Z Ramelson, and David W Bates. 2013. How physicians document outpatient visit notes in an electronic health record. International journal of medical informatics 82, 1 (2013), 39--46.
[40]
Seth M Powsner and Edward R Tufte. 1994. Graphical summary of patient status. The Lancet 344, 8919 (1994), 386--389.
[41]
Daniel Reichert, David Kaufman, Benjamin Bloxham, Herbert Chase, Noémie Elhadad, and others. 2010. Cognitive analysis of the summarization of longitudinal patient records. In AMIA annu symp proc, Vol. 2010. 667--671.
[42]
Alexander Rind, Taowei David Wang, Wolfgang Aigner, Silvia Miksch, Krist Wongsuphasawat, Catherine Plaisant, Ben Shneiderman, and others. 2013. Interactive information visualization to explore and query electronic health records. Foundations and Trends® in Human-Computer Interaction 5, 3 (2013), 207--298.
[43]
S Trent Rosenbloom, Joshua C Denny, Hua Xu, Nancy Lorenzi, William W Stead, and Kevin B Johnson. 2011. Data from clinical notes: a perspective on the tension between structure and flexible documentation. Journal of the American Medical Informatics Association 18, 2 (2011), 181--186.
[44]
Huibert J Tange, Arie Hasman, Pieter F de Vries Robbé, and Harry C Schouten. 1997. Medical narratives in electronic medical records. International journal of medical informatics 46, 1 (1997), 7--29.
[45]
Huibert J Tange, Harry C Schouten, Arnold DM Kester, and Arie Hasman. 1998. The granularity of medical narratives and its effect on the speed and completeness of information retrieval. Journal of the American Medical Informatics Association 5, 6 (1998), 571--582.
[46]
Gaurav Trivedi, Phuong Pham, Wendy Chapman, Rebecca Hwa, Janyce Wiebe, and Harry Hochheiser. 2017. An Interactive Tool for Natural Language Processing on Clinical Text. arXiv preprint arXiv:1707.01890 (2017).
[47]
Lauren Wilcox, Jie Lu, Jennifer Lai, Steven Feiner, and Desmond Jordan. 2010. Physician-driven management of patient progress notes in an intensive care unit. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1879--1888.
[48]
Xiaomu Zhou, Mark S Ackerman, and Kai Zheng. 2009. I just don't know why it's gone: maintaining informal information use in inpatient care. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2061--2070.

Cited By

View all
  • (2024)Seeing Your Stories: Visualization for Narrative MedicineHealth Data Science10.34133/hds.01034Online publication date: 23-Jan-2024
  • (2024)Assembling the Puzzle: Exploring Collaboration and Data Sensemaking in Nursing Practices for Remote Patient MonitoringCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681866(296-302)Online publication date: 11-Nov-2024
  • (2024)TextVista: NLP-Enriched Time-Series Text Data VisualizationsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670971(1-12)Online publication date: 3-Jun-2024
  • Show More Cited By

Index Terms

  1. More Text Please! Understanding and Supporting the Use of Visualization for Clinical Text Overview

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
      April 2018
      8489 pages
      ISBN:9781450356206
      DOI:10.1145/3173574
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 April 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. clinical overview
      2. clinical text
      3. medical narrative
      4. medical visualization
      5. medicine
      6. text visualization
      7. user study

      Qualifiers

      • Research-article

      Funding Sources

      • NSERC

      Conference

      CHI '18
      Sponsor:

      Acceptance Rates

      CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;
      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)120
      • Downloads (Last 6 weeks)10
      Reflects downloads up to 16 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Seeing Your Stories: Visualization for Narrative MedicineHealth Data Science10.34133/hds.01034Online publication date: 23-Jan-2024
      • (2024)Assembling the Puzzle: Exploring Collaboration and Data Sensemaking in Nursing Practices for Remote Patient MonitoringCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681866(296-302)Online publication date: 11-Nov-2024
      • (2024)TextVista: NLP-Enriched Time-Series Text Data VisualizationsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670971(1-12)Online publication date: 3-Jun-2024
      • (2024)From Text to Treatment: How Medical Discharge Letters Are Used as a Key Artifact for Managing Patient CareProceedings of Mensch und Computer 202410.1145/3670653.3670665(99-110)Online publication date: 1-Sep-2024
      • (2024)Explainable Notes: Examining How to Unlock Meaning in Medical Notes with Interactivity and Artificial IntelligenceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642573(1-19)Online publication date: 11-May-2024
      • (2024)ChatKG: Visualizing time-series patterns aided by intelligent agents and a knowledge graphComputers & Graphics10.1016/j.cag.2024.104092124(104092)Online publication date: Nov-2024
      • (2023)MediCoSpace: Visual Decision-Support for Doctor-Patient Consultations using Medical Concept Spaces from EHRsACM Transactions on Management Information Systems10.1145/356427514:2(1-20)Online publication date: 25-Jan-2023
      • (2023) ChartWalk : Navigating large collections of text notes in electronic health records for clinical chart review IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320944429:1(1244-1254)Online publication date: Jan-2023
      • (2023)Patient Dashboards of Electronic Health Record Data to Support Clinical Care: A Systematic Review2023 IEEE 11th International Conference on Healthcare Informatics (ICHI)10.1109/ICHI57859.2023.00060(407-419)Online publication date: 26-Jun-2023
      • (2023)Using Knowledge Construction Theory to Evaluate Learning Processes: A Randomized Controlled Trial on Showing Gradually Built-up Concept Maps Alongside a Scientific TextInternational Journal of Human–Computer Interaction10.1080/10447318.2023.228929640:24(8764-8780)Online publication date: 26-Dec-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media