skip to main content
research-article

Understanding Delay Awareness and Mitigation Mechanisms through an Iterative Design and Evaluation of a Prototype Alert System for Complex Teamwork

Published:04 October 2023Publication History
Skip Abstract Section

Abstract

Almost half of the preventable deaths in emergency care can be associated with a medical delay. Understanding how clinicians experience delays can lead to improved alert designs to increase delay awareness and mitigation. In this paper, we present the findings from an iterative user-centered design process involving 48 clinicians to develop a prototype alert system for supporting delay awareness in complex medical teamwork such as trauma resuscitation. We used semi-structured interviews and card-sorting workshops to identify the most common delays and elicit design requirements for the prototype alert system. We then conducted a survey to refine the alert designs, followed by near-live, video-guided simulations to investigate clinicians' reactions to the alerts. We contribute to CSCW by designing a prototype alert system to support delay awareness in time-critical, complex teamwork and identifying four mechanisms through which teams mitigate delays.

References

  1. Patricia S. Abril and Robert Plant. 2007. The patent holder's dilemma: Buy, sell, or troll? Communications of the ACM, Vol. 1, 36--44. http://dx.doi.org/10.1145/1188913.1188915Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Chitra Acharya, Harold Thimbleby, and Patrick Oladimeji. 2010. Human computer interaction and medical devices. Proceedings of the 24th BCS Interaction Specialist Group Conference (BCS '10). BCS Learning & Development Ltd., Swindon, GBR, 168--176.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Advanced Trauma Life Support. 2018. Chicago, IL: American College of Surgeons.Google ScholarGoogle Scholar
  4. Joshua Avalos, Debrina Roy, Onur Asan, and Yiqi Zhang. 2021. The influential factors on nurses' situation awareness in inpatient settings: A literature review. Human Factors in Healthcare Vol. 1 (2021). http://dx.doi.org/10.1016/j.hfh.2022.100006Google ScholarGoogle ScholarCross RefCross Ref
  5. Ian Akyildiz, Weilan Su, Yogesh Sankarasubramaniam, and Erdal Cayirci. 2002. Wireless Sensor Networks: A Survey. Computer Networks, Vol. 38, 4 (2002), 393--422. https://doi.org/10.1016/S1389--1286(01)00302--4Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. David A. Anisi. 2003. Optimal motion control of a ground vehicle. Master's Thesis. Royal Institute of Technology (KTH), Stockholm, Sweden.Google ScholarGoogle Scholar
  7. Paramir Bahl, Ranveer Chandra, and John Dunagan. 2004. SSCH: Slotted seeded channel hopping for capacity improvement in IEEE 802.11 ad-hoc wireless networks. In Proceedings of the 10th International Conference on Mobile Computing and Networking (MobiCom'04). ACM, New York, NY, 112--117. https://doi.org/10.1145/1023720.1023742Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Jakob E. Bardram. 2000. Temporal coordination --on time and coordination of collaborative activities at a surgical department. Computer Supported Cooperative Work (CSCW) Vol. 9, 2 (2000), 157--187. http://dx.doi.org/10.1023/a:1008748724225Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jakob E. Bardram, Thomas R. Hansen, and Mads Soegaard. 2006. AwareMedia: a shared interactive display supporting social, temporal, and spatial awareness in surgery. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work (CSCW '06). Association for Computing Machinery, New York, NY, USA, 109--118. https://doi.org/10.1145/1180875.1180892Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Martina Buljac-Samardzic, et al. 2020. Interventions to improve team effectiveness within health care: a systematic review of the past decade. Human Resources Health. Vol. 18, 1, 1--42. https://doi.org/10.1186/s12960-019-0411--3.Google ScholarGoogle ScholarCross RefCross Ref
  11. Martina Buljac-Samard?i?, et al. 2021. What do we really know about crew resource management in healthcare? An umbrella review on crew resource management and its effectiveness. Journal of Patient Safety, Vol. 17, 8. e929-e958. https://doi.org/10.1097/PTS.0000000000000816Google ScholarGoogle ScholarCross RefCross Ref
  12. Barbara Burian and R. Key Dismukes. 2020. Why we fail to rescue during critical events. Anesthesiology Clinics Vol. 38, 727--743. https://doi.org/10.1016/j.anclin.2020.08.009Google ScholarGoogle ScholarCross RefCross Ref
  13. Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Federico Cabitza, Carla Simone, Marcello Sarini. 2009. Leveraging coordinative conventions to promote collaboration awareness. Computer Supported Cooperative Work (CSCW), Vol. 18, 301--330. https://doi.org/10.1007/s10606-009--9093-zGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  15. Federico Cabitza, Marcello Sarini, and Carla Simone. 2007. Providing awareness through situated process maps: the hospital care case. In Proceedings of the 2007 ACM International Conference on Supporting Group Work (GROUP '07). Association for Computing Machinery, New York, NY, USA, 41--50. https://doi.org/10.1145/1316624.1316631Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Carrie J. Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S. Corrado, Martin C. Stumpe, and Michael Terry. 2019. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Paper 4, 1--14. https://doi.org/10.1145/3290605.3300234Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Francisco Maria Calisto, Nuno Nunes, and Jacinto C. Nascimento. 2020. BreastScreening: On the use of multi-modality in medical imaging diagnosis. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '20). Association for Computing Machinery, New York, NY, USA, Article 49, 1--5. https://doi.org/10.1145/3399715.3399744Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, Jacinto C. 2021. Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification. International Journal of Human-Computer Studies, Vol. 150, 102607. https://doi.org/10.1016/j.ijhcs.2021.102607Google ScholarGoogle ScholarCross RefCross Ref
  19. Francisco Maria Calisto, Carlos Santiago, Nuno Nunes, Jacinto C. 2022. BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions. Artificial Intelligence Medicine, Vol. 127, 102285. https://doi.org/10.1016/j.artmed.2022.102285.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. John M. Carroll, Mary Beth Rosson, Gregorio Convertino, and Craig H. Ganoe. 2006. Awareness and teamwork in computer-supported collaborations. Interacting with Computers Vol. 18, 1, 21--46. http://dx.doi.org/10.1016/j.intcom.2005.05.005Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Christian Castaneda, Kip Nalley, Ciaran Mannion, Pritish Bhattacharyya, Patrick Blake, Andrew Pecora, Andre Goy, and K Stephen Suh. 2015. Clinical decision support systems for improving diagnostic accuracy and achieving precision medicine. Journal of Clinical Bioinformatics, Vol. 5, 1, 1--16. https://doi.org/10.1186/s13336-015-0019--3Google ScholarGoogle ScholarCross RefCross Ref
  22. John R. Clarke, Stanley Z. Trooskin, Prashant J. Doshi, Lloyd Greenwald, and Charles J. Mode. 2002. Time to laparotomy for intra-abdominal bleeding from trauma does affect survival for delays up to 90 minutes. The Journal of Trauma: Injury, Infection, and Critical Care Vol. 52, 3, 420--425. http://dx.doi.org/10.1097/00005373--200203000-00002Google ScholarGoogle ScholarCross RefCross Ref
  23. Jacques Cohen. 1996. Special Issue: Digital Libraries. Communications of the ACM, Vol. 39, 11 (November 1996).Google ScholarGoogle Scholar
  24. Kadian Davis, Evans Owusu, Jun Hu, Lucio Marcenaro, Carlo Regazzoni, and Loe Feijs. 2016. Promoting social connectedness through human activity-based ambient displays. In Proceedings of the International Symposium on Interactive Technology and Ageing Populations (ITAP '16). Association for Computing Machinery, New York, NY, USA, 64--76. https://doi.org/10.1145/2996267.2996274Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Nicholas P Dempsey. Simulated recall interviews in ethnography. Qualitative Sociology Vol. 33, 349--367 (2010). https://doi.org/10.1007/s11133-010--9157-xGoogle ScholarGoogle ScholarCross RefCross Ref
  26. R. Key Dismukes, Janeen A. Kochan, and Timothy E. Goldsmith. 2018. Flight crew errors in challenging and stressful situations. Aviation Psychology and Applied Human Factors, Vol. 8, 1, 35--46. https://doi.org/10.1027/2192-0923/a000129Google ScholarGoogle ScholarCross RefCross Ref
  27. David Drummond, et al. 2016. An innovative pedagogic course combining video and simulation to teach medical students about pediatric cardiopulmonary arrest: a prospective controlled study. European Journal of Pediatrics, Vol. 175, 6, 767--74. https://doi.org/10.1007/s00431-016--2702--1Google ScholarGoogle ScholarCross RefCross Ref
  28. Lesley Curtis, Ewoud Ter Avest, Joanne Griggs, Richard Lyon. (2020). The ticking clock: does actively making an enhanced care team aware of the passage of time improve pre-hospital scene time following traumatic incidents? Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine. Vol. 28, 1, 1--8. https://doi.org/10.1186/s13049-020-00726--9Google ScholarGoogle ScholarCross RefCross Ref
  29. Bruce P. Douglass. 1998. Statecarts in use: structured analysis and object-orientation. In Lectures on Embedded Systems, Grzegorz Rozenberg and Frits W. Vaandrager (Eds.). Lecture Notes in Computer Science, Vol. 1494, 368--394. http://dx.doi.org/10.1145/3--540--65193--429Google ScholarGoogle ScholarCross RefCross Ref
  30. Marc A Ellsworth, et al. 2017. An appraisal of published usability evaluations of electronic health records via systematic review. Journal of the American Medical Informatics Association: JAMIA Vol. 24, 1 (2017), 218--226. https://doi.org/10.1093/jamia/ocw046Google ScholarGoogle ScholarCross RefCross Ref
  31. Mica Endsley. 1995. Toward a theory of situation awareness in dynamic systems." Human Factors, Vol. 37, 1, 32--64. https://doi-org/10.1518/001872095779049543Google ScholarGoogle ScholarCross RefCross Ref
  32. Sofia Erestam, et al. A survey of surgeons' perception and awareness of intraoperative time utilization. Patient Safety in Surgery Vol. 8, 30, 1--6. https://doi.org/10.1186/1754--9493--8--30Google ScholarGoogle ScholarCross RefCross Ref
  33. You Fang, Yan Xu, Jun Zhang, and Wei Cui. 2022. Design factors of shared situation awareness interface in human--machine co-driving. Information Vol. 13, 9, 437--454. https://doi.org/10.3390/info13090437Google ScholarGoogle ScholarCross RefCross Ref
  34. Ben Green, David Parry, and Rachel Oeppen. 2016. Situational awareness - what it means for clinicians, its recognition and importance in patient safety. Oral Diseases Vol. 23, 6, 721--725. http://dx.doi.org/10.1111/odi.12547Google ScholarGoogle ScholarCross RefCross Ref
  35. Paul R. Greig, Danaja Zolger, Desire N. Onwochei, Neal Thurley, Helen Higham, and Neel Desai. 2022. Cognitive aids in the management of clinical emergencies: A systematic review. Anaesthesia (First published 14 December 2022). http://dx.doi.org/10.1111/anae.15939Google ScholarGoogle ScholarCross RefCross Ref
  36. Vincent Grosjean and Patrice Terrier. 1999. Temporal awareness: pivotal in performance? Ergonomics, Vol. 42, 11, 1443--1456, https://doi.org/10.1080/001401399184802Google ScholarGoogle ScholarCross RefCross Ref
  37. Gregory Gruen, et al. 2006. Patterns of errors contributing to trauma mortality. Annals of Surgery Vol. 244, 3, 371--80. https://doi.org/10.1097/01.sla.0000234655.83517.56Google ScholarGoogle ScholarCross RefCross Ref
  38. Miguel Cabral Guerra, Deedee Kommers, Saskia Bakker, Pengcheng An, Carola van Pul, and Peter Andriessen. 2019. Beepless. Proceedings of the 2019 on Designing Interactive Systems Conference (DIS'19). http://dx.doi.org/10.1145/3322276.3323696Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Carl Gutwin, et al. 2002. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work, Vol. 11, 3--4, 411--446. https://dl.eusset.eu/handle/20.500.12015/3612Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Christian Heath, Marcus Sanchez Svensson, Jon Hindmarsh, Paul Luff, and Dirk Vom Lehn. 2002. Configuring awareness. Computer Supported Cooperative Work (CSCW) Vol. 11, 3, 317--347. https://doi.org/10.1023/A:1021247413718Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Sarah E. Henrickson Parker, Aaron A. Laviana, Rishi K. Wadhera, Douglas A. Wiegmann, and Thoralf M. Sundt. 2010. Development and evaluation of an observational tool for assessing surgical flow disruptions and their impact on surgical performance. World Journal of Surgery 34, 2, 353--361. http://dx.doi.org/10.1007/s00268-009-0312-zGoogle ScholarGoogle ScholarCross RefCross Ref
  42. Stephen G Henry and Michael G Fetters. 2012. Video elicitation interviews: a qualitative research method for investigating physician-patient interactions. Annals of Family Medicine, vol. 10, 2, 118--25. https://doi.org/10.1370/afm.1339Google ScholarGoogle ScholarCross RefCross Ref
  43. Richard J. Holden, Pascale Carayon, Ayse P. Gurses, Peter Hoonakker, Ann Schoofs Hundt, A. Ant Ozok and A. Joy Rivera-Rodriguez. 2013. SEIPS 2.0: a human factors framework for studying and improving the work of healthcare professionals and patients. Ergonomics, Vol. 56. 11, 1669--1686. https://doil/org/10.1080/00140139.2013.838643Google ScholarGoogle ScholarCross RefCross Ref
  44. Yue-Yung Hu, Alexander F. Arriaga, Emilie M. Roth, Sarah E. Peyre, Katherine A. Corso, Richard S. Swanson, Robert T. Osteen et al. 2012. Protecting patients from an unsafe system: the etiology & recovery of intra-operative deviations in care. Annals of Surgery, Vol. 256, 2, 203. https://doi.org/10.1097/SLA.0b013e3182602564Google ScholarGoogle ScholarCross RefCross Ref
  45. Patrick G Hughes, Rami A Ahemd. 2019. Blindfolded trauma team resuscitation: A strategy for improved leadership and communication. BMJ Simulation & Technology Enhanced Learning, Vol. 9, 3, 174--175. https://doi.org/10.1136/bmjstel-2017-000277Google ScholarGoogle ScholarCross RefCross Ref
  46. Jennifer Jewer et al. 2019. Evaluation of a mobile telesimulation unit to train rural and remote practitioners on high-acuity low-occurrence procedures: Pilot randomized controlled trial. Journal of Medical Internet Research, Vol. 21, 8, e14587. https://doi.org/10.2196/14587Google ScholarGoogle ScholarCross RefCross Ref
  47. Brennan Jones, Anthony Tang, and Carman Neustaedter. 2020. Remote communication in wilderness search and rescue. Proceedings of the ACM on Human-Computer Interaction Vol. 4, GROUP (2020), 1--26. http://dx.doi.org/10.1145/3375190Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Gregory J. Jurkovich, Diane Campbell, Herry Padtra, and Arnole Luterman. 1987. Paramedic perception of elapsed field time. The Journal of Trauma: Injury, Infection, and Critical Care Vol. 27, 8, 892--897. http://dx.doi.org/10.1097/00005373--198708000-00008Google ScholarGoogle ScholarCross RefCross Ref
  49. Tom Kontogiannis and Stathis Malakis. 2013. Strategies in coping with complexity: Development of a behavioural marker system for air traffic controllers. Safety Science Vol. 57, 27--34. http://dx.doi.org/10.1016/j.ssci.2013.01.014Google ScholarGoogle ScholarCross RefCross Ref
  50. Kali M. Kuhlenschmidt, Elias Choi, et al. 2022. Provider perception of time during trauma resuscitation: A Prospective quantitative trauma video review analysis. The Journal of Surgical Research, Vol. 274, 207--212. https://doi.org/10.1016/j.jss.2021.12.048Google ScholarGoogle ScholarCross RefCross Ref
  51. Diana S. Kusunoki, Aleksandra Sarcevic, Zhan Zhang, and Maria Yala. 2015. Sketching awareness: A participatory study to elicit designs for supporting ad hoc emergency medical teamwork. Computer Supported Cooperative Work (CSCW) Vol. 24, 1, 1--38. https://doi.org/10.1007/s10606-014--9210--5Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Diana S. Kusunoki and Aleksandra Sarcevic. 2015. Designing for temporal awareness. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW'15). http://dx.doi.org/10.1145/2675133.2675279Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Katherine E. Law, Emily A. Hildebrand, Hunter J. Hawthorne, M. Susan Hallbeck, Russell J. Branaghan, Sean C. Dowdy, and Renaldo C. Blocker. 2019. A pilot study of non-routine events in gynecological surgery: Type, impact, and effect. Gynecologic Oncology Vol. 152, 2, 298--303. https://doi.org/10.1016/j.ygyno.2018.11.035Google ScholarGoogle ScholarCross RefCross Ref
  54. Alice C. Li et al. 2012. Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support. International Journal of Medical Informatics, Vol. 81,11, 761--72. https://doi.org/10.1016/j.ijmedinf.2012.02.009Google ScholarGoogle ScholarCross RefCross Ref
  55. Junfeng Liao, Xu Chen, and Qi Zhang. 2018. Research on virtual personality of role playing online game users. Proceedings of the 4th International Conference on Virtual Reality Association for Computing Machinery (ICVR'18), 10--14. https://doi.org/10.1145/3198910.3198913Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Lennart Lovstrand. 1991. Being selectively aware with the Khronika system. Proceedings of the Second European Conference on Computer Supported Cooperative Work (ECSCW'91), 265--277. http://dx.doi.org/10.1007/978--94-011--3506--1_20Google ScholarGoogle ScholarCross RefCross Ref
  57. Paul Luff, Christian Heath, and Marcus Sanchez Svensson. 2008. Discriminating conduct: Deploying systems to support awareness in organizations. International Journal of Human-Computer Interaction, Vol. 24, 4, 410--436. https://doi.org/10.1080/10447310801920490Google ScholarGoogle ScholarCross RefCross Ref
  58. Andrii Matviienko, Maria Rauschenberger, Vanessa Cobus, Janko Timmermann, Jutta Fortmann, Andreas Löcken, Heiko Müller, Christoph Trappe, Wilko Heuten, and Susanne Boll. 2015. Towards new ambient light systems: a close look at existing encodings of ambient light systems. Interaction Design and Architecture(s) Journal, Vol. 26, 10--24.Google ScholarGoogle Scholar
  59. Nicolette McGeorge, Sudeep Hegde, Rebecca L. Berg, Theresa K. Guarrera-Schick, David T. LaVergne, Sabrina N. Casucci, A. Zachary Hettinger, et al. 2015. Assessment of innovative emergency department information displays in a clinical simulation center. Journal of Cognitive Engineering and Decision Making Vol. 9, 4, 329--46. https://doi.org/10.1177/1555343415613723.Google ScholarGoogle ScholarCross RefCross Ref
  60. National Center for Health Statistics. 2020. Leading Causes of Death. National Vital Statistics System. CDCGoogle ScholarGoogle Scholar
  61. Sara Montagna et al. 2020. Complementing agents with cognitive services: A case study in healthcare. Journal of Medical Systems, Vol. 44, 10, 1--10. https://doi.org/10.1007/s10916-020-01621--7Google ScholarGoogle ScholarCross RefCross Ref
  62. Annette Moxey, Jane Robertson, David Newby, Isla Hains, Margaret Williamson, and Sallie-Anne Pearson. 2010. Computerized clinical decision support for prescribing: provision does not guarantee uptake. Journal of the American Medical Informatics Association, Vol. 17, 1, 25--33. https://doi.org/10.1197/jamia.M3170.Google ScholarGoogle ScholarCross RefCross Ref
  63. Roderick Murray-Smith, Antti Oulasvirta, Andrew Howes, Jörg Müller, Aleksi Ikkala, Miroslav Bachinski, Arthur Fleig, Florian Fischer, and Markus Klar. 2022. What simulation can do for HCI research. Interactions, Vol. 29, 6, 48--53. https://doi.org/10.1145/3564038Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Siegfried Müller, Raji Ghawi, and Jürgen Pfeffer. 2021. Using communication networks to predict team performance in massively multiplayer online games. Proceedings of the 12th IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM '20), 353--360. https://doi.org/10.1109/ASONAM49781.2020.9381481Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Thanh Nguyen, Chee Peng Lim, Ngoc Duy Nguyen, Lee Gordon-Brown, and Saeid Nahavandi. 2019. A review of situation awareness assessment approaches in aviation environments. IEEE Systems Journal Vol. 13, 3, 3590--3603. http://dx.doi.org/10.1109/jsyst.2019.2918283Google ScholarGoogle ScholarCross RefCross Ref
  66. Cliodhna O'Connor, and Helene Joffe. Intercoder reliability in qualitative research: Debates and practical guidelines, International Journal of Qualitative Methods, (2020). https://doi.org/10.1177/1609406919899220Google ScholarGoogle ScholarCross RefCross Ref
  67. JaeYeon Park et al. 2021. Disentangling the clinical data chaos: User-centered interface system design for trauma centers. PLoS ONE, Vol. 16, 5, e0251140. https://doi.org/10.1371/journal.pone.0251140Google ScholarGoogle ScholarCross RefCross Ref
  68. Avi Parush, et al. 2017. Can a technological cognitive aid improve teamwork and situational awareness (SA) in ED resuscitation? Design and a pilot study of a team situation display. Journal of Biomedical Informatics Vol. 76, 154--161. https://doi.org/10.1016/j.jbi.2017.10.009Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Nolan B. Petrosoniak, et al. 2021. Defining adverse events during trauma resuscitation: a modified RAND Delphi study. Trauma Surgery Acute Care Open. Vol. 19, 6, e000805. https://doi.org/10.1136/tsaco-2021-000805.Google ScholarGoogle ScholarCross RefCross Ref
  70. Carla M. Pugh, Susan Santacaterina, Debra A DaRosa, and Richard E. Clark. 2011. Intra-operative decision making: More than meets the eye. Journal of Biomedical Informatics. Vol. 44, 3, 486--496. https://doil.org/10.1016/j.jbi.2010.01.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Madhu C. Reddy, Paul Dourish, and Wanda Pratt. Temporality in medical work: Time also matters. Computer Supported Cooperative Work (CSCW), Vol. 15, 1, 29--53. https://doi.org/10.1007/s10606-005--9010-zGoogle ScholarGoogle ScholarCross RefCross Ref
  72. Gordon Rugg and Peter McGeorge. 1997. The sorting techniques: a tutorial paper on card sorts, picture sorts and item sorts. Expert Systems, Vol. 14, 80--93. https://doi.org/10.1111/1468-0394.00045Google ScholarGoogle ScholarCross RefCross Ref
  73. Safiya Richardson et al. 2017. ?Think aloud" and ?Near live" usability testing of two complex clinical decision support tools. International Journal of Medical Informatics Vol. 106, 1--8. http://dx.doi.org/10.1016/j.ijmedinf.2017.06.003Google ScholarGoogle ScholarCross RefCross Ref
  74. Jason J Saleem, Emily S Patterson, Laura Militello, Steve N Asch, Braldey N Doebbeling, and Marta L Render. Using human factors methods to design a new interface for an electronic medical record. AMIA Annual Symposium Proceedings (AMIA'07), 640--644.Google ScholarGoogle Scholar
  75. Kjeld Schmidt and Liam Bannon. 1992. Taking CSCW seriously. Computer Supported Cooperative Work (CSCW) Vol. 1, 1--2, 7--40. http://dx.doi.org/10.1007/bf00752449Google ScholarGoogle ScholarCross RefCross Ref
  76. Lee Soyoung, Tang Charlotte, Park Sun Young, Chen Yunan. 2012. Loosely formed patient care teams: Communication challenges and technology design. Proceedings of the Conference on Computer-Supported Cooperative Work (CSCW'12), 867--876.Google ScholarGoogle Scholar
  77. Wei Shao, Arian Prabowo, Sichen Zhao, Siyu Tan, Piotr Koniusz, Jeffrey Chan, Xinhong Hei, Bradley Feest, and Flora D. Salim. 2019. Flight delay prediction using airport situational awareness map. Proceedings of the 27th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL '19), 432--435. https://doi.org/10.1145/3347146.3359079Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Mark Stefik, Gregg Foster, Daniel G. Bobrow, Kenneth Kahn, Stan Lanning, and Lucy Suchman. 1987. Beyond the chalkboard: computer support for collaboration and problem solving in meetings. Communications of the ACM, Vol.1, 32--47. http://doi.org/10.1145/7885.7887Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Karel Vredenburg, Ji-Ye Mao, Paul W. Smith, and Tom Carey. 2002. A survey of user-centered design practice. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02), 471--478. https://doi.org/10.1145/503376.503460Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Torben Wallbaum, Maria Rauschenberger, Janko Timmermann, Wilko Heuten, and Susanne Boll. 2018. Exploring social awareness. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. http://dx.doi.org/10.1145/3170427.3174365Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. Rachel B Webman, et al. 2016. Classification and team response to nonroutine events occurring during pediatric trauma resuscitation. The Journal of Trauma and Acute Care Surgery, Vol. 81, 4, 666--73. https://doi.org/10.1097/TA.0000000000001196Google ScholarGoogle ScholarCross RefCross Ref
  82. Priscilla West, et al. 2012. Improving patient safety and optimizing nursing teamwork using crew resource management techniques. The Journal of Nursing Administration, Vol. 42,1, 15--20. https://doi.org/10.1097/NNA.0b013e31823c17c7Google ScholarGoogle ScholarCross RefCross Ref
  83. Anping Xie and Carayon Pascale. 2015. A systematic review of human factors and ergonomics (HFE)-based healthcare system redesign for quality of care and patient safety. Ergonomics, Vol. 58,1, 33--49. https://doi.org/10.1080/00140139.2014.959070Google ScholarGoogle ScholarCross RefCross Ref
  84. Xiao Yan, Stephen Schenkel, Samer Faraj, Colin F. MacKenzie, and Jacqueline Moss. 2007. What whiteboards in a trauma center operating suite can teach us about emergency department communication. Annals of Emergency Medicine, Vol. 50, 4, 387--395. https://doi.org/10.1016/j.annemergmed.2007.03.027Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Understanding Delay Awareness and Mitigation Mechanisms through an Iterative Design and Evaluation of a Prototype Alert System for Complex Teamwork

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Human-Computer Interaction
      Proceedings of the ACM on Human-Computer Interaction  Volume 7, Issue CSCW2
      CSCW
      October 2023
      4055 pages
      EISSN:2573-0142
      DOI:10.1145/3626953
      Issue’s Table of Contents

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 October 2023
      Published in pacmhci Volume 7, Issue CSCW2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
    • Article Metrics

      • Downloads (Last 12 months)124
      • Downloads (Last 6 weeks)23

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader