Skip to main content
Log in

Monitoring Perioperative Services Using 3D Multi-Objective Performance Frontiers

  • Systems-Level Quality Improvement
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

The Acute Care Surgery model has been widely adopted by hospitals across the United States, with Acute Care Surgery services managing Emergency General Surgery patients that were previously being treated by General Surgery. In this analysis, we evaluate the impact of an Acute Care Surgery service model on General Surgery at the University of Vermont Medical Center using three metrics: under-utilized time, spillover time, and a financial ratio of work Relative Value Units over clinical Full Time Equivalents. These metrics are evaluated and used to identify three-dimensional Pareto optimality of General Surgery prior to and after the October 2015 tactical allocation to the Acute Care Surgery model. Our analysis was further substantiated using a Markov Chain Monte Carlo model for Bayesian Inference. We applied multi-objective Pareto and Bayesian breakpoint analysis to three operating room metrics to assess the impact of new operating room management decisions. In the two-dimensional space of Fig. 2, panel a), the post-tactical allocation front lies closer to the origin representing more optimal solutions for productivity and under-utilized time. The post-tactical allocation front is also closer to the origin for productivity and spillover time as shown in the two-dimensional space of Fig. 2, panel b). The results of the three-dimensional multi-objective analysis of Fig. 3 illustrate that the GS post-tactical allocation Pareto-surface is contained within a much smaller volume of space than the GS pre-tactical allocation Pareto-surface. The post-tactical allocation Pareto-surface is slightly lower along the z-axis, representing lower productivity than the pre-tactical allocation surface. This methodology might contribute to the external benchmarking and monitoring of perioperative services by visualizing the operational implications following tactical decisions in operating room management.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Strum DP, Vargas LG, May JH, Bashein G. Surgical suite utilization and capacity planning: a minimal cost analysis model. J. Med. Syst. 1997; 21(5): 309–22.

    Article  CAS  Google Scholar 

  2. Pandit JJ, Westbury S, Pandit M. The concept of a surgical operating list ‘efficiency’: a formla to describe the term. Anaesth 2007 Sep; 62(9): 895–903.

    Article  CAS  Google Scholar 

  3. Fixler T, Wright J. Identification and use of operating room efficiency indicators: the problem of definition. Can. J. Surg. 2013; 56(4): 224–6. doi:https://doi.org/10.1503/cjs.020712.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Macario A. Are your hospital operating rooms “efficient”?: A scoring system with eight performance indicators. Anesthesiology. 2006; 105(2): 237–40. doi:https://doi.org/10.1097/00000542-200,608,000-00004.

    Article  PubMed  Google Scholar 

  5. Gabriel RA, Gimlich R, Ehrenfeld JM, Urman RD. Operating room metrics score card—creating a prototype for individualized feedback. J. Med. Syst.. 2014; 38(11). https://doi.org/10.1007/s10916-014-0144-8.

  6. Paine AN, Andritsos DA, Fitzgerald JR, Norotsky MC, Malhotra AK, Tsai MH. The operational impact of an acute care surgical service on operating room metrics. Perioper. Care Oper. Room Manag. 2017; 8:38–41. doi:https://doi.org/10.1016/j.pcorm.2017.09.002.

    Article  Google Scholar 

  7. Westbury S, Pandit M, Pandit JJ. Matching surgical operating capacity to demand using estimates of operating times. J. Health Organ. Manag. 2009; 23(5): 554–67.

    Article  Google Scholar 

  8. Tsai MH, Breidenstein MW, Flanagan TF, et al. Applying performance frontiers in operating room management. A & A Practice. 2018;11(11):321–327. doi:https://doi.org/10.1213/xaa.0000000000000873.

    Article  PubMed  Google Scholar 

  9. Mcintosh C, Dexter F, Epstein RH. The impact of service-specific staffing, case scheduling, turnovers, and first-case starts on anesthesia group and operating room productivity: a tutorial using data from an Australian hospital. Anesth. Analg. 2008; 103(6): 1499–516.

    Article  Google Scholar 

  10. Wai PY, Ohern T, Andersen DO, et al. Impact of business infrastructure on financial metrics in departments of surgery. Surgery. 2012; 152(4):729–737. doi:https://doi.org/10.1016/j.surg.2012.07.025.

    Article  PubMed  Google Scholar 

  11. Lu Y, Arenson RL. The academic radiologist’s clinical productivity. Acad. Radiol. 2005; 12(9):1211–1223. doi:https://doi.org/10.1016/j.acra.2005.05.015.

    Article  PubMed  Google Scholar 

  12. Wierzbicki AP. The use of reference objectives in multiobjective optimization. Lecture Notes in Economics and Mathematical Systems Multiple Criteria Decision Making Theory and Application. 1980:468–486. doi:https://doi.org/10.1007/978-3-642-48,782-8_32.

  13. Raja SN, Dexter F, Macario A, Traub RD, Lubarsky DA. Operating room utilization alone is not an accurate metric for the allocation of operating room block time to individual surgeons with low caseloads. Anesthesiology. 2003;98(5):1243–1249. doi:https://doi.org/10.1097/00000542-200,305,000-00029.

    Article  Google Scholar 

  14. Wachtel RE, Dexter F. Tactical increases in operating room block time for capacity planning should not be based on utilization. Anesth. Analg. 2008;106(1):215–226. doi:https://doi.org/10.1213/01.ane.0000289641.92927.b9.

    Article  PubMed  Google Scholar 

  15. Mahajan A, Islam SD, Schwartz MJ, Cannesson M. A hospital is not just a factory, but a complex adaptive system—implications for perioperative care. Anesth. Analg. 2017; 125(1):333–341. doi:https://doi.org/10.1213/ane.0000000000002144.

    Article  PubMed  Google Scholar 

  16. Romer PM. Mathiness in the theory of economy growth. Am. Econ. Rev. 2005; 105(5): 89–93.

    Article  Google Scholar 

  17. https://www.rcoa.ac.uk/sites/default/files/documents/2020-08/21075%20RCoA%20Audit%20Recipe%20Book_Combined_Final_25.08.2020_0.pdf. Accessed on January 10, 2021.

  18. Pandit JJ, Stubbs D, Pandit M. Measuring the quantitative performance of surgical operating lists: theoretical modeling of ‘productive potential’ and ‘efficiency’. Anaesth 2009; 64(5): 473–486.

    Article  CAS  Google Scholar 

Download references

Funding

Partial support provided by Vermont EPSCoR, with funds from the National Science Foundation (NSF) Grant OIA-1556770, is acknowledged.

Author information

Authors and Affiliations

Authors

Contributions

Andrea J. Elhajj The author helped design the study, analyze the data, and prepare the manuscript.

Donna M. Rizzo The author helped prepare the manuscript and provided critical edits.

Gary C. An The author helped prepare the manuscript and provided critical edits.

Jaideep J. Pandit The author helped prepare the manuscript and provided critical edits.

Mitchell H. Tsai The author helped design and prepare the manuscript. He is the corresponding and archival author.

Corresponding author

Correspondence to Mitchell H. Tsai.

Ethics declarations

Conflict of interest

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Accepted as an abstract presentation for the International Anesthesia Research Society 2020 Annual Meeting and International Science Symposium, San Francisco, CA

This article is part of the Topical Collection on Systems-Level Quality Improvement

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Elhajj, A.J., Rizzo, D.M., An, G.C. et al. Monitoring Perioperative Services Using 3D Multi-Objective Performance Frontiers. J Med Syst 45, 34 (2021). https://doi.org/10.1007/s10916-021-01713-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-021-01713-y

Keywords

Navigation