Skip to main content

An Interpretable Machine Learning Approach to Prioritizing Factors Contributing to Clinician Burnout

  • Conference paper
  • First Online:
Foundations of Intelligent Systems (ISMIS 2022)

Abstract

Clinician burnout is a multi-factorial problem, and there are limited studies utilizing a theoretical model to assess factors contributing to clinician burnout. A survey of demographic characteristics and work system factors was administered to 278 clinicians (participation rate: 55%). We compare four classifiers with four feature selection methods to predict clinician burnout. We used SHapley Additive exPlanations (SHAP) and permutation importance to prioritize key factors contributing to clinician burnout and interpret the predictions. Random forest had the highest AUC of 0.82 with work system factors only. Six work system factors (administrative burden, excessive workload, inadequate staffing, professional relationship, intrinsic motivation, and values and expectations) and one demographic factor (race) had the highest impact on predicting clinician burnout. Identifying and prioritizing key factors to mitigate clinician burnout is essential for healthcare systems to allocate resources and improve patient safety and quality of care.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rotenstein, L.S., Torre, M., Ramos, M.A., et al.: Prevalence of burnout among physicians: a systematic review. JAMA 320, 1131–1150 (2018). https://doi.org/10.1001/jama.2018.12777

    Article  Google Scholar 

  2. Leo, C.G., Sabina, S., Tumolo, M.R., et al.: Burnout among healthcare workers in the COVID 19 era: a review of the existing literature. Front. Publ. Health 9, 750529 (2021). https://doi.org/10.3389/fpubh.2021.750529

    Article  Google Scholar 

  3. Lost on the frontline: US healthcare workers who died fighting Covid-19—US news—The Guardian. https://www.theguardian.com/us-news/ng-interactive/2020/aug/11/lost-on-the-frontline-covid-19-coronavirus-us-healthcare-workers-deaths-database. Accessed 16 June 2022

  4. Shanafelt, T.D., Balch, C.M., Bechamps, G., et al.: Burnout and medical errors among American surgeons. Ann. Surg. 251, 995–1000 (2010). https://doi.org/10.1097/SLA.0b013e3181bfdab3

    Article  Google Scholar 

  5. Shanafelt, T.D.: Finding meaning, balance, and personal satisfaction in the practice of oncology. J. Support Oncol. 3(157–62), 164 (2005)

    Google Scholar 

  6. Shanafelt, T.D., Hasan, O., Dyrbye, L.N., et al.: Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014. Mayo Clin. Proc. 90, 1600–1613 (2015). https://doi.org/10.1016/j.mayocp.2015.08.023

    Article  Google Scholar 

  7. Dewa, C.S., Loong, D., Bonato, S., et al.: How does burnout affect physician productivity? A systematic literature review. BMC Health Serv. Res. 14, 325 (2014). https://doi.org/10.1186/1472-6963-14-325

    Article  Google Scholar 

  8. Han, S., Shanafelt, T.D., Sinsky, C.A., et al.: Estimating the attributable cost of physician burnout in the United States. Ann. Int. Med. 170, 784–790 (2019). https://doi.org/10.7326/M18-1422

    Article  Google Scholar 

  9. De Hert, S.: Burnout in healthcare workers: prevalence, impact and preventative strategies. Local Reg. Anesth. 13, 171–183 (2020). https://doi.org/10.2147/LRA.S240564

    Article  Google Scholar 

  10. National Academies of Sciences, Engineering, and Medicine; National Academy of Medicine; Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well-Being: Taking Action Against Clinician Burnout: A Systems Approach to Professional Well-Being. National Academies Press (US), Washington (DC) (2019)

    Google Scholar 

  11. West, C.P., Shanafelt, T.D., Kolars, J.C.: Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA 306, 952–960 (2011). https://doi.org/10.1001/jama.2011.1247

    Article  Google Scholar 

  12. Shanafelt, T.D., Noseworthy, J.H.: Executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin. Proc. 92, 129–146 (2017). https://doi.org/10.1016/j.mayocp.2016.10.004

    Article  Google Scholar 

  13. Lee, Y.-L., Chou, W., Chien, T.-W., et al.: An app developed for detecting nurse burnouts using the convolutional neural networks in Microsoft excel: population-based questionnaire study. JMIR Med. Inform. 8, e16528 (2020). https://doi.org/10.2196/16528

    Article  Google Scholar 

  14. Kurbatov, V., Shaughnessy, M., Baratta, V., et al.: Application of advanced bioinformatics to understand and predict burnout among surgical trainees. J. Surg. Educ. 77, 499–507 (2020). https://doi.org/10.1016/j.jsurg.2019.11.008

    Article  Google Scholar 

  15. Nishi, M., Yamano, M., Matoba, S.: Prediction of well-being and insight into work-life integration among physicians using machine learning approach. PLoS ONE 16, e0254795 (2021). https://doi.org/10.1371/journal.pone.0254795

    Article  Google Scholar 

  16. Maslach, C., Jackson, S.E., Leiter, M.P.: Maslach burnout inventory. psycnet.apa.org (1997)

    Google Scholar 

  17. Crum, E.: Clinicians and payers expect to wait and see before embracing CMS MIPS value pathways. Am J. Manag. Care 27, SP245–SP246 (2021). https://doi.org/10.37765/ajmc.2021.88735

  18. Li-Sauerwine, S., Rebillot, K., Melamed, M., et al.: A 2-question summative score correlates with the Maslach burnout inventory. West J. Emerg. Med. 21, 610–617 (2020). https://doi.org/10.5811/westjem.2020.2.45139

    Article  Google Scholar 

  19. Rengasamy, D., Rothwell, B.C., Figueredo, G.P.: Towards a more reliable interpretation of machine learning outputs for safety-critical systems using feature importance fusion. Appl. Sci. 11, 11854 (2021). https://doi.org/10.3390/app112411854

    Article  Google Scholar 

  20. Alvarez-Melis, D., Jaakkola, T.S.: On the robustness of interpretability methods. arXiv. https://doi.org/10.48550/arxiv.1806.08049 (2018)

  21. Strobl, C., Boulesteix, A.-L., Zeileis, A., Hothorn, T.: Bias in random forest variable importance measures: illustrations, sources and a solution. BMC Bioinform. 8, 25 (2007). https://doi.org/10.1186/1471-2105-8-25

    Article  Google Scholar 

  22. Hooker, G., Mentch, L., Zhou, S.: Unrestricted permutation forces extrapolation: variable importance requires at least one more model, or there is no free variable importance. arXiv https://doi.org/10.48550/arxiv.1905.03151 (2019)

  23. Orlenko, A., Moore, J.H.: A comparison of methods for interpreting random forest models of genetic association in the presence of non-additive interactions. BioData Min. 14, 9 (2021). https://doi.org/10.1186/s13040-021-00243-0

    Article  Google Scholar 

  24. Edwards, S.T., Helfrich, C.D., Grembowski, D., et al.: Task delegation and burnout trade-offs among primary care providers and nurses in Veterans affairs patient aligned care teams (VA PACTs). J. Am. Board Fam. Med. 31, 83–93 (2018). https://doi.org/10.3122/jabfm.2018.01.170083

    Article  Google Scholar 

  25. Helfrich, C.D., et al.: The association of team-specific workload and staffing with odds of burnout among VA primary care team members. J. Gen. Intern. Med. 32(7), 760–766 (2017). https://doi.org/10.1007/s11606-017-4011-4

    Article  Google Scholar 

  26. Garcia, L.C., Shanafelt, T.D., West, C.P., et al.: Burnout, depression, career satisfaction, and work-life integration by physician race/ethnicity. JAMA Netw. Open 3, e2012762 (2020). https://doi.org/10.1001/jamanetworkopen.2020.12762

    Article  Google Scholar 

  27. Villanueva, A.M., Kaye, D., Abdelhak, S.S., Morahan, P.S.: Comparing selection criteria of residency directors and physicians’ employers. Acad. Med. 70, 261–271 (1995). https://doi.org/10.1097/00001888-199504000-00008

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Malvika Pillai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pillai, M., Adapa, K., Foster, M., Kratzke, I., Charguia, N., Mazur, L. (2022). An Interpretable Machine Learning Approach to Prioritizing Factors Contributing to Clinician Burnout. In: Ceci, M., Flesca, S., Masciari, E., Manco, G., RaÅ›, Z.W. (eds) Foundations of Intelligent Systems. ISMIS 2022. Lecture Notes in Computer Science(), vol 13515. Springer, Cham. https://doi.org/10.1007/978-3-031-16564-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-16564-1_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-16563-4

  • Online ISBN: 978-3-031-16564-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics