Abstract
Postoperative complications after cardiac surgery can be severe and even fatal, making it a high-risk procedure. Predicting surgical risk can guide the effective formulation of treatment plans for high-risk cardiac surgery, thereby reducing the risk of postoperative complications, which has attracted widespread attention from cardiac surgeons. The most commonly used method, EuroSCORE, has the problems of low prediction accuracy and weak targeting for postoperative complications. In this paper, we developed a machine learning (ML) model for predicting adverse outcomes (AO) after cardiac surgery with high accuracy and demonstrated the clinical interpretability of the model with counterfactual explanation (CE) based explainable artificial intelligence (XAI). A total of 2324 patients who had undergone cardiac surgeries with cardiopulmonary bypass support in a single center were included in this study, were divided into two groups as non-AO (n = 2148) and AO (n = 176). Our ML prediction model showed the best prediction performance using perioperative data (AUC = 0.769) when compared with models of EuroSCORE (AUC = 0.663) and EuroSCORE covariates (AUC = 0.710). CE method applied to the ML model showed how operation duration, ASA class, BMI, Lac entering ICU and PLT value increase the risk of adverse outcomes following surgery. In addition, sufficiency and necessity metrics was used to provide CE with a better explanation of feature importance. It has been proven that machine learning models have shown hope in improving the risk assessment of adverse outcomes after cardiac surgery, and counterfactual explanations methods provide more detailed and practical explanations, which are more useful for medical professionals.
Qin and Liu contributed to the work equally and should be regarded as co-first authors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nashef, S.A., et al.: European system for cardiac operative risk evaluation (EuroSCORE). Eur. J. Cardiothorac. Surg. 16(1), 9–13 (1999)
Nashef, S.A., et al.: EuroSCORE II. Eur. J. Cardiothorac. Surg. 41(4), 734–744 (2012). Discussion 744-5
Parsonnet, V., Dean, D., Bernstein, A.D.: A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 79(6 Pt 2), I3-12 (1989)
Tu, J.V., Jaglal, S.B., Naylor, C.D.: Multicenter validation of a risk index for mortality, intensive care unit stay, and overall hospital length of stay after cardiac surgery. Circulation 91(3), 677–684 (1995). Steering Committee of the Provincial Adult Cardiac Care Network of Ontario
Edwards, F.H., et al.: The Society of Thoracic Surgeons National Cardiac Surgery Database: current risk assessment. Ann. Thorac. Surg. 63(3), 903–908 (1997)
Siregar, S., et al.: Performance of the original EuroSCORE. Eur. J. Cardiothorac. Surg. 41(4), 746–754 (2012)
Parolari, A., et al.: Performance of EuroSCORE in CABG and off-pump coronary artery bypass grafting: single institution experience and meta-analysis. Eur. Heart J. 30(3), 297–304 (2009)
Basraon, J., et al.: Comparison of risk scores to estimate perioperative mortality in aortic valve replacement surgery. Ann. Thorac. Surg. 92(2), 535–540 (2011)
Zheng, Z., et al.: The Chinese coronary artery bypass grafting registry study: how well does the EuroSCORE predict operative risk for Chinese population? Eur. J. Cardiothorac. Surg. 35(1), 54–58 (2009)
Yap, C.H., et al.: Validation of the EuroSCORE model in Australia. Eur. J. Cardiothorac. Surg. 29(4), 441–446 (2006). Discussion 446
Toumpoulis, I.K., et al.: Does EuroSCORE predict length of stay and specific postoperative complications after cardiac surgery? Eur. J. Cardiothorac. Surg. 27(1), 128–133 (2005)
Meyer, A., et al.: Machine learning for real-time prediction of complications in critical care: a retrospective study. Lancet Respir. Med. 6(12), 905–914 (2018)
Allyn, J., et al.: A comparison of a machine learning model with EuroSCORE II in predicting mortality after elective cardiac surgery: a decision curve analysis. PLoS ONE 12(1), e0169772 (2017)
Rufo, D.D., et al.: Diagnosis of diabetes mellitus using gradient boosting machine (LightGBM). Diagnostics (Basel) 11(9), 1714 (2021)
Tseng, P.Y., et al.: Prediction of the development of acute kidney injury following cardiac surgery by machine learning. Crit. Care 24(1), 478 (2020)
Zeng, X., et al.: Prediction of complications after paediatric cardiac surgery. Eur. J. Cardiothorac. Surg. 57(2), 350–358 (2020)
Wachter, S., Mittelstadt, B., Russell, C.: Counterfactual explanations without opening the black box: automated decisions and the GDPR. Harv. JL Tech. 31, 841 (2018)
Qi, M.: LightGBM: a highly efficient gradient boosting decision tree. In: Neural Information Processing Systems (2017)
Wang, C., et al.: FLAML: a fast and lightweight AutoML library (2019)
Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?” Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1135–1144 (2016)
Lundberg, S.M., Lee, S.I.: A unified approach to interpreting model predictions. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Shapley, L.S.: A value for n-person games. Technical report, Rand Corp Santa Monica CA (1952)
Mothilal, R.K., Sharma, A., Tan, C.: Explaining machine learning classifiers through diverse counterfactual explanations. In: FAT* 2020: Conference on Fairness, Accountability, and Transparency (2020)
Mothilal, R.K., et al.: Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same End (2020)
Ad, N., et al.: Comparison of EuroSCORE II, original EuroSCORE, and the society of thoracic surgeons risk score in cardiac surgery patients. Ann. Thorac. Surg. 102(2), 573–579 (2016)
Shamout, F., Zhu, T., Clifton, D.A.: Machine learning for clinical outcome prediction. IEEE Rev. Biomed. Eng. 14, 116–126 (2021)
Thorsen-Meyer, H.C., et al.: Dynamic and explainable machine learning prediction of mortality in patients in the intensive care unit: a retrospective study of high-frequency data in electronic patient records. Lancet Digit. Health 2(4), e179–e191 (2020)
Fan, Y., et al.: Development of machine learning models for mortality risk prediction after cardiac surgery. Cardiovasc. Diagn. Ther. 12(1), 12–23 (2022)
Acknowledgments
This work is supported by the Natural Science Foundation of Sichuan Province (2022NSFSC0503), Sichuan Science and Technology Program (2022ZHCG0007), the National Natural Science Foundation of China (82202071), Sichuan Provincial Science and Technology Program (2022YFS0301, 2023YFS0036), the Science and Technology Project of the Health Planning Committee of Sichuan (20ZD011), and Chengdu Science and Technology Program (2021-YF05-00640-SN).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Qin, D., Liu, M., Chen, Z., Lei, Q. (2023). Optimizing Cardiac Surgery Risk Prediction: An Machine Learning Approach with Counterfactual Explanations. In: Huang, DS., Premaratne, P., Jin, B., Qu, B., Jo, KH., Hussain, A. (eds) Advanced Intelligent Computing Technology and Applications. ICIC 2023. Lecture Notes in Computer Science, vol 14088. Springer, Singapore. https://doi.org/10.1007/978-981-99-4749-2_19
Download citation
DOI: https://doi.org/10.1007/978-981-99-4749-2_19
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-4748-5
Online ISBN: 978-981-99-4749-2
eBook Packages: Computer ScienceComputer Science (R0)