Abstract
We improve the utility of the Risk-calibrated Supersparse Linear Integer Model (RiskSLIM). It is a scoring system that is an interpretable machine learning classification model optimized for performance. Scoring systems are commonly used in healthcare and justice. We implement feature discretization (FD) in the hyperparameter optimization process to improve classification performance and refer to the new approach as FD-RiskSLIM. We test the approach using two medical applications. We compare the results of FD-RiskSLIM, RiskSLIM, and other machine learning (ML) models. We demonstrate that scoring models based on RiskSLIM, in addition to being interpretable, perform at least on par with the state-of-the-art ML models such as Gradient Boosting in terms of classification metrics. We show the superiority of FD-RiskSLIM over RiskSLIM.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahmad, T., Munir, A., Bhatti, S.H., Aftab, M., Raza, M.A.: Survival analysis of heart failure patients: a case study. PLoS ONE 12, e0181001 (2017)
Akiba, T., Sano, S., Yanase, T., Ohta, T., Koyama, M.: Optuna: a next-generation hyperparameter optimization framework. In: Proceedings of the 25rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2019)
Antman, E.M., et al.: The TIMI risk score for unstable angina/non-ST elevation MI: a method for prognostication and therapeutic decision making. JAMA 284(7), 835–842 (2000)
Bone, R.C., et al.: Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. the ACCP/SCCM consensus conference committee. Am. Coll. Chest Phys./Soc. Crit. Care Med. Chest 101(6), 1644–1655 (1992)
Chang, W., et al.: A machine-learning-based prediction method for hypertension outcomes based on medical data. Diagnostics 9, 178 (2019)
Chicco, D., Jurman, G.: Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone. BMC Med. Inform. Dec. Mak. 20, 1-16 (2020)
Chung, F., Abdullah, H.R., Liao, P.: Stop-bang questionnaire: a practical approach to screen for obstructive sleep apnea. Chest 149(3), 631–638 (2016). https://doi.org/10.1378/chest.15-0903
Cruz, J.A., Wishart, D.S.: Applications of machine learning in cancer prediction and prognosis. Cancer Inform. 2, 59–77 (2007)
Dudek, A.Z., Żołnierek, J., Dham, A., Lindgren, B.R., Szczylik, C.: Sequential therapy with sorafenib and sunitinib in renal cell carcinoma. Cancer 115, 61–67 (2009)
Fayyad, U.M., Irani, K.B.: Multi-interval discretization of continuous-valued attributes for classification learning. In: IJCAI (1993)
Gage, B.F., Waterman, A.D., Shannon, W., Boechler, M., Rich, M.W., Radford, M.J.: Validation of clinical classification schemes for predicting StrokeResults from the national registry of atrial fibrillation. JAMA 285(22), 2864–2870 (2001). https://doi.org/10.1001/jama.285.22.2864
Gage, B.F., Waterman, A.D., Shannon, W.D., Boechler, M., Rich, M.W., Radford, M.J.: Validation of clinical classification schemes for predicting stroke: results from the national registry of atrial fibrillation. JAMA 285, 2864–2870 (2001)
Goodman, B., Flaxman, S.: European union regulations on algorithmic decision-making and a “right to explanation" (2016). https://doi.org/10.1609/aimag.v38i3.2741, http://arxiv.org/abs/1606.08813
Knaus, W.A., et al.: The apache iii prognostic system. risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100(6), 1619–1636 (1991)
Metnitz, P.G.H., et al.: SAPs 3-from evaluation of the patient to evaluation of the intensive care unit. part 1: objectives, methods and cohort description. Intensive Care Med. 31, 1336–1344 (2005)
Mohan, S., Thirumalai, C., Srivastava, G.: Effective heart disease prediction using hybrid machine learning techniques. IEEE Access 7, 81542–81554 (2019)
Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Rudin, C.: Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1(5), 206–215 (2019)
Rudin, C., Ustun, B.: Optimized scoring systems: toward trust in machine learning for healthcare and criminal justice. Interfaces 48, 449–466 (2018)
Struck, A.F., et al.: Comparison of machine learning models for seizure prediction in hospitalized patients, June 2019. https://onlinelibrary.wiley.com/doi/full/10.1002/acn3.50817
Struck, A.F., et al.: A practical risk score for EEG seizures in hospitalized patients (s11.002). Neurology 90 (2018). https://n.neurology.org/content/90/15_Supplement/S11.002
Ustun, B., Rudin, C.: Supersparse linear integer models for optimized medical scoring systems. Mach. Learn. 102(3), 349–391 (2015). https://doi.org/10.1007/s10994-015-5528-6
Ustun, B., Rudin, C.: Learning optimized risk scores. J. Mach. Learn. Res. 20(150), 1–75 (2019). http://jmlr.org/papers/v20/18-615.html
Ustun, B., Westover, M.B., Rudin, C., Bianchi, M.T.: Clinical prediction models for sleep apnea: The importance of medical history over symptoms. J. Clin. Sleep Med. JCSM Off. Publ. Am. Acad. Sleep Med. 12(2), 161–8 (2016)
Vilone, G., Longo, L.: Explainable artificial intelligence: a systematic review. arXiv:2006.00093 (2020)
Wang, C.L., Han, B., Patel, B., Mohideen, F., Rudin, C.: In pursuit of interpretable, fair and accurate machine learning for criminal recidivism prediction. ArXiv:2005.04176 (2020)
Acknowledgements
This work is supported in part by the European Union’s Horizon 2020 research and innovation programme under grant agreement Sano No. 857533 and the International Research Agendas programme of the Foundation for Polish Science, co-financed by the EU under the European Regional Development Fund.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
7 Appendix
7 Appendix
Explanations for the features listed in Fig. 4. G1: binary, from tumor grading, denotes low grade (tumor well differentiated), NEUT > UT: binary, 1 if concentration of neutrocytes exceeds upper threshold of a range of normal values, Heng1: binary, Heng scale, neutrophils: continuous, scaled with min-max (0–1) scaler, amount of neutrophils, MSKCC2: binary, MSKCC (Memorial Sloan Kettering Cancer Center) scale, lymphocytes between 2.13 (inc.) and 5.21 (inc.): binary, 1 if amount of lymphocytes is inside this range, G3: binary, from tumor grading, denotes high grade (tumor poorly differentiated), distant lymph nodes: binary, 1 if tumor metastasis in the distant lymph nodes, number of other cancers: numeric, number of other cancers (metastasis) than: lungs, liver, bones and distant lymph nodes, AH: binary, denotes if someone suffers from arterial hypertension, T2: binary, cancer staging (T1–T4), LDH > 1.5 x UT: binary, lactate dehydrogenase activity, 1 if exceeds 1.5 x upper threshold of a range of normal values, leukocytes between 3.21 (inc.) and 4.49 (inc.): binary, 1 if amount of leukocytes is inside this range, HGB < LT: binary, 1 if hemoglobin concentration exceeds lower threshold of a range of normal values, Ca > UT: binary, 1 if calcium concentration exceeds upper threshold of a range of normal values.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Pajor, A., Żołnierek, J., Sniezynski, B., Sitek, A. (2022). Effect of Feature Discretization on Classification Performance of Explainable Scoring-Based Machine Learning Model. In: Groen, D., de Mulatier, C., Paszynski, M., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M.A. (eds) Computational Science – ICCS 2022. ICCS 2022. Lecture Notes in Computer Science, vol 13352. Springer, Cham. https://doi.org/10.1007/978-3-031-08757-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-08757-8_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08756-1
Online ISBN: 978-3-031-08757-8
eBook Packages: Computer ScienceComputer Science (R0)