Abstract
Sepsis is one of the leading causes of death in intensive care units (ICUs). Online early prediction of sepsis has the potential for application to support clinicians. Despite the great success of deep neural networks in modeling electronic health records (EHRs), many architectures are incapable to be applied to online early prediction scenarios due to two major limitations. First, they overlook the earlier signs of the disease which are vital for the early prediction of sepsis. Second, they are unable to provide interpretation of prediction results. To tackle the above limitations, we propose a Dual-level sElf-Attention Gated Recurrent Unit Networks model, DEAR. On the one hand, DEAR is able to directly identify and strengthen the important time steps from the precedent memory. Specifically, the cell of DEAR straightforwardly fusion the history of both feature level and temporal level into the current step. On the other hand, DEAR provides interpretability with multi-head attention. Experimental results in the real-world sepsis dataset demonstrate that our model outperforms state-of-the-art methods in terms of both utility and balanced accuracy. In addition, the visualization of multi-head attention weights also indicates that DEAR reveals the importance of different time steps in the early prediction of sepsis onset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baytas, I.M., Xiao, C., Zhang, X., Wang, F., Jain, A.K., Zhou, J.: Patient subtyping via time-aware LSTM networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 65–74 (2017)
Che, Z., Purushotham, S., Cho, K., Sontag, D., Liu, Y.: Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 8(1), 1–12 (2018)
Häyrinen, K., Saranto, K., Nykänen, P.: Definition, structure, content, use and impacts of electronic health records: a review of the research literature. Int. J. Med. Inform. 77(5), 291–304 (2008)
Horn, M., Moor, M., Bock, C., Rieck, B., Borgwardt, K.: Set functions for time series. In: International Conference on Machine Learning, pp. 4353–4363. PMLR (2020)
Jensen, P.B., Jensen, L.J., Brunak, S.: Mining electronic health records: towards better research applications and clinical care. Nat. Rev. Genet. 13(6), 395–405 (2012)
Kenzaka, T., et al.: Importance of vital signs to the early diagnosis and severity of sepsis: association between vital signs and sequential organ failure assessment score in patients with sepsis. Intern. Med. 51(8), 871–876 (2012)
Kumar, A., et al.: Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit. Care Med. 34(6), 1589–1596 (2006)
Lin, Z., et al.: A structured self-attentive sentence embedding. arXiv preprint arXiv:1703.03130 (2017)
Neil, D., Pfeiffer, M., Liu, S.C.: Phased lstm: accelerating recurrent network training for long or event-based sequences. In: Proceedings of the 30th International Conference on Neural Information Processing Systems, pp. 3889–3897 (2016)
Quinten, V.M., van Meurs, M., Ter Maaten, J.C., Ligtenberg, J.J.: Trends in vital signs and routine biomarkers in patients with sepsis during resuscitation in the emergency department: a prospective observational pilot study. BMJ Open 6(5), e009718 (2016)
Reyna, M.A., et al.: Early prediction of sepsis from clinical data: the physionet/computing in cardiology challenge 2019. In: 2019 Computing in Cardiology (CinC), p. 1. IEEE (2019)
Seymour, C.W., et al.: Time to treatment and mortality during mandated emergency care for sepsis. N. Engl. J. Med. 376(23), 2235–2244 (2017)
Seymour, C.W., et al.: Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315(8), 762–774 (2016)
Shankar-Hari, M., et al.: Developing a new definition and assessing new clinical criteria for septic shock: for the third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315(8), 775–787 (2016)
Shukla, S.N., Marlin, B.: Interpolation-prediction networks for irregularly sampled time series. In: International Conference on Learning Representations (2018)
Singer, M., et al.: The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315(8), 801–810 (2016)
Tennilä, A., Salmi, T., Pettilä, V., Roine, R.O., Varpula, T., Takkunen, O.: Early signs of critical illness polyneuropathy in icu patients with systemic inflammatory response syndrome or sepsis. Intensive Care Med. 26(9), 1360–1363 (2000)
Vaswani, A., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 5998–6008 (2017)
Wu, Y., Zhang, Y., Wu, J.: Configurable in-database similarity search of electronic medical records. In: Xing, C., Fu, X., Zhang, Y., Zhang, G., Borjigin, C. (eds.) WISA 2021. LNCS, vol. 12999, pp. 62–73. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87571-8_6
Yadav, P., Steinbach, M., Kumar, V., Simon, G.: Mining electronic health records (ehrs) a survey. ACM Comput. Surv. (CSUR) 50(6), 1–40 (2018)
Acknowledgements
This research is supported by the National Natural Science Foundation of China (No. 62002178) and NSFC-Xinjiang Joint Fund (No. U1903128).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zhao, Y., Wu, Y., Liu, M., Cai, X., Zhang, Y., Yuan, X. (2022). DEAR: Dual-Level Self-attention GRU for Online Early Prediction of Sepsis. In: Zhao, X., Yang, S., Wang, X., Li, J. (eds) Web Information Systems and Applications. WISA 2022. Lecture Notes in Computer Science, vol 13579. Springer, Cham. https://doi.org/10.1007/978-3-031-20309-1_37
Download citation
DOI: https://doi.org/10.1007/978-3-031-20309-1_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20308-4
Online ISBN: 978-3-031-20309-1
eBook Packages: Computer ScienceComputer Science (R0)