Abstract
Disease prediction, aimed at predicting possible future diseases of patients, is a fundamental research problem in medical informatics. Many studies have proposed the introduction of external knowledge to enhance existing models with some effect, but since most of these studies only consider entities directly related to the patient, they fail to take full advantage of the correlation between entities in the knowledge graph. To this end, we propose a new approach, which uses medical knowledge graphs for multi-hop reasoning to guide the self-attention based transformer model for disease prediction. Specifically, our approach design a reinforcement learning algorithm to perform path reasoning in the knowledge graph to obtain explicit disease progression paths. Since there is a semantic gap between the Electronic Health Records (EHR) data and the knowledge path data, we feed them into two separate transformer encoders to obtain the embedding representation. In order to measure the importance of the different knowledge information in relation to the patient information, an attention module is introduced to obtain a global attention representation. Experimental results on the real-world medical dataset MIMIC-III show the superiority of the proposed approach compared to a series of state-of-the-art baselines. At the same time, multi-hop knowledge paths bring stronger interpretability for disease prediction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
References
Choi, E., Bahadori, M.T., Kulas, J.A., Schuetz, A., Stewart, W.F., Sun, J.: Retain: An interpretable predictive model for healthcare using reverse time attention mechanism. arXiv preprint arXiv:1608.05745 (2016)
Davenport, T., Kalakota, R.: The potential for artificial intelligence in healthcare. Future healthcare J. 6(2), 94 (2019)
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Jiang, F., et al: Artificial intelligence in healthcare: past, present and future. Stroke Vasc. Neurol. 2(4), 230–243 (2017)
Johnson, A.E., et al.: Mimic-iii, a freely accessible critical care database. Sci. data 3(1), 1–9 (2016)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Liu, X., Zhao, R., Zhang, Y., Zhang, F.: Prognosis prediction of breast cancer based on CGAN. In: Xing, C., Fu, X., Zhang, Y., Zhang, G., Borjigin, C. (eds.) WISA 2021. LNCS, vol. 12999, pp. 190–197. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87571-8_16
Luo, J., Ye, M., Xiao, C., Ma, F.: Hitanet: Hierarchical time-aware attention networks for risk prediction on electronic health records. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 647–656 (2020)
Lysaght, T., Lim, H.Y., Xafis, V., Ngiam, K.Y.: Ai-assisted decision-making in healthcare. Asian Bioethics Rev. 11(3), 299–314 (2019)
Ma, F., Chitta, R., Zhou, J., You, Q., Sun, T., Gao, J.: Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1903–1911 (2017)
Qiu, L., Gorantla, S., Rajan, V., Tan, B.C.: Multi-disease predictive analytics: A clinical knowledge-aware approach. ACM Trans. Manage. Inform. Syst. (TMIS) 12(3), 1–34 (2021)
Vaswani, A., et al: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wang, H., Cui, Z., Chen, Y., Avidan, M., Abdallah, A.B., Kronzer, A.: Predicting hospital readmission via cost-sensitive deep learning. IEEE/ACM Trans. Comput. Biol. Bioinform. 15(6), 1968–1978 (2018)
Xu, X., et al.: Predictive modeling of clinical events with mutual enhancement between longitudinal patient records and medical knowledge graph. In: 2021 IEEE International Conference on Data Mining (ICDM), pp. 777–786. IEEE (2021)
Yin, C., Zhao, R., Qian, B., Lv, X., Zhang, P.: Domain knowledge guided deep learning with electronic health records. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 738–747. IEEE (2019)
Zhang, X., Qian, B., Li, Y., Yin, C., Wang, X., Zheng, Q.: Knowrisk: an interpretable knowledge-guided model for disease risk prediction. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 1492–1497. IEEE (2019)
Acknowledgements
This work was supported by National Natural Science Foundation of China (No.62072112, 62176185), Scientific and Technological Innovation Action Plan of Shanghai Science and Technology Committee (No.20511103102), Fudan Double First-class Construction Fund (No. XM03211178).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liang, Y., Wang, H., Zhang, W. (2022). A Knowledge-Guided Method for Disease Prediction Based on Attention Mechanism. In: Zhao, X., Yang, S., Wang, X., Li, J. (eds) Web Information Systems and Applications. WISA 2022. Lecture Notes in Computer Science, vol 13579. Springer, Cham. https://doi.org/10.1007/978-3-031-20309-1_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-20309-1_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20308-4
Online ISBN: 978-3-031-20309-1
eBook Packages: Computer ScienceComputer Science (R0)