Abstract
Clinical records are files that contain detailed information about a patient's health status. Clinical notes are typically complex, and the medical code space is large, so medical code assignment from clinical text is a long-standing challenge. The traditional manual coding method is inefficient and error-prone. Incorrect coding may lead to adverse consequences. With machine learning and computer hardware development, the deep neural network model has been widely applied in the medical care domain. However, noise in lengthy documents, complex code association, and the imbalanced class problem urgently need to be solved. Therefore, we propose a Note-code Interaction Denoising Network (NIDN). We exploit the self-attention mechanism to identify the most relevant context of the medical code in the clinical document. We leverage the label attention mechanism to learn code-specific text representation. We utilize the correlation between labels in multi-task learning to assist the model in prediction. To better learn from lengthy texts and improve the performance of long-tail distribution, we develop a denoising module to reduce the influence of noise in medical code prediction. Experimental results show that our proposed model outperforms competitive baselines on a real-world MIMIC-III dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., Japa, E.J.: Explainable prediction of medical codes from clinical text (2018)
Li, F., Yu, H.: ICD coding from clinical text using multi-filter residual convolutional neural network. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 8180–8187 (2020)
Vu, T., Nguyen, D.Q., Japa, N.A.: A label attention model for ICD coding from clinical text (2020)
Biswas, B., Pham, T.-H., Zhang, P.: Transicd: Transformer based code-wise attention model for explainable ICD coding. In: Tucker, A., Henriques Abreu, P., Cardoso, J., Pereira Rodrigues, P., Riaño, D. (eds.) AIME 2021. LNCS (LNAI), vol. 12721, pp. 469–478. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77211-6_56
Sun, W., Ji, S., Cambria, E., Japa, M.P.: Multitask balanced and recalibrated network for medical code prediction (2021)
Li, X., Zhang, Y., Dong, D., Wei, H., Lu, M.J.B.: Medical code prediction via joint learning attention networks and denoising mechanism. JLAN 22(1), 1–21 (2021)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Dong, H., Wang, W., Huang, K., Coenen, F.: Automated social text annotation with joint multilabel attention networks. IEEE Trans. Neural Netw. Learn. Syst. 32(5), 2224–2238 (2020)
Luo, J., Xiao, C., Glass, L., Sun, J., Ma, F.: Fusion: towards automated ICD coding via feature compression. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 2096–2101 (2021)
Zhou, T., Cao, P., Chen, Y., Liu, K., Zhao, J., Niu, K., et al.: Automatic ICD coding via interactive shared representation networks with self-distillation mechanism. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 5948–5957 (2021)
Wang, W., Feng, F., He, X., Nie, L., Chua, T.-S.: Denoising implicit feedback for recommendation. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 373–381 (2021)
Xin, J., Tang, R., Yu, Y., Lin, J.: BERxiT: early exiting for BERT with better fine-tuning and extension to regression. In: Proceedings of the 16th Conference Of The European Chapter of the Association for Computational Linguistics: Main Volume, pp. 91–104 (2021)
Byrd, J., Lipton, Z.: What is the effect of importance weighting in deep learning? In: International Conference on Machine Learning: PMLR, pp. 872–881 (2019)
Ji, S., Pan, S., Japa, M.P.: Medical code assignment with gated convolution and note-code interaction (2020)
Bai, T., Vucetic, S.: Improving medical code prediction from clinical text via incorporating online knowledge sources. In: The World Wide Web Conference, pp. 72–82 (2019)
Zhao, S., Liu, T., Zhao, S., Wang, F.: A neural multi-task learning framework to jointly model medical named entity recognition and normalization. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 817–824 (2019)
Xie, X., Xiong, Y., Yu, P.S., Zhu, Y.: Ehr coding with multi-scale feature attention and structured knowledge graph propagation. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 649–658 (2019)
Wu, Y., Zeng, M., Fei, Z., Yu, Y., Wu, F.-X., Li, M.J.N.: Kaicd: a knowledge attention-based deep learning framework for automatic ICD coding 469, pp. 376–383 (2022)
Cao, P., Chen,Y., Liu, K., Zhao, J., Liu, S., Chong, W.: Hypercore: hyperbolic and co-graph representation for automatic icd coding. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3105–3114 (2020)
Alsentzer E, et al.: Publicly available clinical BERT embeddings (2019)
Bai, S., Kolter, J.Z., Japa, K.V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling (2018)
Kavuluru, R., Rios, A., Lu, Y., Aiim, J.: An empirical evaluation of supervised learning approaches in assigning diagnosis codes to electronic medical records. Artif. Intell. Med. 65(2), 155–166 (2015)
Acknowledgment
This work is supported by grant from the Natural Science Foundation of China (No. 62072070).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, X., Zhang, Y., Li, X., Wang, J., Lu, M. (2022). NIDN: Medical Code Assignment via Note-Code Interaction Denoising Network. In: Bansal, M.S., Cai, Z., Mangul, S. (eds) Bioinformatics Research and Applications. ISBRA 2022. Lecture Notes in Computer Science(), vol 13760. Springer, Cham. https://doi.org/10.1007/978-3-031-23198-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-23198-8_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-23197-1
Online ISBN: 978-3-031-23198-8
eBook Packages: Computer ScienceComputer Science (R0)