Skip to main content

Medication Combination Prediction via Attention Neural Networks with Prior Medical Knowledge

  • Conference paper
  • First Online:
Knowledge Science, Engineering and Management (KSEM 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12817))

Abstract

With the adoption of electronic health records (EHR), deep learning technologies have the potential to employ the EHR data to assist experts in better understanding the complex mechanisms underlying the health and disease. Existing studies have made progress on the research of medication combination prediction from the medical data, but few of them take into account the prior medical knowledge. This paper proposes a PKANet model that integrates the prior medical knowledge into the deep learning architecture to predict the medication combination. The prior medical knowledge is calculated from the mapping relation between diagnoses and medications hidden in the EHR data. It can provide the heuristic medications to help the PKANet model learn optimal parameters. In order to predict the possible medication combination, the PKANet model utilizes attention neural networks to obtain the relationship between different elements in the medical sequence data. The experiment results have demonstrated that the proposed PKANet model outperforms the state-of-the-art baselines on evaluation metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://mimic.physionet.org/.

References

  1. Cao, J., Zhao, H., Yu, K.: Cross aggregation of multi-head attention for neural machine translation. In: Proceedings of the 8th International Conference on Natural Language Processing and Chinese Computing, pp. 380–392 (2019)

    Google Scholar 

  2. Choi, E., Bahadori, M.T., Sun, J., et al.: RETAIN: an interpretable predictive model for healthcare using reverse time attention mechanism. In: Proceedings of the 30th Conference on Neural Information Processing Systems, pp. 3504–3512 (2016)

    Google Scholar 

  3. Grau, V., Mewes, A., Alcaniz, M., et al.: Improved watershed transform for medical image segmentation using prior information. IEEE Trans. Med. Imaging 23(4), 447–458 (2004)

    Article  Google Scholar 

  4. He, Y., Wang, C., Li, N., Zeng, Z.: Attention and memory-augmented networks for dual-view sequential learning. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 125–134 (2020)

    Google Scholar 

  5. Johnson, A.E., Pollard, T.J., Shen, L., et al.: MIMIC-III, a freely accessible critical care database. Sci. Data 3(1), 1–9 (2016)

    Article  Google Scholar 

  6. Kurrant, D., Baran, A., LoVetri, J., Fear, E.: Integrating prior information into microwave tomography part 1: impact of detail on image quality. Med. Phys. 44(12), 6461–6481 (2017)

    Article  Google Scholar 

  7. Lee, W., Park, S., Joo, W., Moon, I.C.: Diagnosis prediction via medical context attention networks using deep generative modeling. In: Proceedings of the 18th IEEE International Conference on Data Mining, pp. 1104–1109 (2018)

    Google Scholar 

  8. Ma, F., Gao, J., Suo, Q., et al.: Risk prediction on electronic health records with prior medical knowledge. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1910–1919 (2018)

    Google Scholar 

  9. Shang, J., Ma, T., Xiao, C., Sun, J.: Pre-training of graph augmented transformers for medication recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp. 5953–5959 (2019)

    Google Scholar 

  10. Shang, J., Xiao, C., Ma, T., et al.: GAMENet: graph augmented memory networks for recommending medication combination. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence, pp. 1126–1133 (2019)

    Google Scholar 

  11. Song, H., Rajan, D., Thiagarajan, J.J., Spanias, A.: Attend and diagnose: clinical time series analysis using attention models. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 4091–4098 (2018)

    Google Scholar 

  12. Song, J., Wang, Y., Tang, S., et al.: Local-global memory neural network for medication prediction. IEEE Trans. Neural Netw. Learn. Syst. 32(4), 1723–1736 (2021)

    Article  Google Scholar 

  13. Su, C., Gao, S., Li, S.: GATE: graph-attention augmented temporal neural network for medication recommendation. IEEE Access 8, 125447–125458 (2020)

    Article  Google Scholar 

  14. Tofighi, M., Guo, T., Vanamala, J.K., Monga, V.: Prior information guided regularized deep learning for cell nucleus detection. IEEE Trans. Med. Imaging 38(9), 2047–2058 (2019)

    Article  Google Scholar 

  15. Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: Proceedings of the 31st Conference on Neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  16. Wang, Y., Chen, W., Pi, D., Yue, L.: Adversarially regularized medication recommendation model with multi-hop memory network. Knowl. Inf. Syst. 63(1), 125–142 (2020). https://doi.org/10.1007/s10115-020-01513-9

    Article  Google Scholar 

  17. Xiao, L., Zheng, C., Fan, X., et al.: Predicting ICU mortality from heterogeneous clinical events with prior medical knowledge. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp. 55–59 (2019)

    Google Scholar 

  18. Yin, M., Mou, C., Xiong, K., Ren, J.: Chinese clinical named entity recognition with radical-level feature and self-attention mechanism. J. Biomed. Inform. 98, 103289 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Key R&D Program of China (No. 2020AAA0107700), National Natural Science Foundation of China (Nos. 61976181, 11931015), Key Technology Research and Development Program of Science and Technology Scientific and Technological Innovation Team of Shaanxi Province (No. 2020TD-013), the Science and Technology Support Program of Guizhou (No. QKHZC2021YB531) and Chongqing Graduate Student Research Innovation Project (No. CYS21115).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chao Gao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, H., Dong, X., Luo, Z., Zhu, J., Zhu, P., Gao, C. (2021). Medication Combination Prediction via Attention Neural Networks with Prior Medical Knowledge. In: Qiu, H., Zhang, C., Fei, Z., Qiu, M., Kung, SY. (eds) Knowledge Science, Engineering and Management. KSEM 2021. Lecture Notes in Computer Science(), vol 12817. Springer, Cham. https://doi.org/10.1007/978-3-030-82153-1_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-82153-1_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-82152-4

  • Online ISBN: 978-3-030-82153-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics