Skip to main content

Latent Patient Profile Modelling and Applications with Mixed-Variate Restricted Boltzmann Machine

  • Conference paper
Advances in Knowledge Discovery and Data Mining (PAKDD 2013)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7818))

Included in the following conference series:

Abstract

Efficient management of chronic diseases is critical in modern health care. We consider diabetes mellitus, and our ongoing goal is to examine how machine learning can deliver information for clinical efficiency. The challenge is to aggregate highly heterogeneous sources including demographics, diagnoses, pathologies and treatments, and extract similar groups so that care plans can be designed. To this end, we extend our recent model, the mixed-variate restricted Boltzmann machine (MV.RBM), as it seamlessly integrates multiple data types for each patient aggregated over time and outputs a homogeneous representation called “latent profile” that can be used for patient clustering, visualisation, disease correlation analysis and prediction. We demonstrate that the method outperforms all baselines on these tasks - the primary characteristics of patients in the same groups are able to be identified and the good result can be achieved for the diagnosis codes prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. World Health Organization: Diabetes (2012), http://www.who.int/mediacentre/factsheets/fs312/en/index.html (accessed September 2012)

  2. Tran, T., Phung, D.Q., Venkatesh, S.: Mixed-variate restricted Boltzmann machines. Journal of Machine Learning Research - Proceedings Track 20, 213–229 (2011)

    Google Scholar 

  3. Frey, B.J., Dueck, D.: Clustering by passing messages between data points. Science 315, 972–976 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  4. Salakhutdinov, R., Hinton, G.: Replicated softmax: an undirected topic model. Advances in Neural Information Processing Systems 22, 1607–1614 (2009)

    Google Scholar 

  5. McCulloch, C.: Joint modelling of mixed outcome types using latent variables. Statistical Methods in Medical Research 17(1), 53 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  6. Dunson, D., Herring, A.: Bayesian latent variable models for mixed discrete outcomes. Biostatistics 6(1), 11 (2005)

    Article  MATH  Google Scholar 

  7. Freund, Y., Haussler, D.: Unsupervised learning of distributions on binary vectors using two layer networks. Santa Cruz, CA, USA. Tech. Rep. (1994)

    Google Scholar 

  8. Hinton, G.E.: Training products of experts by minimizing contrastive divergence. Neural Computation 14(8), 1771–1800 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  9. Salakhutdinov, R., Hinton, G.: Semantic hashing. In: SIGIR Workshop on Information Retrieval and Applications of Graphical Models, vol. 500(3). ACM Special Interest Group on Information Retrieva (2007)

    Google Scholar 

  10. van der Maaten, L., Hinton, G.: Visualizing data using t-sne. Journal of Machine Learning Research 9, 2579–2605 (2008)

    MATH  Google Scholar 

  11. Rand, W.: Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 846–850 (1971)

    Google Scholar 

  12. World Health Organization: ICD-10th (2010), http://apps.who.int/classifications/icd10/browse/2010/en (accessed September 2012)

  13. Khosla, A., Cao, Y., Lin, C.C.-Y., Chiu, H.-K., Hu, J., Lee, H.: An integrated machine learning approach to stroke prediction. In: Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 183–192. ACM (2010)

    Google Scholar 

  14. Luo, D., Wang, F., Sun, J., Markatou, M., Hu, J., Ebadollahi, S.: Sor: Scalable orthogonal regression for non-redundant feature selection and its healthcare applications. In: SIAM Data Mining Conference (2012)

    Google Scholar 

  15. Ben-Hur, A., Iverson, T., Iyer, H.: Predicting the risk of type 2 diabetes using insurance claims data. In: Neural Information Processing System Foundation (2010)

    Google Scholar 

  16. Neuvirth, H., Ozery-Flato, M., Hu, J., Laserson, J., Kohn, M.S., Ebadollahi, S., Rosen-Zvi, M.: Toward personalized care management of patients at risk: the diabetes case study. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 395–403. ACM (2011)

    Google Scholar 

  17. de Leon, A.R., Wu, B.: Copula-based regression models for a bivariate mixed discrete and continuous outcome. Statistics in Medicine 30(2), 175–185 (2011)

    Article  MathSciNet  Google Scholar 

  18. Song, P.X.-K., Li, M., Yuan, Y.: Joint regression analysis of correlated data using gaussian copulas. Biometrics 65(1), 60–68 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  19. Truyen, T., Phung, D., Venkatesh, S.: Ordinal Boltzmann machines for collaborative filtering. In: Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI), Montreal, Canada (June 2009)

    Google Scholar 

  20. Tran, T., Phung, D., Venkatesh, S.: Cumulative restricted Boltzmann machines for ordinal matrix data analysis. In: Proc. of 4th Asian Conference on Machine Learning (ACML), Singapore (2012)

    Google Scholar 

  21. Tran, T., Phung, D., Venkatesh, S.: Embedded Restricted Boltzmann Machines for fusion of mixed data type and applications in social measurements analysis. In: Proc. of the 15th International Conference on Information Fusion (FUSION), Singapore (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nguyen, T.D., Tran, T., Phung, D., Venkatesh, S. (2013). Latent Patient Profile Modelling and Applications with Mixed-Variate Restricted Boltzmann Machine. In: Pei, J., Tseng, V.S., Cao, L., Motoda, H., Xu, G. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2013. Lecture Notes in Computer Science(), vol 7818. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37453-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37453-1_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37452-4

  • Online ISBN: 978-3-642-37453-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics