Skip to main content

Intrinsic Learning of Dynamic Bayesian Networks

  • Conference paper
Book cover PRICAI 2014: Trends in Artificial Intelligence (PRICAI 2014)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8862))

Included in the following conference series:

  • 6359 Accesses

Abstract

Programs that learn Bayesian networks normally learn directed acyclic graphs (DAGs) of arbitrary structure, including those with repeating structures, such as dynamic Bayesian networks (DBNs). Perhaps for that reason there is relatively little literature on learning DBNs specifically and more focusing on applying general learners to the task. Here we modify a general causal discovery program to search specifically for dynamic Bayesian networks, and we identify the benefits in the quality of the models discovered and the time taken to discover them.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. An, X., Jutla, D., Cercone, N.: Privacy intrusion detection using dynamic Bayesian networks. In: ACM International Conference Proceeding Series, vol. 156, pp. 208–215 (2006)

    Google Scholar 

  2. Basye, K., Dean, T., Kirman, J., Lejter, M.: A decision-theoretic approach to planning, perception, and control. IEEE Expert 7(4), 58–65 (1992)

    Article  Google Scholar 

  3. de Campos, C., Ji, Q.: Efficient structure learning of Bayesian networks using constraints. Journal of Machine Learning Research 12, 663–689 (2011)

    MATH  Google Scholar 

  4. Chickering, D.M.: Learning Bayesian networks is NP-complete. In: Fisher, D., Lenz, H.J. (eds.) Learning from Data: AI and Statistics V, ch. 12, pp. 121–130. Springer (1996)

    Google Scholar 

  5. Chickering, D.M.: Optimal structure identification with greedy search. The Journal of Machine Learning Research 3, 507–554 (2003)

    MATH  MathSciNet  Google Scholar 

  6. Cooper, G., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Tech. Rep. Stanford KSL 9 (June 1991)

    Google Scholar 

  7. Cooper, G.: NESTOR: A Computer-Based Medical Diagnostic Aid That Integrates Causal and Probabilistic Knowledge. Ph.D. thesis, Stanford (1984)

    Google Scholar 

  8. Dojer, N.: Learning Bayesian networks does not have to be NP-Hard. In: Královič, R., Urzyczyn, P. (eds.) MFCS 2006. LNCS, vol. 4162, pp. 305–314. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  9. Forbes, J., Huang, T., Kanazawa, K., Russell, S.: The Batmobile: Towards a Bayesian automated taxi. In: IJCAI, vol. 95, pp. 1878–1885 (1995)

    Google Scholar 

  10. Friedman, N., Murphy, K., Russell, S.: Learning the structure of dynamic probabilistic networks. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence, pp. 139–147 (1998)

    Google Scholar 

  11. Hartemink, A.: Banjo (Bayesian network inference with Java objects) (2005), http://www.cs.duke.edu/amink/software/banjo/

  12. Jensen, F.V., Nielsen, T.D.: Bayesian networks and decision graphs. Springer (2007)

    Google Scholar 

  13. Korb, K.B., Nicholson, A.E.: Bayesian Artificial Intelligence, 2nd edn. Chapman & Hall/CRC, Boca Raton (2011)

    MATH  Google Scholar 

  14. Kullback, S., Leibler, R.: On information and sufficiency. Annals of Mathematical Statistics 22, 76–86 (1951)

    Article  MathSciNet  Google Scholar 

  15. Lauritzen, S.L., Spiegelhalter, D.J.: Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistical Society. Series B (Methodological), 157–224 (1988)

    Google Scholar 

  16. Liang, S., Fuhrman, S., Somogyi, R., et al.: Reveal, a general reverse engineering algorithm for inference of genetic network architectures. In: Pacific Symposium on Biocomputing, vol. 3, p. 2 (1998)

    Google Scholar 

  17. Murphy, K.: The Bayes net toolbox for Matlab. Computing Science and Statistics 33, 1024–1034 (2001)

    Google Scholar 

  18. O’Donnell, R.: Flexible Causal Discovery with MML. In: Faculty of Information Technology (Clayton). Monash University, Australia 3800 (September 2010)

    Google Scholar 

  19. O’Donnell, R.T., Nicholson, A.E., Han, B., Korb, K.B., Alam, M. J., Hope, L.R.: Causal discovery with prior information. In: Sattar, A., Kang, B.-H. (eds.) AI 2006. LNCS (LNAI), vol. 4304, pp. 1162–1167. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  20. Pearl, J.: Probabilistic reasoning in intelligent systems. Morgan-Kaufmann, San Mateo (1988)

    Google Scholar 

  21. Pérez-Ariza, C.B., Nicholson, A.E., Korb, K.B., Mascaro, S., Hu, C.H.: Causal discovery of dynamic Bayesian networks. In: Thielscher, M., Zhang, D. (eds.) AI 2012. LNCS, vol. 7691, pp. 902–913. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  22. Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 14, 461–464 (1978)

    Article  Google Scholar 

  23. Spirtes, P., Glymour, C., Scheines, R.: Causation, Prediction and Search. Lecture Notes in Statistics. Springer (1993)

    Google Scholar 

  24. Tang, Z., Gao, X.G., Zhang, Y.: Overview of research on assessment model of radiant threat rank based on dynamic Bayesian network. In: 2007 IEEE International Conference on Automation and Logistics, pp. 1067–1071. IEEE (2007)

    Google Scholar 

  25. Tucker, A., Liu, X.: Extending evolutionary programming methods to the learning of dynamic Bayesian networks. In: Banzhaf, W., Daida, J., Eiben, A.E., Garzon, M.H. (eds.) Proceedings of the Genetic and Evolutionary Computation Conference (1999)

    Google Scholar 

  26. Tucker, A., Liu, X.: Learning dynamic Bayesian networks from multivariate time series with changing dependencies. In: Berthold, M., Lenz, H.-J., Bradley, E., Kruse, R., Borgelt, C. (eds.) IDA 2003. LNCS, vol. 2810, pp. 100–110. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  27. Van Berlo, R., Van Someren, E., Reinders, M.: Studying the conditions for learning dynamic Bayesian networks to discover genetic regulatory networks. Simulation 79, 689–702 (2003)

    Google Scholar 

  28. Verma, T., Pearl, J.: Equivalence and synthesis of causal models. In: Proceedings of the Sixth Conference on Uncertainty in AI, pp. 220–227 (1990)

    Google Scholar 

  29. Vinh, N.X., Chetty, M., Coppel, R., Wangikar, P.P.: GlobalMIT: Learning globally optimal dynamic Bayesian network with the mutual information test criterion. Bioinformatics 27, 2765–2766 (2011)

    Article  Google Scholar 

  30. Vinh, N.X., Chetty, M., Coppel, R., Wangikar, P.P.: Local and global algorithms for learning dynamic Bayesian networks. In: Proceedings of the 2012 IEEE 12th International Conference on Data Mining, pp. 685–694. IEEE Computer Society (2012)

    Google Scholar 

  31. Wallace, C.S.: Statistical and Inductive Inference by Minimum Message Length. Springer, Berlin (2005)

    MATH  Google Scholar 

  32. Wallace, C.S., Korb, K.B.: Learning linear causal models by MML sampling. In: Gammerman, A. (ed.) Causal Models and Intelligent Data Management, pp. 89–111. Springer (1999)

    Google Scholar 

  33. Weber, P., Jouffe, L.: Complex system reliability modelling with dynamic object oriented Bayesian networks (DOOBN). Reliability Engineering & System Safety 91, 149–162 (2006)

    Article  Google Scholar 

  34. Yang, G., Lin, Y., Bhattacharya, P.: A driver fatigue recognition model based on information fusion and dynamic Bayesian network. Information Sciences 180(10), 1942–1954 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Black, A., Korb, K.B., Nicholson, A.E. (2014). Intrinsic Learning of Dynamic Bayesian Networks. In: Pham, DN., Park, SB. (eds) PRICAI 2014: Trends in Artificial Intelligence. PRICAI 2014. Lecture Notes in Computer Science(), vol 8862. Springer, Cham. https://doi.org/10.1007/978-3-319-13560-1_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13560-1_21

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13559-5

  • Online ISBN: 978-3-319-13560-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics