Skip to main content
Springer Nature Link
Log in

Maximum Likelihood Estimators on MCMC Sampling Algorithms for Decision Making

  • Conference paper
  • First Online:
Artificial Intelligence Applications and Innovations. AIAI 2022 IFIP WG 12.5 International Workshops (AIAI 2022)

Part of the book series: IFIP Advances in Information and Communication Technology ((IFIPAICT,volume 652))

Abstract

Monte Carlo simulations using Markov chains as the Gibbs sampler and Metropolis algorithm are widely used techniques for modelling stochastic problems for decision making. Like all other Monte Carlo approaches, MCMC exploits the law of large numbers via repeated random sampling. Samples are formed by running a Markov Chain that is constructed in such a way that its stationary distribution closely matches the input function, which is represented by a proposal distribution. In this paper, the fundamentals of MCMC methods are discussed, including the algorithm selection process, optimizations, as well as some efficient approaches for utilizing generalized linear mixed models. Another aim of this paper is to highlight the usage of the EM method to get accurate maximum likelihood estimates in the context of generalized linear mixed models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Agresti, A.: Categorical Data Analysis. Wiley, Hoboken (2003)

    MATH  Google Scholar 

  2. Besag, J., York, J., Mollié, A.: Bayesian image restoration, with two applications in spatial statistics. Ann. Inst. Stat. Math. 43(1), 1–20 (1991)

    Article  MathSciNet  Google Scholar 

  3. Breslow, N.E., Clayton, D.G.: Approximate inference in generalized linear mixed models. J. Am. Stat. Assoc. 88(421), 9–25 (1993)

    MATH  Google Scholar 

  4. Clayton, D.G.: Generalized linear mixed models. Markov Chain Monte Carlo Pract. 1, 275–302 (1996)

    MathSciNet  MATH  Google Scholar 

  5. Demidenko, E.: Mixed Models: Theory and Applications (Wiley Series in Probability and Statistics). Wiley-Interscience, New York (2004)

    Book  Google Scholar 

  6. Fahrmeir, L., Tutz, G., Hennevogl, W., Salem, E.: Multivariate Statistical Modelling Based on Generalized Linear Models, vol. 425. Springer, New York (1994). https://doi.org/10.1007/978-1-4899-0010-4

    Book  Google Scholar 

  7. Gelfand, A.E., Smith, A.F.: Sampling-based approaches to calculating marginal densities. J. Am. Stat. Assoc. 85(410), 398–409 (1990)

    Article  MathSciNet  Google Scholar 

  8. Geman, S., Geman, D.: Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Pattern Anal. Mach. Intell. PAMI 6(6), 721–741 (1984). https://doi.org/10.1109/TPAMI.1984.4767596

    Article  MATH  Google Scholar 

  9. Geyer, C.J.: Likelihood inference in exponential families and directions of recession. Electron. J. Stat. 3, 259–289 (2009). https://doi.org/10.1214/08-EJS349

  10. Geyer, C.J., Thompson, E.A.: Constrained Monte Carlo maximum likelihood for dependent data. J. Roy. Stat. Soc. Ser. B (Methodol.) 54(3), 657–683 (1992)

    MathSciNet  Google Scholar 

  11. Hastings, W.K.: Monte Carlo sampling methods using Markov chains and their applications. Biometrika 57, 97–109 (1970)

    Article  MathSciNet  Google Scholar 

  12. Hedeker, D.: Generalized linear mixed models. Encyclopedia of statistics in behavioral science (2005)

    Google Scholar 

  13. Karras, C., Karras, A.: DBSOP: an efficient heuristic for speedy MCMC sampling on polytopes. arXiv preprint arXiv:2203.10916 (2022)

  14. Karras, C., Karras, A., Sioutas, S.: Pattern recognition and event detection on IoT data-streams. arXiv preprint arXiv:2203.01114 (2022)

  15. McCulloch, C.E.: Maximum likelihood algorithms for generalized linear mixed models. J. Am. Stat. Assoc. 92(437), 162–170 (1997)

    Article  MathSciNet  Google Scholar 

  16. Mcculloch, C.E., Neuhaus, J.M.: Generalized Linear Mixed Models. Wiley (2014). https://doi.org/10.1002/9781118445112.stat07540

  17. McCulloch, C.E., Searle, S.R.: Generalized, Linear, and Mixed Models. Wiley, Hoboken (2004)

    MATH  Google Scholar 

  18. Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(6), 1087–1092 (1953)

    Article  Google Scholar 

  19. Moyeed, R., Baddeley, A.J.: Stochastic approximation of the MLE for a spatial point pattern. Scand. J. Stat., 39–50 (1991)

    Google Scholar 

  20. Ogata, Y., Tanemura, M.: Likelihood estimation of soft-core interaction potentials for Gibbsian point patterns. Ann. Inst. Stat. Math. 41(3), 583–600 (1989)

    Article  MathSciNet  Google Scholar 

  21. Penttinen, A.: Modelling interactions in spatial point patterns: parameter estimation by the maximum-likelihood method. Comp. Sci. Econ. Statist. 7, 1–107 (1984)

    Google Scholar 

Download references

Acknowledgements

This paper is funded in the framework of THLEMAXOS project which is funded by the Ionian Region Islands with MIS code 5007986 in the context of Operational Program Ionian Islands 2014-2020.

Author information

Authors and Affiliations

  1. Computer Engineering and Informatics Department, University of Patras, 26504, Patras, Greece

    Christos Karras, Aristeidis Karras & Spyros Sioutas

  2. Department of Management Science and Technology, University of Patras, 26334, Patras, Greece

    Ioanna Giannoukou

  3. Department of Informatics, Ionian University, 49100, Corfu, Greece

    Markos Avlonitis

Authors
  1. Christos Karras
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aristeidis Karras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Markos Avlonitis
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ioanna Giannoukou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Spyros Sioutas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christos Karras .

Editor information

Editors and Affiliations

  1. University of Piraeus, Piraeus, Greece

    Ilias Maglogiannis

  2. Democritus University of Thrace, Xanthi, Greece

    Lazaros Iliadis

  3. University of Sunderland, Sunderland, UK

    John Macintyre

  4. Universidade do Minho, Guimaraes, Portugal

    Paulo Cortez

Rights and permissions

Reprints and permissions

Copyright information

© 2022 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Karras, C., Karras, A., Avlonitis, M., Giannoukou, I., Sioutas, S. (2022). Maximum Likelihood Estimators on MCMC Sampling Algorithms for Decision Making. In: Maglogiannis, I., Iliadis, L., Macintyre, J., Cortez, P. (eds) Artificial Intelligence Applications and Innovations. AIAI 2022 IFIP WG 12.5 International Workshops. AIAI 2022. IFIP Advances in Information and Communication Technology, vol 652. Springer, Cham. https://doi.org/10.1007/978-3-031-08341-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-08341-9_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-08340-2

  • Online ISBN: 978-3-031-08341-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships