Skip to main content
Log in

Abstract

Coupled Hidden Markov Models (CHMM) are a tool which model interactions between variables in state space rather than observation space. Thus they may reveal coupling in cases where classical tools such as correlation fail. In this paper we derive the maximum a posteriori equations for the Expectation Maximisation algorithm. The use of the models is demonstrated on simulated data, as well as in a variety of biomedical signal analysis problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. R. Bannister and C.J. Mathias, Autonomic Failure, A Textbook of Clinical Disorders of the Autonomic Nervous System, 3rd edn., Oxford: Oxford University Press, 1993.

    Google Scholar 

  2. R.K. Kushwaha, W.J. Williams, and H. Shevrin, “An Information Flow Technique for Category Related Evoked Potentials,” IEEE Transactions on Biomedical Engineering, vol. 39,no. 2, 1992, pp. 165-175.

    Article  Google Scholar 

  3. M. Azzouzi and I.T. Nabney, “Time Delay Estimation with Hidden Markov Models,” in Ninth International Conference on Artificial Neural Networks, London: IEE, 1999, pp. 473-478.

    Google Scholar 

  4. W.D. Penny and S.J. Roberts, “Gaussian Observation Hidden Markov Models for EEG Analysis,” Technical Report TR-98-12, Imperial College London, 1998.

  5. M. Brand, “Coupled Hidden Markov Models for Modeling Interacting Processes,” Technical Report 405, MIT Media Lab Perceptual Computing, June 1997.

  6. S. Roweis and Z. Ghahramani, “A Unifying Review of Linear Gaussian Models,” Computation and Neural Systems, California Institute of Technology, 1997.

  7. L.R. Rabiner, “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,” Proceeding of the IEEE, vol. 77,no. 2, 1989, pp. 257-284.

    Article  Google Scholar 

  8. B.J. Frey, Graphical Models for Machine Learning and Digital Communication, Cambridge, MA: MIT Press, 1998.

    Google Scholar 

  9. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, 2nd edn., San Mateo: Morgan Kaufmann, 1988.

    Google Scholar 

  10. P.M. Lee, Bayesian Statistics: An Introduction, London: Edward Arnold, 1989.

    MATH  Google Scholar 

  11. R.W. McLachlan and T. Krishnan, The EM Algorithm and Extensions, New York: John Wiley & Sons, 1997.

    MATH  Google Scholar 

  12. S. Roweis and Z. Ghahramani, “A Unifying Review of Linear Gaussian Models,” Neural Computation, vol. 11,no. 2, 1999, pp. 305-345.

    Article  Google Scholar 

  13. C.M. Bishop, Neural Networks for Pattern Recognition, Oxford: Oxford University Press, 1995.

    Google Scholar 

  14. I. Rezek, P. Sykacek, and S.J. Roberts, “Learning Interaction Dynamics with Coupled Hidden Markov Models,” IEE Proceedings—Science, Measurement and Technology, vol. 147,no. 6, 2000, pp. 345-350. Also available at http://www.robots.ox.ac.uk/~irezek.

    Article  Google Scholar 

  15. I. Rezek and S.J. Roberts, “Parametric Model Order Estimation: A Brief Review,” in IEE Colloquium on the Use of Model-Based Digital Signal Processing Techniques in the Analysis of Biomedical Signals, April 1997.

  16. I. Rezek and S.J. Roberts, “Stochastic Complexity Measures for Physiological Signal Analysis,” IEEE Transactions on Biomedical Engineering, vol. 44,no. 9, 1998, pp. 1186-1191.

    Article  Google Scholar 

  17. R.F. Schmidt and G. Thews, Physiologie des Menschen, 24th edn., Berlin: Springer, 1990.

    Google Scholar 

  18. M. Arnold, W. Miltner, H. Witte, R. Bauer, and C. Braun, “Adaptive Measurement of Linear Dependence between Physiological Signals by Means of Time-Varying Multivariate AR-Modelling,” IEEE Transactions on Biomedical Engineering, submitted.

  19. Task Force of the European Society of Cardiology and the North American Society of Pacing, and Electrophysiology, “Heart-Rate Variability: Standards of Measurement, Physiological Interpretation and Clinical Use,” Circulation, vol. 93, 1996, pp. 1043-1065.

    Article  Google Scholar 

  20. P. Sykacek, S. Roberts, A. Flexer, and G. Dorffner, “A Probabilistic Approach to High Resolution Sleep Analysis,” in Proceedings of the International Conference on Neural Networks (ICANN), G. Dorffner (Ed.), Wien: Springer Verlag, 2001.

    Google Scholar 

  21. J.R. Wolpaw, N. Birbaumer, W.J. Heetderks, D.J. McFarland, P. Hunter Peckham, G. Shalk, E. Donchin, L.A. Quatrano, C.J.U. Robinson, and T.M. Vaughan, “Brain-Computer Interface Technology: A Review of the First International Meeting,” IEEE Transactions on Rehabilitation Engineering, vol. 8,no. 2, 2000, pp. 164-173.

    Article  Google Scholar 

  22. W.D. Penny, S.J. Roberts, E. Curran, and M. Stokes, “EEG-Based Communication: A Pattern Recognition Approach,” IEEE Transactions on Rehabilitation Engineering, vol. 8,no. 2, 2000.

  23. S.J. Roberts, “Analysis of the Human Sleep Electroencephalogram Using a Self-Organising Neural Network,” Ph.D. Thesis, University of Oxford, 1991.

  24. I. Rezek and S.J. Roberts, “Estimation of Coupled Hidden Markov Models with Application to Biosignal Interaction Modelling,” in NNSP International Workshop on Neural Networks for Signal Processing, 2000. Also available at http://www.robots.ox.ac.uk/~irezek.

  25. A. Flexer, P. Sykacek, I. Rezek, and G. Dorffner, “Using Hidden Markov Models to Build an Automatic, Continuous and Probabilistic Sleep Stager for the SIESTA Project,” in European Medical and Biological Engineering Conference, 1999.

  26. M. Brand, “An Entropic Estimator for Structure Discovery,” in Neural Information Processing Systems, NIPS 11, 1999.

  27. T.S. Jaakkola, “Tutorial on Variational Approximation Methods.” Available at http://www.ai.mit.edu/people/tommi/, 2000.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rezek, I., Gibbs, M. & Roberts, S.J. Maximum a Posteriori Estimation of Coupled Hidden Markov Models. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 32, 55–66 (2002). https://doi.org/10.1023/A:1016363317870

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1016363317870

Navigation