Abstract
Coupled Hidden Markov Models (CHMM) are a tool which model interactions between variables in state space rather than observation space. Thus they may reveal coupling in cases where classical tools such as correlation fail. In this paper we derive the maximum a posteriori equations for the Expectation Maximisation algorithm. The use of the models is demonstrated on simulated data, as well as in a variety of biomedical signal analysis problems.
Similar content being viewed by others
References
R. Bannister and C.J. Mathias, Autonomic Failure, A Textbook of Clinical Disorders of the Autonomic Nervous System, 3rd edn., Oxford: Oxford University Press, 1993.
R.K. Kushwaha, W.J. Williams, and H. Shevrin, “An Information Flow Technique for Category Related Evoked Potentials,” IEEE Transactions on Biomedical Engineering, vol. 39,no. 2, 1992, pp. 165-175.
M. Azzouzi and I.T. Nabney, “Time Delay Estimation with Hidden Markov Models,” in Ninth International Conference on Artificial Neural Networks, London: IEE, 1999, pp. 473-478.
W.D. Penny and S.J. Roberts, “Gaussian Observation Hidden Markov Models for EEG Analysis,” Technical Report TR-98-12, Imperial College London, 1998.
M. Brand, “Coupled Hidden Markov Models for Modeling Interacting Processes,” Technical Report 405, MIT Media Lab Perceptual Computing, June 1997.
S. Roweis and Z. Ghahramani, “A Unifying Review of Linear Gaussian Models,” Computation and Neural Systems, California Institute of Technology, 1997.
L.R. Rabiner, “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,” Proceeding of the IEEE, vol. 77,no. 2, 1989, pp. 257-284.
B.J. Frey, Graphical Models for Machine Learning and Digital Communication, Cambridge, MA: MIT Press, 1998.
J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, 2nd edn., San Mateo: Morgan Kaufmann, 1988.
P.M. Lee, Bayesian Statistics: An Introduction, London: Edward Arnold, 1989.
R.W. McLachlan and T. Krishnan, The EM Algorithm and Extensions, New York: John Wiley & Sons, 1997.
S. Roweis and Z. Ghahramani, “A Unifying Review of Linear Gaussian Models,” Neural Computation, vol. 11,no. 2, 1999, pp. 305-345.
C.M. Bishop, Neural Networks for Pattern Recognition, Oxford: Oxford University Press, 1995.
I. Rezek, P. Sykacek, and S.J. Roberts, “Learning Interaction Dynamics with Coupled Hidden Markov Models,” IEE Proceedings—Science, Measurement and Technology, vol. 147,no. 6, 2000, pp. 345-350. Also available at http://www.robots.ox.ac.uk/~irezek.
I. Rezek and S.J. Roberts, “Parametric Model Order Estimation: A Brief Review,” in IEE Colloquium on the Use of Model-Based Digital Signal Processing Techniques in the Analysis of Biomedical Signals, April 1997.
I. Rezek and S.J. Roberts, “Stochastic Complexity Measures for Physiological Signal Analysis,” IEEE Transactions on Biomedical Engineering, vol. 44,no. 9, 1998, pp. 1186-1191.
R.F. Schmidt and G. Thews, Physiologie des Menschen, 24th edn., Berlin: Springer, 1990.
M. Arnold, W. Miltner, H. Witte, R. Bauer, and C. Braun, “Adaptive Measurement of Linear Dependence between Physiological Signals by Means of Time-Varying Multivariate AR-Modelling,” IEEE Transactions on Biomedical Engineering, submitted.
Task Force of the European Society of Cardiology and the North American Society of Pacing, and Electrophysiology, “Heart-Rate Variability: Standards of Measurement, Physiological Interpretation and Clinical Use,” Circulation, vol. 93, 1996, pp. 1043-1065.
P. Sykacek, S. Roberts, A. Flexer, and G. Dorffner, “A Probabilistic Approach to High Resolution Sleep Analysis,” in Proceedings of the International Conference on Neural Networks (ICANN), G. Dorffner (Ed.), Wien: Springer Verlag, 2001.
J.R. Wolpaw, N. Birbaumer, W.J. Heetderks, D.J. McFarland, P. Hunter Peckham, G. Shalk, E. Donchin, L.A. Quatrano, C.J.U. Robinson, and T.M. Vaughan, “Brain-Computer Interface Technology: A Review of the First International Meeting,” IEEE Transactions on Rehabilitation Engineering, vol. 8,no. 2, 2000, pp. 164-173.
W.D. Penny, S.J. Roberts, E. Curran, and M. Stokes, “EEG-Based Communication: A Pattern Recognition Approach,” IEEE Transactions on Rehabilitation Engineering, vol. 8,no. 2, 2000.
S.J. Roberts, “Analysis of the Human Sleep Electroencephalogram Using a Self-Organising Neural Network,” Ph.D. Thesis, University of Oxford, 1991.
I. Rezek and S.J. Roberts, “Estimation of Coupled Hidden Markov Models with Application to Biosignal Interaction Modelling,” in NNSP International Workshop on Neural Networks for Signal Processing, 2000. Also available at http://www.robots.ox.ac.uk/~irezek.
A. Flexer, P. Sykacek, I. Rezek, and G. Dorffner, “Using Hidden Markov Models to Build an Automatic, Continuous and Probabilistic Sleep Stager for the SIESTA Project,” in European Medical and Biological Engineering Conference, 1999.
M. Brand, “An Entropic Estimator for Structure Discovery,” in Neural Information Processing Systems, NIPS 11, 1999.
T.S. Jaakkola, “Tutorial on Variational Approximation Methods.” Available at http://www.ai.mit.edu/people/tommi/, 2000.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Rezek, I., Gibbs, M. & Roberts, S.J. Maximum a Posteriori Estimation of Coupled Hidden Markov Models. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 32, 55–66 (2002). https://doi.org/10.1023/A:1016363317870
Published:
Issue Date:
DOI: https://doi.org/10.1023/A:1016363317870