Skip to main content

Hidden Markov Models

  • Reference work entry
Encyclopedia of Biometrics
  • 289 Accesses

Synonym

HMM

Definition

A Hidden Markov Model is a twofold stochastic process composed by a first-order Markov chain, which is a finite state machine ruled by state transition probabilities that solely depend on the immediate predecessor, and an associated probabilistic function. In a regular Markov model, the state is visible to any observer external to the model, whereas in a Hidden Markov Model (HMM), the state is not observable, that is, hidden, but each state has associated output probabilities over the possible observable tokens.

Introduction

Hidden Markov Models (HMMs) [1] were introduced by L.E. Baum in the late 1960s [2], and since the mid-1970s [3]–5]], they have become popular to model the statistical variation of the spectral features in speech recognition research. In the late 1980s, HMMs were applied to the analysis of DNA and other biological sequences. Nowadays, they are ubiquitous in bioinformatics, and in particular, in biometrics.

Architecture and Types

An HMM is...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 449.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286(1989)

    Article  Google Scholar 

  2. Baum, L.E., Egon, J.A.: An inequality with applications to statistical estimation for probabilistic functions of a markov process and to a model for ecology. Bull. Am. Meteorol. Soc. 73, 360–363 (1967)

    Article  MATH  Google Scholar 

  3. Baker, J.K.: The DRAGON system – an overview. IEEE Acoust. Speech Signal Process. Mag. 23, 24–29 (1975)

    Article  Google Scholar 

  4. Bakis, R.: Continuous speech recognition via centisecond acoustic states. In: Proceedings of the ASA Meeting (1976)

    Google Scholar 

  5. Jelinek, F.: Continuous speech recognition by statistical methods. Proc. IEEE 64, 532–556 (1976)

    Article  Google Scholar 

  6. Rabiner, L.R., Juang, B.H.: An introduction to hidden markov models. IEEE Acoust. Speech Signal Process. Mag. 3, 4–16 (1986)

    Google Scholar 

  7. Juang, B.H., Levinson, S.E., Sondhi, M.M.: Maximum likelihood estimations for multivariate mixture observations of markov chains. IEEE Trans. Inf. Technol. 32, 307–309 (1986)

    Article  Google Scholar 

  8. Baum, L.E.: An inequality and associated maximization technique in statistical estimation of probabilistic functions of markov processes. Inequal. 3, 1–8 (1972)

    Google Scholar 

  9. Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. 39, 1–38 (1977)

    MATH  MathSciNet  Google Scholar 

  10. Merialdo, B.: Phonetic recognition using hidden markov models and maximum mutual information training. In: Proceeding of the International Conference on Acoustics, Speech and Signal Processing pp. 111–114 (1988)

    Google Scholar 

  11. Bahl, Brown, P.F., de Souza, P.V., Mercer, R.L.: Estimating hidden markov model parameters so as to maximize speech recognition accuracy. IEEE Tran Speech Audio Processing 1, 77–83 (1993)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this entry

Cite this entry

Hernando, J. (2009). Hidden Markov Models. In: Li, S.Z., Jain, A. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-73003-5_195

Download citation

Publish with us

Policies and ethics