Regular Article
Large scale discriminative training of hidden Markov models for speech recognition

https://doi.org/10.1006/csla.2001.0182Get rights and content

Abstract

This paper describes, and evaluates on a large scale, the lattice based framework for discriminative training of large vocabulary speech recognition systems based on Gaussian mixture hidden Markov models (HMMs). This paper concentrates on the maximum mutual information estimation (MMIE) criterion which has been used to train HMM systems for conversational telephone speech transcription using up to 265 hours of training data. These experiments represent the largest-scale application of discriminative training techniques for speech recognition of which the authors are aware. Details are given of the MMIE lattice-based implementation used with the extended Baum-Welch algorithm, which makes training of such large systems computationally feasible. Techniques for improving generalization using acoustic scaling and weakened language models are discussed. The overall technique has allowed the estimation of triphone and quinphone HMM parameters which has led to significant reductions in word error rate for the transcription of conversational telephone speech relative to our best systems trained using maximum likelihood estimation (MLE). This is in contrast to some previous studies, which have concluded that there is little benefit in using discriminative training for the most difficult large vocabulary speech recognition tasks. The lattice MMIE-based discriminative training scheme is also shown to out-perform the frame discrimination technique. Various properties of the lattice-based MMIE training scheme are investigated including comparisons of different lattice processing strategies (full search and exact-match) and the effect of lattice size on performance. Furthermore a scheme based on the linear interpolation of the MMIE and MLE objective functions is shown to reduce the danger of over-training. It is shown that HMMs trained with MMIE benefit as much as MLE-trained HMMs from applying model adaptation using maximum likelihood linear regression (MLLR). This has allowed the straightforward integration of MMIE-trained HMMs into complex multi-pass systems for transcription of conversational telephone speech and has contributed to our MMIE-trained systems giving the lowest word error rates in both the 2000 and 2001 NIST Hub5 evaluations.

References (37)

  • M.J.F. Gales

    Maximum likelihood linear transformations for HMM-based speech recognition

    Computer Speech & Language

    (1998)
  • M.J.F. Gales et al.

    Mean and variance adaptation within the MLLR framework

    Computer Speech & Language

    (1996)
  • V. Valtchev et al.

    MMIE training of large vocabulary speech recognition systems

    Speech Communication

    (1997)
  • L. R. Bahl, P. F. Brown, P. V. de Souza, R. L. Mercer, Proceedings of the International Conference on Acoustics, Speech...
  • W. Chou, C.-H. Lee, B.-H. Juang, Proceedings of the International Conference on Acoustics, Speech and Signal...
  • Y. L. Chow, Proceedings of the International Conference on Acoustics, Speech and Signal Processing’90, 1990,...
  • G. Evermann, P. C. Woodland, Proceedings of the International Conference on Acoustics, Speech and Signal...
  • G. Evermann, P. C. Woodland, Proceedings of the Speech Transcription Workshop, 2000b, College...
  • P.S. Gopalakrishnan et al.

    An inequality for rational functions with applications to some statistical estimation problems

    IEEE Trans. Information Theory

    (1991)
  • P. S. Gopalakrishnan, D. Kanevsky, A. Nádas, D. Nahamoo, M. A. Picheney, Proceedings of the International Conference on...
  • T. Hain, P. C. Woodland, G. Evermann, D. Povey, Proceedings of the Speech Transcription Workshop, 2000, College...
  • T. Hain, P. C. Woodland, T. R. Niesler, E. W. D. Whittaker, Proceedings of the International Conference on Acoustics,...
  • M. M. Hochberg, L. T. Niles, J. T. Foote, H. F. Silverman, Proceedings of the International Conference on Acoustics,...
  • S. Kapadia,...
  • S. Kapadia, V. Valtchev, S. J. Young, Proceedings of the International Conference on Acoustics, Speech and Signal...
  • C.J. Leggetter et al.

    Maximum likelihood linear regression for speaker adaptation of continuous density HMMs

    Computer Speech & Language

    (1995)
  • X. Luo, F. Jelinek, Proceedings of the International Conference on Acoustics, Speech and Signal Processing’99,Phoenix,...
  • L. Mangu, E. Brill, A. Stolcke, Proceedings of European Conference on Speech Communication and Technology’99, Budapest,...
  • Cited by (251)

    View all citing articles on Scopus
    1

    {pcw,dp10006}@eng.cam.ac.uk

    View full text