Abstract
This paper proposes a double layer speech recognition and utterance verification system based on the analysis of the temporal evolution of HMM’s state scores. For the lower layer, it uses standard HMM-based acoustic modeling, followed by a Viterbi grammar-free decoding step which provides us with the state scores of the acoustic models. In the second layer, these state scores are added to the regular set of acoustic parameters, building a new set of expanded HMMs. This new paremeter models the acoustic HMM’s temporal evolution. Using the expanded set of HMMs for speech recognition a significant improvement in performance is achieved. Next, we will use this new architecture for utterance verification in a ”second opinion” framework. We will consign to the second layer evaluating the reliability of decoding using the acoustic models from the first layer. An outstanding improvement in performance versus a baseline verification system has been achieved with this new approach.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Huang, et al.: Spoken Language Processing, 1st edn. Prentice Hall PTR, Englewood Cliffs (2001)
Demuynck, et al.: Flavor: a flexible architecture for LVCSR. In: EUROSPEECH (2003)
Cox, Dasmahapatra: High-level approaches to confidence estimation in speech recognition. IEEE Trans. on Speech and Audio Processing 10, 460–471 (2002)
Hernández-Ábrego, Mariño: A second opinion approach for speech recognition verification. In: Proceedings of the VIII SNRFAI, vol. I (1999)
Stemmer, et al.: Context-dependent output densities for Hidden Markov Models in speech recognition. In: EUROSPEECH (2003)
Moreno, Winksky: Spanish fixed network speech corpus. SpeechDat Project. LRE-63314 (1999)
Bonafonte, et al.: Ramses: el sistema de reconocimiento del habla continua y gran vocabulario desarrollado por la UPC. VIII Jornadas de Telecom I+D (1998)
Young: Detecting misrecognitions and out-of-vocabulary words. In: ICASSP, vol. I (1994)
Jiang, Huang: Vocabulary-independent word confidence measure using subword features. In: ICSLP (1998)
Rahim, et al.: Discriminative utterance verification using minimum string verification error (MSVE) training. In: ICASSP (1996)
Schaaf, Kemps: Confidence measures for spontaneous speech recognition. In: ICASSP, vol. II (1997)
Sanchis: PhD Thesis. Estimation and application of confidence measures for speech recognition (in Spanish). PhD thesis, Universidad Politécnica de Valencia. Departamento de Sistemas Informáticos y Computación (2004)
Egan: Signal detection theory and ROC analysis. Academic Press, London (1975)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Casar, M., Fonollosa, J.A.R. (2006). Analysis of HMM Temporal Evolution for Automatic Speech Recognition and Verification. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2006. Lecture Notes in Computer Science(), vol 4188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11846406_45
Download citation
DOI: https://doi.org/10.1007/11846406_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39090-9
Online ISBN: 978-3-540-39091-6
eBook Packages: Computer ScienceComputer Science (R0)