Abstract
This paper proposes an effective loss function to assign the HMM state weight based on the MCE method. This is to remedy the performance limitation inherent in the traditional maximum likelihood method, which adjusts parameters to maximize the likelihood of training HMM. If minimum classification error method is used to minimize the error rate for training data, then the local optimum point can be achieved and the recognition performance can be achieved. However, if the amount of data used in the MCE training is too small, there can be a risk of overfitting to the training data. In this paper, we propose state modification by weighted linear loss function to overcome overfitting to training data. Representative experiments confirm this postulation and show the improvement in error rate when applied.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
X. Huang, et al: Spoken Language Processing, Prentice-Hall PTR, 2001.
Biing-Hwang Juang, Wu Chou, Chin-Hui Lee: Minimum Classification Error Rate Methods for Speech Recognition, IEEE Transactions on Speech and Audio Processing, Vol. 5, No. 3, PP. 257–265, May 1997.
Wu Chou, Chin-Hui Lee, Biing-Hwang Juang: Minimum Error Rate Training Based on N-best String Models, IEEE ICASSP 93, PP. 652–655, April 1993.
Wu Chou: Discriminant-Function-Based Minimum Recognition Error Rate Pattern-Recognition Approach to Speech Recognition, Proceedings of the IEEE, Vol. 88, No. 8, PP. 1201–1223, August 2000.
Min-Tau Lin, Andreas Spanias, Philipos Loizou: An Improved Approach to Robust Speech Recognition Using Minimum Error Classification, Speech Communication, Vol.30, PP. 27–36, 2000.
Darryl William Purnell and Elizabeth C. Botha: Improved Generalization of MCE Parameter Estimation with Application to Speech Recognition, IEEE Transactions on Speech and Audio Processing, Vol. 10, No. 4, PP. 232–239, May 2002.
O.W. Kwon, C.K. Un: Performance of HMM-based Speech Recognizers with Discriminative State-Weights, Speech Communication, Vol. 19, PP. 197–205, June 1996.
S. J. Young: The HTK Book 3.0, Cambridge University, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kwon, T., Ko, H. (2003). GPD-Based State Modification by Weighted Linear Loss Function. In: Sloot, P.M.A., Abramson, D., Bogdanov, A.V., Gorbachev, Y.E., Dongarra, J.J., Zomaya, A.Y. (eds) Computational Science — ICCS 2003. ICCS 2003. Lecture Notes in Computer Science, vol 2660. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44864-0_114
Download citation
DOI: https://doi.org/10.1007/3-540-44864-0_114
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40197-1
Online ISBN: 978-3-540-44864-8
eBook Packages: Springer Book Archive