Abstract
Hidden Markov models (HMM) are widely used for speech recognition and have recently gained a lot of attention in the bioinformatics community, because of their ability to capture the information buried in biological sequences. Usually, heuristic algorithms such as Baum-Welch are used to estimate the model parameters. However, Baum-Welch has a tendency to stagnate on local optima. Furthermore, designing an optimal HMM topology usually requires a priori knowledge from a field expert and is usually found by trial-and-error. In this study, we present an evolutionary algorithm capable of evolving both the topology and the model parameters of HMMs. The applicability of the method is exemplified on a secondary structure prediction problem.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. In: Proceedings of the IEEE, Vol. 77, No. 2. (1989) 257–285
Kwong, S. and Chau, C.: Analysis of Parallel Genetic Algorithms on HMM Based Speech Recognition System. In: Proceedings of ICASSP (1997) 1229–1233
Slimane, M., Venturini, G., de Beauville, J.A., Brouard, T., and Brandeau, A.: Optimizing Hidden Markov Models with a Genetic Algorithm. In: Artificial Evolution (1995) 140–144
Tanaka, H., Onizuka, K., and Asai, K.: Classification of Proteins via Successive State Splitting of Hidden Markov Network. In: 13th International Joint Conference on Artificial Intelligence (IJCAI93) (1993) 140–144
Stolcke, A. and Omohundro, S.: Hidden Markov Model Induction by Bayesian Model Merging. In: Hanson, S.J., Cowan, J.D., and Giles, C.L. eds.: Advances in Neural Information Processing Systems, Vol. 5. Morgan Kaufmann, San Mateo, CA (1993) 11–18
Yada, T., Ishikawa, M., Tanaka, H., and Asai, K.: Extraction of Hidden Markov Model Representations of Signal Patterns in DNA Sequences. In: Proceedings of the First Pacific Symposium on Biocomputing (1996) 686–696
Kwong, S., Chau, C., Man, K., and Tang, K.: Optimisation of HMM Topology and its Model Parameters by Genetic Algorithms. Pattern Recognition, Vol. 34. (2001) 509–522
Asai, K., Hayamizu, S., and Handa, K.: Prediction of Protein Secondary Structure by the Hidden Markov Model. Computer Applications in the Biosciences (CABIOS), Vol. 9, No. 2. (1993) 141–146
Murphy, K. and Mian, S.: Modelling Gene Expression Data using Dynamic Bayesian Networks. Technical report, Computer Science Division, University of California, Berkeley, CA (1999)
Berman, H., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T., Weissig, H., Shindyalov, I.N., and Bourne, P.: The Protein Data Bank. Nucleic Acids Research, Vol. 28, No. 1. (2000) 235–242
Lund, O., Frimand, K., Gorodkin, J., Bohr, H., Bohr, J., Hansen, J., and Brunak, S.: Protein Distance Constraints Predicted by Neural Networks and Probability Density Functions. Prot. Eng., Vol. 10. (1997) 1241–1248
Petersen, T.N., Lundegaard, C., Nielsen, M., Bohr, H., Bohr, J., and Brunak, S.: Prediction of Protein Secondary Structure at 80% Accuracy. PROTEINS: Structure, Function, and Genetics, Vol. 41. (2000) 17–20
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Thomsen, R. (2002). Evolving the Topology of Hidden Markov Models Using Evolutionary Algorithms. In: Guervós, J.J.M., Adamidis, P., Beyer, HG., Schwefel, HP., Fernández-Villacañas, JL. (eds) Parallel Problem Solving from Nature — PPSN VII. PPSN 2002. Lecture Notes in Computer Science, vol 2439. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45712-7_83
Download citation
DOI: https://doi.org/10.1007/3-540-45712-7_83
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44139-7
Online ISBN: 978-3-540-45712-1
eBook Packages: Springer Book Archive