A new method based on model selection for acoustic model training is proposed .The MPE trained model and the MLE trained model is used for model selection for the following training. The selection criteria is based on the ratio of the inter-variance to the intra-variance of each model. Besides we also propose a cluster method for the model in order to get the accuracy information for the weight calculation. The experiments demonstrate that the new model can get better performance than any of the directly trained models.