Extreme Learning Machine (ELM) has become popular for solving classification problem due to its fast speed. However, the system of ELM may be unreliable since its performance often relies on random input hidden node parameters. The techniques of combining multiple classifiers are widely adopted to improve both reliability and accuracy of a single classifier. Thus, this paper presents a minimum square error (MSE) based weighted voting method to optimize the linear combination of multiple ELMs. The experimental results over ten VCI data sets show better classification performance than the original ELM and the voting based ELM classifiers.