Expansions of mobile services and private data have required increased level of protection. Speaker recognition, one of the biometric technologies, arises lots of research interests for its simple, cheap and convenient characteristics. In this paper, a robust speaker recognition system which facilitates reliable authentication with multi-channel voices is presented. A large multi-channel corpus, including mobile phone, personal digital assistant (PDA), telephone and microphone, is collected to evaluate the system performance.