Speech recognition technology and ZigBee technology is widely implemented to improve the quality of life especially for the deaf-mute. This paper presents the design and implementation of a speech interaction system for the deaf-mute based on ZigBee wireless sensor work (WSN). In this system, one speech-recognition modules have been added to the ZigBee-based networks. The recognized messages are sent by these modules then be routed to the target device, and finally be carried out by micro control unit (MCU). Because of the limited number of users, speaker-dependent speech recognition has been used in our work. Also, this system has realized a function of sound alerts for deaf-mute which is based on many acoustic sensors. In order to help deaf-mute perceive the sound when they are alone at home, these sensors are installed on the doors and phone. Some experimental results validate the basic functions of the proposed system. It turns out to be convenient and effective to communicate with deaf-mute for families at home.