Design and Implementation of Speech Recognition System Based on Gesture Control

Abstract

Gesture is a basic human characteristic and an indispensable part of interpersonal communication. Gesture recognition voice playback system is designed for deaf and mute people, which can help them communicate with normal people more conveniently. The system is divided into hardware part and software part. The hardware part includes data acquisition and analysis. The raspberry pie system is adopted. The raspberry pie system mainly includes three hardware modules: camera module, wireless network card module and serial communication module. The software part uses Python language to program the raspberry pie, and PyCharm is used as the programming software. The gestures made by deaf-mute people can be converted into text information through this system and displayed on the display screen. At the same time, the voice can be played, so that the normal people and deaf-mute people can understand each other. The experimental results show that the speech recognition system based on gesture control can achieve the function of gesture acquisition, and can play gesture information through loudspeakers, and display gesture information on the screen, which provides a convenient communication between deaf and mute people and normal people.