Voice and Speech Training System for the Hearing-Impaired Children Using Tablet Terminal

Abstract

Speech is an important human capability, especially as a learning base for expression and communication. However, it is very difficult for children with hearing disorders to obtain this basic ability while they are young.

The authors have found the potential of using voice recognition in application systems for portable devices and tablet terminal for use in the speech training of children with hearing disorders since early childhood (pre-school). In this paper, we propose the creation of this application through evaluation and discussion of practicality.

The application focuses on the enjoyment of a game and a sense of accomplishment so that children can keep learning with motivation while operating. A tablet is used for this system for easy operation by children. The environment includes OS: Windows 10, Game Engine: Unity, and Voice analysis: Julius. The application has voice recognition, so it can be operated through speech. This voice recognition covers from simple sounds to utterance accuracy: it recognizes whether the child is using their voice and if the utterance is correct. In this way, the application can help children with hearing disorders to acquire speech and reduce disability in the future.