Guoyuan Lin
ABSTRACT
In this paper, we proposed an automated speech recognition system focus on the dispatching call recordings in the underground coal mines which promoted the development of intelligent coal mining. The main challenges of the speech recognition system are the noise of recordings and the dialect speech. We employed a voice activity detection module to preprocess the recordings, this module is able to reduce the noise and segment the long recording speech; then the Conformer model with CTC algorithm is utilized to train the ASR module. To get better performance, the WenetSpeech pretrained model is embedded for fine-tuning. The result shows that compared with the other general speech recognition systems, our ASR system has great advance in recognizing the dispatching call recordings of Huaibei dialect.
- Sohn, Jongseo, Nam Soo Kim, and Wonyong Sung. "A statistical model-based voice activity detection." IEEE signal processing letters 6.1 (1999): 1-3.Google Scholar
- Gulati, Anmol, "Conformer: Convolution-augmented transformer for speech recognition." arXiv preprint arXiv:2005.08100 (2020).Google Scholar
- Sharma, Mayank, "A comprehensive empirical review of modern voice activity detection approaches for movies and TV shows." Neurocomputing (2022).Google Scholar
- D. Ying, Y. Yan, J. Dang and F. K. Soong, "Voice Activity Detection Based on an Unsupervised Learning Framework," in IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 8, pp. 2624-2633, Nov. 2011, doi: 10.1109/TASL.2011.2125953.Google ScholarDigital Library
- Woo, Kyoung-Ho, "Robust voice activity detection algorithm for estimating noise spectrum." Electronics Letters 36.2 (2000): 180-181.Google ScholarCross Ref
- J. Ramírez and J. C. Segura , “Efficient voice activity detection algorithms using long-term speech information,” Speech Commun., vol. 42, no. 3, pp. 271–287, 2004.Google ScholarCross Ref
- Greff, Klaus, "LSTM: A search space odyssey." IEEE transactions on neural networks and learning systems 28.10 (2016): 2222-2232.Google Scholar
- Ferroni, Giacomo, "A deep neural network approach for voice activity detection in multi-room domestic scenarios." 2015 International Joint Conference on Neural Networks (IJCNN). IEEE, 2015.Google Scholar
- K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556.Google Scholar
- Davis KH, Biddulph R, Balashek S (1952) Automatic recognition of spoken digits. J Acoust Soc Am 24(6):637–642Google Scholar
- Juang, B‐H. "On the hidden Markov model and dynamic time warping for speech recognition—A unified view." AT&T Bell Laboratories Technical Journal 63.7 (1984): 1213-1243.Google ScholarCross Ref
- Gales, Mark JF. "Maximum likelihood linear transformations for HMM-based speech recognition." Computer speech & language 12.2 (1998): 75-98.Google Scholar
- Li, Jinyu, "Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM." 2012 IEEE Spoken Language Technology Workshop (SLT). IEEE, 2012.Google Scholar
- Soltau, Hagen, Hank Liao, and Hasim Sak. "Neural speech recognizer: Acoustic-to-word LSTM model for large vocabulary speech recognition." arXiv preprint arXiv:1610.09975 (2016).Google Scholar
- Mamiya, Yoshitaka, "Lightly supervised GMM VAD to use audiobook for speech synthesiser." 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, 2013.Google Scholar
- Zhang, B., Lv, H., Guo, P., Shao, Q., Yang, C., Xie, L., Xu, X., Bu, H., Chen, X., Zeng, C., Wu, D., & Peng, Z. (2021). WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognition. ArXiv. /abs/2110.03370.Google Scholar
- Klakow, Dietrich, and Jochen Peters. "Testing the correlation of word error rate and perplexity." Speech Communication 38.1-2 (2002): 19-28.Google ScholarDigital Library
Index Terms
- Automated Speech Recognition System for Dispatching Call Recordings in The Underground Coal Mines
Recommendations
Improving Throat Microphone Speech Recognition by Joint Analysis of Throat and Acoustic Microphone Recordings
We present a new framework for joint analysis of throat and acoustic microphone (TAM) recordings to improve throat microphone only speech recognition. The proposed analysis framework aims to learn joint sub-phone patterns of throat and acoustic ...
MFCC-GMM based accent recognition system for Telugu speech signals
Speech processing is very important research area where speaker recognition, speech synthesis, speech codec, speech noise reduction are some of the research areas. Many of the languages have different speaking styles called accents or dialects. ...
Comments