Loading [a11y]/accessibility-menu.js
Speaker location and microphone spacing invariant acoustic modeling from raw multichannel waveforms | IEEE Conference Publication | IEEE Xplore

Speaker location and microphone spacing invariant acoustic modeling from raw multichannel waveforms


Abstract:

Multichannel ASR systems commonly use separate modules to perform speech enhancement and acoustic modeling. In this paper, we present an algorithm to do multichannel enha...Show More

Abstract:

Multichannel ASR systems commonly use separate modules to perform speech enhancement and acoustic modeling. In this paper, we present an algorithm to do multichannel enhancement jointly with the acoustic model, using a raw waveform convolutional LSTM deep neural network (CLDNN). We will show that our proposed method offers ~5% relative improvement in WER over a log-mel CLDNN trained on multiple channels. Analysis shows that the proposed network learns to be robust to varying angles of arrival for the target speaker, and performs as well as a model that is given oracle knowledge of the true location. Finally, we show that training such a network on inputs captured using multiple (linear) array configurations results in a model that is robust to a range of microphone spacings.
Date of Conference: 13-17 December 2015
Date Added to IEEE Xplore: 11 February 2016
ISBN Information:
Conference Location: Scottsdale, AZ, USA

References

References is not available for this document.