Loading [a11y]/accessibility-menu.js
Speaking mode variability in multimodal speech production | IEEE Journals & Magazine | IEEE Xplore

Speaking mode variability in multimodal speech production


Abstract:

The speech acoustics and the phonetically relevant motion of the face during speech are determined by the time-varying behavior of the vocal tract. A benefit of this link...Show More

Abstract:

The speech acoustics and the phonetically relevant motion of the face during speech are determined by the time-varying behavior of the vocal tract. A benefit of this linkage is that we are able to estimate face motion from the spectral acoustics during speech production using simple neural networks. Thus far, however, the scope of reliable estimation has been limited to individual sentences; network training degrades sharply when multiple sentences are analyzed together. While there is a number of potential avenues for improving network generalization, this paper investigates the possibility that the experimental recording procedures introduce artificial boundary constraints between sentence length utterances. Specifically, the same sentence materials were recorded individually and as part of longer, paragraph length utterances. The scope of reliable network estimation was found to depend both on the length of the utterance (sentence versus paragraph) and, not surprisingly, on phonetic content: estimation of face motion from speech acoustics was reliable for larger sentence training sets when sentences were recorded in continuous paragraph readings; and greater phonetic diversity reduced reliability.
Published in: IEEE Transactions on Neural Networks ( Volume: 13, Issue: 4, July 2002)
Page(s): 894 - 899
Date of Publication: 31 July 2002

ISSN Information:

PubMed ID: 18244485

Contact IEEE to Subscribe

References

References is not available for this document.