Hybrid Voice Conversion of Unit Selection and Generation Using Prosody Dependent HMM

Tadashi OKUBO
Ryo MOCHIZUKI
Tetsunori KOBAYASHI

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E89-D    No.11    pp.2775-2782
Publication Date: 2006/11/01
Online ISSN: 1745-1361
DOI: 10.1093/ietisy/e89-d.11.2775
Print ISSN: 0916-8532
Type of Manuscript: PAPER
Category: Speech and Hearing
Keyword: 
voice conversion,  speech synthesis,  HMM,  unit selection,  MLLR,  

Full Text: PDF(419.3KB)>>
Buy this Article



Summary: 
We propose a hybrid voice conversion method which employs a combination of techniques using HMM-based unit selection and spectrum generation. In the proposed method, the HMM-based unit selection selects the most likely unit for the required phoneme context from the target speaker's corpus when candidates of the target unit exist in the corpus. Unit selection is performed based on the sequence of the spectral probability distribution obtained from the adapted HMMs. On the other hand, when a target unit does not exist in a corpus, a target waveform is generated from the adapted HMM sequence by maximizing the spectral likelihood. The proposed method also employs the HMM in which the spectral probability distribution is adjusted to the target prosody using the weight defined by the prosodic probability of each distribution. To show the effectiveness of the proposed method, sound quality and speaker individuality tests were conducted. The results revealed that the proposed method could produce high-quality speech and individuality of the synthesized sound was more similar to the target speaker compared to conventional methods.


open access publishing via