ABSTRACT
One main concern of audiovisual speech research is the intelligibility of audiovisual speech (i.e., talking head). In fact, lip reading is crucial for challenged population as hard of hearing people. For audiovisual synthesis and animation, this suggests that one should pay careful attention to modeling the region of the face that participates actively during speech. Above all, a facial animation system needs extremely good representations of lip motion and deformation in order to achieve realism and effective communication.
Index Terms
- Dynamic realistic lip animation using a limited number of control points
Recommendations
Multimodal speaker/speech recognition using lip motion, lip texture and audio
Special section: Multimodal human-computer interfacesWe present a new multimodal speaker/speech recognition system that integrates audio, lip texture and lip motion modalities. Fusion of audio and face texture modalities has been investigated in the literature before. The emphasis of this work is to ...
3D Models Of The Lips For Realistic Speech Animation
CA '96: Proceedings of the Computer Animation3D models of the lips have been developed in the framework of an audio visual articulatory speech synthesizer. Unlike most of the regions of the human face, the lips are essentially characterized by their border contours. The internal and external ...
A coupled HMM approach to video-realistic speech animation
We propose a coupled hidden Markov model (CHMM) approach to video-realistic speech animation, which realizes realistic facial animations driven by speaker independent continuous speech. Different from hidden Markov model (HMM)-based animation approaches ...
Comments