Abstract
Audio/visual speech, in the form of labial movement and facial expression data, was utilized in order to semi-automatically build a new Italian expressive and emotive talking head capable of believable and emotional behavior. The methodology, the procedures and the specific software tools utilized for this scope will be described together with some implementation examples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Working Group at the Dagstuhl Seminar on Multimodality, questionnaire on Multimodality (2001), http://www.dfki.de/~wahlster/Dagstuhl_Multi_Modality
Ferrigno, G., Pedotti, A.: ELITE: A Digital Dedicated Hardware System for Movement Analysis via Real-Time TV Signal Processing. IEEE Trans. on Biomedical Engineering BME-32, 943–950 (1985)
Boersma, P.: PRAAT, a system for doing phonetics by computer. Glot International 5(9/10), 341–345 (1996)
Magno Caldognetto, E., Cosi, P., Drioli, C., Tisato, G., Cavicchio, F.: Coproduction of Speech and Emotions: Visual and Acoustic Modifications of Some Phonetic Labial Targets. In: Proc. AVSP 2003, Audio Visual Speech Processing, ISCA Workshop, St Jorioz, France, September 4-7, pp. 209–214 (2003)
Drioli, C., Tisato, G., Cosi, P., Tesser, F.: Emotions and Voice Quality: Experiments with Sinusoidal Modeling. In: Proceedings of Voqual 2003, Voice Quality: Functions, Analysis and Synthesis, ISCA Workshop, Geneva, Switzerland, August 27-29, pp. 127–132 (2003)
Pelachaud, C., Magno Caldognetto, E., Zmarich, C., Cosi, P.: Modelling an Italian Talking Head. In: Proc. AVSP 2001, Aalborg, Denmark, September 7-9, pp. 72–77 (2001)
Cosi, P., Magno Caldognetto, E., Perin, G., Zmarich, C.: Labial Coarticulation Modeling for Realistic Facial Animation. In: Proc. ICMI 2002, 4th IEEE International Conference on Multimodal Interfaces 2002, Pittsburgh, PA, USA, October 14-16, pp. 505–510 (2002)
Cosi, P., Magno Caldognetto, E., Tisato, G., Zmarich, C.: Biometric Data Collection For Bimodal Applications. In: Proceedings of COST 275 Workshop, The Advent of Biometric on the Internet, Rome, November 7-8, pp. 127–130 (2002)
MPEG-4 standard. Home page: http://www.chiariglione.org/mpeg/index.htm
Cosi, P., Fusaro, A., Tisato, G.: LUCIA a New Italian Talking-Head Based on a Modified Cohen-Massaro’s Labial Coarticulation Model. In: Proc. Eurospeech 2003, Geneva, Switzerland, September 1-4, pp. 127–132 (2003)
Cosi, P., Tesser, F., Gretter, R., Avesani, C.: Festival Speaks Italian! In: Proc. Eurospeech 2001, Aalborg, Denmark, September 3-7, pp. 509–512 (2001)
FACEGEN web page: http://www.facegen.com/index.htm
Cohen, M., Massaro, D.: Modeling Coarticulation in Synthetic Visual Speech. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) Models and Techniques in Computer Animation, pp. 139–156. Springer, Tokyo (1993)
Perin, G.: Facce parlanti: sviluppo di un modello coarticolatorio labiale per un sistema di sintesi bimodale. MThesis, Univ. of Padova, Italy, 2000-1
Ekman, P., Friesen, W.: Facial Action Coding System. Consulting Psychologist Press Inc., Palo Alto (1978)
Tiede, M.K., Vatikiotis-Bateson, E., Hoole, P., Yehia, H.: Magnetometer data acquisition and analysis software for speech production research. ATR Technical Report TRH, 1999, ATR Human Information Processing Labs, Japan (1999)
BTS home page: http://www.bts.it/index.php
Ruttkay, Z., Noot, H., ten Hagen, P.: Emotion Disc and Emotion Squares: tools to explore the facial expression space. Computer Graphics Forum 22(1), 49–53 (2003)
Costantini, E., Pianesi, F., Cosi, P.: Evaluation of Synthetic Faces: Human Recognition of Emotional Facial Displays. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds.) ADS 2004. LNCS (LNAI), vol. 3068, pp. 276–287. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cosi, P., Fusaro, A., Grigoletto, D., Tisato, G. (2004). Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-24842-2_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22143-2
Online ISBN: 978-3-540-24842-2
eBook Packages: Springer Book Archive