Abstract
This paper presents a set of technologies developed with the goal to improve the learning and practice of Cued Speech (CS). They are based on 3D graphics and are covering the entire end-to-end content chain: production, transmission and visualization. Starting from the requirements of an online system for CS, the research and development path took into account real-time constraints, personalization, user acceptability and equally important, the easiness and feasibility of the deployment. The original components of the system include 3D graphics and animation encoders, streaming servers and visualization engines and are validated in two applications: a web service for text to animation conversion and a chat service supporting two or more users.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aboutabit, N., et al.: TELMA: Telephony for the Hearing-Impaired People.From models to User Tests (2007)
Albrecht, I., Haber, J., Seidel, H.-P.: Speech synchronization for physics-based facial animation. In: Proceedings of WSCG 2002, pp. 9–16 (2002)
Beier, T., Neely, S.: Feature-based image metamorphosis. In: SIGGRAPH proceedings, pp. 35–42. ACM Press, New York (1992)
Beskow, J., Dahlquist, M., Granström, B., Lundeberg, M., Spens, K.-E., Öhman, T.: The Teleface project - Multimodal Speech Communication for the Hearing Impaired. In: Eurospeech 1997, Greece (1997)
Caplier, A., Bonnaud, L., Malassiotis, S., Strintzis, M.G.: Comparison of 2D and 3D Analysis For Automated Cued Speech Gesture Recognition (2004)
Cornett, R.O.: Annotated bibliography of research on Cued Speech. CS Journal 4, 77–99 (1990)
Coquillart, S.: Extended free-form deformation: A sculpturing tool for 3d geometricmodeling. Computer Graphics 24, 187–193 (1990)
Deng, Z., Neumann, U.: Data-Driven 3D Facial Animation. In: Softcover, illus. in color, vol. VIII, 296, p. 149 (2008) ISBN: 978-1-84628-906-4
Doenges, P., Lavagetto, F., Ostermann, J., Pandzic, I.S., Petajan, E.: MPEG-4: Audio/video and synthetic graphics/audio for mixed media. Image Communications Journal 5(4) (1997)
Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press (1978)
Escher, M., Pandzic, I.S., Thalmann, N.M.: Facial deformations for mpeg-4. In: Proc. of Computer Animation 1998, Philadelphia, USA, pp. 138–145. IEEE Computer Society, Los Alamitos (1998)
Faulkner, A.: SYNFACE: A speech-driven synthetic face as a communication aid for hearing-impaired people. ELSNews 10.3, 3 (2001)
Gibert, G., Baily, G., Elisei, F.: Evaluation d’un système de synthèse 3D de Langue françaice parlée complétée, in Les Journées d’Étude sur la Parole, JEP (2006)
Kalra, P., Mangili, A., Thalmann, N.M., Thalmann, D.: Simulation of facial muscle actions based on rational free from deformations. In: Eurographics, vol. 11, pp. 59–69 (1992)
Lavagetto, F., Pockaj, R.: The facial animation engine: Toward a high-level interface for the design of mpeg-4 compliant animated faces. IEEE TCSVT 9(2), 277–289 (1999)
Massaro, D.W.: Symbiotic Value of an Embodied Agent in Language Learning. University of California, Santa Cruz (2004)
Nahas, M., Hutric, H., Rioux, M., Domey, J.: Facial image synthesis using skin texture recording. Visual Computer 6(6), 337–343 (1990)
Ostermann, J.: Animation of synthetic faces in mpeg-4. Proc. of IEEE CA (1998)
Parke, F.I.: Computer generated animation of faces (1972)
Pereira, F., Touradj, E.: The MPEG-4 Book. IMSC Press, Upper Saddle River (2002)
Preda, M., Prêteux, F.: Critic review on MPEG-4 Face and Body Animation. In: Proceedings IEEE International Conference on Image Processing (ICIP 2002), Rochester, NY, vol. 3, pp. 505–508 (2002)
Preda, M., Jovanova, B., Arsov, I., Prêteux, F.: Optimized MPEG-4 animation encoder for motion capture data. In: 3D Web Technology (Web3D 2007), Perugia, Italy, pp. 181–190 (2007)
Viad, M.L., Yahia, H.: Facial animation with wrinkles. In: Proceedings of the Third Eurographics Workshop on Animation and Simulation (1992)
Wang, C.L.Y., Langwidere, D.R.F.: A new facial animation system. In: Proceedings of Computer Animation, pp. 59–68 (1994)
Waters, K.: A muscle model for animating three-dimensional facial expression. In: SIGGRAPH Proceedings, vol. 21, pp. 17–24 (1987)
ISO/IEC JTC1/SC29/WG11: Standard 14496 2, a.k.a. MPEG 4 Part 2: Visual (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Arsov, I., Jovanova, B., Preda, M., Preteux, F. (2010). On-Line Animation System for Learning and Practice Cued Speech. In: Davcev, D., Gómez, J.M. (eds) ICT Innovations 2009. ICT Innovations 2009. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10781-8_33
Download citation
DOI: https://doi.org/10.1007/978-3-642-10781-8_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10780-1
Online ISBN: 978-3-642-10781-8
eBook Packages: EngineeringEngineering (R0)