Abstract
While facial expressions and phoneme states are analyzed and published very well, the dynamic deformation of a face is rarely described or modeled. Recently dynamic facial expressions are analyzed. We describe a capture system, processing steps and analysis results useful for modeling facial deformations while speaking. The capture system consists of a double mirror construction and a high speed camera, in order to get fluid motion. Not only major face features as well as a high accuracy of the tracked facial points, are required for such analysis. The dynamic analysis results demonstrate the potential of a reduced phoneme alphabet, because of similar 3D shape deformations. The separation of asymmetric facial motion allows to setup a personalized deformation model, besides the common symmetric deformation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cohen, I., Sebe, N., Garg, A., Lew, M.S., Huang, T.S.: Facial Expression Recognition from Video Sequences: Temporal ansd Static Modeling. In: Computer Vision and Image Understanding, September 2003, pp. 160–187 (2003)
Hu, C., Chang, Y., Feris, R., Turk, M.: Manifold based analysis of facial expression. In: CVPRW 2004: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW 2004), Washington, DC, USA, vol. 5, p. 81. IEEE Computer Society, Los Alamitos (2004)
Zhang, Y., Ji, Q.: Facial expression understanding in image sequences using dynamic and active visual information fusion. In: ICCV 2003: Proceedings of the Ninth IEEE International Conference on Computer Vision, Washington, DC, USA, p. 1297. IEEE Computer Society, Los Alamitos (2003)
Basu, S.: A Three-Dimensional Model of Human Lip Motions. Master’s thesis, Massachusetts Institute of Technology Department of EECS, Cambridge, MA, USA (February 1997)
Odisioa, M., Baillya, G., Eliseia, F.: Tracking talking faces with shape and appearance models. Journal of Speech Communication 44, 63–82 (2004)
Badin, P., Bailly, G., Revéret, L., Baciu, M., Segebarth, C., Savariaux, C.: Three-dimensional articulatory modeling of tongue, lips and face, based on MRI and video images. Journal of Phonetics 30(3) (2002)
Dainese, G., Marcon, M., Sarti, A., Tubaro, S.: Accurate Depth-map estimation for 3D face modelling. In: 13th European Signal Processing Conference, September 2005, pp. 1883–1886 (2005)
International Phonetic Alphabet (IPA) for British and American phonemes. World Wide Web electronic publication
Rabiner, L., Rosenberg, A., Levinson, S.: Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Transaction on Acoustics, Speech and Signal Processing 26, 575–582 (1978)
Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Transaction on Acoustics, Speech and Signal Processing 26, 43–49 (1978)
Corradini, A.: Dynamic Time Warping for Off-Line Recognition of a Small Gesture Vocabulary. In: IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems (RATFG-RTS 2001), Washington, DC, USA, p. 82. IEEE Computer Society, Los Alamitos (2001)
Li, H., Greenspan, M.: Segmentation and Recognition of Continuous Gestures. In: Proc. of the IEEE International Conference on Image Processing ICIP 2007, San Antonio, TX, USA, pp. 365–368 (September 2007)
Niels, R.: Dynamic Time Warping: An Intuitive Way of Handwriting Recognition? Master’s thesis, Radboud University Nijmegen, Nijmegen, The Netherlands (2004)
Ratanamahatana, C.A., Keogh, E.: Three Myths about Dynamic Time Warping. In: Proc. of the SIAM International Conference on Data Mining (SDM 2005), Newport Beach, CA, USA, pp. 506–510 (April 2005)
Angeles-Yreta, A., Figueroa-Nazuno, J.: Computing Similarity Among 3D Objects Using Dynamic Time Warping. Springer, Heidelberg (2005)
Rabiner, L., Juang, B.H.: Fundamentals of speech recognition. Prentice-Hall, Inc., Upper Saddle River (1993)
ten Holt, G., Reinders, M., Hendriks, E.: Multi-dimensional dynamic time warping for gesture recognition. In: Proc. of the 13th Conference of the Advanced School of Computing and Imaging, Delft, The Netherlands, pp. 158–165 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rurainsky, J. (2010). System and Analysis Used for a Dynamic Facial Speech Deformation Model. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2010. Lecture Notes in Computer Science, vol 6111. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13772-3_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-13772-3_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13771-6
Online ISBN: 978-3-642-13772-3
eBook Packages: Computer ScienceComputer Science (R0)