Abstract
We present a method for the synthesis of sequences of realistically looking human movements from learned example patterns. We apply this technique for the synthesis of dynamic facial expressions. Sequences of facial movements are decomposed into individual movement elements which are modeled by linear combinations of learned examples. The weights of the linear combinations define an abstract pattern space that permits a simple modification and parameterization of the style of the individual movement elements. The elements are defined in a way that is suitable for a simple automatic resynthesis of longer sequences from movement elements with different styles. We demonstrate the efficiency of this technique for the animation of a 3D head model and discuss how it can be used to generate spatio-temporally exaggerated sequences of facial expressions for psychophysical experiments on caricature effects.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P Benson and D Perrett. Perception and recognition of photographic quality facial caricatures: Implications for the recognition of natural images. Journal of Cognitive Psychology, 3(1):105–135, 1991.
V Blanz and T Vetter. Morphable model for the synthesis of 3d faces. In Proceedings of SIGGRAPH 99, Los Angeles, pages 187–194, 1999.
M Brand. Style machines. In Proceedings of SIGGRAPH 2000, New Orleans, Lousiana, USA, pages 23–28, 2000.
A Bruderlin and L Williams. Motion signal processing. In Proceedings of SIGGRAPH 95, Los Angeles, pages 97–104, 1995.
T Caelli, A McCabe, and G Binsted. Learning the shape of complex actions. In C Arcelli, L Cordella, and G Sanniti, editors, Proceedings of the International Workshop on Visual Form: IWVF2001, pages 24–39;. Springen, Berlin, 2001.
A J Calder, D Rowland, A W Young, I Nimmo-Smith, J Keane, and D I Perrett. Caricaturing facial expressions. Cognition, 76:105–146, 2000.
M A Giese and T Poggio. Morphable models for the analysis and synthesis of complex motion pattern,. International Journal of Computer Vision, 38:59–73, 2000.
H Hill and A Johnston. Categorizing sex and identity from the biological motion of faces. Current Biology, 11:880–885, 2001.
H Hill and F E Pollick. Exaggerating temporal differences enhances recognition of individuals from point light displays. Psychological Science, 11:223–228, 2000.
W Ilg and M A Giese. Modeling of movement sequences based on hierarchical hierarchical spatio-temporal correspondence between movement primitives. In Workshop on Biologically Motivated Computer Vision 2002. Springer, Berlin, this volume.
A Lamouret and M van de Panne. Motion synthesis by example. In Proceedings of 7th CAS’ 96 Eurographics Workshop on Animation and Simulation, pages 199–212, 1996.
J Lee, J Chai, P S Reitsma, J K Hodgkins, and N S Pollard. Interactive control of avatars animated with human motion data. In Proceedings of SIGGRAPH 2002, San Antonio, Texas, USA, page (in press), 2002.
H Sidenbladh, M J Black, and L Sigal. Implicit probabilistic models of human motion for synthesis and tracking. In Proceedings of the European Conference on Computer Vision (ECCV), Copenhagen, Danmark, pages 784–800, 2002.
D J Wiley and J Hahn. Interpolation synthesis of articulated figure motion. IEEE Transactions on Computer Graphics and Applications, 11:39–45, 1997.
A Witkin and Z Popović. Motion warping. In Proceedings of SIGGRAPH 95, Los Angeles, pages 105–108, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giese, M.A., Knappmeyer, B., Bülthoff, H.H. (2002). Automatic Synthesis of Sequences of Human Movements by Linear Combination of Learned Example Patterns. In: Bülthoff, H.H., Wallraven, C., Lee, SW., Poggio, T.A. (eds) Biologically Motivated Computer Vision. BMCV 2002. Lecture Notes in Computer Science, vol 2525. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36181-2_54
Download citation
DOI: https://doi.org/10.1007/3-540-36181-2_54
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00174-4
Online ISBN: 978-3-540-36181-7
eBook Packages: Springer Book Archive