Transformation of dynamic facial image sequences using static 2D prototypes

Abstract

This paper describes a new method for creating visually realistic moving facial image sequences that retain an actor’s personality (individuality, expression and characteristic movements) while altering the facial appearance along a certain specified facial dimension. We combine two existing technologies, facial feature tracking and facial image transformation, to create the sequences. Examples are given of transforming the apparent age, ethnic appearance and gender of a face. We also create “virtual cartoons” by transforming image sequences into the style of famous artists. The results show that static 2D face models can be used to create realistic transformations of sequences that include changes in pose, expression andmouth shape.