Head Modeling from Pictures and Morphing in 3D with Image Metamorphosis Based on Triangulation

Abstract

This paper describes a combined method of facial reconstruction and morphing between two heads, showing the extensive usage of feature points detected from pictures. We first present an efficient method to generate a 3D head for animation from picture data and then a simple method to do 3D-shape interpolation and 2D morphing based on triangulation. The basic idea is to generate an individualized head modified from a generic model using orthogonal picture input, then process automatic texture mapping with texture image generation by combining orthogonal pictures and coordinate generation by projection from a resulted head in front, right and left views, which results a nice triangulation on texture image. Then an intermediate shape can be obtained from interpolation between two different persons. The morphing between 2D images is processed by generating an intermediate image and new texture coordinate. Texture coordinates are interpolated linearly, and the texture image is created using Barycentric coordinates for each pixel in each triangle given from a 3D head. Various experiments, with different ratio between shape, images and various expressions, are illustrated.