Wan-Chun Ma
ABSTRACT
In this paper we present an interactive editing system that allows digital modelers to rapidly create new blendshape face models for incidental or background characters, starting from a small number of given face models. The obvious approach of generating linear combinations of the given models is limited in that it does not explore the combinatorial variety in the given source models. Instead, we take an approach similar to the "facial composite" systems used in forensics, in which face features (eyes, nose, mouth, etc.) from different individuals are assembled to create a composite likeness. A literal implementation of the facial composite idea does not produce realistic faces however, since choosing features from faces of different sizes can result in both unrealistic discontinuities and position relationship violations (a selected mouth might be at a higher position that the bottom of the nose selected from a different character). To handle this, we adopt a gradient-domain assembly and blending of the individual features, and produce the final face by integrating the resulting Poisson equation. This method guarantees that the result is smooth and that position relationships from the source characters are preserved. Additional blendshape expression targets are generated by the same approach, using the same gradient blending used to produce the neutral face. The resulting system is simple, operates at interactive rates, and has already proven itself in production.
- Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. Graph. 23, 3, 294--302. Google Scholar
Digital Library
- Agarwala, A. 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
- Alexa, M. 2003. Differential coordinates for local mesh morphing and deformation. The Visual Computer 19, 2--3, 105--114.Google ScholarCross Ref
- Amberg, B., Romdhani, S., and Vetter, T. 2007. Optimal step nonrigid ICP algorithms for surface registration. In Proc. Computer Vision and Pattern Recognition 2007, 1--8.Google Scholar
- Botsch, M., and Sorkine, O. 2008. On linear variational surface deformation methods. IEEE Trans. on Visualization and Computer Graphics 14, 1, 213--230. Google ScholarDigital Library
- Connor, M., and Kumar, P. 2010. Fast construction of k-nearest neighbor graphs for point clouds. IEEE Trans. on Visualization and Computer Graphics 16, 4, 599--608. Google ScholarDigital Library
- Daneshmandi, A., 2012. PortraitPad web application. http://portraitpad.com.Google Scholar
- Goldman, D. B., and Chen, J.-H. 2005. Vignette and exposure calibration and compensation. In Proc. International Conference on Computer Vision 2005, 899--906. Google ScholarDigital Library
- IQ Biometrix, Inc., 2012. FACES 4.0 facial composite software. http://www.iqbiometrix.com.Google Scholar
- Ishchenko, M., 2012. FlashFace web application. http://flashface.ctapt.de.Google Scholar
- Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In Proc. European Conference on Computer Vision 2004, 377--389.Google Scholar
- Lewis, J. 2001. Lifting detail from darkness. In ACM SIGGRAPH 2001 Talks.Google Scholar
- Lipman, Y., Sorkine, O., Cohen-Or, D., Levin, D., Rössl, C., and Seidel, H.-P. 2004. Differential coordinates for interactive mesh editing. In Proc. Shape Modeling International 2004, 181--190. Google ScholarDigital Library
- Noh, J.-y., and Neumann, U. 2001. Expression cloning. In Proc. SIGGRAPH 2001, 277--288. Google ScholarDigital Library
- Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. In Proc. SIGGRAPH 2003, 313--318. Google ScholarDigital Library
- Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proc. Eurographics/ACM SIGGRAPH Symposium on Geometry Processing 2004, 175--184. Google ScholarDigital Library
- Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. Graph. 23, 3, 399--405. Google ScholarDigital Library
- A facial composite editor for blendshape characters
Recommendations
Semantically-aware blendshape rigs from facial performance measurements
SA '16: SIGGRAPH ASIA 2016 Technical BriefsWe present a framework for automatically generating personalized blendshapes from actor performance measurements, while preserving the semantics of a template facial animation rig. Firstly, we capture various poses from the subject with our ...
Rapid Photorealistic Blendshape Modeling from RGB-D Sensors
CASA '16: Proceedings of the 29th International Conference on Computer Animation and Social AgentsCreating and animating realistic 3D human faces is an important element of virtual reality, video games, and other areas that involve interactive 3D graphics. In this paper, we propose a system to generate photorealistic 3D blendshape-based face models ...
Comments