Article

Reducing blendshape interference by selected motion attenuation

Authors:

Jonathan Mooser,

Ulrich NeumannAuthors Info & Claims

I3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and games

Pages 25 - 29

https://doi.org/10.1145/1053427.1053431

Published: 03 April 2005 Publication History

Abstract

Blendshapes (linear shape interpolation models) are perhaps the most commonly employed technique in facial animation practice. A major problem in creating blendshape animation is that of blendshape interference: the adjustment of a single blendshape "slider" may degrade the effects obtained with previous slider movements, because the blendshapes have overlapping, non-orthogonal effects. Because models used in commercial practice may have 100 or more individual blendshapes, the interference problem is the subject of considerable manual effort. Modelers iteratively resculpt models to reduce interference where possible, and animators must compensate for those interference effects that remain. In this short paper we consider the blendshape interference problem from a linear algebra point of view. We find that while full orthogonality is not desirable, the goal of preserving previous adjustments to the model can be effectively approached by allowing the user to temporarily designate a set of points as representative of the previous (desired) adjustments. We then simply solve for blendshape slider values that mimic desired new movement while moving these "tagged" points as little as possible. The resulting algorithm is easy to implement and demonstrably reduces cases of blendshape interference found in existing models.

References

[1]

Beier, T., 2005. personal communication. Hammerhead Productions.

[2]

Bergeron, P., and Lachapelle, P. 1985. Controlling facial expression and body movements in the computer generated short 'Tony de Peltrie'. In SIGGRAPH Tutorial Notes. ACM.

[3]

Bergeron, P. 1987. 3-d character animation on the symbolics system. SIGGRAPH Course Notes: 3-D Character Animation by Computer (July).

[4]

Blanz, T., and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In Proceedings of ACM SIGGRAPH 1999, ACM SIGGRAPH, 187--194.

Digital Library

[5]

Choe, B., Lee, H., and Ko, H.-S. 2001. Performance-driven muscle-based facial animation. J. Visualization and Computer Animation 12, 2, 67--79.

[6]

Elson, M. 1990. "Displacement" facial animation techniques. SIGGRAPH Course Notes: State of the Art in Facial Animation.

[7]

Grochow, K., Martin, S. L., Hertzmann, A., and Popovic, Z. 2004. Style-based inverse kinematics. ACM Trans. Graph. 23, 3, 522--531.

Digital Library

[8]

Jenkins, S., 2004. personal communication. Disney Feature Animation.

[9]

Joshi, P., Tien, W. C., Desbrun, M., and Pighin, F. 2003. Learning controls for blend shape based realistic facial animation. Eurographics/SIGGRAPH Symposium on Computer Animation (SCA).

Digital Library

[10]

Kleiser, J. 1989. A fast, efficient, accurate way to represent the human face. In SIGGRAPH '89 Course Notes 22: State of the Art in Facial Animation.

[11]

Kurihara, T., and Miyata, N. 2004. Modeling deformable human hands from medical images. In SCA '04: Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, 355--363.

Digital Library

[12]

Landreth, C., 1998. Bingo. Computer generated short film directed by Chris Landreth.

[13]

Magnenat-Thalmann, N., Laperriere, R., and Thalmann, D. 1988. Joint-dependent local deformations for hand animation and object grasping. In Proc. Graphics Interface, 26--33.

Digital Library

[14]

Mohr, A., Tokheim, L., and Gleicher, M. 2003. Direct manipulation of interactive character skins. In Symposium on Interactive 3D Graphics, ACM.

Digital Library

[15]

Parke, F. 1972. Computer generated animation of faces. Proceedings ACM annual conference. (Aug.).

Digital Library

[16]

Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., and Salesin, D. 1998. Synthesizing realistic facial expressions from photographs. In Proceedings of ACM SIGGRAPH 1998, ACM SIGGRAPH, 75--84.

Digital Library

[17]

Raitt, B., 2004. The making of Gollum. Presentation at U. Southern California Institute for Creative Technologies's Frontiers of Facial Animation Workshop, August.

[18]

Video, 2005. Accompanying video for "Reducing Blendshape Interference by Selected Motion Attenuation". http://graphics.usc.edu/~noisebrain/I3D2005.mov.

[19]

Yamane, K., and Nakamura, Y. 2003. Natural motion animation through constraining and deconstraining at will. IEEE Tran. Visualization and Computer Graphics 9, 3, 352--360.

Digital Library

[20]

Zhao, X., 2001. personal communication. Disney Feature Animation.

Cited By

Wisetchat SStevens KFrost S(2024)Facial modeling and measurement based upon homologous topographical featuresPLOS ONE10.1371/journal.pone.030456119:5(e0304561)Online publication date: 31-May-2024
https://doi.org/10.1371/journal.pone.0304561
Nicolas WUlrich SMario B(2024)SparseSoftDECA — Efficient high-resolution physics-based facial animation from sparse landmarksComputers & Graphics10.1016/j.cag.2024.103903119(103903)Online publication date: Apr-2024
https://doi.org/10.1016/j.cag.2024.103903
Bin Ahmad MMohd Suaib NAhmad Rahman A(2024)Position-Aware 3D Facial Expression Mapping Using Ray Casting and BlendshapeEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_376(1442-1446)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_376
Show More Cited By

Index Terms

Reducing blendshape interference by selected motion attenuation
1. Computing methodologies
  1. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Animating blendshape faces by cross-mapping motion capture data
I3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games

Animating 3D faces to achieve compelling realism is a challenging task in the entertainment industry. Previously proposed face transfer approaches generally require a high-quality animated source face in order to transfer its motion to new 3D faces. In ...
Orthogonal-Blendshape-Based Editing System for Facial Motion Capture Data

The authors present a novel data-driven 3D facial motion capture data editing system using automated construction of an orthogonal blendshape face model and constrained weight propagation, aiming to bridge the popular facial motion capture technique and ...
Facial retargeting with automatic range of motion alignment

While facial capturing focuses on accurate reconstruction of an actor's performance, facial animation retargeting has the goal to transfer the animation to another character, such that the semantic meaning of the animation remains. Because of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and games

April 2005

231 pages

ISBN:1595930132

DOI:10.1145/1053427

Conference Chairs:
Anselmo Lastra
University of North Carolina at Chapel Hill, USA
,
Marc Olano
University of Maryland Baltimore County, USA
,
Program Chairs:
David Luebke
University of Virginia, USA
,
Hanspeter Pfister
Mitsubishi Electric Research Laboratories, USA

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 April 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

I3D05

Sponsor:

SIGGRAPH

I3D05: Symposium on Interactive 3D Graphics and Games 2005

April 3 - 6, 2005

District of Columbia, Washington

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Upcoming Conference

I3D '25

Sponsor:
siggraph

Symposium on Interactive 3D Graphics and Games

May 7 - 9, 2025

Jersey City , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
385
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wisetchat SStevens KFrost S(2024)Facial modeling and measurement based upon homologous topographical featuresPLOS ONE10.1371/journal.pone.030456119:5(e0304561)Online publication date: 31-May-2024
https://doi.org/10.1371/journal.pone.0304561
Nicolas WUlrich SMario B(2024)SparseSoftDECA — Efficient high-resolution physics-based facial animation from sparse landmarksComputers & Graphics10.1016/j.cag.2024.103903119(103903)Online publication date: Apr-2024
https://doi.org/10.1016/j.cag.2024.103903
Bin Ahmad MMohd Suaib NAhmad Rahman A(2024)Position-Aware 3D Facial Expression Mapping Using Ray Casting and BlendshapeEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_376(1442-1446)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_376
Wagner NBotsch MSchwanecke U(2023)SoftDECA: Computationally Efficient Physics-Based Facial AnimationsProceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games10.1145/3623264.3624439(1-11)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1145/3623264.3624439
Somepalli MCharan MShruthi SPalaniswamy S(2021)Implementation of Single Camera Markerless Facial Motion Capture using Blendshapes2021 IEEE International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS)10.1109/CSITSS54238.2021.9683460(1-6)Online publication date: 16-Dec-2021
https://doi.org/10.1109/CSITSS54238.2021.9683460
Abdrashitov RChevalier FSingh KIqbal SMacLean KChevalier FMueller S(2020)Interactive Exploration and Refinement of Facial Expression using Manifold LearningProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415877(778-790)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415877
Bin Ahmad MMohd Suaib NAhmad Rahman A(2020)Position-Aware 3D Facial Expression Mapping Using Ray Casting and BlendshapeEncyclopedia of Computer Graphics and Games10.1007/978-3-319-08234-9_376-1(1-4)Online publication date: 10-Apr-2020
https://doi.org/10.1007/978-3-319-08234-9_376-1
Seol YCozens M(2019)Interactive editing of performance-based facial animationSIGGRAPH Asia 2019 Technical Briefs10.1145/3355088.3365147(61-64)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3355088.3365147
Reed KCosker D(2019)User‐Guided Facial Animation through an Evolutionary InterfaceComputer Graphics Forum10.1111/cgf.1361238:6(165-176)Online publication date: 19-Mar-2019
https://doi.org/10.1111/cgf.13612
Wisetchat SStevens K(2018)Visualizing style differences through 3D animationDigital Creativity10.1080/14626268.2018.1542316(1-12)Online publication date: 10-Nov-2018
https://doi.org/10.1080/14626268.2018.1542316
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten