skip to main content
research-article

Interactive generation of human animation with deformable motion models

Published: 15 December 2009 Publication History

Abstract

This article presents a new motion model deformable motion models for human motion modeling and synthesis. Our key idea is to apply statistical analysis techniques to a set of precaptured human motion data and construct a low-dimensional deformable motion model of the form x = M(α, γ), where the deformable parameters α and γ control the motion's geometric and timing variations, respectively. To generate a desired animation, we continuously adjust the deformable parameters' values to match various forms of user-specified constraints. Mathematically, we formulate the constraint-based motion synthesis problem in a Maximum A Posteriori (MAP) framework by estimating the most likely deformable parameters from the user's input. We demonstrate the power and flexibility of our approach by exploring two interactive and easy-to-use interfaces for human motion generation: direct manipulation interfaces and sketching interfaces.

References

[1]
Arikan, O. and Forsyth, D. A. 2002. Interactive motion generation from examples. ACM Trans. Graph. 21, 3, 483--490.
[2]
Bishop, C. 1996. Neural Network for Pattern Recognition. Cambridge University Press.
[3]
Brand, M. and Hertzmann, A. 2000. Style machines. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). 183--192.
[4]
Catmull, E. and Rom, R. 1974. A class of local interpolating splines. In Computer Aided Geometric Design, Academic Press.
[5]
Chai, J. and Hodgins, J 2005. Performance animation from low-dimensional control signals. ACM Trans. Graph. 24, 3, 686--696.
[6]
Chai, J. and Hodgins, J. 2007. Constraint-Based motion optimization using a statistical dynamic model. ACM Trans. Graph. 26, 3, Article no.8.
[7]
Grochow, K., Martin, S. L., Hertzmann, A., and Popović, Z. 2004. Style-Based inverse kinematics. ACM Trans. Graph. 23, 3, 522--531.
[8]
Heck, R., Kovar, L., and Gleicher, M 2007. Splicing upper-body actions with locomotion. Comput. Graph. Forum 25, 3, 459--466.
[9]
Howe, N., Leventon, M., and Freeman, W 1999. Bayesian reconstruction of 3D human motion from single-camera video. Adv. Neural Inform. Process. Syst. 12, 820--826.
[10]
Kovar, L. and Gleicher, M. 2003. Registration curves. In Proceedings of the ACM SIGGRAPH/EUROGRAPHICS Symposium on Computer Animation. 214--224.
[11]
Kovar, L. and Gleicher, M. 2004. Automated extraction and parameterization of motions in large data sets. ACM Trans. Graph. 23, 3, 559--568.
[12]
Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. ACM Trans. Graph. 21, 3, 473--482.
[13]
Kwon, T. and Shin, S. Y. 2005. Motion modeling for on-line locomotion synthesis. In Proceedings of the ACM SIGGRAPH Symposium on Computer Animation. 29--38.
[14]
Lee, J., Chai, J., Reitsma, P., Hodgins, J., and Pollard, N. 2002. Interactive control of avatars animated with human motion data. ACM Trans. Graph. 21, 3, 491--500.
[15]
Lee, K. H., Choi, M. G., and Lee, J 2006. Motion patches: Building blocks for virtual environments annotated with motion data. ACM Trans. Graph. 25, 3, 898--906.
[16]
Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: A two-level statistical model for character synthesis. ACM Trans. Graph. 21, 3, 465--472.
[17]
Lourakis, M. 2009. Levmar: Nonlinear least squares algorithms in C/C++. http://www.ics.forth.gr/lourakis/levmar/.
[18]
Molina Tanco, L. and Hilton, A. 2000. Realistic synthesis of novel human movements from a database of motion capture examples. In Proceedings of the Workshop on Human Motion. 137--142.
[19]
Mukai, T. and Kuriyama, S. 2005. Geostatistical motion interpolation. ACM Trans. Graph. 24, 3, 1062--1070.
[20]
Myers, C. S. and Rabiner, L. R. 1981. A comparative study of several dynamic time-warping algorithms for connected word recognition. The Bell Syst.Tech. J. 60, 7, 1389--1409.
[21]
Ormoneit, D., Sidenbladh, H., Black, M., and Hastie, T. 2001. Learning and tracking cyclic human motion. Adv. Neural Inform. Process. Syst. 13, 894--900.
[22]
Pavlović, V., Rehg, J. M., and MacCormick, J. 2000. Learning switching linear models of human motion. Adv. Neural Inform. Process. Syst. 12, 981--987.
[23]
Rose, C., Cohen, M. F., and Bodenheimer, B. 1998. Verbs and adverbs: Multidimensional motion interpolation. IEEE Comput. Graph. Appl. 18, 5, 32--40.
[24]
Safonova, A. and Hodgins, J. K. 2007. Construction and optimal search of interpolated motion graphs. ACM Trans. Graph. 26, 3, Article no. 106.
[25]
Shum, H. P. H., Komura, T., Shiraishi, M., and Yamazaki, S. 2008. Interaction patches for multi-character animation. ACM Trans. Graph. 27, 5, Article no. 114.
[26]
Sidenbladh, H., Black, M. J., and Sigal, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In Proceedings of the European Conference on Computer Vision. 784--800.
[27]
Treuille, A., Lee, Y., and Popović, Z. 2007. Near-Optimal character animation with continuous control. ACM Trans. Graph. 26, 3, Article no. 7.
[28]
Witkin, A. and Kass, M. 1988. Spacetime constraints. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'88). 159--168.
[29]
Yin, K., Loken, K., and van de Panne, M. 2007. Simbicon: Simple biped locomotion control ACM Trans. Graph. 26, 3, Article no. 105.

Cited By

View all
  • (2025)Diverse Motion In-Betweening From Sparse Keyframes With Dual Posture StitchingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.336345731:2(1402-1413)Online publication date: Feb-2025
  • (2024)Personality Expression Using Co-Speech GestureACM Transactions on Applied Perception10.1145/369490522:2(1-20)Online publication date: 30-Nov-2024
  • (2024)SKEL-Betweener: a Neural Motion Rig for Interactive Motion AuthoringACM Transactions on Graphics10.1145/368794143:6(1-11)Online publication date: 19-Dec-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 29, Issue 1
December 2009
127 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1640443
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 December 2009
Accepted: 01 August 2009
Received: 01 May 2009
Published in TOG Volume 29, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 3D animation interfaces
  2. Character animation
  3. animation with constraints
  4. data-driven animation
  5. optimization
  6. statistical analysis and synthesis

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)85
  • Downloads (Last 6 weeks)9
Reflects downloads up to 06 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Diverse Motion In-Betweening From Sparse Keyframes With Dual Posture StitchingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.336345731:2(1402-1413)Online publication date: Feb-2025
  • (2024)Personality Expression Using Co-Speech GestureACM Transactions on Applied Perception10.1145/369490522:2(1-20)Online publication date: 30-Nov-2024
  • (2024)SKEL-Betweener: a Neural Motion Rig for Interactive Motion AuthoringACM Transactions on Graphics10.1145/368794143:6(1-11)Online publication date: 19-Dec-2024
  • (2024)Long‐term Motion In‐betweening via Keyframe PredictionComputer Graphics Forum10.1111/cgf.15171Online publication date: 9-Oct-2024
  • (2024)A Deep Learning Framework for Start–End Frame Pair-Driven Motion SynthesisIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.321359635:5(7021-7034)Online publication date: May-2024
  • (2024)Breathing Life Into Sketches Using Text-to-Video Priors2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00414(4325-4336)Online publication date: 16-Jun-2024
  • (2024)Orientation-aware leg movement learning for action-driven human motion predictionPattern Recognition10.1016/j.patcog.2024.110317150(110317)Online publication date: Jun-2024
  • (2024)Plan, Posture and Go: Towards Open-Vocabulary Text-to-Motion GenerationComputer Vision – ECCV 202410.1007/978-3-031-73383-3_26(445-463)Online publication date: 29-Sep-2024
  • (2023)MOCHA: Real-Time Motion Characterization via Context MatchingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618252(1-11)Online publication date: 10-Dec-2023
  • (2023)A Deep Learning Framework for Character Motion Synthesis and EditingSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596789(733-743)Online publication date: 1-Aug-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media