skip to main content
article

Style-based inverse kinematics

Published: 01 August 2004 Publication History

Abstract

This paper presents an inverse kinematics system based on a learned model of human poses. Given a set of constraints, our system can produce the most likely pose satisfying those constraints, in real-time. Training the model on different input data leads to different styles of IK. The model is represented as a probability distribution over the space of all possible poses. This means that our IK system can generate any pose, but prefers poses that are most similar to the space of poses in the training data. We represent the probability with a novel model called a Scaled Gaussian Process Latent Variable Model. The parameters of the model are all learned automatically; no manual tuning is required for the learning component of the system. We additionally describe a novel procedure for interpolating between styles.Our style-based IK can replace conventional IK, wherever it is used in computer animation and computer vision. We demonstrate our system in the context of a number of applications: interactive character posing, trajectory keyframing, real-time motion capture with missing markers, and posing from a 2D image.

Supplementary Material

MOV File (pps039.mov)

References

[1]
ARIKAN, O., AND FORSYTH, D. A. 2002. Synthesizing Constrained Motions from Examples. ACM Transactions on Graphics 21, 3 (July), 483--490. (Proc. of ACM SIGGRAPH 2002).
[2]
ARIKAN, O., FORSYTH, D. A., AND O'BRIEN, J. F. 2003. Motion Synthesis From Annotations. ACM Transactions on Graphics 22, 3 (July), 402--408. (Proc. SIGGRAPH 2003).
[3]
BISHOP, C. M. 1995. Neural Networks for Pattern Recognition. Oxford University Press.
[4]
BODENHEIMER, B., ROSE, C., ROSENTHAL, S., AND PELLA, J. 1997. The process of motion capture -- dealing with the data. In Computer Animation and Simulation '97, Springer-Verlag Wien New York, D. Thalmann and M. van de Panne, Eds., Eurographics, 3--18.
[5]
BRAND, M., AND HERTZMANN, A. 2000. Style machines. Proceedings of SIGGRAPH 2000 (July), 183--192.
[6]
BRAND, M. 1999. Shadow Puppetry. In Proc. ICCV, vol. 2, 1237--1244.
[7]
BRUDERLIN, A., AND WILLIAMS, L. 1995. Motion signal processing. Proceedings of SIGGRAPH 95 (Aug.), 97--104.
[8]
ELKOURA, G., AND SINGH, K. 2003. Handrix: Animating the Human Hand. Proc. SCA, 110--119.
[9]
GIRARD, M., AND MACIEJEWSKI, A. A. 1985. Computational Modeling for the Computer Animation of Legged Figures. In Computer Graphics (Proc. of SIGGRAPH 85), vol. 19, 263--270.
[10]
GRASSIA, F. S. 2000. Believable Automatically Synthesized Motion by Knowledge-Enhanced Motion Transformation. PhD thesis, CMU Computer Science.
[11]
GRAUMAN, K., SHAKHNAROVICH, G., AND DARRELL, T. 2003. Inferring 3D Structure with a Statistical Image-Based Shape Model. In Proc. ICCV, 641--648.
[12]
GULLAPALLI, V., GELFAND, J. J., AND LANE, S. H. 1996. Synergy-based learning of hybrid position/force control for redundant manipulators. In Proceedings of IEEE Robotics and Automation Conference, 3526--3531.
[13]
HOWE, N. R., LEVENTON, M. E., AND FREEMAN, W. T. 2000. Bayesian Reconstructions of 3D Human Motion from Single-Camera Video. In Proc. NIPS 12, 820--826.
[14]
KOVAR, L., AND GLEICHER, M. 2004. Automated Extraction and Parameterization of Motions in Large Data Sets. ACM Transactions on Graphics 23, 3 (Aug.). In these proceedings.
[15]
KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion Graphs. ACM Transactions on Graphics 21, 3 (July), 473--482. (Proc. SIGGRAPH 2002).
[16]
LAWRENCE, N., SEEGER, M., AND HERBRICH, R. 2003. Fast Sparse Gaussian Process Methods: The Informative Vector Machine. Proc. NIPS 15, 609--616.
[17]
LAWRENCE, N. D. 2004. Gaussian Process Latent Variable Models for Visualisation of High Dimensional Data. Proc. NIPS 16.
[18]
LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive Control of Avatars Animated With Human Motion Data. ACM Transactions on Graphics 21, 3 (July), 491--500. (Proc. SIGGRAPH 2002).
[19]
LI, Y., WANG, T., AND SHUM, H.-Y. 2002. Motion Texture: A Two-Level Statistical Model for Character Motion Synthesis. ACM Transactions on Graphics 21, 3 (July), 465--472. (Proc. SIGGRAPH 2002).
[20]
MACKAY, D. J. C. 1998. Introduction to Gaussian processes. In Neural Networks and Machine Learning, C. M. Bishop, Ed., NATO ASI Series. Kluwer Academic Press, 133--166.
[21]
NEAL, R. M. 1996. Bayesian Learning for Neural Networks. Lecture Notes in Statistics No. 118. Springer-Verlag.
[22]
NOCEDAL, J., AND WRIGHT, S. J. 1999. Numerical Optimization. Springer-Verlag.
[23]
O'HAGAN, A. 1978. Curve Fitting and Optimal Design for Prediction. J. of the Royal Statistical Society, ser. B 40, 1--42.
[24]
POPOVIĆ, Z., AND WITKIN, A. P. 1999. Physically Based Motion Transformation. Proceedings of SIGGRAPH 99 (Aug.), 11--20.
[25]
PULLEN, K., AND BREGLER, C. 2002. Motion Capture Assisted Animation: Texturing and Synthesis. ACM Transactions on Graphics 21, 3 (July), 501--508. (Proc. of ACM SIGGRAPH 2002).
[26]
RAMANAN, D., AND FORSYTH, D. A. 2004. Automatic annotation of everyday movements. In Proc. NIPS 16.
[27]
REDNER, R. A., AND WALKER, H. F. 1984. Mixture Densities, Maximum Likelihood and the EM Algorithm. SIAM Review 26, 2 (Apr.), 195--202.
[28]
ROSALES, R., AND SCLAROFF, S. 2002. Learning Body Pose Via Specialized Maps. In Proc. NIPS 14, 1263--1270.
[29]
ROSE, C., COHEN, M. F., AND BODENHEIMER, B. 1998. Verbs and Adverbs: Multidimensional Motion Interpolation. IEEE Computer Graphics & Applications 18, 5, 32--40.
[30]
ROSE III, C. F., SLOAN, P.-P. J., AND COHEN, M. F. 2001. Artist-Directed Inverse-Kinematics Using Radial Basis Function Interpolation. Computer Graphics Forum 20, 3, 239--250.
[31]
SIDENBLADH, H., BLACK, M. J., AND SIGAL, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In Proc. ECCV, LNCS 2353, vol. 1, 784--800.
[32]
SNELSON, E., RASMUSSEN, C. E., AND GHAHRAMANI, Z. 2004. Warped Gaussian Processes. Proc. NIPS 16.
[33]
TAYLOR, C. J. 2000. Reconstruction of Articulated Objects from Point Correspondences in a Single Image. In Proc. CVPR, 677--684.
[34]
WELMAN, C. 1993. Inverse Kinematics and Geometric Constraints for Articulated Figure Manipulation. PhD thesis, Simon Fraser University.
[35]
WILEY, D. J., AND HAHN, J. K. 1997. Interpolation Synthesis of Articulated Figure Motion. IEEE Computer Graphics & Applications 17, 6 (Nov.), 39--45.
[36]
WILLIAMS, C. K. I., AND RASMUSSEN, C. E. 1996. Gaussian Processes for Regression. Proc. NIPS 8, 514--520.
[37]
WILSON, A. D., AND BOBICK, A. F. 1999. Parametric Hidden Markov Models for Gesture Recognition. IEEE Trans. PAMI 21, 9 (Sept.), 884--900.
[38]
WITKIN, A., AND POPOVIĆ, Z. 1995. Motion Warping. Proceedings of SIGGRAPH 95 (Aug.), 105--108.
[39]
YAMANE, K., AND NAKAMURA, Y. 2003. Natural motion animation through constraining and deconstraining at will. IEEE Transactions on Visualization and Computer Graphics 9, 3 (July), 352--360.
[40]
ZHAO, L., AND BADLER, N. 1998. Gesticulation Behaviors for Virtual Humans. In Pacific Graphics '98, 161--168.

Cited By

View all
  • (2024)Body Movement Mirroring and Synchrony in Human–Robot InteractionACM Transactions on Human-Robot Interaction10.1145/368207413:4(1-26)Online publication date: 1-Aug-2024
  • (2024)Motion In-Betweening via Deep $\Delta$Δ-InterpolatorIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330910730:8(5693-5704)Online publication date: 1-Aug-2024
  • (2024)A Deep Learning Framework for Start–End Frame Pair-Driven Motion SynthesisIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.321359635:5(7021-7034)Online publication date: May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 23, Issue 3
August 2004
684 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1015706
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004
Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Character animation
  2. Gaussian Processes
  3. Inverse Kinematics
  4. machine learning
  5. motion style
  6. non-linear dimensionality reduction
  7. style interpolation

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)31
  • Downloads (Last 6 weeks)8
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Body Movement Mirroring and Synchrony in Human–Robot InteractionACM Transactions on Human-Robot Interaction10.1145/368207413:4(1-26)Online publication date: 1-Aug-2024
  • (2024)Motion In-Betweening via Deep $\Delta$Δ-InterpolatorIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330910730:8(5693-5704)Online publication date: 1-Aug-2024
  • (2024)A Deep Learning Framework for Start–End Frame Pair-Driven Motion SynthesisIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.321359635:5(7021-7034)Online publication date: May-2024
  • (2024)Enhancing Medical Training Through Learning From Mistakes by Interacting With an Ill-Trained Reinforcement Learning AgentIEEE Transactions on Learning Technologies10.1109/TLT.2024.337250817(1248-1260)Online publication date: 2024
  • (2024)CLOAF: CoLlisiOn-Aware Human Flow2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00118(1176-1185)Online publication date: 16-Jun-2024
  • (2024)Dancing with the sound in edge computing environmentsWireless Networks10.1007/s11276-021-02810-z30:5(3935-3945)Online publication date: 1-Jul-2024
  • (2024)Contrastive disentanglement for self-supervised motion style transferMultimedia Tools and Applications10.1007/s11042-024-18238-483:27(70523-70544)Online publication date: 30-Jan-2024
  • (2023)SparsePoser: Real-time Full-body Motion Reconstruction from Sparse DataACM Transactions on Graphics10.1145/362526443:1(1-14)Online publication date: 31-Oct-2023
  • (2023)MOCHA: Real-Time Motion Characterization via Context MatchingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618252(1-11)Online publication date: 10-Dec-2023
  • (2023)SCAPE: Shape Completion and Animation of PeopleSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596797(819-827)Online publication date: 1-Aug-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media