Joan Llobera
ABSTRACT
The application of deep learning for physics-based character animation and for cinematic controllers for interactive animation is changing how we should think about interactive character animation in video games and virtual reality. We will review the benefits and drawbacks of the techniques used and the implementations available to get started.
Supplemental Material
Available for Download
- Okan Arikan and David A Forsyth. 2002. Interactive motion generation from examples. ACM Transactions on Graphics (TOG) 21, 3 (2002), 483--490.Google Scholar
Digital Library
- Kevin Bergamin, Simon Clavet, Daniel Holden, and James Richard Forbes. 2019. DReCon: data-driven responsive control of physics-based characters. ACM Transactions On Graphics (TOG) 38, 6 (2019), 1--11.Google ScholarDigital Library
- Ronan Boulic and Richard Kulpa. 2007. Inverse Kinematics and Kinetics for Virtual Humanoids.. In Eurographics (Tutorials). 173--243.Google Scholar
- Simon Clavet. 2015. Motion Matching - The Road to NextGen Animation. Proc of GDC (2015). https://doi.org/watch?v=z_wpgHFSWss&t=658sGoogle Scholar
- Nicolas Heess, Dhruva TB, Srinivasan Sriram, Jay Lemmon, Josh Merel, Greg Wayne, Yuval Tassa, Tom Erez, Ziyu Wang, SM Eslami, et al. 2017. Emergence of locomotion behaviours in rich environments. arXiv preprint arXiv:1707.02286 (2017).Google Scholar
- Daniel Holden, Oussama Kanoun, Maksym Perepichka, and Tiberiu Popa. 2020. Learned motion matching. ACM Transactions on Graphics (TOG) 39, 4 (2020), 53--1.Google ScholarDigital Library
- Daniel Holden, Taku Komura, and Jun Saito. 2017. Phase-functioned neural networks for character control. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1--13.Google ScholarDigital Library
- John T Kent. 1982. The Fisher-Bingham distribution on the sphere. Journal of the Royal Statistical Society: Series B (Methodological) 44, 1 (1982), 71--80.Google ScholarCross Ref
- Jehee Lee, Jinxiang Chai, Paul SA Reitsma, Jessica K Hodgins, and Nancy S Pollard. 2002. Interactive control of avatars animated with human motion data. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques. 491--500.Google ScholarDigital Library
- F Landis Markley, Yang Cheng, John L Crassidis, and Yaakov Oshman. 2007. Averaging quaternions. Journal of Guidance, Control, and Dynamics 30, 4 (2007), 1193--1197.Google ScholarCross Ref
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing Atari with Deep Reinforcement Learning. Neural Information Processing (2013). arXiv:1312.5602 [cs.LG]Google Scholar
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski,, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg, and Demis Hassabis. 2015. Human-level control through deep reinforcement learning. nature 518, 7540 (2015), 529--533. Google Scholar
- Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel van de Panne. 2018. Deepmimic: Example-guided deep reinforcement learning of physics-based character skills. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--14.Google ScholarDigital Library
- Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel, and Sergey Levine. 2018. Sfv: Reinforcement learning of physical skills from videos. ACM Transactions On Graphics (TOG) 37, 6 (2018), 1--14.Google ScholarDigital Library
- Alexander Shoulson, Nathan Marshak, Mubbasir Kapadia, and Norman I Badler. 2013. Adapt: the agent developmentand prototyping testbed. IEEE Transactions on Visualization and Computer Graphics 20, 7 (2013), 1035--1047.Google ScholarDigital Library
- Sebastian Starke, Norman Hendrich, and Jianwei Zhang. 2018. Memetic evolution for generic full-body inverse kinematics in robotics and animation. IEEE Transactions on Evolutionary Computation 23, 3 (2018), 406--420.Google ScholarCross Ref
- Sebastian Starke, Yiwei Zhao, Taku Komura, and Kazi Zaman. 2020. Local motion phases for learning multi-contact character movements. ACM Transactions on Graphics (TOG) 39, 4 (2020), 54--1.Google ScholarDigital Library
- Tingwu Wang, Yunrong Guo, Maria Shugrina, and Sanja Fidler. 2020. UniCon: Universal Neural Controller For Physics-based Character Motion. arXiv:2011.15119 [cs.GR]Google Scholar
Index Terms
- New techniques in interactive character animation
Recommendations
Learning an inverse rig mapping for character animation
SCA '15: Proceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer AnimationWe propose a general, real-time solution to the inversion of the rig function - the function which maps animation data from a character's rig to its skeleton. Animators design character movements in the space of an animation rig, and a lack of a general ...
Rigging the Rigging: An Animation Friendly Rope System for The Sea Beast
DigiPro '22: The Digital Production SymposiumThis talk presents an animation friendly, procedural solution for animating ropes in the movie The Sea Beast. With over 5000 ropes on our hero tall ship, we embarked on development of a better rope solution for our animators. The resulting rope rig ...
A comparison of linear skinning techniques for character animation
AFRIGRAPH '07: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in AfricaCharacter animation is the task of moving a complex, artificial character in a life-like manner. A widely used method for character animation involves embedding a simple skeleton within a character model and then animating the character by moving the ...
Comments