Cited By
View all- Pan YAgrawal RSingh K(2024)S3: Speech, Script and Scene driven Head and Eye AnimationACM Transactions on Graphics10.1145/365817243:4(1-12)Online publication date: 19-Jul-2024
Generating Emotionally Expressive Look-At Animation
Author: 
Ylva FerstlAuthors Info & Claims
Ylva FerstlAuthors Info & ClaimsArticle No.: 15, Pages 1 - 6
Abstract
Humanoid characters in video games are generally animated using motion capture technology, enabling high-quality, realistic animation. This animation has to remain interactive and allow characters to react to their environment; one important component of this adaptation are look-at animations which direct the character’s torso towards an object or person of interest. Look-at animations are generated procedurally in order to handle any desired target direction, however, this procedural animation can have a robotic quality and negatively affect the overall perceived realism of the character. In this work, we present a neural network controller for generating look-at animations that are equally as appealing as motion capture while requiring minimal memory. Moreover, our controller can generate animations stylized by emotion, allowing characters to react to look-at targets depending on their context, and this style expressiveness is shown to be on par with motion captured samples.
Supplementary Material
short paper video, supplemental graphs
- Download
- 172.07 MB
References
[1]
Sean Andrist, Tomislav Pejsa, Bilge Mutlu, and Michael Gleicher. 2012. Designing effective gaze mechanisms for virtual agents. In Proceedings of the SIGCHI conference on Human factors in computing systems. 705–714.
[2]
Ific Goudé, Alexandre Bruckert, Anne-Hélène Olivier, Julien Pettré, Rémi Cozot, Kadi Bouatouch, Marc Christie, and Ludovic Hoyet. 2023. Real-time Multi-map Saliency-driven Gaze Behavior for Non-conversational Characters. IEEE Transactions on Visualization and Computer Graphics (2023).
[3]
Arthur Gretton, Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, and Alex Smola. 2006. A kernel method for the two-sample-problem. Advances in neural information processing systems 19 (2006).
[4]
Patrik Jonell, Youngwoo Yoon, Pieter Wolfert, Taras Kucherenko, and Gustav Eje Henter. 2021. HEMVIP: Human Evaluation of Multiple Videos in Parallel. In Proceedings of the 2021 International Conference on Multimodal Interaction (Montréal, QC, Canada) (ICMI ’21). Association for Computing Machinery, New York, NY, USA, 707–711. https://doi.org/10.1145/3462244.3479957
[5]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[6]
Alex Klein, Zerrin Yumak, Arjen Beij, and A Frank van der Stappen. 2019. Data-driven gaze animation using recurrent neural networks. In Proceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and Games. 1–11.
[7]
Brent Lance and Stacy Marsella. 2010. The expressive gaze model: Using gaze to express emotion. IEEE computer graphics and applications 30, 4 (2010), 62–73.
[8]
Tomislav Pejsa, Sean Andrist, Michael Gleicher, and Bilge Mutlu. 2015. Gaze and attention management for embodied conversational agents. ACM Transactions on Interactive Intelligent Systems (TiiS) 5, 1 (2015), 1–34.
[9]
Tomislav Pejsa, Bilge Mutlu, and Michael Gleicher. 2013. Stylized and performative gaze for character animation. In Computer Graphics Forum, Vol. 32. Wiley Online Library, 143–152.
[10]
Christopher Peters and Adam Qureshi. 2010. A head movement propensity model for animating gaze shifts and blinks of virtual characters. Computers & Graphics 34, 6 (2010), 677–687.
[11]
Robert Plutchik. 2001. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American scientist 89, 4 (2001), 344–350.
[12]
B Series. 2014. Method for the subjective assessment of intermediate quality level of audio systems. International Telecommunication Union Radiocommunication Assembly (2014).
[13]
Marcus Thiebaux, Brent Lance, and Stacy Marsella. 2009. Real-time expressive gaze animation for virtual humans. In Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1. 321–328.
[14]
Sang Hoon Yeo, Martin Lesmana, Debanga R Neog, and Dinesh K Pai. 2012. Eyecatch: Simulating visuomotor coordination for object interception. ACM Transactions on Graphics (TOG) 31, 4 (2012), 1–10.
Index Terms
- Generating Emotionally Expressive Look-At Animation
Recommendations
Faking dynamics of cloth animation for animated films
AMDO'10: Proceedings of the 6th international conference on Articulated motion and deformable objectsIn this paper we argue for the concept of fake dynamics to allow animators to interactively create visually pleasing animations of cloth models while keeping him/her in full control of the animation process. Existing animation and simulation techniques ...
Faking Dynamics of Cloth Animation for Animated Films
6th International Conference on Articulated Motion and Deformable Objects - Volume 6169In this paper we argue for the concept of fake dynamics to allow animators to interactively create visually pleasing animations of cloth models while keeping him/her in full control of the animation process. Existing animation and simulation techniques ...
Directable animation of elastic bodies with point-constraints
CASA'2008 Special IssueWe propose a simple framework for making elastic body animation with point constraints. In general, a physics-based approach for constraint animation offers a variety of animations with physically correct realism, which are achieved by solving the ...
Comments
Information & Contributors
Information
Published In
November 2023
224 pages
ISBN:9798400703935
DOI:10.1145/3623264
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 November 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
MIG '23
Sponsor:
MIG '23: The 16th ACM SIGGRAPH Conference on Motion, Interaction and Games
November 15 - 17, 2023
Rennes, France
Acceptance Rates
Overall Acceptance Rate -9 of -9 submissions, 100%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 169Total Downloads
- Downloads (Last 12 months)66
- Downloads (Last 6 weeks)5
Reflects downloads up to 28 Feb 2025
Other Metrics
Citations
Cited By
View all- Pan YAgrawal RSingh K(2024)S3: Speech, Script and Scene driven Head and Eye AnimationACM Transactions on Graphics10.1145/365817243:4(1-12)Online publication date: 19-Jul-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format