research-article

Acting the part: the role of gesture on avatar identity

Authors:

Stacy Marsella,

Chung-Cheng Chiu,

Ari ShapiroAuthors Info & Claims

MIG '14: Proceedings of the 7th International Conference on Motion in Games

Pages 49 - 54

https://doi.org/10.1145/2668064.2668102

Published: 06 November 2014 Publication History

Abstract

Recent advances in scanning technology have enabled the widespread capture of 3D character models based on human subjects. However, in order to generate a recognizable 3D avatar, the movement and behavior of the human subject should be captured and replicated as well. We present a method of generating a 3D model from a scan, as well as a method to incorporate a subjects style of gesturing into a 3D character. We present a study which shows that 3D characters that used the gestural style as their original human subjects were more recognizable as the original subject than those that don't.

Supplementary Material

MP4 File (p49-feng.mp4)

Download
14.92 MB

References

[1]

Andersen, S. M., Glassman, N. S., Chen, S., and Cole, S. W. 1995. Transference in social perception: The role of chronic accessibility in significant-other representations. Journal of Personality and Social Psychology 69, 41--57.

[2]

Bailenson, J., Iyengar, S., and Yee, N. 2005. Facial identity capture and presidential candidate preference. Proceedings of the 55th Annual International Communication Association.

[3]

Bailenson, J. N. 2012. Doppelgangers-a new form of self? PSYCHOLOGIST 25, 1, 36--38.

[4]

Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26, 3 (July).

Digital Library

[5]

Bharaj, G., Thormählen, T., Seidel, H.-P., and Theobalt, C. 2011. Automatically rigging multi-component characters. Comp. Graph. Forum (Proc. Eurographics 2012) 30, 2.

Digital Library

[6]

Casas, D., Volino, M., Collomosse, J., and Hilton, A. 2014. 4D Video Textures for Interactive Character Appearance. Computer Graphics Forum (Proc. EUROGRAPHICS 2014) 33, 2, 371--380.

[7]

Chen, S., and Andersen, S. M. 1999. Relationships from the past in the present: Significant-other representations and transference in interpersonal life. Advances in experimental social psychology 31, 123--190.

[8]

Chiu, C.-C., and Marsella, S. 2014. Gesture generation with low-dimensional embeddings. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, International Foundation for Autonomous Agents and Multiagent Systems, 781--788.

Digital Library

[9]

Cui, Y., Chang, W., Nöll, T., and Stricker, D. 2013. Kinectavatar: fully automatic body capture using a single kinect. In Computer Vision-ACCV 2012 Workshops, Springer, 133--147.

Digital Library

[10]

Cutting, J. E., and Kozlowski, L. T. 1977. Recognizing friends by their walk: Gait perception without familiarity cues. Bulletin of the psychonomic society 9, 5, 353--356.

[11]

Feng, A., Huang, Y., Xu, Y., and Shapiro, A. 2014. Fast, automatic character animation pipelines. Computer Animation and Virtual Worlds 25, 1, 3--16.

Digital Library

[12]

Fox, J., and Bailenson, J. N. 2009. Virtual self-modeling: The effects of vicarious reinforcement and identification on exercise behaviors. Media Psychology 12, 1, 1--25.

[13]

Fox, J., and Bailenson, J. 2010. The use of doppelgängers to promote health behavior change. CyberTherapy & Rehabil 3, 2, 16--17.

[14]

Gleicher, M. 1998. Retargetting motion to new characters. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques, ACM, 33--42.

Digital Library

[15]

Hernandez, M., Choi, J., and Medioni, G. 2012. Laser scan quality 3-d face modeling using a low-cost depth camera. In Signal Processing Conference (EUSIPCO), 2012 Proceedings of the 20th European, 1995--1999.

[16]

iPiSoft. Motion Capture for the Masses, year = 2014, url = http://ipisoft.com/, urldate = 2014-09-15.

[17]

Kraus, M. W., and Chen, S. 2010. Facial-feature resemblance elicits the transference effect. Psychological Science 21, 4, 518--522.

[18]

Lee, S., Carlson, G., Jones, S., Johnson, A., Leigh, J., and Renambot, L. 2010. Designing an expressive avatar of a real person. In Intelligent Virtual Agents, Springer, 64--76.

Digital Library

[19]

Levine, S., Theobalt, C., and Koltun, V. 2009. Real-time prosody-driven synthesis of body language. ACM Trans. Graph. 28, 5 (Dec.), 172:1--172:10.

Digital Library

[20]

Levine, S., Krähenbühl, P., Thrun, S., and Koltun, V. 2010. Gesture controllers. In ACM SIGGRAPH 2010 papers, ACM, New York, NY, USA, SIGGRAPH '10, 124:1--124:11.

Digital Library

[21]

Li, H., Vouga, E., Gudym, A., Luo, L., Barron, J. T., and Gusev, G. 2013. 3d self-portraits. ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2013) 32, 6 (November).

Digital Library

[22]

Loula, F., Prasad, S., Harber, K., and Shiffrar, M. 2005. Recognizing people from their movement. Journal of Experimental Psychology: Human Perception and Performance 31, 1, 210.

[23]

Luo, P., Ng-Thow-Hing, V., and Neff, M. 2013. An examination of whether people prefer agents whose gestures mimic their own. In Intelligent Virtual Agents, Springer, 229--238.

[24]

Marsella, S., Xu, Y., Lhommet, M., Feng, A., Scherer, S., and Shapiro, A. 2013. Virtual character performance from speech. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation, ACM, New York, NY, USA, SCA '13, 25--35.

Digital Library

[25]

2013. Mixamo auto-rigger. http://www.mixamo.com/c/auto-rigger.

[26]

Neff, M., Kipp, M., Albrecht, I., and Seidel, H.-P. 2008. Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Transactions on Graphics 27, 1, 5.

Digital Library

[27]

Shapiro, A., Feng, A., Wang, R., Li, H., Bolas, M., Medioni, G., and Suma, E. 2014. Rapid avatar capture and simulation using commodity depth sensors. Computer Animation and Virtual Worlds 25, 3-4, 201--211.

Digital Library

[28]

Starck, J., and Hilton, A. 2007. Surface capture for performance-based animation. Computer Graphics and Applications, IEEE 27, 3, 21--31.

Digital Library

[29]

Stone, M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A., and Bregler, C. 2004. Speaking with hands: creating animated conversational characters from recordings of human performance. ACM Trans. Graph. 23, 3 (Aug.), 506--513.

Digital Library

[30]

Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. In ACM Transactions on Graphics (TOG), vol. 26, ACM, 80.

Digital Library

[31]

Tong, J., Zhou, J., Liu, L., Pan, Z., and Yan, H. 2012. Scanning 3d full human bodies using kinects. Visualization and Computer Graphics, IEEE Transactions on 18, 4, 643--650.

Digital Library

[32]

Wang, R., Choi, J., and Medioni, G. 2012. Accurate full body scanning from a single fixed 3d camera. In 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2012 Second International Conference on, IEEE, 432--439.

Digital Library

[33]

Wilcoxon, F. 1945. Individual comparisons by ranking methods. Biometrics bulletin, 80--83.

[34]

Zeng, M., Zheng, J., Cheng, X., and Liu, X. 2013. Templateless quasi-rigid shape modeling with implicit loop-closure. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, IEEE, 145--152.

Digital Library

Cited By

Borovikov EZavorin IYershov S(2019)On Vision-Based Human-Centric Virtual Character DesignHuman Performance Technology10.4018/978-1-5225-8356-1.ch094(1897-1923)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-8356-1.ch094
Thomas JAzmandian MGrunwald SLe DKrum DKang SRosenberg EBillinghurst MSmith RLindeman RBruder GIwai D(2017)Effects of personalized avatar texture fidelity on identity recognition in virtual realityProceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments10.5555/3298830.3298849(97-100)Online publication date: 22-Nov-2017
https://dl.acm.org/doi/10.5555/3298830.3298849
Narang SBest AShapiro AManocha DWu WYang JTian QZimmermann R(2017)Generating Virtual Avatars with Personalized Walking Gaits using Commodity HardwareProceedings of the on Thematic Workshops of ACM Multimedia 201710.1145/3126686.3126766(219-227)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3126686.3126766
Show More Cited By

Index Terms

Acting the part: the role of gesture on avatar identity

Recommendations

A Layered Authoring Tool for Stylized 3D animations
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Guided by the 12 principles of animation, stylization is a core 2D animation feature but has been utilized mainly by experienced animators. Although there are tools for stylizing 2D animations, creating stylized 3D animations remains a challenging ...
Just-in-time, viable, 3d avatars from scans
SIGGRAPH '17: ACM SIGGRAPH 2017 Talks

We demonstrate a system that can generate a photorealistic, interactive 3D character from a human subject that is capable of movement, emotion, speech and gesture in less than 20 minutes without the need for 3D artist intervention or specialized ...
Coco animsim: increasing quality and efficiency
SIGGRAPH '18: ACM SIGGRAPH 2018 Talks

Coco's clothing design and story presented challenges for the Simulation and Animation departments, requiring a new approach to create appealing clothed silhouettes and believable motion on characters. Many of the characters are skeletons, whose ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MIG '14: Proceedings of the 7th International Conference on Motion in Games

November 2014

184 pages

ISBN:9781450326230

DOI:10.1145/2668064

Conference Chair:
Ari Shapiro
USC Institute for Creative Technologies
,
Program Chairs:
Nancy M. Amato
Texas A&M University
,
Jessica Hodgins
Carnegie Mellon University and Disney Research

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MIG '14

Sponsor:

SIGGRAPH

MIG '14: Motion in Games

November 6 - 8, 2014

California, Playa Vista

Acceptance Rates

Overall Acceptance Rate -9 of -9 submissions, 100%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)2

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Borovikov EZavorin IYershov S(2019)On Vision-Based Human-Centric Virtual Character DesignHuman Performance Technology10.4018/978-1-5225-8356-1.ch094(1897-1923)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-8356-1.ch094
Thomas JAzmandian MGrunwald SLe DKrum DKang SRosenberg EBillinghurst MSmith RLindeman RBruder GIwai D(2017)Effects of personalized avatar texture fidelity on identity recognition in virtual realityProceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments10.5555/3298830.3298849(97-100)Online publication date: 22-Nov-2017
https://dl.acm.org/doi/10.5555/3298830.3298849
Narang SBest AShapiro AManocha DWu WYang JTian QZimmermann R(2017)Generating Virtual Avatars with Personalized Walking Gaits using Commodity HardwareProceedings of the on Thematic Workshops of ACM Multimedia 201710.1145/3126686.3126766(219-227)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3126686.3126766
Michael NDrakou MLanitis A(2017)Model-based generation of personalized full-body 3D avatars from uncalibrated multi-view photographsMultimedia Tools and Applications10.1007/s11042-016-3808-176:12(14169-14195)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11042-016-3808-1
Narang SBest AFeng AKang SManocha DShapiro A(2017)Motion recognition of self and others on realistic 3D avatarsComputer Animation and Virtual Worlds10.1002/cav.176228:3-4Online publication date: 21-May-2017
https://doi.org/10.1002/cav.1762
Borovikov EZavorin IYershov S(2016)On Vision-Based Human-Centric Virtual Character DesignIntegrating Cognitive Architectures into Virtual Character Design10.4018/978-1-5225-0454-2.ch001(1-34)Online publication date: 2016
https://doi.org/10.4018/978-1-5225-0454-2.ch001
Lucas GSzablowski EGratch JFeng AHuang TBoberg JShapiro ANeff MGeraerts RShum H(2016)The effect of operating a virtual doppleganger in a 3D simulationProceedings of the 9th International Conference on Motion in Games10.1145/2994258.2994263(167-174)Online publication date: 10-Oct-2016
https://dl.acm.org/doi/10.1145/2994258.2994263

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten