poster

A software pipeline for 3D animation generation using mocap data and commercial shape models

Authors:

David S. Biswas,

Guoliang FanAuthors Info & Claims

CIVR '10: Proceedings of the ACM International Conference on Image and Video Retrieval

Pages 350 - 357

https://doi.org/10.1145/1816041.1816092

Published: 05 July 2010 Publication History

Abstract

We propose a software pipeline to generate 3D animations by using the motion capture (mocap) data and human shape models. The proposed pipeline integrates two animation software tools, Maya and MotionBuilder in one flow. Specifically, we address the issue of skeleton incompatibility among the mocap data, shape models, and animation software. Our objective is to generate both realistic and accurate motion-specific animation sequences. Our method is tested by three mocap data sets of various motion types and five commercial human shape models, and it demonstrates better visual realisticness and kinematic accuracy when compared with three other animation generation methods.

References

[1]

CMU Mocap Library. http://mocap.cs.cmu.edu/.

[2]

Ohio State University Motion Capture Lab. http://accad.osu.edu/research/mocap/mocapdata.htm.

[3]

A. Agarwal and B. Triggs. 3D human pose from silhouettes by relevance vector regression. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2004.

Digital Library

[4]

I. Baran and J. Popovic. Automatic rigging and animation of 3D characters. ACM Trans. on Graphics, 26, 2007.

Digital Library

[5]

J. Black, T. Ellis, and P. Rosin. A novel method for video tracking performance evaluation. In Proc. VS-PETS, 2003.

[6]

C. Canton-Ferrer, J. Casas, and M. Pardas. Exploiting structural hierarchy in articulated objects towards robust motion capture. In Conf. on Articulated Motion and Deformable Objects, 2008.

Digital Library

[7]

Y. Chen, R. Parent, R. Machiraju, and J. Davis. Human activity recognition for synthesis. In IEEE Workshop on Learning, Representation, and Context for Human Sensing in Video, 2006.

[8]

Z. Deng, Q. Gu, and Q. Li. Perceptually consistent example-based human motion retrieval. In Proc. of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (SI3D), 2009.

Digital Library

[9]

X. Desurmont, J.-B. Hayet, C. Machy, J.-F. Delaigle, and J.-F. Macq. On the performance evaluation of tracking systems using multiple pan-tilt-zoom cameras. In IS&T/SPIE Symposium on Electronic Imaging, 2007.

[10]

A. Elgammal and C.-S. Lee. Tracking people on torus. IEEE Trans. on Pattern Analysis and Machine Intelligence, 31:520--538, 2009.

Digital Library

[11]

M. Gleicher. Retargetting motion to new characters. In SIGGRAPH, 1998.

Digital Library

[12]

A. Godil and S. Ressler. Retrieval and clustering from a 3d human database based on body and head shape. In Proc. of SAE Digital Human Modeling Conference, 2006.

[13]

F. Guo and G. Qian. Monocular 3D tracking of articulated human motion in silhouette and pose manifolds. EURASIP Journal on Image and Video Processing, 2008:1--18, 2008.

Digital Library

[14]

L. Kovar, M. Gleicher, and F. Pighin. Motion graphs. In SIGGRAPH '08: ACM SIGGRAPH 2008 classes, pages 1--10, New York, NY, USA, 2008. ACM.

Digital Library

[15]

Y. Li, B. Wu, and R. Nevatia. Human detection by searching in 3d space using camera and scene knowledge. In Proc. International Conference on Pattern Recognition, 2008.

[16]

Z. Lin, L. S. Davis, D. Doermann, and D. DeMenthon. Hierarchical part-template matching for human detection and segmentation. In IEEE International Conference on Computer Vision, 2007.

[17]

M. Meredith and S. Maddock. Motion capture file formats explained. Technical Report CS-01-11, University of Sheffield.

[18]

M. Müller, T. Röder, and M. Clausen. Efficient content-based retrieval of motion capture data. ACM Trans. Graph., 24(3):677--685, 2005.

Digital Library

[19]

L. Mundermann, S. Corazza, and T. P. Andriacchi. Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2007.

[20]

O. Onder, U. Gudukbay, B. Ozguc, T. Erdem, C. E. Erdem, and M. Ozkan. Keyframe reduction techniques for motion capture data. In Proceedings of the 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, 2008.

[21]

J. Park, S. Park, and J. Aggarwal. Model-based human motion tracking and behavior recognition using hierarchical finite state automata. In ACM Conference on Image and Video Retrieval, 2003.

[22]

M. Pawar, G. Pradhan, K. Zhang, and B. Prabhakaran. Content based querying and searching for 3D human motions. In Proc. of Internaltional ACM Multimedia Modeling Conference, 2008.

Digital Library

[23]

B. Peng, G. Qian, and S. Rajko. View-invariant full-body gesture recognition from video. In Proc. of International Conference on Pattern Recognition, 2008.

[24]

F. Qureshi and D. Terzopoulos. Towards intelligent camera networks: A virtual vision approach. In Proc. VS-PETS, 2005.

[25]

H. Ragheb, S. Velastin, P. Remagnino, and T. Ellis. Vihasi: Virtual human action silhouette data for the performance evaluation of silhouette-based action recognition methods. In Workshop on Activity Monitoring by Multi-Camera Surveillance Systems, 2008.

Digital Library

[26]

L. Ren, A. Patrick, A. A. Efros, J. K. Hodgins, and J. M. Rehg. A data-driven approach to quantifying natural human motion. ACM Transactions on Graphics (SIGGRAPH 2005), 24(3):1090--1097, Aug. 2005.

Digital Library

[27]

T. Schlogl, C. Beleznai, M. Winter, and H. Bischof. Performance evaluation metrics for motion detection and tracking. In Procs. International Conference on Pattern Recognition, 2004.

Digital Library

[28]

G. Shakhnarovich, P. Viola, and T. Darrell. Fast pose estimation with parameter sensitive hashing. In Proc. of International Conference on Computer Vision, 2003.

Digital Library

[29]

L. Sigal, S. Bhatia, S. Roth, M. Black, and M. Isard. Tracking loose-limbed people. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2004.

[30]

L. Sigal and M. Black. HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion. Technical Report CS-06-08, Brown University, 2006.

[31]

C. Sminchisescu, A. Kanaujia, and D. N. Metaxas. Bm3e: Discriminative density propagation for visual tracking. IEEE Trans. on Pattern Analysis and Machine Intelligence, 29:2030--2044, 2007.

Digital Library

[32]

C. Sminchisescu and B. Triggs. Kinematic jump processes for monocular 3d human tracking. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2003.

Digital Library

[33]

G. R. Taylor, A. J. Chosak, and P. C. Brewer. OVVV: Using virtual worlds to design and evaluate surveillance systems. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 2007.

[34]

R. Urtasun and P. Fua. 3d human body tracking using deterministic temporal motion models. In Proc. of European Conference on Computer Vision, 2004.

[35]

X. K. Wei and J. Chai. Modeling 3d human poses from uncalibrated monocular images. In Proc. IEEE International Conference on Computer Vision, 2009.

[36]

X. Zhang and G. Fan. Dual gait generative models for human motion estimation from a single camera. IEEE Trans. on Systems, Man, and Cybernetics Part B: Cybernetics, 2010 (to appear).

Digital Library

[37]

X. Zhang, G. Fan, and L. Chou. Two-layer gait generative models for estimating unknown human gait kinematics. In Proc. IEEE ICCV Workshop on Machine Learning for Vision-based Motion Analysis, 2009.

Cited By

Kwon BLee S(2020)Ensemble Learning for Skeleton-Based Body Mass Index ClassificationApplied Sciences10.3390/app1021781210:21(7812)Online publication date: 4-Nov-2020
https://doi.org/10.3390/app10217812
Zhang XDing MFan G(2017)Video-Based Human Walking Estimation Using Joint Gait and Pose ManifoldsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.252721827:7(1540-1554)Online publication date: Jul-2017
https://doi.org/10.1109/TCSVT.2016.2527218

Index Terms

A software pipeline for 3D animation generation using mocap data and commercial shape models
1. Computing methodologies
  1. Modeling and simulation
    1. Simulation types and techniques
      1. Simulation by animation
      2. Visual analytics
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
      1. Multimedia databases

Recommendations

Interactive manipulation of large-scale crowd animation

Editing large-scale crowd animation is a daunting task due to the lack of an efficient manipulation method. This paper presents a novel cage-based editing method for large-scale crowd animation. The cage encloses animated characters and supports ...
Synchronized multi-character motion editing

The ability to interactively edit human motion data is essential for character animation. We present a novel motion editing technique that allows the user to manipulate synchronized multiple character motions interactively. Our Laplacian motion editing ...
Mobilizing mocap, motion blending, and mayhem: rig interoperability for crowd simulation on Incredibles 2
SIGGRAPH '18: ACM SIGGRAPH 2018 Talks

The stylized world of Incredibles 2 features large urban crowds both in everyday situations and in scenes of panicked mayhem. While Pixar's now academy award winning animation software, Presto, has allowed us to create expressive and nuanced rigs for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIVR '10: Proceedings of the ACM International Conference on Image and Video Retrieval

July 2010

492 pages

ISBN:9781450301176

DOI:10.1145/1816041

Conference Chairs:
Shipeng Li
Microsoft Research Asia, China
,
Xinbo Gao
Xidian University, China
,
Nicu Sebe
University of Trento, Italy

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

Oklahoma Center for the Advancement of Science and Technology (OCAST), OHRS award
Division of Information and Intelligent Systems

Conference

CIVR' 10

Sponsor:

SIGMM

CIVR' 10: International Conference on Image and Video Retrieval

July 5 - 7, 2010

Xi'an, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
528
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kwon BLee S(2020)Ensemble Learning for Skeleton-Based Body Mass Index ClassificationApplied Sciences10.3390/app1021781210:21(7812)Online publication date: 4-Nov-2020
https://doi.org/10.3390/app10217812
Zhang XDing MFan G(2017)Video-Based Human Walking Estimation Using Joint Gait and Pose ManifoldsIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.252721827:7(1540-1554)Online publication date: Jul-2017
https://doi.org/10.1109/TCSVT.2016.2527218

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten