Christian Theobalt
ABSTRACT
For realistic animation of an artificial character a body model that represents the character's kinematic structure is required. Hierarchical skeleton models are widely used which represent bodies as chains of bones with interconnecting joints. In video motion capture, animation parameters are derived from the performance of a subject in the real world. For this acquisition procedure too, a kinematic body model is required. Typically, the generation of such a model for tracking and animation is, at best, a semi-automatic process. We present a novel approach that estimates a hierarchical skeleton model of an arbitrary moving subject from sequences of voxel data that were reconstructed from multi-view video footage. Our method does not require a-priori information about the body structure. We demonstrate its performance using synthetic and real data.
- F. Banégas, M. Jaeger, D. Michelucci, and M. Roelens. The ellipsoidal skeleton in medical applications. In Proc. of the sixth ACM symposium on Solid modeling and applications, pages 30--38. ACM Press, 2001.]] Google Scholar
Digital Library
- A. Bottino and A. Laurentini. A silhouette-based technique for the reconstruction of human movement. CVIU, 83:79--95, 2001.]] Google ScholarDigital Library
- C. Bregler and J. Malik. Tracking people with twists and exponential maps. In Proc. of CVPR 98, pages 8--15, 1998.]] Google ScholarDigital Library
- R. Byrd, P. Lu, J. Nocedal, and C. Zhu. A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comp., 16(5):1190--1208, 1995.]] Google ScholarDigital Library
- J. Carranza, C. Theobalt, M. Magnor, and H.-P. Seidel. Free-viewpoint video of human actors. In Proc. of SIGGRAPH'03, pages 569--577, 2003.]] Google ScholarDigital Library
- G. Cheung, B. S., and T. Kanada. Shape-from-silhouette of articulated objects and its use for human body kinematics estiamtion and motion capture. In Proc. of CVPR, 2003.]]Google Scholar
- K. Cheung, T. Kanade, J.-Y. Bouguet, and M. Holler. A real time system for robust 3D voxel reconstruction of human motions. In Proc. of CVPR, volume 2, pages 714--720, 2000.]]Google ScholarCross Ref
- L. Chevalier, F. Jaillet, and B. A. Segmentation and superquadric modeling of 3D objects. In Proc. of WSCG 2003, 2003.]]Google Scholar
- E. de Aguiar, C. Theobalt, M. Magnor, H. Theisel, and H.-P. Seidel. M3: Marker-free model reconstruction and motion tracking from 3d voxel data. In Proc. of Pacific Graphics'04. to appear, 2004.]] Google ScholarDigital Library
- Q. Delamarre and O. Faugeras. 3D articulated models and multi-view tracking with silhouettes. In Proc. of ICCV 99, pages 716--721, 1999.]] Google ScholarDigital Library
- B. Deutscher, A. Blake, and I. Reid. Articulated body motion capture by annealed particle filtering. In Proc. of CVPR'00, 2000.]]Google ScholarCross Ref
- D. Gavrila. The visual analysis of human movement. CVIU, 73(1):82--98, January 1999.]] Google ScholarDigital Library
- D. Gavrila and L. Davis. 3D model-based tracking of humans in action: A multi-view approach. In Proc. of CVPR 96, pages 73--80, 1996.]] Google ScholarDigital Library
- I. Kakadiaris and D. Metaxas. 3D human body model acquisition from multiple views. In Proc. of ICCV'95, pages 618--623, 1995.]] Google ScholarDigital Library
- S. Katz and A. Tal. Hierarchical mesh decomposition using fuzzy clustering and cuts. In Proc. of SIGGRAPH'03, pages 954--961, 2003.]] Google ScholarDigital Library
- K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. Int. J. Comput. Vision, 38(3):199--218, 2000.]] Google ScholarDigital Library
- A. Leonardis, A. Jaklic, and F. Solina. Superquadrics for segmenting and modeling range data. IEEE PAMI, 19(11):1289--1295, 1997.]] Google ScholarDigital Library
- M. Leung and Y. Yang. First sight: A human body outline labeling system. PAMI, 17(4):359--379, 1995.]] Google ScholarDigital Library
- S. Loncaric. A survey of shape analysis techniques. Pattern Recognition, 31(8):983--1001, 1998.]]Google ScholarCross Ref
- J. Luck and D. Small. Real-time markerless motion tracking using linked kinematic chains. In Proc. of CVPRIP02, 2002.]]Google Scholar
- A. Menache. Understanding Motion Capture for Computer Animation and Video Games. Morgan Kaufmann, 1995.]] Google ScholarDigital Library
- I. Mikić, M. Triverdi, E. Hunter, and P. Cosman. Articulated body posture estimation from multicamera voxel data. In Proc. of CVPR, 2001.]]Google Scholar
- R. Plaenkers and P. Fua. Tracking and modeling people in video sequences. CVIU, 81(3):285--302, March 2001.]] Google ScholarDigital Library
- W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery. Numerical recipes in C++. Cambridge University Press, 2002.]] Google ScholarDigital Library
- K. Rohr. Incremental recognition of pedestrians from image sequences. In Proc. of CVPR, pages 8--13, 1993.]]Google ScholarCross Ref
- M.-C. Silaghi, R. Plaenkers, R. Boulic, P. Fua, and D. Thalmann. Local and global skeleton fitting techniques for optical motion capture. In Modeling and Motion Capture Techniques for Virtual Environments, number 1537 in LNAI, No1537, pages 26--40. Springer, 1998.]] Google ScholarDigital Library
- M. Sniedovich. Dynamic programming. Marcel Dekker, Inc., 1992.]] Google ScholarDigital Library
- C. Theobalt, M. Li, M. Magnor, and H.-P. Seidel. A flexible and versatile studio for synchronized multi-view video recording. In Proc. of Vision, Video and Graphics, pages 9--16, 2003.]]Google Scholar
- C. Theobalt, M. Magnor, P. Schueler, and H.-P. Seidel. Combining 2D feature tracking and volume reconstruction for online video-based human motion capture. In Proc. of Pacific Graphics 2002, pages 96--103, 2002.]] Google ScholarDigital Library
- C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland. Pfinder: Real-time tracking of the human body. PAMI, 19(7):780--785, 1997.]] Google ScholarDigital Library
- S. Yonemoto, D. Arita, and R. Taniguchi. Real-time human motion analysis and IK-based human figure control. In Proc. of IEEE Workshop on Human Motion, pages 149--154, 2000.]] Google ScholarDigital Library
Index Terms
- Marker-free kinematic skeleton estimation from sequences of volume data
Recommendations
Real time automatic skeleton and motion estimation for character animation
International Workshop Motion in Games (MIG08)Motion capture is prevalent in the pipeline of realistic articulated character animation. To define accurate joint positions and joint orientations for the movement of a hierarchical human-like character without using a pre-defined skeleton remains a ...
Sketch-based skeleton-driven 2D animation and motion capture
Transactions on edutainment VIWe present a novel sketch-based 2D animation technique, which allows the user to produce 2D character animations efficiently. It consists of two parts, sketch-based skeleton-driven 2D animation production and 2D motion capture. The user inputs one image ...
Research on Skeleton Animation Motion Data Based on Kinect
ISCID '12: Proceedings of the 2012 Fifth International Symposium on Computational Intelligence and Design - Volume 02Skeleton animation motion data is the connection of motion capture and computer skeleton animation technologies. This paper presents a method which creates standard motion data file in real time. First, get original coordinate data of human skeleton ...
Comments