Abstract
In this paper, we present a new approach to reconstruct 3D human motion from video clips with the assistance of a precaputred motion library. Given a monocular video clip recording of one person performing some kind of locomotion and a motion library consisting of similar motions, we can infer the 3D motion from the video clip. We segment the video clip into segments with fixed length, and by using a shape matching method we can find out from the motion library several candidate motion sequences for every video segment, then from these sequences a coarse motion clip is generated by performing a continuity test on the boundaries of these candidate sequences. We propose a pose deformation algorithm to refine the coarse motion. To guarantee the naturalness of the recovered motion, we apply a motion splicing algorithm to the motion clip. We tested the approach using synthetic and real sports videos. The experimental results show the effectiveness of this approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Goldberg, A., Kennedy, R.: An Efficient Cost Scaling Algorithm for the Assignment Problem. Math. Prog. 71, 153–178 (1995)
Indyk, P., Motwani, R.: Approximate Nearest Neighbor - Towards Removing the Curse of Dimensionality. In: Proceedings of the 30th Symposium on Theory of Computing, pp. 604–613 (1998)
Wachter, S., Nagel, H.: Tracking Persons in Monocular Image Sequences. Computer Vision and Image Understanding 74(3), 174–192 (1999)
Sidenbladh, H., Black, M., Fleet, D.: Stochastic Tracking of 3D Human Figures Using 2D ImageMotion. In: European Conference on Computer Vision (2000)
Taylor, C.J.: econstruction of Articulated Objects from Point Correspondences in a Single Uncalibrated Image. In: IEEE International Conference on Computer Vision and Pattern Recognition, pp. 677–684 (2000)
Taylor, C.J.: Reconstruction of articulated objects from point correspondences in a single image. Computer Vision and Image Understanding 80(3), 349–363 (2000)
Lee, J., Shin, S.Y.: A Coordinate-invariant Approach to Multiresolution Motion Analysis. Graphics Model 63(2), 87–105 (2001)
Sidenbladh, H., Black, M.: Learning Image Statistics for Bayesian Tracking. In: IEEE International Conference on Computer Vision (2001)
Sminchisescu, C., Triggs, B.: Covariance scaled sampling for monocular 3d body tracking. In: Proc. Conf. Computer Vision and Pattern Recognition (2001)
Belogie, S., Malik, J., Puzicha, J.: Shape Matching and Object Recognition Using Shape Context. IEEE Transactions On Pattern Analysis and Machine Intelligence 24(24) (2002)
Sidenbladh, H., Black, M., Sigal, L.: Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 784–800. Springer, Heidelberg (2002)
Indyk, P., Thaper, N.: Fast Image Retrieval via Embeddings. In: 3rd International Workshop on Statistical and Computational Theories of Vision (2003)
Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3d human tracking. In: Proc. Conf. Computer Vision and Pattern Recognition (2003)
Grauman, K., Darrell, T.: Fast Contour Matching Using Approximate Earth Mover’s Distance. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2004)
Chen, Y., Lee, J., Parent, R., Machiraju, R.: Markerless Monocular Motion Capture Using Image Features and Physical Constraints. In: Computer Graphics International 2005, Stony Brook, USA ( June 2005)
Agarwal, A., Triggs, B.: Recovering 3D Human Pose from Monocular Images. IEEE Trans. On Pattern Analysis and Machine Intelligence(PAMI) 28(1), 44–58 (2006)
Chiu, C.Y., Wu, C.C., Wu, Y.C., Wu, M.Y., Chao, S.P., Yang, S.N.: Retrieval and Constraint-Based Human Posture Reconstruction from a Single Image. Journal of Visual Communication and Image Representation 17(4), 892–915 (2006)
Wang, R., Qiu, X., Wang, Z., Xia, S.: A Video-Driven Approach to Continuous Human Motion Synthesis. In: Nishita, T., Peng, Q., Seidel, H.-P. (eds.) CGI 2006. LNCS, vol. 4035, pp. 614–621. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, W., Qiu, X., Wang, Z., Wang, R., Li, J. (2008). Reconstruct 3D Human Motion from Monocular Video Using Motion Library. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-77409-9_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77407-5
Online ISBN: 978-3-540-77409-9
eBook Packages: Computer ScienceComputer Science (R0)