Abstract
In order to achieve precise, accurate and reliable tracking of human movement, a 3D human model that is very similar to the subject is essential. In this paper, we present a new system to (1) precisely construct the surface shape of the whole human body, and (2) estimate the underlying skeleton. In this work we make use of a set of images of the subject in collaboration with a generic anthropometrical 3D model made up of regular surfaces and skeletons to adapt to the specific subject. We developed a three-stage technique that uses the human shape feature points and limb outlines that work together with the generic 3D model to yield our final customized 3D model. The first stage is an iterative camera pose calibration and 3D characteristic point reconstruction-deformation algorithm that gives us an initial customized 3D model. The second stage refines the initial customized 3D model by deformation via the silhouette limbs information, thus obtaining the surface skin model. In the final stage, we make use of the results of skin deformation to estimate the underlying skeleton. From our final results, we demonstrate that our system is able to construct quality human model, where the skeleton is constructed and positioned automatically.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Canny, J.: A Computational Approach to edge detection. IEEE Trans. PAMI 8(6), 679–698 (1986)
Carranza, J., Theobalt, C., Magnor, M.A., Seidel, H.: Free-Viewpoint Video of Human Actors. In: Proceedings of the SIGGRAPH 2003 Conference, pp. 569–577 (2003)
Dementhon, D.F., Davis, L.S.: Model-based object pose in 25 lines of code. International Journal of Computer Vision 15, 123–141 (1995)
Fang, S., Raghavan, R., Richtsmeier, J.: Volume morphing methods for landmark based 3D image deformation. SPIE Int. Symp. on Medical Imaging (1996)
Garvrila, D.M., Davis, L.S.: 3-D model-based tracking of humans in action: a multi-view approach. In: CVPR, San Franscisco, USA, pp. 73–80 (1996)
Gérard, P., Gagalowicz, A.: Human Body Tracking using a 3D Generic Model applied to Golf Swing Analysis. In: MIRAGE 2003 Conf., INRIA Rocquencourt, France (March 2003)
Goncalves, L., Di Bernardom, E., Ursella, E., Perona, P.: Monocular tracking of the human arm in 3D. In: Proc. of ICCV 1995, Boston, USA, pp. 764–770 (1995)
Hilton, A., Beresford, D., Gentils, T., Smith, R., Sun, W., Illingworth, J.: Whole-body modelling of people from multi-view images to populate virtual worlds. The Visual Computer 16(7), 411–436 (2000)
Kakadiaris, I.A., Metaxas, D.: Three-dimensional human body model acquisition from multiple views. International Journal of Computer Vision 30, 191–218 (1998)
Kass, M., Watkin, A., Terzopoulos, D.: Snake: Active contour models. International Journal of Computger Vision 1, 321–331 (1988)
Kettner, L., Welzl, E.: Contour edge analysis for polyhedral analysis. In: Geometric Modeling: Theory and Practice, pp. 379–394. Springer, Heidelberg (1997)
Laurentini, A.: How far 3D shapes can be understood from 2D silhouettes. IEEE Trans. PAMI 17, 188–195 (1995)
Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81, 231–268 (2001)
O’Brien, J.F., Bodenheimer Jr., R.E., Brostow, G.J., Hodgins, J.K.: Joint parameter estimation from magnetic motion capture data. In: Proceedings of Graphics Interface 2000, Montreal, Canada, pp. 53–60 (May 2000)
Panjabi, M.M., Goel, V.K., Walter, S.D.: Errors in the centre and angle of rotation of a joint: An experimental study. Journal of Biomechanics 15(7), 537–544 (1982)
Remondino, F.: 3-D reconstruction of static human body shape from an image sequence. Computer Vision and Image Understanding 93, 65–85 (2004)
Roussel, R., Gagalowicz, A.: Morphological adaptation of a 3D model of face from images. In: MIRAGE 2003 Conf., INRIA Rocquencort, France (March 2003)
Ruprecht, D., Muller, H.: Free form deformation with scattering data interpolation methods. In: Farin, G., Hagen, H., Noltemeier, H. (eds.) Geometric Modeling (Computing Suppl. 8), pp. 267–281. Springer, Heidelberg (1993)
Sidenbladh, H., Black, M.J., Sigal, L.: Implicit probabilistic models of human motion for synthesis and tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 784–800. Springer, Heidelberg (2002)
Silaghi, M.-C., Plankers, R., Boulic, R., Fua, P., Thalmann, D.: Local and global skeleton fitting techniques for optical motion capture. In: Thalmann, N., Thalmann, D. (eds.) Modeling and Motion Capture Techniques for Virtual Environments. Lecture notes in artificial intelligence, pp. 26–40 (1998)
Theobalt, C., Aguiar, E., Magnor, M., Theisel, H., Seidel, H.-P.: Marker-free kinematic skeleton estimation from sequence of volume data. In: Proc. ACM Virtual Reality Software and Technology, Hong Kong, November 2004, pp. 57–64 (2004)
Weik, S.: A passive full body scan using shape from silhouette. In: Proc. ICPR 2000, Barcelona, Spain, pp. 99–105 (2000)
Wren, C., Azarbayejani, A., Darrell, T., Pentland, A.: Pfinder: real-time tracking of the human body. IEEE Trans. PAMI 19(7), 780–785 (1997)
Yaniz, C., Rocha, J., Perales, F.: 3D Part Recognition Method for Human Motion Analysis. In: Proceedings of the International Workshop on Modelling and Motion Capture Techniques for Virtual Environments, pp. 41–55 (1998)
Camera calibration toolkit for Matlab, J Bouguet, http://www.vision.caltech.edu/bouguetj/calib_doc
Cyberware, http://www.cyberware.com
Hamamatsu, http://usa.hamamatsu.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Quah, C.K., Gagalowicz, A., Roussel, R., Seah, H.S. (2005). 3D Modeling of Humans with Skeletons from Uncalibrated Wide Baseline Views. In: Gagalowicz, A., Philips, W. (eds) Computer Analysis of Images and Patterns. CAIP 2005. Lecture Notes in Computer Science, vol 3691. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11556121_47
Download citation
DOI: https://doi.org/10.1007/11556121_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28969-2
Online ISBN: 978-3-540-32011-1
eBook Packages: Computer ScienceComputer Science (R0)