Abstract
Estimation of human shape from images has numerous applications ranging from graphics to surveillance. A single image provides insufficient constraints (e.g. clothing), making human shape estimation more challenging. We propose a method to simultaneously estimate a person’s clothed and naked shapes from a single image of that person wearing clothing. The key component of our method is a deformable model of clothed human shape. We learn our deformable model, which spans variations in pose, body, and clothes, from a training dataset. These variations are derived by the non-rigid surface deformation, and encoded in various low-dimension parameters. Our deformable model can be used to produce clothed 3D meshes for different people in different poses, which neither appears in the training dataset. Afterward, given an input image, our deformable model is initialized with a few user-specified 2D joints and contours of the person. We optimize the parameters of the deformable model by pose fitting and body fitting in an iterative way. Then the clothed and naked 3D shapes of the person can be obtained simultaneously. We illustrate our method for texture mapping and animation. The experimental results on real images demonstrate the effectiveness of our method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Smith Micro Poser 8.0.3.
References
Allen, B., Curless, B., Popović, Z.: The space of human body shapes: reconstruction and parameterization from range scans. In: SIGGRAPH, pp. 587–594 (2003)
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: Scape: shape completion and animation of people. ACM Trans. Graph. 24(3), 408–416 (2005)
Balan, A.O., Sigal, L., Black, M.J., Davis, J.E., Haussecker, H.W.: Detailed human shape and pose from images. In: Proc. of CVPR, pp. 1–8 (2007)
Baran, I., Popović, J.: Automatic rigging and animation of 3d characters. ACM Transactions on Graphics 26(3) (2007)
Bălan, A.O., Black, M.J.: The naked truth: estimating body shape under clothing. In: Proc. of ECCV, pp. 15–29 (2008)
Chai, M., Wang, L., Weng, Y., Yu, Y., Guo, B., Zhou, K.: Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31(4), 116:1–116:8 (2012)
Chen, T., Tan, P., Ma, L., Cheng, M., Shamir, A., Hu, S.: Poseshop: human image database construction and personalized content synthesis. In: IEEE Trans Vis Comput Graph (2012)
Chen, X., Li, Q., Song, Y., Jin, X., Zhao, Q.: Supervised geodesic propagation for semantic label transfer. In: Proc. of ECCV, pp. 554–566 (2012)
Chen, Y., Kim, T.K., Cipolla, R.: Inferring 3d shapes and deformations from single views. In: Proc. of ECCV, pp. 300–313 (2010)
Ghahramani, Z., Hinton, G.E.: The em algorithm for mixtures of factor analyzers. Technical Report CRG-TR-96-1 (1997)
Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. In: SIGGRAPH, pp. 522–531 (2004)
Guan, P., Weiss, A., Bălan, A.O., Black, M.J.: Estimating human shape and pose from a single image. In: Proc. of ICCV (2009)
Guo, Y., Chen, X., Zhou, B., Zhao, Q.: Clothed and naked human shapes estimation from a single image. In: Computational Visual Media, pp. 1–8 (2012)
Hasler, N., Ackermann, H., Rosenhahn, B., Thormählen, T., Seidel, H.P.: Multilinear pose and body shape estimation of dressed subjects from image sets. In: Proc. of CVPR, pp. 1823–1830 (2010)
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.P.: A statistical model of human pose and body shape. In: CGF (Proc. EG2008), vol. 2 (2009)
Huang, T., Tian, Y., Li, J., Yu, H.: Salient region detection and segmentation for general object recognition and image understanding. In: Science China Information Sciences, pp. 2461–2470 (2011)
Kraevoy, V., Sheffer, A., van de Panne, M.: Modeling from contour drawings. In: Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling, SBIM, pp. 37–44 (2009)
Lourakis, M.: levmar: Levenberg–Marquardt algorithms in C/C++ (2009). http://www.ics.forth.gr/~lourakis/levmar
Ma, Y., Košecká, J., Soatto, S., Sastry, S.: An Invitation to 3d Vision. Springer, Berlin
Rose, C.F., Sloan, P.P., Cohen, J., Cohen, M.F.: Artist-directed inverse-kinematics using radial basis function interpolation. Comput. Graph. Forum 20(3), 239–250 (2001)
Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Sigal, L., Balan, A.O., Black, M.J.: Combined discriminative and generative articulated pose and non-rigid shape estimation. In: Proc. of NIPS (2007)
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. 23(3), 399–405 (2004)
Teramoto, O., Park, I.K., Igarashi, T.: Interactive motion photography from a single image. Vis. Comput. 26(11), 1339–1348 (2010)
Wei, X., Chai, J.: Intuitive interactive human-character posing with millions of example poses. IEEE Comput. Graph. Appl. 31(4), 78–88 (2011)
Xu, K., Ma, L.Q., Ren, B., Wang, R., Hu, S.M.: Interactive hair rendering and appearance editing under environment lighting. In: ACM Transactions on Graphics, pp. 173 (2011)
Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 126 (2010)
Acknowledgements
We would like to acknowledge the indispensable help of Dragomir Anguelov and Nils Hasler who provided us with the scan data. This work was partially supported by NSFC (60933006), 863 Program (2012AA011504), and ITER (2012GB102008).
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Chen, X., Guo, Y., Zhou, B. et al. Deformable model for estimating clothed and naked human shapes from a single image. Vis Comput 29, 1187–1196 (2013). https://doi.org/10.1007/s00371-013-0775-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-013-0775-7