skip to main content
10.1145/3284398.3284406acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

PROME: projected measures model for fast human shape estimation

Published: 02 December 2018 Publication History

Abstract

Human parametric models can provide useful constraints for human shape estimation to produce more accurate results. However, the state-of-art models are computational expensive which limit their wide use in interactive graphics applications. We present PROME (PROjected MEasures) - a novel human parametric model which has high expressive power and low computational complexity. Projected measures are sets of 2D contour poly-lines that capture key measure features defined in anthropometry. The PROME model builds the relationship between 3D shape and pose parameters and 2D projected measures. We train the PROME model in two parts: the shape model formulates deformations of projected measures caused by shape variation, and the pose model formulates deformations of projected measures caused by pose variation. Based on the PROME model we further propose a fast shape estimation method which estimates the 3D shape parameters of a subject from a single image in nearly real-time. The method builds an optimize problem and solves it using gradient optimizing strategy. Experiment results show that the PROME model has well capability in representing human body in different shape and pose comparing to existing 3D human parametric models, such as SCAPE[Anguelov et al. 2005] and TenBo[Chen et al. 2013], yet keeps much lower computational complexity. Our shape estimation method can process an image in about one second, orders of magnitude faster than state-of-art methods, and the estimating result is very close to the ground truth. The proposed method can be widely used in interactive applications such as virtual try-on and virtual reality collaboration.

References

[1]
M. Andriluka, S. Roth, and B. Schiele. 2009. Pictorial structures revisited: People detection and articulated pose estimation. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1014--1021.
[2]
Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, and James Davis. 2005. SCAPE: shape completion and animation of people. ACM Transactions on Graphics 24, 3 (July 2005), 408--416.
[3]
AO Balan and Michael J. Black. 2008. The naked truth: Estimating body shape under clothing. In ECCV 2008, David Forsyth, Philip Torr, and Andrew Zisserman (Eds.). Springer Berlin Heidelberg, 15--29.
[4]
A. O. Balan, L. Sigal, M. J. Black, J. E. Davis, and H. W. Haussecker. 2007. Detailed human shape and pose from images. In CVPR 2007. 1--8.
[5]
C Bregler, J Malik, and K Pullen. 2004. Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision 56, 3 (2004), 179--194.
[6]
Yinpeng Chen, Zicheng Liu, and Zhengyou Zhang. 2013. Tensor-Based Human Body Modeling. In 2013 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 105--112.
[7]
Oren Freifeld, Alexander Weiss, Silvia Zuffi, and Michael J. Black. 2010. Contour people: A parameterized model of 2D articulated human shape. In CVPR 2010, Vol. 1. IEEE, 639--646.
[8]
Peng Guan, O Freifeld, and Michael J. Black. 2010. A 2D human body model dressed in eigen clothing. In ECCV 2010. Springer Berlin Heidelberg, 285--298.
[9]
N. Hasler, C. Stoll, M. Sunkel, B. Rosenhahn, and H.-P. Seidel. 2009. A statistical model of human pose and body shape. In Computer Graphics Forum. Blackwell Publishing Ltd, 337--346.
[10]
Oyama Mei, Naoshi Kaneko Aoyama, Masaki Hayashi, Kazuhiko Sumi, and Takeshi Yoshida. 2017. Two-stage model fitting approach for human body shape estimation from a single depth image. In Fifteenth Iapr International Conference on Machine Vision Applications. 234--237.
[11]
Carsten Rother, Vladimir Kolmogorov, and Andrew Blake. 2004. "GrabCut". ACM Transactions on Graphics 23, 3 (Aug. 2004), 309--314.
[12]
Jamie Shotton, Andrew Fitzgibbon, Mat Cook, Toby Sharp, Mark Finocchio, Richard Moore, Alex Kipman, and Andrew Blake. 2011. Real-time human pose recognition in parts from single depth images. In CVPR 2011. IEEE, 1297--1304.
[13]
Hubert P H Shum, Edmond S L Ho, Yang Jiang, and Shu Takagi. 2013. Real-time posture reconstruction for Microsoft Kinect. IEEE transactions on cybernetics 43, 5 (Oct. 2013), 1357--1369.
[14]
Xiaolin Wei, Peizhao Zhang, and Jinxiang Chai. 2012. Accurate realtime full-body motion capture using a single depth camera. ACM Transactions on Graphics 31, 6 (Nov. 2012), 188:1--188:12.
[15]
Alexander Weiss, Alexandru O. Balan, and Michael J. Black. 2009. Estimating human shape and pose from a single image. In ICCV 2009. IEEE, 1381--1388.
[16]
Mao Ye and Ruigang Yang. 2014. Real-Time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera. 2014 IEEE Conference on Computer Vision and Pattern Recognition (June 2014), 2353--2360.
[17]
Chao Zhang, Sergi Pujades, Michael Black, and Gerard Pons-Moll. 2017. Detailed, Accurate, Human Shape Estimation from Clothed 3D Scan Sequences. In Computer Vision and Pattern Recognition. 5484--5493.
[18]
Yuzhe Zhang, Jianmin Zheng, and Nadia Magnenat-Thalmann. 2014. Example-guided anthropometric human body modeling. The Visual Computer (2014), 1--17.

Index Terms

  1. PROME: projected measures model for fast human shape estimation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    VRCAI '18: Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
    December 2018
    200 pages
    ISBN:9781450360876
    DOI:10.1145/3284398
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 December 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. anthropometry
    2. human shape estimation
    3. parametric models

    Qualifiers

    • Research-article

    Conference

    VRCAI '18
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 51 of 107 submissions, 48%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 103
      Total Downloads
    • Downloads (Last 12 months)4
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media