Skip to main content
SpringerLink
Log in

Monocular Video Guided Garment Simulation

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

We present a prototype to generate a garment-shape sequence guided by a monocular video sequence. It is a combination of a physically-based simulation and a boundary-based modification. Given a garment in the video worn on a mannequin, the simulation generates a garment initial shape by exploiting the mannequin shapes estimated from the video. The modification then deforms the simulated 3D shape into such a shape that matches the garment 2D boundary extracted from the video. According to the matching correspondences between the vertices on the shape and the points on the boundary, the modification is implemented by attracting the matched vertices and their neighboring vertices. For best-matching correspondences and efficient performance, three criteria are introduced to select the candidate vertices for matching. Since modifying each garment shape independently may cause inter-frame oscillations, changes by the modification are also propagated from one frame to the next frame. As a result, the generated garment 3D shape sequence is stable and similar to the garment video sequence. We demonstrate the effectiveness of our prototype with a number of examples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Fadaifard H,Wolberg G. Image warping for retargeting garments among arbitrary poses. The Visual Computer, 2013, 29(6/7/8): 525–534.

  2. Guan P, Weiss A, Bˇalan A, Black M J. Estimating human shape and pose from a single image. In Proc. the 12th International Conference on Computer Vision, Sept.29–Oct.2, 2009, pp.1381-1388.

  3. Wei X, Chai J. VideoMocap: Modeling physically realistic human motion from monocular video sequences. ACM Transactions on Graphics, 2010, 29(4): 42:1–42:10.

  4. Zhou S, Fu H, Liu L, Cohen-Or D, Han X. Parametric reshaping of human bodies in images. ACM Transactions on Graphics, 2010, 29(4): 126:1–126:10.

  5. Vondrak M, Sigal L, Hodgins J, Jenkins O. Video-based 3D motion capture through biped control. ACM Transactions on Graphics, 2012, 31(4): 27:1–27:12.

  6. Chen X, Guo Y, Zhou B, Zhao Q. Deformable model for estimating clothed and naked human shapes from a single image. The Visual Computer, 2013, 29(11): 1187–1196.

    Article  Google Scholar 

  7. Guo Y, Chen X, Zhou B, Zhao Q. Clothed and naked human shapes estimation from a single image. In Proc. the 1st International Conference on Computational Visual Media, Nov. 2012, pp.43-50.

  8. Popa T, Zhou Q, Bradley D, Kraevoy V, Fu H, Sheffer A, Heidrich W. Wrinkling captured garments using space-time data-driven deformation. Computer Graphics Forum, 2009, 28(2): 427–435.

    Article  Google Scholar 

  9. Kraevoy V, Sheffer A, van de Panne M. Modeling from contour drawings. In Proc. the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling, Aug. 2009, pp.37-44.

  10. Wang H, Liao M, Zhang Q, Yang R, Turk G. Physically guided liquid surface modeling from videos. ACM Transactions on Graphics, 2009, 28(3): 90:1–90:11.

  11. Guskov I, Klibanov S, Bryant B. Trackable surfaces. In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, July 2003, pp.251-257.

  12. Hasler N, Asbach M, Rosenhahn B et al. Physically based tracking of cloth. In Proc. the 11th International Fall Workshop on Vision, Modeling, and Visualization, Nov. 2006, pp.49-56.

  13. Pritchard D, Heidrich W. Cloth motion capture. Computer Graphics Forum, 2003, 22(3): 263–271.

    Article  Google Scholar 

  14. Scholz V, Stich T, Keckeisen M et al. Garment motion capture using color-coded patterns. Computer Graphics Forum, 2005, 24(3): 439–447.

    Article  Google Scholar 

  15. White R, Crane K, Forsyth D A. Capturing and animating occluded cloth. ACM Transactions on Graphics, 2007, 26(3): 34:1–34:8.

  16. Bradley D, Popa T, Sheffer A, Heidrich W, Boubekeur T. Markerless garment capture. ACM Transactions on Graphics, 2008, 27(3): 99:1–99:10.

  17. de Aguiar E, Stoll C, Theobalt C, Ahmed N, Seidel H P, Thrun S. Performance capture from sparse multi-view video. ACM Transactions on Graphics, 2008, 27(3): 98:1–98:10.

  18. Gall J, Stoll C, de Aguiar E, Theobalt C, Rosenhahn B, Seidel H P. Motion capture using joint skeleton tracking and surface estimation. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 2009, pp.1746-1753.

  19. Stoll C, Gall J, de Aguiar E, Thrun S, Theobalt C. Videobased reconstruction of animatable human characters. ACM Transactions on Graphics, 2010, 29(6): 139:1–139:10.

  20. Rosenhahn B, Kersting U, Powell K, Klette R, Klette G, Seidel H P. A system for articulated tracking incorporating a clothing model. Machine Vision and Applications, 2007, 18(1): 25–40.

    Article  Google Scholar 

  21. Vlasic D, Baran I, Matusik W, Popović J. Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics, 2008, 27(3): 97:1–97:9.

  22. Decaudin P, Julius D, Wither J, Boissieux L, Sheffer A, Cani M P. Virtual garments: A fully geometric approach for clothing design. Computer Graphics Forum, 2006, 25(3): 625–634.

    Article  Google Scholar 

  23. Turquin E, Cani M P, Hughes J F. Sketching garments for virtual characters. In Proc. the 1st Eurographics Workshop on Sketch-Based Interfaces and Modeling, Aug. 2004, pp.175-182.

  24. Robson C, Maharik R, Sheffer A, Carr N. Context-aware garment modeling from sketches. Computers and Graphics, 2011, 35(3): 604–613.

    Article  Google Scholar 

  25. Turquin E, Wither J, Boissieux L, Cani M P, Hughes J F. A sketch-based interface for clothing virtual characters. IEEE Computer Graphics and Applications, 2007, 27(1): 72–81.

    Article  Google Scholar 

  26. Zhou B, Chen X, Fu Q, Guo K, Tan P. Garment modeling from a single image. Computer Graphics Forum, 2013, 32(7): 85–91.

    Article  Google Scholar 

  27. Miguel E, Tamstorf R, Bradley D, Schvartzman S C, Thomaszewski B, Bickel B, Matusik W, Marschner S, Otaduy M A. Modeling and estimation of internal friction in cloth. ACM Transactions on Graphics, 2013, 32(6): 212:1–212:10.

  28. Wang H, O’Brien J F, Ramamoorthi R. Datadriven elastic models for cloth: Modeling and measurement. ACM Transactions on Graphics, 2011, 30(4): 71:1–71:12.

  29. Bhat K S, Twigg C D, Hodgins J K, Khosla P K, Popović Z, Seitz S M. Estimating cloth simulation parameters from video. In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, July 2003, pp.37-51.

  30. Jojic N, Huang T S. Estimating cloth draping parameters from range data. In Proc. International Workshop on Synthetic-Natural Hybrid Coding and 3D Imaging, Sept. 1997, pp.73-76.

  31. Jojic N, Huang T S. On analysis of cloth drape range data. In Proc. the 3rd Asian Conference on Computer Vision, Jan. 1998, pp.463-470.

  32. Miguel E, Bradley D, Thomaszewski B, Bickel B, Matusik W, Otaduy M A, Marschner S. Data-driven estimation of cloth simulation models. Computer Graphics Forum, 2012, 31(2pt2): 519–528.

  33. Berthouzoz F, Garg A, Kaufman D M, Grinspun E, Agrawala M. Parsing sewing patterns into 3D garments. ACM Transactions on Graphics, 2013, 32(4): 85:1–85:12.

  34. Selle A, Su J, Irving G, Fedkiw R. Robust high-resolution cloth using parallelism, history-based collisions, and accurate friction. IEEE Transactions on Visualization and Computer Graphics, 2009, 15(2): 339–350.

    Article  Google Scholar 

  35. Chen X, Li F, Zhao Q, Quan L. Optimizing neighborhood projection with relaxation factor for inextensible cloth simulation. The Visual Computer, 2013, 30(4): 431–442.

    Article  Google Scholar 

  36. Bridson R, Fedkiw R, Anderson J. Robust treatment of collisions, contact and friction for cloth animation. ACM Transactions on Graphics, 2002, 21(3): 594–603.

    Article  Google Scholar 

  37. Vijayanarasimhan S, Grauman K. Active frame selection for label propagation in videos. In Proc. the 12th European Conference on Computer Vision, Oct. 2012, pp.496-509.

  38. Cao C, Hou Q, Zhou K. Displaced dynamic expression regression for real-time facial tracking and animation. ACM Transactions on Graphics, 2014, 33(4): 43:1–43:10.

  39. Liu X, Hao A, Zhao D. Optimization-based key frame extraction for motion capture animation. The Visual Computer, 2013, 29(1): 85–95.

    Article  Google Scholar 

  40. Chen T, Tan P, Ma L, Cheng M, Shamir A, Hu S. Pose-Shop: A human image database and personalized content synthesis. IEEE Transactions on Visualization and Computer Graphics, 2013, 19(5): 824–837.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering Beihang University, Beijing, 100191, China

    Fa-Ming Li, Xiao-Wu Chen, Bin Zhou, Fei-Xiang Lu, Kan Guo & Qiang Fu

Authors
  1. Fa-Ming Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiao-Wu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bin Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fei-Xiang Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kan Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qiang Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiao-Wu Chen.

Additional information

This work was partially supported by the National High Technology Research and Development 863 Program of China under Grant No. 2013AA013801, the National Natural Science Foundation of China under Grant No. 61325011, and the Specialized Research Fund for the Doctoral Program of Higher Education of China under Grant No. 20131102130002.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, FM., Chen, XW., Zhou, B. et al. Monocular Video Guided Garment Simulation. J. Comput. Sci. Technol. 30, 528–539 (2015). https://doi.org/10.1007/s11390-015-1543-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-015-1543-0

Keywords

Search

Navigation