Skip to main content
SpringerLink
Log in

Cloth Simulation Based Motion Capture of Dressed Humans

  • Chapter
  • First Online:
Virtual Realities

  • 1824 Accesses

Abstract

Commonly, marker based as well as markerless motion capture systems assume that the tracked person is wearing tightly fitting clothes. Unfortunately, this restriction cannot be satisfied in many situations and most preexisting video data does not adhere to it either. In this work we propose a graphics based vision approach for tracking humans markerlessly without making this assumption. Instead, a physically based simulation of the clothing the tracked person is wearing is used to guide the tracking algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ascher, U., Boxerman, E.: On the modified conjugate gradient method in cloth simulation. The Visual Computer 19(7–8), 523–531 (2003)

    Google Scholar 

  2. Baraff, D., Witkin, A.: Large steps in cloth simulation. In: Proceedings of ACM SIGGRAPH 98, pp. 43–54. ACM (1998)

    Google Scholar 

  3. Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popović, Z., Seitz, S.: Estimating cloth simulation parameters from video. In: Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2003), pp. 37–51. ACM (2003)

    Google Scholar 

  4. Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 8. IEEE Computer Society, Washington, DC, USA (1998)

    Google Scholar 

  5. Bregler, C., Malik, J., Pullen, K.: Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision 56(3), 179–194 (2004). DOI dx.doi.org/10.1023/B:VISI.0000011203.00237.9b

  6. Bridson, R.: Computational aspects of dynamic surfaces. Ph.D. thesis, Stanford University (2003)

    Google Scholar 

  7. Bridson, R., Fedkiw, R., Anderson, J.: Robust treatment of collisions, contact and friction for cloth animation. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 594–603 (2002)

    Google Scholar 

  8. Brox, T., Rousson, M., Deriche, R., Weickert, J.: Unsupervised segmentation incorporating colour, texture, and motion. In: N. Petkov, M.A. Westenberg (eds.) Computer Analysis of Images and Patterns, LNCS, vol. 2756, pp. 353–360. Springer, Groningen, (2003)

    Google Scholar 

  9. Chan, T., Vese, L.: Active contours without edges. In: IEEE Transactions on Image Processing, vol. 10, pp. 266–277. Los Angeles, CA, USA (2001)

    Google Scholar 

  10. Choi, K.J., Ko, H.S.: Stable but responsive cloth. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 604–611 (2002)

    Google Scholar 

  11. Desbrun, M., Schröder, P., Barr, A.: Interactive animation of structured deformable objects. In: Proceedings of Graphics Interface (GI 1999), pp. 1–8. Canadian Computer-Human Communications Society (1999)

    Google Scholar 

  12. Eberhardt, B., Weber, A., Straßer, W.: A fast, flexible, particle-system model for cloth draping. IEEE Computer Graphics and Applications 16(5), 52–59 (1996)

    Article  Google Scholar 

  13. Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)

    Article  MATH  Google Scholar 

  14. Gavrila, D.M., Davis, L.S.: 3-d model-based tracking of humans in action: a multi-view approach. In: CVPR ’96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR ’96), p. 73. IEEE Computer Society, Washington, DC, USA (1996)

    Google Scholar 

  15. Hogg, D.: Model-based vision: a program to see a walking person. Image and Vision Computing 1(1), 5–20 (1983)

    Article  Google Scholar 

  16. Jojic, N., Huang, T.: On analysis of cloth drape range data. In: ACCV ’98: Proceedings of the Third Asian Conference on Computer Vision-Volume II, pp. 463–470. Springer, London (1997)

    Google Scholar 

  17. Kang, Y.M., Cho, H.G.: Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. In: Proceedings of Computer Animation, pp. 203–214. IEEE Computer Society (2002)

    Google Scholar 

  18. Kawabata, S.: The standardization and analysis of hand evaluation. The Textile Machinery Society of Japan (1980)

    Google Scholar 

  19. Lowe, D.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, pp. 1150–1157 (1999)

    Google Scholar 

  20. Mezger, J., Kimmerle, S., Etzmuß, O.: Progress in collision detection and response techniques for cloth animation. In: Proceedings of 10th Pacific Conference on Computer Graphics and Applications (PG 2002), pp. 444–445. IEEE Computer Society (2002)

    Google Scholar 

  21. Moeslund, T., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding: CVIU 81(3), 231–268 (2001)

    Article  MATH  Google Scholar 

  22. Murray, R.M., Sastry, S.S., Zexiang, L.: A Mathematical Introduction to Robotic Manipulation. CRC, Boca Raton (1994)

    MATH  Google Scholar 

  23. Muybridge, E.: Animal Locomotion (1887)

    Google Scholar 

  24. Pritchard, D., Heidrich, W.: Cloth motion capture. Computer Graphics Forum (Eurographics 2003) 22(3), 263–271 (2003)

    Google Scholar 

  25. Provot, X.: Collision and self-collision handling in cloth model dedicated to design garments. In: Proceedings of the Eurographics Workshop on Computer Animation and Simulation (CAS 1997), pp. 177–189. Springer (1997)

    Google Scholar 

  26. Richards, J.G.: The measurement of human motion: A comparison of commercially available systems. Human Movement Science 18(5), 589–602 (1999)

    Article  Google Scholar 

  27. Rohr, K.: Incremental recognition of pedestrians from image sequences. In: Computer Vision and Pattern Recognition, 1993. Proceedings CVPR ’93., 1993 IEEE Computer Society Conference on, pp. 8–13. New York (1993)

    Google Scholar 

  28. Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.P.: A system for articulated tracking incorporating a clothing model. Machine Vision and Applications (2006). DOI 10.1007/s00138-006-0046-y

    Google Scholar 

  29. Scholz, V., Magnor, M.: Cloth motion from optical flow. In: B. Girod, M. Magnor, H.P. Seidel (eds.) Proc. Vision, Modeling and Visualization 2004, pp. 117–124. Akademische Verlagsgesellschaft Aka GmbH, Stanford (2004)

    Google Scholar 

  30. Scholz, V., Stich, T., Keckeisen, M., Wacker, M., Magnor, M.: Garment motion capture using color-coded patterns. Computer Graphics Forum (Proc. Eurographics EG’05) 24(3), 439–448 (2005)

    Google Scholar 

  31. Shewchuk, J.R.: Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In: M.C. Lin, D. Manocha (eds.) Applied Computational Geometry: Towards Geometric Engineering, Lecture Notes in Computer Science, vol. 1148, pp. 203–222. Springer, Berlin (1996)

    Chapter  Google Scholar 

  32. Terzopoulos, D., Platt, J., Barr, A., Fleischer, K.: Elastically deformable models. In: Computer Graphics (Proceedings of ACM SIGGRAPH 87), pp. 205–214. ACM (1987)

    Google Scholar 

  33. Volino, P., Magnenat-Thalmann, N.: Accurate garment prototyping and simulation. Computer-Aided Design Applications 2(5), 645–654 (2005)

    Google Scholar 

  34. White, R., Forsyth, D., Vasanth, J.: Capturing real folds in cloth. Tech. Rep. UCB/EECS-2006-10, EECS Department, University of California, Berkeley (2006)

    Google Scholar 

  35. Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997). DOI dx.doi.org/10.1109/34.598236

Download references

Acknowledgements

We gratefully acknowledge funding by the Max-Planck Center for Visual Computing and Communication.

Author information

Authors and Affiliations

  1. Weta Digital, Wellington, New Zealand

    Nils Hasler

  2. MPI Informatik, Saarbrücken, Germany

    Nils Hasler & Hans-Peter Seidel

  3. Institut für Informationsverarbeitung, Hannover University, Hannover, Germany

    Bodo Rosenhahn

Authors
  1. Nils Hasler
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bodo Rosenhahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hans-Peter Seidel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nils Hasler .

Editor information

Editors and Affiliations

  1. Fak. Informatik, Professur für Graphische, TU Chemnitz, Straße der Nationen 62, Chemnitz, 09107, Germany

    Guido Brunnett

  2. ZIRST, INRIA Rhône-Alpes, avenue de l'Europe 655, St.Ismier, 38334, France

    Sabine Coquillart

  3. Dept. Computer Science, University of North Carolina, Sitterson Hall, Chapel Hill, 27599-3175, North Carolina, USA

    Greg Welch

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag/Wien

About this chapter

Cite this chapter

Hasler, N., Rosenhahn, B., Seidel, HP. (2011). Cloth Simulation Based Motion Capture of Dressed Humans. In: Brunnett, G., Coquillart, S., Welch, G. (eds) Virtual Realities. Springer, Vienna. https://doi.org/10.1007/978-3-211-99178-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-211-99178-7_7

  • Published:

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-99177-0

  • Online ISBN: 978-3-211-99178-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation