Abstract
Commonly, marker based as well as markerless motion capture systems assume that the tracked person is wearing tightly fitting clothes. Unfortunately, this restriction cannot be satisfied in many situations and most preexisting video data does not adhere to it either. In this work we propose a graphics based vision approach for tracking humans markerlessly without making this assumption. Instead, a physically based simulation of the clothing the tracked person is wearing is used to guide the tracking algorithm.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ascher, U., Boxerman, E.: On the modified conjugate gradient method in cloth simulation. The Visual Computer 19(7–8), 523–531 (2003)
Baraff, D., Witkin, A.: Large steps in cloth simulation. In: Proceedings of ACM SIGGRAPH 98, pp. 43–54. ACM (1998)
Bhat, K., Twigg, C., Hodgins, J., Khosla, P., Popović, Z., Seitz, S.: Estimating cloth simulation parameters from video. In: Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2003), pp. 37–51. ACM (2003)
Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: CVPR ’98: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, p. 8. IEEE Computer Society, Washington, DC, USA (1998)
Bregler, C., Malik, J., Pullen, K.: Twist based acquisition and tracking of animal and human kinematics. International Journal of Computer Vision 56(3), 179–194 (2004). DOI dx.doi.org/10.1023/B:VISI.0000011203.00237.9b
Bridson, R.: Computational aspects of dynamic surfaces. Ph.D. thesis, Stanford University (2003)
Bridson, R., Fedkiw, R., Anderson, J.: Robust treatment of collisions, contact and friction for cloth animation. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 594–603 (2002)
Brox, T., Rousson, M., Deriche, R., Weickert, J.: Unsupervised segmentation incorporating colour, texture, and motion. In: N. Petkov, M.A. Westenberg (eds.) Computer Analysis of Images and Patterns, LNCS, vol. 2756, pp. 353–360. Springer, Groningen, (2003)
Chan, T., Vese, L.: Active contours without edges. In: IEEE Transactions on Image Processing, vol. 10, pp. 266–277. Los Angeles, CA, USA (2001)
Choi, K.J., Ko, H.S.: Stable but responsive cloth. ACM Transactions on Graphics (ACM SIGGRAPH 2002) 21(3), 604–611 (2002)
Desbrun, M., Schröder, P., Barr, A.: Interactive animation of structured deformable objects. In: Proceedings of Graphics Interface (GI 1999), pp. 1–8. Canadian Computer-Human Communications Society (1999)
Eberhardt, B., Weber, A., Straßer, W.: A fast, flexible, particle-system model for cloth draping. IEEE Computer Graphics and Applications 16(5), 52–59 (1996)
Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)
Gavrila, D.M., Davis, L.S.: 3-d model-based tracking of humans in action: a multi-view approach. In: CVPR ’96: Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR ’96), p. 73. IEEE Computer Society, Washington, DC, USA (1996)
Hogg, D.: Model-based vision: a program to see a walking person. Image and Vision Computing 1(1), 5–20 (1983)
Jojic, N., Huang, T.: On analysis of cloth drape range data. In: ACCV ’98: Proceedings of the Third Asian Conference on Computer Vision-Volume II, pp. 463–470. Springer, London (1997)
Kang, Y.M., Cho, H.G.: Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. In: Proceedings of Computer Animation, pp. 203–214. IEEE Computer Society (2002)
Kawabata, S.: The standardization and analysis of hand evaluation. The Textile Machinery Society of Japan (1980)
Lowe, D.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, pp. 1150–1157 (1999)
Mezger, J., Kimmerle, S., Etzmuß, O.: Progress in collision detection and response techniques for cloth animation. In: Proceedings of 10th Pacific Conference on Computer Graphics and Applications (PG 2002), pp. 444–445. IEEE Computer Society (2002)
Moeslund, T., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding: CVIU 81(3), 231–268 (2001)
Murray, R.M., Sastry, S.S., Zexiang, L.: A Mathematical Introduction to Robotic Manipulation. CRC, Boca Raton (1994)
Muybridge, E.: Animal Locomotion (1887)
Pritchard, D., Heidrich, W.: Cloth motion capture. Computer Graphics Forum (Eurographics 2003) 22(3), 263–271 (2003)
Provot, X.: Collision and self-collision handling in cloth model dedicated to design garments. In: Proceedings of the Eurographics Workshop on Computer Animation and Simulation (CAS 1997), pp. 177–189. Springer (1997)
Richards, J.G.: The measurement of human motion: A comparison of commercially available systems. Human Movement Science 18(5), 589–602 (1999)
Rohr, K.: Incremental recognition of pedestrians from image sequences. In: Computer Vision and Pattern Recognition, 1993. Proceedings CVPR ’93., 1993 IEEE Computer Society Conference on, pp. 8–13. New York (1993)
Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.P.: A system for articulated tracking incorporating a clothing model. Machine Vision and Applications (2006). DOI 10.1007/s00138-006-0046-y
Scholz, V., Magnor, M.: Cloth motion from optical flow. In: B. Girod, M. Magnor, H.P. Seidel (eds.) Proc. Vision, Modeling and Visualization 2004, pp. 117–124. Akademische Verlagsgesellschaft Aka GmbH, Stanford (2004)
Scholz, V., Stich, T., Keckeisen, M., Wacker, M., Magnor, M.: Garment motion capture using color-coded patterns. Computer Graphics Forum (Proc. Eurographics EG’05) 24(3), 439–448 (2005)
Shewchuk, J.R.: Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In: M.C. Lin, D. Manocha (eds.) Applied Computational Geometry: Towards Geometric Engineering, Lecture Notes in Computer Science, vol. 1148, pp. 203–222. Springer, Berlin (1996)
Terzopoulos, D., Platt, J., Barr, A., Fleischer, K.: Elastically deformable models. In: Computer Graphics (Proceedings of ACM SIGGRAPH 87), pp. 205–214. ACM (1987)
Volino, P., Magnenat-Thalmann, N.: Accurate garment prototyping and simulation. Computer-Aided Design Applications 2(5), 645–654 (2005)
White, R., Forsyth, D., Vasanth, J.: Capturing real folds in cloth. Tech. Rep. UCB/EECS-2006-10, EECS Department, University of California, Berkeley (2006)
Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 780–785 (1997). DOI dx.doi.org/10.1109/34.598236
Acknowledgements
We gratefully acknowledge funding by the Max-Planck Center for Visual Computing and Communication.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag/Wien
About this chapter
Cite this chapter
Hasler, N., Rosenhahn, B., Seidel, HP. (2011). Cloth Simulation Based Motion Capture of Dressed Humans. In: Brunnett, G., Coquillart, S., Welch, G. (eds) Virtual Realities. Springer, Vienna. https://doi.org/10.1007/978-3-211-99178-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-211-99178-7_7
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-99177-0
Online ISBN: 978-3-211-99178-7
eBook Packages: Computer ScienceComputer Science (R0)