Abstract
In this paper, we present an augmented reality system for interactive virtual try-on of garments based on real-time motion capture. The system uses a commodity depth sensor to obtain depth images and joint motion data of a user. We first apply a novel evaluation method over two specific depth images to determine the user’s body measurements, according to which garment models are deformed to fit his/her actual size. Torso joint of the selected garment model is translated to follow the user’s position, while other joints are rotated to mimic the user’s postures. Then the system superimposes the transformed model onto the same user in a live image sequence and move with him/her accurately. We also propose a method for handling model dangling artifacts due to the limitations of current tracking techniques in producing smooth, noise free motion data in real-time. The system can be used at user’s home as well as retailer’s shop to present an interactive try-on experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cordier, F., Seo, H., Magnenat-Thalmann, N.: Made-to-measure technologies for an online clothing store. IEEE Computer Graphics and Applications 23(1), 38–48 (2003)
Zhang, W., Matsumoto, T., Liu, J., Chu, M., Begole, B.: An intelligent fitting room using multi-camera perception. In: Proceedings of the 13th International Conference on Intelligent User Interfaces, IUI 2008, pp. 60–69. ACM, New York (2008)
Hauswiesner, S., Straka, M., Reitmayr, G.: Free viewpoint virtual try-on with commodity depth cameras. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 23–30. ACM, New York (2011)
Yuan, M., Khan, I.R., Farbiz, F., Niswar, A., Huang, Z.: A mixed reality system for virtual glasses try-on. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 363–366. ACM, New York (2011)
Kasap, M., Magnenat-Thalmann, N.: Parameterized human body model for real-time applications. In: Proceedings of the 2007 International Conference on Cyberworlds, CW 2007, pp. 160–167. IEEE Computer Society, Washington, DC (2007)
Kasap, M., Magnenat-Thalmann, N.: Sizing avatars from skin weights. In: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, VRST 2009, pp. 123–126. ACM, New York (2009)
Magnenat-Thalmann, N., Laperrière, R., Thalmann, D.: Joint-dependent local deformations for hand animation and object grasping. In: Proceedings on Graphics Interface 1988, pp. 26–33. Canadian Information Processing Society, Toronto (1988)
Kavan, L., Collins, S., Žára, J., O’Sullivan, C.: Geometric skinning with approximate dual quaternion blending. ACM Trans. Graph. 27(4), 105:1–105:23 (2008)
Cordier, F., Magnenat-Thalmann, N.: A data-driven approach for real-time clothes simulation. In: Proceedings of the 12th Pacific Conference on Computer Graphics and Applications, PG 2004, pp. 257–266 (October 2004)
Kavan, L., Žára, J.: Spherical blend skinning: a real-time deformation of articulated models. In: Proceedings of the 2005 Symposium on Interactive 3D Graphics and Games, I3D 2005, pp. 9–16. ACM, New York (2005)
Jacobson, A., Sorkine, O.: Stretchable and twistable bones for skeletal shape deformation. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 165:1–165:8. ACM, New York (2011)
Meng, Y., Mok, P.Y., Jin, X.: Interactive virtual try-on clothing design systems. Comput. Aided Des. 42(4), 310–321 (2010)
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., Theobalt, C.: Video-based reconstruction of animatable human characters. ACM Trans. Graph. 29(6), 139:1–139:10 (2010)
Baran, I., Popović, J.: Automatic rigging and animation of 3d characters. In: ACM SIGGRAPH 2007 Papers, SIGGRAPH 2007. ACM, New York (2007)
Ganapathi, V., Plagemann, C., Koller, D., Thrun, S.: Real time motion capture using a single time-of-flight camera. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 755–762 (June 2010)
OpenNI: Open Natural Interface SDK (2012), http://www.openni.org
Alexiadis, D.S., Kelly, P., Daras, P., O’Connor, N.E., Boubekeur, T., Moussa, M.B.: Evaluating a dancer’s performance using kinect-based skeleton tracking. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 659–662. ACM, New York (2011)
Bleiweiss, A., Eshar, D., Kutliroff, G., Lerner, A., Oshrat, Y., Yanai, Y.: Enhanced interactive gaming by blending full-body tracking and gesture animation. In: ACM SIGGRAPH ASIA 2010 Sketches, SA 2010, pp. 34:1–34:2. ACM, New York (2010)
Montgomery, D.C., Peck, E.A., Vining, G.G.: Introduction to Linear Regression Analysis, Solutions Manual. Wiley Series in Probability and Statistics. Wiley-Interscience (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhu, X., Qin, S., Yu, H., Ge, S., Yang, Y., Jiang, Y. (2012). Interactive Virtual Try-On Based on Real-Time Motion Capture. In: Lin, W., et al. Advances in Multimedia Information Processing – PCM 2012. PCM 2012. Lecture Notes in Computer Science, vol 7674. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34778-8_58
Download citation
DOI: https://doi.org/10.1007/978-3-642-34778-8_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34777-1
Online ISBN: 978-3-642-34778-8
eBook Packages: Computer ScienceComputer Science (R0)