Abstract
We propose an image-based virtual try-on system for garments in order to reproduce the appearance of try-on during online shopping. Given whole-body images of a fashion model and a customer, we cut out a garment image from the fashion model image and reshape it so that it fits to the body shape of the customer. The reshaping function is estimated automatically from the body contours of the fashion model and the customer. The fitting result is refined further by automatic color correction with reference to the facial regions and a method of retouching parts that protrude from the rear of the garment image. We verified the effectiveness of our system through a user test.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: shape completion and animation of people. In: ACM SIGGRAPH 2005 Papers, pp. 408–416 (2005)
Bianco, S., Schettini, R.: Color constancy using faces. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 65–72 (2012)
Brouet, R., Sheffer, A., Boissieux, L., Cani, M.P.: Design preserving garment transfer. ACM Trans. Graph. 31(4), 36:1–36:11 (2012)
Cordier, F., Lee, W., Seo, H., Magnenat-Thalmann, N.: From 2D photos of yourself to virtual try-on dress on the web. In: Blandford, A., Vanderdonckt, J., Gray, P. (eds.) People and Computers XV—Interaction Without Frontiers, pp. 31–46. Springer, London (2001)
Cordier, F., Seo, H., Magnenat-Thalmann, N.: Made-to-measure technologies for an online clothing store. IEEE Comput. Graph. Appl. 23(1), 38–48 (2003)
Avielan Corporation: Awaseba. www.awaseba.com/
Edwards, G.J., Taylor, C.J., Cootes, T.F.: Interpreting face images using active appearance models. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 300–305 (1998)
Ehara, J., Saito, H.: Texture overlay for virtual clothing based on PCA of silhouettes. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 139–142. IEEE Computer Society (2006)
Guan, P., Freifeld, O., Black, M.J.: A 2D human body model dressed in eigen clothing. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 285–298. Springer, Heidelberg (2010)
Guan, P., Reiss, L., Hirshberg, D.A., Weiss, A., Black, M.J.: DRAPE: DRessing Any PErson. ACM Trans. Graph. 31(4), 35:1–35:10 (2012)
Hauswiesner, S., Straka, M., Reitmayr, G.: Free viewpoint virtual try-on with commodity depth cameras. In: Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI 2011, pp. 23–30 (2011)
Hilsmann, A., Fechteler, P., Eisert, P.: Pose space image based rendering. Comput. Graph. Forum 32(2), 265–274 (2013). Proceedings of Eurographics
Jain, V., Zhang, H.: Robust 2D shape correspondence using geodesic shape context. In: Proceedings of Pacific Graphics, pp. 121–124 (2005)
von Kries, J.: Influence of adaptation on the effects produced by luminous stimuli. In: MacAdam, D. (ed.) Sources of Color Science, pp. 109–119. MIT Press, Cambridge (1970)
Protopsaltou, D., Luible, C., Arevalo-Poizat, M., Magnenat-Thalmann, N.: A body and garment creation method for an internet based virtual fitting room. In: Proceedings of Computer Graphics International (CGI 2002), pp. 105–122. Springer (2002)
Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. In: ACM SIGGRAPH 2006 Papers, pp. 533–540. ACM, New York (2006)
STARTTODAY CO., LTD.: ZOZOTOWN. http://zozo.jp/
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. 23(3), 399–405 (2004). Proceedings of SIGGRAPH 2004
Tong, J., Zhou, J., Liu, L., Pan, Z., Yan, H.: Scanning 3D full human bodies using kinects. IEEE Trans. Visual. Comput. Graph. 18(4), 643–650 (2012). Proceedings of IEEE Virtual Reality
Wang, H., Hecht, F., Ramamoorthi, R., O’Brien, J.: Example-based wrinkle synthesis for clothing animation. In: ACM SIGGRAPH 2010 Papers, pp. 107:1–107:8 (2010)
Weng, Y., Xu, W., Wu, Y., Zhou, K., Guo, B.: 2D shape deformation using nonlinear least squares optimization. Vis. Comput. 22(9), 653–660 (2006)
Xu, W., Umentani, N., Chao, Q., Mao, J., Jin, X., Tong, X.: Sensitivity-optimized rigging for example-based real-time clothing synthesis. In: ACM Transactions on Graphics (Proceedings of SIGGRAPH 2014), vol. 33, no. 4, August 2014
Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. In: ACM SIGGRAPH 2010 Papers, pp. 126:1–126:10 (2010)
Zhou, Z., Shu, B., Zhuo, S., Deng, X., Tan, P., Lin, S.: Image-based clothes animation for virtual fitting. In: SIGGRAPH Asia 2012 Technical Briefs, pp. 33:1–33:4 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kanamori, Y., Yamada, H., Hirose, M., Mitani, J., Fukui, Y. (2016). Image-Based Virtual Try-On System with Garment Reshaping and Color Correction. In: Gavrilova, M., Tan, C., Iglesias, A., Shinya, M., Galvez, A., Sourin, A. (eds) Transactions on Computational Science XXVI. Lecture Notes in Computer Science(), vol 9550. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-49247-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-662-49247-5_1
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-49246-8
Online ISBN: 978-3-662-49247-5
eBook Packages: Computer ScienceComputer Science (R0)