Abstract
In this paper we introduce an image-based virtual exhibition system especially for clothing product. It can provide a powerful material substitution function, which is very useful for customization clothing-built. A novel color substitution algorithm and two texture morphing methods are designed to ensure realistic substitution result. To extend it to 3D, we need to do the model reconstruction based on photos. Thus we present an improved method for modeling human body. It deforms a generic model with shape details extracted from pictures to generate a new model. Our method begins with model image generation followed by silhouette extraction and segmentation. Then it builds a mapping between pixels inside every pair of silhouette segments in the model image and in the picture. Our mapping algorithm is based on a slice space representation that conforms to the natural features of human body.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Matsushita. Wired 2.07: Kitchen Magician, [Online], Available: http://www.wired.com/wired/archive/2.07/kitchen.html, 8 Dec. 2006.
Benz Mercedes. Mercedes-Benz Website, [Online], Available: http://www.mercedesbenz.com/e/home/iaa/iaa_pr10.html, 8 Dec. 2006.
F. Corcoran, J. Demaine, M. Picard. INUIT3D: An Interactive Virtual 3D Web Exhibition. In Proceedings of the Conference on Museums and the Web, Boston, Massachusetts, pp. 18–20, 2002.
Y. Liu, D. M. Lu, C. Y. Diao, Y. Zhu. Dunhuang 285 Cave Multimedia Integrated Virtual Exhibit. Journal of Computer-Aided Design & Computer Graphics, vol. 16, no. 11, pp. 1528–1534, 2004.
M. White et al. ARCO-An Architecture for Digitization, Management and Presentation of Virtual Exhibitions. In Proceedings of International Conference on Computer Graphics, Hersonissos, Crete, pp. 622–625, 2004.
Peace Home Inc. Peace Home, [Online], Available: http://www.jj5u.com/hwm/company.asp, 8 Dec. 2006.
RNA2006. RNA. Cloth Exhibition System, [Online], Available: http://rnainc.jp/index2.html, 8 Dec. 2006.
Y. Li, J. Sun, C. K. Tang, H. Y. Shum, Lazy Snapping. ACM Transactions on Graphics, vol. 23, no. 3, pp. 303–308, 2004.
C. Rother, V. Kolmogorov, A. Blake. “GrabCut”: Interactive Foreground Extraction Using Iterated Graph Cuts. ACM Transactions on Graphics, vol. 23, no. 3, pp. 309–314, 2004.
J. Sun, J. Jia, C. K. Tang, H. Y. Shum, Poisson Matting. ACM Transactions on Graphics, vol. 23, no. 3, pp. 315–321, 2004.
A. Criminisi, I. Reid, A. Zisserman, Single View Metrology. International Journal of Computer Vision, vol. 40, no. 2, pp. 123–148, 2000.
R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge, UK, 2004.
L. Zhang, G. D. Phocion, J. S. Samson, S. M. Seitz. Single View Modeling of Free-form Scenes. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Los Alamitos, CA, USA, vol. 1, pp. 990–997, 2001.
Y. Horry, K. I. Anjyo, K. Arai. Tour into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, pp. 225–232, 1997.
D. Hoiem, A. A. Efros, M. Hebert. Automatic Photo Pop-up. In Proceedings of ACM SIGGRAPH 2005, ACM Press, New York, NY, USA, vol. 24, no. 3, pp. 577–584, 2005.
E. Reinhard, M. Adhikhmin, B. Gooch, P. Shirley. Color Transfer between Images. IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34–41, 2001.
T. Welsh, M. Ashikhmin, K. Mueller. Transferring Colour to Grayscale Images. In Proceedings of ACM SIGGRAPH 2002, San Antonio, Texas, pp. 277–280, 2002.
A. Levin, D. Lischinski, Y. Weiss. Colorization Using Optimization. ACM Transactions on Graphics, vol. 23, no. 3, pp. 689–694, 2004.
N. Magnenat-Thalmann, H. Seo, F. Cordier. Automatic Modeling of Virtual Humans and Body Clothing. Journal of Computer Science and Technology, vol. 19, no. 5, pp. 575–584, Sep. 2004.
F. Devernay, O. D. Faugeras. Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Seattle, WA, pp. 208–213, 1994.
P. P. Sloan, C. Rose, M. Cohen. Shape by Example. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, ACM Press, New York, NY, USA, pp. 135–143, 2001.
T. Funkhouser et al. Modeling by Example. ACM Transactions on Graphics, vol. 23, no. 3, pp. 652–663, 2004.
A. Hilton, D. Beresford, T. Gentils, R. Smith. Virtual People: Capturing Human Models to Populate Virtual Worlds. In Proceedings of IEEE International Conference on Computer Animation, Geneva, Switzerland, pp. 174–185, 1999.
W. S. Lee, J. Gu, N. Magnenat-Thalmann. Generating Animatable 3D Virtual Humans from Photographs, Computer Graphics Forum, vol. 19, no. 3, pp. 1–10, 2000.
Z. G. Pan, P. Wang, J. H. Xin, M. M. Zhang, H. L. Shen. An Illumination Distribution Preserved Colour Substitution Algorithm Based on Dichromatic Reflection Model. Displays, vol. 26, no. 3, pp. 121–127, 2005.
S. Shafer. Using Color to Separatere Reflection Components. Color Research and Applications, vol. 10, pp. 210–218, 1985.
S. Tominaga, N. Tanaka. Estimating Reflection Parameters from a Single Color Image. IEEE Computer Graphics and Applications, vol. 20, no. 5, pp. 58–66, 2000.
P. Wang, M. M. Zhang, J. H. Xin, Z. G. Pan, H. L. Shen. An Image-based Texture Mapping Technique for Apparel Products Exhibition and Interior Design. Displays, vol. 24, no. 4–5, pp. 179–186, 2003.
C. Babski et al. Humanoid Animation Specification, [Online], Available: http://www.h-anim.org/Specifications/H-Anim200x/ISO_IEC_FCD_19774/, 8 Dec. 2006.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by 973 Project (No. 2002CB312100) and Key National Natural Science Foundation of China Project on Digital Olympic Museum (No. 60533080), and National 863 High-tech Project (No. 2006AA01Z303).
Ming-Min Zhang received her B. Sc. and M. Sc. degrees from Computer Science Dept, Nanjing University in 1990 and from Zhengjiang University in 1995, respectively. She is currently an associate professor of Computer and Engineering Department, Zhejiang University.
She has published more than 20 papers in recent years. She is the co-author of two books related to computer graphics and multimedia. Her research interests include virtual reality/virtual environment, multi-resolution modeling, real-time rendering, distributed VR, visualization, multimedia and image processing.
Zhi-Geng Pan received his B. Sc. and M. Sc. degrees from Computer Science Dept, Nanjing University in 1987 and 1990, respectively, and the Ph.D. degree from Computer Science and Engineering Department, Zhejiang University in 1993. He is currently a professor of Computer and Engineering Department, Zhejiang University.
He has published more than 70 papers in recent years. He is the co-author of two books related to computer graphics and multimedia. His research interests include virtual reality/virtual environment, multi-resolution modeling, real-time rendering, distributed VR, visualization, multimedia and image processing.
Li-Feng Ren received his B. Sc. degree in engineering from Hebei University of Technology in 1996. Currently, he is a Ph. D. student in the Department of Computer Science at Zhejiang University, China.
His research interests include human body modeling, character animation, and real-time rendering.
Peng Wang received his Ph.D. degree in engineering from Computer Science Department, Zhejiang University in 2005.
His research interests include virtual reality/virtual environment, distributed VR, visualization, multimedia and image processing.
Rights and permissions
About this article
Cite this article
Zhang, MM., Pan, ZG., Ren, LF. et al. Image-based virtual exhibit and its extension to 3D. Int J Automat Comput 4, 18–24 (2007). https://doi.org/10.1007/s11633-007-0018-3
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/s11633-007-0018-3