Skip to main content
SpringerLink
Log in

Image-based virtual exhibit and its extension to 3D

  • Published:
International Journal of Automation and Computing Aims and scope Submit manuscript

Abstract

In this paper we introduce an image-based virtual exhibition system especially for clothing product. It can provide a powerful material substitution function, which is very useful for customization clothing-built. A novel color substitution algorithm and two texture morphing methods are designed to ensure realistic substitution result. To extend it to 3D, we need to do the model reconstruction based on photos. Thus we present an improved method for modeling human body. It deforms a generic model with shape details extracted from pictures to generate a new model. Our method begins with model image generation followed by silhouette extraction and segmentation. Then it builds a mapping between pixels inside every pair of silhouette segments in the model image and in the picture. Our mapping algorithm is based on a slice space representation that conforms to the natural features of human body.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Matsushita. Wired 2.07: Kitchen Magician, [Online], Available: http://www.wired.com/wired/archive/2.07/kitchen.html, 8 Dec. 2006.

  2. Benz Mercedes. Mercedes-Benz Website, [Online], Available: http://www.mercedesbenz.com/e/home/iaa/iaa_pr10.html, 8 Dec. 2006.

  3. F. Corcoran, J. Demaine, M. Picard. INUIT3D: An Interactive Virtual 3D Web Exhibition. In Proceedings of the Conference on Museums and the Web, Boston, Massachusetts, pp. 18–20, 2002.

    Google Scholar 

  4. Y. Liu, D. M. Lu, C. Y. Diao, Y. Zhu. Dunhuang 285 Cave Multimedia Integrated Virtual Exhibit. Journal of Computer-Aided Design & Computer Graphics, vol. 16, no. 11, pp. 1528–1534, 2004.

    Google Scholar 

  5. M. White et al. ARCO-An Architecture for Digitization, Management and Presentation of Virtual Exhibitions. In Proceedings of International Conference on Computer Graphics, Hersonissos, Crete, pp. 622–625, 2004.

    Chapter  Google Scholar 

  6. Peace Home Inc. Peace Home, [Online], Available: http://www.jj5u.com/hwm/company.asp, 8 Dec. 2006.

  7. RNA2006. RNA. Cloth Exhibition System, [Online], Available: http://rnainc.jp/index2.html, 8 Dec. 2006.

  8. Y. Li, J. Sun, C. K. Tang, H. Y. Shum, Lazy Snapping. ACM Transactions on Graphics, vol. 23, no. 3, pp. 303–308, 2004.

    Article  Google Scholar 

  9. C. Rother, V. Kolmogorov, A. Blake. “GrabCut”: Interactive Foreground Extraction Using Iterated Graph Cuts. ACM Transactions on Graphics, vol. 23, no. 3, pp. 309–314, 2004.

    Article  Google Scholar 

  10. J. Sun, J. Jia, C. K. Tang, H. Y. Shum, Poisson Matting. ACM Transactions on Graphics, vol. 23, no. 3, pp. 315–321, 2004.

    Article  Google Scholar 

  11. A. Criminisi, I. Reid, A. Zisserman, Single View Metrology. International Journal of Computer Vision, vol. 40, no. 2, pp. 123–148, 2000.

    Article  Google Scholar 

  12. R. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge, UK, 2004.

    MATH  Google Scholar 

  13. L. Zhang, G. D. Phocion, J. S. Samson, S. M. Seitz. Single View Modeling of Free-form Scenes. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, Los Alamitos, CA, USA, vol. 1, pp. 990–997, 2001.

    Google Scholar 

  14. Y. Horry, K. I. Anjyo, K. Arai. Tour into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, pp. 225–232, 1997.

    Chapter  Google Scholar 

  15. D. Hoiem, A. A. Efros, M. Hebert. Automatic Photo Pop-up. In Proceedings of ACM SIGGRAPH 2005, ACM Press, New York, NY, USA, vol. 24, no. 3, pp. 577–584, 2005.

    Chapter  Google Scholar 

  16. E. Reinhard, M. Adhikhmin, B. Gooch, P. Shirley. Color Transfer between Images. IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34–41, 2001.

    Article  Google Scholar 

  17. T. Welsh, M. Ashikhmin, K. Mueller. Transferring Colour to Grayscale Images. In Proceedings of ACM SIGGRAPH 2002, San Antonio, Texas, pp. 277–280, 2002.

    Google Scholar 

  18. A. Levin, D. Lischinski, Y. Weiss. Colorization Using Optimization. ACM Transactions on Graphics, vol. 23, no. 3, pp. 689–694, 2004.

    Article  Google Scholar 

  19. N. Magnenat-Thalmann, H. Seo, F. Cordier. Automatic Modeling of Virtual Humans and Body Clothing. Journal of Computer Science and Technology, vol. 19, no. 5, pp. 575–584, Sep. 2004.

    Google Scholar 

  20. F. Devernay, O. D. Faugeras. Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Seattle, WA, pp. 208–213, 1994.

    Chapter  Google Scholar 

  21. P. P. Sloan, C. Rose, M. Cohen. Shape by Example. In Proceedings of the 2001 Symposium on Interactive 3D Graphics, ACM Press, New York, NY, USA, pp. 135–143, 2001.

    Chapter  Google Scholar 

  22. T. Funkhouser et al. Modeling by Example. ACM Transactions on Graphics, vol. 23, no. 3, pp. 652–663, 2004.

    Article  Google Scholar 

  23. A. Hilton, D. Beresford, T. Gentils, R. Smith. Virtual People: Capturing Human Models to Populate Virtual Worlds. In Proceedings of IEEE International Conference on Computer Animation, Geneva, Switzerland, pp. 174–185, 1999.

    Google Scholar 

  24. W. S. Lee, J. Gu, N. Magnenat-Thalmann. Generating Animatable 3D Virtual Humans from Photographs, Computer Graphics Forum, vol. 19, no. 3, pp. 1–10, 2000.

    Article  Google Scholar 

  25. Z. G. Pan, P. Wang, J. H. Xin, M. M. Zhang, H. L. Shen. An Illumination Distribution Preserved Colour Substitution Algorithm Based on Dichromatic Reflection Model. Displays, vol. 26, no. 3, pp. 121–127, 2005.

    Article  Google Scholar 

  26. S. Shafer. Using Color to Separatere Reflection Components. Color Research and Applications, vol. 10, pp. 210–218, 1985.

    Google Scholar 

  27. S. Tominaga, N. Tanaka. Estimating Reflection Parameters from a Single Color Image. IEEE Computer Graphics and Applications, vol. 20, no. 5, pp. 58–66, 2000.

    Article  Google Scholar 

  28. P. Wang, M. M. Zhang, J. H. Xin, Z. G. Pan, H. L. Shen. An Image-based Texture Mapping Technique for Apparel Products Exhibition and Interior Design. Displays, vol. 24, no. 4–5, pp. 179–186, 2003.

    Article  Google Scholar 

  29. C. Babski et al. Humanoid Animation Specification, [Online], Available: http://www.h-anim.org/Specifications/H-Anim200x/ISO_IEC_FCD_19774/, 8 Dec. 2006.

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, 310027, PRC

    Ming-Min Zhang, Zhi-Geng Pan, Li-Feng Ren & Peng Wang

Authors
  1. Ming-Min Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhi-Geng Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Li-Feng Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ming-Min Zhang.

Additional information

This work was supported by 973 Project (No. 2002CB312100) and Key National Natural Science Foundation of China Project on Digital Olympic Museum (No. 60533080), and National 863 High-tech Project (No. 2006AA01Z303).

Ming-Min Zhang received her B. Sc. and M. Sc. degrees from Computer Science Dept, Nanjing University in 1990 and from Zhengjiang University in 1995, respectively. She is currently an associate professor of Computer and Engineering Department, Zhejiang University.

She has published more than 20 papers in recent years. She is the co-author of two books related to computer graphics and multimedia. Her research interests include virtual reality/virtual environment, multi-resolution modeling, real-time rendering, distributed VR, visualization, multimedia and image processing.

Zhi-Geng Pan received his B. Sc. and M. Sc. degrees from Computer Science Dept, Nanjing University in 1987 and 1990, respectively, and the Ph.D. degree from Computer Science and Engineering Department, Zhejiang University in 1993. He is currently a professor of Computer and Engineering Department, Zhejiang University.

He has published more than 70 papers in recent years. He is the co-author of two books related to computer graphics and multimedia. His research interests include virtual reality/virtual environment, multi-resolution modeling, real-time rendering, distributed VR, visualization, multimedia and image processing.

Li-Feng Ren received his B. Sc. degree in engineering from Hebei University of Technology in 1996. Currently, he is a Ph. D. student in the Department of Computer Science at Zhejiang University, China.

His research interests include human body modeling, character animation, and real-time rendering.

Peng Wang received his Ph.D. degree in engineering from Computer Science Department, Zhejiang University in 2005.

His research interests include virtual reality/virtual environment, distributed VR, visualization, multimedia and image processing.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, MM., Pan, ZG., Ren, LF. et al. Image-based virtual exhibit and its extension to 3D. Int J Automat Comput 4, 18–24 (2007). https://doi.org/10.1007/s11633-007-0018-3

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11633-007-0018-3

Keywords

Search

Navigation