Skip to main content

Image-Based Deformation of Objects in Real Scenes

  • Conference paper
Advances in Visual Computing (ISVC 2005)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3804))

Included in the following conference series:

Abstract

We present a new method for deforming an object in a static real scene, which interacts with animated synthetic characters. Unlike the existing method – making a new synthetic object to substitute for the interacting object in the real scene, we directly deform the object in image space using an image-warping technique with assistance from a simplified 3D sub-model. The deformed image sequence is processed further using the Expression Ratio Image (ERI) technique to apply the illumination changes generated by the deformation. Using this method, we can maintain the photo-realistic rendering quality of the scene efficiently by preserving the appearance of the object in the real scene as it is.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Birn, J.: Digital Lighting & Rendering. New Riders Press, Indianapolis (2000)

    Google Scholar 

  2. Debevec, P.: HDRI and Image-Based Lighting. In: SIGGRAPH 2003 Course Notes No.19 (2003)

    Google Scholar 

  3. Liu, Z., Shan, Y., Zhang, Z.: Expresive Expression Mapping with Ratio Image. In: Proceedings of SIGGRAPH 2001, pp. 271–276 (2001)

    Google Scholar 

  4. Blasko, G.: Vision-based Camera Matching Using Markers. In: Proceedings of CESCG 2000 (2000)

    Google Scholar 

  5. Gomes, J., Darsa, L., Costa, B., Velho, L.: Warping and Morphing of Graphical Objects. In: SIGGRAPH 1995 Course Notes No.3 (1995)

    Google Scholar 

  6. Barr, A.H.: Global and Local Deformations of Solid Primitives. In: Proceedings of SIGGRAPH 1984, pp. 21–30 (1984)

    Google Scholar 

  7. Smith, A.R.: Planar 2-Pass Texture Mapping and Warping. In: Proceedings of SIGGRAPH 1987, pp. 263–271 (1987)

    Google Scholar 

  8. Smithe, D.B.: A Two-Pass Mesh Warping Algorithm for Object Transformation and Image Interpolation. Technical Report 1030, ILM Computer Graphics Department, Lucas_lm (1990)

    Google Scholar 

  9. Beier, T., Neely, S.: Feature-Based Image Metamorphosis. In: Proceedings of SIGGRAPH 1992, pp. 263–271 (1992)

    Google Scholar 

  10. Lee, S.-Y., Chwa, K.-Y., Shin, S.-Y., Wolberg, G.: Image Metamorphosis Using Snakes and Free-Form Deformations. In: Proceedings of SIGGRAPH 1995, pp. 439–448 (1995)

    Google Scholar 

  11. McMillan, L., Bishop, G.: Plenoptic modeling: An Image-based rendering system. In: Proceedings of SIGGRAPH 1995, pp. 39–46 (1995)

    Google Scholar 

  12. Chen, S.E.: QuickTime VR - An Image-Based Approach to Virtual Environment Navigation. In: ACM SIGGRAPH 1995 Conference Proceedings, pp. 29–38 (1995)

    Google Scholar 

  13. Mark, W.R., McMillan, L., Bishop, G.: Post-Rendering 3D Warping. In: Proceedings 1997 Symposiums on Interactive 3D Graphics, pp. 7–16 (1997)

    Google Scholar 

  14. Chen, S.E., Williams, L.: View Interpolation for Image Synthesis. In: SIGGRAPH 1993 Conference Proceedings, pp. 279–288 (1993)

    Google Scholar 

  15. Shade, J., Gortler, S.J., He, L.W., Szeliski, R.: Layered Depth Images. In: Proceedings of SIGGRAPH 1998, pp. 231–242 (1998)

    Google Scholar 

  16. Liebowitz, D., Criminisi, A., Zisserman, A.: Creating Architectural Models from Images. In: EuroGraphics 1999 Conference Proceedings, pp. 39–50 (1999)

    Google Scholar 

  17. Debevec, P., Taylor, C., Malik, J.: Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In: Proceedings of SIGGRAPH 1996, pp. 11–20 (1996)

    Google Scholar 

  18. Chuang, Y., Goldman, D., Zheng, K., Curless, B., Salesin, D., Szeliski, R.: Animating Pictures With Stochastic Motion Textures. In: Proceedings of SIGGRAPH 2005, pp. 853–860 (2005)

    Google Scholar 

  19. Wright, S.: Digital Compositing for Film and Video. Focal Press (2001)

    Google Scholar 

  20. Witkin, A., Baraff, D., Blum, M., Monheit, G.: Physically Based Modeling: Principles and Practice. In: SIGGRAPH Course Notes 19 (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chung, HV., Lee, IK. (2005). Image-Based Deformation of Objects in Real Scenes. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds) Advances in Visual Computing. ISVC 2005. Lecture Notes in Computer Science, vol 3804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595755_20

Download citation

  • DOI: https://doi.org/10.1007/11595755_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30750-1

  • Online ISBN: 978-3-540-32284-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics