Abstract
We present a new method for deforming an object in a static real scene, which interacts with animated synthetic characters. Unlike the existing method – making a new synthetic object to substitute for the interacting object in the real scene, we directly deform the object in image space using an image-warping technique with assistance from a simplified 3D sub-model. The deformed image sequence is processed further using the Expression Ratio Image (ERI) technique to apply the illumination changes generated by the deformation. Using this method, we can maintain the photo-realistic rendering quality of the scene efficiently by preserving the appearance of the object in the real scene as it is.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Birn, J.: Digital Lighting & Rendering. New Riders Press, Indianapolis (2000)
Debevec, P.: HDRI and Image-Based Lighting. In: SIGGRAPH 2003 Course Notes No.19 (2003)
Liu, Z., Shan, Y., Zhang, Z.: Expresive Expression Mapping with Ratio Image. In: Proceedings of SIGGRAPH 2001, pp. 271–276 (2001)
Blasko, G.: Vision-based Camera Matching Using Markers. In: Proceedings of CESCG 2000 (2000)
Gomes, J., Darsa, L., Costa, B., Velho, L.: Warping and Morphing of Graphical Objects. In: SIGGRAPH 1995 Course Notes No.3 (1995)
Barr, A.H.: Global and Local Deformations of Solid Primitives. In: Proceedings of SIGGRAPH 1984, pp. 21–30 (1984)
Smith, A.R.: Planar 2-Pass Texture Mapping and Warping. In: Proceedings of SIGGRAPH 1987, pp. 263–271 (1987)
Smithe, D.B.: A Two-Pass Mesh Warping Algorithm for Object Transformation and Image Interpolation. Technical Report 1030, ILM Computer Graphics Department, Lucas_lm (1990)
Beier, T., Neely, S.: Feature-Based Image Metamorphosis. In: Proceedings of SIGGRAPH 1992, pp. 263–271 (1992)
Lee, S.-Y., Chwa, K.-Y., Shin, S.-Y., Wolberg, G.: Image Metamorphosis Using Snakes and Free-Form Deformations. In: Proceedings of SIGGRAPH 1995, pp. 439–448 (1995)
McMillan, L., Bishop, G.: Plenoptic modeling: An Image-based rendering system. In: Proceedings of SIGGRAPH 1995, pp. 39–46 (1995)
Chen, S.E.: QuickTime VR - An Image-Based Approach to Virtual Environment Navigation. In: ACM SIGGRAPH 1995 Conference Proceedings, pp. 29–38 (1995)
Mark, W.R., McMillan, L., Bishop, G.: Post-Rendering 3D Warping. In: Proceedings 1997 Symposiums on Interactive 3D Graphics, pp. 7–16 (1997)
Chen, S.E., Williams, L.: View Interpolation for Image Synthesis. In: SIGGRAPH 1993 Conference Proceedings, pp. 279–288 (1993)
Shade, J., Gortler, S.J., He, L.W., Szeliski, R.: Layered Depth Images. In: Proceedings of SIGGRAPH 1998, pp. 231–242 (1998)
Liebowitz, D., Criminisi, A., Zisserman, A.: Creating Architectural Models from Images. In: EuroGraphics 1999 Conference Proceedings, pp. 39–50 (1999)
Debevec, P., Taylor, C., Malik, J.: Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In: Proceedings of SIGGRAPH 1996, pp. 11–20 (1996)
Chuang, Y., Goldman, D., Zheng, K., Curless, B., Salesin, D., Szeliski, R.: Animating Pictures With Stochastic Motion Textures. In: Proceedings of SIGGRAPH 2005, pp. 853–860 (2005)
Wright, S.: Digital Compositing for Film and Video. Focal Press (2001)
Witkin, A., Baraff, D., Blum, M., Monheit, G.: Physically Based Modeling: Principles and Practice. In: SIGGRAPH Course Notes 19 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chung, HV., Lee, IK. (2005). Image-Based Deformation of Objects in Real Scenes. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds) Advances in Visual Computing. ISVC 2005. Lecture Notes in Computer Science, vol 3804. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595755_20
Download citation
DOI: https://doi.org/10.1007/11595755_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30750-1
Online ISBN: 978-3-540-32284-9
eBook Packages: Computer ScienceComputer Science (R0)