Abstract
We synthesize animations from a single image by transferring fluid motion of a video example globally. Given a target image of a fluid scene, an alpha matte is required to extract the fluid region. Our method needs to adjust a user-specified video example for producing the fluid motion suitable for the extracted fluid region. Employing the fluid video database, the flow field of the target image is obtained by warping the optical flow of a video frame that has a visually similar scene to the target image according to their scene correspondences, which assigns fluid orientation and speed automatically. Results show that our method is successful in preserving large fluid features in the synthesized animations. In comparison to existing approaches, it is both possible and useful to utilize our method to create flow animations with higher quality.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barrett, W.A., Cheney, A.S., 2002. Object-Based Image Editing. SIGGRAPH, p.777–784. [doi:10.1145/566570.566651]
Bhat, K.S., Seitz, S.M., Hodgins, J.K., Khosla, P.K., 2004. Flow-based video synthesis and editing. ACM Trans. Graph., 23(3):360–363. [doi:10.1145/1015706.1015729]
Brostow, G.J., Essa, I., 2001. Image-Based Motion Blur for Stop Motion Animation. SIGGRAPH, p.561–566. [doi:10.1145/383259.383325]
Brox, T., Malik, J., 2011. Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans. Pattern Anal. Mach. Intell., 33(3):500–513. [doi:10.1109/TPAMI.2010.143]
Brox, T., Bruhn, A., Papenberg, N., Weickert, J., 2004. High Accuracy Optical Flow Estimation Based on a Theory for Warping. 8th European Conf. on Computer Vision, p.25–36.
Chuang, Y.Y., Goldman, D.B., Zheng, K.C., Curless, B., Salesin, D.H., Szeliski, R., 2005. Animating pictures with stochastic motion textures. ACM Trans. Graph., 24(3):853–860. [doi:10.1145/1073204.1073273]
Corpetti, T., Memin, E., Perez, P., 2002. Dense estimation of fluid flows. IEEE Trans. Pattern Anal. Mach. Intell., 24(3):365–380. [doi:10.1109/34.990137]
Courty, N., Corpetti, T., 2007. Crowd motion capture. Comput. Anim. Virt. Worlds, 18(4–5):361–370. [doi:10.1002/cav.199]
Doretto, G., Chiuso, A., Wu, Y.N., Soatto, S., 2003. Dynamic textures. Int. J. Comput. Vis., 51(2):91–109. [doi:10.1023/A:1021669406132]
Freeman, W.T., Adelson, E.H., Heeger, D.J., 1991. Motion without Movement. SIGGRAPH, p.27–30. [doi:10.1145/122718.122721]
Heeger, D.J., Bergen, J.R., 1995. Pyramid-Based Texture Analysis/Synthesis. SIGGRAPH, p.229–238. [doi:10.1145/218380.218446]
Igarashi, T., Moscovich, T., Hughes, J.F., 2005. As-Rigidas-Possible Shape Manipulation. SIGGRAPH, p.1134–1141. [doi:10.1145/1186822.1073323]
Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A., 2003. Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph., 22(3):277–286. [doi:10.1145/882262.882264]
Levin, A., Lischinski, D., Weiss, Y., 2008. A closed-form solution to natural image matting. IEEE Trans. Pattern Anal. Mach. Intell., 30(2):228–242. [doi:10.1109/TPAMI.2007.1177]
Lin, Z., Wang, L., Wang, Y., Kang, S.B., Fang, T., 2007. High resolution animated scenes from stills. IEEE Trans. Visual. Comput. Graph., 13(3):562–568. [doi:10.1109/TVCG.2007.1005]
Litwinowicz, P., Williams, L., 1994. Animating Images with Drawings. SIGGRAPH, p.409–412. [doi:10.1145/192161.192270]
Liu, C., Yuen, J., Torralba, A., Sivic, J., Freeman, W.T., 2008. SIFT flow: dense correspondence across different scenes. LNCS, 5304:28–42. [doi:10.1007/978-3-540-88690-7_3]
Lowe, D.G., 2004. Distinctive image features from scaleinvariant keypoints. Int. J. Comput. Vis., 60(2):91–110. [doi:10.1023/B:VISI.0000029664.99615.94]
Lucas, B.D., Kanade, T., 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. Int. Joint Conf. on Artificial Intelligence, p.674–679.
Okabe, M., Anjyo, K., Igarashi, T., Seidel, H.P., 2009. Animating pictures of fluid using video examples. Comput. Graph. Forum, 28(2):677–686. [doi:10.1111/j.1467-8659.2009.01408.x]
Okabe, M., Anjyo, K., Onai, R., 2011. Creating fluid animation from a single image using video database. Comput. Graph. Forum, 30(7):1973–1982. [doi:10.1111/j.1467-8659.2011.02062.x]
Rubinstein, M., Shamir, A., Avidan, S., 2008. Improved seam carving for video retargeting. ACM Trans. Graph., 27(3), Article No. 16, p.1–9. [doi:10.1145/1360612.1360615]
Schodl, A., Szeliski, R., Salesin, D.H., Essa, I., 2000. Video Textures. SIGGRAPH, p.489–498. [doi:10.1145/344779.345012]
Shinya, M., Aoki, M., Tsutsuguchi, K., Kotani, N., 1999. Dynamic Texture: Physically Based 2D Animation. SIGGRAPH, p.239. [doi:10.1145/311625.312130]
Sun, M., Jepson, A.D., Fiume, E., 2003. Video Input Driven Animation (VIDA). Proc. 9th IEEE Int. Conf. on Computer Vision, p.96–103. [doi:10.1109/ICCV.2003.1238319]
Treuille, A., McNamara, A., Popovc, C., Stam, J., 2003. Keyframe control of smoke simulations. ACM Trans. Graph., 22(3):716–723. [doi:10.1145/882262.882337]
Wang, Y., Zhu, S.C., 2003. Modeling Textured Motion: Particle, Wave and Sketch. Proc. 9th IEEE Int. Conf. on Computer Vision, p.213–220. [doi:10.1109/ICCV.2003.1238343]
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Basic Research Program (973) of China (No. 2011CB302203) and the Innovation Program of the Science and Technology Commission of Shanghai Municipality, China (No. 10511501200)
Rights and permissions
About this article
Cite this article
Gui, Y., Ma, Lz., Yin, C. et al. Preserving global features of fluid animation from a single image using video examples. J. Zhejiang Univ. - Sci. C 13, 510–519 (2012). https://doi.org/10.1631/jzus.C1100342
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C1100342