skip to main content
research-article

LazyFluids: appearance transfer for fluid animations

Published: 27 July 2015 Publication History

Abstract

In this paper we present a novel approach to appearance transfer for fluid animations based on flow-guided texture synthesis. In contrast to common practice where pre-captured sets of fluid elements are combined in order to achieve desired motion and look, we bring the possibility of fine-tuning motion properties in advance using CG techniques, and then transferring the desired look from a selected appearance exemplar. We demonstrate that such a practical work-flow cannot be simply implemented using current state-of-the-art techniques, analyze what the main obstacles are, and propose a solution to resolve them. In addition, we extend the algorithm to allow for synthesis with rich boundary effects and video exemplars. Finally, we present numerous results that demonstrate the versatility of the proposed approach.

Supplementary Material

ZIP File (a92-jamriska.zip)
Supplemental files
MP4 File (a92.mp4)

References

[1]
Bargteil, A. W., Sin, F., Michaels, J. E., Goktekin, T., and O'Brien, J. F. 2006. A texture synthesis method for liquid animations. In Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 345--351.
[2]
Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics 28, 3, 24.
[3]
Barnes, C., Shechtman, E., Goldman, D. B., and Finkelstein, A. 2010. The generalized PatchMatch correspondence algorithm. In Proceedings of European Conference on Computer Vision, 29--43.
[4]
Bénard, P., Cole, F., Kass, M., Mordatch, I., Hegarty, J., Senn, M. S., Fleischer, K., Pesare, D., and Breeden, K. 2013. Stylizing animation by example. ACM Transactions on Graphics 32, 4, 119.
[5]
Bhat, K. S., Seitz, S. M., Hodgins, J. K., and Khosla, P. K. 2004. Flow-based video synthesis and editing. ACM Transactions on Graphics 23, 3, 360--363.
[6]
Bousseau, A., Neyret, F., Thollot, J., and Salesin, D. 2007. Video watercolorization using bidirectional texture advection. ACM Transactions on Graphics 26, 3, 104.
[7]
Browning, M., Barnes, C., Ritter, S., and Finkelstein, A. 2014. Stylized keyframe animation of fluid simulations. In Proceedings of the Workshop on Non-Photorealistic Animation and Rendering, 63--70.
[8]
Chen, J., and Wang, B. 2010. High quality solid texture synthesis using position and index histogram matching. The Visual Computer 26, 4, 253--262.
[9]
Darabi, S., Shechtman, E., Barnes, C., Goldman, D. B., and Sen, P. 2012. Image melding: Combining inconsistent images using patch-based synthesis. ACM Transactions on Graphics 31, 4, 82.
[10]
Han, J., Zhou, K., Wei, L.-Y., Gong, M., Bao, H., Zhang, X., and Guo, B. 2006. Fast example-based surface texture synthesis via discrete optimization. The Visual Computer 22, 9--11, 918--925.
[11]
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. In Proceedings of SIGGRAPH 2001, 327--340.
[12]
Kaspar, A., Neubert, B., Lischinski, D., Pauly, M., and Kopf, J. 2015. Self tuning texture optimization. Computer Graphics Forum 34, 2, 349--360.
[13]
Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. ACM Transactions on Graphics 26, 3, 2.
[14]
Kwatra, V., Schödl, A., Essa, I. A., Turk, G., and Bobick, A. F. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.
[15]
Kwatra, V., Essa, I. A., Bobick, A. F., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Transactions on Graphics 24, 3, 795--802.
[16]
Kwatra, V., Adalsteinsson, D., Kim, T., Kwatra, N., Carlson, M., and Lin, M. C. 2007. Texturing fluids. IEEE Transactions on Visualization and Computer Graphics 13, 5, 939--952.
[17]
Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Transactions on Graphics 25, 3, 541--548.
[18]
Liao, Z., Joshi, N., and Hoppe, H. 2013. Automated video looping with progressive dynamism. ACM Transactions on Graphics 32, 4, 77.
[19]
Lukáč, M., Fišer, J., Bazin, J.-C., Jamriška, O., Sorkine-Hornung, A., and Sýkora, D. 2013. Painting by feature: Texture boundaries for example-based image creation. ACM Transaction on Graphics 32, 4, 116.
[20]
Max, N., Crawfis, R., and Williams, D. 1992. Visualizing wind velocities by advecting cloud textures. In Proceedings of IEEE Conference on Visualization, 179--183.
[21]
Narain, R., Kwatra, V., Lee, H.-P., Kim, T., Carlson, M., and Lin, M. C. 2007. Feature-guided dynamic texture synthesis on continuous flows. In Proceedings of Eurographics Symposium on Rendering, 361--370.
[22]
Newson, A., Almansa, A., Fradet, M., Gousseau, Y., and Pérez, P. 2014. Video inpainting of complex scenes. SIAM Journal of Imaging Science 7, 4, 1993--2019.
[23]
Neyret, F. 2003. Advected textures. In Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 147--153.
[24]
Perlin, K. 1985. An image synthesizer. SIGGRAPH Comput. Graph. 19, 3, 287--296.
[25]
Reeves, W. T. 1983. Particle systems---a technique for modeling a class of fuzzy objects. ACM Transactions on Graphics 2, 2, 91--108.
[26]
Rosenberger, A., Cohen-Or, D., and Lischinski, D. 2009. Layered shape synthesis: Automatic generation of control maps for non-stationary textures. ACM Transactions on Graphics 28, 5, 107.
[27]
Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In SIGGRAPH Conference Proceedings, 489--498.
[28]
Shechtman, E., Rav-Acha, A., Irani, M., and Seitz, S. M. 2010. Regenerative morphing. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 615--622.
[29]
Simakov, D., Caspi, Y., Shechtman, E., and Irani, M. 2008. Summarizing visual data using bidirectional similarity. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.
[30]
Stam, J. 1999. Stable fluids. In SIGGRAPH Conference Proceedings, 121--128.
[31]
Wei, L.-Y., Han, J., Zhou, K., Bao, H., Guo, B., and Shum, H.-Y. 2008. Inverse texture synthesis. ACM Transactions on Graphics 27, 3.
[32]
Wexler, Y., Shechtman, E., and Irani, M. 2007. Space-time completion of video. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 3, 463--476.
[33]
Yu, Q., Neyret, F., Bruneton, E., and Holzschuch, N. 2011. Lagrangian texture advection: Preserving both spectrum and velocity field. IEEE Transactions on Visualization and Computer Graphics 17, 11, 1612--1623.

Cited By

View all
  • (2024)Efficient high-resolution template matching with vector quantized nearest neighbour fieldsPattern Recognition10.1016/j.patcog.2024.110386(110386)Online publication date: Feb-2024
  • (2024)Physics-based fluid simulation in computer graphics: Survey, research trends, and challengesComputational Visual Media10.1007/s41095-023-0368-y10:5(803-858)Online publication date: 27-Apr-2024
  • (2023)Portrait stylized rendering for 3D light-field display based on radiation field and example guideOptics Express10.1364/OE.49487031:18(29664)Online publication date: 22-Aug-2023
  • Show More Cited By

Index Terms

  1. LazyFluids: appearance transfer for fluid animations

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Graphics
      ACM Transactions on Graphics  Volume 34, Issue 4
      August 2015
      1307 pages
      ISSN:0730-0301
      EISSN:1557-7368
      DOI:10.1145/2809654
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 27 July 2015
      Published in TOG Volume 34, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. coherency
      2. example-based
      3. flow-guided
      4. fluid simulation
      5. temporal
      6. texture synthesis

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)38
      • Downloads (Last 6 weeks)2
      Reflects downloads up to 16 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Efficient high-resolution template matching with vector quantized nearest neighbour fieldsPattern Recognition10.1016/j.patcog.2024.110386(110386)Online publication date: Feb-2024
      • (2024)Physics-based fluid simulation in computer graphics: Survey, research trends, and challengesComputational Visual Media10.1007/s41095-023-0368-y10:5(803-858)Online publication date: 27-Apr-2024
      • (2023)Portrait stylized rendering for 3D light-field display based on radiation field and example guideOptics Express10.1364/OE.49487031:18(29664)Online publication date: 22-Aug-2023
      • (2023)Physics‐Informed Neural Corrector for Deformation‐based Fluid ControlComputer Graphics Forum10.1111/cgf.1475142:2(161-173)Online publication date: 23-May-2023
      • (2022)StyleBin: Stylizing Video by Example in StereoSIGGRAPH Asia 2022 Conference Papers10.1145/3550469.3555420(1-8)Online publication date: 29-Nov-2022
      • (2022)GAD: A Global-Aware Diversity-Based Template Matching MethodIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2021.313432671(1-13)Online publication date: 2022
      • (2022)Generating Natural Images with Direct Patch Distributions MatchingComputer Vision – ECCV 202210.1007/978-3-031-19790-1_33(544-560)Online publication date: 23-Oct-2022
      • (2022)Diverse Generation from a Single Video Made PossibleComputer Vision – ECCV 202210.1007/978-3-031-19790-1_30(491-509)Online publication date: 23-Oct-2022
      • (2021)Reliable Template Matching for Image Detection in Vision Sensor SystemsSensors10.3390/s2124817621:24(8176)Online publication date: 7-Dec-2021
      • (2021)FaceBlitProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/34512704:1(1-17)Online publication date: 28-Apr-2021
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media