skip to main content
10.1145/2370919.2370928acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Extracting fluid from a video for efficient post-production

Published: 04 August 2012 Publication History

Abstract

We propose a method to extract fluids from a video that is captured outside a special studio. Since such a video usually has a complex background and the fluids overlap with much transparency, it is a difficult, time-consuming task for a designer to extract them. Our goal is to develop an efficient method to solve the problem: we estimate the background of an input video, and then compute the foreground and alpha matte at each frame. Our method estimates the background by observing only pixels that have little motion at each frame. Given the estimated background, we estimate an initial alpha matte based on the color difference at every pixel between each frame and the estimated background. Since the initial alpha matte usually includes many artifacts, we employ the gradient-domain image processing approach to refine it: our method attenuates unrequired gradients adequately, and then integrate them to recover the refined alpha matte. The foreground, which explains about the color and texture pattern of the fluid itself, is also estimated in a similar manner. We demonstrate that our method enables to extract the fluids from a video, which were difficult to achieve using the previous methods.

References

[1]
Apostoloff, N. E., and Fitzgibbon, A. W. 2004. Bayesian video matting using learnt image priors. In Proc. of CVPR '04.
[2]
Chuang, Y.-Y., Agarwala, A., Curless, B., Salesin, D. H., and Szeliski, R. 2002. Video matting of complex scenes. 243--248.
[3]
Gastal, E. S. L., and Oliveira, M. M. 2010. Shared sampling for real-time alpha matting. Comput. Graph. Forum 29, 2, 575--584.
[4]
Ghanem, B., and Ahuja, N. 2008. Extracting a fluid dynamic texture and the background from video. In Proc. of CVPR '08, 1--8.
[5]
Levin, A., Rav-Acha, A., and Lischinski, D. 2008. Spectral matting. IEEE Trans. Pattern Anal. Mach. Intell. 30, 10, 1699--1712.
[6]
Lin, H. T., Tai, Y.-W., and Brown, M. S. 2011. Motion regularization for matting motion blurred objects. IEEE Trans. Pattern Anal. Mach. Intell. 33, 11, 2329--2336.
[7]
Péteri, R., Fazekas, S., and Huiskes, M. J. DynTex: a Comprehensive Database of Dynamic Textures. Pattern Recognition Letters. http://projects.cwi.nl/dyntex/.
[8]
Smith, A. R., and Blinn, J. F. 1996. Blue screen matting. In Proc. SIGGRAPH '96, 259--268.
[9]
Sun, J., Jia, J., Tang, C.-K., and Shum, H.-Y. 2004. Poisson matting. ACM Trans. Gr. 23, 3, 315--321.
[10]
Sun, J., Zhang, W., Tang, X., and Shum, H. Y. 2006. Background cut. In Europ. Conf. on Computer Vision, 628--641.
[11]
Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. In SIGGRAPH2006, 1135--1143.
[12]
Wang, J., and Cohen, M. F. 2007. Image and video matting: a survey. Found. Trends. Comput. Graph. Vis. 3, 2, 97--175.
[13]
Zach, C., Pock, T., and Bischof, H. 2007. A duality based approach for realtime tv-l1 optical flow. In Pattern Recognition (Proc. DAGM), 214--223.
[14]
Zhang, J., Li, L., Zhang, Y., Yang, G., Cao, X., and Sun, J. 2011. Video dehazing with spatial and temporal coherence. Vis. Comput. 27, 749--757.

Cited By

View all
  • (2021)Video‐Based Rendering of Dynamic Stationary Environments from Unsynchronized InputsComputer Graphics Forum10.1111/cgf.1434240:4(73-86)Online publication date: 15-Jul-2021
  • (2017)Dense Motion Estimation for SmokeComputer Vision – ACCV 201610.1007/978-3-319-54190-7_14(225-239)Online publication date: 12-Mar-2017
  • (2013)Synthesis of Fluid Animation Using Videos of Real Fluid PhenomenaJournal of the Japan Society for Precision Engineering10.2493/jjspe.79.48979:6(489-492)Online publication date: 2013

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DigiPro '12: Proceedings of the Digital Production Symposium
August 2012
80 pages
ISBN:9781450316491
DOI:10.1145/2370919
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. alpha matte
  2. fluid
  3. post-production
  4. video processing

Qualifiers

  • Research-article

Conference

DigiPro '12
Sponsor:
DigiPro '12: The Digital Production Symposium
August 4, 2012
California, Glendale

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Video‐Based Rendering of Dynamic Stationary Environments from Unsynchronized InputsComputer Graphics Forum10.1111/cgf.1434240:4(73-86)Online publication date: 15-Jul-2021
  • (2017)Dense Motion Estimation for SmokeComputer Vision – ACCV 201610.1007/978-3-319-54190-7_14(225-239)Online publication date: 12-Mar-2017
  • (2013)Synthesis of Fluid Animation Using Videos of Real Fluid PhenomenaJournal of the Japan Society for Precision Engineering10.2493/jjspe.79.48979:6(489-492)Online publication date: 2013

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media