skip to main content
10.1145/2947688.2947689acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
abstract

Large scale VFX pipelines

Published: 23 July 2016 Publication History

Abstract

To ensure peak utilization of hardware resources, as well as handle the increasingly dynamic demands placed on its render farm infrastructure, Weta Digital developed custom queuing, scheduling, job description and submission systems - which work in concert to maximize the available cores across a large range of non-uniform task types.
The render farm is one of the most important, high traffic components of a modern VFX pipeline. Beyond the hardware itself a render farm requires careful management and maintenance to ensure it is operating at peak efficiency. In Wetas case this hardware consists of a mix of over 80,000 CPU cores and a number of GPU resources, and as this has grown it has introduced many interesting scalability challenges.
In this talk we aim to present our end-to-end solutions in the render farm space, from the structure of the resource and the inherent problems introduced at this scale, through the development of Plow - our management, queuing and monitoring software, and Kenobi - our job description framework. Finally we will detail the deployment process and production benefits realized. Within each section we intend to present the scalability issues encountered, and detail our strategy, process and results in solving these problems.
The ever increasing complexity and computational demands of modern VFX drives Wetas need to innovate in all areas, from surfacing, rendering and simulation but also to core pipeline infrastructure.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DigiPro '16: Proceedings of the 2016 Symposium on Digital Production
July 2016
70 pages
ISBN:9781450344296
DOI:10.1145/2947688
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 July 2016

Check for updates

Author Tags

  1. distributed computing
  2. pipeline
  3. queuing
  4. scheduling

Qualifiers

  • Abstract

Conference

DigiPro '16
Sponsor:
DigiPro '16: The Digital Production Symposium
July 23, 2016
California, Anaheim

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 726
    Total Downloads
  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)1
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media