skip to main content
10.1145/3450623.3464631acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
invited-talk

Towards Large-Scale Super Resolution Datasets via Learned Downsampling of Ray-Traced Renderings

Published: 06 August 2021 Publication History

Abstract

Delivering high resolution content is a challenge in the film and games industries due to the cost of photorealistic ray-traced rendering. Image upscaling techniques are commonly used to obtain a high resolution result from a low resolution render. Recently, deep learned upscaling has started to make an impact in production settings, synthesizing sharper and more detailed imagery than previous methods. The quality of a super resolution model depends on the size of its dataset, which can be expensive to generate at scale due to the large number of ray-traced pairs of renders required. In this report, we discuss our experiments training an additional neural network to learn the degradation operator, which can be used to rapidly generate low resolution images from existing high resolution renders. Our testing on production scenes shows that super resolution networks trained with a large synthetic dataset produce fewer artifacts and better reconstruction quality than networks trained on a smaller rendered dataset alone, and compare favorably to recent state of the art blind synthetic data techniques.

References

[1]
Victor Cornillere, Abdelaziz Djelouah, Wang Yifan, Olga Sorkine-Hornung, and Christopher Schroers. 2019. Blind image super-resolution with spatially variant degradations. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1–13.
[2]
Vaibhav Vavilala and Mark Meyer. 2020. Deep Learned Super Resolution for Feature Film Production. In ACM SIGGRAPH 2020 Talks(SIGGRAPH ’20). Association for Computing Machinery, New York, NY, USA, Article 41, 2 pages. https://doi.org/10.1145/3388767.3407334
[3]
Yifan Wang, Federico Perazzi, Brian McWilliams, Alexander Sorkine-Hornung, Olga Sorkine-Hornung, and Christopher Schroers. 2018. A fully progressive approach to single-image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 864–873.

Cited By

View all
  • (2024)MV2MV: Multi-View Image Translation via View-Consistent Diffusion ModelsACM Transactions on Graphics10.1145/368797743:6(1-12)Online publication date: 19-Nov-2024
  1. Towards Large-Scale Super Resolution Datasets via Learned Downsampling of Ray-Traced Renderings

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGGRAPH '21: ACM SIGGRAPH 2021 Talks
    July 2021
    116 pages
    ISBN:9781450383738
    DOI:10.1145/3450623
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 August 2021

    Check for updates

    Qualifiers

    • Invited-talk
    • Research
    • Refereed limited

    Conference

    SIGGRAPH '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)MV2MV: Multi-View Image Translation via View-Consistent Diffusion ModelsACM Transactions on Graphics10.1145/368797743:6(1-12)Online publication date: 19-Nov-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media