research-article

Stochastic Substitute Trees for Real-Time Global Illumination

Authors:

Wolfgang Tatzgern,

Bernhard Kerbl,

Markus SteinbergerAuthors Info & Claims

I3D '20: Symposium on Interactive 3D Graphics and Games

Article No.: 2, Pages 1 - 9

https://doi.org/10.1145/3384382.3384521

Published: 05 May 2020 Publication History

Abstract

With the introduction of hardware-supported ray tracing and deep learning for denoising, computer graphics has made a considerable step toward real-time global illumination. In this work, we present an alternative global illumination method: The stochastic substitute tree (SST), a hierarchical structure inspired by lightcuts with light probability distributions as inner nodes. Our approach distributes virtual point lights (VPLs) in every frame and efficiently constructs the SST over those lights by clustering according to Morton codes. Global illumination is approximated by sampling the SST and considers the BRDF at the hit location as well as the SST nodes’ intensities for importance sampling directly from inner nodes of the tree. To remove the introduced Monte Carlo noise, we use a recurrent autoencoder. In combination with temporal filtering, we deliver real-time global illumination for complex scenes with challenging light distributions.

Supplementary Material

a2-tatzgern-supplement (sst_video.mp4)

SST video

Download
185.20 MB

References

[1]

Timo Aila and Samuli Laine. 2009. Understanding the Efficiency of Ray Traversal on GPUs. In Proceedings of the Conference on High Performance Graphics 2009(HPG ’09). ACM, New York, NY, USA, 145–149. https://doi.org/10.1145/1572769.1572792

Digital Library

[2]

Nir Benty, Kai-Hwa Yao, Lucy Chen, Tim Foley, Matthew Oakes, Conor Lavelle, and Chris Wyman. 2019. The Falcor Rendering Framework. https://github.com/NVIDIAGameWorks/Falcor https://github.com/NVIDIAGameWorks/Falcor.

[3]

Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive Reconstruction of Monte Carlo Image Sequences Using a Recurrent Denoising Autoencoder. ACM Trans. Graph. 36, 4, Article 98 (July 2017), 12 pages. https://doi.org/10.1145/3072959.3073601

Digital Library

[4]

R. L. Cook and K. E. Torrance. 1982. A Reflectance Model for Computer Graphics. ACM Trans. Graph. 1, 1 (Jan. 1982), 7–24. https://doi.org/10.1145/357290.357293

Digital Library

[5]

Carsten Dachsbacher, Jaroslav Křivánek, Miloš Hašan, Adam Arbree, Bruce Walter, and Jan Novák. 2014. Scalable Realistic Rendering with Many-Light Methods. Comput. Graph. Forum 33, 1 (Feb. 2014), 88–104. https://doi.org/10.1111/cgf.12256

Digital Library

[6]

Holger Dammertz, Daniel Sewtz, Johannes Hanika, and Hendrik P. A. Lensch. 2010. Edge-avoiding À-Trous Wavelet Transform for Fast Global Illumination Filtering. In Proceedings of the Conference on High Performance Graphics(HPG ’10). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 67–75. http://dl.acm.org/citation.cfm?id=1921479.1921491

[7]

Michael Deering, Stephanie Winner, Bic Schediwy, Chris Duffy, and Neil Hunt. 1988. The Triangle Processor and Normal Vector Shader: A VLSI System for High Performance Graphics. SIGGRAPH Comput. Graph. 22, 4 (June 1988), 21–30. https://doi.org/10.1145/378456.378468

Digital Library

[8]

Eric Haines and Tomas Akenine-Moller. 2019. Ray Tracing Gems: High-Quality and Real-Time Rendering with DXR and Other APIs. Apress, Berkely, CA, USA.

[9]

Miloš Hašan, Jaroslav Křivánek, Bruce Walter, and Kavita Bala. 2009. Virtual Spherical Lights for Many-Light Rendering of Glossy Scenes. In ACM SIGGRAPH Asia 2009 Papers(SIGGRAPH Asia ’09). Association for Computing Machinery, New York, NY, USA, Article Article 143, 6 pages. https://doi.org/10.1145/1661412.1618489

Digital Library

[10]

Miloš Hašan, Fabio Pellacini, and Kavita Bala. 2007. Matrix Row-column Sampling for the Many-light Problem. ACM Trans. Graph. 26, 3, Article 26 (July 2007). https://doi.org/10.1145/1276377.1276410

Digital Library

[11]

Yuchi Huo, Rui Wang, Shihao Jin, Xinguo Liu, and Hujun Bao. 2015. A Matrix Sampling-and-recovery Approach for Many-lights Rendering. ACM Trans. Graph. 34, 6, Article 210 (Oct. 2015), 12 pages. https://doi.org/10.1145/2816795.2818120

Digital Library

[12]

Henrik Wann Jensen. 1996. Global Illumination Using Photon Maps. In Proceedings of the Eurographics Workshop on Rendering Techniques ’96. Springer-Verlag, London, UK, UK, 21–30. http://dl.acm.org/citation.cfm?id=275458.275461

[13]

James T. Kajiya. 1986. The Rendering Equation. SIGGRAPH Comput. Graph. 20, 4 (Aug. 1986), 143–150. https://doi.org/10.1145/15886.15902

Digital Library

[14]

Tero Karras. 2012. Maximizing Parallelism in the Construction of BVHs, Octrees, and K-d Trees. In Proceedings of the Fourth ACM SIGGRAPH / Eurographics Conference on High-Performance Graphics(EGGH-HPG’12). Eurographics Association, Goslar Germany, Germany, 33–37. https://doi.org/10.2312/EGGH/HPG12/033-037

[15]

Alexander Keller. 1997. Instant Radiosity. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 49–56. https://doi.org/10.1145/258734.258769

Digital Library

[16]

Alexander Keller, Timo Viitanen, Colin Barré-Brisebois, Christoph Schied, and Morgan McGuire. 2019. Are We Done with Ray Tracing?. In ACM SIGGRAPH 2019 Courses(SIGGRAPH ’19). ACM, New York, NY, USA, Article 3, 381 pages. https://doi.org/10.1145/3305366.3329896

Digital Library

[17]

Tzu-Mao Li, Yu-Ting Wu, and Yung-Yu Chuang. 2012. SURE-based Optimization for Adaptive Sampling and Reconstruction. ACM Trans. Graph. 31, 6, Article 194 (Nov. 2012), 9 pages. https://doi.org/10.1145/2366145.2366213

Digital Library

[18]

Daqi Lin and Cem Yuksel. 2019. Real-Time Rendering with Lighting Grid Hierarchy. Proc. ACM Comput. Graph. Interact. Tech. (Proceedings of I3D 2019) 2, 1, Article 8 (2019), 17 pages. https://doi.org/10.1145/3321361

Digital Library

[19]

Morgan McGuire. 2017. Computer Graphics Archive. https://casual-effects.com/data https://casual-effects.com/data.

[20]

NVIDIA Corporation. 2018. NVIDIA Turing GPU Architecture. https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdf

[21]

Jiawei Ou and Fabio Pellacini. 2011. LightSlice: Matrix Slice Sampling for the Many-lights Problem. ACM Trans. Graph. 30, 6, Article 179 (Dec. 2011), 8 pages. https://doi.org/10.1145/2070781.2024213

Digital Library

[22]

Roman Prutkin, Anton Kaplanyan, and Carsten Dachsbacher. 2012. Reflective Shadow Map Clustering for Real-Time Global Illumination. (2012).

[23]

Hauke Rehfeld and Carsten Dachsbacher. 2016. Lightcut Interpolation. In Proceedings of High Performance Graphics(HPG ’16). Eurographics Association, Goslar, DEU, 99–108.

[24]

T. Ritschel, T. Grosch, M. H. Kim, H.-P. Seidel, C. Dachsbacher, and J. Kautz. 2008. Imperfect Shadow Maps for Efficient Computation of Indirect Illumination. ACM Trans. Graph. 27, 5, Article 129 (Dec. 2008), 8 pages. https://doi.org/10.1145/1409060.1409082

Digital Library

[25]

Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, and Marco Salvi. 2017. Spatiotemporal Variance-guided Filtering: Real-time Reconstruction for Path-traced Global Illumination. In Proceedings of High Performance Graphics(HPG ’17). ACM, New York, NY, USA, Article 2, 12 pages. https://doi.org/10.1145/3105762.3105770

Digital Library

[26]

Christoph Schied, Christoph Peters, and Carsten Dachsbacher. 2018. Gradient Estimation for Real-time Adaptive Temporal Filtering. Proc. ACM Comput. Graph. Interact. Tech. 1, 2, Article 24 (Aug. 2018), 16 pages. https://doi.org/10.1145/3233301

Digital Library

[27]

B. Segovia, J.C. Iehl, and B. Peroche. 2007. Metropolis Instant Radiosity. Computer Graphics Forum(2007). https://doi.org/10.1111/j.1467-8659.2007.01065.x

[28]

Florian Simon, Johannes Hanika, and Carsten Dachsbacher. 2015. Rich-VPLs for Improving the Versatility of Many-Light Methods. Comput. Graph. Forum 34, 2 (May 2015), 575–584. https://doi.org/10.1111/cgf.12585

Digital Library

[29]

Gabriel Taubin and Jarek Rossignac. 1998. Geometric Compression Through Topological Surgery. ACM Trans. Graph. 17, 2 (April 1998), 84–115. https://doi.org/10.1145/274363.274365

Digital Library

[30]

Yusuke Tokuyoshi and Takahiro Harada. 2016. Stochastic Light Culling. Journal of Computer Graphics Techniques (JCGT) 5, 1 (March 2016), 35–60. http://jcgt.org/published/0005/01/02/

[31]

Eric Veach and Leonidas J. Guibas. 1997. Metropolis Light Transport. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 65–76. https://doi.org/10.1145/258734.258775

Digital Library

[32]

Bruce Walter, Adam Arbree, Kavita Bala, and Donald P. Greenberg. 2006. Multidimensional Lightcuts. ACM Trans. Graph. 25, 3 (July 2006), 1081–1088. https://doi.org/10.1145/1141911.1141997

Digital Library

[33]

Bruce Walter, Sebastian Fernandez, Adam Arbree, Kavita Bala, Michael Donikian, and Donald P. Greenberg. 2005. Lightcuts: A Scalable Approach to Illumination. ACM Trans. Graph. 24, 3 (July 2005), 1098–1107. https://doi.org/10.1145/1073204.1073318

Digital Library

[34]

Cem Yuksel. 2019. Stochastic Lightcuts. In High-Performance Graphics (HPG 2019). The Eurographics Association. https://doi.org/10.2312/hpg.20191192

Digital Library

Cited By

Colom AMarques RSantos L(2022)Interactive VPL-based global illumination on the GPU using fuzzy clusteringComputers and Graphics10.1016/j.cag.2022.09.008108:C(74-85)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.09.008
Zeng ZLiu SYang JWang LYan L(2021)Temporally Reliable Motion Vectors for Real‐time Ray TracingComputer Graphics Forum10.1111/cgf.14261640:2(79-90)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142616

Recommendations

Precomputed illuminance composition for real-time global illumination
I3D '16: Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

In this paper we present a new real-time approach for indirect global illumination under dynamic lighting conditions. We use surfels to gather a sampling of the local illumination and propagate the light through the scene using a hierarchy and a set of ...
Clustered voxel real-time global illumination
Abstract
Real-time global illumination is an extremely challenging problem because of its intrinsic complexity due to the interplay between complex geometry, multiple light bounces, and stringent real-time frame-rate requirements. In this paper,...
Graphical abstract

Display Omitted
Highlights
- Adaptation of GPU clustering techniques to voxels, using normals for the clusters.
Ray tracing-based interactive diffuse indirect illumination

Despite great efforts in recent years to accelerate global illumination computation, the real-time ray tracing of fully dynamic scenes to support photorealistic indirect illumination effects has yet to be achieved in computer graphics. In this paper, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '20: Symposium on Interactive 3D Graphics and Games

May 2020

156 pages

ISBN:9781450375894

DOI:10.1145/3384382

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Austrian Science Fund
German Research Foundation

Conference

I3D '20

Sponsor:

SIGGRAPH

I3D '20: Symposium on Interactive 3D Graphics and Games

May 5 - 7, 2020

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Upcoming Conference

I3D '25

Sponsor:
siggraph

Symposium on Interactive 3D Graphics and Games

May 7 - 9, 2025

Jersey City , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
766
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)2

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Colom AMarques RSantos L(2022)Interactive VPL-based global illumination on the GPU using fuzzy clusteringComputers and Graphics10.1016/j.cag.2022.09.008108:C(74-85)Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.09.008
Zeng ZLiu SYang JWang LYan L(2021)Temporally Reliable Motion Vectors for Real‐time Ray TracingComputer Graphics Forum10.1111/cgf.14261640:2(79-90)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142616

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten