Wolfgang Tatzgern
ABSTRACT
With the introduction of hardware-supported ray tracing and deep learning for denoising, computer graphics has made a considerable step toward real-time global illumination. In this work, we present an alternative global illumination method: The stochastic substitute tree (SST), a hierarchical structure inspired by lightcuts with light probability distributions as inner nodes. Our approach distributes virtual point lights (VPLs) in every frame and efficiently constructs the SST over those lights by clustering according to Morton codes. Global illumination is approximated by sampling the SST and considers the BRDF at the hit location as well as the SST nodes’ intensities for importance sampling directly from inner nodes of the tree. To remove the introduced Monte Carlo noise, we use a recurrent autoencoder. In combination with temporal filtering, we deliver real-time global illumination for complex scenes with challenging light distributions.
Supplemental Material
- Timo Aila and Samuli Laine. 2009. Understanding the Efficiency of Ray Traversal on GPUs. In Proceedings of the Conference on High Performance Graphics 2009(HPG ’09). ACM, New York, NY, USA, 145–149. https://doi.org/10.1145/1572769.1572792Google Scholar
Digital Library
- Nir Benty, Kai-Hwa Yao, Lucy Chen, Tim Foley, Matthew Oakes, Conor Lavelle, and Chris Wyman. 2019. The Falcor Rendering Framework. https://github.com/NVIDIAGameWorks/Falcor https://github.com/NVIDIAGameWorks/Falcor.Google Scholar
- Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive Reconstruction of Monte Carlo Image Sequences Using a Recurrent Denoising Autoencoder. ACM Trans. Graph. 36, 4, Article 98 (July 2017), 12 pages. https://doi.org/10.1145/3072959.3073601Google ScholarDigital Library
- R. L. Cook and K. E. Torrance. 1982. A Reflectance Model for Computer Graphics. ACM Trans. Graph. 1, 1 (Jan. 1982), 7–24. https://doi.org/10.1145/357290.357293Google ScholarDigital Library
- Carsten Dachsbacher, Jaroslav Křivánek, Miloš Hašan, Adam Arbree, Bruce Walter, and Jan Novák. 2014. Scalable Realistic Rendering with Many-Light Methods. Comput. Graph. Forum 33, 1 (Feb. 2014), 88–104. https://doi.org/10.1111/cgf.12256Google ScholarDigital Library
- Holger Dammertz, Daniel Sewtz, Johannes Hanika, and Hendrik P. A. Lensch. 2010. Edge-avoiding À-Trous Wavelet Transform for Fast Global Illumination Filtering. In Proceedings of the Conference on High Performance Graphics(HPG ’10). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 67–75. http://dl.acm.org/citation.cfm?id=1921479.1921491Google Scholar
- Michael Deering, Stephanie Winner, Bic Schediwy, Chris Duffy, and Neil Hunt. 1988. The Triangle Processor and Normal Vector Shader: A VLSI System for High Performance Graphics. SIGGRAPH Comput. Graph. 22, 4 (June 1988), 21–30. https://doi.org/10.1145/378456.378468Google ScholarDigital Library
- Eric Haines and Tomas Akenine-Moller. 2019. Ray Tracing Gems: High-Quality and Real-Time Rendering with DXR and Other APIs. Apress, Berkely, CA, USA.Google Scholar
- Miloš Hašan, Jaroslav Křivánek, Bruce Walter, and Kavita Bala. 2009. Virtual Spherical Lights for Many-Light Rendering of Glossy Scenes. In ACM SIGGRAPH Asia 2009 Papers(SIGGRAPH Asia ’09). Association for Computing Machinery, New York, NY, USA, Article Article 143, 6 pages. https://doi.org/10.1145/1661412.1618489Google ScholarDigital Library
- Miloš Hašan, Fabio Pellacini, and Kavita Bala. 2007. Matrix Row-column Sampling for the Many-light Problem. ACM Trans. Graph. 26, 3, Article 26 (July 2007). https://doi.org/10.1145/1276377.1276410Google ScholarDigital Library
- Yuchi Huo, Rui Wang, Shihao Jin, Xinguo Liu, and Hujun Bao. 2015. A Matrix Sampling-and-recovery Approach for Many-lights Rendering. ACM Trans. Graph. 34, 6, Article 210 (Oct. 2015), 12 pages. https://doi.org/10.1145/2816795.2818120Google ScholarDigital Library
- Henrik Wann Jensen. 1996. Global Illumination Using Photon Maps. In Proceedings of the Eurographics Workshop on Rendering Techniques ’96. Springer-Verlag, London, UK, UK, 21–30. http://dl.acm.org/citation.cfm?id=275458.275461Google ScholarDigital Library
- James T. Kajiya. 1986. The Rendering Equation. SIGGRAPH Comput. Graph. 20, 4 (Aug. 1986), 143–150. https://doi.org/10.1145/15886.15902Google ScholarDigital Library
- Tero Karras. 2012. Maximizing Parallelism in the Construction of BVHs, Octrees, and K-d Trees. In Proceedings of the Fourth ACM SIGGRAPH / Eurographics Conference on High-Performance Graphics(EGGH-HPG’12). Eurographics Association, Goslar Germany, Germany, 33–37. https://doi.org/10.2312/EGGH/HPG12/033-037Google ScholarCross Ref
- Alexander Keller. 1997. Instant Radiosity. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 49–56. https://doi.org/10.1145/258734.258769Google ScholarDigital Library
- Alexander Keller, Timo Viitanen, Colin Barré-Brisebois, Christoph Schied, and Morgan McGuire. 2019. Are We Done with Ray Tracing?. In ACM SIGGRAPH 2019 Courses(SIGGRAPH ’19). ACM, New York, NY, USA, Article 3, 381 pages. https://doi.org/10.1145/3305366.3329896Google ScholarDigital Library
- Tzu-Mao Li, Yu-Ting Wu, and Yung-Yu Chuang. 2012. SURE-based Optimization for Adaptive Sampling and Reconstruction. ACM Trans. Graph. 31, 6, Article 194 (Nov. 2012), 9 pages. https://doi.org/10.1145/2366145.2366213Google ScholarDigital Library
- Daqi Lin and Cem Yuksel. 2019. Real-Time Rendering with Lighting Grid Hierarchy. Proc. ACM Comput. Graph. Interact. Tech. (Proceedings of I3D 2019) 2, 1, Article 8 (2019), 17 pages. https://doi.org/10.1145/3321361Google ScholarDigital Library
- Morgan McGuire. 2017. Computer Graphics Archive. https://casual-effects.com/data https://casual-effects.com/data.Google Scholar
- NVIDIA Corporation. 2018. NVIDIA Turing GPU Architecture. https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/technologies/turing-architecture/NVIDIA-Turing-Architecture-Whitepaper.pdfGoogle Scholar
- Jiawei Ou and Fabio Pellacini. 2011. LightSlice: Matrix Slice Sampling for the Many-lights Problem. ACM Trans. Graph. 30, 6, Article 179 (Dec. 2011), 8 pages. https://doi.org/10.1145/2070781.2024213Google ScholarDigital Library
- Roman Prutkin, Anton Kaplanyan, and Carsten Dachsbacher. 2012. Reflective Shadow Map Clustering for Real-Time Global Illumination. (2012).Google Scholar
- Hauke Rehfeld and Carsten Dachsbacher. 2016. Lightcut Interpolation. In Proceedings of High Performance Graphics(HPG ’16). Eurographics Association, Goslar, DEU, 99–108.Google Scholar
- T. Ritschel, T. Grosch, M. H. Kim, H.-P. Seidel, C. Dachsbacher, and J. Kautz. 2008. Imperfect Shadow Maps for Efficient Computation of Indirect Illumination. ACM Trans. Graph. 27, 5, Article 129 (Dec. 2008), 8 pages. https://doi.org/10.1145/1409060.1409082Google ScholarDigital Library
- Christoph Schied, Anton Kaplanyan, Chris Wyman, Anjul Patney, Chakravarty R. Alla Chaitanya, John Burgess, Shiqiu Liu, Carsten Dachsbacher, Aaron Lefohn, and Marco Salvi. 2017. Spatiotemporal Variance-guided Filtering: Real-time Reconstruction for Path-traced Global Illumination. In Proceedings of High Performance Graphics(HPG ’17). ACM, New York, NY, USA, Article 2, 12 pages. https://doi.org/10.1145/3105762.3105770Google ScholarDigital Library
- Christoph Schied, Christoph Peters, and Carsten Dachsbacher. 2018. Gradient Estimation for Real-time Adaptive Temporal Filtering. Proc. ACM Comput. Graph. Interact. Tech. 1, 2, Article 24 (Aug. 2018), 16 pages. https://doi.org/10.1145/3233301Google ScholarDigital Library
- B. Segovia, J.C. Iehl, and B. Peroche. 2007. Metropolis Instant Radiosity. Computer Graphics Forum(2007). https://doi.org/10.1111/j.1467-8659.2007.01065.xGoogle Scholar
- Florian Simon, Johannes Hanika, and Carsten Dachsbacher. 2015. Rich-VPLs for Improving the Versatility of Many-Light Methods. Comput. Graph. Forum 34, 2 (May 2015), 575–584. https://doi.org/10.1111/cgf.12585Google ScholarDigital Library
- Gabriel Taubin and Jarek Rossignac. 1998. Geometric Compression Through Topological Surgery. ACM Trans. Graph. 17, 2 (April 1998), 84–115. https://doi.org/10.1145/274363.274365Google ScholarDigital Library
- Yusuke Tokuyoshi and Takahiro Harada. 2016. Stochastic Light Culling. Journal of Computer Graphics Techniques (JCGT) 5, 1 (March 2016), 35–60. http://jcgt.org/published/0005/01/02/Google Scholar
- Eric Veach and Leonidas J. Guibas. 1997. Metropolis Light Transport. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 65–76. https://doi.org/10.1145/258734.258775Google ScholarDigital Library
- Bruce Walter, Adam Arbree, Kavita Bala, and Donald P. Greenberg. 2006. Multidimensional Lightcuts. ACM Trans. Graph. 25, 3 (July 2006), 1081–1088. https://doi.org/10.1145/1141911.1141997Google ScholarDigital Library
- Bruce Walter, Sebastian Fernandez, Adam Arbree, Kavita Bala, Michael Donikian, and Donald P. Greenberg. 2005. Lightcuts: A Scalable Approach to Illumination. ACM Trans. Graph. 24, 3 (July 2005), 1098–1107. https://doi.org/10.1145/1073204.1073318Google ScholarDigital Library
- Cem Yuksel. 2019. Stochastic Lightcuts. In High-Performance Graphics (HPG 2019). The Eurographics Association. https://doi.org/10.2312/hpg.20191192Google ScholarDigital Library
Recommendations
Precomputed illuminance composition for real-time global illumination
I3D '16: Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and GamesIn this paper we present a new real-time approach for indirect global illumination under dynamic lighting conditions. We use surfels to gather a sampling of the local illumination and propagate the light through the scene using a hierarchy and a set of ...
Clustered voxel real-time global illumination
AbstractReal-time global illumination is an extremely challenging problem because of its intrinsic complexity due to the interplay between complex geometry, multiple light bounces, and stringent real-time frame-rate requirements. In this paper,...
Graphical abstractDisplay Omitted
Highlights- Adaptation of GPU clustering techniques to voxels, using normals for the clusters.
Ray tracing-based interactive diffuse indirect illumination
Despite great efforts in recent years to accelerate global illumination computation, the real-time ray tracing of fully dynamic scenes to support photorealistic indirect illumination effects has yet to be achieved in computer graphics. In this paper, we ...
Comments