research-article

High-quality object-space dynamic ambient occlusion for characters using Bi-level regression

Authors:

Carlos Gonzalez-Ochoa,

JP LewisAuthors Info & Claims

I3D '19: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Article No.: 6, Pages 1 - 10

https://doi.org/10.1145/3306131.3317029

Published: 21 May 2019 Publication History

Abstract

The widely used ambient occlusion (AO) technique provides an approximation of some global illumination effects and is efficient enough for use in real-time applications. Because it relies on computing the visibility from each point on a surface, AO computation is expensive for dynamically deforming objects, such as characters in particular. In this paper, we describe an algorithm for producing high-quality dynamically changing AO for characters. Our fundamental idea is to factorize the AO computation into a coarse-scale component in which visibility is determined by approximating spheres, and a fine-scale component that leverages a skinning-like algorithm for efficiency, with both components trained in a regression against ground-truth AO values. The resulting algorithm accommodates interactions with external objects and generalizes without requiring carefully constructed training data. Extensive comparisons illustrate the capabilities and advantages of our algorithm.

Supplementary Material

ZIP File (a6-le.zip)

Supplemental material.

Download
162.79 MB

References

[1]

Okan Arikan, David A. Forsyth, and James F. O'Brien. 2005. Fast and Detailed Approximate Global Illumination by Irradiance Decomposition. ACM Trans. Graph. 24, 3 (July 2005), 1108--1114.

Digital Library

[2]

David Arthur and Sergei Vassilvitskii. 2007. K-means++: The Advantages of Careful Seeding. In Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA '07). 1027--1035.

Digital Library

[3]

Steve Bako, Thijs Vogels, Brian Mcwilliams, Mark Meyer, Jan NováK, Alex Harvill, Pradeep Sen, Tony Derose, and Fabrice Rousselle. 2017. Kernel-predicting Convolutional Networks for Denoising Monte Carlo Renderings. ACM Trans. Graph. 36, 4 (July 2017), 97:1--97:14.

Digital Library

[4]

D.P. Bertsekas. 1999. Nonlinear Programming. Athena Scientific.

[5]

Michael Bunnell. 2005. Dynamic Ambient Occlusion And Indirect Lighting. Vol. 2. 223--233. http://http.download.nvidia.com/developer/GPU_Gems_2/GPU_Gems2_ch14.pdf

[6]

Chakravarty R. Alla Chaitanya, Anton S. Kaplanyan, Christoph Schied, Marco Salvi, Aaron Lefohn, Derek Nowrouzezahrai, and Timo Aila. 2017. Interactive Reconstruction of Monte Carlo Image Sequences Using a Recurrent Denoising Autoencoder. ACM Trans. Graph. 36, 4, Article 98 (July 2017), 98:1--98:12 pages.

Digital Library

[7]

Per H. Christensen. 2002. Note #35: Ambient Occlusion, Image-Based Illumination, and Global Illumination. PhotoRealistic RenderMan Application Notes. (2002).

[8]

Per H. Christensen and Wojciech Jarosz. 2016. The Path to Path-Traced Movies. Found. Trends. Comput. Graph. Vis. 10, 2 (Oct. 2016), 103--175.

Digital Library

[9]

Philip Dutre, Kavita Bala, Philippe Bekaert, and Peter Shirley. 2006. Advanced Global Illumination. AK Peters Ltd.

Digital Library

[10]

Roger Fletcher. 1987. Practical Methods of Optimization; (2nd Ed.). Wiley-Interscience.

Digital Library

[11]

Daniel Holden, Jun Saito, and Taku Komura. 2016. Neural Network Ambient Occlusion. In SIGGRAPH ASIA 2016 Technical Briefs (SA '16). Article 9, 9:1--9:4 pages.

Digital Library

[12]

Doug L. James and Christopher D. Twigg. 2005. Skinning Mesh Animations. ACM Trans. Graph. 24, 3 (July 2005), 399--407.

Digital Library

[13]

Ladislav Kavan, Adam W. Bargteil, and Peter-Pike Sloan. 2011. Least Squares Vertex Baking. In Proceedings of the 22nd Eurographics Conference on Rendering (EGSR '11). 1319--1326.

Digital Library

[14]

Adam G. Kirk and Okan Arikan. 2007. Real-time Ambient Occlusion for Dynamic Character Skins. In Proceedings of the 2007 Symposium on Interactive 3D Graphics and Games (I3D '07). 47--52.

Digital Library

[15]

Janne Kontkanen and Timo Aila. 2006. Ambient Occlusion for Animated Characters. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (EGSR '06). 343--348.

Digital Library

[16]

Dylan Lacewell. 2016. Baking With OptiX. (2016). https://developer.nvidia.com/optix-prime-baking-sample

[17]

H. Landis. 2002a. Global illumination in production. In ACM SIGGRAPH Course Notes.

[18]

H. Landis. 2002b. RenderMan in Production. ACM SIGGRAPH Course 16. (2002).

[19]

D. Larsson and H. Halen. 2009. The unique lighting of Mirror's Edge. In Proceedings of the Game Developers Conference (GDC).

[20]

Binh Huy Le and Jessica K. Hodgins. 2016. Real-time Skeletal Skinning with Optimized Centers of Rotation. ACM Trans. Graph. 35, 4, Article 37 (July 2016), 37:1--37:10 pages.

Digital Library

[21]

Nelson L. Max. 1988. Horizon mapping: shadows for bump-mapped surfaces. The Visual Computer 4, 2 (01 Mar 1988), 109--117.

[22]

Oleg Mazonka. 2012. Solid Angle of Conical Surfaces, Polyhedral Cones, and Intersecting Spherical Caps. (2012).

[23]

Martin Mittring. 2007. Finding Next Gen: Cry Engine 2. In ACM SIGGRAPH 2007 Courses (SIGGRAPH '07). 97--121.

Digital Library

[24]

Oliver Nalbach, Elena Arabadzhiyska, Dushyant Mehta, Hans-Peter Seidel, and Tobias Ritschel. 2017. Deep Shading: Convolutional Neural Networks for Screen-Space Shading. 36, 4 (2017).

Digital Library

[25]

Zhong Ren, Rui Wang, John Snyder, Kun Zhou, Xinguo Liu, Bo Sun, Peter-Pike Sloan, Hujun Bao, Qunsheng Peng, and Baining Guo. 2006. Real-time Soft Shadows in Dynamic Scenes Using Spherical Harmonic Exponentiation. ACM Trans. Graph. 25, 3 (July 2006), 977--986.

Digital Library

[26]

RTX 2018. NVIDIA Developer Blog: Introduction to NVIDIA RTX and DirectX Ray Tracing. (2018). https://devblogs.nvidia.com/introduction-nvidia-rtx-directx-ray-tracing

[27]

S. Schaefer and C. Yuksel. 2007. Example-based Skeleton Extraction. In Proceedings of the 5th Eurographics Symposium on Geometry Processing (SGP '07). 153--162.

Digital Library

[28]

Ari Silvennoinen and Jaakko Lehtinen. 2017. Real-time Global Illumination by Pre-computed Local Reconstruction from Sparse Radiance Probes. ACM Trans. Graph. 36, 6, Article 230 (Nov. 2017), 230:1--230:13 pages.

Digital Library

[29]

Peter-Pike Sloan, Naga K. Govindaraju, Derek Nowrouzezahrai, and John Snyder. 2007. Image-Based Proxy Accumulation for Real-Time Soft Global Illumination. In Proceedings of the 15th Pacific Conference on Computer Graphics and Applications (PG '07). 97--105.

Digital Library

[30]

Peter-Pike Sloan, Jan Kautz, and John Snyder. 2002. Precomputed Radiance Transfer for Real-time Rendering in Dynamic, Low-frequency Lighting Environments. ACM Trans. Graph. 21, 3 (July 2002), 527--536.

Digital Library

[31]

Lance Williams. 1978. Casting Curved Shadows on Curved Surfaces. In Proceedings of the 5th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '78). 270--274.

Digital Library

[32]

S. Zhukov, A. Iones, and G. Kronin. 1998. An ambient light illumination model. In Rendering Techniques '98. 45--55.

Cited By

Tan YLow SChow JTeo JBhojan A(2024)DHR+S: distributed hybrid rendering with realistic real-time shadows for interactive thin client metaverse and game applicationsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03501-440:7(4981-4991)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s00371-024-03501-4
Xu YJiang YZhang JLi KGeng G(2022)Real-Time Ray-Traced Soft Shadows of Environmental Lighting by Conical Ray CullingProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/35226175:1(1-15)Online publication date: 4-May-2022
https://dl.acm.org/doi/10.1145/3522617
De Paolis LDe Luca VGatto CD’Errico GPaladini G(2020)Photogrammetric 3D Reconstruction of Small Objects for a Real-Time FruitionAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_28(375-394)Online publication date: 31-Aug-2020
https://doi.org/10.1007/978-3-030-58465-8_28

Index Terms

High-quality object-space dynamic ambient occlusion for characters using Bi-level regression
1. Computing methodologies
  1. Computer graphics
    1. Animation
    2. Rendering
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning
        Supervised learning by regression
2. Mathematics of computing
  1. Mathematical analysis
    1. Mathematical optimization
      1. Continuous optimization
        Nonconvex optimization

Recommendations

Real-Time Volume-Based Ambient Occlusion

Real-time rendering can benefit from global illumination methods to make the 3D environments look more convincing and lifelike. On the other hand, the conventional global illumination algorithms for the estimation of the diffuse surface interreflection ...
Ambient Occlusion Using Cone Tracing with Scene Voxelization
SIBGRAPI '12: Proceedings of the 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images

Ambient occlusion is a low-cost technique to simulate indirect ambient illumination in a realistic way. The goal is to estimate the amount of incident ambient light at each visible point. In this paper, we propose a novel ambient occlusion method that ...
Dual space directional occlusion

Current real-time ambient or directional occlusion approximation methods are either screen space or object space based. Both methods suffer from drawbacks such as time incoherence and occlusion popping for screen space methods or loss of detailed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

I3D '19: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

May 2019

152 pages

ISBN:9781450363105

DOI:10.1145/3306131

Editor:
Stephen N. Spencer
University of Washington
,
General Chairs:
Sheldon Andrews
École de Technologie Supérieure
,
Natalya Tatarchuk
Unity Technologies

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

I3D '19

Sponsor:

SIGGRAPH

I3D '19: Symposium on Interactive 3D Graphics and Games

May 21 - 23, 2019

Quebec, Montreal, Canada

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Upcoming Conference

I3D '25

Sponsor:
siggraph

Symposium on Interactive 3D Graphics and Games

May 7 - 9, 2025

Jersey City , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
202
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tan YLow SChow JTeo JBhojan A(2024)DHR+S: distributed hybrid rendering with realistic real-time shadows for interactive thin client metaverse and game applicationsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03501-440:7(4981-4991)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s00371-024-03501-4
Xu YJiang YZhang JLi KGeng G(2022)Real-Time Ray-Traced Soft Shadows of Environmental Lighting by Conical Ray CullingProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/35226175:1(1-15)Online publication date: 4-May-2022
https://dl.acm.org/doi/10.1145/3522617
De Paolis LDe Luca VGatto CD’Errico GPaladini G(2020)Photogrammetric 3D Reconstruction of Small Objects for a Real-Time FruitionAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_28(375-394)Online publication date: 31-Aug-2020
https://doi.org/10.1007/978-3-030-58465-8_28

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten