research-article

Real-time depth of field using multi-layer filtering

Authors:

Christian Reintges,

Marc StammingerAuthors Info & Claims

i3D '15: Proceedings of the 19th Symposium on Interactive 3D Graphics and Games

Pages 121 - 127

https://doi.org/10.1145/2699276.2699288

Published: 27 February 2015 Publication History

Abstract

We present a novel technique for rendering depth of field that addresses difficult overlap cases, such as close, but out-of-focus, geometry in the near-field. Such scene configurations are not managed well by state-of-the-art post-processing approaches since essential information is missing due to occlusion.

Our proposed algorithm renders the scene from a single camera position and computes a layered image using a single pass by constructing per-pixel lists. These lists can be filtered progressively to generate differently blurred representations of the scene. We show how this structure can be exploited to generate depth of field in real-time, even in complicated scene constellations.

Supplementary Material

GZ File (p121-selgrad.gz)

Supplemental material.

Download
1.40 MB

MP4 File (p121-selgrad.mp4)

Download
36.30 MB

References

[1]

Belcour, L., Soler, C., Subr, K., Holzschuch, N., and Durand, F. 2013. 5d covariance tracing for efficient defocus and motion blur. ACM Trans. Graph. 32, 3, 31:1--31:18.

Digital Library

[2]

Dammertz, H., Sewtz, D., Hanika, J., and Lensch, H. 2010. Edge-avoiding a-trous wavelet transform for fast global illumination filtering. In Proc. High Performance Graphics 2010, 67--75.

Digital Library

[3]

Demers, J. 2004. Depth of field: A survey of techniques. In GPU Gems, R. Fernando, Ed. Pearson Higher Education.

[4]

Haeberli, P., and Akeley, K. 1990. The accumulation buffer: hardware support for high-quality rendering. In Proceedings SIGGRAPH 1990, ACM, 309--318.

Digital Library

[5]

Hullin, M. B., Hanika, J., and Heidrich, W. 2012. Polynomial optics: A construction kit for efficient ray-tracing of lens systems. Computer Graphics Forum 31, 4, 1375--1383.

Digital Library

[6]

Kass, M., Lefohn, A., and Owens, J. 2006. Interactive depth of field using simulated diffusion on a gpu. Pixar Animation Studios Tech Report 2, 1--8.

[7]

Kosloff, T. J., Tao, M. W., and Barsky, B. A. 2009. Depth of field postprocessing for layered scenes using constant-time rectangle spreading. In Proceedings of Graphics Interface 2009, Canadian Information Processing Society, 39--46.

Digital Library

[8]

Krivanek, J., Zara, J., and Bouatouch, K. 2003. Fast depth of field rendering with surface splatting. In Computer Graphics International, 2003. Proceedings, IEEE, 196--201.

[9]

Lee, S., Kim, G. J., and Choi, S. 2008. Real-time depth-of-field rendering using point splatting on per-pixel layers. Computer Graphics Forum 27, 7, 1955--1962.

[10]

Lee, S., Eisemann, E., and Seidel, H.-P. 2009. Depth-of-field rendering with multiview synthesis. ACM Trans. Graph. (Proc. of SIGGRAPH Asia) 28, 5.

Digital Library

[11]

Lehtinen, J., Aila, T., Chen, J., Laine, S., and Durand, F. 2011. Temporal light field reconstruction for rendering distribution effects. ACM Trans. Graph. 30, 4, 55:1--55:12.

Digital Library

[12]

Lei, K., and Hughes, J. F. 2013. Approximate depth of field effects using few samples per pixel. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, 119--128.

Digital Library

[13]

McIntosh, L., Riecke, B. E., and DiPaola, S. 2012. Efficiently simulating the bokeh of polygonal apertures in a postprocess depth of field shader. Comp. Graph. Forum 31, 6, 1810--1822.

Digital Library

[14]

Riguer, G., Tatarchuk, N., and Isidoro, J. R. 2003. Realtime depth of field simulation. In ShaderX2: Shader Programming Tips and Tricks with DirectX 9.0, W. Engel, Ed. Wordware, Plano, Texas.

[15]

Schedl, D., and Wimmer, M. 2012. A layered depth-of-field method for solving partial occlusion. Journal of WSCG 20, 3 (6), 239--246.

[16]

Schwarz, M., and Stamminger, M. 2008. Quality scalability of soft shadow mapping. In Proc. Graphics Interface, 147--154.

Digital Library

[17]

Selgrad, K., Dachsbacher, C., Meyer, Q., and Stamminger, M. 2014. Filtering multi-layer shadow maps for accurate soft shadows. Computer Graphics Forum.

[18]

Sengupta, S., Harris, M., Zhang, Y., and Owens, J. D. 2007. Scan primitives for GPU computing. In Proc. Symposium on Graphics Hardware, 97--106.

Digital Library

[19]

Tzeng, S., Patney, A., Davidson, A., Ebeida, M. S., Mitchell, S. A., and Owens, J. D. 2012. High-quality parallel depth-of-field using line samples. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics Conference on High-Performance Graphics, Eurographics Association, 23--31.

Digital Library

[20]

Yang, J. C., Hensley, J., Grün, H., and Thibieroz, N. 2010. Real-time concurrent linked list construction on the GPU. Computer Graphics Forum (Proc. EGSR) 29, 4, 1297--1304.

Digital Library

Cited By

Kim JLee S(2023)Potentially Visible Hidden-Volume Rendering for Multi-View WarpingACM Transactions on Graphics10.1145/359210842:4(1-11)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592108
Kiourt CPavlidis GKoutsoudis AKalles D(2020)Realistic Simulation of Cultural HeritageNatural Language Processing10.4018/978-1-7998-0951-7.ch064(1314-1347)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-0951-7.ch064
Vasilakis AVardis KPapaioannou G(2020)A Survey of Multifragment RenderingComputer Graphics Forum10.1111/cgf.1401939:2(623-642)Online publication date: 13-Jul-2020
https://doi.org/10.1111/cgf.14019
Show More Cited By

Index Terms

Real-time depth of field using multi-layer filtering
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Filtering Multi-Layer Shadow Maps for Accurate Soft Shadows

In this paper, we introduce a novel technique for pre-filtering multi-layer shadow maps. The occluders in the scene are stored as variable-length lists of fragments for each texel. We show how this representation can be filtered by progressively merging ...
Real-time multiply recursive reflections and refractions using hybrid rendering

We present a new method for real-time rendering of multiple recursions of reflections and refractions. The method uses the strengths of real-time ray tracing for objects close to the camera, by storing them in a per-frame constructed bounding volume ...
Real-Time Illumination of Foliage Using Depth Maps
ICCS '08: Proceedings of the 8th international conference on Computational Science, Part II

This article presents a new method for foliage illumination which takes into account direct, indirect illumination and self-shadowing. Both indirect illumination and self-shadowing are approximated by means of a novel technique using depth maps. In ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

i3D '15: Proceedings of the 19th Symposium on Interactive 3D Graphics and Games

February 2015

133 pages

ISBN:9781450333924

DOI:10.1145/2699276

Conference Chairs:
John Keyser
Texas A&M University
,
Pedro Sander
HKUST
,
General Chairs:
Kartic Subr
Heriot Watt University
,
Li-Yi Wei
The University of Hong Kong

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Research Foundation

Conference

I3D '15

Sponsor:

SIGGRAPH

I3D '15: Symposium on Interactive 3D Graphics and Games

February 27 - March 1, 2015

California, San Francisco

Acceptance Rates

Overall Acceptance Rate 148 of 485 submissions, 31%

Upcoming Conference

I3D '25

Sponsor:
siggraph

Symposium on Interactive 3D Graphics and Games

May 7 - 9, 2025

Jersey City , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
669
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim JLee S(2023)Potentially Visible Hidden-Volume Rendering for Multi-View WarpingACM Transactions on Graphics10.1145/359210842:4(1-11)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592108
Kiourt CPavlidis GKoutsoudis AKalles D(2020)Realistic Simulation of Cultural HeritageNatural Language Processing10.4018/978-1-7998-0951-7.ch064(1314-1347)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-0951-7.ch064
Vasilakis AVardis KPapaioannou G(2020)A Survey of Multifragment RenderingComputer Graphics Forum10.1111/cgf.1401939:2(623-642)Online publication date: 13-Jul-2020
https://doi.org/10.1111/cgf.14019
Chen YChang T(2020)Image Synthesis With Efficient Defocus Blur for Stereoscopic DisplaysIEEE Access10.1109/ACCESS.2020.30263328(176304-176312)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3026332
Kang JLee JShin YKim B(2020)Depth-of-Field Rendering Using Progressive Lens Sampling in Direct Volume RenderingIEEE Access10.1109/ACCESS.2020.29943788(93335-93345)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2994378
Kim JJeong YStengel MAkşit KAlbert RBoudaoud BGreer TKim JLopes WMajercik ZShirley PSpjut JMcGuire MLuebke D(2019)Foveated ARACM Transactions on Graphics10.1145/3306346.332298738:4(1-15)Online publication date: 12-Jul-2019
https://dl.acm.org/doi/10.1145/3306346.3322987
Xiao LKaplanyan AFix AChapman MLanman D(2018)DeepFocusACM Transactions on Graphics10.1145/3272127.327503237:6(1-13)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3272127.3275032
Franke LHofmann NStamminger MSelgrad K(2018)Multi-Layer Depth of Field Rendering with Tiled SplattingProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/32032001:1(1-17)Online publication date: 25-Jul-2018
https://dl.acm.org/doi/10.1145/3203200
Meng XDu RZwicker MVarshney A(2018)Kernel Foveated RenderingProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/32031991:1(1-20)Online publication date: 25-Jul-2018
https://dl.acm.org/doi/10.1145/3203199
Choi WKim KKim C(2018)Reliable Depth-of-Field Rendering Using Estimated Depth Maps2018 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS.2018.8351453(1-4)Online publication date: 2018
https://doi.org/10.1109/ISCAS.2018.8351453
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten