Abstract
In this paper we present a novel method for real-time high quality previsualization and cinematic relighting. The physically based Path Tracing algorithm is used within an Augmented Reality setup to preview high-quality light transport. A novel differential version of progressive path tracing is proposed, which calculates two global light transport solutions that are required for differential rendering. A real-time previsualization framework is presented, which renders the solution with a low number of samples during interaction and allows for progressive quality improvement. If a user requests the high-quality solution of a certain view, the tracking is stopped and the algorithm progressively converges to an accurate solution. The problem of rendering complex light paths is solved by using photon mapping. Specular global illumination effects like caustics can easily be rendered. Our framework utilizes the massive parallel power of modern GPUs to achieve fast rendering with complex global illumination, a depth of field effect, and antialiasing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kajiya, J.T.: The rendering equation. In: Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1986, pp. 143–150. ACM, New York (1986)
Fournier, A., Gunawan, A.S., Romanzin, C.: Common illumination between real and computer generated scenes. In: Proceedings of Graphics Interface 1993, Toronto, ON, Canada, pp. 254–262 (1993)
Debevec, P.: Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1998, pp. 189–198. ACM, New York (1998)
Grosch, T.: Differential photon mapping: Consistent augmentation of photographs with correction of all light paths. Eurographics Short Papers, Dublin (2005)
Karsch, K., Hedau, V., Forsyth, D., Hoiem, D.: Rendering synthetic objects into legacy photographs. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 1–12. ACM, New York (2011)
Knecht, M., Traxler, C., Mattausch, O., Purgathofer, W., Wimmer, M.: Differential instant radiosity for mixed reality. In: Proceedings of the 2010 IEEE International Symposium on Mixed and Augmented Reality, pp. 99–107 (2010)
Lensing, P., Broll, W.: Instant indirect illumination for dynamic mixed reality scenes. In: Proceedings of the 11th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2012, pp. 109–118. IEEE (2012)
Pessoa, S., Moura, G., Lima, J., Teichrieb, V., Kelner, J.: Photorealistic rendering for augmented reality: A global illumination and brdf solution. In: 2010 IEEE Virtual Reality Conference, VR, pp. 3–10 (2010)
Agusanto, K., Li, L., Chuangui, Z., Sing, N.W.: Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the International Symposium on Mixed and Augmented Reality, ISMAR 2003, pp. 208–218. IEEE Computer Society, Washington, DC (2003)
Grosch, T., Eble, T., Mueller, S.: Consistent interactive augmentation of live camera images with correct near-field illumination. In: Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology, VRST 2007, pp. 125–132. ACM, New York (2007)
Ikeda, S., Taketomi, T., Okumura, B., Sato, T., Kanbara, M., Yokoya, N., Chihara, K.: Real-time outdoor pre-visualization method for videographers. In: 2008 IEEE International Conference on Multimedia and Expo, pp. 949–952 (2008)
Northam, L., Istead, J., Kaplan, C.S.: A collaborative real time previsualization tool for video games and film. In: ACM SIGGRAPH 2012 Posters. SIGGRAPH 2012. ACM, New York (2012)
Wong, H.H.: Previsualization: assisting filmmakers in realizing their vision. In: SIGGRAPH Asia 2012 Courses, pp. 1–20. ACM, New York (2012)
Pantaleoni, J., Fascione, L., Hill, M., Aila, T.: Pantaray: fast ray-traced occlusion caching of massive scenes. In: ACM SIGGRAPH 2010 papers. SIGGRAPH 2010, pp. 1–10. ACM, New York (2010)
Christensen, P.H., Harker, G., Shade, J., Schubert, B., Batali, D.: Multiresolution radiosity caching for global illumination in movies. In: ACM SIGGRAPH 2012 Talks. SIGGRAPH 2012. ACM, New York (2012)
Kán, P., Kaufmann, H.: Physically-based depth of field in augmented reality. In: EG 2012, pp. 89–92. Eurographics Association, Cagliari (2012)
Banterle, F., Ledda, P., Debattista, K., Chalmers, A.: Inverse tone mapping. In: Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, GRAPHITE 2006, pp. 349–356. ACM, New York (2006)
Parker, S.G., Bigler, J., Dietrich, A., Friedrich, H., Hoberock, J., Luebke, D., McAllister, D., McGuire, M., Morley, K., Robison, A., Stich, M.: Optix: a general purpose ray tracing engine. ACM Trans. Graph. 29 (2010)
Kán, P., Kaufmann, H.: High-quality reflections, refractions, and caustics in augmented reality and their contribution to visual coherence. In: Proceedings of International Symposium on Mixed and Augmented Reality, pp. 99–108. ACM Press (2012)
Jensen, H.: Realistic Image Synthesis Using Photon Mapping. Ak Peters Series. A K Peters, Limited (2009)
Gastal, E.S.L., Oliveira, M.M.: Adaptive manifolds for real-time high-dimensional filtering. ACM TOG 31, 1–13 (2012); Proceedings of SIGGRAPH 2012
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kán, P., Kaufmann, H. (2013). Differential Progressive Path Tracing for High-Quality Previsualization and Relighting in Augmented Reality. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2013. Lecture Notes in Computer Science, vol 8034. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41939-3_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-41939-3_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41938-6
Online ISBN: 978-3-642-41939-3
eBook Packages: Computer ScienceComputer Science (R0)