SLFT: A physically accurate framework for Tracing Synthetic Light Fields
Article No.: 64, Pages 1 - 9
Abstract
A light field is a 4D function which captures all the radiance information of a scene. Image-based creation of light fields reconstructs the 4D space using pre-captured imagery from various views and employs refocusing to generate output images. Handheld cameras can also capture light fields using a microlens array between the sensor and the main lens, but physical constraints limit their spatial and angular resolutions. In this paper, we present a GPU based synthetic light field rendering framework that is robust and physically accurate. We demonstrate the equivalence of the standard light field camera representation with light slab representation for synthetic light fields and exhibit the capability of our framework to trace light fields of resolutions much higher than available in commercial plenoptic cameras. The light slab is rich in quality but bulky to store. Our system provides parameters to balance the quality and storage requirements. We also present a compact representation of the 4D light slabs using a video compression codec and demonstrate different quality-size combinations using these representations.
References
[1]
Edward H Adelson and John Y. A. Wang. Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis & Machine Intelligence, (2):99--106, 1992.
[2]
Arthur Appel. Some techniques for shading machine renderings of solids. In Proceedings of the April 30-May 2, 1968, Spring Joint Computer Conference, AFIPS '68 (Spring), pages 37--45, New York, NY, USA, 1968. ACM. URL http://doi.acm.org/10.1145/1468075.1468082.
[3]
James F. Blinn. Models of light reflection for computer synthesized pictures. SIGGRAPH Comput. Graph., 11(2):192--198, July 1977. ISSN 0097-8930. URL http://doi.acm.org/10.1145/965141.563893.
[4]
Donald G Dansereau, Oscar Pizarro, and Stefan B Williams. Decoding, calibration and rectification for lenselet-based plenoptic cameras. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1027--1034, 2013.
[5]
H. E. Ives. Parallax panoramagrams made with a large diameter lens. J. Opt. Soc. Amer., (20):332--342, 1930.
[6]
Bahram Javidi and Fumio Okano. Three-dimensional television, video, and display technologies. Springer Science & Business Media, 2002.
[7]
Timothy L. Kay and James T. Kajiya. Ray tracing complex scenes. SIGGRAPH Comput. Graph., 20(4):269--278, August 1986. ISSN 0097-8930. URL http://doi.acm.org/10.1145/15886.15916.
[8]
Craig Kolb, Don Mitchell, and Pat Hanrahan. A realistic camera model for computer graphics. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '95, pages 317--324, New York, NY, USA, 1995. ACM. ISBN 0-89791-701-4. URL http://doi.acm.org/10.1145/218380.218463.
[9]
Marc Levoy and Pat Hanrahan. Light field rendering. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '96, pages 31--42, New York, NY, USA, 1996. ACM. ISBN 0-89791-746-4. URL http://doi.acm.org/10.1145/237170.237199.
[10]
G. Lippmann. La photographie intégrale. Comptes-Rendus, Académie des Sciences, (146):446--551, 1908.
[11]
David J. MacDonald and Kellogg S. Booth. Heuristics for ray tracing using space subdivision. Vis. Comput., 6(3):153--166, May 1990. ISSN 0178-2789. URL http://dx.doi.org/10.1007/BF01911006.
[12]
M. Magnor and B. Girod. Data compression for light-field rendering. IEEE Trans. Cir. and Sys. for Video Technol., 10(3):338--343, April 2000. ISSN 1051-8215. URL http://dx.doi.org/10.1109/76.836278.
[13]
Ren Ng, Marc Levoy, Mathieu Brédif, Gene Duval, Mark Horowitz, Pat Hanrahan, et al. Light field photography with a hand-held plenoptic camera. Computer Science Technical Report CSTR, 2(11):1--11, 2005.
[14]
Takanori Okoshi. Three-dimensional imaging techniques. Elsevier, 2012.
[15]
Michael Potmesil and Indranil Chakravarty. Synthetic image generation with a lens and aperture camera model. ACM Trans. Graph., 1(2):85--108, April 1982. ISSN 0730-0301. URL http://doi.acm.org/10.1145/357299.357300.
[16]
Timothy J. Purcell, Ian Buck, William R. Mark, and Pat Hanrahan. Ray tracing on programmable graphics hardware. ACM Trans. Graph., 21(3):703--712, July 2002. ISSN 0730-0301. URL http://doi.acm.org/10.1145/566654.566640.
[17]
Turner Whitted. An improved illumination model for shaded display. Commun. ACM, 23(6):343--349,June 1980. ISSN 0001-0782. URL http://doi.acm.org/10.1145/358876.358882.
[18]
Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Eino-Ville Talvala, Emilio Antunez, Adam Barth, Andrew Adams, Mark Horowitz, and Marc Levoy. High performance imaging using large camera arrays. In ACM Transactions on Graphics (TOG), volume 24, pages 765--776. ACM, 2005.
Index Terms
- SLFT: A physically accurate framework for Tracing Synthetic Light Fields
Recommendations
Real-time reflection mapping with parallax
I3D '05: Proceedings of the 2005 symposium on Interactive 3D graphics and gamesWe present a novel algorithm to efficiently render accurate reflections on programmable graphics hardware. Our algorithm overcomes problems that commonly occur in environment mapping such as the lack of motion parallax and inaccuracies when objects are ...
Shield fields: modeling and capturing 3D occluders
We describe a unified representation of occluders in light transport and photography using shield fields: the 4D attenuation function which acts on any light field incident on an occluder. Our key theoretical result is that shield fields can be used to ...
Light-field supported fast volume rendering
SIGGRAPH '12: ACM SIGGRAPH 2012 PostersWe present a combination of light-field rendering and volume rendering to enable the interactive exploration of large volumetric data sets. We recycle previously rendered images and use the idle times of the volume renderer for filling a cached-managed ...
Comments
Information & Contributors
Information
Published In
December 2018
659 pages
ISBN:9781450366151
DOI:10.1145/3293353
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 May 2020
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICVGIP 2018
ICVGIP 2018: 11th Indian Conference on Computer Vision, Graphics and Image Processing
December 18 - 22, 2018
Hyderabad, India
Acceptance Rates
Overall Acceptance Rate 95 of 286 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 26Total Downloads
- Downloads (Last 12 months)1
- Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in