Skip to main content

The Wavelet Stream: Interactive Multi Resolution Light Field Rendering

  • Conference paper
  • First Online:
Rendering Techniques 2001 (EGSR 2001)

Part of the book series: Eurographics ((EUROGRAPH))

Included in the following conference series:

Abstract

One of the most general image based object representations is the Light Field. Unfortunately, a large amount of data is required to reconstruct high quality views from a Light Field. In this paper, we present the wavelet stream which employs non-standard four-dimensional wavelet decomposition for Light Field compression. It allows for progressive transmission, storage, and rendering of compressed Light Field data. Our results show that 0.8% of the original coefficients or 0.3 bits per pixel, respectively are sufficient to obtain visually pleasing new views. Additionally, the wavelet stream allows for an adaptive multi-resolution representation of the Light Field data. Furthermore, a silhouette-encoding scheme helps to reduce the number of coefficients required. Our data structure allows to store arbitrary vector-valued data like RGB- or YUV-data. The Light Field data stored in the wavelet stream can be decompressed in real time for interactive rendering. For this, the reconstruction algorithm uses supplementary caching schemes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. E. H. Adelson and J. R. Bergen. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, 1991.

    Google Scholar 

  2. Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. The lumigraph. In SIGGRAPH 96 Conference Proceedings, pages 43–54. August 1996.

    Google Scholar 

  3. Xianfeng Gu, Steven J. Gortler, and Michael F. Cohen. Polyhedral geometry and the twoplane parameterization. In Eurographics Rendering Workshop 1997, pages 1–12, June 1997. Springer Wien.

    Google Scholar 

  4. Insung Ihm, Rae Kyoung Lee, and Sanghoon Park. Rendering of Spherical Light Fields. In 5th Pacific Conference on Computer Graphics and Applications, pages 59–68, 1997.

    Google Scholar 

  5. Ming-Hoe Kiu, Xiao-Song Du, Robert J. Moorhead, David C. Banks, and Raghu Machiraju. Two Dimensional Sequence Compression Using MPEG. In SPIE Vol. 3309, SPIF/IS&T Electronic Imaging’ 97, San Jose, CA, January 1998.

    Google Scholar 

  6. Paul Lalonde and Alain Fournier. Interactive rendering of wavelet projected light fields. In Graphics Interface, pages 170–114, June 1999.

    Google Scholar 

  7. Marc Levoy and Pat Hanrahan. Light field rendering. In SIGGRAPH 96 Conference Proceedings, pages 31–42. August 1996.

    Google Scholar 

  8. M. Magnor, A. Endmann, and B. Girod. Progressive compression and rendering of light fields. In VMV 2000, pages 199–204, Saarbrücken, Germany.

    Google Scholar 

  9. Marcus Magnor and Bernd Girod. Data Compression in Image-Based Rendering. IEEE Transactions on Circuits and Systems for Video Technology, April 2000.

    Google Scholar 

  10. Gavin Miller, Steve Rubin, and Dulce Ponceleon. Lazy decompression of surface light fields for precomputer global illumination. In Rendering Techniques’ 98, pages 281–292. 1998 Springer Wien.

    Google Scholar 

  11. Ingmar Peter and Wolfgang Straßer. The wavelet stream: Progressive transmission of compressed light field data. In IEEE Visualization 1999 Late Breaking Hot Topics, pages 69–72. IEEE Computer Society, October 1999.

    Google Scholar 

  12. Amir Said and William A. Pearlman. A new fast and efficient image codec based on set partitioning in hierarchical trees. IEEE Transactions on Circuits and Systems for Video Technology, 6:243–250, June 1996.

    Article  Google Scholar 

  13. Hartrnut Schirmacher, Wolfgang Heidrich, and Hans-Peter Seidel. High-quality interactive lumigraph rendering through warping. In Graphics Interface, pages 87–94, May 2000.

    Google Scholar 

  14. J. M. Shapiro. Embedded image coding using zerotrees of wavelet coefficients. IEEE Transactions on Acoustics, Speech and Signal Processing, 41(12):3445–3462, 1993.

    Article  Google Scholar 

  15. The Stanford Light Fields Archive. http://www-graphics.stanford.edu/software/lightpack/lifs.html.

    Google Scholar 

  16. Peter-Pike Sloan and Charles Hansen. Parallel Lumigraph Reconstruction. In Proc. of PVG 99, San Francisco, October 1999.

    Google Scholar 

  17. Eric J. Stollnitz, Tony D. DeRose, and David H. Salesin. Wavelets for Computer Graphics: Theory and Applications. Morgan Kaufmann, San Francisco, 1996.

    Google Scholar 

  18. T.-T. Wong, P.-A. Heng, S.-H. Or, and W-Y. Ng. Illumination of image-based objects. The Journal of Visualization and Computer Animation, 9(3), 1998.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Wien

About this paper

Cite this paper

Peter, I., Straßer, W. (2001). The Wavelet Stream: Interactive Multi Resolution Light Field Rendering. In: Gortler, S.J., Myszkowski, K. (eds) Rendering Techniques 2001. EGSR 2001. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-6242-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-7091-6242-2_12

  • Published:

  • Publisher Name: Springer, Vienna

  • Print ISBN: 978-3-211-83709-2

  • Online ISBN: 978-3-7091-6242-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics