Skip to main content
SpringerLink
Log in

Plenoptic video geometry

  • Special issue on computational video
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

More and more processing of visual information is nowadays done by computers, but the images captured by conventional cameras are still based on the pinhole principle inspired by our own eyes. This principle though is not necessarily the optimal image-formation principle for automated processing of visual information. Each camera samples the space of light rays according to some pattern. If we understand the structure of the space formed by the light rays passing through a volume of space, we can determine the camera, or in other words the sampling pattern of light rays, that is optimal with regard to a given task. In this work we analyze the differential structure of the space of time-varying light rays described by the plenoptic function and use this analysis to relate the rigid motion of an imaging device to the derivatives of the plenoptic function. The results can be used to define a hierarchy of camera models with respect to the structure from motion problem and formulate a linear, scene-independent estimation problem for the rigid motion of the sensor purely in terms of the captured images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Adelson EH, Bergen JR (1991) The plenoptic function and the elements of early vision. In: Landy M, Movshon JA (eds) Computational models of visual processing. MIT Press, Cambridge, Mass, pp 3–20

  2. Adelson EH, Wang JYA (1992) Single lens stereo with a plenoptic camera. IEEE Trans PAMI 14:99–106

    Article  Google Scholar 

  3. Bolles RC, Baker HH, Marimont DH (1987) Epipolar-plane image analysis: an approach to determining structure from motion. Int J Comput Vision 1:7–55

    Article  Google Scholar 

  4. Camahort E, Fussell D (1999) A geometric study of light field representations. Technical Report TR99-35, Department of Computer Sciences, The University of Texas at Austin

  5. Capurro C, Panerai F, Sandini G (1996) Vergence and tracking fusing log-polar images. In: Proceedings International Conference on Pattern Recognition

  6. Chai J, Shum H (2000) Parallel projections for stereo reconstruction. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, Vol 2, pp 493–500

  7. Chai J, Tong X, Shum H (2000) Plenoptic sampling. In: Proceedings ACM SIGGRAPH, pp 307–318

  8. Dawkins R (1996) Climbing Mount Improbable. Norton, New York

  9. Gortler S, Grzeszczuk R, Szeliski R, Cohen M (1996) The lumigraph. In: Proceedings ACM SIGGRAPH, pp 43–54

  10. Grossberg MD, Nayar SK (2001) A general imaging model and a method for finding its parameters. In: Proceedings International Conference on Computer Vision, pp 108–115

  11. Horn BKP (1986) Robot vision. McGraw Hill, New York

  12. Koch R, Pollefeys M, Heigl B, VanGool L, Niemann H (1999) Calibration of hand-held camera sequences for plenoptic modeling. In: Proceedings International Conference on Computer Vision, pp 585–591

  13. Levoy M, Hanrahan P (1996) Light field rendering. In: Proceedings ACM SIGGRAPH, pp 161–170

  14. Moon P, Spencer DE (1981) The photic field. MIT Press, Cambridge, Mass

  15. Nayar S (1997) Catadioptric omnidirectional camera. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, pp 482–488

  16. Neumann J, Fermüller C, Aloimonos Y (2002) Eyes from eyes: new cameras for structure from motion. In: IEEE Workshop on Omnidirectional Vision 2002 (in conjunction with ECCV 2002), pp 19–26

  17. Pajdla T (2002) Stereo with oblique cameras. Int J Comput Vision 47(1/2/3):161–170

  18. Peleg S, Herman J (1997) Panoramic mosaics by manifold projection. In: CVPR’97, pp 338–343

  19. Rademacher P, Bishop G (1998) Multiple-center-of-projection images. Proceedings ACM SIGGRAPH, pp 199–206

  20. Richter JP (ed) (1970) The notebooks of Leonardo da Vinci, Vol 1. Dover, New York, p 39

  21. Seitz S (2001) The space of all stereo images. In: Proceedings International Conference on Computer Vision

  22. Shum HY, Kalai A, Seitz SM (1999) Omnivergent stereo. In: Proceedings International Conference on Computer Vision

  23. Wood DN, Finkelstein A, Hughes JF, Thayer CE, Salesin DH (1997) Multiperspective panoramas for cell animation. Proceedings ACM SIGGRAPH, pp 243–250

Download references

Author information

Authors and Affiliations

  1. Center for Automation Research, University of Maryland, 20742-3275, College Park, MD, USA

    Jan Neumann & Cornelia Fermüller

Authors
  1. Jan Neumann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cornelia Fermüller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan Neumann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Neumann, J., Fermüller, C. Plenoptic video geometry. Vis Comput 19, 395–404 (2003). https://doi.org/10.1007/s00371-003-0203-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-003-0203-5

Keywords

Search

Navigation