skip to main content
10.1145/3355056.3364593acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
poster

A Low Cost Multi-Camera Array for Panoramic Light Field Video Capture

Published: 17 November 2019 Publication History

Abstract

We present a portable multi-camera system for recording panoramic light field video content. The proposed system captures wide baseline (0.8 meters), high resolution (>15 pixels per degree), large field of view (>220°) light fields at 30 frames per second. The array contains 47 time-synchronized cameras distributed on the surface of a hemispherical, 0.92 meter diameter plastic dome. We use commercially available action sports cameras (Yi 4k) mounted inside the dome using 3D printed brackets. The dome, mounts, triggering hardware and cameras are inexpensive and the array itself is easy to fabricate. Using modern view interpolation algorithms we can render objects as close as 33-cm to the surface of the array.

References

[1]
John Flynn, Michael Broxton, Paul Debevec, Matthew DuVall, Graham Fyffe, Ryan Overbeck, Noah Snavely, and Richard Tucker. 2019. DeepView: View Synthesis With Learned Gradient Descent. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[2]
Ben Mildenhall, Pratul Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019. Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines. ACM Transactions on Graphics(2019).
[3]
Tim Milliron, Chrissy Szczupak, and Orin Green. 2017. Hallelujah: the world’s first lytro VR experience. In ACM SIGGRAPH 2017 VR Village. 7:1–7:2.
[4]
Ryan Overbeck, Daniel Erickson, Daniel Evangelakos, Matt Pharr, and Paul Debevec. 2018. A System for Acquiring, Processing, and Rendering Panoramic Light Field Stills for Virtual Reality. ACM Transactions on Graphics 37 (10 2018).
[5]
Eric Penner and Li Zhang. 2017. Soft 3D Reconstruction for View Synthesis. ACM Trans. Graph. 36, 6, Article 235 (Nov. 2017), 11 pages.
[6]
B M Smith, L Zhang, H Jin, and A Agarwala. 2009. Light field video stabilization. In 2009 IEEE 12th International Conference on Computer Vision. 341–348.
[7]
Ting-Chun Wang, Jun-Yan Zhu, Nima Khademi Kalantari, Alexei A Efros, and Ravi Ramamoorthi. 2017. Light Field Video Capture Using a Learning-based Hybrid Imaging System. ACM Trans. Graph. 36, 4 (July 2017), 133:1–133:13.
[8]
Bennett S Wilburn, Michal Smulski, Hsiao-Heng Kelin Lee, and Mark A Horowitz. 2001. Light field video camera. In Media Processors 2002, Vol. 4674. International Society for Optics and Photonics, 29–36.
[9]
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. 2018. Stereo Magnification: Learning View Synthesis using Multiplane Images. In ACM Transactions on Graphics.

Cited By

View all
  • (2024)Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction2024 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCP61108.2024.10644854(1-12)Online publication date: 22-Jul-2024
  • (2024)OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00656(6871-6880)Online publication date: 16-Jun-2024
  • (2024)Light field imaging technology for virtual reality content creation: A reviewIET Image Processing10.1049/ipr2.1314418:11(2817-2837)Online publication date: 14-Jun-2024
  • Show More Cited By

Index Terms

  1. A Low Cost Multi-Camera Array for Panoramic Light Field Video Capture
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          SA '19: SIGGRAPH Asia 2019 Posters
          November 2019
          94 pages
          ISBN:9781450369435
          DOI:10.1145/3355056
          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 17 November 2019

          Check for updates

          Author Tags

          1. camera array
          2. image-based rendering
          3. light field
          4. view synthesis

          Qualifiers

          • Poster
          • Research
          • Refereed limited

          Conference

          SA '19
          Sponsor:
          SA '19: SIGGRAPH Asia 2019
          November 17 - 20, 2019
          QLD, Brisbane, Australia

          Acceptance Rates

          Overall Acceptance Rate 178 of 869 submissions, 20%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)19
          • Downloads (Last 6 weeks)1
          Reflects downloads up to 19 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction2024 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCP61108.2024.10644854(1-12)Online publication date: 22-Jul-2024
          • (2024)OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00656(6871-6880)Online publication date: 16-Jun-2024
          • (2024)Light field imaging technology for virtual reality content creation: A reviewIET Image Processing10.1049/ipr2.1314418:11(2817-2837)Online publication date: 14-Jun-2024
          • (2023)PanoVpr: Towards Unified Perspective-to-Equirectangular Visual Place Recognition via Sliding Windows Across the Panoramic View2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)10.1109/ITSC57777.2023.10421857(1333-1340)Online publication date: 24-Sep-2023
          • (2022)SILVRProceedings of the 13th ACM Multimedia Systems Conference10.1145/3524273.3532890(221-226)Online publication date: 14-Jun-2022
          • (2021)Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.00643(6494-6504)Online publication date: Jun-2021

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media