skip to main content
10.1145/3283289.3283296acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
poster

Free-viewpoint synthesis over panoramic images

Published: 04 December 2018 Publication History

Abstract

In the world of virtual reality, the task of constructing a playback data set to navigate through a scene has traditionally required a particularly inefficient procedure. The conventional method of taking pictures and videos with a pinhole camera model is costly due to the slow run time and memory space required. We propose a method which takes advantage of a less costly setup and improves the visual quality of the final images. This method allows users to choose the desired viewpoint, as well as whether the output should be computed as a panoramic or perspective image. This entire procedure consists of four steps: structure from motion (SfM), image rectification and depth estimation, 3D reconstruction, and view synthesis.

References

[1]
Patrice Bouvier, Francois De Sorbier, Pascal Chaudeyrac, and Venceslas Biri. 2008. Cross Benefits Between Virtual Reality And Games.
[2]
J. Huang, Z. Chen, D. Ceylan, and H. Jin. 2017. 6-DOF VR videos with a single 360-camera. In 2017 IEEE Virtual Reality (VR). 37--44.
[3]
B. Micusik and T. Pajdla. 2006. Structure from motion with wide circular field of view cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 7 (July 2006), 1135--1149.
[4]
OpenSfM. 2014. OpenSfM. https://github.com/mapillary/OpenSfM.
[5]
Eric Penner and Li Zhang. 2017. Soft 3D Reconstruction for View Synthesis. 36, 6 (2017).
[6]
D. Scaramuzza, A. Martinelli, and R. Siegwart. 2006. A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion. In Fourth IEEE International Conference on Computer Vision Systems (ICVS'06). 45--45.
[7]
Xide Xia and Brian Kulis. 2017. W-Net: A Deep Model for Fully Unsupervised Image Segmentation. CoRR abs/1711.08506 (2017).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SA '18: SIGGRAPH Asia 2018 Posters
December 2018
166 pages
ISBN:9781450360630
DOI:10.1145/3283289
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018

Check for updates

Author Tags

  1. free-viewpoint
  2. panoramic image
  3. view synthesis
  4. virtual reality

Qualifiers

  • Poster

Funding Sources

  • Ministry of Science and Technology(MOST), Taiwan
  • MediaTek Inc.

Conference

SA '18
Sponsor:
SA '18: SIGGRAPH Asia 2018
December 4 - 7, 2018
Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 192
    Total Downloads
  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media