Wenxiu Sun
ABSTRACT
In this paper, we present a view synthesis method named Visto which aims to generate seamless novel views from a monocular view input. We formulate the problem as joint optimization of inter-view texture similarity and geometry preservation, which significantly differs from traditional view synthesis framework. In this way, the image characteristics of virtual view are inherently inherited from the reference view without introducing any image prior or texture modeling technique. The energy function is minimized using Gauss-Seidel-like approach, and the quality of the virtual view is refined iteratively. The proposed approach also tolerates small depth map errors. Further more, the algorithm is parallel friendly. The simulation results outperform several existing state-of-the-art monocular view synthesis systems.
- S. Chen and L. Williams. View interpolation for image synthesis. In SIGGRAPH '93, pages 279--288. ACM, 1993. Google Scholar
Digital Library
- A. Criminisi and A. Blake. The SPS algorithm: Patching figural continuity and transparency by split-patch search. In CVPR'04, 2004.Google ScholarCross Ref
- I. Daribo and B. Pesquet-Popescu. Depth-aided image inpainting for novel view synthesis. In MMSP'10, 2010.Google ScholarCross Ref
- C. Fehn. Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In Proc. SPIE, pages 93--104, 2004.Google Scholar
- J. Gautier, O. Le Meur, and C. Guillemot. Depth-based image completion for view synthesis. In 3DTV-CON'11. IEEE, 2011.Google Scholar
- S. W. Hasinoff, S. B. Kang, and R. Szeliski. Boundary matting for view synthesis. Computer Vision and Image Understanding, 103(1):22--32, July 2006. Google ScholarDigital Library
- ISO/IECJTC1/SC29/WG11. Reference softwares for depth estimation and view synthesis. Doc. M15377, April 2008.Google Scholar
- L. Mcmillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In SIGGRAPH'95. Google ScholarDigital Library
- K.-J. Oh, S. Yea, and Y.-S. Ho. Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-d video. In PCS'09, 2009. Google ScholarDigital Library
- H.-Y. Shum and S. B. Kang. A Review of image-based rendering techniques. In Proc. SPIE, 2000.Google ScholarCross Ref
- W. Sun, O. C. Au, L. Xu, S. H. Chui, C. W. Kwok, and Y. Li. Error Compensation and Reliability Based View Synthesis. In ICASSP'11, 2011.Google Scholar
- C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. In ACM TOG, volume 23, pages 600--608. ACM, 2004. Google ScholarDigital Library
Index Terms
- Texture optimization for seamless view synthesis through energy minimization
Recommendations
Seamless View Synthesis Through Texture Optimization
In this paper, we present a novel view synthesis method named Visto, which uses a reference input view to generate synthesized views in nearby viewpoints. We formulate the problem as a joint optimization of inter-view texture and depth map similarity, a ...
A fast texture-by-numbers synthesis method based on texture optimization
VINCI '12: Proceedings of the 5th International Symposium on Visual Information Communication and InteractionThe framework of Texture-by-numbers (TBN) synthesizes images of global-varying patterns with intuitive user control. Previous TBN synthesis methods have difficulties in achieving high-quality synthesis results and efficiency simultaneously. This paper ...
Constrained Texture Synthesis via Energy Minimization
This paper describes CMS (constrained minimization synthesis), a fast, robust texture synthesis algorithm that creates output textures while satisfying constraints. We show that constrained texture synthesis can be posed in a principled way as an energy ...
Comments