poster

Texture optimization for seamless view synthesis through energy minimization

Authors:

Wei Hu,

Zhiding YuAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 733 - 736

https://doi.org/10.1145/2393347.2396299

Published: 29 October 2012 Publication History

Get Access

Abstract

In this paper, we present a view synthesis method named Visto which aims to generate seamless novel views from a monocular view input. We formulate the problem as joint optimization of inter-view texture similarity and geometry preservation, which significantly differs from traditional view synthesis framework. In this way, the image characteristics of virtual view are inherently inherited from the reference view without introducing any image prior or texture modeling technique. The energy function is minimized using Gauss-Seidel-like approach, and the quality of the virtual view is refined iteratively. The proposed approach also tolerates small depth map errors. Further more, the algorithm is parallel friendly. The simulation results outperform several existing state-of-the-art monocular view synthesis systems.

References

[1]

S. Chen and L. Williams. View interpolation for image synthesis. In SIGGRAPH '93, pages 279--288. ACM, 1993.

Digital Library

Google Scholar

[2]

A. Criminisi and A. Blake. The SPS algorithm: Patching figural continuity and transparency by split-patch search. In CVPR'04, 2004.

Crossref

Google Scholar

[3]

I. Daribo and B. Pesquet-Popescu. Depth-aided image inpainting for novel view synthesis. In MMSP'10, 2010.

Crossref

Google Scholar

[4]

C. Fehn. Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In Proc. SPIE, pages 93--104, 2004.

Google Scholar

[5]

J. Gautier, O. Le Meur, and C. Guillemot. Depth-based image completion for view synthesis. In 3DTV-CON'11. IEEE, 2011.

Google Scholar

[6]

S. W. Hasinoff, S. B. Kang, and R. Szeliski. Boundary matting for view synthesis. Computer Vision and Image Understanding, 103(1):22--32, July 2006.

Digital Library

Google Scholar

[7]

ISO/IECJTC1/SC29/WG11. Reference softwares for depth estimation and view synthesis. Doc. M15377, April 2008.

Google Scholar

[8]

L. Mcmillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In SIGGRAPH'95.

Digital Library

Google Scholar

[9]

K.-J. Oh, S. Yea, and Y.-S. Ho. Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-d video. In PCS'09, 2009.

Digital Library

Google Scholar

[10]

H.-Y. Shum and S. B. Kang. A Review of image-based rendering techniques. In Proc. SPIE, 2000.

Crossref

Google Scholar

[11]

W. Sun, O. C. Au, L. Xu, S. H. Chui, C. W. Kwok, and Y. Li. Error Compensation and Reliability Based View Synthesis. In ICASSP'11, 2011.

Google Scholar

[12]

C. L. Zitnick, S. B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski. High-quality video view interpolation using a layered representation. In ACM TOG, volume 23, pages 600--608. ACM, 2004.

Digital Library

Google Scholar

Cited By

View all

Xu LAu OSun WFang LZou FLi J(2015)Stereo Matching with Optimal Local Adaptive Radiometric CompensationIEEE Signal Processing Letters10.1109/LSP.2014.235002822:2(131-135)Online publication date: Feb-2015
https://doi.org/10.1109/LSP.2014.2350028
Sun WAu OXu LLi YHu W(2014)Seamless View Synthesis Through Texture OptimizationIEEE Transactions on Image Processing10.1109/TIP.2013.228999423:1(342-355)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1109/TIP.2013.2289994

Index Terms

Texture optimization for seamless view synthesis through energy minimization
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

Seamless View Synthesis Through Texture Optimization

In this paper, we present a novel view synthesis method named Visto, which uses a reference input view to generate synthesized views in nearby viewpoints. We formulate the problem as a joint optimization of inter-view texture and depth map similarity, a ...
A fast texture-by-numbers synthesis method based on texture optimization
VINCI '12: Proceedings of the 5th International Symposium on Visual Information Communication and Interaction

The framework of Texture-by-numbers (TBN) synthesizes images of global-varying patterns with intuitive user control. Previous TBN synthesis methods have difficulties in achieving high-quality synthesis results and efficiency simultaneously. This paper ...
Constrained Texture Synthesis via Energy Minimization

This paper describes CMS (constrained minimization synthesis), a fast, robust texture synthesis algorithm that creates output textures while satisfying constraints. We show that constrained texture synthesis can be posed in a principled way as an energy ...

Comments

Information & Contributors

Information

Published In

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
170
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xu LAu OSun WFang LZou FLi J(2015)Stereo Matching with Optimal Local Adaptive Radiometric CompensationIEEE Signal Processing Letters10.1109/LSP.2014.235002822:2(131-135)Online publication date: Feb-2015
https://doi.org/10.1109/LSP.2014.2350028
Sun WAu OXu LLi YHu W(2014)Seamless View Synthesis Through Texture OptimizationIEEE Transactions on Image Processing10.1109/TIP.2013.228999423:1(342-355)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1109/TIP.2013.2289994

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Seamless View Synthesis Through Texture Optimization

A fast texture-by-numbers synthesis method based on texture optimization

Constrained Texture Synthesis via Energy Minimization

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations