Layer-based disparity adjustment in stereoscopic 3D media
Article No.: 2, Pages 1 - 9
Abstract
We present a method to adjust the disparity of stereoscopic 3D (S3D) images non-uniformly to improve viewing comfort or to allow artistic license with depth after capture. Using disparity maps, our method decomposes the input S3D image into layers where adjustments are performed. Since adjusting the disparity potentially introduces holes where previously occluded regions become visible, we also present a disparity-aware inpainting method to fill these holes. We test our method using raytraced S3D images with ground truth disparity maps to demonstrate that our method produces close-to-ideal results. Finally, we discuss how we used our method to adjust the disparity of several S3D photos used in the WWI documentary "Soldiers' Stories".
References
[1]
C. Barnes, E. Shechtman, A. Finkelstein, and D. B. Goldman. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph., 28(3):24:1--24:11, July 2009.
[2]
M. Bertalmìo, A. Bertozzi, and G. Sapiro. Navier-Stokes, fluid dynamics, and image and video inpainting. In Computer Vision and Pattern Recognition, volume 1, 2001.
[3]
H. Furihata, T. Yendo, M. Panahpour Tehrani, T. Fujii, and M. Tanimoto. Novel view synthesis with residual error feedback for FTV, 2010.
[4]
H. Hirschmuller. Stereo processing by semiglobal matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(2):328--341, Feb 2008.
[5]
G. R. Jones, D. Lee, N. S. Holliman, and D. Ezra. Controlling perceived depth in stereoscopic images, 2001.
[6]
Dir. J. Kitzen. Soldiers' Stories. Kallisti Media, 2014.
[7]
M. T. M. Lambooij, W. A. IJsselsteijn, M. Fortuin, and I. Heynderickx. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology, 53(3):030201:1--14, May/June 2009.
[8]
M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross. Nonlinear disparity mapping for stereoscopic 3D. SIGGRAPH '10, New York, NY, USA, 2010. ACM.
[9]
N. Manap and J. Soraghan. Novel view synthesis based on depth map layers representation. In 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, pages 1--4, 2011.
[10]
N. Manap, J. Soraghan, and L. Petropoulakis. Depth image layers separation (DILS) algorithm of image view synthesis based on stereo vision. In Signal and Image Processing Applications (ICSIPA), pages 61--66, 2013.
[11]
B. Mendiburu. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press, May 2009.
[12]
B. Morse, J. Howard, S. Cohen, and B. Price. PatchMatch-based content completion of stereo image pairs. In 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2012 Second International Conference on, pages 555--562, Oct 2012.
[13]
L. Northam, P. Asente, and C. S. Kaplan. Consistent stylization and painterly rendering of stereoscopic 3D images. In NPAR, NPAR '12, pages 47--56, Aire-la-Ville, Switzerland, Switzerland, 2012. Eurographics Association.
[14]
L. Northam, P. Asente, and C. S. Kaplan. Stereoscopic 3D image stylization. Comput. Graph., 37(5):389--402, 2013.
[15]
H. Pan, C. Yuan, and S. Daly. 3D video disparity scaling for preference and prevention of discomfort, 2011.
[16]
C. Richardt, L. Świrski, I. P. Davies, and N. A. Dodgson. Predicting stereoscopic viewing comfort using a coherence-based computational model. In Proceedings of the International Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, CAe '11, pages 97--104, New York, NY, USA, 2011. ACM.
[17]
D. Sarto. Stereoscopic supervisor Robert Neuman talks Disney 3-D. VFXWorld Magazine Online, apr 2012.
[18]
D. Scharstein and C. Pal. Learning conditional random fields for stereo. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, pages 1--8, June 2007.
[19]
A. Telea. An image inpainting technique based on the fast marching method. J. Graphics, GPU, and Game Tools, 9(1):23--34, 2004.
[20]
L. Wang, H. Jin, R. Yang, and M. Gong. Stereoscopic inpainting: Joint color and depth completion from stereo images. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1--8, June 2008.
[21]
O. Wang, M. Lang, M. Frei, A. Hornung, A. Smolic, and M. Gross. Stereobrush: Interactive 2D to 3D conversion using discontinuous warps. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, SBIM '11, pages 47--54, 2011.
Index Terms
- Layer-based disparity adjustment in stereoscopic 3D media
Index terms have been assigned to the content through auto-classification.
Recommendations
Boundary-preserving stereo matching with certain region detection and adaptive disparity adjustment
Boundary-preserving stereo matching.Initial disparity estimation based on segmentation.Classification of disparity map into certain and uncertain regions.Disparity adjustment based on certain region detection. In this paper, we propose boundary-...
Perceptual Tolerance to Stereoscopic 3D Image Distortion
An intriguing aspect of picture perception is the viewer’s tolerance to variation in viewing position, perspective, and display size. These factors are also present in stereoscopic media, where there are additional parameters associated with the camera ...
Stereo panorama acquisition and automatic image disparity adjustment for stereoscopic visualization
Image-based visualization is popular for various virtual tour applications, due to high-quality photorealism or simplicity for rendering. Stereo panorama representations of the virtual world are already a common part of this, either in small (computer ...
Comments
Information & Contributors
Information
Published In
December 2016
90 pages
ISBN:9781450347440
DOI:10.1145/2998559
Copyright © 2016 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- The Foundry: The Foundry Visionmongers Ltd.
- University of Bath: University of Bath
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 December 2016
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
CVMP 2016
CVMP 2016: 13th European Conference on Visual Media Production
December 12 - 13, 2016
London, United Kingdom
Acceptance Rates
Overall Acceptance Rate 40 of 67 submissions, 60%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 114Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in