Abstract
We present a multi-view alpha matting method that requires no user input and is able to deal with any arbitrary scene geometry through the use of depth maps. The algorithm uses multiple observations of the same point to construct constraints on the true foreground color and estimate its transparency. A novel free viewpoint rendering pipeline is also presented that takes advantage of the generated alpha maps to improve the quality of synthesized views over state-of-the-art methods. The results show a clear improvement on image quality by implicitly correcting depth map errors, providing more natural boundaries on transparent regions, and removing artifacts.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Smolic, A.: 3d video and free viewpoint video-from capture to display. In: Pattern Recognition (2010)
Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., Rott, P.: A perceptually motivated online benchmark for image matting. In: CVPR (2009)
Gastal, E., Oliveira, M.: Shared sampling for real-time alpha matting. Computer Graphics Forum 29(2) (2010)
Levin, A., Lischinski, D., Weiss, Y.: A closed-form solution to natural image matting. In: PAMI (2007)
Wang, J., Cohen, M.: Optimized color sampling for robust matting. In: CVPR (2007)
Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. ACM Trans. on Graph (Proc. SIGGRAPH) (2004)
Chuang, Y., Curless, B., Salesin, D., Szeliski, R.: “A bayesian approach to digital matting. In: CVPR (2001)
Hasinoff, S., Kang, S., Szeliski, R.: Boundary matting for view synthesis. Computer Vision and Image Understanding 103(1) (2006)
Joshi, N., Matusik, W., Avidan, S.: Natural video matting using camera arrays. ACM Trans. Graph 25 (2006)
Wexler, Y., Fitzgibbon, A., Zisserman, A.: Image-based environment matting. In: Proceedings of the 13th Eurographics Workshop on Rendering (2002)
Wexler, Y., Fitzgibbon, A.W., Zisserman, A.: Bayesian estimation of layers from multiple images. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 487–501. Springer, Heidelberg (2002)
Shade, J., Gortler, S., He, L., Szeliski, R.: Layered depth images. In: SIGGRAPH (1998)
Frick, A., Kellner, F., Bartczak, B., Koch, R.: Generation of 3d-tv ldv-content with time-of-flight camera. In: 3DTV Con. (2009)
Müller, K., Smolic, A., Dix, K., Merkle, P., Kauff, P., Wiegand, T.: View synthesis for advanced 3d video systems. EURASIP Journal on Image and Video Processing (2008)
Fitzgibbon, A., Wexler, Y., Zisserman, A.: Image-based rendering using image-based priors. In: ICCV (2003)
Smith, A., Blinn, J.: Blue screen matting. In: Proc. of ACM SIGGRAPH (1996)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. In: PAMI, vol. 23(11) (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Herrera C., D., Kannala, J., Heikkilä, J. (2011). Multi-view Alpha Matte for Free Viewpoint Rendering. In: Gagalowicz, A., Philips, W. (eds) Computer Vision/Computer Graphics Collaboration Techniques. MIRAGE 2011. Lecture Notes in Computer Science, vol 6930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24136-9_9
Download citation
DOI: https://doi.org/10.1007/978-3-642-24136-9_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24135-2
Online ISBN: 978-3-642-24136-9
eBook Packages: Computer ScienceComputer Science (R0)