Abstract
In this paper we attempt to solve the problem of synthesizing a novel view corresponding to a virtual camera given the scene description in the form of images captured from other view points. We project each line of sight emerging from the virtual camera on each of the given views, align them geometrically and assign a color that is photo consistent as per the radiance model. This being ill-conditioned, a smooth variation of depth in the scene is utilized as the regularizing constraint. It leads to development of an algorithm which is computationally fast and generates visually realistic images with negligible artifacts even with a limited number of input views. The proposed approach puts no restriction on the view points from which the input images are captured.
Funded under the Swarnajayanti Project of DST.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Shum, H., Kang, S.B.: Review of image-based rendering techniques. In: SPIE 2000, vol. 4067, pp. 2–13 (2000)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Computer Graphics 30, 11–20 (1996)
Seitz, S.M., Dyer, C.R.: View morphing. In: SIGGRAPH 1996: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pp. 21–30. ACM Press, New York (1996)
McMillan, L., Bishop, G.: Plenoptic modeling: An image-based rendering system. Computer Graphics 29, 39–46 (1995)
Levoy, M., Hanrahan, P.: Light field rendering. In: SIGGRAPH 1996: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pp. 31–42. ACM Press, New York (1996)
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. Computer Graphics 30, 43–54 (1996)
Shum, H.-Y., He, L.-W.: Rendering with concentric mosaics. Computer Graphics 33, 299–306 (1999)
Chen, S.E.: QuickTime VR — an image-based approach to virtual environment navigation. Computer Graphics 29, 29–38 (1995)
Adelson, E.H., Bergen, J.R.: The plenoptic function and the elements of early vision. In: Landy, M., Movshon, J.A. (eds.) Computational Models of Visual Processing (1991)
Irani, M., Hassner, T., Anandan, P.: What does the scene look like from a scene point? In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 883–897. Springer, Heidelberg (2002)
Fitzgibbon, A., Wexler, Y., Zisserman, A.: Image-based rendering using image-based priors. In: ICCV 2003, p. 1176. IEEE Computer Society Press, Washington (2003)
Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press, New York (2000)
Chai, J.X., Chan, S.C., Shum, H.Y., Tong, X.: Plenoptic sampling. In: SIGGRAPH 2000: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pp. 307–318. ACM Press, New York (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shah, H., Chaudhuri, S. (2006). Novel View Synthesis Using Locally Adaptive Depth Regularization. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3851. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612032_46
Download citation
DOI: https://doi.org/10.1007/11612032_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31219-2
Online ISBN: 978-3-540-32433-1
eBook Packages: Computer ScienceComputer Science (R0)