Abstract
In this paper, we present a depth-extracting method on the scenes of 4D light fields. The method is based on image segmentation and epipolar plane images. We extract disparity map and reliability map from the original image of 4D light fields. Then this information is applied to image segmentation, in which a large number of planes are produced, so that the disparity map which is consist of pixels can be transferred to the disparity map which is consist of planes. In the resulting optimization problem, graph-cut technique is used to assign a corresponding disparity plane to each segment. Our method is tested on a number of synthetic and real-world examples captured with a light field camera, and compared to ground truth where available. Furthermore, an approach to optimize the method to reduce the running time is also proposed.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis 40(1), 120–145 (2011)
Criminisi, A., Kang, S., Swaminathan, R., Szeliski, R., Anandan, P.: Extracting layers and analyzing their specular properties using epipolar-plane-image analysis. Computer vision and image understanding 97(1), 51–85 (2005)
Goldluecke, B., Wanner, S.: The variational structure of disparity and regularization of 4d light fields. In: International Conference on Computer Vision and Pattern Recognition (2013)
Strekalovskiy, E., Cremers, D.: Generalized ordering constraints for multilabel optimization. In: International Conference on Computer Vision (2011)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. In: Computer Vision and Pattern Recognition (2009)
Berent, J., Dragotti, P.: Segmentation of epipolar-plane image volumes with occlusion and disocclusion competition. In: IEEE 8th Workshop on Multimedia Signal Processing, pp. 182–185 (2006)
Bleyer, M., Rother, C., Kohli, P., Scharstein, D., Sinha, S.: Object stereo - joint stereo matching and object segmentation. In: Computer Vision and Pattern Recognition (2011)
Matousek, M., Werner, T., Hlavac, V.: Accurate correspondences from epipolar plane images. Computer Vision Winter Workshop, pp. 181–189 (2001)
Campbell, N., Vogiatzis, G., Hernandez, C., Cipolla, R.: Automatic object segmentation from calibrated images. In: Conference for Visual Media Production (2011)
Bolles, R., Baker, H., Marimont, D.: Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision 1(1), 7–55 (1987)
Vicente, S., Kolmogorov, V., Rother, C.: Joint optimization of segmentation and appearance models. In: International Conference on Computer Vision and Pattern Recognition (2009)
Wanner, S., Goldluecke, B.: Globally consistent depth labeling of 4d light fields. In: Computer Vision and Pattern Recognition, pp. 41–48 (2012)
Wanner, S., Fehr, J., Jähne, B.: Generating EPI Representations of 4D Light Fields with a Single Lens Focused Plenoptic Camera. In: Boyle, R., Parvin, B., Koracin, D., Wang, S., Kyungnam, K., Benes, B., Moreland, K., Borst, C., Di Verdi, S., Yi-Jen, C., Ming, J., Bebis, G. (eds.) ISVC 2011, Part I. LNCS, vol. 6938, pp. 90–101. Springer, Heidelberg (2011)
Bishop, T.E., Favaro, P.: Full-Resolution depth map estimation from an aliased plenoptic light field. In: Sugimoto, A., Klette, R., Kimmel, R. (eds.) ACCV 2010, Part II. LNCS, vol. 6493, pp. 186–200. Springer, Heidelberg (2011)
Pock, T., Cremers, D., Bischof, H., Chambolle, A.: Global solutions of variational models with convex regularization. SIAM Journal on Imaging Sciences (2010)
Lee, W., Wontack, W., Boyer, E.: Silhouette segmentation in multiple views. Transactions on Pattern Analysis and Machine Intelligence (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Shao, W., Sheng, H., Li, C. (2015). Segment-Based Depth Estimation in Light Field Using Graph Cut. In: Zhang, S., Wirsing, M., Zhang, Z. (eds) Knowledge Science, Engineering and Management. KSEM 2015. Lecture Notes in Computer Science(), vol 9403. Springer, Cham. https://doi.org/10.1007/978-3-319-25159-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-25159-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25158-5
Online ISBN: 978-3-319-25159-2
eBook Packages: Computer ScienceComputer Science (R0)