Abstract
In this paper, we present and analyze a depth imaging system based on the integration of active stereo matching and structured light methods. The integration of these methods benefits from the advantages of the two approaches, allowing a shape recovery from a wider view with less occlusion. We build a system composed of two cameras and a projector, and project a single one-shot pattern. We first use the structured light part in order to estimate reliable correspondences between each camera and the projector via an efficient pattern decoding technique. The remaining unresolved regions are explored by a stereo matching technique which is less sensitive to object surface colors and projectors short depth of field to estimate additional correspondences. By switching between the colored pattern and a white light, the texture information of the system is retrieved at the same time and from the same viewpoint. Finally, we present a thoughtful and in-depth analysis of the capabilities and limitations of the presented system in the context of the development and contents creation for depth image-based representation (DIBR) 3DTV. Through carefully designed experiments we quantify the depth range of the camera system, the effects of the projector depth of field on the pattern decoding performance and the robustness to scene surface colors with respect to their hue, saturation, and brightness.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Je, C., Lee, S., Park, R.: High-Contrast Color Stripe Pattern for Rapid Structured-Light Range Imaging. In: European Conference on Computer Vision, pp. 95–107 (2004)
Fechteler, P., Eisert, P., Rurainsky, J.: Fast and high resolution 3D face scanning. In: IEEE International Conference on Image Processing, vol. 3, pp. 81–84 (2007)
Scharstein, D., Szeliski, R.: High-Accuracy Stereo Depth Maps Using Structured Light. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 195–202 (2003)
Zhang, L., Curless, B., Seitz, S.M.: Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming. In: International Symposium on 3D Data Processing, Visualization and Transmission, pp. 24–36 (2002)
Ilie, A., Welch, G.: Ensuring color consistency across multiple cameras. In: IEEE International Conference on Computer vision, vol. 2, pp. 1268–1275 (2005)
Kawasaki, H., Furukawa, R., Sagawa, R., Yagi, Y.: Dynamic scene shape reconstruction using a single structured light pattern. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Bouget, J.Y.: Camera Calibration Toolbox for Matlab, www.vision.caltech.edu/bougetj
Zhang, S., Huang, P.S.: High-resolution, real-time three-dimensional shape measurement. In: SPIE Optical Engineering, vol 45 (2006)
Wust, C., Capson, D.W.: Surface profile measurement using color fringe projection. Machine Vision Applications 4, 193–203 (1991)
Viejo, D., Saez, J.M., Cazorla, M.A., Escolano, F.: Active Stereo Based Compact Mapping. In: Intelligent Robots and Systems, pp. 529–534 (2005)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal on Computer Vision 47, 7–42 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ribera, R.B., Kim, T., Kim, J., Hur, N. (2009). Dense Depth Map Acquisition System for 3DTV Applications Based on Active Stereo and Structured Light Integration. In: Muneesawang, P., Wu, F., Kumazawa, I., Roeksabutr, A., Liao, M., Tang, X. (eds) Advances in Multimedia Information Processing - PCM 2009. PCM 2009. Lecture Notes in Computer Science, vol 5879. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10467-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-10467-1_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10466-4
Online ISBN: 978-3-642-10467-1
eBook Packages: Computer ScienceComputer Science (R0)