Abstract
A novel registration method is presented for 3D point clouds, acquired from a multi-view camera, for scene reconstruction. In general, conventional registration methods require a high computational complexity, and are not robust for 3D point clouds with a low precision. To remedy these drawbacks, a projection-based registration is proposed. Firstly, depth images are refined based on temporal property by excluding 3D points with large variations, and spatial property by filling holes referring to neighboring 3D points. Secondly, 3D point clouds are projected to find correspondences and fine registration is conducted through minimizing errors. Finally, final colors are evaluated using colors of correspondences, and a 3D virtual environment is reconstructed by applying the above procedure to several views. The proposed method not only reduces computational complexity by searching for correspondences on an image plane, but also enables an effective registration even for 3D points with a low precision. The generated model can be adopted for interaction with a virtual environment as well as navigation in it.
This work was supported in part by MIC through RBRC at GIST, and in part by CTRC at GIST.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mann, S.: Mediated Reality. In: TR 260. M.I.T. Media Lab Perceptual Computing Section, Cambridge (1994)
Besl, P.J., McKay, N.D.: A Method for Registration of 3-D Shapes. IEEE Trans. on PAMI 14(2), 239–256 (1992)
Johnson, A., Kang, S.: Registration and Integration of Textured 3-D Data. Tech. report CRL96/4, Digital Equipment Corp., Cambridge Research Lab (October 1996)
Blais, G., Levine, M.D.: Registering multiview range data to create 3-D computer objects. IEEE Trans. PAMI 17(8), 820–824 (1995)
Masuda, T., Yokoya, N.: A robust method for registration and segmentation of multiple range images. Computer Vision and Image Understanding 61(3), 295–307 (1995)
Weik, S.: Registration of 3-d partial surface models using luminance and depth information. In: Proc. of 3-D Digital Imaging and Modeling, pp. 93–100 (1997)
Pulli, K.: Surface Reconstruction and Display from Range and Color Data, Ph.D. dissertation, UW (1997)
Bernardini, F., Martin, I.M., Rushmeier, H.: High-quality texture reconstruction from multiple scans. IEEE Trans. Visualization and Computer Graphics 7(4), 318–332 (2001)
Sharp, G.C., Lee, S.W., Wehe, D.K.: Invariant Features and the Registration of Rigid Bodies. In: IEEE Int’l Conf., on Robotics and Automation, pp. 932–937 (1999)
Fisher, R.: Projective ICP and Stabilizing Architectural Augmented Reality Overlays. In: VAA 2001, pp. 69–80 (2001)
Nishino, K., Ikeuchi, K.: Robust Simultaneous Registration of Multiple Range Images Comprising A Large Number of Points. In: ACCV 2002 (2002)
Kim, S., Kim, K., Woo, W.: Projection-based Registration using Color and Texture Information for Virtual Environment Generation. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3331, pp. 434–443. Springer, Heidelberg (2004)
Kim, K., Woo, W.: Multi-view Camera Tracking for Modeling of Indoor Environment. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM 2004. LNCS, vol. 3331, pp. 288–297. Springer, Heidelberg (2004)
KLT: Kanade-Lucas-Tomasi Feature Tracker (2005), http://www.ces.clemson.edu/~stb/klt/
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Comm. of ACM 24, 381–395 (1981)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2004)
Tsai, R.: A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Journal of Robotics and Automation 3(4), 323–344 (1987)
Point Grey Research Inc. (2002), http://www.ptgrey.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, S., Woo, W. (2005). Indoor Scene Reconstruction Using a Projection-Based Registration Technique of Multi-view Depth Images. In: Ho, YS., Kim, HJ. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11582267_66
Download citation
DOI: https://doi.org/10.1007/11582267_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30040-3
Online ISBN: 978-3-540-32131-6
eBook Packages: Computer ScienceComputer Science (R0)