Abstract
We present a method for augmenting the 3D reconstruction of a dynamic indoor scene using Pan-Tilt-Zoom cameras. The system combines Pan-Tilt-Zoom cameras with static wide field-of-view depth cameras within a networked platform. Traditionally, Pan-Tilt-Zoom cameras have been extensively used in surveillance applications, since their ability to pan, tilt and zoom in on an object allows them to cover a large area with a reduced number of cameras. However, most of the existing work with PTZ cameras deals with scanning or tracking objects in large outdoor environments, where objects are typically large distances away from the cameras. We use PTZ cameras in an indoor setting to zoom in on relevant and interesting objects to get fine visual details. The fine details and high resolution imagery enables us to augment and refine the room’s 3D surface as constructed from off-the-shelf depth cameras statically mounted around the room. We show significant improvements in both texture quality and geometry when high-resolution imagery from multiple PTZ cameras is used to supplement the 3D model built from fixed commodity depth cameras.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Dou, M., Fuchs, H.: Temporally enhanced 3d capture of room-sized dynamic scenes with commodity depth cameras. In: IEEE VR (2014)
Yous, S., Ukita, N., Kidode, M.: An assignment scheme to control multiple pan/tilt cameras for 3d video. Journal of Multimedia 2 (2007)
Davis, J.E.: Mixed Scale Motion Recovery. PhD thesis, Stanford University (2002)
Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence, IEEE Transactions on Visualization and Computer Graphics (2013)
Matsuyama, T., Wu, X., Takai, T., Nobuhara, S.: Real-time 3d shape reconstruction, dynamic 3d mesh deformation, and high fidelity visualization for 3d video. Journal of Computer Vision and Image Understanding 96, 393 (2004)
Kutulakos, K.N., Seitz, S.M.: A theory of shape by shape carving. Interntional Journal of Computer Vision 38, 198 (2000)
Ilie, A., Welch, G.: Automated camera selection and control for better training support. In: 15th International Conference on Human-Computer Interaction, p. 50 (2013)
Wan, D., Zhou, J.: Stereo vision using two ptz cameras. Computer Vision and Image Understanding 112, 184 (2008)
Sinha, S.N., Pollefeys, M.: Towards calibrating a pan-tilt-zoom camera network. In: Workshop on Omnidirectional Vision and Camera Networks, ECCV (2004)
Sinha, S.N., Pollefeys, M., Kim, S.J.: High resolution multiscale panoramic mosaics from pan-tilt-zoom cameras. In: 4th Indian Conference on Computer Vision, Graphics and Image Processing (2004)
Kumar, S., Micheloni, C., Piciarelli, C.: Stereo localization using dual PTZ cameras. In: Jiang, X., Petkov, N. (eds.) CAIP 2009. LNCS, vol. 5702, pp. 1061–1069. Springer, Heidelberg (2009)
Dou, M., Guan, L., Frahm, J.-M., Fuchs, H.: Exploring high-level plane primitives for indoor 3D reconstruction with a hand-held RGB-D camera. In: Park, J.-I., Kim, J. (eds.) ACCV Workshops 2012, Part II. LNCS, vol. 7729, pp. 94–108. Springer, Heidelberg (2013)
Lorensen, W.E., Cline, H.E.: Marching cubes: A high resolution 3d surface construction algorithm. Computer Graphics 21 (1987)
Lowe, D.G.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, p. 1150 (1999)
Hirschmuller, H.: Stereo processing by semiglobal matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (2008)
Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rossl, C., Seidel, H.P.: Laplacian surface editing. ACM Transactions on Computer Graphics and Modeling 175 (2004)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Eurographics Symposium on Geometry Processing (2006)
Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Naweed, A.U., Chen, L., Dou, M., Fuchs, H. (2014). Enhancement of 3D Capture of Room-Sized Dynamic Scenes with Pan-Tilt-Zoom Cameras. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-14249-4_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14248-7
Online ISBN: 978-3-319-14249-4
eBook Packages: Computer ScienceComputer Science (R0)