Abstract
Recently, the number of researches aiming at showing real world objects from arbitrary viewpoint have been steadily growing. The processing method is divided into three stages: 3D shape reconstruction by the visual cone intersection method, conversion of 3D shape representation from a voxel form into a triangular patch form, and coloring triangular patches. If the surface area of the object becomes larger, the frame rate decreases since the processing time of the conversion and coloring depends on the number of triangular patches. Stability of the frame rate is essential for on-line distribution of a free-viewpoint video. To solve this problem, we propose a new method which accommodates the space resolution during the 3D shape reconstruction step, thus stabilizing the number of triangular patches and the frame rate. This is achieved by raising the space resolution step by step and stopping the process on a time criteria. The reconstruction is done by using an octree-based visual cone intersection method. Experimental results show that this method makes the frame rate more stable.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Kanade, T., Rander, P.W., Narayanan, P.J.: Concepts and early results. In: IEEE Workshop on the Representation of Visual Scenes, June 1995, pp. 69–76 (1995)
Nobuhara, S., Matsuyama, T.: Heterogeneous Deformation Model for 3D Shape and Motion Recovery from Multi-Viewpoint Images. In: Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization, and Transmission, Thessaloniki, Greece, September 2004, pp. 566–573 (2004)
Carranza, J., Theobalt, C., Magnor, M.A., Seidel, H.-P.: Freeviewpoint video of human actors. ACM Trans. on Graphics 22(3), 569–577 (2003)
Ueda, M., Arita, D., Taniguchi, R.-I.: Real-Time Free-Viewpoint Video Generation Using Multiple Cameras and a PC-Cluster. In: Proc. of Pacific-Rim Conference on Multimedia, December 2004, pp. 418–425 (2004)
Martin, W.N., Aggarwal, J.K.: Volumetric description of objects from multiple views. IEEE Trans. on Pattern Analysis and Machine Intelligence 5(2), 150–158 (1983)
Matusik, W., Buehler, C., Raskar, R., Gortler, S.J., McMillan, L.: Image-Based Visual Hulls. In: Proc. of SIGGRAPH, pp. 369–374 (2000)
Sato, H., Matsuoka, H., Onozawa, A., Kitazawa, H.: Image-Based Photorealistic 3D Reconstruction Using Hexagonal Representation. IPSJ Journal 46(2), 639–648 (2005)
Arita, D., Taniguchi, R.-I.: RPV-II: A stream-based real-time parallel vision system and its application to real-time volume reconstruction. In: Proc. of Second International Workshop on Computer Vision System, July 2001, pp. 174–189 (2001)
Kenmochi, Y., Kotani, K., Imiya, A.: Marching cubes method with connectivity. In: Proc. on International Conference on Image Processing, October 1999, vol. 4, pp. 361–365 (1999)
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE Trans. on Robotics and Automation 3(4), 323–344 (1987)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nabeshima, R., Ueda, M., Arita, D., Taniguchi, Ri. (2006). Frame Rate Stabilization by Variable Resolution Shape Reconstruction for On-Line Free-Viewpoint Video Generation. In: Narayanan, P.J., Nayar, S.K., Shum, HY. (eds) Computer Vision – ACCV 2006. ACCV 2006. Lecture Notes in Computer Science, vol 3852. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11612704_9
Download citation
DOI: https://doi.org/10.1007/11612704_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31244-4
Online ISBN: 978-3-540-32432-4
eBook Packages: Computer ScienceComputer Science (R0)