Abstract
In this paper we present a new framework for an accelerated 3D reconstruction of deformable objects within a multi-view setup. It is based on a new memory management and an enhanced algorithm pipeline of the well known Image-Based Visual Hull (IBVH) algorithm that enables efficient and fast reconstruction results and opens up new perspectives for the scalability of time consuming computations within larger camera environments. As a result, a significant increase of frame rates for the volumetric reconstruction of deformable objects can be achieved using an optimized CUDA-based implementation on NVIDIA’s Fermi-GPUs.
Chapter PDF
References
Matusik, W., Buehler, C., Raskar, R., Gortler, S.J., McMillan, L.: Image-Based Visual Hulls. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2000, pp. 369–374. ACM Press/Addison-Wesley Publishing Co., New York (2000)
Laurentini, A.: The Visual Hull Concept for Silhouette-Based Image Understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(2), 150–162 (1994)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, pp. 519–526 (2006)
Hornung, A., Kobbelt, L.: Robust and Efficient Photo-Consistency Estimation for Volumetric 3D Reconstruction. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 179–190. Springer, Heidelberg (2006)
Furukawa, Y., Ponce, J.: Accurate, Dense, and Robust Multiview Stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1362–1376 (2010)
Corazza, S., Mündermann, L., Gambaretto, E., Ferrigno, G., Andriacchi, T.: Markerless Motion Capture through Visual Hull, Articulated ICP and Subject Specific Model Generation. International Journal of Computer Vision 87, 156–169 (2010)
Graf, H., Yoon, S.M., Malerczyk, C.: Real-time 3D Reconstruction and Pose Estimation for Human Motion Analysis. In: Proceedings of the 2010 17th IEEE International Conference on Image Processing, ICIP 2010, pp. 3981–3984 (2010)
Owens, J.D., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A., Purcell, T.J.: A Survey of General-Purpose Computation on Graphics Hardware. Computer Graphics Forum 26(1), 80–113 (2007)
Fung, J., Mann, S.: Using Graphics Devices in Reverse: GPU based Image Processing and Computer Vision. In: Proceedings of the 2008 IEEE International Conference on Multimedia and Expo, ICME 2008, pp. 9–12 (2008)
Rossi, R., Savatier, X., Ertaud, J.-Y., Mazari, B.: Real-time 3D Reconstruction for Mobile Robot Using Catadioptric Cameras. In: Proceedings of the 2009 IEEE International Workshop on Robotic and Sensors Environments, ROSE 2009, pp. 104–109 (2009)
Weinlich, A., Keck, B., Scherl, H., Kowarschik, M., Hornegger, J.: Comparison of High-Speed Ray Casting on GPU using CUDA and OpenGL. In: Proceedings of the First International Workshop on New Frontiers in High-performance and Hardware-aware Computing, pp. 25–30 (2008)
Waizenegger, W., Feldmann, I., Eisert, P., Kauff, P.: Parallel High Resolution Real-time Visual Hull on GPU. In: Proceedings of the 2009 16th IEEE International Conference on Image Processing, ICIP 2009, pp. 4301–4304 (2009)
Ladikos, A., Benhimane, S., Navab, N.: Efficient Visual Hull Computation for Real-time 3D Reconstruction using CUDA. In: Proceedings of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2008, pp. 1–8 (2008)
Kim, H., Sakamoto, R., Kitahara, I., Orman, N., Toriyama, T., Kogure, K.: Compensated Visual Hull for Defective Segmentation and Occlusion. In: Proceedings of the 17th International Conference on Artificial Reality and Telexistence, ICAT 2007, pp. 210–217 (2007)
Castano-Diez, D., Moser, D., Schoenegger, A., Pruggnaller, S., Frangakis, A.S.: Performance Evaluation of Image Processing Algorithms on the GPU. Journal of Structural Biology 164, 153–160 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Graf, H., Hazke, L., Kahn, S., Malerczyk, C. (2011). Accelerated Real-Time Reconstruction of 3D Deformable Objects from Multi-view Video Channels. In: Duffy, V.G. (eds) Digital Human Modeling. ICDHM 2011. Lecture Notes in Computer Science, vol 6777. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21799-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-21799-9_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21798-2
Online ISBN: 978-3-642-21799-9
eBook Packages: Computer ScienceComputer Science (R0)