Abstract
This contribution discusses the 3D reconstruction of deformable freeform surfaces with high spatial and temporal resolution. These are conflicting requirements, since high-resolution surface scanners typically cannot achieve high temporal resolution, while high-speed range cameras like the Time-of-Flight (ToF) cameras capture depth at 25 fps but have a limited spatial resolution. We propose to combine a high-resolution surface scan with a ToF-camera and a color camera to achieve both requirements. The 3D surface deformation is modeled by a NURBS surface that approximates the object surface and estimates the 3D object motion and local 3D deformation from the ToF and color camera data. A set of few NURBS control points can faithfully model the motion and deformation and will be estimated from the ToF and color data with high accuracy. The contribution will focus on the estimation of the 3D deformation NURBS from the ToF and color data.
This work was supported by the German Research Foundation (DFG), KO-2044/3-2 and the EU Interreg A4 Project “Intelligent Robots for Handling flexible Objects” (IRFO), 33-1.2-09
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Montagnat, J., Delingette, H., Ayache, N.: A review of deformable surfaces: topology, geometry and deformation. Image and Vision Computing 19(14), 1023–1040 (2001)
Cohen, F.S., Ibrahim, W., Pintavirooj, C.: Ordering and parameterizing scattered 3d data for b-spline surface approximation. IEEE Transactions on pattern analysis and machine intelligence 22(6), 642–648 (2000)
Cagniar, C., Boyer, E., Ilic, S.: Iterative mesh deformation for dense surface tracking. In: 12th International Conference on Computer Vision Workshops (2009)
Zhu, J., Hoi, S.C.H., Xu, Z., Lyu, M.R.: An effective approach to 3d deformable surface tracking. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 766–779. Springer, Heidelberg (2008)
Bowyer, K.W., Chang, K., Flynn, P.: A survey of approaches and challenges in 3d and multi-modal 3d+2d face recognition. Computer Vision and Image Understanding 101(1), 1–15 (2006)
Zhang, L., Snavely, N., Curless, B., Seitz, S.M.: Spacetime faces: High-resolution capture for modeling and animation. In: ACM Annual Conference on Computer Graphics, pp. 548–558 (August 2004)
Walder, C., Breidt, M., Buelthoff, H.H., Schoelkopf, B., Curio, C.: Markerless 3d face tracking. In: Denzler, J., Notni, G., Süe, H. (eds.) DAGM 2009. LNCS, vol. 5748, pp. 41–50. Springer, Heidelberg (2009)
Xu, Z., Schwarte, R., Heinol, H., Buxbaum, B., Ringbeck., T.: Smart pixel - photonic mixer device (pmd). In: M2VIP 1998 - International Conference on Mechatronics and Machine Vision in Practice, pp. 259–264 (1998)
Lange, R., Seitz, P., Biber, A., Schwarte, R.: Time-of-flight range imaging with a custom solid-state imagesensor. In: EOS/SPIE Laser Metrology and Inspection, vol. 3823 (1999)
Schiller, I., Beder, C., Koch, R.: Calibration of a pmd camera using a planar calibration object together with a multi-camera setup. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, China, vol. XXXVII, Part B3a, pp. 297–302. XXI. ISPRS Congress (2008)
Shi, J., Tomasi, C.: Good features to track. In: Conference on Computer Vision and Pattern Recognition, Seattle, pp. 593–600. IEEE, Los Alamitos (June 1994)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000) ISBN: 0521623049
Piegl, L., Tiller, W.: The NURBS Book, 2nd edn. Springer, Berlin (1997)
Isgro, F., Odone, F., Verri, A.: An open system for 3d data acquisition from multiple sensor. In: CAMP 2005:7th Int. Workshop on Computer Architecture for Machine Perception, Washington, DC, USA, pp. 52–57. IEEE Computer Society, Los Alamitos (2005)
Terzopoulos, D., Qin, H.: Dynamic nurbs with geometric constraints for interactive sculpting. ACM Trans. Graph. 13(2), 103–136 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jordt, A., Schiller, I., Bruenger, J., Koch, R. (2010). High-Resolution Object Deformation Reconstruction with Active Range Camera. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds) Pattern Recognition. DAGM 2010. Lecture Notes in Computer Science, vol 6376. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15986-2_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-15986-2_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15985-5
Online ISBN: 978-3-642-15986-2
eBook Packages: Computer ScienceComputer Science (R0)