Abstract
We present a system which first builds and tracks a model of a robot’s hand using a depth camera, and then uses this ability to construct a kinematic model of its own arm using very little prior information. The system is flexible, and easy to integrate with different robots, because the model building process does not require any fiducial markers to be attached to the robot’s hand. To validate the models built by the system we perform a number of experiments. The results of the experiments demonstrate that the hand model built by the system can be tracked with a precision in the order of 1mm, and that the kinematic model is accurate enough for reliably positioning the hand of the robot in camera space.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bennett, D.J., Hollerbach, J.M.: Kinematic calibration by direct estimation of the Jacobian matrix. Robotics and Automation, 351–357 (1992)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 239–256 (1992)
Chen, Y., Medioni, G.: Object modeling by registration of multiple range images. In: IEEE International Conference on Robotics and Automation, pp. 2724–2729 (1991)
Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: RGB-D Mapping: Using depth cameras for dense 3D modeling of indoor environments. In: 12th International Symposium on Experimental Robotics, ISER (2010)
Hersch, M., Sauser, E., Billard, A.: Online learning of the body schema. International Journal of Humanoid Robotics, 161 (2008)
Hoffmann, M., Marques, H., Arieta, A.: Body schema in robotics: A review. IEEE Transactions on Autonomous Mental Development, 304–324 (2010)
Kijewski, W.: SI Units, Conversion & Measurement Skills (1999)
Krainin, M., Henry, P., Ren, X.: Manipulator and object tracking for in hand 3d object modeling. University of Washington, Tech. Rep. UW-CSE-10, pp. 1–34 (2010)
Lepetit, V., Fua, P.: Monocular model-based 3D tracking of rigid bbjects: A survey. Foundations and Trends in Computer Graphics and Vision, 1–89 (2005)
Mason, M.T.: Mechanics of robotic manipulation. MIT Press (2001)
Mooring, B., Driels, M., Roth, Z.: Fundamentals of manipulator calibration. Wiley (1991)
Murray, R.M., Li, Z., Sastry, S.S.: A mathematical introduction to robotic manipulation (1994)
Pfister, H., Zwicker, M., Van Baar, J., Gross, M.: Surfels: Surface elements as rendering primitives. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 335–342 (2000)
Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., Ng, A.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software (2009)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings Third International Conference on 3-D Digital Imaging and Modeling, pp. 145–152 (2001)
Stone, H., Sanderson, A., Neuman, C.: Arm signature identification. In: IEEE International Conference on Robotics and Automation, pp. 41–48 (1986)
Sturm, J., Plagemann, C., Burgard, W.: Body schema learning for robotic manipulators from visual self-perception. In: Journal of Physiology, pp. 220–231 (2009)
Sudderth, E.B., Mandel, M.I., Freeman, W.T., Willsky, A.S.: Visual hand tracking using nonparametric belief propagation. In: Conference on Computer Vision and Pattern Recognition Workshop, pp. 189–189 (2004)
Weise, T., Wismer, T., Leibe, B., Van Gool, L.: In-hand scanning with online loop closure. In: IEEE 12th International Conference on Computer Vision, pp. 1630–1637 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Broun, A., Beck, C., Pipe, T., Mirmehdi, M., Melhuish, C. (2012). Building a Kinematic Model of a Robot’s Arm with a Depth Camera. In: Herrmann, G., et al. Advances in Autonomous Robotics. TAROS 2012. Lecture Notes in Computer Science(), vol 7429. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32527-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-32527-4_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32526-7
Online ISBN: 978-3-642-32527-4
eBook Packages: Computer ScienceComputer Science (R0)