Abstract
In this paper we introduce an online object manipulation system for the NAO robot that is able to detect and grasp an object out of a human hand and then give it back in real-time. Known objects are rendered from 3D models and detected stereo contour-based by using a new stereo vision head for NAO. In order to grasp objects, motion trajectories are generated by an A* planner while avoiding obstacles. In order to safely release objects back into a human hand, a combination of tactile and force sensors of the carrying arm is used to detect whether someone touched the grasped object. We performed quantitative experiments in order to evaluate the quality of the detector, the time to grasp an object, as well as the number of successful grasps. We demonstrated the whole system on the real robot.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Gouaillier, D., Hugel, V., Blazevic, P., Kilner, C., Monceaux, J., Lafourcade, P., Marnier, B., Serre, J., Maisonnier, B.: Mechatronic design of NAO humanoid. In: IEEE International Conference on Robotics and Automation, ICRA 2009, pp. 769–774 (May 2009)
Müller, J., Frese, U., Röfer, T.: Grab a mug - object detection and grasp motion planning with the Nao robot. In: IEEE-RAS International Conference on Humanoid Robots (2012)
Azad, P., Asfour, T., Dillmann, R.: Stereo-based 6D object localization for grasping with humanoid robot systems. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007, October 29-November 2, pp. 919–924 (2007)
Cotugno, G., Mellmann, H.: Dynamic motion control: Adaptive bimanual grasping for a humanoid robot. In: Proceedings of the Workshop on Concurrency, Specification, and Programming CS&P 2010, Börnicke (near Berlin), Germany, vol. 2 (September 2010)
Stuckler, J., Holz, D., Behnke, S.: Robocup@home: Demonstrating everyday manipulation skills in robocup@home. IEEE Robotics Automation Magazine 19(2), 34–42 (2012)
Hegger, F., Mueller, C.A., Jin, Z., Alvarez Ruiz, J., Giorgana, G.R.G., Hochgeschwender, N., Reckhaus, M., Paulus, J., Ploeger, P.G., Kraetzschmar, G.K.: The b-it-bots robocup@home 2011 team description paper. In: Proc. RoboCup Symp. (2011)
Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004)
Stückler, J., Steffens, R., Holz, D., Behnke, S.: Efficient 3d object perception and grasp planning for mobile manipulation in domestic environments. Robotics and Autonomous Systems (2012)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Rusu, R., Blodow, N., Marton, Z., Beetz, M.: Close-range scene segmentation and reconstruction of 3d point cloud maps for mobile manipulation in domestic environments. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, pp. 1–6 (2009)
Hsiao, K., Chitta, S., Ciocarlie, M., Jones, E.: Contact-reactive grasping of objects with partial shape information. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1228–1235 (2010)
Stückler, J., Behnke, S.: Following human guidance to cooperatively carry a large object. In: IEEE-RAS Int. Conf. Humanoid Robots (Humanoids), Bled, Slowenia, pp. 218–223 (2011)
Kuffner Jr., J.J., Kagami, S., Nishiwaki, K., Inaba, M., Inoue, H.: Dynamically-stable motion planning for humanoid robots. Autonomous Robots 12(1), 105–118 (2002)
Burget, F., Hornung, A., Bennewitz, M.: Whole-body motion planning for manipulation of articulated objects. In: Proceedings of the IEEE International Conference on Robotics and Automation, ICRA (2013)
Kavraki, L., Svestka, P., Latombe, J.C., Overmars, M.: Probabilistic roadmaps for path planning in high-dimensional configuration spaces. IEEE Transactions on Robotics and Automation 12(4), 566–580 (1996)
Harada, K., Kaneko, K., Kanehiro, F.: Fast grasp planning for hand/arm systems based on convex model. In: IEEE International Conference on Robotics and Automation, ICRA 2008, pp. 1162–1168 (May 2008)
Vahrenkamp, N., Asfour, T., Dillmann, R.: Simultaneous grasp and motion planning: Humanoid robot armar-iii. IEEE Robotics Automation Magazine 19(2), 43–57 (2012)
Zacharias, F., Borst, C., Hirzinger, G.: Object-specific grasp maps for use in planning manipulation actions. In: Kröger, T., Wahl, F.M. (eds.) Advances in Robotics Research, pp. 203–213. Springer, Heidelberg (2009)
Zacharias, F., Borst, C., Hirzinger, G.: Capturing robot workspace structure: representing robot capabilities. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2007, October 29-November 2, pp. 3229–3236 (2007)
Lalibertže, K., Birglen, L., Gosselin, C.M.: Underactuation in robotic grasping hands. Journal of Machine Intelligence and Robotic Control 4, 77–87 (2002)
Borst, C., Fischer, M., Hirzinger, G.: Grasping the dice by dicing the grasp. In: Proceedings. 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2003, vol. 4, pp. 3692–3697 (October 2003)
Kragten, G., Kool, A., Herder, J.: Ability to hold grasped objects by underactuated hands: Performance prediction and experiments. In: IEEE International Conference on Robotics and Automation, ICRA 2009, pp. 2493–2498 (May 2009)
Aptina, http://www.aptina.com/products/soc/mt9m114/ (accessed: June 03, 2013)
DeRose, T.D., Barsky, B.A.: Geometric continuity, shape parameters, and geometric constructions for Catmull-Rom splines. ACM Trans. Graph. 7(1), 1–41 (1988)
Müller, J., Laue, T., Röfer, T.: Kicking a ball – modeling complex dynamic motions for humanoid robots. In: Ruiz-del-Solar, J., Chown, E., Ploeger, P.G. (eds.) RoboCup 2010. LNCS (LNAI), vol. 6556, pp. 109–120. Springer, Heidelberg (2010)
Itoh, K., Ohno, Y.: A curve fitting algorithm for character fonts. Electronic Publishing 6(3), 195–198 (1993)
Herold, J.: Least squares Bezier fit, http://jimherold.com/2012/04/20/least-squares-bezier-fit/ (accessed: June 03, 2013)
Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical recipes in C the art of scientific computing, 2nd edn. Cambridge University Press, New York (1992)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Müller, J., Frese, U., Röfer, T., Gelin, R., Mazel, A. (2014). GRASPY – Object Manipulation with NAO. In: Röhrbein, F., Veiga, G., Natale, C. (eds) Gearing Up and Accelerating Cross‐fertilization between Academic and Industrial Robotics Research in Europe:. Springer Tracts in Advanced Robotics, vol 94. Springer, Cham. https://doi.org/10.1007/978-3-319-03838-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-03838-4_9
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03837-7
Online ISBN: 978-3-319-03838-4
eBook Packages: EngineeringEngineering (R0)