Skip to main content

Towards Reliable Grasping and Manipulation in Household Environments

  • Chapter
Experimental Robotics

Abstract

We present a complete software architecture for reliable grasping of household objects. Our work combines aspects such as scene interpretation from 3D range data, grasp planning, motion planning, and grasp failure identification and recovery using tactile sensors. We build upon, and add several new contributions to the significant prior work in these areas. A salient feature of our work is the tight coupling between perception (both visual and tactile) and manipulation, aiming to address the uncertainty due to sensor and execution errors. This integration effort has revealed new challenges, some of which can be addressed through system and software engineering, and some of which present opportunities for future research. Our approach is aimed at typical indoor environments, and is validated by long running experiments where the PR2 robotic platform was able to consistently grasp a large variety of known and unknown objects. The set of tools and algorithms for object grasping presented here have been integrated into the open-source Robot Operating System (ROS).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balasubramanian, R., Xu, L., Brook, P., Smith, J., Matsuoka, Y.: Human-guided grasp measures improve grasp robustness on physical robot. In: IEEE Intl. Conf. on Robotics and Automation (2010)

    Google Scholar 

  2. Besl, P., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence 14(2) (1992)

    Google Scholar 

  3. Şucan, I., Kalakrishnan, M., Chitta, S.: Combining planning techniques for manipulation using realtime perception. In: IEEE Intl. Conf. on Robotics and Automation (2010)

    Google Scholar 

  4. Goldfeder, C., Ciocarlie, M., Peretzman, J., Dang, H., Allen, P.: Data-driven grasping with partial sensor data. In: IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (2009)

    Google Scholar 

  5. Hsiao, K., Chitta, S., Ciocarlie, M., Jones, E.G.: Contact-reactive grasping of objects with partial shape information. In: Workshop on Mobile Manipulation, IEEE Intl. Conf. on Robotics and Automation (2010)

    Google Scholar 

  6. Inamura, T., Okada, K., Tokutsu, S., Hatao, N., Inaba, M., Inoue, H.: HRP-2W: A humanoid platform for research on support behavior in daily life environments. Robotics and Autonomous Systems (2009)

    Google Scholar 

  7. Jain, A., Kemp, C.: EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces. Autonomous Robots (2010)

    Google Scholar 

  8. Miller, A., Allen, P.K.: GraspIt!: a versatile simulator for robotic grasping. IEEE Robotics and Automation Magazine 11(4) (2004)

    Google Scholar 

  9. Partlitz, C., Hagele, M., Klein, P., Seifert, J., Dautenhahn, K.: Care-o-bot 3 - rationale for human-robot interaction design. In: Intl. Symposium on Robotics (2008)

    Google Scholar 

  10. Ratliff, N., Zucker, M., Bagnell, J.A., Srinivasa, S.: CHOMP: Gradient optimization techniques for efficient motion planning. In: IEEE Intl. Conf. on Robotics and Automation, pp. 489–494 (2009)

    Google Scholar 

  11. Romano, J.M., Hsiao, K., Niemeyer, G., Chitta, S., Kuchenbecker, K.J.: Human-inspired robotic grasp control with tactile sensing. Under Review (2011)

    Google Scholar 

  12. Rusu, R., Sucan, I., Gerkey, B., Chitta, S., Beetz, M., Kavraki, L.: Real-time perception-guided motion planning for a personal robot. In: IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (2009)

    Google Scholar 

  13. Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3d registration. In: IEEE Intl. Conf. on Robotics and Automation (2009)

    Google Scholar 

  14. Sánchez, G., Latombe, J.C.: A single-query bi-directional probabilistic roadmap planner with lazy collision checking. Intl. Journal of Robotics Research 6, 403–417 (2003)

    Article  Google Scholar 

  15. Saxena, A., Wong, L., Ng, A.: Learning grasp strategies with partial shape information. In: AAAI Conf. on Artificial Intelligence (2008)

    Google Scholar 

  16. Srinivasa, S., Ferguson, D., Weghe, M., Diankov, R., Berenson, D., Helfrich, C., Strasdat, H.: The robotic busboy: Steps towards developing a mobile robotic home assistant. In: Intl. Conf. on Intelligent Autonomous Systems (2008)

    Google Scholar 

  17. Stuckler, J., Schreiber, M., Behnke, S.: Dynamaid, an anthropomorphic robot for research on domestic service applications. In: European Conf. on Mobile Robots (2009)

    Google Scholar 

  18. Sucan, I.A., Kavraki, L.: Kinodynamic motion planning by interior-exterior cell exploration. In: Workshop on the Algorithmic Foundations of Robotics (2008)

    Google Scholar 

  19. Sucan, I.A., Moll, M., Kavraki, L. (2010), http://www.ros.org/wiki/ompl

  20. Wurm, K.M., Hornung, A., Bennewitz, M., Stachniss, C., Burgard, W.: OctoMap: A probabilistic, flexible, and compact 3D map representation for robotic systems. In: Workshop on Best Practice in 3D Perception and Modeling for Mobile Manipulation, IEEE Intl. Conf. on Robotics and Automation (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matei Ciocarlie .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag GmbH Berlin Heidelberg

About this chapter

Cite this chapter

Ciocarlie, M., Hsiao, K., Jones, E.G., Chitta, S., Rusu, R.B., Şucan, I.A. (2014). Towards Reliable Grasping and Manipulation in Household Environments. In: Khatib, O., Kumar, V., Sukhatme, G. (eds) Experimental Robotics. Springer Tracts in Advanced Robotics, vol 79. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28572-1_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28572-1_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28571-4

  • Online ISBN: 978-3-642-28572-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics