Skip to main content

Generalizing Demonstrated Manipulation Tasks

  • Chapter
Algorithmic Foundations of Robotics V

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 7))

Abstract

Captured human motion data can provide a rich source of examples of successful manipulation strategies. General techniques for adapting these examples for use in robotics are not yet available, however, in part because the problem to be solved by the robot will rarely be the same as that in the human demonstration. This paper considers the problem of adapting a human demonstration of a quasistatic manipulation task to new objects and friction conditions (Figure 1). We argue that a manipulation plan is similar to a demonstration if it involves the identical number of contacts and if the applied contact wrenches follow similar trajectories. Based on this notion of similarity, we present an algorithm that uses the human demonstration to constrain the solution space to a set of manipulation plans similar to the demonstration. Our algorithm provides guarantees on maximum task forces and flexibility in contact placement. Results for the task of tumbling large, heavy objects show that manipulation plans similar to a demonstration can be synthesized for a variety of object sizes, shapes, and coefficients of friction. Experimental results with a humanoid robot show that the approach produces natural-looking motion in addition to effective manipulation plans.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Y. Aiyama, M. Inaba, and H. Inoue. Pivoting: A new method of graspless manipulation of object by robot fingers. In Proc. IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, 1993.

    Google Scholar 

  2. H. Asada and Y. Asari. The direct teaching of tool manipulation skills via the impedance identification of human motion. In Proc. IEEE Intl. Conference on Robotics and Automation, 1988.

    Google Scholar 

  3. C. G. Atkeson and S. Schaal. Robot learning from demonstration. In International Conference on Machine Learning, 1997.

    Google Scholar 

  4. A. Bicchi. Hands for dexterous manipulation and robust grasping: A difficult road toward simplicity. IEEE Transactions on Robotics and Automation, 16 (6): 652–662, 2000.

    Article  Google Scholar 

  5. I-M. Chen and J. W. Burdick. Finding antipodal point grasps on irregularly shaped objects. IEEE Transactions on Robotics and Automation, 9 (4): 507–512, 1993.

    Article  Google Scholar 

  6. DB. http://www.his.atr.co.jp/cyh//cyh/.

  7. M. Erdmann. An exploration of nonprehensile two-palm manipulation. International Journal of Robotics Research, 17 (5), 1998.

    Google Scholar 

  8. S. B. Kang and K. Ikeuchi. Toward automatic robot instruction from perception-Temporal segmentation of tasks from human hand motion. IEEE Transactions on Robotics and Automation, 11 (5): 670–681, 1995.

    Article  Google Scholar 

  9. Y. Kuniyoshi, M. Inaba, and H. Inoue. Learning by watching: Extracting reusable task knowledge from visual observation of human performance. IEEE Transactions on Robotics and Automation, 10 (6): 799–822, 1994.

    Article  Google Scholar 

  10. S. Liu and H. Asada. Transferring manipulative skills to robots: Representation and acquisition of tool manipulative skills using a process dynamics model. Journal of Dynamic Systems, Measurement, and Control, 114: 220–228, June 1992.

    Article  MATH  Google Scholar 

  11. Y.-H. Liu. Computing n-finger form-closure grasps on polygonal objects. International Journal of Robotics Research, 19 (2): 149–158, February 2000.

    Article  Google Scholar 

  12. K. M. Lynch. Toppling manipulation. In Proc. IEEE Intl. Conference on Robotics and Automation, 1999.

    Google Scholar 

  13. K. M. Lynch and M. T. Mason. Dynamic nonprehensile manipulation: Controllability, planning, and experiments. International Journal of Robotics Research, 18 (l): 64–92, January 1999.

    Article  Google Scholar 

  14. V. Nguyen. Constructing force-closure grasps. International Journal of Robotics Research, 7 (3): 3–16, June 1988.

    Article  Google Scholar 

  15. N. S. Pollard. Parallel methods for synthesizing whole-hand grasps from generalized prototypes. Technical Report AI-TR-1464, MIT AI Lab., January 1994.

    Google Scholar 

  16. N. S. Pollard. Synthesizing grasps from generalized prototypes. In Proc. IEEE Intl. Conference on Robotics and Automation, April 1996.

    Google Scholar 

  17. N. S. Pollard, J. K. Hodgins, M. J. Riley, and C. G. Atkeson. Adapting human motion for the control of a humanoid robot. In Proc. IEEE Intl. Conference on Robotics and Automation, May 2002.

    Google Scholar 

  18. J. Ponce and B. Faverjon. On computing three-finger force-closure grasps of polygonal objects. IEEE Transactions on Robotics and Automation, 11 (6): 868–881, 1995.

    Article  Google Scholar 

  19. J. Ponce, D. Stam, and B. Faverjon. On computing force-closure grasps of curved two-dimensional objects. International Journal of Robotics Research, 12 (3): 263–273, June 1993.

    Article  Google Scholar 

  20. J. Ponce, S. Sullivan, A. Sudsang, J.-D. Boissonnat, and J.-P. Merlet. On computing four-finger equilibrium and force-closure grasps of polyhedral objects. International Journal of Robotics Research, 16 (1): 11–35, February 1997.

    Article  Google Scholar 

  21. N. Sawasaki, M. Inaba, and H. Inoue. Tumbling objects using a multi-fingered robot. In Proc. 20th ISIR, 1989.

    Google Scholar 

  22. S. Schaal, C. G. Atkeson, and S. Vijayakumar. Scalable techniques from non-parametric statistics for real-time robot learning. Applied Intelligence, (in press).

    Google Scholar 

  23. Vicon Motion Systems, http://www.vicon.com/.

  24. J. C. Trinkle and R. P. Paul. Planning for dexterous manipulation with sliding contacts. International Journal of Robotics Research, 9 (3): 24–48, June 1990.

    Article  Google Scholar 

  25. A. F. van der Stappen, C. Wentink, and M. H. Overmars. Computing immobilizing grasps of polygonal parts. International Journal of Robotics Research, 19 (5): 467–479, May 2000.

    Article  Google Scholar 

  26. R. M. Voyles, J. D. Morrow, and P. K. Khosla. Towards gesture-based programming: Shape from motion primordial learning of sensorimotor primitives. Robotics and Autonomous Systems, 22: 361–375, 1997.

    Article  Google Scholar 

  27. M. T. Zhang and K. Goldberg. Gripper point contacts for part alignment. IEEE Transactions on Robotics and Automation, in press.

    Google Scholar 

  28. R. Zhang and K. Gupta. Automatic orienting of polyhedra through step devices. In Proc. IEEE Intl. Conference on Robotics and Automation, 1998.

    Google Scholar 

  29. T. Zhang, K. Goldberg, G. Smith, R.-P. Berretty, and M. Overmars. Pin design for part feeding. Robotica, 19 (6): 695–702, 2001.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Pollard, N.S., Hodgins, J.K. (2004). Generalizing Demonstrated Manipulation Tasks. In: Boissonnat, JD., Burdick, J., Goldberg, K., Hutchinson, S. (eds) Algorithmic Foundations of Robotics V. Springer Tracts in Advanced Robotics, vol 7. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45058-0_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45058-0_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-07341-0

  • Online ISBN: 978-3-540-45058-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics