Skip to main content

Human Robot Collaboration for Folding Fabrics Based on Force/RGB-D Feedback

  • Conference paper
  • First Online:
Advances in Robot Design and Intelligent Control

Abstract

In this paper, the human-robot collaboration for executing complicated handling tasks for folding non-rigid objects is investigated. A hierarchical control system is developed for the co-manipulation task of folding sheets like fabrics/cloths. The system is based on force and RGB-D feedback in both higher and lower control levels of the process. In the higher level, the perception of the human’s intention is used for deciding the robot’s action; in the lower level the robot reacts to the force/RGB-D feedback to follow human guidance. The proposed approach is tested in folding a rectangular piece of fabric. Experiments showed that the developed robotic system is able to track the human’s movement in order to help her/him to accomplish the folding co-manipulation task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Rethink Robotics, http://youtu.be/Mr7U9pQtwq8.

  2. 2.

    CloPeMa research project, http://youtu.be/gK7yuPfzuD4.

  3. 3.

    UC Berkeley Folding Robot, http://youtu.be/gy5g33S0Gzo.

  4. 4.

    A demonstration of the folding task can be viewed in the Robotics Group YouTube channel.

References

  1. Saadat, M., Ping, N.: Industrial applications of automatic manipulation of flexible materials. Ind. Robot: Int. J. 29(5), 434–442 (2002)

    Article  Google Scholar 

  2. Koustoumpardis, P.N., Aspragathos, N.A.: Intelligent hierarchical robot control for sewing fabrics. Robot. Comput. Int. Manuf. 30(1), 34–46 (2014)

    Article  Google Scholar 

  3. Zoumponos, G.T., Aspragathos, N.A.: A fuzzy strategy for the robotic folding of fabrics with machine vision feedback. Ind. Robot: Int. J. 37(3), 302–308 (2010)

    Article  Google Scholar 

  4. Oshima, T., Yoshimi, T., Mizukawa, M., Ando, Y.: A study of towel folding by a robot arm—Spreading and vertex detection using image processing. In: Proceedings of 14th International Conference on Control, Automation and Systems (ICCAS’14), pp. 627–631 (2014)

    Google Scholar 

  5. Yamakawa, Y., Namiki, A., Ishikawa, M.: Motion planning for dynamic folding of a cloth with two high-speed robot hands and two high-speed sliders. In: Proceedings of 2011 IEEE International Conference on Robotics and Automation, pp. 5486–5491 (2011)

    Google Scholar 

  6. Miller, S., Van Den Berg, J., Fritz, M., Darrell, T., Goldberg, K., Abbeel, P.: A geometric approach to robotic laundry folding. Int. J. Robot. Res. 31(2), 249–267 (2011)

    Google Scholar 

  7. Stria, J., Prusa, D. Hlavac, V., Wagner, L., Petrik, V., Krsek, P., Smutny, V.: Garment perception and its folding using a dual-arm robot. In: Proceedings of 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 61–67 (2014)

    Google Scholar 

  8. Koustoumpardis, P.N., Aspragathos, N.A.: Neural network force control for robotized handling of fabrics. In: Proceedings of International Conference on Control, Automation and Systems ICCAS 2007, COEX, Seoul, Korea, 17–20 Oct, pp. 566–571 (2007)

    Google Scholar 

  9. Koustoumpardis, P.N., Aspragathos, N.A.: Robot-human cooperation holding and handling a piece of fabric. In: Proceedings of 11th International Conference on Climbing and Walking Robots and Support Technologies for Mobile Machines, CLAWAR’2008, Coimbra, Portugal, 8–10 Sept, pp. 820–827 (2008)

    Google Scholar 

  10. Quigley, M., Conley, K., Gerkey B., et al.: ROS: An open source robot operating system. In: ICRA Workshop on Open Source Software (2009)

    Google Scholar 

  11. Bradski, G.: The openCV library. Dr. Dobb’s J. Softw. Tools 2236121 (2000)

    Google Scholar 

  12. PrimeSense Inc.: Prime sensor™ NITE 1.3 algorithms notes. Online manual last viewed online at 24 Oct 2013

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Panagiotis N. Koustoumpardis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Koustoumpardis, P.N., Chatzilygeroudis, K.I., Synodinos, A.I., Aspragathos, N.A. (2016). Human Robot Collaboration for Folding Fabrics Based on Force/RGB-D Feedback. In: Borangiu, T. (eds) Advances in Robot Design and Intelligent Control. Advances in Intelligent Systems and Computing, vol 371. Springer, Cham. https://doi.org/10.1007/978-3-319-21290-6_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21290-6_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21289-0

  • Online ISBN: 978-3-319-21290-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics