Skip to main content
Springer Nature Link
Log in

Modelling folded garments by fitting foldable templates

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This work presents a novel method performing shape matching between folded garments and corresponding unfolded templates. It incorporates both partial and global shape analysis techniques, estimating point correspondences between contours of folded garments and generic templates of unfolded garments. The established correspondences are used in the estimation of polygonal models of the folded garments. The initial matching results are also used for modifying the original templates to better fit the folded garments. The method is applied in an iterative fashion, using the fitted templates as a new input, resulting to more accurate matching as indicated by the experimental results. The produced polygon models can be used for planning the unfolding strategy during autonomous robotic manipulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. The employed image database, including manual ground truth annotation, is publicly available for testing and benchmarking. For more information on how to acquire the database, please contact the corresponding author via email.

References

  1. Osawa, F., Seki, H., Kamiya, Y.: Unfolding of Massive Laundry and Classification Types. J. of Adv. Comp. Intell. and Intell. Inf. 11, 457–463 (2007)

    Google Scholar 

  2. Hamajima, K., Kakikura, M.: Planning strategy for task of unfolding clothes. Rob. and Aut. Syst. 32, 145–152 (2000)

    Article  Google Scholar 

  3. Maitin-Shepard, J., Cusumano-Towner, M., Lei, J., Abbeel, P.: Cloth grasp point detection based on multiple-view geometric cues with application to robotic towel folding. In: ICRA, pp. 2308–2315 (2010)

  4. Cusumano-Towner, M., Singh, A., Miller, S., O’Brien, J.F., Abbeel, P.: Bringing clothing into desired configurations with limited perception. In: ICRA, pp. 3893–3900 (2011)

  5. Bersch, C., Pitzer, B., Kammel, S.: Bimanual robotic cloth manipulation for laundry folding. In: IROS, pp. 1413–1419 (2011)

  6. Willimon, B., Birchfield, S., Walker, I.D.: Model for unfolding laundry using interactive perception. In: IROS, pp. 4871–4876. IEEE Press, New York (2011)

  7. Willimon, B., Birchfield, S., Walker, I.D.: Interactive perception of rigid and non-rigid objects. Int. J. Adv. Robotic Syst. 9, 227–238 (2012)

    Google Scholar 

  8. Willimon, B., Hickson, S., Walker, I., Birchfield, S.: An energy minimization approach to 3D non-rigid deformable surface estimation using RGBD data. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, pp. 2711–2717 (2012)

  9. Willimon, B., Birchfield, S., Walker, I.D.: 3D non-rigid deformable surface estimation without feature correspondence. In: Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, pp. 638–643 (2013)

  10. Willimon, B., Walker, I.D., Birchfield, S.: Classification of clothing using mid-level layers. In: ISRN Robotics, pp. 1–17 (2013)

  11. Triantafyllou, D., Aspragathos, N.A.: A vision system for the unfolding of highly non-rigid objects on a table by one manipulator. In: ICIRA, pp. 509–519 (2011)

  12. Ono, E., Kita, N., Sakane, S.: Unfolding folded fabric using outline information with vision and touch sensors. J. Robotics Mech. 10(3), 235–243 (1998)

    Google Scholar 

  13. Miller S., Fritz M., Darrell T., Abbeel P.: Parametrized shape models for clothing. In: ICRA, pp. 4861–4868 (2011)

  14. Mariolis, I., Malassiotis, S.: Matching folded garments to unfolded templates using robust shape analysis techniques. In: Lecture Notes in Computer Science, LNCS (part 2), vol 8048, pp. 193–200 (2013)

  15. Hershberger, J., Snoeyink, J.: An \(o(n{\rm log}n)\) implementation of the Douglas–Peucker algorithm for line simplification. In: Proceedings of the 10th Annual Symposium on Computational Geometry, SCG ’94, pp. 383–384. ACM, New York (1994)

  16. Riemenschneider, H., Donoser, M., Bischof, H.: Using partial edge contour matches for efficient object category localization. In: Proceedings of the 11th European Conference on Computer Vision, Part V, ECCV’10 (Berlin, Heidelberg), pp. 29–42. Springer, New York (2010)

  17. Ling, H., Jacobs, D.W.: Shape classification using the inner-distance. IEEE Trans. Pattern Anal. Mach. Intell. 29, 286–299 (2007)

    Article  Google Scholar 

  18. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of Conference on Computer Vision and Pattern Recognition (CVPR), pp. 511–518 (2001)

  19. Donoser, M., Riemenschneider, H., Bischof, H.: Efficient partial shape matching of outer contours. In: ACCV (2009)

  20. Szeliski, R.: Computer Vision: Algorithms and Applications, 1st edn, pp. 35–38. Springer, Berlin (2011)

  21. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Research and Technology-Hellas (CERTH), Thessaloniki, Greece

    Ioannis Mariolis & Sotiris Malassiotis

Authors
  1. Ioannis Mariolis
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Sotiris Malassiotis
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ioannis Mariolis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mariolis, I., Malassiotis, S. Modelling folded garments by fitting foldable templates. Machine Vision and Applications 26, 549–560 (2015). https://doi.org/10.1007/s00138-015-0671-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0671-4

Keywords