Skip to main content

Advertisement

Hierarchical kernelized movement primitives for learning human-robot collaborative trajectories in referred object handover

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

While research in Learning-by-Demonstration (LbD) methods has made significant progress, learning human-robot collaborative trajectories has been a challenging task. In this paper, a hierarchical kernelized movement primitives (KMPs) model is proposed for learning human-robot handover trajectories. The model learns the non-linear correlations between human hand positions and robotic end-effector positions within a baseline subregion and generalizes them to other subregions. Therefore, the proposed hierarchical KMPs achieve one-shot cross-subregion trajectory skill transfer, which is the major advantage over the classic KMPs. The benefit of such an improvement is the generalization capability of the robot’s reactive trajectory in the whole workspace while avoiding collecting a large number of trajectory samples. In addition, we also present a trajectory scaling and modulation method to ensure the adaptation and generalization of joint trajectory scales. This enables the adaptation of the robot’s movement toward trajectory scales. Experiments of human-robot handover in a robot-assistive assembly scenario demonstrate the performance gains over the classic KMPs in trajectory prediction accuracy. In addition, the results also validate that the proposed method is capable of one-shot transfer across subregions and adaptation to the trajectory scale variance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability and Access

The data that support the findings of this study is available from the corresponding author, upon reasonable request.

References

  1. Maeda GJ, Neumann G, Ewerton M, Lioutikov R, Kroemer O, Peters J (2017) Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton Robots 41:593–612

    Article  Google Scholar 

  2. Ortenzi V, Cosgun A, Pardi T, Chan WP, Croft E, Kulic D (2021) Object handovers: A review for robotics. IEEE Trans Robot 37(6):1855–1873

    Article  Google Scholar 

  3. Schaal S (1999) Is imitation learning the route to humanoid robots? Trends Cogn Sci 3(6):233–242

    Article  MATH  Google Scholar 

  4. Perez-Dattari R, Brito1 B, Groot O.d, Kober J, Alonso-Mora J (2022) Visually-guided motion planning for autonomous driving from interactive demonstrations. Eng Appl Artif Intell 116:105277

  5. Sun P, Yang Z, Zhang T, Guo S, Chen F (2022) Primitive-contrastive network: data-efficient self-supervised learning from robot demonstration videos. Appl Intell 52(4):4258–4273

    Article  MATH  Google Scholar 

  6. Xu X, Qian K, Jing X, Song W (2022) Learning robot manipulation skills from human demonstration videos using two-stream 2d/3d residual networks with self-attention. IEEE Transactions on Cognitive and Developmental Systems, 1–1

  7. Huang Y, Silverio J, Rozo L, Caldwell DG (2018) Generalized task-parameterized skill learning. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp 5667–5474

  8. Huang Y, Xu D, Tan M (2022) On imitation learning of robot movement trajectories: A survey. Acta Autom Sin 48:315–334

    MATH  Google Scholar 

  9. Yuan Y, Yu ZL, Hua L, Cheng Y, Li J, Sang X (2023) Hierarchical dynamic movement primitive for the smooth movement of robots based on deep reinforcement learning. Appl Intell 53(2):1417–1434

    Article  MATH  Google Scholar 

  10. Huang Y, Rozo L, Silverio J, Caldwell DG (2019) Kernelized movement primitives. Int J Robot Res 38(7):833–852

    Article  Google Scholar 

  11. Wang L, Wang G, Wang Z, Turner A, Ratchev S (2023) Uncertainty-propagated cartesian coordinated human-robot collaboration on riemannian manifold with hidden state-space model. Eng Appl Artif Intell 117:105491

    Article  Google Scholar 

  12. Christen S, Yang W, Perez-D’Arpino C, Hilliges O, Fox D, Chao YW (2023) Learning human-to-robot handovers from point clouds. arXiv preprint arXiv:2303.17592

  13. Lioutikov R, Maeda G, Veiga F, Kersting K, Peters J (2020) Learning attribute grammars for movement primitive sequencing. Int J Robot Res 39(1):21–38

    Article  Google Scholar 

  14. Cui Y, Poon J, Miro JV, Yamazaki K, Sugimoto K, Matsubara T (2019) Environment-adaptive interaction primitives through visual context for human-robot motor skill learning. Auton Robots 43:1225–1240

    Article  MATH  Google Scholar 

  15. Huang Y, Abu-Dakka FJ, Silverio J, Caldwell DG (2021) Toward orientation learning and adaptation in cartesian space. IEEE Trans Robotics 37(1):82–98

    Article  Google Scholar 

  16. Ijspeert AJ, Nakanishi J, Hoffmann H, Pastor P, Schaal S (2013) Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors. Neural Comput 25(2):328–373

    Article  MathSciNet  MATH  Google Scholar 

  17. Ben Amor H, Neumann G, Kamthe S, Kroemer O, Peters J (2014) Interaction primitives for human-robot cooperation tasks. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp 2831–2837

  18. Paraschos A, Daniel C, Peters JR, Neumann G (2013) Probabilistic movement primitives. Advances in Neural Information Processing Systems 26:2616–2624

    MATH  Google Scholar 

  19. Dermy O, Paraschos A, Ewerton M, Peters J, Charpillet F, Ivaldi S (2017) Prediction of intention during interaction with icub with probabilistic movement primitives. Front Robotics AI 4

  20. Ewerton M, Neumann G, Lioutikov R, Ben Amor H, Peters J, Maeda G (2015) Learning multiple collaborative tasks with a mixture of interaction primitives. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp 1535–1542

  21. Maeda G, Ewerton M, Neumann G, Lioutikov R, Peters J (2017) Phase estimation for fast action recognition and trajectory generation in human-robot collaboration. Int J Robot Res 36(13–14):1579–1594

    Article  Google Scholar 

  22. Seeger M (2004) Gaussian processes for machine learning. Int J Neural Syst 14(02):69–106

    Article  MATH  Google Scholar 

  23. Silverio J, Huang Y, Rozo L, caldwell DG (2018) An uncertainty-aware minimal intervention control strategy learned from demonstrations. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 6065–6071

  24. Van Dat N, Van Toan P, Thanh TM (2022) Solving distribution problems in content-based recommendation system with gaussian mixture model. Appl Intell 52(2):1602–1614

    Article  MATH  Google Scholar 

  25. Mainprice J, Berenson D (2013) Human-robot collaborative manipulation planning using early prediction of human motion. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 299–306

  26. Luo RC, Mai L (2019) Human intention inference and on-line human hand motion prediction for human-robot collaboration. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 5958–5964

  27. Calinon S, Bruno D, Caldwell DG (2014) A task-parameterized probabilistic model with minimal intervention control. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp 3339–3344

  28. Yan Z, He W, Wang Y, Sun L, Yu X (2022) Probabilistic motion prediction and skill learning for human-to-cobot dual-arm handover control. IEEE Trans Neural Netw Learn Syst, 1–13

  29. Liu A, Zhan S, Jin Z, Zhang Wa (2023) A variable impedance skill learning algorithm based on kernelized movement primitives. IEEE Trans Ind Electron, 1–10

  30. Silverio J, Huang Y, Abu-Dakka FJ, Rozo L, Caldwell DG (2019) Uncertainty-aware imitation learning using kernelized movement primitives. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 90–97

  31. Huang Y (2021) Ekmp: Generalized imitation learning with adaptation, nonlinear hard constraints and obstacle avoidance. arXiv preprint arXiv:2103.00452

  32. Calinon S (2016) A tutorial on task-parameterized movement learning and retrieval. Intel Serv Robotics 9(1):1–29. https://doi.org/10.1007/s11370-015-0187-9

    Article  MATH  Google Scholar 

  33. Qian K, Zhang Z, Song W, Liao J (2023) Gvgnet: Gaze-directed visual grounding for learning under-specified object referring intention. IEEE Robot Autom Lett 8(9):5990–5997

    Article  MATH  Google Scholar 

  34. Zhang D, Tian Y, Chen K, Qian K (2022) Gaze-directed visual grounding under object referring uncertainty. In: 2022 41st Chinese Control Conference (CCC), pp 3807–3811

  35. Liu Y, Qian K, Xu X, Zhou B, Fang F (2022) Grasp pose learning from human demonstration with task constraints. J Intell Robot Syst 105(2):37

    Article  MATH  Google Scholar 

  36. Qian K, Xu X, Liu H, Bai J, Luo S (2022) Environment-adaptive learning from demonstration for proactive assistance in human-robot collaborative tasks. Robot Auton Syst 151:104046

    Article  Google Scholar 

Download references

Funding

This work is sponsored by Zhejiang Lab (No.2022NB0AB02), the National Natural Science Foundation of China (No.61573101), and the Natural Science Foundation of Jiangsu Province (No.BK20201264).

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the study’s conception and design. Material preparation, data collection, and analysis were performed by Zhaokun Yue. Methodology: Kun Qian; Formal analysis and investigation: Jishen Bai; Writing - original draft preparation: Kun Qian; Funding acquisition: Kun Qian, Resources: Kun Qian.

Corresponding author

Correspondence to Kun Qian.

Ethics declarations

Competing Interests

The authors declare they have no financial interests.

Ethical and Informed Consent for Data Used

Not applicable

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qian, K., Yue, Z. & Bai, J. Hierarchical kernelized movement primitives for learning human-robot collaborative trajectories in referred object handover. Appl Intell 55, 38 (2025). https://doi.org/10.1007/s10489-024-05902-3

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10489-024-05902-3

Keywords