Abstract
While research in Learning-by-Demonstration (LbD) methods has made significant progress, learning human-robot collaborative trajectories has been a challenging task. In this paper, a hierarchical kernelized movement primitives (KMPs) model is proposed for learning human-robot handover trajectories. The model learns the non-linear correlations between human hand positions and robotic end-effector positions within a baseline subregion and generalizes them to other subregions. Therefore, the proposed hierarchical KMPs achieve one-shot cross-subregion trajectory skill transfer, which is the major advantage over the classic KMPs. The benefit of such an improvement is the generalization capability of the robot’s reactive trajectory in the whole workspace while avoiding collecting a large number of trajectory samples. In addition, we also present a trajectory scaling and modulation method to ensure the adaptation and generalization of joint trajectory scales. This enables the adaptation of the robot’s movement toward trajectory scales. Experiments of human-robot handover in a robot-assistive assembly scenario demonstrate the performance gains over the classic KMPs in trajectory prediction accuracy. In addition, the results also validate that the proposed method is capable of one-shot transfer across subregions and adaptation to the trajectory scale variance.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability and Access
The data that support the findings of this study is available from the corresponding author, upon reasonable request.
References
Maeda GJ, Neumann G, Ewerton M, Lioutikov R, Kroemer O, Peters J (2017) Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton Robots 41:593–612
Ortenzi V, Cosgun A, Pardi T, Chan WP, Croft E, Kulic D (2021) Object handovers: A review for robotics. IEEE Trans Robot 37(6):1855–1873
Schaal S (1999) Is imitation learning the route to humanoid robots? Trends Cogn Sci 3(6):233–242
Perez-Dattari R, Brito1 B, Groot O.d, Kober J, Alonso-Mora J (2022) Visually-guided motion planning for autonomous driving from interactive demonstrations. Eng Appl Artif Intell 116:105277
Sun P, Yang Z, Zhang T, Guo S, Chen F (2022) Primitive-contrastive network: data-efficient self-supervised learning from robot demonstration videos. Appl Intell 52(4):4258–4273
Xu X, Qian K, Jing X, Song W (2022) Learning robot manipulation skills from human demonstration videos using two-stream 2d/3d residual networks with self-attention. IEEE Transactions on Cognitive and Developmental Systems, 1–1
Huang Y, Silverio J, Rozo L, Caldwell DG (2018) Generalized task-parameterized skill learning. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp 5667–5474
Huang Y, Xu D, Tan M (2022) On imitation learning of robot movement trajectories: A survey. Acta Autom Sin 48:315–334
Yuan Y, Yu ZL, Hua L, Cheng Y, Li J, Sang X (2023) Hierarchical dynamic movement primitive for the smooth movement of robots based on deep reinforcement learning. Appl Intell 53(2):1417–1434
Huang Y, Rozo L, Silverio J, Caldwell DG (2019) Kernelized movement primitives. Int J Robot Res 38(7):833–852
Wang L, Wang G, Wang Z, Turner A, Ratchev S (2023) Uncertainty-propagated cartesian coordinated human-robot collaboration on riemannian manifold with hidden state-space model. Eng Appl Artif Intell 117:105491
Christen S, Yang W, Perez-D’Arpino C, Hilliges O, Fox D, Chao YW (2023) Learning human-to-robot handovers from point clouds. arXiv preprint arXiv:2303.17592
Lioutikov R, Maeda G, Veiga F, Kersting K, Peters J (2020) Learning attribute grammars for movement primitive sequencing. Int J Robot Res 39(1):21–38
Cui Y, Poon J, Miro JV, Yamazaki K, Sugimoto K, Matsubara T (2019) Environment-adaptive interaction primitives through visual context for human-robot motor skill learning. Auton Robots 43:1225–1240
Huang Y, Abu-Dakka FJ, Silverio J, Caldwell DG (2021) Toward orientation learning and adaptation in cartesian space. IEEE Trans Robotics 37(1):82–98
Ijspeert AJ, Nakanishi J, Hoffmann H, Pastor P, Schaal S (2013) Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors. Neural Comput 25(2):328–373
Ben Amor H, Neumann G, Kamthe S, Kroemer O, Peters J (2014) Interaction primitives for human-robot cooperation tasks. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp 2831–2837
Paraschos A, Daniel C, Peters JR, Neumann G (2013) Probabilistic movement primitives. Advances in Neural Information Processing Systems 26:2616–2624
Dermy O, Paraschos A, Ewerton M, Peters J, Charpillet F, Ivaldi S (2017) Prediction of intention during interaction with icub with probabilistic movement primitives. Front Robotics AI 4
Ewerton M, Neumann G, Lioutikov R, Ben Amor H, Peters J, Maeda G (2015) Learning multiple collaborative tasks with a mixture of interaction primitives. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp 1535–1542
Maeda G, Ewerton M, Neumann G, Lioutikov R, Peters J (2017) Phase estimation for fast action recognition and trajectory generation in human-robot collaboration. Int J Robot Res 36(13–14):1579–1594
Seeger M (2004) Gaussian processes for machine learning. Int J Neural Syst 14(02):69–106
Silverio J, Huang Y, Rozo L, caldwell DG (2018) An uncertainty-aware minimal intervention control strategy learned from demonstrations. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 6065–6071
Van Dat N, Van Toan P, Thanh TM (2022) Solving distribution problems in content-based recommendation system with gaussian mixture model. Appl Intell 52(2):1602–1614
Mainprice J, Berenson D (2013) Human-robot collaborative manipulation planning using early prediction of human motion. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 299–306
Luo RC, Mai L (2019) Human intention inference and on-line human hand motion prediction for human-robot collaboration. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 5958–5964
Calinon S, Bruno D, Caldwell DG (2014) A task-parameterized probabilistic model with minimal intervention control. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp 3339–3344
Yan Z, He W, Wang Y, Sun L, Yu X (2022) Probabilistic motion prediction and skill learning for human-to-cobot dual-arm handover control. IEEE Trans Neural Netw Learn Syst, 1–13
Liu A, Zhan S, Jin Z, Zhang Wa (2023) A variable impedance skill learning algorithm based on kernelized movement primitives. IEEE Trans Ind Electron, 1–10
Silverio J, Huang Y, Abu-Dakka FJ, Rozo L, Caldwell DG (2019) Uncertainty-aware imitation learning using kernelized movement primitives. In: 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 90–97
Huang Y (2021) Ekmp: Generalized imitation learning with adaptation, nonlinear hard constraints and obstacle avoidance. arXiv preprint arXiv:2103.00452
Calinon S (2016) A tutorial on task-parameterized movement learning and retrieval. Intel Serv Robotics 9(1):1–29. https://doi.org/10.1007/s11370-015-0187-9
Qian K, Zhang Z, Song W, Liao J (2023) Gvgnet: Gaze-directed visual grounding for learning under-specified object referring intention. IEEE Robot Autom Lett 8(9):5990–5997
Zhang D, Tian Y, Chen K, Qian K (2022) Gaze-directed visual grounding under object referring uncertainty. In: 2022 41st Chinese Control Conference (CCC), pp 3807–3811
Liu Y, Qian K, Xu X, Zhou B, Fang F (2022) Grasp pose learning from human demonstration with task constraints. J Intell Robot Syst 105(2):37
Qian K, Xu X, Liu H, Bai J, Luo S (2022) Environment-adaptive learning from demonstration for proactive assistance in human-robot collaborative tasks. Robot Auton Syst 151:104046
Funding
This work is sponsored by Zhejiang Lab (No.2022NB0AB02), the National Natural Science Foundation of China (No.61573101), and the Natural Science Foundation of Jiangsu Province (No.BK20201264).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study’s conception and design. Material preparation, data collection, and analysis were performed by Zhaokun Yue. Methodology: Kun Qian; Formal analysis and investigation: Jishen Bai; Writing - original draft preparation: Kun Qian; Funding acquisition: Kun Qian, Resources: Kun Qian.
Corresponding author
Ethics declarations
Competing Interests
The authors declare they have no financial interests.
Ethical and Informed Consent for Data Used
Not applicable
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Qian, K., Yue, Z. & Bai, J. Hierarchical kernelized movement primitives for learning human-robot collaborative trajectories in referred object handover. Appl Intell 55, 38 (2025). https://doi.org/10.1007/s10489-024-05902-3
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-05902-3