Abstract
Robotic skill learning has been increasingly studied but the demonstration collections are more challenging compared to collecting images/videos in computer vision and texts in natural language processing. This paper presents a skill learning paradigm by using intuitive teleoperation devices to generate high-quality human demonstrations efficiently for robotic skill learning in a data-driven manner. By using a reliable teleoperation interface, the da Vinci Research Kit (dVRK) master, a system called dVRK-Simulator-for-Demonstration (dS4D) is proposed in this paper. Various manipulation tasks show the system’s effectiveness and advantages in efficiency compared to other interfaces. Using the collected data for policy learning has been investigated, which verifies the initial feasibility. We believe the proposed paradigm can facilitate robot learning driven by high-quality demonstrations and efficiency while generating them.
X. Chu and Y. Tang—Equal contribution.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Padalkar, A., et al.: Open X-embodiment: robotic learning datasets and RT-X models (2023). https://robotics-transformer-x.github.io/paper.pdf
Nair, S., Rajeswaran, A., Kumar, V., Finn, C., Gupta, A.: R3M: a universal visual representation for robot manipulation. In: Conference on Robot Learning (CoRL) (2022)
Majumdar, A., et al.: Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence? https://arxiv.org/abs/2303.18240
Kent, D., Saldanha, C., Chernova, S.: A comparison of remote robot teleoperation interfaces for general object manipulation. In: 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (2017)
Mandlekar, A., et al.: Roboturk: a crowdsourcing platform for robotic skill learning through imitation. In: Conference on Robot Learning, pp. 879–893 (2018)
Lipton, J.I., Fay, A.J., Rus, D.: Baxter’s homunculus: Virtual reality spaces for teleoperation in manufacturing. IEEE Robot. Autom. Lett. 3(1), 179–186 (2018)
Arunachalam, S.P., Güzey, I., Chintala, S., Pinto, L.: Holo-Dex: teaching dexterity with immersive mixed reality. In: 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), pp. 5962–5969 (2023)
Zhao, T., Kumar, V., Levine, S., Finn, C.: Learning fine-grained bimanual manipulation with low-cost hardware. Science and Systems, Robotics (2023)
Liang, J., Mahler, J., Laskey, M., Li, P., Goldberg, K.: Using dVRK teleoperation to facilitate deep learning of automation tasks for an industrial robot. In: 13th IEEE Conference on Automation Science and Engineering (CASE), pp. 1–8 (2017)
Zhu, Y., et al.: robosuite: a modular simulation framework and benchmark for robot learning, arXiv preprint arXiv:2009.12293 (2020)
Li, C., et al.: iGibson 2.0: Object-centric simulation for robot learning of everyday household tasks. In: Proceedings of the 5th Conference on Robot Learning, pp. 455–465 (2022)
Gu, J., et al.: ManiSkill2: a unified benchmark for generalizable manipulation skills. In: International Conference on Learning Representations (2023)
Muelling, K., Boularias, A., Mohler, B., Scholkopf, B., Peters, J.: Learning strategies in table tennis using inverse reinforcement learning. Biol. Cybern. 108(5), 603–619 (2014)
Sharma, P., Mohan, L., Pinto, L., Gupta, A.: Multiple interactions made easy (mime): large scale demonstrations data for imitation, CoRL (2018)
Song, S., Zeng, A., Lee, J., Funkhouser, T.: Grasping in the wild: learning 6dof closed-loop grasping from low-cost demonstrations. IEEE Robot. Autom. Lett. (RA-L) 5(3), 4978–4985 (2020)
Young, S., Gandhi, D., Tulsiani, S., Gupta, A., Abbeel, P., Pinto, L.: Visual imitation made easy. In: 4th Conference on Robot Learning (CoRL) (2020)
Zhu, Y., et al.: Reinforcement and imitation learning for diverse visuomotor skills. In: Proceedings of Robotics: Science and Systems (2018)
Pomerleau, D.A.: Alvinn: an autonomous land vehicle in a neural network. In: Advances in Neural Information Processing Systems, pp. 305–313 (1989)
Mandlekar, A., Xu, D., MartÃn-MartÃn, R., Savarese, S., Fei-Fei, L.: GTI: learning to generalize across long-horizon tasks from human demonstrations. science and systems, Robotics (2020)
Tung, A., et al.: Learning multi-arm manipulation through collaborative teleoperation. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 9212–9219 (2021)
Fujimoto, S., Meger, D., Precup, D.: Off-policy deep reinforcement learning without exploration. In: International Conference on Machine Learning, pp. 2052–2062 (2019)
Kumar, A., Zhou, A., Tucker, G., Levine, S.: Conservative Q-learning for offline reinforcement learning. In: Conference on Neural Information Processing Systems (NeurIPS) (2020)
Mandlekar, A., et al.: What matters in learning from offline human demonstrations for robot manipulation. In: Conference on Robot Learning (CoRL) (2021)
Lin, H., et al.: A reliable gravity compensation control strategy for dVRK robotic arms with nonlinear disturbance forces. IEEE Robot. Autom. Lett. 4(4), 3892–3899 (2019)
Kazanzides, P., et al.: An open-source research kit for the da vinci®surgical system. In: 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 6434–6439 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chu, X., Tang, Y., Kwok, L.H., Cai, Y., Au, K.W.S. (2024). Bootstrapping Robotic Skill Learning with Intuitive Teleoperation: Initial Feasibility Study. In: Ang Jr, M.H., Khatib, O. (eds) Experimental Robotics. ISER 2023. Springer Proceedings in Advanced Robotics, vol 30. Springer, Cham. https://doi.org/10.1007/978-3-031-63596-0_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-63596-0_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-63595-3
Online ISBN: 978-3-031-63596-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)