Abstract
This paper describes the construction of an operator support system for teleoperation of dual-arm robots in the real world and the virtual world. The robot simulator Choreonoid was implemented to create a virtual space. We focus on dual-arm robot teleoperation in particular because it is difficult for the operator to operate a dual arm with one controller. In the verification experiment for usability, through the use of questionnaires and statistical analysis, we show that it is possible to reduce the risks involved in dual-arm operation for a novice teleoperator by comparing the case when the virtual space was confirmed with when it was not.
Similar content being viewed by others
References
Nagatani K, Kiribayashi S, Okada Y, Tadokoro S, Nishimura T, Yoshida T, Koyanagi E, Hada Y (2011) Redesign of rescue mobile robot Quince. In: 2011 IEEE international symposium on safety, security, and rescue robotics, pp 13–18
Suzuki S, Hasegawa S, Okugawa M (2014) Remote control system of disaster response robot with passive sub-crawlers considering falling down avoidance. Robomech J 1:20
Steuer J (1992) Defining virtual reality: dimensions determining telepresence. J Commun 42(4):73–93
Yanpei H (2019) Development of an intuitive foot-machine interface for robotic surgery. arXiv preprint arXiv:1905.11191
Vahrenkamp N, Berenson D, Asfour T, Kuffner J, Dillmann R (2009) Humanoid motion planning for dual-arm manipulation and re-grasping tasks. In: 2009 IEEE/RSJ international conference on intelligent robots and systems, pp 2464–2470
Shiroma N, Chium Y, Kamegawa T, Matsuno F (2004) Development of rescue robotic systems for both daily and emergency use. In: IEEE conference on robotics and automation, 2004. TExCRA Technical Exhibition Based, pp 85–86
Figueroa F, Nadia B, Mirrazavi S, Seyed S, Billard A (2018) Multi-arm self-collision avoidance: a sparse solution for a big data problem. In: Proceedings of the third machine learning in planning and control of robot motion (MLPC) workshop
Vahrenkamp N, Asfour T, Dillmann R (2012) Simultaneous grasp and motion planning: Humanoid robot ARMAR-III. IEEE Robot Autom Mag 19(2):43–57
Ge Sam SS, Cui YJ (2000) New potential functions for mobile robot path planning. IEEE Trans Robot Autom 16(5):615–620
Choreonoid Official Site. http://choreonoid.org/en/. Accessed 9 Dec 2019
E2 SPIDER (in Japanese). http://www.aizuk.jp/spider.php. Accessed 9 Dec 2019
Tadokoro S, Kimura T, Okugawa M, Oogane K, Igarashi H, Ohtsubo Y, Sato N, Shimizu M, Suzuki S, Takahashi T, Nakaoka S, Murata M, Takahashi M, Morita Y, Rooney EM (2019) The world robot summit disaster robotics category—achievements of the 2018 preliminary competition. Adv Robot 33(17):854–875
KINOVA Gen2 Ultra lightweight robot. https://www.kinovarobotics.com/en/products/robotic-arms/kinova-gen2-ultra-lightweight-robot. Accessed 9 Dec 2019
Kinova Grippers. https://www.kinovarobotics.com/en/products/accessories/grippers. Accessed 9 Dec 2019
Intel® RealSense™ Depth Camera. https://www.intelrealsense.com/stereo-depth. Accessed 9 Dec 2019
OpenRTM-aist official website. http://openrtm.org/. Accessed 9 Dec 2019
NewTek NDI SDK. https://ndi.tv/sdk/. Accessed 9 Dec 2019
OpenCV. https://opencv.org/. Accessed 9 Dec 2019
ZBar code reader. http://zbar.sourceforge.net/index.html. Accessed 9 Dec 2019
Result video archive for Standard Disaster Robotics Challenge. https://www.youtube.com/playlist?list=PL5Oq_p2DlThH6Go81cexNeDP08sUzswV_. Accessed 9 Dec 2019
RoboCup Rescue Robot League Japan Open 2019 (in Japanese). https://sites.google.com/site/robocupjorescuerobotleague/japanopen2019-nagaoka. Accessed 9 Dec 2019
Result Movie. https://www.youtube.com/watch?v=uzl5rgUGdrI. Accessed 9 Dec 2019
Klingensmith M, Siddartha SS, Michael K (2016) Articulated robot motion for simultaneous localization and mapping (arm-slam). IEEE Robot Autom Lett 1(2):1156–1163
Acknowledgements
The authors thank Tomoya Kohno from Liberaware CO., LTD., Yasunari Motoki, Chiaki Saito, and Noritaka Baba from Aizuk, Inc. for developing E2 Spider, and Takeshi Moue and Tsuyoshi Anazawa from FSK CO., LTD for advising about Choreonoid in our proposed system.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was presented in part at the 24th International Symposium on Artificial Life and Robotics, Beppu, Oita, January 23-25, 2019.
About this article
Cite this article
Nakamura, K., Tohashi, K., Funayama, Y. et al. Dual-arm robot teleoperation support with the virtual world. Artif Life Robotics 25, 286–293 (2020). https://doi.org/10.1007/s10015-020-00587-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10015-020-00587-6