Abstract
In many scenarios where robots could assist humans, handover situations are essential. But they are still challenging for robots, especially if these are initiated by the human interaction partner. Human-human handover studies report average reaction times of 0.4 s, which is only achievable for robots, if they are able to predict the object transfer point (OTP) sufficiently early and then adapt to the human movement. In this paper, we propose a hand tracking system that can be used in the context of human initiated handover as a basis for human reaching motion prediction. The OTP prediction implemented is based on the minimum jerk model and combines a static estimation utilizing the human’s initial pose and a dynamic estimation from the current hand trajectory. Results are generated and analyzed for a broad spectrum of human initiated scenarios. For these cases we examine the dynamics of different variants of the proposed prediction algorithm, i.e., how early is a robot’s prediction of the OTP within a certain error range? The tracking delivers results with an average delay, after the initialization, of 0.07 s. We show that the OTP prediction delivers results after 75 % of the movement within a 10 cm precision box.
S. Meyer zu Borgsen and S. Wachsmuth—This research/work was supported by the Cluster of Excellence Cognitive Interaction Technology ‘CITEC’ (EXC 277) at Bielefeld University, which is funded by the German Research Foundation (DFG).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Basili, P., Huber, M., Brandt, T., Hirche, S., Glasauer, S.: Investigating human-human approach and hand-over. In: Vernon, D., et al. (eds.) Human Centered Robot Systems, vol. 6. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-10403-9_16
Bray, M., Koller-Meier, E., Van Gool, L.: Smart particle filtering for 3D hand tracking. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, Seoul, Korea (2004)
Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv:1812.08008 (2018)
Chen, C., Chen, Y., Lee, P., Tsai, Y., Lei, S.: Real-time hand tracking on depth images. In: 2011 Visual Communications and Image Processing (VCIP), November 2011
Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5(7), 1688–1703 (1985)
Hackenberg, G., McCall, R., Broll, W.: Lightweight palm and finger tracking for real-time 3D gesture control. In: 2011 IEEE Virtual Reality Conference, March 2011
Huber, M., et al.: Evaluation of a novel biologically inspired trajectory generator in human-robot interaction. In: RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication, September 2009
Kajikawa, S., Ishikawa, E.: Trajectory planning for hand-over between human and robot. In: Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No. 00TH8499), September 2000
Li, Z., Hauser, K.: Predicting object transfer position and timing in human-robot handover tasks. In: Science and Systems (2015)
Maeda, G.J., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., Peters, J.: Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton. Robots 41(3), 593–612 (2017)
Meyer zu Borgsen, S., Bernotat, J., Wachsmuth, S.: Hand in hand with robots: differences between experienced and naive users in human-robot handover scenarios. In: Kheddar, A., et al. (eds.) Social Robotics. ICSR 2017. LNCS, vol. 10652. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70022-9_58
Nemlekar, H., Dutia, D., Li, Z.: Object transfer point estimation for fluent human-robot handovers. In: International Conference on Robotics and Automation (ICRA). Montreal, Canada (2019)
Perez-D’Arpino, C., Shah, J.A.: Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Seattle, WA, USA, May 2015
Shibata, S., Sahbi, B.M., Tanaka, K., Shimizu, A.: An analysis of the process of handing over an object and its application to robot motions. In: Computational Cybernetics and Simulation 1997 IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, October 1997
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Simmering, J., Meyer zu Borgsen, S., Wachsmuth, S., Al-Hamadi, A. (2019). Combining Static and Dynamic Predictions of Transfer Points for Human Initiated Handovers. In: Salichs, M., et al. Social Robotics. ICSR 2019. Lecture Notes in Computer Science(), vol 11876. Springer, Cham. https://doi.org/10.1007/978-3-030-35888-4_63
Download citation
DOI: https://doi.org/10.1007/978-3-030-35888-4_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35887-7
Online ISBN: 978-3-030-35888-4
eBook Packages: Computer ScienceComputer Science (R0)