Skip to main content

Combining Static and Dynamic Predictions of Transfer Points for Human Initiated Handovers

  • Conference paper
  • First Online:
Social Robotics (ICSR 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11876))

Included in the following conference series:

  • 2643 Accesses

Abstract

In many scenarios where robots could assist humans, handover situations are essential. But they are still challenging for robots, especially if these are initiated by the human interaction partner. Human-human handover studies report average reaction times of 0.4 s, which is only achievable for robots, if they are able to predict the object transfer point (OTP) sufficiently early and then adapt to the human movement. In this paper, we propose a hand tracking system that can be used in the context of human initiated handover as a basis for human reaching motion prediction. The OTP prediction implemented is based on the minimum jerk model and combines a static estimation utilizing the human’s initial pose and a dynamic estimation from the current hand trajectory. Results are generated and analyzed for a broad spectrum of human initiated scenarios. For these cases we examine the dynamics of different variants of the proposed prediction algorithm, i.e., how early is a robot’s prediction of the OTP within a certain error range? The tracking delivers results with an average delay, after the initialization, of 0.07 s. We show that the OTP prediction delivers results after 75 % of the movement within a 10 cm precision box.

S. Meyer zu Borgsen and S. Wachsmuth—This research/work was supported by the Cluster of Excellence Cognitive Interaction Technology ‘CITEC’ (EXC 277) at Bielefeld University, which is funded by the German Research Foundation (DFG).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Basili, P., Huber, M., Brandt, T., Hirche, S., Glasauer, S.: Investigating human-human approach and hand-over. In: Vernon, D., et al. (eds.) Human Centered Robot Systems, vol. 6. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-10403-9_16

    Chapter  Google Scholar 

  2. Bray, M., Koller-Meier, E., Van Gool, L.: Smart particle filtering for 3D hand tracking. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, Seoul, Korea (2004)

    Google Scholar 

  3. Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv:1812.08008 (2018)

  4. Chen, C., Chen, Y., Lee, P., Tsai, Y., Lei, S.: Real-time hand tracking on depth images. In: 2011 Visual Communications and Image Processing (VCIP), November 2011

    Google Scholar 

  5. Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5(7), 1688–1703 (1985)

    Article  Google Scholar 

  6. Hackenberg, G., McCall, R., Broll, W.: Lightweight palm and finger tracking for real-time 3D gesture control. In: 2011 IEEE Virtual Reality Conference, March 2011

    Google Scholar 

  7. Huber, M., et al.: Evaluation of a novel biologically inspired trajectory generator in human-robot interaction. In: RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication, September 2009

    Google Scholar 

  8. Kajikawa, S., Ishikawa, E.: Trajectory planning for hand-over between human and robot. In: Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No. 00TH8499), September 2000

    Google Scholar 

  9. Li, Z., Hauser, K.: Predicting object transfer position and timing in human-robot handover tasks. In: Science and Systems (2015)

    Google Scholar 

  10. Maeda, G.J., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., Peters, J.: Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton. Robots 41(3), 593–612 (2017)

    Article  Google Scholar 

  11. Meyer zu Borgsen, S., Bernotat, J., Wachsmuth, S.: Hand in hand with robots: differences between experienced and naive users in human-robot handover scenarios. In: Kheddar, A., et al. (eds.) Social Robotics. ICSR 2017. LNCS, vol. 10652. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-70022-9_58

    Chapter  Google Scholar 

  12. Nemlekar, H., Dutia, D., Li, Z.: Object transfer point estimation for fluent human-robot handovers. In: International Conference on Robotics and Automation (ICRA). Montreal, Canada (2019)

    Google Scholar 

  13. Perez-D’Arpino, C., Shah, J.A.: Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Seattle, WA, USA, May 2015

    Google Scholar 

  14. Shibata, S., Sahbi, B.M., Tanaka, K., Shimizu, A.: An analysis of the process of handing over an object and its application to robot motions. In: Computational Cybernetics and Simulation 1997 IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, October 1997

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sebastian Meyer zu Borgsen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Simmering, J., Meyer zu Borgsen, S., Wachsmuth, S., Al-Hamadi, A. (2019). Combining Static and Dynamic Predictions of Transfer Points for Human Initiated Handovers. In: Salichs, M., et al. Social Robotics. ICSR 2019. Lecture Notes in Computer Science(), vol 11876. Springer, Cham. https://doi.org/10.1007/978-3-030-35888-4_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-35888-4_63

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-35887-7

  • Online ISBN: 978-3-030-35888-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics