Skip to main content
SpringerLink
Log in

On the Control of Human-Robot Bi-Manual Manipulation

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

As robots begin to permeate the everyday human workspace to collaborate in innumerable and varied tasks, the robotic structure must adhere and replicate human-like gestures for effective interaction. Whether rehabilitation or augmentation, upper arm human-robot interaction is some of the most prevalent and investigated forms of collaboration. However, currently robotic control schemes fail to capture the true intricacies of anthropomorphic motion and intent during simple bi-manual manipulation tasks. This paper focuses on the introduction of bio-inspired control schemes for robot manipulators that coordinate with humans during dual arm object manipulation. Using experimental data captured from human subjects performing a variety of every-day bi-manual life tasks, we propose a bio-inspired controller for a robot arm, that is able to learn human inter- and intra-arm coordination during those tasks. Using dimensionality reduction techniques to make comprehensible the linear correlations of both arms in joint space we fit and utilize potential fields that attract the robot to human-like configurations. This method is then tested using real experimental data across multiple bi-manual tasks with a comparison made between the bio-inspired and traditional inverse kinematic controllers. Using a robotic kinematic chain identical to the human arm, models are evaluated for anthropomorphic configurations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Al-Gallaf, E.A.: Multi-fingered robot hand optimal task force distribution: neural inverse kinematics approach. Robot. Auton. Syst. 54(1), 34–51 (2006)

    Article  Google Scholar 

  2. Artemiadis, P.K., Kyriakopoulos, K.J.: EMG-based control of a robot arm using low-dimensional embeddings. IEEE Trans. Robot. 26(2), 393–398 (2010)

    Article  Google Scholar 

  3. Asfour, T., Dillmann, R.: Human-like motion of a humanoid robot arm based on a closed-form solution of the inverse kinematics problem. Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. 2, 1407–1412 (2003)

    Google Scholar 

  4. Bagnell, J.A., Cavalcanti, F., Cui, L.: An integrated system for autonomous robotics manipulation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2955–2962 (2012)

  5. Beetz, M., Klank, U., Kresse, I., Maldonado, A., Mösenlechner, L., Pangercic, D., Rühr, T., Tenorth, M.: Robotic roommates making pancakes. In: 11th IEEE-RAS International Conference on Humanoid Robots (2011)

  6. Berg, J., Miller, S., Goldberg, K., Abbeel, P.: Gravity-Based Robotic Cloth Folding, pp 409–424. Springer Berlin Heidelberg (2011)

  7. Billard, A.: Learning human arm movements by imitation: evaluation of a biologically inspired connectionist architecture. Robot. Auton. Syst. 941, 1–16 (2001)

    Google Scholar 

  8. Caggiano, V., De Santis, A., Siciliano, B., Chianese, A.: A biomimetic approach to mobility distribution for a human-like redundant arm. In: Proceedings of the IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, pp. 393–398 (2006)

  9. Cardoso de Oliveira, S.: The neuronal basis of bimanual coordination: recent neurophysiological evidence and functional models. Acta Psychol. 110(2), 139–159 (2002)

    Article  Google Scholar 

  10. Cruse, H., Wischmeyer, E., Bruser, M., Brockfeld, P., Dress, A.: On the cost functions for the control of the human arm movement. Biol. Cybern. 62(6), 519–528 (1990)

    Article  Google Scholar 

  11. Cutkosky, M.R.: On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Trans. Robot. Autom. 5(3), 269–279 (1989)

    Google Scholar 

  12. Debaere, F., Wenderoth, N., Sunaert, S., Van Hecke, P., Swinnen, S.P.: Cerebellar and premotor function in bimanual coordination: parametric neural responses to spatiotemporal complexity and cycling frequency. Neuroimage 21(4), 1416–1427 (2004)

    Article  Google Scholar 

  13. Do, M., Azad, P., Asfour, T., Dillmann, R.: Imitation of human motion on a humanoid robot using non-linear optimization. In: 8th IEEE-RAS International Conference on Humanoid Robots, pp. 545–552 (2008)

  14. Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688–1703 (1985)

    Google Scholar 

  15. Gamage, S.S.H.U., Lasenby, J.: New least squares solutions for estimating the average centre of rotation and the axis of rotation. J. Biomech. 35(1), 87–93 (2002)

    Article  Google Scholar 

  16. Gharbi, M., Cortes, J., Simeon, T.: A sampling-based path planner for dual-arm manipulation. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2008. AIM 2008, pp. 383–388 (2008)

  17. Gribovskaya, E., Billard, A.: Combining dynamical systems control and programming by demonstration for teaching discrete bimanual coordination tasks to a humanoid robot. In: 3rd ACM/IEEE International Conference on Human-Robot Interaction, pp. 33–40 (2008)

  18. Härtl, H.: Dextrous manipulation with multifingered robot hands including rolling and slipping of the fingertips. Robot. Auton. Syst. 14(1), 29–53 (1995)

    Article  Google Scholar 

  19. Hwang, M.J., Lee, D.Y., Chung, S.Y.: Motion Planning of bimanual robot for assembly. In: IEEE International Conference on Systems, Man and Cybernetics, 2007. ISIC, pp. 240–245 (2007)

  20. Jackson, J.E.: A user’s guide to principal components, vol. 587. Wiley (2005)

  21. Khatib, O.: Real-time obstacle avoidance for manipulators and mobile robots. Int. J. Robot. Res. 5(1), 90–98 (1986)

    Article  MathSciNet  Google Scholar 

  22. Kim, C., Kim, D., Oh, Y.: Solving an inverse kinematics problem for a humanoid robots imitation of human motions using optimization. In: Proceedings of International Conference on Informatics in Control Automation and Robotics, pp. 85–92 (2005)

  23. Kulic, D., Takano, W., Nakamura, Y.: Representability of human motions by factorial hidden markov models. In: Proceedings of IEEE/RSJ International Conference Intelligent Robots and Systems, pp. 2388–2393 (2007)

  24. Lee, J., Sato, M., Wada, Y., Koike, Y.: Extraction of motor primitive in consideration of arm posture, movement direction and velocity using hidden markov model. In: Proceedings of the IEEE-EMBS Annual International Conference of the Engineering in Medicine and Biology Society, pp. 4385–4388 (2005)

  25. McLachlan, G., Peel, D.: Finite Mixture Models. Wiley (2004)

  26. Mohan, V., Morasso, P., Metta, G., Sandini, G.: A biomimetic, force-field based computational model for motion planning and bimanual coordination in humanoid robots. Auton. Robot. 27(3), 291–307 (2009)

    Article  Google Scholar 

  27. Pollard, N.S., Hodgins, J.K., Riley, M. J., Atkeson, C. G.: Adapting human motion for the control of a humanoid robot. Proc. IEEE Int. Conf. Robot. Autom. 2, 1390–1397 (2002)

    Google Scholar 

  28. Potkonjak, V., Popovic, M., Lazarevic, M., Sinanovic, J.: Redundancy problem in writing: from human to anthropomorphic robot arm. IEEE Trans. Syst. Man Cybern. B 28, 790–805 (1998)

    Article  Google Scholar 

  29. Ruhr, T., Sturm, J., Pangercic, D., Beetz, M., Cremers, D.: A generalized framework for opening doors and drawers in kitchen environments. In: Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 3852–3858 (2012)

  30. Schaal, S., Kotosaka, S., Sternad, D.: Nonlinear dynamical systems as movement primitives. In: IEEE International Conference on Humanoid Robotics, pp. 1–11 (2000)

  31. Sciavicco, L., Siciliano, B.:Modeling and Control of Robot Manipulators. Springer (2000)

  32. Shi, J.Q., Choi, T.: Gaussian Process Regression Analysis for Functional Data. CRC Press (2011)

  33. Sian, N., Sakaguchi, T., Yokoi, K., Kawai, Y.: Operating humanoid robots in human environments. In: Proceedings of the Robotics, Science & Systems Workshop on Manipulation for Human Environments, Philadelphia (2006)

  34. Smith, C., Karayiannidis, Y., Nalpantidis, L., Gratal, X., Qi, P., Dimarogonas, D. V., Kragic, D.: Dual arm manipulation—a survey. Robot. Auton. Syst. 60, 1340–1353 (2012)

    Article  Google Scholar 

  35. Steffen, J., Elbrechter, C., Haschke, R., Ritter, H.: Bio-inspired motion strategies for a bimanual manipulation task. In: 2010 10th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pp. 625–630 (2010)

  36. Steffen, J., Pardowitz, M., Ritter, H.: Using structured UKR manifolds for motion classification and segmentation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4785–4790 (2009)

  37. Temprado, J.J., Swinnen, S.P., Carson, R.G., Tourment, A., Laurent, M.: Interaction of directional, neuromuscular and egocentric constraints on the stability of preferred bimanual coordination patterns, Human movement science (2003)

  38. Inamura, T., Toshima, I., Tanie, H., Nakamura, Y.: Embodied symbol emergence based on mimesis theory. Int. J. Robot. Res. 23(3–5), 363–377 (2004)

    Article  Google Scholar 

  39. Treffner, P.J., Turvey, M.T.: Symmetry, broken symmetry, and handedness in bimanual coordination dynamics. Exp. Brain Res. 107(3), 463–478 (1996)

    Article  Google Scholar 

  40. Ude, A., Atkeson, C.G., Riley, M.: Programming full-body movements for humanoid robots by observation. Robot. Auton. Syst. 47(2), 93–108 (2004)

    Article  Google Scholar 

  41. Uno, Y., Kawato, M., Suzuki, R.: Formation and control of optimal trajectory in human multijoint arm movement. Biol. Cybern. 61, 89–101 (1989)

    Article  Google Scholar 

  42. Zacharias, F., Leidner, D., Schmidt, F., Borst, C., Hirzinger, G.: Exploiting structure in two-armed manipulation tasks for humanoid robots. In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5446–5452 (2010)

  43. Zhuang, J., LaConte, S., Peltier, S., Zhang, K., Hu, X.: Connectivity exploration with structural equation modeling: an fMRI study of bimanual motor coordination. Neuroimage 25(2), 462–470 (2005)

    Article  Google Scholar 

  44. Zollner, R, Asfour, T, Dillmann, R.: Programming by demonstration: dual-arm manipulation tasks for humanoid robots. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 1, pp. 479–484 (2004)

Download references

Author information

Authors and Affiliations

  1. Human-Oriented Robotics and Control Lab, School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, AZ, 85287, USA

    Stephen Warren & Panagiotis Artemiadis

Authors
  1. Stephen Warren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Panagiotis Artemiadis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Panagiotis Artemiadis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Warren, S., Artemiadis, P. On the Control of Human-Robot Bi-Manual Manipulation. J Intell Robot Syst 78, 21–32 (2015). https://doi.org/10.1007/s10846-014-0055-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-014-0055-4

Keywords

Search

Navigation