Skip to main content
Springer Nature Link
Log in

Human–Robot Interaction

  • Chapter
Advanced Bimanual Manipulation

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 80))

Abstract

To interact with humans, robots will possess a software architecture much more complete than current robots and be equipped with new functionalities. The purpose of this chapter is to introduce some necessary elements to build companion robots that interact physically with humans and particularly for the exchange of object tasks. To obtain soft motion acceptable by humans, we use trajectories represented by cubic functions of time that allow mastering and limiting velocity, acceleration and jerk of the robot in the vicinity of the humans. During a hand-over task and to adapt its trajectory to the human behavior, the robot must adjust the time motion law and the path of the trajectory in real time. The necessity of real time planning is illustrated by the task of exchanging an object and in particular by the planning of double grasps. The robot has to choose dynamically a consistent grasp that enables both robot and human to hold simultaneously the exchanged object. Then, we present a robotic control system endowed with attentional models and mechanisms suitable for balancing the trade-off between safe human–robot interaction (HRI) and effective task execution. In particular, these mechanisms allow the robot to increase or decrease the degree of attention toward relevant activities modulating the frequency of the monitoring rate and the speed associated to the robot movements. In this attentional framework, we consider pick-and-place and give-and-receive attentional behaviors. To assess the system performances we introduce suitable evaluation criteria taking into account safety, reliability, efficiency, and effectiveness.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Alami, R., Albu-Schäffer, A., Bicchi, A., Bischoff, R., Chatila, R., De Luca, A., De Santis, A., Giralt, G., Hirzinger, G., Lippiello, V., Mattone, R., Sen, S., Siciliano, B., Tonietti, G., Villani, L.: Safe and dependable physical human-robot interaction in anthropic domains: State of the art and challenges. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Workshop on Physical Human–Robot Interaction, Beijing (2006)

    Google Scholar 

  2. Arbib, M.A.: Schema theory. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, pp. 830–834. MIT Press, Cambridge (1998)

    Google Scholar 

  3. Berchtold, S., Glavina, B.: A scalable optimizer for automatically generated manipulator motions. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai (2004)

    Google Scholar 

  4. Berenson, D., Diankov, R., Nishiwaki, K., Kagami, S., Kuffner, J.: Grasp planning in complex scenes. In: 7th IEEE-RAS International Conference on Humanoid Robots, Pittsburgh, PA (2007)

    Google Scholar 

  5. Bicchi, A.: On the closure properties of robotic grasping. International Journal of Robotics Research 14, 319–334 (1995)

    Article  Google Scholar 

  6. Bicchi, A., Tonietti, G.: Fast and soft arm tactics: Dealing with the safety-performance trade-off in robot arms design and control 11(2), 22–33 (2004)

    Google Scholar 

  7. Bounab, B., Sidobre, D., Zaatri, A.: Central axis approach for computing n-finger force-closure grasps. In: IEEE International Conference on Robotics and Automation, Pasadena, CA (2008)

    Google Scholar 

  8. Breazeal, C.: Designing Sociable Robots. MIT Press, Cambridge (2002)

    Google Scholar 

  9. Brock, O., Khatib, O.: Real-time re-planning in high-dimensional configuration spaces using sets of homotopic paths. In: IEEE International Conference on Robotics and Automation, San Francisco, CA (2000)

    Google Scholar 

  10. Broquère, X.: Planification de trajectoire pour la manipulation d’objets et l’interaction homme-robot, Ph.D. thesis, LAAS-CNRS and Université Paul Sabatier (2011)

    Google Scholar 

  11. Broquère, X., Sidobre, D.: From motion planning to trajectory control with bounded jerk for service manipulator robots. In: IEEE International Conference on Robotics and Automation, Anchorage, AK (2010)

    Google Scholar 

  12. Broquère, X., Sidobre, D., Herrera-Aguilar, I.: Soft motion trajectory planner for service manipulator robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice (2008)

    Google Scholar 

  13. Burattini, E., Finzi, A., Rossi, S., Staffa, M.: Attentive monitoring strategies in a behavior-based robotic system: An evolutionary approach. In: International Conference on Emerging Security Technologies, Canterbury, UK (2010)

    Google Scholar 

  14. Burattini, E., Finzi, A., Rossi, S., Staffa, M.: Attentional human-robot interaction in simple manipulation tasks. In: 7th ACM/IEEE International Conference on Human Robot Interaction, Boston, MA (2012)

    Google Scholar 

  15. Burattini, E., Rossi, S.: A robotic architecture with innate releasing mechanism. In: 2nd International Symposium on Brain, Vision and Artificial Intelligence, Napoli (2007)

    Google Scholar 

  16. Burattini, E., Rossi, S.: Periodic adaptive activation of behaviors in robotic system. International Journal of Pattern Recognition and Artificial Intelligence 22, 987–999 (2008)

    Article  Google Scholar 

  17. Cakmak, M., Srinivasa, S.S., Lee, M.K., Forlizzi, J., Kiesler, S.: Human preferences for robot-human hand-over configurations. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA (2011)

    Google Scholar 

  18. Cakmak, M., Srinivasa, S.S., Lee, M.K., Kiesler, S., Forlizzi, J.: Using spatial and temporal contrast for fluent robot-human hand-overs. In: 6th International Conference on Human–Robot Interaction, New York (2011)

    Google Scholar 

  19. Carbone, A., Finzi, A., Orlandini, A., Pirri, F.: Model-based control architecture for attentive robots in rescue scenarios. Autonomous Robots 24, 87–120 (2008)

    Article  Google Scholar 

  20. Ciocarlie, M., Goldfeder, C., Allen, P.: Dimensionality reduction for hand-independent dexterous robotic grasping. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA (2007)

    Google Scholar 

  21. Cooper, R., Shallice, T.: Contention scheduling and the control of routine activities. Cognitive Neuropsychology 17, 297–338 (2000)

    Article  Google Scholar 

  22. Cornellà, J., Suárez, R.: Fast and flexible determination of force-closure independent regions to grasp polygonal objects. In: IEEE International Conference on Robotics and Automation, Barcelona (2005)

    Google Scholar 

  23. Cornellà, J., Suárez, R.: Determining independent grasp regions on 2D discrete objects. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton (2005)

    Google Scholar 

  24. Cortés, J., Siméon, T.: Sampling-based motion planning under kinematic loop-closure constraints. In: 6th International Workshop on Algorithmic Foundations of Robotics, Utrecht (2004)

    Google Scholar 

  25. Diankov, R., Ratliff, N., Ferguson, D., Srinivasa, S., Kuffner, J.: Bispace planning: Concurrent multi-space exploration. In: Robotics: Science and Systems, Zurich (2008)

    Google Scholar 

  26. Ding, D., Liu, Y.H., Wang, S.: The synthesis of 3D form-closure grasps. In: IEEE International Conference on Robotics and Automation, San Francisco, CA (2000)

    Google Scholar 

  27. Edsinger, A., Kemp, C.C.: Human–robot interaction for cooperative manipulation: Handling objects to one another. In: 16th IEEE International Symposium on Robot and Human Interactive Communication, Jeju Island, Korea (2007)

    Google Scholar 

  28. Ferguson, D., Stentz, A.: Anytime RRTs. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing (2006)

    Google Scholar 

  29. Ferrari, C., Canny, J.: Planning optimal grasps. In: IEEE International Conference on Robotics and Automation, Nice (1992)

    Google Scholar 

  30. Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. Journal of Neuroscience 5, 1688–1703 (1985)

    Google Scholar 

  31. Frintrop, S., Jensfelt, P., Christensen, H.I.: Attentional landmark selection for visual slam. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing (2006)

    Google Scholar 

  32. Goldfeder, C., Allen, P., Lackner, C., Pelossof, R.: Grasp planning via decomposition trees. In: IEEE International Conference on Robotics and Automation, Roma (2007)

    Google Scholar 

  33. Haddadin, S., Albu-Schäffer, A., Hirzinger, G.: Requirements for safe robots: Measurements, analysis and new insights. International Journal of Robotics Research 28, 1507–1527 (2009)

    Article  Google Scholar 

  34. Hall, E.T.: A system for the notation of proxemic behavior. American Anthropologist 65, 1003–1026 (1963)

    Article  Google Scholar 

  35. Han, L., Amato, N.: A kinematics-based probabilistic roadmap method for closed chain systems. In: Donald, B.R., Lynch, K.M., Rus, D. (eds.) Algorithmic and Computational Robotics: New Directions, pp. 233–246. A.K. Peters, Wellesley (2001)

    Google Scholar 

  36. Harada, K., Kaneko, K., Kanehiro, F.: Fast grasp planning for hand/arm systems based on convex model. In: IEEE International Conference on Robotics and Automation, Roma (2008)

    Google Scholar 

  37. Huber, M., Rickert, M., Knoll, A., Brandt, T., Glasauer, S.: Human–robot interaction in handing-over tasks. In: 17th International Symposium on Robot and Human Interactive Communication, München (2008)

    Google Scholar 

  38. Huebner, K., Ruthotto, S., Kragic, D.: Minimum volume bounding box decomposition for shape approximation in robot grasping. In: IEEE International Conference on Robotics and Automation, Roma (2008)

    Google Scholar 

  39. Ikuta, K., Ishii, H., Nokata, M.: Safety evaluation method of design and control for human-care robots. International Journal of Robotics Research 22, 281–297 (2003)

    Article  Google Scholar 

  40. Jaillet, L., Cortés, J., Siméon, T.: Sampling-based path planning on configuration-space costmaps. IEEE Transactions on Robotics 26, 635–646 (2010)

    Article  Google Scholar 

  41. Kahneman, D.: Attention and Effort. Prentice-Hall, Englewood Cliffs (1973)

    Google Scholar 

  42. Koay, K.L., Sisbot, E.A., Syrdal, D.A., Walters, M.L., Dautenhahn, K., Alami, R.: Exploratory study of a robot approaching a person in the context of handling over an object. In: Association for the Advancement of Artificial Intelligence Spring Symposia, Palo Alto, CA (2007)

    Google Scholar 

  43. LaValle, S.M., Kuffner, J.J.: Rapidly-exploring random trees: Progress and prospects. In: 4th International Workshop on the Algorithmic Foundations of Robotics, Hanover, NH (2000)

    Google Scholar 

  44. Mainprice, J., Sisbot, E., Jaillet, L., Cortés, J., Siméon, T., Alami, R.: Planning human-aware motions using a sampling-based costmap planner. In: IEEE International Conference on Robotics and Automation, Shanghai (2011)

    Google Scholar 

  45. Marler, R., Rahmatalla, S., Shanahan, M., Abdel-Malek, K.: A new discomfort function for optimization-based posture prediction. In: Digital Human Modeling for Design and Engineering Conference, Seattle, WA (2005)

    Google Scholar 

  46. Miller, A., Allen, P.: Graspit! a versatile simulator for robotic grasping. IEEE Robotics & Automation Magazine 11(4), 110–122 (2004)

    Article  Google Scholar 

  47. Miller, A., Knoop, S., Christensen, H., Allen, P.: Automatic grasp planning using shape primitives. In: IEEE International Conference on Robotics and Automation, Taipei (2003)

    Google Scholar 

  48. Mitsunaga, N., Asada, M.: Visual attention control for a legged mobile robot based on information criterion. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Lausanne (2002)

    Google Scholar 

  49. Nagai, Y., Hosoda, K., Morita, A., Asada, M.: A constructive model for the development of joint attention. Connection Science 15, 211–229 (2003)

    Article  Google Scholar 

  50. Nguyen, V.D.: Constructing force-closure grasps. In: IEEE International Conference on Robotics and Automation, San Francisco, CA (1986)

    Google Scholar 

  51. Nonaka, S., Inoue, K., Arai, T., Mae, Y.: Evaluation of human sense of security for coexisting robots using virtual reality. 1st report: Evaluation of pick and place motion of humanoid robots. In: IEEE International Conference on Robotics and Automation, New Orleans, LA (2004)

    Google Scholar 

  52. Norman, D., Shallice, T.: Attention in action: Willed and automatic control of behaviour. In: Davidson, R., Schwartz, R., Shapiro, D. (eds.) Consciousness and Self-Regulation: Advances in Research and Theory IV, pp. 1–18 (1986)

    Google Scholar 

  53. Ott, C., Eiberger, O., Friedl, W., Bäuml, B., Hillenbrand, U., Borst, C., Albu-Schäffer, A., Brunner, B., Hirschmüller, H., Kielhöfer, S., Konietschke, R., Suppa, M., Wimböck, T., Zacharias, F., Hirzinger, G.: A humanoid two-arm system for dexterous manipulation. In: 6th IEEE-RAS International Conference on Humanoid Robots, Genova (2006)

    Google Scholar 

  54. Ponce, J., Sullivan, S., Sudsang, A., Boissonnat, J.D., Merlet, J.P.: On computing four-finger equilibrium and force-closure grasps of polyhedral objects. International Journal of Robotics Research 16, 11–35 (1997)

    Article  Google Scholar 

  55. Roa, M., Suárez, R.: Independent contact regions for frictional grasps on 3D objects. In: IEEE International Conference on Robotics and Automation, Pasadena, CA (2008)

    Google Scholar 

  56. Santello, M., Flanders, M., Soechting, J.F.: Postural hand synergies for tool use. Journal of Neuroscience 18, 10105–10115 (1998)

    Google Scholar 

  57. Saxena, A., Driemeyer, J., Ng, A.Y.: Robotic grasping of novel objects using vision. International Journal of Robotics Research 27, 157–173 (2008)

    Article  Google Scholar 

  58. Sisbot, E.A., Marin-Urias, L., Broquère, X., Sidobre, D., Alami, R.: Synthesizing robot motions adapted to human presence. International Journal of Social Robotics 2, 329–343 (2010)

    Article  Google Scholar 

  59. Sisbot, E.A., Clodic, A., Alami, R., Ransan, M.: Supervision and motion planning for a mobile manipulator interacting with humans. In: 3rd ACM/IEEE International Conference on Human Robot Interaction, Amsterdam (2008)

    Google Scholar 

  60. Sisbot, E.A., Marin-Urias, L.F., Alami, R., Siméon, T.: Human aware mobile robot motion planner. IEEE Transactions on Robotics 23, 874–883 (2007)

    Article  Google Scholar 

  61. Sisbot, E.A., Marin-Urias, L.F., Broquère, X., Sidobre, D., Alami, R.: Synthesizing robot motions adapted to human presence — A planning and control framework for safe and socially acceptable robot motions. International Journal of Social Robotics 2, 329–343 (2010)

    Article  Google Scholar 

  62. Price, K., Storn, R.: Differential evolution — A simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 11, 341–359 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  63. Suarez, R., Roa, M., Cornella, J.: Grasp quality measures, Technical Report, Universitat Politecnica de Catalunya (2006)

    Google Scholar 

  64. Tinbergen, N.: The Study of Instinct. Oxford University Press, Oxford (1951)

    Google Scholar 

  65. Todorov, E., Ghahramani, Z.: Analysis of the synergies underlying complex hand manipulation. In: 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Francisco, CA (2004)

    Google Scholar 

  66. Xue, Z., Zöllner, J.M., Dillmann, R.: Grasp planning: Find the contact points. In: IEEE International Conference on Robotics and Biomimetics, Sanya, China (2007)

    Google Scholar 

  67. Yershova, A., LaValle, S.: Deterministic sampling methods for spheres and so(3). In: IEEE International Conference on Robotics and Automation, New Orleans, LA (2004)

    Google Scholar 

  68. Zinn, M., Khatib, O., Roth, B., Salisbury, J.K.: Playing it safe [human-friendly robots]. IEEE Robotics & Automation Magazine 11(2), 12–21 (2004)

    Article  Google Scholar 

  69. Zucker, M., Kuffner, J., Branicky, M.: Multipartite RRTS for rapid replanning in dynamic environments. In: IEEE International Conference on Robotics and Automation, Roma (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. LAAS–CNRS, 7 av. Col. Roche, 31077, Toulouse, France

    Daniel Sidobre, Xavier Broquère & Jim Mainprice

  2. Dipartimento di Scienze Fisiche, Università degli Studi di Napoli Federico II, via Cintia, 80126, Napoli, Italy

    Ernesto Burattini, Alberto Finzi & Silvia Rossi

  3. PRISMA Lab, Dipartimento di Informatica e Sistemistica, Università degli Studi di Napoli Federico II, via Claudio 21, 80125, Napoli, Italy

    Mariacarla Staffa

Authors
  1. Daniel Sidobre
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xavier Broquère
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jim Mainprice
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ernesto Burattini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alberto Finzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Silvia Rossi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mariacarla Staffa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel Sidobre .

Editor information

Editors and Affiliations

  1. Dipto. Informatica e, Sistemistica, Università di Napoli Federico II, Via Claudio 21, Napoli, 80125, Italy

    Bruno Siciliano

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag GmbH Berlin Heidelberg

About this chapter

Cite this chapter

Sidobre, D. et al. (2012). Human–Robot Interaction. In: Siciliano, B. (eds) Advanced Bimanual Manipulation. Springer Tracts in Advanced Robotics, vol 80. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29041-1_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29041-1_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29040-4

  • Online ISBN: 978-3-642-29041-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics