Skip to main content
SpringerLink
Log in

Human-Robot Adaptive Control of Object-Oriented Action

  • Chapter
Immersive Multimodal Interactive Presence

Part of the book series: Springer Series on Touch and Haptic Systems ((SSTHS))

  • 808 Accesses

Abstract

This chapter is concerned with how implicit, nonverbal cues support coordinated action between two partners. Recently, neuroscientists have started uncovering the brain mechanisms involved in how people make predictions about other people’s behavioural goals and intentions through action observation. To date, however, only a small number of studies have addressed how the involvement of a task partner influences the planning and control of one’s own purposeful action. Here, we review three studies of cooperative action between human and robot partners that address the nature of predictive and reactive motor control in cooperative action. We conclude with a model which achieves motor coordination by task partners each adjusting their actions on the basis of previous trial outcome.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Danchin, E., Giraldeau, L.A., Valone, T.J., Wagner, R.H.: Public information: From noisy neighbors to cultural evolution. Science 305, 487–491 (2004)

    Article  Google Scholar 

  2. Herrmann, E., Call, J., Hernandez-Lloreda, M.V., Hare, B., Tomasello, M.: Humans have evolved specialized skills of social cognition: The cultural intelligence hypothesis. Science 317, 1360–1366 (2007)

    Article  Google Scholar 

  3. Brosnan, S.F., Bshary, R.: Cooperation and deception: from evolution to mechanisms introduction. Philos. Trans. R. Soc. Lond. B, Biol. Sci. 365, 2593–2598 (2010)

    Article  Google Scholar 

  4. Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together. Trends Cogn. Sci. 10, 70–76 (2006)

    Article  Google Scholar 

  5. Sebanz, N., Knoblich, G., Prinz, W.: Representing others’ actions: Just like one’s own? Cognition 88, B11–B21 (2003)

    Article  Google Scholar 

  6. Tsai, C.C., Kuo, W.J., Jing, J.T., Hung, D.L., Tzeng, O.J.L.: A common coding framework in self-other interaction: evidence from joint action task. Exp. Brain Res. 175, 353–362 (2006)

    Article  Google Scholar 

  7. Knoblich, G., Sebanz, N.: The social nature of perception and action. Curr. Dir. Psychol. Sci. 15, 99–104 (2006)

    Article  Google Scholar 

  8. Rizzolatti, G., Sinigaglia, C.: The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations. Nat. Rev., Neurosci. 11, 264–274 (2010)

    Article  Google Scholar 

  9. Bosga, J., Meulenbroek, R.G.J.: Joint-action coordination of redundant force contributions in a virtual lifting task. Mot. Control 11, 235–258 (2007)

    Google Scholar 

  10. Newman-Norlund, R.D., van Schie, H.T., van Zuijlen, A.M.J., Bekkering, H.: The mirror neuron system is more active during complementary compared with imitative action. Nat. Neurosci. 10, 817–818 (2007)

    Article  Google Scholar 

  11. Reed, K., Peshkin, M., Hartmann, M.J., Grabowecky, M., Patton, J., Vishton, P.M.: Haptically linked dyads—are two motor-control systems better than one? Psychol. Sci. 17, 365–366 (2006)

    Article  Google Scholar 

  12. Faisal, A.A., Selen, L.P.J., Wolpert, D.M.: Noise in the nervous system. Nat. Rev., Neurosci. 9, 292–303 (2008)

    Article  Google Scholar 

  13. Johansson, R.S., Westling, G.: Programmed and triggered actions to rapid load changes during precision grip. Exp. Brain Res. 71, 72–86 (1988)

    Google Scholar 

  14. Darton, K., Lippold, O.C., Shahani, M., Shahani, U.: Long-latency spinal reflexes in humans. J. Neurophysiol. 53, 1604–1618 (1985)

    Google Scholar 

  15. Wolpert, D.M., Ghahramani, Z.: Computational principles of movement neuroscience. Nat. Neurosci. 3, 1212–1217 (2000)

    Article  Google Scholar 

  16. Kawato, M.: Internal models for motor control and trajectory planning. Curr. Opin. Neurobiol. 9(6), 718–727 (1999)

    Article  Google Scholar 

  17. Thoroughman, K.A., Shadmehr, R.: Learning of action through adaptive combination of motor primitives. Nature 407, 742–747 (2000)

    Article  Google Scholar 

  18. Vorberg, D., Wing, A.: Modeling variability and dependence in timing. In: Keele, S., Heuer, H. (eds.) Handbook of Perception and Action, pp. 181–262. Academic Press, New York (1996)

    Google Scholar 

  19. Behrens, T.E.J., Hunt, L.T., Woolrich, M.W., Rushworth, M.F.S.: Associative learning of social value. Nature 456, 245–249 (2008)

    Article  Google Scholar 

  20. Kon, H., Miyake, Y.: An analysis and modeling of mutual synchronization process in cooperative tapping. J. Hum. Interface Soc. 7, 61–70 (2005)

    Google Scholar 

  21. Repp, B.H., Keller, P.E.: Sensorimotor synchronization with adaptively timed sequences. Hum. Mov. Sci. 27, 423–456 (2008)

    Article  Google Scholar 

  22. Schuch, S., Tipper, S.P.: On observing another person’s actions: Influences of observed inhibition and errors. Percept. Psychophys. 69, 828–837 (2007)

    Article  Google Scholar 

  23. Rabbitt, P.M.A.: Errors and error correction in choice-response tasks. J. Exp. Psychol. 71, 264–672 (1966)

    Article  Google Scholar 

  24. Notebaert, W., Houtman, F., Van Opstal, F., Gevers, W., Fias, W., Verguts, T.: Post-error slowing: An orienting account. Cognition 111, 275–279 (2009)

    Article  Google Scholar 

  25. Flash, T., Hogan, N.: The coordination of arm movements—an experimentally confirmed mathematical-model. J. Neurosci. 5, 1688–1703 (1985)

    Google Scholar 

  26. Ito, S., Yuasa, H., Ito, M., Hosoe, S.: On an adaptation in distributed system based on a gradient dynamics. In: Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, Japan (1999)

    Google Scholar 

  27. Murian, A., Deschamps, T., Bourbousson, J., Temprado, J.J.: Influence of an exhausting muscle exercise on bimanual coordination stability and attentional demands. Neurosci. Lett. 432, 64–68 (2008)

    Article  Google Scholar 

  28. Griffiths, D., Tipper, S.P.: Priming of reach trajectory when observing actions: Hand-centred effects. Q. J. Exp. Psychol. 62, 2450–2470 (2009)

    Article  Google Scholar 

  29. Endo, S., Bracewell, R.M., Wing, A.M.: Learning cooperative object lifting using haptic feedbacks (submitted)

    Google Scholar 

  30. Quinn, M., Smith, L., Mayley, G., Husbands, P.: Evolving controllers for a homogeneous system of physical robots: structured cooperation with minimal sensors. Philos. Trans. R. Soc., Math. Phys. Eng. Sci. 361, 2321–2343 (2003)

    Article  MathSciNet  Google Scholar 

  31. Vaughan, R.T., Støy, K., Sukhatme, G.S., Mataric, M.J.: Go ahead; make my day: Robot conflict resolution by aggressive competition. Anim. Animats 6, 491–500 (2000)

    Google Scholar 

  32. Stone, P., Veloso, M.: Task decomposition, dynamic role assignment, and low-bandwidth communication for real-time strategic teamwork. Artif. Intell. 110, 241–273 (1999)

    Article  MATH  Google Scholar 

  33. Di Paolo, E.A., Rohde, M., Iizuka, H.: Sensitivity to social contingency or stability of interaction? Modelling the dynamics of perceptual crossing. New Ideas Psychol. 26, 278–294 (2008)

    Article  Google Scholar 

  34. Thompson, E., Varela, F.J.: Radical embodiment: neural dynamics and consciousness. Trends Cogn. Sci. 5, 418–425 (2001)

    Article  Google Scholar 

  35. Tognoli, E., Lagarde, J., deGuzman, G.C., Kelso, J.A.S.: The phi complex as a neuromarker of human social coordination. In: Proceedings of the National Academy of Sciences of the United States of America, vol. 104, pp. 8190–8195 (2007)

    Google Scholar 

  36. van Ulzen, N.R., Lamoth, C.J.C., Daffertshofer, A., Semin, G.R., Beek, P.J.: Characteristics of instructed and uninstructed interpersonal coordination while walking side-by-side. Neurosci. Lett. 432, 88–93 (2008)

    Article  Google Scholar 

  37. Zivotofsky, A.Z., Hausdorff, J.M.: The sensory feedback mechanisms enabling couples to walk synchronously: An initial investigation. Journal of Neuroengineering and Rehabilitation 4(28) (2007)

    Google Scholar 

  38. Chartrand, T.L., Bargh, J.A.: The chameleon effect: The perception-behavior link and social interaction. J. Pers. Soc. Psychol. 76, 893–910 (1999)

    Article  Google Scholar 

  39. Wilson, M., Knoblich, G.: The case for motor involvement in perceiving conspecifics. Psychol. Bull. 131, 460–473 (2005)

    Article  Google Scholar 

  40. Richardson, M.J., Marsh, K.L., Isenhower, R.W., Goodman, J.R.L., Schmidt, R.C.: Rocking together: Dynamics of intentional and unintentional interpersonal coordination. Hum. Mov. Sci. 26, 867–891 (2007)

    Article  Google Scholar 

  41. Neda, Z., Ravasz, E., Brechet, Y., Vicsek, T., Barabasi, A.L.: The sound of many hands clapping—tumultuous applause can transform itself into waves of synchronized clapping. Nature 403, 849–850 (2000)

    Article  Google Scholar 

  42. Oullier, O., de Guzman, G.C., Jantzen, K.J., Lagarde, J., Kelso, J.A.S.: Social coordination dynamics: Measuring human bonding. Soc. Neurosci. 3, 178–192 (2008)

    Article  Google Scholar 

  43. Schmidt, R.C., Bienvenu, M., Fitzpatrick, P.A., Amazeen, P.G.: A comparison of intra- and interpersonal interlimb coordination: Coordination breakdowns and coupling strength. J. Exp. Psychol. Hum. Percept. Perform. 24, 884–900 (1998)

    Article  Google Scholar 

  44. Felmlee, D.H., Greenberg, D.F.: A dynamic systems model of dyadic interaction. J. Math. Sociol. 23, 155–180 (1999)

    Article  MATH  Google Scholar 

  45. Vorberg, D., Schulze, H.H.: Linear phase-correction in synchronization: Predictions; parameter estimation; and simulations. J. Math. Psychol. 46, 56–87 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  46. Endo, S., Wing, A.M., Diedrichsen, J.: Joint adaptation in cooperative action (submitted)

    Google Scholar 

  47. Braun, D.A., Ortega, P.A., Wolpert, D.M.: Nash equilibria in multi-agent motor interactions. PLoS Comput. Biol. 5(8), 1–8 (2009)

    Article  MathSciNet  Google Scholar 

  48. Brownlow, S., Dixon, A.R., Egbert, C.A., Radcliffe, R.D.: Perception of movement and dancer characteristics from point-light displays of dance. Psychol. Rec. 47, 411–421 (1997)

    Google Scholar 

  49. Blake, R., Shiffrar, M.: Perception of human motion. Annu. Rev. Psychol. 58, 47–73 (2007)

    Article  Google Scholar 

  50. Shim, J., Carlton, J.G.: Perception of kinematic characteristics in the motion of lifted weight. J. Mot. Behav. 29(2), 131–146 (1997)

    Article  Google Scholar 

  51. Stanley, J., Gowen, E., Miall, R.C.: Effects of agency on movement interference during observation of a moving dot stimulus. J. Exp. Psychol. Hum. Percept. Perform. 33, 915–926 (2007)

    Article  Google Scholar 

  52. Gazzola, V., Rizzolatti, G., Wicker, B., Keysers, C.: The anthropomorphic brain: The mirror neuron system responds to human and robotic actions. NeuroImage 35, 1674–1684 (2007)

    Article  Google Scholar 

  53. Kilner, J.M., Paulignan, Y., Blakemore, S.J.: An interference effect of observed biological movement on action. Curr. Biol. 13, 522–525 (2003)

    Article  Google Scholar 

  54. Grammer, K., Kruck, K., Juette, A., Fink, B.: Non-verbal behavior as courtship signals: The role of control and choice in selecting partners. Evol. Hum. Behav. 21, 371–390 (2000)

    Article  Google Scholar 

  55. Janovic, T., Ivkovic, V., Nazor, D., Grammer, K., Jovanovic, V.: Empathy, communication, deception. Coll. Antropol. 27, 809–822 (2003)

    Google Scholar 

  56. Isenhower, R.M., Marsh, K.L., Carello, C., Baron, R.M., Richardson, R.M.: The specificity of intrapersonal and interpersonal affordance boundaries: intrinsic versus extrinsic metrics. In: Heft, H., Marsh, K.L. (eds.) Studies in Perception and Action, VIII, pp. 54–58. Erlbaum, Hillsdale (2005)

    Google Scholar 

Download references

Acknowledgements

This work was partly supported by the ImmerSence project within the 6th Framework Programme of the European Union, FET—Presence Initiative, contract number IST-2006-027141, see also www.immersence.info and by BBSRC grant BB/F010087/1 to AMW.

Author information

Authors and Affiliations

  1. Behavioural Brain Sciences Centre, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK

    Satoshi Endo & Alan M. Wing

  2. Laboratoire d’Intégration des Systémes et des Technologies (LIST), Commissariat à l’énergie atomique et aux énergies alternatives (CEA), Fontenay-aux-Roses, France

    Paul Evrard

  3. CNRS-AIST Joint Robotics Laboratory (JRL), UMI3218/CRT, Tsukuba, Japan

    Abderrahmane Kheddar

  4. CNRS-UM2 LIRMM, Interactive Digital Human, Montpellier, France

    Abderrahmane Kheddar

Authors
  1. Satoshi Endo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul Evrard
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abderrahmane Kheddar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alan M. Wing
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Satoshi Endo .

Editor information

Editors and Affiliations

  1. Electro- and Information Technology, Technische Universität München, Theresienstrasse 90, Munich, 80333, Germany

    Angelika Peer

  2. Research and Development, BMT Group Ltd, Goodrich House, Waldegrave Road 1, Teddington, TW11 8LZ, United Kingdom

    Christos D. Giachritsis

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag London Limited

About this chapter

Cite this chapter

Endo, S., Evrard, P., Kheddar, A., Wing, A.M. (2012). Human-Robot Adaptive Control of Object-Oriented Action. In: Peer, A., Giachritsis, C. (eds) Immersive Multimodal Interactive Presence. Springer Series on Touch and Haptic Systems. Springer, London. https://doi.org/10.1007/978-1-4471-2754-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2754-3_6

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2753-6

  • Online ISBN: 978-1-4471-2754-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation