Abstract
Synchrony is claimed by psychology as a crucial parameter of any social interaction: to give to human a feeling of natural interaction, a feeling of agency [17], an agent must be able to synchronise with this human on appropriate time [29] [11] [15] [16] [27]. In the following experiment, we show that synchrony can be more than a state to reach during interaction, it can be a useable cue of the human’s satisfaction and level of engagement concerning the ongoing interaction: the better is the interaction, the more synchronous with the agent is the human. We built an architecture that can acquire a human partner’s level of synchrony and use this parameter to adapt the agent behavior. This architecture detects temporal relation [1] existing between the actions of the agent and the actions of the human. We used this detected level of synchrony as reinforcement for learning [6]: the more constant the temporal relation between agent and human remains, the more positive is the reinforcement, conversely if the temporal relation varies above a threshold the reinforcement is negative. In a teaching task, this architecture enables naive humans to make the agent learn left-right associations just by the mean of intuitive interactions. The convergence of this learning reinforced by synchrony shows that synchrony conveys current information concerning human satisfaction and that we are able to extract and reuse this information to adapt the agent behavior appropriately.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Andry, P., Gaussier, P., Moga, S., Banquet, J.P., Nadel, J.: Learning and Communication in Imitation: An Autonomous Robot Perspective. IEEE transactions on Systems, Man and Cybernetics, Part A 31(5), 431–444 (2001)
Andry, P., Moga, S., Gaussier, P., Revel, A., Nadel, J.: Imitation: learning and communication. In: The Sixth International Conference on Simulation for Adaptive Behavior SAB 2000, Paris, pp. 353–362. MIT Press, Cambridge (2000)
Banquet, J.P., Gaussier, P., Dreher, J.C., Joulain, C., Revel, A., Günther, W.: Space-time, order, and hierarchy in fronto-hippocampal system: A neural basis of personality. In: Matthews, G. (ed.) Advances in Psychology, Amsterdam, vol. 124, pp. 123–189. North-Holland, Amsterdam (1997)
Condon, W.S.: An analysis of behavioral organisation. Sign Language Studies 13, 285–318 (1976)
Condon, W.S., Ogston, W.D.: Sound film analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease 143, 338–347 (1966)
Gaussier, P., Revel, A., Joulain, C., Zrehen, S.: Living in a partially structured environment: How to bypass the limitation of classical reinforcement techniques. Robotics and Autonomous Systems 20, 225–250 (1997)
Gergely, G., Watson, J.: The social biofeedback model of parental affect-mirroring. International Journal of Psycho-Analysis 77, 1181–1212 (1996)
Gergely, G., Watson, J.: Early social-emotional development: Contingency perception and the social biofeedback model. In: Early social cognition, pp. 101–136. Erlbaum, Hillsdale (1999)
Grossberg, S., Merrill, J.W.L.: The hippocampus and cerebellum in adaptively timed learning, recognition, and movement. Journal of Cognitive Neuroscience 8, 257–277 (1996)
Lopresti-Goodman, S.M., Richardson, M.J., Silva, P.L., Schmidt, R.C.: Period basin of entrainment for unintentional visual coordination. Journal of Motor Behavior 40(1), 3–10 (2008)
Murray, L., Trevarthen, C.: Emotional regulation of interactions vetween two-month-olds and their mothers. Social perception in infants, 101–125 (1985)
Nadel, J.: Imitation et communication entre jeunes enfants. Presse Universitaire de France, Paris (1986)
Nadel, J.: The functionnal use of imitation in preverbal infants and nonverbal children with autism. In: Meltzoff, A., Prinz, W. (eds.) The Imitative Mind: Developement, Evolution and Brain Bases. Cambridge University Press, Cambridge (2000)
Nadel, J.: Imitation and imitation recognition: their functional role in preverbal infants and nonverbal children with autism, pp. 42–62. Cambridge University Press, UK (2002)
Nadel, J., Camaioni, L.: New Perspectives in Early Communicative Development. Routledge, London (1993)
Nadel, J., Guerini, C., Peze, A., Rivet, C.: The evolving nature of imitation as a format for communication. In: Nadel, G., Butterworth, J. (eds.) Imitation in Infancy, pp. 209–234. Cambridge University Press, Cambridge (1999)
Nadel, J., Prepin, K., Okanda, M.: Experiencing contigency and agency: first step toward self-understanding? In: Hauf, P. (ed.) Making Minds II: Special issue of Interaction Studies 6:3 2005, pp. 447–462. John Benjamins publishing company, Amsterdam (2005)
Nadel, J., Tremblay-Leveau, H.: Early social cognition, chapter Early perception of social contingencies and interpersonal intentionality: dyadic and triadic paradigms, pp. 189–212. Lawrence Erlbaum Associates, Mahwah (1999)
Oullier, O., de Guzman, G.C., Jantzen, K.J., Lagarde, J., Kelso, J.A.S.: Social coordination dynamics: Measuring human bonding. Social Neuroscience 3(2), 178–192 (2008)
Oullier, O., Kelso, J.A.S.: Coordination from the perspective of Social Coordination Dynamics. In: Encyclopedia of Complexity and Systems Science. Springer, Heidelberg (2009)
Pikovsky, A., Rosenblum, M., Kurths, J.: Synchronization: A Universal Concept in Nonlinear Sciences. Cambridge University Press, Cambridge (1981)
Pineda, J.A.: The functional significance of mu rhythms: Translating “seeing” and “hearing” into “doing”. Brain Research Reviews 50, 57–68 (2005)
Prepin, K., Revel, A.: Human-machine interaction as a model of machine-machine interaction: how to make machines interact as humans do. Advanced Robotics 21(15), 1709–1723 (2007)
Revel, A.: Contrôle d’un robot mobile autonome par approche neuro-mimétique. Doctorat de traitement de l’image et du signal, Université de Cergy-Pontoise (Novembre 1997)
Richardson, M.J., Marsh, K.L., Isenhower, R.W., Goodman, J.R.L., Schmidt, R.C.: Rodking together: Dynamics of intentional and unitentional interpersonal coordination. Human Movement Science 26, 867–891 (2007)
Richardson, M.J., Marsh, K.L., Schmidt, R.C.: Effects of visual and verbal interaction on unintentional interpersonal coordination. Journal of Experimental Psychology: Human Perception and Performance 31(1), 62–79 (2005)
Soussignan, R., Nadel, J., Canet, P., Girardin, P.: Sensitivity to social contingency and positive emotion in 2-month-olds. Infancy 10(2), 123–144 (2006)
Tognoli, E., Lagarde, J., DeGuzman, G.C., Kelso, J.A.S.: The phi complex as a neuromarker of human social coordination (2007)
Tronick, E., Als, H., Adamson, L., Wise, S., Brazelton, T.B.: The infants’ response to entrapment between contradictory messages in face-to-face interactions. Journal of the American Academy of Child Psychiatry (Psychiatrics) 17, 1–13 (1978)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Prepin, K., Gaussier, P. (2010). How an Agent Can Detect and Use Synchrony Parameter of Its Own Interaction with a Human?. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds) Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science, vol 5967. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12397-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-12397-9_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12396-2
Online ISBN: 978-3-642-12397-9
eBook Packages: Computer ScienceComputer Science (R0)