Skip to main content
SpringerLink
Log in
Book cover

Neural Nets and Surroundings pp 345–356Cite as

How Social Signal Processing (SSP) Can Help Assessment of Bonding Phenomena in Developmental Psychology?

  • Chapter

  • 1436 Accesses

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 19))

Abstract

In the field of biology, the study of bonding has been renewed by the discovery of non genetic transmission of behavioural traits through early mother-infant interaction and the role of stress hormones and ocytocin. However, the study of early interaction is complex and Social Signal Processing (SSP) can help in addressing some issues. Based on works from our group, we will show data from diverse sources (e.g. experiments, home movies) showing how SSP was used to address synchrony between partners (e.g. infant, child, care giver, agent) and characteristics that participates to interpersonal exchanges (e.g. motherese, emotional prosody or faces).

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Altmann, U.: Studying movement synchrony using time series and regression models. In: Esposito, I.A., Hoffmann, R., Hübler, S., Wrann, B. (eds.) Program and Abstracts of the COST 2102 Final Conference Held in Conjunction with the 4th COST 2102 International Training School on Cognitive Behavioural Systems, p. 23 (2011)

    Google Scholar 

  2. Ashenfelter, K.T., Boker, S.M., Waddell, J.R., Vitanov, N.: Spatiotemporal symmetry and multifractal structure of head movements during dyadic conversation. J. Exp. Psychol. Hum. Percept. Perform. 35(4), 1072–1091 (2009)

    Article  Google Scholar 

  3. Bernieri, F.J., Reznick, J.S., Rosenthal, R.: Synchrony, pseudo synchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions. Journal of Personality and Social Psychology 54(2), 243–253 (1988)

    Article  Google Scholar 

  4. Boucenna, S., Gaussier, P., Andry, P.: What should be taught first: the emotional expression or the face? In: epirob (2008)

    Google Scholar 

  5. Boucenna, S., Gaussier, P., Hafemeister, L., Bard, K.: Towards a new social referencing paradigm. In: epirob 2009, pp. 201–202 (2009)

    Google Scholar 

  6. Cappella, J.N.: Behavioral and judged coordination in adult informal social interactions: vocal and kinesic indicators. Pers. Soc. Psychol. 72, 119–131 (1997)

    Article  Google Scholar 

  7. Cassel, R.S., Saint-Georges, C., Mahdhaoui, A., Chetouani, M., Laznik, M.-C., Muratori, F., Adrien, J.-L., Cohen, D.: Course of maternal prosodic incitation (motherese) during early development in autism: an exploratory home movie study. Interaction Studies (in Press)

    Google Scholar 

  8. Champagne, F., Diorio, J., Sharma, S., Meaney, M.J.: Naturally occurring variations in maternal behavior in the rat are associated with differences in estrogen-inducible central oxytocin receptors. Proceedings of the National Academy of Sciences of the United States of America 98, 12736–12741 (2001)

    Article  Google Scholar 

  9. Delaherche, E., Chetouani, M.: Multimodal coordination: exploring relevant features and measures. In: Second International Workshop on Social Signal Processing. ACM Multimedia (2010)

    Google Scholar 

  10. Delaherche, E., Chetouani, M., Bigouret, F., Xavier, J., Plaza, M., Cohen, D.: Assessment of communicative and coordination skills of children with pervasive developmental disorders and typically developing children (submitted, 2012)

    Google Scholar 

  11. Delaherche, E., Chetouani, M., Mahdhaoui, M., Saint-Georges, C., Viaux, S., Cohen, D.: Interpersonal synchrony: A survey of evaluation methods across disciplines. IEEE Transactions on Affective Computing (to appear, 2012)

    Google Scholar 

  12. Denenberg, V.H., Whimby, A.E.: Behavior of adult rats is modified by the experiences their mothers had as infants. Science 142, 1192–1193 (1963)

    Article  Google Scholar 

  13. Falk, D.: Prelinguistic evolution in early hominins: whence motherese? Behavioral and Brain Sciences 27(4), 491–503 (2004)

    MathSciNet  Google Scholar 

  14. Feldman, R.: Infant-mother and infant-father synchrony: the coregulation of positive arousal. Infant Mental Health Journal 24(1), 1–23 (2003)

    Article  Google Scholar 

  15. Feldman, R.: Parent-infant synchrony and the construction of shared timing; physiological precursors, developmental outcomes, and risk conditions. The Journal of Child Psychology and Psychiatry and Allied Disciplines 48(3-4), 329–354 (2007)

    Article  Google Scholar 

  16. Francis, D., Diorio, J., Liu, D., Meaney, M.J.: Nongenomic transmission across generations of maternal behavior and stress responses in the rat. Science 286, 1155–1158 (1999)

    Article  Google Scholar 

  17. Gaussier, P.: Toward a cognitive system algebra: A perception/action perspective. In: European Workshop on Learning Robots (EWRL), pp. 88–100 (2001)

    Google Scholar 

  18. Goldstein, M.H., King, A.P., West, M.J.: Social interaction shapes babbling: Testing parallels between birdsong and speech. Proceedings of the National Academy of Sciences of the United States of America 100(13), 8030–8035 (2003)

    Article  Google Scholar 

  19. Harrist, A.W., Waugh, R.M.: Dyadic synchrony: Its structure and function in children‘s development. Developmental Review 22(4), 555–592 (2002)

    Article  Google Scholar 

  20. Cappella, J.: Coding Mutual Adaptation in Dyadic Nonverbal Interaction, pp. 383–392. Lawrence Erlbaum (2005)

    Google Scholar 

  21. Kozima, H., Michalowski, M., Nakagawa, C.: Keepon. International Journal of Social Robotics 1, 3–18 (2009)

    Article  Google Scholar 

  22. Kuhl, P.K.: Early language acquisition: cracking the speech code. Nat. Rev. Neurosci. 5(11), 831–843 (2004)

    Article  Google Scholar 

  23. Liu, D., Diorio, J., Tannenbaum, B., Caldji, C., Francis, D., Freedman, A., Sharma, S., Pearson, D., Plotsky, P.M., Meaney, M.J.: Maternal care, hippocampal glucocorticoid receptors, and hypothalamic-pituitary-adrenal responses to stress. Science 277, 1659–1662 (1997)

    Article  Google Scholar 

  24. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 2, 91–110 (2004)

    Article  Google Scholar 

  25. Mahdhaoui, A., Chetouani, M., Cassel, R.S., Saint-Georges, C., Parlato, E., Laznik, M.C., Apicella, F., Muratori, F., Maestro, S., Cohen, D.: Computerized home video detection for motherese may help to study impaired interaction between infants who become autistic and their parents. International Journal of Methods in Psychiatric Research (2011)

    Google Scholar 

  26. Marcelli, D., Cohen, D.: Enfance et psychopathologie. Masson (2012)

    Google Scholar 

  27. Mataruna, H.R., Varela, F.J.: Autopoiesis and Cognition: the realization of the living. Reidel, Dordrecht (1980)

    Book  Google Scholar 

  28. Meltzoff, A.N., Kuhl, P.K., Movellan, J., Sejnowski, T.J.: Foundations for a new science of learning. Science 325(5938), 284–288 (2009)

    Article  Google Scholar 

  29. Messinger, D.M., Ruvolo, P., Ekas, N.V., Fogel, A.: Applying machine learning to infant interaction: The development is in the details. Neural Networks 23(8-9), 1004 (2010); Social Cognition: From Babies to Robots

    Google Scholar 

  30. Morency, L.-P., de Kok, I., Gratch, J.: Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 176–190. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  31. Oullier, O., de Guzman, G.C., Jantzen, K.J., Scott Kelso, J.A., Lagarde, J.: Social coordination dynamics: Measuring human bonding. Social Neuroscience 3(2), 178–192 (2008)

    Article  Google Scholar 

  32. Ozkan, D., Sagae, K., Morency, L.-P.: Latent mixture of discriminative experts for multimodal prediction modeling. Computational Linguistics, 860–868 (August 2010)

    Google Scholar 

  33. Prepin, K., Pelachaud, C.: Shared understanding and synchrony emergence: Synchrony as an indice of the exchange of meaning between dialog partners. In: ICAART 2011 International Conference on Agent and Artificial Intelligence, vol. 2, pp. 25–30 (January 2011)

    Google Scholar 

  34. Ramseyer, F., Tschacher, W.: Nonverbal synchrony in psychotherapy: Coordinated body movement reflects relationship quality and outcome. Journal of Consulting and Clinical Psychology 79(3), 284–295 (2011)

    Article  Google Scholar 

  35. Richardson, D., Dale, R., Shockley, K.: Synchrony and swing in conversation: Coordination, temporal dynamics, and communication. Oxford University Press (2008)

    Google Scholar 

  36. Richardson, D.C., Dale, R.: Looking to understand: The coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cognitive Science 29(6), 1045–1060 (2005)

    Article  Google Scholar 

  37. Richardson, M.J., Marsh, K.L., Isenhower, R.W., Goodman, J.R.L., Schmidt, R.C.: Rocking together: Dynamics of intentional and unintentional interpersonal coordination. Human Movement Science 26(6), 867–891 (2007)

    Article  Google Scholar 

  38. Saint-Georges, C., Mahdhaoui, A., Chetouani, M., Cassel, R.S., Laznik, M.-C., Apicella, F., Muratori, P., Maestro, S., Muratori, F., Cohen, D.: Do parents recognize autistic deviant behavior long before diagnosis? Taking into account interaction using computational methods. PLoS ONE 6(7), e22393 (2011)

    Google Scholar 

  39. Shockley, K., Santana, M.-V., Fowler, C.A.: Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance (29) (2003)

    Google Scholar 

  40. Sun, X., Truong, K., Nijholt, A., Pantic, M.: Automatic visual mimicry expression analysis in interpersonal interaction. In: Proceedings of IEEE Int’l Conf. Computer Vision and Pattern Recognition (CVPR-W 2011), Workshop on CVPR for Human Behaviour Analysis, Colorado Springs, USA, pp. 40–46 (2011)

    Google Scholar 

  41. Thorisson, K.R.: Natural Turn-Taking Needs No Manual: Computational Theory And Model, From Perception to Action, pp. 173–207. Kluwer Acedemic Publishers, Dordrecht (2002)

    Google Scholar 

  42. Varni, G., Volpe, G., Camurri, A.: A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media. IEEE Transactions on Multimedia 12(6), 576–590 (2010)

    Article  Google Scholar 

  43. Ward, N.G., Fuentes, O., Vega, A.: Dialog prediction for a general model of turn-taking. In: INTERSPEECH, pp. 2662–2665 (2010)

    Google Scholar 

  44. Weaver, I.C., Cervoni, N., Champagne, F.A., D’Alessio, A.C., Sharma, S., Seckl, J.R., Dymov, S., Szyf, M., Meaney, M.J.: Epigenetic programming by maternal behavior. Nat. Neuroscience 7, 847–854 (2004)

    Article  Google Scholar 

  45. Widrow, B., Hoff, M.E.: Adaptive switching circuits. In: IRE WESCON, New York, pp. 96–104 (1960); Convention Record

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institut des Systèmes Intelligents et de Robotique, CNRS UMR 7222, Université Pierre et Marie Curie, Paris, France

    Emilie Delaherche, Sofiane Boucenna, Mohamed Chetouani & David Cohen

  2. Department of Child and Adolescent Psychiatry, AP-HP, Groupe Hospitalier Pitie-Salpetriere, Université Pierre et Marie Curie, Paris, France

    David Cohen

Authors
  1. Emilie Delaherche
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sofiane Boucenna
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohamed Chetouani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David Cohen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emilie Delaherche .

Editor information

Editors and Affiliations

  1. , Dept of Computer Science, Milano University, Via Comelico 39, Milano, 20135, Italy

    Bruno Apolloni

  2. Dept of Computer Science, Milano University, Via Comelico 39, Milano, 20135, Italy

    Simone Bassis

  3. Dept. of Psychology, Second University of Naples, Via Vivaldi 43, Caserta, 81100, Salerno, Italy

    Anna Esposito

  4. , Dipartimento di Meccanica e Materiali, University Mediterranea of Reggio, Via Graziella - Feo di Vito, Reggio Calabria, 89124, Reggio Calabria, Italy

    Francesco Carlo Morabito

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Delaherche, E., Boucenna, S., Chetouani, M., Cohen, D. (2013). How Social Signal Processing (SSP) Can Help Assessment of Bonding Phenomena in Developmental Psychology?. In: Apolloni, B., Bassis, S., Esposito, A., Morabito, F. (eds) Neural Nets and Surroundings. Smart Innovation, Systems and Technologies, vol 19. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35467-0_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35467-0_34

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35466-3

  • Online ISBN: 978-3-642-35467-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation