Skip to main content
SpringerLink
Log in

Study of Coordination Between Patients with Schizophrenia and Socially Assistive Robot During Physical Activity

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

The goal of this study was to analyze the interpersonal coordination of patients suffering from schizophrenia (SZ) using a humanoid robot NAO. NAO was controlled by a neurally-inspired model that enables motions synchronization between robot and human. Using a robot has the advantage in that it can be modified and controlled without being influenced by the human with whom they are interacting. More specifically, we were interested in non-intentional interpersonal coordination which has been found in previous studies to be preserved for SZ. We performed an experiment in which we asked patients and control participants to jointly perform fitness movements with the robot which was programmed to either synchronize with the human (a bidirectional condition) or move at a fixed frequency with them (a unidirectional condition). We showed that non-intentional interpersonal coordination was preserved for SZ during Human/Robot interaction (as for human/human interaction). Also, the best synchronization, stability and the best performance in term of speed were obtained with the bidirectional condition. Our results showed that, in this specific context of an interaction at preferential frequency of subject, there were only a few differences between SZ and controls in terms of interpersonal synchronization skills. Nevertheless, we observed more variability for SZ which could partly be explained by the weaker intrapersonal coordination that they exhibited.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data Availability Statement

Not available.

Code availability

Statistical analyses were performed with Jamovi software (The jamovi project (2020), jamovi (Version 1.1.9) for Windows).

References

  1. Alahbabi M, Almazroei F, Almarzoqi M, Almeheri A, Alkabi M, Nuaimi AA, Cappuccio M, Alnajjar F (2017) Avatar based interaction therapy: a potential therapeutic approach for children with autism. In: 2017 IEEE international conference on mechatronics and automation (ICMA), pp 480–484. https://doi.org/10.1109/ICMA.2017.8015864

  2. Amazeen P, Schmidt R, Turvey MT (1995) Frequency detuning of the phase entrainment dynamics of visually coupled rhythmic movements. Biol Cybern. https://doi.org/10.1007/BF00199893

    Article  Google Scholar 

  3. Anzalone S, Tanet A, Pallanca O, Cohen D, Chetouani M (2016) A humanoid robot controlled by neurofeedback to reinforce attention in autism spectrum disorder. In: Proceedings of the 3rd Italian workshop on artificial intelligence and robotics. https://hal.sorbonne-universite.fr/hal-02422951

  4. Argyle M, Salter V, Nicholson H, Williams M, Burgess P (1970) The communication of inferior and superior attitudes by verbal and non-verbal signals. Br J Soc Clin Psychol. https://doi.org/10.1111/j.2044-8260.1970.tb00668.x

    Article  Google Scholar 

  5. Barakova EI, Bajracharya P, Willemsen M, Lourens T, Huskens B (2014) Long-term lego therapy with humanoid robot for children with asd. Expert Syst. https://doi.org/10.1111/exsy.12098

    Article  Google Scholar 

  6. Chartrand LT, Bargh JA (1999) The chameleon effect: the perception-behavior link and social interaction. J Pers Soc Psychol. https://doi.org/10.1037//0022-3514.76.6.893

    Article  Google Scholar 

  7. Ciolacu MV (2014) Facial expressions and non verbal communication. Procedia Soc Behav Sci. https://doi.org/10.1016/j.sbspro.2014.03.372

    Article  Google Scholar 

  8. Cohen L, Khoramshahi M, Salesse RN, Bortolon C, Słowiński P, Krasimira Tsaneva-Atanasova CZ, Bernardo MD, Ludovic Marin DC, Schmidt RC, Bardy BG, Billard A, Raffard S (2017) Influence of facial feedback during a cooperative human-robot task in schizophrenia. Sci Rep. https://doi.org/10.1038/s41598-017-14773-3

    Article  Google Scholar 

  9. Davalos DB, Kisley MA, Ross RG (2003) Effects of interval duration on temporal processing in schizophrenia. Brain Cogn. https://doi.org/10.1016/s0278-2626(03)00157-x

    Article  Google Scholar 

  10. Degnan A, Berry K, Sweet D, Abel K, Crossley N, Edge D (2018) Social networks and symptomatic and functional outcomes in schizophrenia: a systematic review and meta-analysis. Soc Psychiatry Psychiatr Epidemiol. https://doi.org/10.1007/s00127-018-1552-8

    Article  Google Scholar 

  11. Del-Monte J, Capdevielle D, Varlet M, Marin L, Schmidt R, Salesse R, Bardy B, Boulenger JP, Gély-Nargeot MC, Attal J, Raffard S (2013) Social motor coordination in unaffected relatives of schizophrenia patients: a potential intermediate phenotype. Front Behav Neurosci. https://doi.org/10.3389/fnbeh.2013.00137

    Article  Google Scholar 

  12. Del-Monte J, Raffard S, Salesse RN, Marin L, Schmidt RC, Varlet M, Bardy BG, Boulenger JP, Gély-Nargeot MC, Capdevielle D (2013) Nonverbal expressive behaviour in schizophrenia and social phobia. Psychiatry Res. https://doi.org/10.1016/j.psychres.2013.05.034

    Article  Google Scholar 

  13. de Rugy A, Salesse R, Oullier O, Temprado JJ (2006) A neuro-mechanical model for interpersonal coordination. Biol Cybern. https://doi.org/10.1007/s00422-006-0059-7

    Article  MathSciNet  MATH  Google Scholar 

  14. Dodell-Feder D, Tully LM, Hooker CI (2015) Social impairment in schizophrenia: new approaches for treating a persistent problem. Curr Opin Psychiatry. https://doi.org/10.1097/YCO.0000000000000154

    Article  Google Scholar 

  15. Elvevag B, McCormack T, Gilbert A, Brown GDA, Weinberger DR, Goldberg TE (2003) Duration judgements in patients with schizophrenia. Psychol Med. https://doi.org/10.1017/s0033291703008122

    Article  Google Scholar 

  16. Freitas H, Costa P, Silva V, da Silva Pereira AP, Soares F, Esteves JS (2017) Using a humanoid robot as the promoter of the interaction with children in the context of educational games. Int J Mechatron Appl Mech

  17. Green MF, Horan WP, Lee J (2015) Social cognition in schizophrenia. Nat Rev Neurosci. https://doi.org/10.1038/nrn4005

    Article  Google Scholar 

  18. Green MF, Kern RS, Braff DL, Mintz J (2000) Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the “right stuff”? Schizophr Bull. https://doi.org/10.1093/oxfordjournals.schbul.a033430

    Article  Google Scholar 

  19. Feasibility of collaborative learning and work between robots and children with autism spectrum disorders. Lecture Notes in Computer Science, vol 10091. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-50953-2_32

  20. Hasnain SK, Mostafaoui G, Gaussier P (2012) A synchrony-based perspective for partner selection and attentional mechanism in human–robot interaction. Paladyn J Behav Robot. https://doi.org/10.2478/s13230-013-0111-y

    Article  Google Scholar 

  21. Hasnain SK, Mostafaoui G, Salesse R, Marin L, Gaussier P (2013) Intuitive human robot interaction based on unintentional synchrony: a psycho-experimental study. https://doi.org/10.1109/DevLrn.2013.6652569

  22. Henkel V, Mergl R, Schäfer M, Rujescu D, Möller H, Hegerl U (2004) Kinematical analysis of motor function in schizophrenic patients: a possibility to separate negative symptoms from extrapyramidal dysfunction induced by neuroleptics? Pharmacopsychiatry. https://doi.org/10.1055/s-2004-818988

    Article  Google Scholar 

  23. Horn KPB, Schunck GB (1981) Determining optical flow. Artif Intell 17(1):185–203

    Article  Google Scholar 

  24. Issartel J, Marin L, Cadopi M (2007) Unintended interpersonal co-ordination: “can we march to the beat of our own drum?”. Neurosci Lett. https://doi.org/10.1016/j.neulet.2006.09.086

    Article  Google Scholar 

  25. Lavelle M, Healey P, McCabe R (2013) Is nonverbal communication disrupted in interactions involving patients with schizophrenia? Schizophr Bull. https://doi.org/10.1093/schbul/sbs091

    Article  Google Scholar 

  26. Lavelle M, Healey PG, McCabe R (2014) Nonverbal behavior during face-to-face social interaction in schizophrenia: a review. J Nerv Ment Dis. https://doi.org/10.1097/NMD.0000000000000031

    Article  Google Scholar 

  27. Levit-Binnun N, Handzy NZ, Moses E, Modai I, Peled A (2007) Transcranial magnetic stimulation at m1 disrupts cognitive networks in schizophrenia. Schizophr Res. https://doi.org/10.1016/j.schres.2007.02.019

    Article  Google Scholar 

  28. Maxwell SE, Delaney HD (1990) Designing experiments and analyzing data: a model comparison perspective. Routledge, New York. https://doi.org/10.2307/2532173

    Book  MATH  Google Scholar 

  29. Usefulness of animal type robot assisted therapy for autism spectrum disorder in the child and adolescent psychiatric ward. Lecture Notes in Computer Science, vol 10091. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-50953-2_35

  30. Mittal VA, Neumann C, Saczawa M, Walker EF (2008) Longitudinal progression of movement abnormalities in relation to psychotic symptoms in adolescents at high risk of schizophrenia. Arch Gen Psychiatry. https://doi.org/10.1001/archgenpsychiatry.2007.23

    Article  Google Scholar 

  31. Morrison RL, Bellack AS (1987) Social functioning of schizophrenic patients: clinical and research issues. Schizophr Bull. https://doi.org/10.1093/schbul/13.4.715

    Article  Google Scholar 

  32. Rae I, Takayama L, Mutlu B (2013) In-body experiences: embodiment, control, and trust in robot-mediated communication. In: Proceedings of the 2013 ACM annual conference on human factors in computing systems. https://doi.org/10.1145/2470654.2466253

  33. Raffard S, Salesse R, Catherine Bortolo BGB, Henriques J, Marin L, Stricker D, Capdevielle D (2018) Using mimicry of body movements by a virtual agent to increase synchronization behavior and rapport in individuals with schizophrenia. Sci Rep. https://doi.org/10.1038/s41598-018-35813-6

    Article  Google Scholar 

  34. Revel A, Andry P (2009) Emergence of structured interactions: from theoretical model to pragmatic robotics. Neural Netw. https://doi.org/10.1016/j.neunet.2009.01.005

    Article  Google Scholar 

  35. Robot-assisted training of joint attention skills in children diagnosed with autism. Lecture Notes in Computer Science, vol 9388. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25554-5_30

  36. Schmidt R, O’Brien B (1997) Evaluating the dynamics of unintended interpersonal coordination. Ecol Psychol. https://doi.org/10.1207/s15326969eco0903_2

    Article  Google Scholar 

  37. Schmidt RC, Richardson MJ (2008) Dynamics of interpersonal coordination. Chap. Understanding complex systems. Springer. https://doi.org/10.1007/978-3-540-74479-5_14

  38. Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zaharid NI (2012) Humanoid robot nao interacting with autistic children of moderately impaired intelligence to augment communication skills. Procedia Engineering 41:1533–1538. https://doi.org/10.1016/j.proeng.2012.07.346

    Article  Google Scholar 

  39. Silva S, Soares F, Costa S, Pereira AP, Moreira F (2012) Development of skills in children with asd using a robotic platform. In: 2012 IEEE 2nd Portuguese meeting in bioengineering (ENBENG), pp. 1–4. https://doi.org/10.1109/ENBENG.2012.6331347

  40. So W, Wong M, Cabibihan J, Lam C, Chan R, Qian H (2016) Using robot animation to promote gestural skills in children with autism spectrum disorders. J Comput Assist Learn. https://doi.org/10.1111/jcal.12159

    Article  Google Scholar 

  41. Tennyson M, Kuester DA, Casteel J, Nikolopoulos C (2016) Accessible robots for improving social skills of individuals with autism. J Artif Intell Soft Comput Res. https://doi.org/10.1515/jaiscr-2016-0020

    Article  Google Scholar 

  42. Tiruneh G (2009) The relationship between physical activity and body mass index: issues in model specification. Nat Precedings. https://doi.org/10.1038/npre.2009.2758.4

    Article  Google Scholar 

  43. Turrell YND, Thomas P, Giersch A (2006) Attention for movement production: abnormal profiles in schizophrenia. Schizophr Res. https://doi.org/10.1016/j.schres.2006.02.013

    Article  Google Scholar 

  44. Varlet M, Stephane Raffard LM, Schmidt R, Capdevielle D, Boulenger J, Del-Monte J, Bardy B (2012) Impairments of social motor coordination in schizophrenia. PLoS ONE. https://doi.org/10.1371/journal.pone.0029772

    Article  Google Scholar 

  45. Vicaria I, Dickens L (2016) Meta-analyses of the intra- and interpersonal outcomes of interpersonal coordination. J Nonverbal Behav. https://doi.org/10.1007/s10919-016-0238-8

    Article  Google Scholar 

  46. Zheng Z, Young EM, Swanson AR, Weitlauf AS, Warren ZE, Sarkar N (2016) Robot-mediated imitation skill training for children with autism. IEEE Trans Neural Syst Rehabil Eng. https://doi.org/10.1109/TNSRE.2015.2475724

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by local grant (Clinical research funding from CHU Montpellier), CNRS RHIAPS Project and DGA (Direction Générale des Armées)

Funding

This work was funding by local grant (Clinical research funding from CHU Montpellier), CNRS RHIAPS Project and DGA (Direction Générale des Armées).

Author information

Authors and Affiliations

  1. EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Montpellier, France

    Lise Aubin, Chloé Amiel & Ludovic Marin

  2. ETIS UMR8051, CY University, ENSEA, CNRS, 95000, Cergy, France

    Ghilès Mostafaoui

  3. GIPSA-lab, Université Grenoble Alpes, 38185, Grenoble, France

    Hélène Serré

  4. INSERM U-1061, 34090, Montpellier, France

    Delphine Capdevielle

  5. Service Universitaire de Psychiatrie Adulte, CHU Montpellier, 34090, Montpellier, France

    Maëlane Hellouin de Menibus

  6. Laboratoire Epsylon Universite Paul Valery Montpellier, 34090, Montpellier, France

    Julie Boiché

  7. College of the Holy Cross, Worcester, MA, 01610, USA

    Richard Schmidt

  8. Laboratoire Epsylon Université Paul Valery Montpellier & Service Universitaire de Psychiatrie Adulte, CHU Montpellier, Montpellier, 34090, France

    Stéphane Raffard

Authors
  1. Lise Aubin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ghilès Mostafaoui
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chloé Amiel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hélène Serré
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Delphine Capdevielle
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Maëlane Hellouin de Menibus
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Julie Boiché
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Richard Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Stéphane Raffard
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Ludovic Marin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lise Aubin.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aubin, L., Mostafaoui, G., Amiel, C. et al. Study of Coordination Between Patients with Schizophrenia and Socially Assistive Robot During Physical Activity. Int J of Soc Robotics 13, 1625–1640 (2021). https://doi.org/10.1007/s12369-021-00750-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-021-00750-4

Keywords

Search

Navigation