Skip to main content

Human-Avatar Symbiosis in Cognitive Cybertherapies: Proof of Concept for Auditory Verbal Hallucinations

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10586))

Abstract

Schizophrenia, a health and social problem of enormous importance and cost, is a serious mental disorder that has defied researchers for many years. Virtual and augmented reality (VR/AR) is proving to be a powerful experimental tool to study such complex cognitive processes. But there are no VR/AR tools for the systematic treatment of schizophrenia. Avatars do not incorporate adaptation, learning and evolution able to produce natural communication and interaction with humans. To significantly advance the state of art, it is proposed to supplement VR/AR with brain-computer interfaces (BCI) based on obtaining electrical brain signals. The project “Human-avatar symbiosis in cognitive cybertherapies: Proof of concept for auditory verbal hallucinations” assesses whether, through the complementary use of VR/AR and BCI, it is possible to achieve human-machine symbiosis (between a patient who hears voices and “his/her” avatar), which would provide an unforeseen advance. It relies on automatic adaptation, learning and evolution over BDI (beliefs-desires-intentions) models, proper of the intelligent agency paradigm inspired in social behaviour. The proof of concept will show if the proposal is an alternative/complement to conventional therapies of auditory verbal hallucinations and can guide the patient from a negative socio-emotional behaviour toward successful social situations.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Freud, S.: Psychoanalytische Bemerkungen über einen Autobiographisch Beschriebenen Fall von Paranoia (Dementia paranoides). Gesammelte Werke 8, 240–320 (1911)

    Google Scholar 

  2. Byerly, M.J., Nakonezny, P.A., Lescouflair, E.: Antipsychotic medication adherence in schizophrenia. Psychiatr. Clin. North Am. 30, 437–452 (2007)

    Article  Google Scholar 

  3. Elkis, H.: Treatment-resistant schizophrenia. Psychiatr. Clin. North Am. 30, 511–533 (2007)

    Article  Google Scholar 

  4. Leucht, S., Arbter, D., Engel, R.R., Kissling, W., Davis, J.M.: How effective are second- generation antipsychotic drugs? A meta-analysis of placebo-controlled trials. Mol. Psychiatr. 14, 429–447 (2009)

    Article  Google Scholar 

  5. Harrow, M., Jobe, T.H., Faull, R.N.: Does treatment of schizophrenia with antipsychotic medications eliminate or reduce psychosis? A 20-year multi-follow-up study. Psychol. Med. 44, 3007–3016 (2014)

    Article  Google Scholar 

  6. Ricarte, J.J., Hernández-Viadel, J.V., Ros, L.: Tratamiento de los trastornos psicóticos. Nuevas Terapias Cognitivas y Aportaciones de la Experiencia Autobiográfica. Editorial Psicología Pirámide, Madrid (2014)

    Google Scholar 

  7. Hooker, C.I., Benson, T.L., Gyurak, A., Tully, L.: Neural activity to positive expressions predicts daily experience of schizophrenia-spectrum symptoms in adults with high social anhedonia. J. Abnorm. Psychol. 123, 190–204 (2014)

    Article  Google Scholar 

  8. Krabbendam, L., Hooker, C.L., Aleman, A.: Neural effects of the social environment. Schizophr. Bull. 40, 248–251 (2014)

    Article  Google Scholar 

  9. Schultheis, M.T., Rizzo, A.A.: The application of virtual reality technology in rehabilitation. Rehabil. Psychol. 46, 296 (2001)

    Article  Google Scholar 

  10. Segal, R., Bhatia, M., Drapeau, M.: Therapists’ perception of benefits and costs of using virtual reality treatments. Cyberpsychol. Behav. SoC. Netw. 14, 29–34 (2011)

    Article  Google Scholar 

  11. Rodríguez, A., Rey, B., Clemente, M., Wrzesien, M., Alcañiz, M.: Assessing brain activations associated with emotional regulation during virtual reality mood induction procedures. Expert Sys. Appl. 42, 1699–1709 (2015)

    Article  Google Scholar 

  12. Martinez, J., Garcia, A.S., Oliver, M., Molina, J.P., González, P.: Identifying 3D geometric shapes with a vibrotactile glove. IEEE Comput. Graph. Appl. 99 (2014). doi:10.1109/MCG.2014.81

  13. Martínez, J., García, A.S., Oliver, M., Molina, J.P., González, P.: VITAKI: a vibrotactile prototyping toolkit for virtual reality and video games. Int. J. Hum. Comput. Interact. 30, 855–871 (2014)

    Article  Google Scholar 

  14. Hobbs, C.N., Kreiner, D.N., Honeycutt, M.W., Hinds, R.M., Brockman, C.J.: The illusion of control in a virtual reality setting. North Am. J. Psychol. 123, 551–564 (2010)

    Google Scholar 

  15. Botella, C.M., Juan, M.X., Baños, R.M., Alcañiz, M., Guillén, V., Rey, B.: Mixing realities? An application of augmented reality for the treatment of cockroach phobia. Cyberpsychol. Behav. 8, 216–217 (2005)

    Article  Google Scholar 

  16. Eichenberg, C.: Application of “virtual realities” in psychotherapy: possibilities, limitations and effectiveness. In: Virtual Reality, Chap. 22. InTech (2011)

    Google Scholar 

  17. Licklider, J.C.R.: Man-computer symbiosis. IRE Trans. Hum. Fact. Electron. 1, 4–11 (1960)

    Article  Google Scholar 

  18. Gascueña, J.M., Navarro, E., Fernández-Caballero, A.: Model-driven engineering techniques for the development of multi-agent systems. Eng. Appl. Artif. Intell. 25, 159–173 (2012)

    Article  Google Scholar 

  19. Pavón, J., Gómez-Sanz, J., Fernández-Caballero, A., Valencia-Jiménez, J.J.: Development of intelligent multisensor surveillance systems with agents. Robot. Auton. Syst. 55, 892–903 (2007)

    Article  Google Scholar 

  20. Ruse, S.A., Harvey, P.D., Davis, V.G., Atkins, A.S., Fox, K.H., Keefe, R.S.E.: Virtual reality functional capacity assessment in schizophrenia: preliminary data regarding feasibility and correlations with cognitive and functional capacity performance. Schizophr. Res. Cogn. 1, e21–e26 (2014)

    Article  Google Scholar 

  21. Han, K.: Assessment of cognitive flexibility in real life using virtual reality: a comparison of healthy individuals and schizophrenia patients. Comput. Biol. Med. 42, 841–847 (2012)

    Article  Google Scholar 

  22. Park, K., Ku, J., Choi, S., Jang, G., Park, J.: A virtual reality application in role-plays of social skills training for schizophrenia: a randomized, controlled trial. Psychiatr. Res. 189, 166–172 (2011)

    Article  Google Scholar 

  23. Peyroux, E., Franck, N.: RC2S: a cognitive remediation program to improve social cognition in schizophrenia and related disorders. Front. Hum. Neurosci. 8, 400 (2014)

    Article  Google Scholar 

  24. Tsang, M.M., Man, D.W.: A virtual reality-based vocational training system (VRVTS) for people with schizophrenia in vocational rehabilitation. Schizophr. Res. 144, 51–62 (2013)

    Article  Google Scholar 

  25. Moritz, S., Voigt, M., Köther, U., Leighton, L., Kjahili, B., Babur, Z., Jungclaussen, D., Veckenstedt, R., Grzella, K.: Can virtual reality reduce reality distortion? Impact of performance feedback on symptom change in schizophrenia patients. J. Behav. Ther. Exp. Psychiatr. 45, 267–271 (2014)

    Article  Google Scholar 

  26. Stinson, K., Valmaggia, L.R., Antley, A., Slater, M., Freeman, D.: Cognitive triggers of auditory hallucinations: an experimental investigation. J. Behav. Ther. Exp. Psychiatr. 41, 179–184 (2010)

    Article  Google Scholar 

  27. Zhao, Q., Hu, B., Liu, L., Ratcliffe, M., Peng, H., Zhai, J., Li, L., Shi, Q., Liu, Q., Qi, Y.: An EEG based nonlinearity analysis method for schizophrenia diagnosis. In: 9th IASTED International Conference on Biomedical Engineering, pp. 136–142 (2012)

    Google Scholar 

  28. Ruiz, S., Birbaumer, N., Sitaram, R.: Abnormal neural connectivity in schizophrenia and fMRI-brain-computer interface as a potential therapeutic approach. Front. Psychiatr. 4, 17 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by Spanish Ministerio de Economía, Industria y Competitividad, Agencia Estatal de Investigación (AEI)/European Regional Development Fund under HA-SYMBIOSIS (TIN2015-72931-EXP) grant.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Antonio Fernández-Caballero .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Fernández-Caballero, A. et al. (2017). Human-Avatar Symbiosis in Cognitive Cybertherapies: Proof of Concept for Auditory Verbal Hallucinations. In: Ochoa, S., Singh, P., Bravo, J. (eds) Ubiquitous Computing and Ambient Intelligence. UCAmI 2017. Lecture Notes in Computer Science(), vol 10586. Springer, Cham. https://doi.org/10.1007/978-3-319-67585-5_72

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67585-5_72

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67584-8

  • Online ISBN: 978-3-319-67585-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics