Jean Zagdoun
ABSTRACT
Virtual-Patients (VP) are currently developed to train healthcare professionals in several domains. In this paper, we specifically explore non-verbal behaviors of healthcare professionals engaged in an interaction with a VP that displays a neurodegenerative disease. The main motivation is to contribute to the training of healthcare professionals with a focus on non-verbal behaviors, which are known to play an important role in patient- caregivers interaction. Our paper presents the VirtuAlZ corpus which is a video corpus of 29 professional caregivers interacting with a VP. Based on the literature and exploratory studies, we developed an architecture able to perceive a list of non-verbal signals, which are then transformed in discrete symbols. An N-gram based approach is then exploited to model, analyze and compare healthcare professional strategies. In particular, we report analysis on the work experience context and we cluster the participants in order to understand the different patterns of behavior present in our corpus.
- Fotis Aisopos, George Papadakis, and Theodora Varvarigou. 2011. Sentiment Analysis of Social Media Content Using N-Gram Graphs. In Proceedings of the 3rd ACM SIGMM International Workshop on Social Media (Scottsdale, Arizona, USA) (WSM ’11). Association for Computing Machinery, New York, NY, USA, 9–14. https://doi.org/10.1145/2072609.2072614Google Scholar
Digital Library
- T. Baltrusaitis, A. Zadeh, Y. C. Lim, and L. Morency. 2018. OpenFace 2.0: Facial Behavior Analysis Toolkit. (2018), 59–66. https://doi.org/10.1109/FG.2018.00019Google Scholar
- Amine Benamara, Brian Ravenet, Elise Prigent, Laurence Chaby, and Jean-Claude Martin. 2020. Patient virtuel Alzheimer: vers une modélisation informatique des pathologies émotionnelles et expressives. In Workshop sur les Affects, Compagnons artificiels et Interactions.Google Scholar
- Beatrice Biancardi. 2019. Les premières secondes comptent; Gérer les premières impressions pour un agent virtuel plus engageant. Ph.D. Dissertation. Sorbonne-Université, UPMC.Google Scholar
- C. M. Bishop and N. Nasrabadi. 2007. Pattern Recognition and Machine Learning. J. Electronic Imaging 16(2007), 049901.Google ScholarCross Ref
- Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. In arXiv preprint arXiv:1812.08008.Google Scholar
- Laurence Chaby and Pauline Narme. 2009. Processing facial identity and emotional expression in normal aging and neurodegenerative diseases. Psychologie & NeuroPsychiatrie du vieillissement 7, 1(2009), 31–42.Google Scholar
- K. Cheng, Y. Chen, and W. Fang. 2015. Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2909–2917. https://doi.org/10.1109/CVPR.2015.7298909Google ScholarCross Ref
- Lauren Collins, Anne Schrimmer, James Diamond, and Janice Burke. 2011. Evaluating verbal and non-verbal communication skills, in an ethnogeriatric OSCE. Patient education and counseling 83 (05 2011), 158–62. https://doi.org/10.1016/j.pec.2010.05.012Google Scholar
- Y. Cong, J. Yuan, and J. Liu. 2011. Sparse reconstruction cost for abnormal event detection. In CVPR 2011. 3449–3456. https://doi.org/10.1109/CVPR.2011.5995434Google ScholarDigital Library
- Marc Damashek. 1995. Gauging Similarity with n-Grams: Language-Independent Categorization of Text. Science 267, 5199 (1995), 843–848. https://doi.org/10.1126/science.267.5199.843 arXiv:https://science.sciencemag.org/content/267/5199/843.full.pdfGoogle Scholar
- Marc Damashek. 1995. Gauging Similarity with n-Grams: Language-Independent Categorization of Text. Science 267, 5199 (1995), 843–848. https://doi.org/10.1126/science.267.5199.843 arXiv:https://science.sciencemag.org/content/267/5199/843.full.pdfGoogle Scholar
- E. Delaherche and M. Chetouani. 2010. Multimodal coordination: exploring relevant features and measures. In SSPW ’10.Google Scholar
- Lucile Dupuy, Etienne de Sevin, Hélène Cassoudesalle, Orlane Ballot, Patrick Dehail, Bruno Aouizerate, Emmanuel Cuny, Jean-Arthur Micoulaud-Franchi, and Pierre Philip. 2021. Guidelines for the design of a virtual patient for psychiatric interview training. Journal on Multimodal User Interfaces 15, 2 (2021), 99–107.Google ScholarCross Ref
- Oluwapelumi Giwa and Marelie Davel. 2013. N-gram based Language Identification of Individual Words. https://doi.org/10.13140/RG.2.1.4846.4083Google Scholar
- Gutemberg Guerra Filho and Yiannis Aloimonos. 2007. A Language for Human Action. Computer 40 (06 2007), 42 – 51. https://doi.org/10.1109/MC.2007.154Google Scholar
- Jennifer Fong Ha and Nancy Longnecker. 2010. Doctor-patient communication: a review. Ochsner Journal 10, 1 (2010), 38–43.Google Scholar
- Judith A Hall, Terrence G Horgan, and Nora A Murphy. 2019. Nonverbal communication. Annual Review of Psychology 70 (2019), 271–294.Google ScholarCross Ref
- Jinni A. Harrigan. 1985. Self-touching as an indicator of underlying affect and language processes. Social Science & Medicine 20, 11 (1985), 1161–1168. https://doi.org/10.1016/0277-9536(85)90193-5Google ScholarCross Ref
- Rowan H Harwood, Rebecca O’Brien, Sarah E Goldberg, Rebecca Allwood, Alison Pilnick, Suzanne Beeke, Louise Thomson, Megan Murray, Ruth Parry, Fiona Kearney, 2018. A staff training intervention to improve communication between people living with dementia and health-care professionals in hospital: the VOICE mixed-methods development and evaluation study. Health Services and Delivery Research 6, 41 (2018).Google Scholar
- Hazaël Jones and Nicolas Sabouret. 2013. TARDIS - A simulation platform with an affective virtual recruiter for job interviews.Google Scholar
- Joe H. Ward Jr.1963. Hierarchical Grouping to Optimize an Objective Function. J. Amer. Statist. Assoc. 58, 301 (1963), 236–244. https://doi.org/10.1080/01621459.1963.10500845 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/01621459.1963.10500845Google ScholarCross Ref
- Patrick G Kenny and Thomas D Parsons. 2011. Embodied conversational virtual patients. In Conversational agents and natural language interaction: Techniques and effective practices. IGI Global, 254–281.Google Scholar
- Dhruv Khullar. 2019. Building trust in health care—why, where, and how. Jama 322, 6 (2019), 507–509.Google ScholarCross Ref
- Naomi MacBean, Deborah Theodoros, Bronwyn Davidson, and Anne E Hill. 2013. Simulated learning environments in speech-language pathology: An Australian response. International Journal of Speech-Language Pathology 15, 3 (2013), 345–357.Google ScholarCross Ref
- Marianne Mast. 2007. On the importance of nonverbal communication in the physician-patient interaction. Patient education and counseling 67 (09 2007), 315–318. https://doi.org/10.1016/j.pec.2007.03.005Google Scholar
- Vu H. Nguyen, Hien T. Nguyen, Hieu N. Duong, and Vaclav Snasel. 2016. N-Gram-Based Text Compression. Intell. Neuroscience 2016 (Nov. 2016), 9. https://doi.org/10.1155/2016/9483646Google Scholar
- Yasuharu Okuda, Ethan O Bryson, Samuel DeMaria Jr, Lisa Jacobson, Joshua Quinones, Bing Shen, and Adam I Levine. 2009. The utility of simulation in medical education: what is the evidence?Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine: A Journal of Translational and Personalized Medicine 76, 4(2009), 330–343.Google ScholarCross Ref
- Eric Orton and Paul Mulhausen. 2008. E-learning virtual patients for geriatric education. Gerontology & geriatrics education 28, 3 (2008), 73–88.Google Scholar
- Pierre Philip, Jean-Arthur Micoulaud-Franchi, Patricia Sagaspe, Etienne De Sevin, Jérôme Olive, Stéphanie Bioulac, and Alain Sauteraud. 2017. Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders. Scientific reports 7, 1 (2017), 1–7.Google Scholar
- Becerril-Ortega R., Vanderstichel H., L. Petit, Urbiolagallegos M.J., Schoch J., Dacunha S., A. Benamara, Ravenet B., Zagdoun J., and L. Chaby. [n.d.]. Didactical conception process of a virtual simulation environment for the training of healthcare professionals in geriatrics. Simulation Training through the Lens of Experience and Activity Analysis.([n. d.]).Google Scholar
- F. Ramseyer and W. Tschacher. 2006. Synchrony - a core concept for a constructivist approach to psychotherapy.Google Scholar
- Huamin Ren, Weifeng Liu, Søren Olsen, Sergio Escalera, and Thomas Moeslund. 2015. Unsupervised Behavior-Specific Dictionary Learning for Abnormal Event Detection. https://doi.org/10.5244/C.29.28Google Scholar
- Albert Rizzo, Russell Shilling, Eric Forbell, Stefan Scherer, Jonathan Gratch, and Louis-Philippe Morency. 2016. Autonomous virtual human agents for healthcare information support and clinical interviewing. In Artificial intelligence in behavioral and mental health care. Elsevier, 53–79.Google Scholar
- Kate E Robinson, Peter J Allen, Michelle Quail, and Janet Beilby. 2020. Virtual patient clinical placements improve student communication competence. Interactive Learning Environments 28, 6 (2020), 795–805.Google ScholarCross Ref
- Catherine Saint-Georges, Ammar Mahdhaoui, Mohamed Chetouani, Raquel S. Cassel, Marie-Christine Laznik, Fabio Apicella, Pietro Muratori, Sandra Maestro, Filippo Muratori, and David Cohen. 2011. Do Parents Recognize Autistic Deviant Behavior Long before Diagnosis? Taking into Account Interaction Using Computational Methods. PLOS ONE 6, 7 (07 2011), 1–13. https://doi.org/10.1371/journal.pone.0022393Google Scholar
- Claude E. Shannon, Warren Weaver, and Shannon. 1998. The Mathematical Theory of Communication. University of Illinois Press.Google Scholar
- Mel Slater and Maria V Sanchez-Vives. 2016. Enhancing our lives with immersive virtual reality. Frontiers in Robotics and AI 3 (2016), 74.Google ScholarCross Ref
- Pascal M Staccini and Jean-Paul Fournier. 2019. Virtual Patients and Serious Games. In Clinical Simulation. Elsevier, 41–51.Google Scholar
- Giota Stratou and Louis-Philippe Morency. 2016. MultiSense - Context-Aware Nonverbal Behavior Analysis Framework: A Psychological Distress Use Case. IEEE Transactions on Affective Computing PP (09 2016), 1–1. https://doi.org/10.1109/TAFFC.2016.2614300Google Scholar
- Wataru Takano, Hirotaka Imagawa, and Yoshihiko Nakamura. [n.d.]. Prediction of human behaviors in the future through symbolic inference. https://doi.org/10.1109/ICRA.2011.5980422Google Scholar
- Thomas B Talbot and Albert Skip Rizzo. 2019. Virtual Standardized Patients for Interactive Conversational Training: A Grand Experiment and New Approach. In Exploring the Cognitive, Social, Cultural, and Psychological Aspects of Gaming and Simulations. IGI Global, 62–86.Google Scholar
- Lorraine Templier, Mohamed Chetouani, Monique Plaza, Zoé Belot, Patrick Bocquet, and Laurence Chaby. 2015. Altération de l’identification de la prosodie émotionnelle avec relative préservation de la production chez des patients atteints de la maladie d’Alzheimer. Gériatrie et Psychologie Neuropsychiatrie du Vieillissement 13, 1(2015), 106–115.Google ScholarCross Ref
- Philippe Thomas, Gérard Chandès, Cyril Hazif-Thomas, and Jacques Fontanille. 2017. Analyse du sens d’un trouble du comportement dans la démence. Annales Médico-psychologiques, revue psychiatrique 175, 10(2017), 906 – 913. https://doi.org/10.1016/j.amp.2017.10.004Google Scholar
- Christian Thurau and Václav Hlaváč. 2007. N-Grams of Action Primitives for Recognizing Human Behavior. In Proceedings of the 12th International Conference on Computer Analysis of Images and Patterns (Vienna, Austria) (CAIP’07). Springer-Verlag, Berlin, Heidelberg, 93–100.Google ScholarDigital Library
- Connie Timmermann, Lisbeth Uhrenfeldt, and Regner Birkelund. 2017. Ethics in the communicative encounter: seriously ill patients’ experiences of health professionals’ nonverbal communication. Scandinavian journal of caring sciences 31, 1 (2017), 63–71.Google Scholar
- Andrija Tomović, Predrag Janičić, and Vlado Kešelj. 2006. n-Gram-based classification and unsupervised hierarchical clustering of genome sequences. Computer Methods and Programs in Biomedicine 81, 2(2006), 137–153. https://doi.org/10.1016/j.cmpb.2005.11.007Google ScholarCross Ref
- Annick S van Manen Drs. 2020. A Communication Model for Nursing Staff Working in Dementia Care: Results of a Scoping Review. International Journal of Nursing Studies(2020), 103776.Google Scholar
- Bin Zhao and Fei Fei Li. 2011. Online detection of unusual events in videos via dynamic sparse coding. 3313–3320. https://doi.org/10.1109/CVPR.2011.5995524Google Scholar
- George Kingsley Zipf. 1949. Human Behavior and the Principle of Least Effort: An Introduction to Human Ecology. Addison-Wesley, Cambridge, Massachusetts. 588 pages.Google Scholar
Index Terms
- Non-Verbal behaviors analysis of healthcare professionals engaged with a Virtual-Patient
Index terms have been assigned to the content through auto-classification.
Recommendations
A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals
AbstractLanguage resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation ...
Building an Integrated Patient Information System for a Healthcare Network
The recent healthcare reform act provides incentive payments to providers for their 'meaningful use' of electronic health records to achieve significant improvements in care. The HITECH Act 2009 provides incentives payments through Medicare and Medicaid ...
How Healthcare Professionals "Make Sense" of an Electronic Patient Record Adoption
This article examines how healthcare professionals experience an Electronic Patient Record (EPR) adoption process. Based on a case study from two surgical wards in Danish hospitals, we analyze the healthcare professionals' conceptions of the technology, ...
Comments