Abstract
For the training of interpersonal skills, such as those required in the medical field, virtual agents can provide a safe environment for practice. However, many agent systems are not developed with the ability to understand non-verbal input. Being able to automatically parse such input is essential for the practice of interpersonal skills such as empathy. Currently, it is still an open question which prosodic or visual features would aid automatic classification of empathy and how this knowledge can be used to support the practice of these skills. As a first step towards this goal, we report on 42 second-year nursing students practicing their empathy skills with a virtual patient or through collaborative role playing. We found that across both the role playing and simulation, students assessed their empathy as increasing over time but as higher during the role playing. This work contributes to the continued development of virtual agents for the training of interpersonal skills.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
As with many areas of vocational education, the medical field has challenges in teaching skills to students in safe environments where the risk from mistakes is minimal and in a way that is scalable. One proposed solution that has been effective across a range of skills has been to use virtual agents [4, 14, 20, 25]. Outside of the medical domain, virtual agents can take on many different roles to support the learning process including those of instructor [1], students for teacher training [9, 10], or role-player [24]. Across studies, environments that include virtual agents have been found to enhance learning compared to those that do not [15, 29]. Within medical trains, researchers have used virtual patients, a subset of virtual agents, to support both the acquisition of theoretical knowledge [5, 27] as well as communication skills [22, 31]. Virtual patients provide many advantages to medical training including standardization, accessibility and efficiency, and practice in a safe environment with feedback [5, 27].
More recently, research within virtual agents has expanded from focusing primarily on guidance and coaching to using agents’ social and affective capabilities to support learning [18], specifically interpersonal behaviors [2]. For the training of interpersonal skills, students can respond realistically to virtual humans [13] and can improve their target interpersonal skills [17, 24]. Furthermore, these skills practiced with the virtual agent may transfer to use with real humans [14].
Moreover, virtual patients can provide increased exposure to cases that take extra care such as those with special needs [28] or dementia. With virtual patients, students are able to practice in a safe environment [31] that prepares them for emotionally-charged real-life encounters and to transfer their skills to a more realistic situation [20]. When training students to deal with sensitive situations specifically, such as those when working with a dementia patient, there is far less work. One specific challenge is to support the training of empathy, which is critical to patient outcomes [16, 30]. We define empathy as “a two-phase process: (a) understand and appreciate another person’s feelings and emotions and (b) communicate understanding back to the patient in a supportive way” [21] with a focus on the communication through voice. In these situations, the empathy exhibited by the student through both verbal and non-vernal actions is key to fruitful interactions with the patient. Virtual agents have shown mixed results in their ability to support empathy training with higher empathy with real people in some studies [8] and lower in others [19]. One strength of using virtual agents to support empathy training is their ability to provide feedback to students [11, 12] and support reflection on their responses [19]. However, virtual patients are still limited in their ability to support complex communication skills [5, 7, 27].
In this work, we investigate how a virtual agent can be designed and support the training of empathy skills. Specifically, we evaluate the use of a virtual patient for empathy training compared to that of standard practice – collaborative role playing. Our research question is: how does the students’ empathy compare over time between the virtual patient condition and the role playing condition? We hypothesize that students will increase their empathy over time but that they will have higher empathy when interacting with real humans [8]. This research contributes to our understanding of using virtual patients to support empathy training.
2 Methods
2.1 Virtual Patient and Collaborative Role Playing Conditions
We developed the patient simulation using Unity with a narrative design, in which decisions the user makes results in different outcomes over time. We represented facial expressions and body posture through a 2-D sketch and speech as both text and audio. The students worked individually with the patient through simple text selections. At each decision point, the student could choose from three answers. We designed the student choices together with experts to represent a range of choices. After making their choice, the students were asked to read out loud the choice that they selected in the way that they would say it to a patient. If they had not liked any of the choices, at this point they were also given the opportunity to rephrase their response. The students could then replay their recording to reflect on the level of empathy. Based on their choice, the next interaction scenario (i.e., dialogue of the patient) would appear on the screen and the facial features of the patient would change subtly to indicate the emotions of the patient (Fig. 1).
In the collaborative role-playing, the students were assigned to act out different scenarios in either groups of two or three. In each group there was a patient with dementia and a nurse. When there was a third student, they observed the interaction and took notes. This role-playing set up followed the current school practices. For instructions, we asked the students to speak in High German to standardize the interactions across the different groups as there are multiple dialects of Swiss German. Furthermore, the students were told that they could take advantage of any of the furniture or items in the rooms as props.
2.2 Study Design and Procedure
We collected data from 42 second-year nursing students (16–25 years old) enrolled in a Swiss vocational education program. Of the participants, 37 were female and five male, which is similar to the proportion in the profession. For the experiment, we conducted a within-subject design in which all participants experienced both the virtual patient simulation and the collaborative role playing. We randomly assigned students to experience the virtual patient or the role playing first to counter-balance the order.
For each condition, the students were given three scenarios that were designed to be different across the conditions, but equal. In between each of the scenarios, the students were asked to reflect on the empathy level displayed by the nurse in that scenario on a 1–5 Likert scale [26]. Additionally, they were asked to explain which actions were taken that concretely displayed empathy and which did not display empathy allowing them to reflect on their current actions to elicited self-explanation [6].
3 Results
Our research question related to the impact of the virtual patients on the learning of empathy skills. Specifically, we were interested in the difference between the students’ empathy levels between the two conditions, how students’ empathy levels changed over time, and if the condition had any impact on this slope. To investigate this question, we used a mixed model to account for the nested nature of the data with each student having multiple scores within each condition. We found a significant impact of time on students’ empathy ratings, t(157) = 5.15, p< .001, with an increase over time. Moreover, we found a significant impact of condition, t(38) = 3.13, p<.01, with students rating their empathy higher in the role-playing condition. Finally, we found a marginally significant interaction between the time and condition, t(157) = −1.84, p = .07, with the change over time being positively steeper in the virtual patient condition.
4 Discussion and Conclusion
For virtual agents to support the training of interpersonal skills, it is not enough to only capture the verbal content but to also provide training support for the non-verbal content. In this paper, we conducted a study with 42 nursing students to compare the impact of role playing and virtual patients on their empathy training. Unsurprisingly, we found that the students rated their empathy as being higher in the role-playing condition compared with the virtual patient. One reason for this difference is that the virtual patient did not include many of the channels through which people express empathy. These results support previous work in which students were able to respond empathetically to virtual patients, but not as well as a human [8]. In this case, much of the difference in empathy was also related to the non-verbal aspects of the communication and would be a place for future development of virtual agents. One limitation of our ratings was that they were all self-assessed so may have contained bias, although previous work has shown a correlation between self-assessed communication performance and expert ratings [3, 26]. Nevertheless, in this paper, we contribute to the understanding of how virtual agents, specifically the use of virtual patients, can be used to support the learning of interpersonal skills such as empathy. To move in this direction, future work is needed to further develop the non-verbal feedback support within virtual agents.
In this future work, we aim to provide objective ratings of the recorded speech in each condition to further support these results. However, the software is still very limited in being able to provide any feedback around non-verbal features. Extracting prosodic features from the speech samples collected will enable the development of an automatic empathy classifier, similar in approach to the ones developed for engagement [23]. Although gestures and touching cannot be reflected with the virtual patient, the speech support could be greatly strengthened with the automatic detection of prosodic features. Furthermore, we aim to model these student futures to be able to integrate empathy attributes into virtual patients.
References
Atkinson, R.K.: Optimizing learning from examples using animated pedagogical agents. J. Educ. Psychol. 94(2), 416 (2002)
Aylett, R., Vannini, N., Andre, E., Paiva, A., Enz, S., Hall, L.: But that was in another country: agents and intercultural empathy. In: Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 1. pp. 329–336. International Foundation for Autonomous Agents and Multiagent Systems (2009)
Beaird, G., Nye, C., Thacker II, L.R.: The use of video recording and standardized patient feedback to improve communication performance in undergraduate nursing students. Clin. Simul. Nurs. 13(4), 176–185 (2017)
Berman, A.H., et al.: Virtual patients in a behavioral medicine massive open online course (MOOC): a qualitative and quantitative analysis of participants’ perceptions. Acad. Psychiatry 41(5), 631–641 (2017)
Cendan, J., Lok, B.: The use of virtual patients in medical school curricula. Adv. Physiol. Educ. 36(1), 48–53 (2012)
Chi, M.T., Siler, S.A., Jeong, H., Yamauchi, T., Hausmann, R.G.: Learning from human tutoring. Cognit. Sci. 25(4), 471–533 (2001)
Consorti, F., Mancuso, R., Nocioni, M., Piccolo, A.: Efficacy of virtual patients in medical education: a meta-analysis of randomized studies. Comput. Educ. 59(3), 1001–1008 (2012)
Deladisma, A.M., et al.: Do medical students respond empathetically to a virtual patient? Am. J. Sur. 193(6), 756–760 (2007)
Delamarre, A.P., et al.: An interactive virtual training (IVT) simulation for early career teachers to practice in 3D classrooms with student avatars. In: The Thirtieth International Flairs Conference (2017)
Dieker, L., Hynes, M., Stapleton, C., Hughes, C.: Virtual classrooms: star simulator. New Learn. Technol.SALT 4, 1–22 (2007)
Foster, A., et al.: Using virtual patients to teach empathy: a randomized controlled study to enhance medical students’ empathic communication. Simul. Healthcare 11(3), 181–189 (2016)
Foster, A., Trieu, M., Azutillo, E., Halan, S., Lok, B.: Teaching empathy in healthcare: from mirror neurons to education technology. J. Technol. Behav. Sci. 2(2), 94–105 (2017)
Gillies, M., Pan, X.: Virtual reality for social skills training. In: Proceedings of the Virtual and Augmented Reality to Enhance Learning and Teaching in Higher Education Conference 2018, No. 8, pp. 83–92. IM Publications Open (2018)
Johnsen, K., Raij, A., Stevens, A., Lind, D.S., Lok, B.: The validity of a virtual human experience for interpersonal skills education. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1049–1058 (2007)
Johnson, W.L., Lester, J.C.: Face-to-face interaction with pedagogical agents, twenty years later. Int. J. Artif. Intell. Educ. 26(1), 25–36 (2016)
Kelm, Z., Womer, J., Walter, J.K., Feudtner, C.: Interventions to cultivate physician empathy: a systematic review. BMC Med. Educ. 14(1), 219 (2014)
Kim, J.M., et al.: Bilat: a game-based environment for practicing negotiation in a cultural context. Int. J. Artif. Intell. Educ. 19(3), 289–308 (2009)
Kim, Y., Baylor, A.L.: based design of pedagogical agent roles: a review, progress, and recommendations. Int. J. Artif. Intell. Educ. 26(1), 160–169 (2016)
Kleinsmith, A., Rivera-Gutierrez, D., Finney, G., Cendan, J., Lok, B.: Understanding empathy training with virtual patients. Comput. Hum. Behav. 52, 151–158 (2015)
Kron, F.W., et al.: Using a computer simulation for teaching communication skills: a blinded multisite mixed methods randomized controlled trial. Patient Educ. Couns. 100(4), 748–759 (2017)
Kurtz, S., Draper, J., Silverman, J.: Teaching and Learning Communication Skills in Medicine. CRC Press, London (2017)
Menendez, E., et al.: Using a virtual patient system for the teaching of pharmaceutical care. Int. J. Med. Inform. 84(9), 640–646 (2015)
Oertel, C., Scherer, S., Campbell, N.: On the use of multimodal cues for the prediction of degrees of involvement in spontaneous conversation. In: Twelfth Annual Conference of the International Speech Communication Association (2011)
Ogan, A., Aleven, V., Kim, J., Jones, C.: Intercultural negotiation with virtual humans: the effect of social goals on gameplay and learning. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 174–183. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13388-6_22
Raij, A.B., et al.: Comparing interpersonal interactions with a virtual human to those with a real human. IEEE Trans. Visual Comput. Graphics 13(3), 443–457 (2007)
Rivera-Gutierrez, D., Kleinsmith, A., Childs, G., Pileggi, R., Lok, B.: Self-assessment through interactive in-action reflections to improve interpersonal skills training. In: 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT), pp. 143–147. IEEE (2016)
Saleh, N.: The value of virtual patients in medical education. Ann. Behav. Sci. Med. Educ. 16(2), 29–31 (2010)
Sanders, C., Kleinert, H.L., Boyd, S.E., Herren, C., Theiss, L., Mink, J.: Virtual patient instruction for dental students: can it improve dental care access for persons with special needs? Spec. Care Dentist. 28(5), 205–213 (2008)
Schroeder, N.L., Adesope, O.O., Gilbert, R.B.: How effective are pedagogical agents for learning? a meta-analytic review. J. Educ. Comput. Res. 49(1), 1–39 (2013)
Shao, Y.N., Sun, H.M., Huang, J.W., Li, M.L., Huang, R.R., Li, N.: Simulation-based empathy training improves the communication skills of neonatal nurses. Clin. Simul. Nurs. 22, 32–42 (2018)
Stevens, A., et al.: The use of virtual patients to teach medical students history taking and communication skills. Am. J. Sur. 191(6), 806–811 (2006)
Acknowledgements
This project was supported by the leading house DUAL-T research project funded by the Swiss State Secretariat for Education, Research and Innovation (SERI). We would like to thank KOGS (www.kogs.ch) for their excellent collaboration and support in running this study. It would not have been possible without their expert knowledge in health and effort in bringing together input and study opportunities from different inter-company course centres all across the German speaking part of Switzerland.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Olsen, J.K., Oertel, C. (2020). Supporting Empathy Training Through Virtual Patients. In: Bittencourt, I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds) Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science(), vol 12164. Springer, Cham. https://doi.org/10.1007/978-3-030-52240-7_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-52240-7_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-52239-1
Online ISBN: 978-3-030-52240-7
eBook Packages: Computer ScienceComputer Science (R0)