Laura Götz
Florian Alt
Albrecht Schmidt
ABSTRACT
Autobiographical Recall (ABR) is a method for eliciting emotions by recalling past personal events (e.g., recalling happy memories to induce happiness). ABR could have many uses in virtual reality (VR), ranging from virtual therapy to training and research. However, we currently do not know how users experience different implementations of ABR in VR, and how effective they are relative to each other. Hence, we investigate how well real-world ABR methods work in VR. We conducted a user study (N=17) where participants evoked emotions using four ABR methods: thinking quietly, writing/drawing, talking to a virtual avatar, and talking to an avatar connected to another person. Our results show that 1) all methods of ABR were equally successful in inducing changes in emotion, and 2) the users’ experiences with the different methods varied, yet, methods in which events are recalled in private were generally deemed most comfortable (writing/drawing, thinking quietly).
Supplemental Material
- [n.d.]. Word frequency data. https://www.wordfrequency.info/Google Scholar
- Richard W. Backs, Sergio P. da Silva, and Kyunghee Han. 2005. A Comparison of Younger and Older Adults’ Self-Assessment Manikin Ratings of Affective Pictures. Experimental Aging Research 31, 4 (2005), 421–440. https://doi.org/10.1080/03610730500206808 Place: United Kingdom Publisher: Taylor & Francis.Google ScholarCross Ref
- Richard C. Baker and Daniel O. Guttfreund. 1993. The effects of written autobiographical recollection induction procedures on mood. Journal of Clinical Psychology 49, 4 (1993), 563–568. https://doi.org/10.1002/1097-4679(199307)49:4<563::AID-JCLP2270490414>3.0.CO;2-W _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/1097-4679%28199307%2949%3A4%3C563%3A%3AAID-JCLP2270490414%3E3.0.CO%3B2-W.Google ScholarCross Ref
- Roy F. Baumeister, Ellen Bratslavsky, Catrin Finkenauer, and Kathleen D. Vohs. 2001. Bad Is Stronger Than Good. Review of General Psychology 5, 4 (2001), 323–370.Google ScholarCross Ref
- Rosa María Baños, Víctor Liaño, Cristina Botella, Mariano Alcañiz, Belén Guerrero, and Beatriz Rey. 2006. Changing Induced Moods Via Virtual Reality. In Persuasive Technology(Lecture Notes in Computer Science), Wijnand A. IJsselsteijn, Yvonne A. W. de Kort, Cees Midden, Berry Eggen, and Elise van den Hoven (Eds.). Springer, Berlin, Heidelberg, 7–15. https://doi.org/10.1007/11755494_3Google Scholar
- Margaret M. Bradley and Peter J. Lang. 1994. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (March 1994), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9Google ScholarCross Ref
- Holly P. Branigan, Martin J. Pickering, Jamie Pearson, and Janet F. McLean. 2010. Linguistic alignment between people and computers. Journal of Pragmatics 42, 9 (Sept. 2010), 2355–2368. https://doi.org/10.1016/j.pragma.2009.12.012Google ScholarCross Ref
- Michael Braun, Simon Weiser, Bastian Pfleging, and Florian Alt. 2018. A Comparison of Emotion Elicitation Methods for Affective Driving Studies. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, Toronto ON Canada, 77–81. https://doi.org/10.1145/3239092.3265945Google ScholarDigital Library
- Deanna Brewer, Eugene B. Doughtie, and Bernard Lubin. 1980. Induction of mood and mood shift. Journal of Clinical Psychology 36, 1 (1980), 215–226. https://doi.org/10.1002/1097-4679(198001)36:1<215::AID-JCLP2270360127>3.0.CO;2-6 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/1097-4679%28198001%2936%3A1%3C215%3A%3AAID-JCLP2270360127%3E3.0.CO%3B2-6.Google ScholarCross Ref
- Sven Buechel and Udo Hahn. 2017. EmoBank: Studying the Impact of Annotation Perspective and Representation Format on Dimensional Emotion Analysis. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Association for Computational Linguistics, Valencia, Spain, 578–585. https://aclanthology.org/E17-2092Google ScholarCross Ref
- Veena Chattaraman, Wi-Suk Kwon, and Juan E. Gilbert. 2012. Virtual agents in retail web sites: Benefits of simulated social interaction for older users. Computers in Human Behavior 28, 6 (Nov. 2012), 2055–2066. https://doi.org/10.1016/j.chb.2012.06.009Google ScholarDigital Library
- Alice Chirico, Pietro Cipresso, and Andrea Gaggioli. 2018. Psychophysiological specificity of four basic emotions through autobiographical recall and videos. In International Symposium on Pervasive Computing Paradigms for Mental Health. Springer, 1–8.Google ScholarCross Ref
- Julia Diemer, Georg W. Alpers, Henrik M. Peperkorn, Youssef Shiban, and Andreas Mühlberger. 2015. The impact of perception and presence on emotional reactions: a review of research in virtual reality. Frontiers in Psychology 6 (2015), 26. https://doi.org/10.3389/fpsyg.2015.00026Google ScholarCross Ref
- Pedro Diniz Bernardo, Amrita Bains, Sophia Westwood, and Daniel C. Mograbi. 2020. Mood Induction Using Virtual Reality: a Systematic Review of Recent Findings. Journal of Technology in Behavioral Science (Aug. 2020). https://doi.org/10.1007/s41347-020-00152-9Google Scholar
- Shichuan Du and Aleix M. Martinez. 2015. Compound facial expressions of emotion: from basic research to clinical applications. Dialogues in Clinical Neuroscience 17, 4 (Dec. 2015), 443–455.Google ScholarCross Ref
- Paul Ekman, E. Richard Sorenson, and Wallace V. Friesen. 1969. Pan-Cultural Elements in Facial Displays of Emotion. Science (April 1969). https://www.science.org/doi/abs/10.1126/science.164.3875.86 Publisher: American Association for the Advancement of Science.Google Scholar
- Javier Fernandez-Alvarez, Desirée Colombo, Carlos Suso-Ribera, Alice Chirico, Silvia Serino, Daniele Di Lernia, Azucena García Palacios, Giuseppe Riva, and Cristina Botella. 2021. Using virtual reality to target positive autobiographical memory in individuals with moderate-to-moderately severe depressive symptoms: A single case experimental design. Internet Interventions(2021), 100407. Publisher: Elsevier.Google Scholar
- T. Lee Gilman, Razan Shaheen, K. Maria Nylocks, Danielle Halachoff, Jessica Chapman, Jessica J. Flynn, Lindsey M. Matt, and Karin G. Coifman. 2017. A film set for the elicitation of emotion in research: A comprehensive catalog derived from four decades of investigation. (2017).Google Scholar
- Mar Gonzalez-Franco, Eyal Ofek, Ye Pan, Angus Antley, Anthony Steed, Bernhard Spanlang, Antonella Maselli, Domna Banakou, Nuria Pelechano, Sergio Orts-Escolano, Veronica Orvalho, Laura Trutoiu, Markus Wojcik, Maria V. Sanchez-Vives, Jeremy Bailenson, Mel Slater, and Jaron Lanier. 2020. The Rocketbox Library and the Utility of Freely Available Rigged Avatars. Frontiers in Virtual Reality 1 (2020). https://doi.org/10.3389/frvir.2020.561558 Publisher: Frontiers.Google Scholar
- Samuel D Gosling, Peter J Rentfrow, and William B Swann. 2003. A very brief measure of the Big-Five personality domains. Journal of Research in Personality 37, 6 (Dec. 2003), 504–528. https://doi.org/10.1016/S0092-6566(03)00046-1Google ScholarCross Ref
- James J. Gross and Robert W. Levenson. 1995. Emotion elicitation using films. Cognition & emotion 9, 1 (1995), 87–108. Publisher: Taylor & Francis.Google Scholar
- Eddie Harmon-Jones, David Amodio, and Leah Zinner. 2007. Social Psychological Methods of Emotion Elicitation. Handbook of Emotion Elicitation and Assessment (Jan. 2007).Google Scholar
- Kai Holländer, Ashley Colley, Christian Mai, Jonna Häkkilä, Florian Alt, and Bastian Pfleging. 2019. Investigating the Influence of External Car Displays on Pedestrians’ Crossing Behavior in Virtual Reality. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, Taipei Taiwan, 1–11. https://doi.org/10.1145/3338286.3340138Google ScholarDigital Library
- Carroll E. Izard. 2010. The many meanings/aspects of emotion: Definitions, functions, activation, and regulation. Emotion Review 2, 4 (2010), 363–370. Publisher: Sage Publications Sage UK: London, England.Google ScholarCross Ref
- Christophe Jallais and Anne-Laure Gilet. 2010. Inducing changes in arousal and valence: Comparison of two mood induction procedures. Behavior research methods 42, 1 (2010), 318–325. Publisher: Springer.Google Scholar
- Vladimir J. Konečni, Amber Brown, and Rebekah A. Wanic. 2008. Comparative effects of music and recalled life-events on emotional state. Psychology of Music 36, 3 (July 2008), 289–308. https://doi.org/10.1177/0305735607082621Google ScholarCross Ref
- Magda Kowalska and Monika Wróbel. 2017. Basic Emotions. In Encyclopedia of Personality and Individual Differences, Virgil Zeigler-Hill and Todd K. Shackelford (Eds.). Springer International Publishing, Cham, 1–6. https://doi.org/10.1007/978-3-319-28099-8_495-1Google Scholar
- Peter J. Lang, Margaret M. Bradley, and Bruce N. Cuthbert. 1997. International affective picture system (IAPS): Technical manual and affective ratings. NIMH Center for the Study of Emotion and Attention 1 (1997), 39–58. Publisher: Gainesville, FL.Google Scholar
- Robert W. Levenson. 2011. Basic Emotion Questions. Emotion Review 3, 4 (Oct. 2011), 379–386. https://doi.org/10.1177/1754073911410743 Publisher: SAGE Publications.Google ScholarCross Ref
- Manuela Macedonia, Iris Groher, and Friedrich Roithmayr. 2014. Intelligent virtual agents as language trainers facilitate multilingualism. Frontiers in Psychology 5 (2014), 295. https://doi.org/10.3389/fpsyg.2014.00295Google ScholarCross Ref
- C. Mills and S. D’Mello. 2014. On the Validity of the Autobiographical Emotional Memory Task for Emotion Induction. PLoS ONE 9, 4 (2014), e95837.Google ScholarCross Ref
- Catherine Monnier, Arielle Syssau, Nathalie Blanc, and Claire Brechet. 2018. Assessing the effectiveness of drawing an autobiographical memory as a mood induction procedure in children. The Journal of Positive Psychology 13, 2 (2018), 174–180. Publisher: Taylor & Francis.Google ScholarCross Ref
- Ville Mäkelä, Rivu Radiah, Saleh Alsherif, Mohamed Khamis, Chong Xiao, Lisa Borchert, Albrecht Schmidt, and Florian Alt. 2020. Virtual Field Studies: Conducting Studies on Public Displays in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–15. https://doi.org/10.1145/3313831.3376796Google ScholarDigital Library
- Brian Parkinson and Antony S. R. Manstead. 2015. Current Emotion Research in Social Psychology: Thinking About Emotions and Other People. Emotion Review 7, 4 (Oct. 2015), 371–380. https://doi.org/10.1177/1754073915590624 Publisher: SAGE Publications.Google ScholarCross Ref
- James W. Pennebaker and Cindy K. Chung. 2007. Expressive writing, emotional upheavals, and health.(2007). Publisher: Oxford University Press.Google Scholar
- Rosalind W. Picard. 2010. Emotion Research by the People, for the People. Emotion Review 2, 3 (July 2010), 250–254. https://doi.org/10.1177/1754073910364256Google ScholarCross Ref
- Mark B. Powers and Paul M. G. Emmelkamp. 2008. Virtual reality exposure therapy for anxiety disorders: A meta-analysis. Journal of Anxiety Disorders 22, 3 (2008), 561–569. https://doi.org/10.1016/j.janxdis.2007.04.006 Place: Netherlands Publisher: Elsevier Science.Google ScholarCross Ref
- Rebecca D. Ray and James J. Gross. 2007. Emotion elicitation using films. Handbook of emotion elicitation and assessment 9 (2007). Publisher: Oxford University Press London, UK.Google Scholar
- Greg M. Reger, Derek Smolenski, Aaron Norr, Andrea Katz, Benjamin Buck, and Barbara O. Rothbaum. 2019. Does virtual reality increase emotional engagement during exposure for PTSD? Subjective distress during prolonged and virtual reality exposure therapy. Journal of Anxiety Disorders 61 (2019), 75–81. https://doi.org/10.1016/j.janxdis.2018.06.001 Place: Netherlands Publisher: Elsevier Science.Google ScholarCross Ref
- Radiah Rivu, Ruoyu Jiang, Ville Mäkelä, Mariam Hassib, and Florian Alt. 2021. Emotion Elicitation Techniques in Virtual Reality. In Human-Computer Interaction – INTERACT 2021, Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 93–114.Google ScholarDigital Library
- Barbara Olasov Rothbaum, Larry Hodges, and Rob Kooper. 1997. Virtual reality exposure therapy. Journal of Psychotherapy Practice & Research 6, 3 (1997), 219–226. Place: US Publisher: American Psychiatric Press.Google Scholar
- James Russell and Albert Mehrabian. 1977. Evidence for a Three-Factor Theory of Emotions. Journal of Research in Personality 11 (Sept. 1977), 273–294. https://doi.org/10.1016/0092-6566(77)90037-XGoogle ScholarCross Ref
- James A. Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6(1980), 1161. Publisher: American Psychological Association.Google Scholar
- Andrea C. Samson, Sylvia D. Kreibig, Blake Soderstrom, A. Ayanna Wade, and James J. Gross. 2016. Eliciting positive, negative and mixed emotional states: A film library for affective scientists. Cognition and Emotion 30, 5 (July 2016), 827–856. https://doi.org/10.1080/02699931.2015.1031089Google ScholarCross Ref
- Ewa Siedlecka and Thomas F. Denson. 2018. Experimental Methods for Inducing Basic Emotions: A Qualitative Review. Emotion Review 1(2018), 11.Google Scholar
- Ana Soares, Ana Pinheiro, Ana Costa, Sofia Frade, Montserrat Comesaña, and Rita Pureza. 2013. Affective auditory stimuli: Adaptation of the International Affective Digitized Sounds (IADS-2) for European Portuguese. Behavior research methods 45 (March 2013). https://doi.org/10.3758/s13428-012-0310-1Google Scholar
- Sahinya Susindar, Mahnoosh Sadeghi, Lea Huntington, Andrew Singer, and Thomas K. Ferris. 2019. The Feeling is Real: Emotion Elicitation in Virtual Reality. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 63. SAGE Publications Sage CA: Los Angeles, CA, 252–256. Issue: 1.Google ScholarCross Ref
- Myrthe L. Tielman, Mark A. Neerincx, Rafael Bidarra, Ben Kybartas, and Willem-Paul Brinkman. 2017. A Therapy System for Post-Traumatic Stress Disorder Using a Virtual Agent and Virtual Storytelling to Reconstruct Traumatic Memories. Journal of Medical Systems 41, 8 (Aug. 2017), 125. https://doi.org/10.1007/s10916-017-0771-yGoogle ScholarDigital Library
- Meike K. Uhrig, Nadine Trautmann, Ulf Baumgärtner, Rolf-Detlef Treede, Florian Henrich, Wolfgang Hiller, and Susanne Marschall. [n.d.]. Emotion Elicitation: A Comparison of Pictures and Films. ([n. d.]).Google Scholar
- Tugba Uzer, Peter J. Lee, and Norman R. Brown. 2012. On the prevalence of directly retrieved autobiographical memories.Journal of Experimental Psychology: Learning, Memory, and Cognition 38, 5(2012), 1296–1308. https://doi.org/10.1037/a0028142Google ScholarCross Ref
- Emmett Velten. 1968. A laboratory task for induction of mood states. Behaviour Research and Therapy 6, 4 (Nov. 1968), 473–482. https://doi.org/10.1016/0005-7967(68)90028-4Google ScholarCross Ref
- Daniel Västfjäll. 2001. Emotion induction through music: A review of the musical mood induction procedure. Musicae Scientiae Spec Issue, 2001-2002 (2001), 173–211. https://doi.org/10.1177/10298649020050S107 Place: Belgium Publisher: European Society for the Cognitive Sciences of Music.Google Scholar
- Thomas Waltemate, Dominik Gall, Daniel Roth, Mario Botsch, and Marc Erich Latoschik. 2018. The Impact of Avatar Personalization and Immersion on Virtual Body Ownership, Presence, and Emotional Response. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1643–1652. https://doi.org/10.1109/TVCG.2018.2794629 Conference Name: IEEE Transactions on Visualization and Computer Graphics.Google ScholarDigital Library
- Hans-Heinrich Wängler. 1963. Rangwörterbuch hochdeutscher Umgangssprache. NG Elwert.Google Scholar
- Blair E. Wisco and Susan Nolen-Hoeksema. 2009. The interaction of mood and rumination in depression: Effects on mood maintenance and mood-congruent autobiographical memory. Journal of Rational-Emotive & Cognitive-Behavior Therapy 27, 3(2009), 144–159. Publisher: Springer.Google ScholarCross Ref
- Sze Ngar Vanessa Yuan and Horace Ho Shing Ip. 2018. Using virtual reality to train emotional and social skills in children with autism spectrum disorder. London Journal of Primary Care 10, 4 (June 2018), 110–112. https://doi.org/10.1080/17571472.2018.1483000Google Scholar
Index Terms
- Real-World Methods of Autobiographical Recall in Virtual Reality
Recommendations
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality ConferenceIn this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
A comparative study of presence in virtual reality vs. presence in the real world
ACM-SE 42: Proceedings of the 42nd annual Southeast regional conferenceThe main objective of this project was to study and compare the relationship between the sense of presence in the virtual environment and the sense of presence in the physical world while experiencing the virtual world. The study consisted of two parts, ...
Comments