Rivu Radiah
Pascal Knierim
Florian Alt
ABSTRACT
Emotions affect our perception, attention, and behavior. Hereby, the emotional state is greatly affected by the surrounding environment that can seamlessly be designed in Virtual Reality (VR). However, research typically does not account for the influence of the environment on participants’ emotions, even if this influence might alter acquired data. To mitigate the impact, we formulated a design space that explains how the creation of virtual environments influences emotions. Furthermore, we present EmotionEditor, a toolbox that assists researchers in rapidly developing virtual environments that influence and asses the users’ emotional state. We evaluated the capability of EmotionEditor to elicit emotions in a lab study (n=30). Based on interviews with VR experts (n=13), we investigate how they consider the effect of emotions in their research, how the EmotionEditor can prospectively support them, and analyze prevalent challenges in the design as well as development of VR user studies.
- Frederick Aardema, Kieron O’Connor, Sophie Côté, and Annie Taillon. 2010. Virtual reality induces dissociation and lowers sense of presence in objective reality. Cyberpsychology, Behavior, and Social Networking 13, 4 (2010), 429–435. https://doi.org/10.1089/cyber.2009.0164Google Scholar
Cross Ref
- Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376722Google ScholarDigital Library
- Maryam Banaei, Javad Hatami, Abbas Yazdanfar, and Klaus Gramann. 2017. Walking through architectural spaces: the impact of interior forms on human brain dynamics. Frontiers in human neuroscience 11 (2017), 477.Google Scholar
- Moshe Bar and Maital Neta. 2006. Humans prefer curved visual objects. Psychological science 17, 8 (2006), 645–648.Google Scholar
- Anke Berns, Salvador Reyes Sánchez, and Iván Ruiz Rube. 2020. Virtual Reality Authoring Tools for Teachers to Create Novel and Immersive Learning Scenarios. In Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (Salamanca, Spain) (TEEM’20). Association for Computing Machinery, New York, NY, USA, 896–900. https://doi.org/10.1145/3434780.3436668Google ScholarDigital Library
- Margaret M Bradley and Peter J Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1 (1994), 49–59.Google ScholarCross Ref
- Tobias Brosch, Klaus R Scherer, Didier Maurice Grandjean, and David Sander. 2013. The impact of emotion on perception, attention, memory, and decision-making. Swiss medical weekly 143 (2013), w13786.Google Scholar
- Alice Chirico, David B Yaden, Giuseppe Riva, and Andrea Gaggioli. 2016. The potential of virtual reality for the investigation of awe. Frontiers in psychology 7 (2016), 1766.Google Scholar
- Annabelle Cumyn, Kathleen Ouellet, Anne-Marie Côté, Caroline Francoeur, and Christina St-Onge. 2019. Role of researchers in the ethical conduct of research: A discourse analysis from different stakeholder perspectives. Ethics & Behavior 29, 8 (2019), 621–636.Google ScholarCross Ref
- Elise S Dan-Glauser and Klaus R Scherer. 2011. The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behavior research methods 43, 2 (2011), 468–477.Google Scholar
- Sibel S Dazkir and Marilyn A Read. 2012. Furniture forms and their influence on our emotional responses toward interior environments. Environment and Behavior 44, 5 (2012), 722–732.Google ScholarCross Ref
- Arindam Dey, Hao Chen, Mark Billinghurst, and Robert W. Lindeman. 2018. Effects of Manipulating Physiological Feedback in Immersive Virtual Environments. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 101–111. https://doi.org/10.1145/3242671.3242676Google ScholarDigital Library
- Nicoló Dozio, Federica Marcolin, Giulia Wally Scurati, Luca Ulrich, Francesca Nonis, Enrico Vezzetti, Gabriele Marsocci, Alba La Rosa, and Francesco Ferrise. 2022. A design methodology for affective Virtual Reality. International Journal of Human-Computer Studies 162 (2022), 102791. https://doi.org/10.1016/j.ijhcs.2022.102791Google ScholarDigital Library
- Andrea Dravigne, Tina Marie Waliczek, RD Lineberger, and JM Zajicek. 2008. The effect of live plants and window views of green spaces on employee perceptions of job satisfaction. HortScience 43, 1 (2008), 183–187.Google ScholarCross Ref
- Paul Ekman. 1999. Basic emotions. Handbook of cognition and emotion 98, 45-60 (1999), 16.Google Scholar
- Andrew J Elliot. 2015. Color and psychological functioning: a review of theoretical and empirical work. Frontiers in psychology 6 (2015), 368.Google Scholar
- Anna Felnhofer, Oswald D Kothgassner, Mareike Schmidt, Anna-Katharina Heinzle, Leon Beutl, Helmut Hlavacs, and Ilse Kryspin-Exner. 2015. Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios. International journal of human-computer studies 82 (2015), 48–56.Google ScholarDigital Library
- Marina Fiori, Alessandra Lintas, Sarah Mesrobian, and Alessandro EP Villa. 2013. Effect of emotion and personality on deviation from purely rational decision-making. In Decision making and imperfection. Springer, 129–161.Google Scholar
- William W Gaver. 1993. What in the world do we hear?: An ecological approach to auditory event perception. Ecological psychology 5, 1 (1993), 1–29.Google Scholar
- Sandrine Gil and Ludovic Le Bigot. 2014. Seeing life through positive-tinted glasses: color–meaning associations. PloS one 9, 8 (2014), e104291.Google ScholarCross Ref
- Mike Goslin and Jacquelyn Ford Morie. 1996. Virtopia: Emotional experiences in virtual environments. Leonardo 29, 2 (1996), 95–100.Google ScholarCross Ref
- Laura Götz, Radiah Rivu, Florian Alt, Albrecht Schmidt, and Ville Mäkelä. 2022. Real-World Methods of Autobiographical Recall in Virtual Reality. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI ’22). Association for Computing Machinery, New York, NY, USA, Article 31, 11 pages. https://doi.org/10.1145/3546155.3546704Google ScholarDigital Library
- Jeffrey Alan Gray. 1987. The psychology of fear and stress. Vol. 5. CUP Archive.Google Scholar
- Alberto Greco, Gaetano Valenza, Luca Citi, and Enzo Pasquale Scilingo. 2016. Arousal and valence recognition of affective sounds based on electrodermal activity. IEEE Sensors Journal 17, 3 (2016), 716–725.Google ScholarCross Ref
- Rebecca Guillet and Jason Arndt. 2009. Taboo words: The effect of emotion on memory for peripheral information. Memory & Cognition 37, 6 (2009), 866–879.Google ScholarCross Ref
- Zayd Hendricks, Gary Marsden, and Edwin Blake. 2003. A Meta-Authoring Tool for Specifying Interactions in Virtual Reality Environments. In Proceedings of the 2nd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (Cape Town, South Africa) (AFRIGRAPH ’03). Association for Computing Machinery, New York, NY, USA, 171–180. https://doi.org/10.1145/602330.602362Google ScholarDigital Library
- Sergi Bermudez i Badia, Luis Velez Quintero, Monica S Cameirao, Alice Chirico, Stefano Triberti, Pietro Cipresso, and Andrea Gaggioli. 2018. Toward emotionally adaptive virtual reality for mental health applications. IEEE journal of biomedical and health informatics 23, 5 (2018), 1877–1887.Google Scholar
- Konrad Jamrozik. 2004. Research ethics paperwork: what is the plot we seem to have lost?Bmj 329, 7460 (2004), 286–287.Google Scholar
- Crescent Jicol, Christopher Clarke, Emilia Tor, Rebecca M Dakin, Tom Charlie Lancaster, Sze Tung Chang, Karin Petrini, Eamonn O’Neill, Michael J Proulx, and Christof Lutteroth. 2023. Realism and Field of View Affect Presence in VR but Not the Way You Think. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 399, 17 pages. https://doi.org/10.1145/3544548.3581448Google ScholarDigital Library
- Naz Kaya and Helen H Epps. 2004. Relationship between color and emotion: A study of college students. College student journal 38, 3 (2004), 396–405.Google Scholar
- Patricia Keith-Spiegel, Gerald P Koocher, and Barbara Tabachnick. 2006. What scientists want from their research ethics committee. Journal of Empirical Research on Human Research Ethics 1, 1 (2006), 67–81.Google ScholarCross Ref
- T Kiefer and RB Briner. 2006. Emotion at work. Developments in work and organizational psychology: Implications for international business (2006), 185–228.Google Scholar
- Kay Köhle, Matthias Hoppe, Albrecht Schmidt, and Ville Mäkelä. 2021. Diegetic and non-diegetic health interfaces in VR shooter games. In IFIP Conference on Human-Computer Interaction. Springer, 3–11.Google ScholarDigital Library
- Rikard Küller, Byron Mikellides, and Jan Janssens. 2009. Color, arousal, and performance—A comparison of three experiments. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur 34, 2 (2009), 141–152.Google Scholar
- Joung Huem Kwon, John Powell, and Alan Chalmers. 2013. How Level of Realism Influences Anxiety in Virtual Reality Environments for a Job Interview. Int. J. Hum.-Comput. Stud. 71, 10 (Oct. 2013), 978–987. https://doi.org/10.1016/j.ijhcs.2013.07.003Google ScholarDigital Library
- Pontus Larsson, Daniel Västfjäll, Pierre Olsson, Mendel Kleiner, 2007. When what you hear is what you see: Presence and auditory-visual integration in virtual environments. In Proceedings of the 10th annual international workshop on presence. 11–18.Google Scholar
- Ruby Lipson-Smith, Julie Bernhardt, Edoardo Zamuner, Leonid Churilov, Nick Busietta, and Damian Moratti. 2020. Exploring colour in context using Virtual Reality: Does a room change how you feel?Virtual Reality (2020), 1–15.Google Scholar
- Virginia I Lohr and Caroline H Pearson-Mims. 2000. Physical discomfort may be reduced in the presence of interior plants. HortTechnology 10, 1 (2000), 53–58.Google ScholarCross Ref
- Virginia I Lohr and Caroline H Pearson-Mims. 2006. Responses to scenes with spreading, rounded, and conical tree forms. Environment and Behavior 38, 5 (2006), 667–688.Google ScholarCross Ref
- Colin MacLeod, Lynlee Campbell, Elizabeth Rutherford, and Edward Wilson. 2004. The causal status of anxiety-linked attentional and interpretive bias. Cognition, emotion and psychopathology: Theoretical, empirical and clinical directions 172 (2004), 189.Google Scholar
- Kayvan Madani Nejad. 2007. Curvilinearity in architecture: Emotional effect of curvilinear forms in interior design. Ph.D. Dissertation. Texas A&M University.Google Scholar
- Ville Mäkelä, Rivu Radiah, Saleh Alsherif, Mohamed Khamis, Chong Xiao, Lisa Borchert, Albrecht Schmidt, and Florian Alt. 2020. Virtual Field Studies: Conducting Studies on Public Displays in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376796Google ScholarDigital Library
- Federica Marcolin, Giulia Wally Scurati, Luca Ulrich, Francesca Nonis, Enrico Vezzetti, Nicolò Dozio, and Francesco Ferrise. 2021. Affective Virtual Reality: How to Design Artificial Experiences Impacting Human Emotions. IEEE Computer Graphics and Applications 41, 6 (2021), 171–178. https://doi.org/10.1109/MCG.2021.3115015Google ScholarCross Ref
- Francis T McAndrew. 2020. The psychology, geography, and architecture of horror: how places creep us out. Evolutionary Studies in Imaginative Culture 4, 2 (2020), 47–62.Google ScholarCross Ref
- Joan Meyers-Levy and Rui Zhu. 2007. The influence of ceiling height: The effect of priming on the type of processing that people use. Journal of consumer research 34, 2 (2007), 174–186.Google ScholarCross Ref
- Michael Nebeling and Maximilian Speicher. 2018. The trouble with augmented reality/virtual reality authoring tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 333–337.Google ScholarCross Ref
- Sebastian Oberdörfer, David Heidrich, and Marc Erich Latoschik. 2019. Usability of Gamified Knowledge Learning in VR and Desktop-3D. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300405Google ScholarDigital Library
- Daniel Oberfeld and Lisa Wilms. 2015. Effects of color on emotion: Evidence from self-report ratings and physiological measures. (2015).Google Scholar
- Vanessa Okken, Thomas Van Rompay, and Ad Pruyn. 2013. Room to move: On spatial constraints and self-disclosure during intimate conversations. Environment and behavior 45, 6 (2013), 737–760.Google ScholarCross Ref
- Frank E Ritter, Jong W Kim, Jonathan H Morgan, and Richard A Carlson. 2012. Running behavioral studies with human participants: A practical guide. Sage Publications.Google Scholar
- Giuseppe Riva, Fabrizia Mantovani, Claret Samantha Capideville, Alessandra Preziosa, Francesca Morganti, Daniela Villani, Andrea Gaggioli, Cristina Botella, and Mariano Alcañiz. 2007. Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychology & behavior 10, 1 (2007), 45–56.Google Scholar
- Radiah Rivu, Ruoyu Jiang, Ville Mäkelä, Mariam Hassib, and Florian Alt. 2021. Emotion Elicitation Techniques in Virtual Reality. In IFIP Conference on Human-Computer Interaction. Springer, 93–114.Google Scholar
- Robert S Rubin, David C Munz, and William H Bommer. 2005. Leading from within: The effects of emotion recognition and personality on transformational leadership behavior. Academy of management journal 48, 5 (2005), 845–858.Google Scholar
- James A Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6 (1980), 1161.Google Scholar
- Sally V Russell, C William Young, Kerrie L Unsworth, and Cheryl Robinson. 2017. Bringing habits and emotions into food waste behaviour. Resources, Conservation and Recycling 125 (2017), 107–114.Google ScholarCross Ref
- Rohit Priyadarshi Sanatani. 2019. An Empirical Inquiry into the Affective Qualities of Virtual Spatial Enclosures in Head Mounted Display driven VR Systems. Virtually Real: Immersing into the Unbuilt. Proceedings of the 7th eCAADe ….Google Scholar
- Norbert Schwarz. 2000. Emotion, cognition, and decision making. Cognition & Emotion 14, 4 (2000), 433–440.Google ScholarCross Ref
- Valentin Schwind, Pascal Knierim, Nico Haas, and Niels Henze. 2019. Using Presence Questionnaires in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300590Google ScholarDigital Library
- Avishag Shemesh, Ronen Talmon, Ofer Karp, Idan Amir, Moshe Bar, and Yasha Jacob Grobman. 2017. Affective response to architecture–investigating human reaction to spaces with different geometry. Architectural Science Review 60, 2 (2017), 116–125.Google ScholarCross Ref
- James S Spiegel. 2018. The ethics of virtual reality technology: social hazards and public policy recommendations. Science and engineering ethics 24, 5 (2018), 1537–1550.Google Scholar
- Arthur E Stamps III. 2011. Effects of area, height, elongation, and color on perceived spaciousness. Environment and Behavior 43, 2 (2011), 252–273.Google ScholarCross Ref
- A. Steed, S. Frlston, M. M. Lopez, J. Drummond, Y. Pan, and D. Swapp. 2016. An ‘In the Wild’ Experiment on Presence and Embodiment using Consumer Virtual Reality Equipment. IEEE Transactions on Visualization and Computer Graphics 22, 4 (2016), 1406–1414. https://doi.org/10.1109/TVCG.2016.2518135Google ScholarDigital Library
- Jeanine K Stefanucci and Justin Storbeck. 2009. Don’t look down: Emotional arousal elevates height perception.Journal of Experimental Psychology: General 138, 1 (2009), 131.Google Scholar
- Xuan Sun, Wenting Yang, Tao Sun, and Ya Ping Wang. 2019. Negative emotion under haze: An investigation based on the microblog and weather records of Tianjin, China. International journal of environmental research and public health 16, 1 (2019), 86.Google Scholar
- Roger S. Ulrich. 1984. View Through a Window May Influence Recovery from Surgery. Science 224, 4647 (1984), 420–421. https://doi.org/10.1126/science.6143402Google ScholarCross Ref
- Nadine Wagener, Jasmin Niess, Yvonne Rogers, and Johannes Schöning. 2022. Mood Worlds: A Virtual Environment for Autonomous Emotional Expression. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 22, 16 pages. https://doi.org/10.1145/3491102.3501861Google ScholarDigital Library
- K. Walczak and W. Cellary. 2003. X-VRML for advanced virtual reality applications. Computer 36, 3 (2003), 89–92. https://doi.org/10.1109/MC.2003.1185226Google ScholarDigital Library
- Shangfei Wang and Rui Ding. 2012. A qualitative and quantitative study of color emotion using valence-arousal. Frontiers of Computer Science 6, 4 (2012), 469–476.Google Scholar
- Angela Wright. 1995. The beginner’s guide to colour psychology. Kyle Cathie Ltd.Google Scholar
- Tong Xue, Abdallah El Ali, Tianyi Zhang, Gangyi Ding, and Pablo Cesar. 2021. RCEA-360VR: Real-Time, Continuous Emotion Annotation in 360° VR Videos for Collecting Precise Viewport-Dependent Ground Truth Labels. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 513, 15 pages. https://doi.org/10.1145/3411764.3445487Google ScholarDigital Library
- Wanlu Yang, Kai Makita, Takashi Nakao, Noriaki Kanayama, Maro G Machizawa, Takafumi Sasaoka, Ayako Sugata, Ryota Kobayashi, Ryosuke Hiramoto, Shigeto Yamawaki, 2018. Affective auditory stimulus database: An expanded version of the International Affective Digitized Sounds (IADS-E). Behavior Research Methods 50, 4 (2018), 1415–1429.Google ScholarCross Ref
- Lei Zhang and Steve Oney. 2020. FlowMatic: An Immersive Authoring Tool for Creating Interactive Scenes in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 342–353. https://doi.org/10.1145/3379337.3415824Google ScholarDigital Library
- Jing Zhu and Paul Thagard. 2002. Emotion and Action. Philosophical Psychology 15, 1 (2002), 19–36. https://doi.org/10.1080/09515080120109397Google ScholarCross Ref
Index Terms
- How Are Your Participants Feeling Today? Accounting For and Assessing Emotions in Virtual Reality
Recommendations
Emotion Elicitation Techniques in Virtual Reality
Human-Computer Interaction – INTERACT 2021AbstractIn this paper, we explore how state-of-the-art methods of emotion elicitation can be adapted in virtual reality (VR). We envision that emotion research could be conducted in VR for various benefits, such as switching study conditions and settings ...
How do emotions elicited in virtual reality affect our memory? A systematic review
AbstractEmotion has been shown to have a significant influence on memory. However, most of the investigations that led to this conclusion used non-virtual reality procedures. Virtual reality, as an emotional medium, is suitable for the study ...
Highlights- Studies investigating how emotions affect memory using VR range from basic (e.g., episodic memories) to applied research.
Can Virtual Reality Increase Emotional Responses (Arousal and Valence)? A Pilot Study
Proceedings of the Third International Conference on Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments - Volume 8518Emotions in the context of UX are generally evaluated in regard to product appearance and sensorial experience. The use of virtual reality can be a way to study UX in consumer products. We want to evaluate if we could increase emotional responses using ...
Comments