skip to main content
10.1145/3638067.3638132acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

A Socioenactive Perspective on Emotion Contagion and Senses: Analyzing the Phenomenon via EEG Signals

Published:24 January 2024Publication History

ABSTRACT

Emotion contagion is a phenomenon in which emotions are transmitted from one to another in social interactions. In this process, our senses are involved because our body perceives the environment through them. Many activities are triggered between our mind, body, and the space around us involving sensory-motor, perception, and cognition aspects. All the aforementioned aspects are studied by the Socioenactive perspective in the frame of relationships connecting the social, physical, and digital worlds. This research explores the Socioenactive perspective into the emotion contagion phenomenon in the interaction with computational systems. Our study used an EEG device to collect brain wave data from 21 participants in a scenario of potential emotional contagion. Our analysis adopted the Transform Fourier technique to get features in brain wavelets of happiness, fear, anger, and sadness emotional states. The brain waves analysis considering the amplitude and frequency allows for finding features associated with each kind of emotional state. A post-experiment questionnaire was used to gather self-reported emotional states from participants. We investigated the relations between emotional states data gathered by the self-report and by brain waves directly. The results shown through the self-report and brain waves indicate that 71% of participants felt the happiness emotion; 38% of participants felt the sadness emotion; the fear and anger emotion resulted in 24% and 19% of the cases, respectively.

References

  1. M Cecília C Baranauskas. 2014. Social awareness in HCI. interactions 21, 4 (2014), 66–69.Google ScholarGoogle Scholar
  2. Maria Cecília C Baranauskas. 2015. Sistemas sócio-enativos: investigando novas dimensões no design da interação mediada por tecnologias de informação e comunicação. FAPESP Thematic Project (2015/165280) (2015).Google ScholarGoogle Scholar
  3. M Cecília C Baranauskas, Yusseli Lizeth Méndez Mendoza, and Emanuel Felipe Duarte. 2021. Designing for a socioenactive experience: A case study in an educational workshop on deep time. International Journal of Child-Computer Interaction 29 (2021), 100287.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Hayfa Blaiech, Mohamed Neji, Ali Wali, and Adel M Alimi. 2013. Emotion recognition by analysis of EEG signals. In 13th International Conference on Hybrid Intelligent Systems (HIS 2013). IEEE, 312–318.Google ScholarGoogle ScholarCross RefCross Ref
  5. Ricardo Caceffo, Diego Addan Gonçalves, Rodrigo Bonacin, Julio Cesar dos Reis, José A Valente, and Maria Cecília Calani Baranauskas. 2022. Children’s social interactions within a socioenactive scenario. Computers & Education 176 (2022), 104324.Google ScholarGoogle ScholarCross RefCross Ref
  6. Henry Candra, Mitchell Yuwono, Ardi Handojoseno, Rifai Chai, Steven Su, and Hung T Nguyen. 2015. Recognizing emotions from EEG subbands using wavelet analysis. In 2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, 6030–6033.Google ScholarGoogle Scholar
  7. Tom Clarke and Alan Costall. 2008. The emotional connotations of color: A qualitative investigation. Color Research & Application: Endorsed by Inter-Society Color Council, The Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur 33, 5 (2008), 406–410.Google ScholarGoogle Scholar
  8. Giovanna Colombetti. 2017. Enactive affectivity, extended. Topoi 36, 3 (2017), 445–455.Google ScholarGoogle ScholarCross RefCross Ref
  9. José Valderlei da Silva, Vanessa RML Maike, Luã M Muriana, Camilla VLT Brennand, Roberto Pereira, Tânia Lima, and Maria Cecília C Baranauskas. 2019. Explorando afeto e sócioenaçao no cenário de um hospital. Technical Report. Technical Report IC-19-02. Institute of Computing, University of Campinas.Google ScholarGoogle Scholar
  10. Emanuel Felipe Duarte and M Cecília C Baranauskas. 2018. Interart: Learning human-computer interaction through the making of interactive art. In Human-Computer Interaction. Theories, Methods, and Human Issues: 20th International Conference, HCI International 2018, Las Vegas, NV, USA, July 15–20, 2018, Proceedings, Part I 20. Springer, 35–54.Google ScholarGoogle Scholar
  11. Emanuel Felipe Duarte, Vanessa Maike, Yusseli Lizeth Méndez Mendoza, Camilla Brennand, and M Cecília Baranauskas. 2019. " The Magic of Science:" Beyond Action, a Case Study on Learning Through Socioenaction. In Anais do XXV Workshop de Informática na Escola. SBC, 501–510.Google ScholarGoogle Scholar
  12. Emanuel Felipe Duarte, VRML Maike, Yusseli Lizeth Méndez Mendoza, Camilla Valéria de Lima Tenório, and M Cecília C Baranauskas. 2019. A hands-on experience with interactive art within a museum scenario. Technical Report. Technical Report IC-19-03, Institute of Computing (IC), University of ….Google ScholarGoogle Scholar
  13. Geovanna Evelyn Taype Espinoza and Maria Cecilia Calani Baranauskas. 2020. Designing Socially-Aware Persuasive Systems: a Proposed Framework. In Anais do XLVII Seminário Integrado de Software e Hardware. SBC, 234–245.Google ScholarGoogle Scholar
  14. Geovanna Evelyn Taype Espinoza and Maria Cecília Calani Baranauskas. 2020. Motivation, persuasion and healthy eating: a case study on a socially-aware persuasive system design. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Thomas Fuchs. 2017. Ecology of the brain: The phenomenology and biology of the embodied mind. Oxford University Press.Google ScholarGoogle Scholar
  16. Jennifer Marie Binzak Fugate and Courtny L Franco. 2019. What color is your anger? Assessing color-emotion pairings in English speakers. Frontiers in Psychology (2019), 206.Google ScholarGoogle Scholar
  17. Diego Addan Gonçalves, Ricardo Edgard Caceffo, and Maria Cecilia Calani Baranauskas. 2021. Analysis of Emotion in Socioenactive Systems. In Human-Computer Interaction. Theory, Methods and Tools: Thematic Area, HCI 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part I 23. Springer, 535–544.Google ScholarGoogle Scholar
  18. Elaine Hatfield, John T Cacioppo, and Richard L Rapson. 1993. Emotional contagion. Current directions in psychological science 2, 3 (1993), 96–100.Google ScholarGoogle Scholar
  19. Carolina Herrando and Efthymios Constantinides. 2021. Emotional contagion: a brief overview and future directions. Frontiers in psychology 12 (2021), 712606.Google ScholarGoogle Scholar
  20. Tim Ingold. 2011. Being alive: Essays on movement, knowledge and description. Routledge.Google ScholarGoogle Scholar
  21. Yuuna ISHIKAMI and Hisaya TANAKA. 2022. Emotional Contagion and Mirror System Activity in the Highly Sensitive Person. In International Symposium on Affective Science and Engineering ISASE2022. Japan Society of Kansei Engineering, 1–4.Google ScholarGoogle Scholar
  22. Noppadon Jatupaiboon, Setha Pan-Ngum, and Pasin Israsena. 2013. Real-time EEG-based happiness detection system. The Scientific World Journal 2013 (2013).Google ScholarGoogle Scholar
  23. Mauri Kaipainen, Niklas Ravaja, Pia Tikka, Rasmus Vuori, Roberto Pugliese, Marco Rapino, and Tapio Takala. 2011. Enactive systems and enactive media: embodied human-machine coupling beyond interfaces. Leonardo 44, 5 (2011), 433–438.Google ScholarGoogle ScholarCross RefCross Ref
  24. Elizabeth A Kensinger. 2004. Remembering emotional experiences: The contribution of valence and arousal. Reviews in the Neurosciences 15, 4 (2004), 241–252.Google ScholarGoogle ScholarCross RefCross Ref
  25. Christian G Kohler, Travis Turner, Neal M Stolar, Warren B Bilker, Colleen M Brensinger, Raquel E Gur, and Ruben C Gur. 2004. Differences in facial expressions of four universal emotions. Psychiatry research 128, 3 (2004), 235–244.Google ScholarGoogle Scholar
  26. Tian-Hao Li, Wei Liu, Wei-Long Zheng, and Bao-Liang Lu. 2019. Classification of five emotions from EEG and eye movement signals: Discrimination ability and stability over time. In 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 607–610.Google ScholarGoogle ScholarCross RefCross Ref
  27. Vanessa Regina Margareth Lima Maike and M Cecília C Baranauskas. 2019. An Enactive Perspective on Emotion: A Case Study on Monitoring Brainwaves. In Augmented Cognition: 13th International Conference, AC 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings 21. Springer, 418–435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Yusseli Lizeth Méndez Mendoza and M Cecília C Baranauskas. 2021. Designing a tangible tabletop installation and enacting a socioenactive experience with TangiTime. Journal of the Brazilian Computer Society 27, 1 (2021), 1–22.Google ScholarGoogle ScholarCross RefCross Ref
  29. Luã Marcelo Muriana, José Valderlei d Silva, Andressa Cristina dos Santos, and Maria Cecília C Baranauskas. 2019. Affective state, self-esteem and technology: an exploratory study with children in hospital context. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. M Murugappan and Subbulakshmi Murugappan. 2013. Human emotion recognition through short time Electroencephalogram (EEG) signals using Fast Fourier Transform (FFT). In 2013 IEEE 9th International Colloquium on Signal Processing and its Applications. IEEE, 289–294.Google ScholarGoogle Scholar
  31. Leonor Neves, Carolina Cordeiro, Sophie K Scott, São Luís Castro, and César F Lima. 2018. High emotional contagion and empathy are associated with enhanced detection of emotional authenticity in laughter. Quarterly Journal of Experimental Psychology 71, 11 (2018), 2355–2363.Google ScholarGoogle ScholarCross RefCross Ref
  32. Dan Nie, Xiao-Wei Wang, Li-Chen Shi, and Bao-Liang Lu. 2011. EEG-based emotion recognition during watching movies. In 2011 5th International IEEE/EMBS Conference on Neural Engineering. IEEE, 667–670.Google ScholarGoogle ScholarCross RefCross Ref
  33. Becky L Omdahl and Carol O’Donnell. 1999. Emotional contagion, empathic concern and communicative responsiveness as variables affecting nurses’ stress and occupational commitment. Journal of Advanced Nursing 29, 6 (1999), 1351–1359.Google ScholarGoogle ScholarCross RefCross Ref
  34. Jaak Panksepp. 2004. Affective neuroscience: The foundations of human and animal emotions. Oxford university press.Google ScholarGoogle Scholar
  35. Lara Schibelsky G Piccolo, Elaine CS Hayashi, and Maria Cecília C Baranauskas. 2010. The evaluation of affective quality in social software: preliminary thoughts. II WAIHCWS, IHC2010 (2010), 29–38.Google ScholarGoogle Scholar
  36. Jessica Sharmin Rahman, Tom Gedeon, Sabrina Caldwell, and Richard Jones. 2020. Brain melody informatics: analysing effects of music on brainwave patterns. In 2020 international joint conference on neural networks (ijcnn). IEEE, 1–8.Google ScholarGoogle Scholar
  37. Andressa C dos Santos, Luã M Muriana, Josiane ROG Pimenta, José V da Silva, Eliana A Moreira, and Julio C dos Reis. 2019. Investigating aspects of affectibility for universal access in socioenactive system scenarios. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems. 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Laura Sels, Anh Tran, Katharine H Greenaway, Lesley Verhofstadt, and Elise K Kalokerinos. 2021. The social functions of positive emotions. Current Opinion in Behavioral Sciences 39 (2021), 41–45.Google ScholarGoogle ScholarCross RefCross Ref
  39. José Valderlei da Silva and M Cecília C Baranauskas. 2020. Interaction spaces and socioenactive dimensions: exploring perturbations of IoHT. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Geovanna Evelyn Espinoza Taype and Maria Cecilia Baranauskas Calani. 2020. Extending persuasive system design frameworks: an exploratory study. In Information Technology and Systems: Proceedings of ICITS 2020. Springer, 35–45.Google ScholarGoogle ScholarCross RefCross Ref
  41. Amrisha Vaish, Tobias Grossmann, and Amanda Woodward. 2008. Not all emotions are created equal: the negativity bias in social-emotional development.Psychological bulletin 134, 3 (2008), 383.Google ScholarGoogle Scholar
  42. José Armando Valente, Ricardo Caceffo, Rodrigo Bonacin, Julio Cesar dos Reis, Diego Addan Gonçalves, and Maria Cecília Calani Baranauskas. 2021. Embodied-based environment for kindergarten children: Revisiting constructionist ideas. British Journal of Educational Technology 52, 3 (2021), 986–1003.Google ScholarGoogle ScholarCross RefCross Ref
  43. Francisco J Varela, Evan Thompson, and Eleanor Rosch. 2016. The embodied mind: Cognitive science and human experience. MIT press.Google ScholarGoogle Scholar
  44. Minchang Yu, Shasha Xiao, Minlei Hua, Hui Wang, Xi Chen, Feng Tian, and Yingjie Li. 2022. EEG-based emotion recognition in an immersive virtual reality environment: From local activity to brain network features. Biomedical Signal Processing and Control 72 (2022), 103349.Google ScholarGoogle ScholarCross RefCross Ref
  45. Yingying Zhao, Yuhu Chang, Yutian Lu, Yujiang Wang, Mingzhi Dong, Qin Lv, Robert P Dick, Fan Yang, Tun Lu, Ning Gu, 2022. Do Smart Glasses Dream of Sentimental Visions? Deep Emotionship Analysis for Eyewear Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Jia-Yi Zhu, Wei-Long Zheng, Yong Peng, Ruo-Nan Duan, and Bao-Liang Lu. 2014. EEG-based emotion recognition using discriminative graph regularized extreme learning machine. In 2014 International Joint Conference on Neural Networks (IJCNN). IEEE, 525–532.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. A Socioenactive Perspective on Emotion Contagion and Senses: Analyzing the Phenomenon via EEG Signals

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      IHC '23: Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems
      October 2023
      791 pages
      ISBN:9798400717154
      DOI:10.1145/3638067

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 24 January 2024

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate331of973submissions,34%
    • Article Metrics

      • Downloads (Last 12 months)7
      • Downloads (Last 6 weeks)2

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format