Radha Kumaran
ABSTRACT
While online forums provide a convenient platform for people to interact anonymously with others who share similar interests, they have to deal with large amounts of hate speech and inappropriate content, often posted by users in the heat of the moment. This can have a negative impact on the psychological state of other forum users and moderators, who are tasked to identify and delete such content. We investigate a preventative approach to this problem with the design of EChat, a proof-of-concept augmentation to online forums that helps users attend to their emotional state. The user’s current emotional state is detected using facial emotion recognition, and the aesthetics of the UI are adapted to reflect this emotion. In case of an emotion with negative valence such as anger or sadness, the UI aesthetic is gradually transitioned to one that evokes a more positive emotion. Semi-structured interviews with EChat users confirm the potential of emotion-aware design to reduce hateful content, and also highlight important design considerations.
Supplemental Material
Available for Download
zip
- Jussi Ängeslevä, Carson Reynolds, and Sile O’Modhrain. 2004. EmoteMail. In ACM SIGGRAPH 2004 Posters. 9.Google Scholar
- Lisa Feldman Barrett and James J Gross. 2001. Emotional intelligence: A process model of emotion representation and regulation. (2001).Google Scholar
- Upasna Bhandari, Klarissa Chang, and Tillmann Neben. 2019. Understanding the impact of perceived visual aesthetics on user evaluations: An emotional perspective. Information & management 56, 1 (2019), 85–93.Google Scholar
- Reuben Binns, Michael Veale, Max Van Kleek, and Nigel Shadbolt. 2017. Like trainer, like bot? Inheritance of bias in algorithmic content moderation. In International conference on social informatics. Springer, 405–415.Google ScholarCross Ref
- Iris Birman. 2018. Moderation in different communities on Reddit–A qualitative analysis study. (2018).Google Scholar
- Svenja Boberg, Tim Schatto-Eckrodt, Lena Frischlich, and Thorsten Quandt. 2018. The moral gatekeeper? Moderation and deletion of user-generated content in a leading news forum. Media and Communication 6, 4 (2018), 58–69.Google ScholarCross Ref
- Moira Burke and Robert E Kraut. 2014. Growing closer on Facebook: Changes in tie strength through social network site use. In Proceedings of the SIGCHI conference on human factors in computing systems. 4187–4196.Google ScholarDigital Library
- Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A cross-community learning-based system to assist reddit moderators. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–30.Google ScholarDigital Library
- Bryan Dosono and Bryan Semaan. 2019. Moderation practices as emotional labor in sustaining online communities: The case of AAPI identity work on Reddit. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–13.Google ScholarDigital Library
- Robert Gorwa, Reuben Binns, and Christian Katzenbach. 2020. Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society 7, 1 (2020), 2053951719897945.Google ScholarCross Ref
- Miriam Greenberg. 2019. A Study of Community Engagement on Discord for Game Marketing-Case TJR Games Oy. (2019).Google Scholar
- Michelle CP Hendriks and Ad JJM Vingerhoets. 2006. Social messages of crying faces: Their influence on anticipated person perception, emotions and behavioural responses. Cognition and Emotion 20, 6 (2006), 878–886.Google ScholarCross Ref
- Jesús Ibáñez. 2011. Minimalist approach to show emotions via a flock of smileys. Journal of network and computer applications 34, 4 (2011), 1283–1291.Google ScholarDigital Library
- Jesús Ibáñez and Carlos Delgado-Mata. 2013. Can the same Visual Modality Express Arousal or Valence Depending on the other Modalities it is Combined with?Procedia Technology 7 (2013), 424–435.Google Scholar
- Yubo Kou and Xinning Gui. 2021. Flag and Flaggability in Automated Moderation: The Case of Reporting Toxic Behavior in an Online Game Community. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.Google ScholarDigital Library
- Yanran Li, Hui Su, Xiaoyu Shen, Wenjie Li, Ziqiang Cao, and Shuzi Niu. 2017. Dailydialog: A manually labelled multi-turn dialogue dataset. arXiv preprint arXiv:1710.03957 (2017).Google Scholar
- Mainack Mondal, Leandro Araújo Silva, and Fabrício Benevenuto. 2017. A measurement study of hate speech in social media. In Proceedings of the 28th ACM conference on hypertext and social media. 85–94.Google ScholarDigital Library
- Erik C Nook, Kristen A Lindquist, and Jamil Zaki. 2015. A new look at emotion perception: Concepts speed and shape facial emotion recognition.Emotion 15, 5 (2015), 569.Google Scholar
- Leonhard Oberascher and Michael Gallmetzer. 2003. Colour and emotion. In Proceedings of AIC. 370–374.Google Scholar
- Omkar M Parkhi, Andrea Vedaldi, and Andrew Zisserman. 2015. Deep face recognition. (2015).Google Scholar
- Robert Plutchik. 2001. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American scientist 89, 4 (2001), 344–350.Google ScholarCross Ref
- James A Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6 (1980), 1161.Google Scholar
- Koustuv Saha, Eshwar Chandrasekharan, and Munmun De Choudhury. 2019. Prevalence and psychological effects of hateful speech in online college communities. In Proceedings of the 10th ACM conference on web science. 255–264.Google ScholarDigital Library
- J Alfredo Sánchez, Norma P Hernández, Julio C Penagos, and Yulia Ostróvskaya. 2006. Conveying mood and emotion in instant messaging by using a two-dimensional model for affective states. In Proceedings of VII Brazilian symposium on Human factors in computing systems. 66–72.Google ScholarDigital Library
- Shabnoor Siddiqui, Tajinder Singh, 2016. Social media its impact with positive and negative aspects. International journal of computer applications technology and research 5, 2 (2016), 71–75.Google ScholarCross Ref
- Paul J Silvia and Christopher M Barona. 2009. Do people prefer curved objects? Angularity, expertise, and aesthetic preference. Empirical studies of the arts 27, 1 (2009), 25–42.Google Scholar
- Miriah Steiger, Timir J Bharucha, Sukrit Venkatagiri, Martin J Riedl, and Matthew Lease. 2021. The psychological well-being of content moderators: the emotional labor of commercial moderation and avenues for improving support. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–14.Google ScholarDigital Library
- Alistair Sutcliffe. 2009. Designing for user engagement: Aesthetic and attractive user interfaces. Synthesis lectures on human-centered informatics 2, 1 (2009), 1–55.Google ScholarDigital Library
- Madeline Toubiana and Charlene Zietsma. 2017. The message is on the wall? Emotions, social media and the dynamics of institutional complexity. Academy of Management Journal 60, 3 (2017), 922–953.Google ScholarCross Ref
- Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. " At the End of the Day Facebook Does What ItWants" How Users Experience Contesting Algorithmic Content Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1–22.Google Scholar
- Emily Van der Nagel and Jordan Frith. 2015. Anonymity, pseudonymity, and the agency of online identity: Examining the social practices of r/Gonewild. First Monday (2015).Google Scholar
- Jian Wang and Yen Hsu. 2020. The relationship of symmetry, complexity, and shape in mobile interface aesthetics, from an emotional perspective—A case study of the smartwatch. Symmetry 12, 9 (2020), 1403.Google ScholarCross Ref
- Sandy Wolfson and Gill Case. 2000. The effects of sound and colour on responses to a computer game. Interacting with computers 13, 2 (2000), 183–192.Google Scholar
Index Terms
- EChat: An Emotion-Aware Adaptive UI for a Messaging App
Recommendations
A comparison of students' emotional self-reports with automated facial emotion recognition in a reading situation
TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing MulticulturalityThis study investigated the measurement of students' emotional states during a common learning activity, digital reading of factual texts. The objective was to compare emotional self-reports with automated facial emotion recognition. The latter promises ...
Exploring social and temporal dimensions of emotion induction using an adaptive affective mirror
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing SystemsThis paper investigates if and how a digital, interactive affective mirror induces positive emotions in participants. We study whether the induced affect is repeatable after a fixed interval (Study 1) and how the social presence affects the emotion ...
Emotion-aware Multi-view Contrastive Learning for Facial Emotion Recognition
Computer Vision – ECCV 2022AbstractWhen a person recognizes another’s emotion, he or she recognizes the (facial) features associated with emotional expression. So, for a machine to recognize facial emotion(s), the features related to emotional expression must be represented and ...
Comments