Miki Liu
Skip Abstract Section
Abstract
In this paper we present ReactionBot, a system that attaches emoji based on users' facial expressions to text messages on Slack. Through a study of 16 dyads, we found that ReactionBot was able to help communicate participants' affect, reducing the need for participants to self-react with emoji during conversations. However, contrary to our hypothesis, ReactionBot reduced social presence (behavioral interdependence) between dyads. Post study interviews suggest that the emotion feedback through ReactionBot indeed provided valuable nonverbal cues: offered more genuine feedback, and participants were more aware of their own emotions. However, this can come at the cost of increasing anxiety from concerns about negative emotion leakage. Further, the more active role of the system in facilitating the conversation can also result in unwanted distractions and may have attributed to the reduced sense of behavioral interdependence. We discuss implications for utilizing this type of cues in text-based communication.
- Frank Biocca, Chad Harms, and Judy K. Burgoon. (2003). Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators & virtual environments, 12(5), 456--480. Google Scholar
Digital Library
- Frank Biocca, Chad Harms, and Jenn Gregg. (2001, May). The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual international workshop on presence, Philadelphia, PA (pp. 1--9).Google Scholar
- Sara A. Bly, Steven Harrison, and Susan Irwin. (1993). Media spaces: bringing people together in a video, audio, and computing environment. Communications of the ACM, 36(1), 28--46. Google ScholarDigital Library
- Judy K. Bugoon, David D. Buller, and W. Gill Woodall. (1996). Nonverbal communication: The unspoken dialogue.Google Scholar
- V. Orengo Castellá, A.M. Zornoza Abad, F. Prieto Alonso, and J.M. Peiro Silla. (2000). The influence of familiarity among group members, group atmosphere and assertiveness on uninhibited behavior through three different communication media. Computers in Human Behavior, 16(2), 141--159.Google ScholarCross Ref
- Richard L. Daft, and Robert H. Lengel. (1986). Organizational information requirements, media richness and structural design. Management science, 32(5), 554--571.Google Scholar
- Daantje Derks, Arjan ER Bos, and Jasper Von Grumbkow. (2007). Emoticons and social interaction on the Internet: the importance of social context. Computers in human behavior, 23(1), 842--849.Google Scholar
- Judith Donath. (2007). Signals in social supernets. Journal of Computer-Mediated Communication, 13(1), 231--251. Google ScholarDigital Library
- Paul Ekman, and Wallace V. Friesen. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. semiotica, 1(1), 49--98.Google Scholar
- Nicole Ellison, Rebecca Heino, and Jennifer Gibbs. (2006). Managing impressions online: Self-presentation processes in the online dating environment. Journal of computer-mediated communication, 11(2), 415--441.Google ScholarCross Ref
- Emotion API Preview. Microsoft Azure.Google Scholar
- Scott E. Fahlman. (n.d.). Smiley Lore :-).Google Scholar
- Jackson Feijó Filho, Thiago Valle, and Wilson Prata. (2014, September). Non-verbal communications in mobile text chat: emotion-enhanced mobile chat. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (pp. 443--446). ACM. Google ScholarDigital Library
- Mark G. Frank, Paul Ekman, and Wallace V. Friesen. (1993). Behavioral markers and recognizability of the smile of enjoyment. Journal of personality and social psychology, 64(1), 83.Google ScholarCross Ref
- Tina Ganster, Sabrina C. Eimler, and Nicole C. Krämer. (2012). Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking, 15(4), 226--230.Google ScholarCross Ref
- Ella Glikson, Arik Cheshin, and Gerben A. van Kleef. (2017). The dark side of a smiley: Effects of smiling emoticons on virtual first impressions. Social Psychological and Personality Science, 9(5), 614--625.Google ScholarCross Ref
- Charlotte N. Gunawardena, and Frank J. Zittle. (1997). Social presence as a predictor of satisfaction within a computer-mediated conferencing environment. American journal of distance education, 11(3), 8--26.Google Scholar
- Jay Hall, and Wilfred Harvey Watson. (1970). The effects of a normative intervention on group decision-making performance. Human relations, 23(4), 299--317.Google Scholar
- Albert H. Huang, David C. Yen, and Xiaoni Zhang. (2008). Exploring the potential effects of emoticons. Information & Management, 45(7), 466--473. Google ScholarDigital Library
- Scott E. Hudson, and Ian Smith. (1996, November). Techniques for addressing fundamental privacy and disruption tradeoffs in awareness support systems. In Proceedings of the 1996 ACM conference on Computer supported cooperative work (pp. 248--257). ACM. Google ScholarDigital Library
- Benjamin Kehrwald. (2008). Understanding social presence in text-based online learning environments. Distance Education, 29(1), 89--106.Google ScholarCross Ref
- Ryan Kelly, and Leon Watts. (2015). Characterising the inventive appropriation of emoji as relationally meaningful in mediated close personal relationships. Experiences of Technology Appropriation: Unanticipated Users, Usage, Circumstances, and Design.Google Scholar
- Adam Kendon. (1987). Speaking and signing simultaneously in Warlpiri sign language users. Multilingua-Journal of Cross-Cultural and Interlanguage Communication, 6(1), 25--68. Google ScholarDigital Library
- Joon Young Lee, Nahi Hong, Soomin Kim, Jonghwan Oh, and Joonhwan Lee. (2016, September). Smiley face: why we use emoticon stickers in mobile messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (pp. 760--766). ACM. Google ScholarDigital Library
- Shao-Kang Lo. (2008). The nonverbal communication functions of emoticons in computer-mediated communication. CyberPsychology & Behavior, 11(5), 595--597.Google ScholarCross Ref
- Katja Lohmann, Sebastian Stefan Pyka, and Cornelia Zanger. (2017). The effects of smileys on receivers' emotions. Journal of Consumer Marketing, 34(6), 489--495Google ScholarCross Ref
- Alexandra Martins, Nelson Ramalho, and Estelle Morin. (2010). A comprehensive meta-analysis of the relationship between emotional intelligence and health. Personality and individual differences, 49(6), 554--564.Google Scholar
- Lee-Ellen Marvin, L. (1995). Spoof, spam, lurk, and lag: The aesthetics of text-based virtual realities. Journal of Computer-Mediated Communication, 1(2), JCMC122.Google Scholar
- Hannah Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac Johnson, Loren Terveen, and Brent Hecht. (2016). Blissfully happy" or "ready to fight": Varying Interpretations of Emoji. In Proceedings of ICWSM, 2016.Google Scholar
- Mariella Moon. (2016). Instagram takes a serious look at how people use emojis. https://www.engadget.com/2015/05/02/instagram-emoji-study/Google Scholar
- Alena Neviarouskaya, Helmut Prendinger, and Mitsuru Ishizuka. (2010). User study on AffectIM, an avatar-based Instant Messaging system employing rule-based affect sensing from text. International Journal of Human-Computer Studies, 68(7), 432--450. Google ScholarDigital Library
- Kostantinos V. Petrides, Norah Frederickson, and Adrian Furnham. (2004). The role of trait emotional intelligence in academic performance and deviant behavior at school. Personality and individual differences, 36(2), 277--293.Google Scholar
- Lynne D. Roberts, Leigh M. Smith, and Clare Pollock. (1996). Exploring virtuality: Telepresence in text-based virtual environments.Google Scholar
- Peter Salovey, and John D. Mayer. (1990). Emotional intelligence. Imagination, cognition and personality, 9(3), 185--211.Google Scholar
- Craig Smith. (2018, March 31). 50 interesting Slack Statistics. https://expandedramblings.com/index.php/slack-statistics/Google Scholar
- Leslie D. Setlock, Susan R. Fussell, and Christine Neuwirth. (2004, November). Taking it out of context: collaborating within and across cultures in face-to-face settings and via instant messaging. In Proceedings of the 2004 ACM conference on Computer supported cooperative work (pp. 604--613). ACM. Google ScholarDigital Library
- Adam Stembergh, A. (2014). Smile, You're Speaking Emoji: The Rapid Evolution of a Wordless Tongue.Google Scholar
- Satomi Sugiyama. (2015). Kawaii meiru and Maroyakaneko: Mobile emoji for relationship maintenance and aesthetic expressions among Japanese teens. First Monday 20, 10 (2015).Google Scholar
- Alan Swinkels, and Traci A. Giuliano. (1995). The measurement and conceptualization of mood awareness: Monitoring and labeling one's mood states. Personality and social psychology bulletin, 21(9), 934--949.Google Scholar
- Sonja Utz. (2000). Social information processing in MUDs: The development of friendships in virtual worlds. Journal of online behavior.Google Scholar
- Hannes Högni Vilhjálmsson, & Justine Cassell. (1998, May). Bodychat: Autonomous communicative behaviors in avatars. In Proceedings of the second international conference on Autonomous agents (pp. 269--276). ACM. Google ScholarDigital Library
- Joseph B. Walther. (1993). Impression development in computer-mediated interaction. Western Journal of Communication (includes Communication Reports), 57(4), 381--398.Google Scholar
- Joseph B. Walther. Relational aspects of computer-mediated communication: Experimental observations over time. Organization Science 6: 189--203, 1995. Google ScholarDigital Library
- Joseph B. Walther. (2008). Social information processing theory. Engaging theories in interpersonal communication: Multiple perspectives, 391--404.Google Scholar
- Joseph B. Walther. (2011). Theories of computer-mediated communication and interpersonal relations. The handbook of interpersonal communication, 4, 443--479.Google Scholar
- Joseph B. Walther, and Kyle P. D'Addario. (2001). The impacts of emoticons on message interpretation in computer-mediated communication. Social science computer review, 19(3), 324--347.Google Scholar
- Joseph B. Walther, and Malcolm R. Parks. (2002). Cues filtered out, cues filtered in. Handbook of interpersonal communication, 3, 529--563.Google Scholar
- Steve Whittaker. (2003). Theories and Methods in Mediated Communication: Steve Whittaker. In Handbook of discourse processes (pp. 246--289). Routledge.Google Scholar
- Youngjin Yoo, and Maryam Alavi. (2001). Media and group cohesion: Relative influences on social presence, task participation, and group consensus. MIS quarterly, 371--390. Google ScholarDigital Library
- Rui Zhou, Jasmine Hentschel, and Neha Kumar. (2017, May). Goodbye text, hello emoji: mobile communication on wechat in China. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (pp. 748--759). ACM. Google ScholarDigital Library
- Robert W. Zmud, Mary R. Lind, and Forrest W. Young. (1990). An attribute space for organizational communication channels. Information systems research, 1(4), 440--457. Google ScholarDigital Library
Index Terms
- ReactionBot: Exploring the Effects of Expression-Triggered Emoji in Text Messages
Recommendations
The communicative role of non-face emojis
Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...
I'm sad you're sad: emotional contagion in CMC
CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative workAn enduring assumption about computer-mediated communication is that it undermines emotional understanding. The present study examined emotional communication in CMC by inducing negative affect in one condition and neutral affect in another. The results ...
Is chatting with a sophisticated chatbot as good as chatting online or FTF with a stranger?
AbstractEmotionally-responsive chatbots are marketed as agents with which one can form emotional connections. They can also become weak ties in the outer layers of one's acquaintance network and available for social support. In this experiment,...
Highlights- Adults had positive reactions after talking to the emotionally responsive Replika chatbot.
Comments