Mimi Nguyen
ABSTRACT
While a significant part of communication in the workplace is now happening online, current platforms don’t fully support socio-cognitive nonverbal communication, which hampers the shared understanding and creativity of virtual teams. Given text-based communication being the main channel for virtual collaboration, we propose a novel solution leveraging an AI-based, dynamic affective recognition system. The app provides live feedback about the affective content of the communication in Slack, in the form of a visual representation and percentage breakdown of the ‘sentiment’ (tone, emoji) and main ‘emotion states’ (e.g. joy, anger). We tested the usability of the app in a quasi-experiment with 30 participants from diverse backgrounds, linguistic analysis and user interviews. The findings show that the app significantly increases shared understanding and creativity within virtual teams. Emerged themes included impression formation assisted by affective recognition, supporting long-term relationships development; identified challenges related to transparency and emotional complexity detected by AI.
Supplemental Material
- Ahmad Abdellatif, Khaled Badran, Diego Elias Costa, and Emad Shihab. 2021. A Comparison of Natural Language Understanding Platforms for Chatbots in Software Engineering. arXiv:2012.02640 [cs] (July 2021). http://arxiv.org/abs/2012.02640 arXiv:2012.02640.Google Scholar
- Mike Allen. 2017. The SAGE Encyclopedia of Communication Research Methods. SAGE Publications, Inc, 2455 Teller Road, Thousand Oaks California 91320. https://doi.org/10.4135/9781483381411Google Scholar
- Teresa M Amabile. 1988. A model of creativity and innovation in organizations. Research in organizational behavior 10, 1 (1988), 123–167.Google Scholar
- ARUP. [n.d.]. Drivers of Change. https://foresight.arup.com/our-tools/drivers-of-change/Google Scholar
- Natalya N. Bazarova, Jessie G. Taft, Yoon Hyung Choi, and Dan Cosley. 2013. Managing Impressions and Relationships on Facebook: Self-Presentational and Relational Concerns Revealed Through the Analysis of Language Style. Journal of Language and Social Psychology 32, 2 (June 2013), 121–141. https://doi.org/10.1177/0261927X12456384 Publisher: SAGE Publications Inc.Google ScholarCross Ref
- Ivo Benke, Michael Knierim, and Alexander Maedche. 2020. Chatbot-based Emotion Management for Distributed Teams: A Participatory Design Study. Proceedings of the ACM on Human-Computer Interaction 4 (Oct. 2020). https://doi.org/10.1145/3415189Google ScholarDigital Library
- Michael Brooks, Cecilia R. Aragon, Katie Kuksenok, Megan K. Torkildson, Daniel Perry, John J. Robinson, Taylor J. Scott, Ona Anicello, Ariana Zukowski, and Paul Harris. 2013. Statistical affect detection in collaborative chat. In Proceedings of the 2013 conference on Computer supported cooperative work - CSCW ’13. ACM Press, San Antonio, Texas, USA, 317. https://doi.org/10.1145/2441776.2441813Google ScholarDigital Library
- Rafael A Calvo and Sidney D’Mello. 2010. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Transactions on Affective Computing 1, 1 (Jan. 2010), 18–37. https://doi.org/10.1109/T-AFFC.2010.1Google ScholarDigital Library
- Janis A. Cannon-Bowers, Eduardo Salas, and Sharolyn Converse. 1993. Shared mental models in expert team decision making. In Individual and group decision making: Current issues. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, US, 221–246.Google Scholar
- Kathy Charmaz. 2006. Constructing grounded theory: A practical guide through qualitative analysis. sage.Google Scholar
- Gerald L. Clore and Janet Palmer. 2009. Affective guidance of intelligent agents: How emotion controls cognition. Cognitive Systems Research 10, 1 (March 2009), 21–30. https://doi.org/10.1016/j.cogsys.2008.03.002Google ScholarDigital Library
- Juliet Corbin and Anselm Strauss. 2014. Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage publications.Google Scholar
- Henriette Cramer, Paloma de Juan, and Joel Tetreault. 2016. Sender-intended functions of emojis in US messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 504–509. https://doi.org/10.1145/2935334.2935370Google ScholarDigital Library
- Trudy C. DiLiello, Jeffery D. Houghton, and David Dawley. 2011. Narrowing the creativity gap: the moderating effects of perceived support for creativity. The Journal of Psychology 145, 3 (June 2011), 151–172. https://doi.org/10.1080/00223980.2010.548412Google ScholarCross Ref
- William Easley, Darius McCoy, Shawn Grimes, Steph Grimes, Foad Hamidi, Wayne G Lutters, and Amy Hurst. 2018. Understanding How Youth Employees Use Slack. (2018), 4.Google Scholar
- Tatiana Ermakova, Max Henke, and Benjamin Fabian. 2021. Commercial Sentiment Analysis Solutions: A Comparative Study:. In Proceedings of the 17th International Conference on Web Information Systems and Technologies. SCITEPRESS - Science and Technology Publications, Online Streaming, — Select a Country —, 103–114. https://doi.org/10.5220/0010709400003058Google ScholarCross Ref
- Mohamed Ez-Zaouia, Aurélien Tabard, and Elise Lavoué. 2020. EMODASH: A dashboard supporting retrospective awareness of emotions in online learning. International Journal of Human-Computer Studies 139 (2020), 102411. Publisher: Elsevier.Google ScholarCross Ref
- Jonas Frich, Michael Mose Biskjaer, and Peter Dalsgaard. 2018. Why HCI and Creativity Research Must Collaborate to Develop New Creativity Support Tools. In Proceedings of the Technology, Mind, and Society. ACM, Washington DC USA, 1–6. https://doi.org/10.1145/3183654.3183678Google ScholarDigital Library
- Gartner. 2021. Magic Quadrant for Data Science and Machine Learning Platforms. https://www.gartner.com/doc/reprints?id=1-25DOZD29&ct=210304&st=sbGoogle Scholar
- Cristina B. Gibson, Patrick D. Dunlop, Ann Majchrzak, and Terence Chia. 2021. Sustaining Effectiveness in Global Teams: The Coevolution of Knowledge Management Activities and Technology Affordances. Organization Science (Aug. 2021). https://doi.org/10.1287/orsc.2021.1478 Publisher: INFORMS.Google Scholar
- Barney G Glaser and Anselm L Strauss. 1967. The discovery of grounded theory: strategies for qualitative research. OCLC: 253912.Google Scholar
- Homer. 1998. The Iliad. Oxford University Press. Google-Books-ID: OT9pj8chUbQC.Google Scholar
- Lauren J. Human, Gillian M. Sandstrom, Jeremy C. Biesanz, and Elizabeth W. Dunn. 2013. Accurate First Impressions Leave a Lasting Impression: The Long-Term Effects of Distinctive Self-Other Agreement on Relationship Development. Social Psychological and Personality Science 4, 4 (July 2013), 395–402. https://doi.org/10.1177/1948550612463735 Publisher: SAGE Publications Inc.Google ScholarCross Ref
- Jeroen Janssen, Gijsbert Erkens, Gellof Kanselaar, and Jos Jaspers. 2007. Visualization of participation: Does it contribute to successful computer-supported collaborative learning?Computers & Education 49, 4 (2007), 1037–1065. Publisher: Elsevier.Google Scholar
- Karen A Jehn. 1995. A multimethod examination of the benefits and detriments of intragroup conflict. Administrative science quarterly(1995), 256–282. Publisher: JSTOR.Google Scholar
- Ryan P Kennedy, Philip D Waggoner, and Matthew Ward. 2021. Trust in Public Policy Algorithms. The Journal of Politics (July 2021). https://doi.org/10.1086/716283 Publisher: The University of Chicago Press.Google Scholar
- Miikka Kuutila, Mika V. Mãntylã, and Maëlick Claes. 2020. Chat activity is a better predictor than chat sentiment on software developers productivity. In Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops. ACM, Seoul Republic of Korea, 553–556. https://doi.org/10.1145/3387940.3392224Google ScholarDigital Library
- Gilly Leshed, Diego Perez, Jeffrey T. Hancock, Dan Cosley, Jeremy Birnholtz, Soyoung Lee, Poppy L. McLeod, and Geri Gay. 2009. Visualizing real-time language-based feedback on teamwork behavior in computer-mediated groups. In Proceedings of the 27th international conference on Human factors in computing systems - CHI 09. ACM Press, Boston, MA, USA, 537. https://doi.org/10.1145/1518701.1518784Google ScholarDigital Library
- Q. Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the AI: Informing Design Practices for Explainable AI User Experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–15. https://doi.org/10.1145/3313831.3376590Google ScholarDigital Library
- Yu Liu, Yue Liu, and Kane Yue. 2021. Integration of Concept Maps into the Mixed Reality Learning Space: Quasi-Experimental Design and Preliminary Results. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 627–628. https://doi.org/10.1109/VRW52623.2021.00196Google ScholarCross Ref
- United Nations. 2021. Resource Guide on Artificial Intelligence (AI) Strategies | Department of Economic and Social Affairs. https://sdgs.un.org/documents/resource-guide-artificial-intelligence-ai-strategies-25128Google Scholar
- R.J. Ocker. 2005. Influences on creativity in asynchronous virtual teams: a qualitative analysis of experimental teams. IEEE Transactions on Professional Communication 48, 1 (March 2005), 22–39. https://doi.org/10.1109/TPC.2004.843294 Conference Name: IEEE Transactions on Professional Communication.Google ScholarCross Ref
- Adam Ozimek. 2020. The Future of Remote Work. SSRN Electronic Journal(2020). https://doi.org/10.2139/ssrn.3638597Google Scholar
- Ayellet Pelled, Tanya Zilberstein, Eran Pick, Yael Patkin, Alona Tsironlikov, and Nurit Tal-Or. 2016. Which Post Will Impress the Most? Impression Formation Based on Visual and Textual Cues in Facebook Profiles. In Proceedings of the 7th 2016 International Conference on Social Media & Society(SMSociety ’16). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/2930971.2930997Google ScholarDigital Library
- Zhenhui Peng, Taewook Kim, and Xiaojuan Ma. 2019. GremoBot: Exploring Emotion Regulation in Group Chat. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing. ACM, Austin TX USA, 335–340. https://doi.org/10.1145/3311957.3359472Google ScholarDigital Library
- Sandra Walker Russ. 1993. Affect and Creativity: the Role of Affect and Play in the Creative Process. Routledge, New York. https://doi.org/10.4324/9780203772621Google Scholar
- Samiha Samrose, Daniel McDuff, Robert Sim, Jina Suh, Kael Rowan, Javier Hernandez, Sean Rintel, Kevin Moynihan, and Mary Czerwinski. 2021. MeetingCoach: An Intelligent Dashboard for Supporting Effective & Inclusive Meetings. (2021), 13.Google Scholar
- Samiha Samrose, Ru Zhao, Jeffery White, Vivian Li, Luis Nova, Yichen Lu, Mohammad Rafayet Ali, and Mohammed Ehsan Hoque. 2018. Coco: Collaboration coach for understanding team dynamics during video conferencing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 1, 4 (2018), 1–24. Publisher: ACM New York, NY, USA.Google ScholarDigital Library
- Taylor Jackson Scott, Katie Kuksenok, Daniel Perry, Michael Brooks, Ona Anicello, and Cecilia Aragon. 2012. Adapting grounded theory to construct a taxonomy of affect in collaborative online chat. In Proceedings of the 30th ACM international conference on Design of communication - SIGDOC ’12. ACM Press, Seattle, Washington, USA, 197. https://doi.org/10.1145/2379057.2379096Google ScholarDigital Library
- Ben Shneiderman. 2009. Creativity Support Tools: A Grand Challenge for HCI Researchers. In Engineering the User Interface, Miguel Redondo, Crescencio Bravo, and Manuel Ortega (Eds.). Springer London, London, 1–9. https://doi.org/10.1007/978-1-84800-136-7_1Google Scholar
- Paul Spector. 1997. Job Satisfaction: Application, Assessment, Causes, and Consequences. Thousand Oaks, California. https://doi.org/10.4135/9781452231549Google ScholarCross Ref
- Spiceworks. 2017. Distribution of collaboration tools used in organizations worldwide, as of 2016, by company size.Google Scholar
- Statista. 2020. COVID-19 digital engagement report. http://www.statista.com/study/86023/covid-19-digital-engagement-report/Google Scholar
- Statista. 2020. Remote work frequency before/after COVID-19 2020. https://www.statista.com/statistics/1122987/change-in-remote-work-trends-after-covid-in-usa/Google Scholar
- Jamie S. Switzer. 2008. Impression Formation in Computer-Mediated Communication and Making a Good (Virtual) Impression. https://doi.org/10.4018/978-1-59904-893-2.ch008 ISBN: 9781599048932 Pages: 98-109 Publisher: IGI Global.Google Scholar
- Thiemo Wambsganss, Christina Niklaus, Matthias Söllner, Siegfried Handschuh, and J. M. Leimeister. 2021. Supporting Cognitive and Emotional Empathic Writing of Students. SSRN Scholarly Paper ID 3910431. Social Science Research Network, Rochester, NY. https://papers.ssrn.com/abstract=3910431Google Scholar
- L. Alan Witt and Mark N. Beorkrem. 1989. Climate for creative productivity as a predictor of research usefulness and organizational effectiveness in an R&D organization. Creativity Research Journal 2, 1-2 (1989), 30–40. https://doi.org/10.1080/10400418909534298 Place: US Publisher: Lawrence Erlbaum.Google ScholarCross Ref
- Douglas Zytko, Sukeshini A. Grandhi, and Quentin (Gad) Jones. 2014. Impression management through communication in online dating. In Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing(CSCW Companion ’14). Association for Computing Machinery, New York, NY, USA, 277–280. https://doi.org/10.1145/2556420.2556487Google ScholarDigital Library
Recommendations
Creative feelings: the effect of mood on creative ideation and evaluation
C&C '11: Proceedings of the 8th ACM conference on Creativity and cognitionResearch has found mixed effects of mood on creative problem solving. Here we examined the effects of mood on two components of creative problem solving; ideation and evaluation. After induction of positive, negative or neutral mood participants ...
The dynamic influence of emotions on game-based creativity
Emotion has been identified as an important predictor of creativity, but little attention has been put on investigating how emotion, especially that considers regulation focus, may dynamically influence male and female students' creativity in game-based ...
Interactions with a moody robot
HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interactionThis paper reports on the results of a long-term experiment in which a social robot's facial expressions were changed to reflect different moods. While the facial changes in each condition were not extremely different, they still altered how people ...
Comments