skip to main content
10.1145/3313831.3376609acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion

Published: 23 April 2020 Publication History

Abstract

Online chat is an emerging channel for discussing community problems. It is common practice for communities to assign dedicated moderators to maintain a structured discussion and enhance the problem-solving experience. However, due to the synchronous nature of online chat, moderators face a high managerial overhead in tasks like discussion stage management, opinion summarization, and consensus-building support. To assist moderators with facilitating a structured discussion for community problem-solving, we introduce SolutionChat, a system that (1) visualizes discussion stages and featured opinions and (2) recommends contextually appropriate moderator messages. Results from a controlled lab study (n=55, 12 groups) suggest that participants' perceived discussion trackability was significantly higher with SolutionChat than without. Also, moderators provided better summarization with less effort and better managerial support using system-generated messages with SolutionChat than without. With SolutionChat, we envision untrained moderators to effectively facilitate chat-based discussions of important community matters.

Supplemental Material

MP4 File
Preview video
MP4 File
Supplemental video

References

[1]
Christa SC Asterhan and Baruch B Schwarz. 2007. The effects of monological and dialogical argumentation on concept learning in evolutionary theory. Journal of educational psychology 99, 3 (2007), 626.
[2]
Christa SC Asterhan and Baruch B Schwarz. 2009. Argumentation and explanation in conceptual change: Indications from protocol analyses of peer-to-peer dialog. Cognitive science 33, 3 (2009), 374--400.
[3]
Christa SC Asterhan and Baruch B Schwarz. 2010. Online moderation of synchronous e-argumentation. International Journal of Computer-Supported Collaborative Learning 5, 3 (2010), 259--282.
[4]
R Bartlett and M Deseriis. 2016. Loomio and the Problem of Deliberation. Open Democracy (2016).
[5]
Mia Xu Chen, Benjamin N Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M Dai, Zhifeng Chen, and others. 2019. Gmail Smart Compose: Real-Time Assisted Writing. arXiv preprint arXiv:1906.00080 (2019).
[6]
Christine Chin and Jonathan Osborne. 2010. Supporting argumentation through students' questions: Case studies in science classrooms. The Journal of the Learning Sciences 19, 2 (2010), 230--284.
[7]
Elaine B Coleman. 1998. Using explanatory knowledge during collaborative problem solving in science. Journal of the Learning Sciences 7, 3--4 (1998), 387--427.
[8]
Jeff Conklin. 2006. Wicked problems & social complexity. CogNexus Institute San Francisco, CA.
[9]
Alice Coucke, Alaa Saade, Adrien Ball, Théodore Bluche, Alexandre Caulier, David Leroy, Clément Doumouro, Thibault Gisselbrecht, Francesco Caltagirone, Thibaut Lavril, and others. 2018. Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces. arXiv preprint arXiv:1805.10190 (2018), 12--16.
[10]
Fiorella De Cindio and Stefano Stortone. 2013. Experimenting liquidfeedback for online deliberation in civic contexts. In International Conference on Electronic Participation. Springer, 147--158.
[11]
Erica De Vries, Kristine Lund, and Michael Baker. 2002. Computer-mediated epistemic dialogue: Explanation and argumentation as vehicles for understanding scientific notions. The journal of the learning sciences 11, 1 (2002), 63--103.
[12]
Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2015. Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General 144, 1 (2015), 114.
[13]
Thomas Erickson, Christine Halverson, Wendy Kellogg, Mark Laff, Peter Malkin, and Tracee Wolf. 2001. Loops: Designing A Web-Based Environment for Persistent, Semi-Structured Conversation. Yorktown Heights, NY (2001).
[14]
Shelly Farnham, Harry R Chesley, Debbie E McGhee, Reena Kawal, and Jennifer Landau. 2000. Structured online interactions: improving the decision-making of small discussion groups. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. ACM, 299--308.
[15]
Robert Farrell, Peter G Fairweather, and Kathleen Snyder. 2001. Summarization of discussion groups. In Proceedings of the tenth international conference on Information and knowledge management. ACM, 532--534.
[16]
Fiona E Fox, Marianne Morris, and Nichola Rumsey. 2007. Doing synchronous online focus groups with young people: Methodological reflections. Qualitative health research 17, 4 (2007), 539--547.
[17]
Google. 2016. GBoard - the Google Keyword. (May 2016). https://play.google.com/store/apps/details?id= com.google.android.inputmethod.latin Accessed: 2019-09--20.
[18]
Matthew Henderson, Rami Al-Rfou, Brian Strope, Yun-hsuan Sung, László Lukács, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, and Ray Kurzweil. 2017. Efficient natural language response suggestion for smart reply. arXiv preprint arXiv:1705.00652 (2017).
[19]
Kevin A Hill and John E Hughes. 1998. Cyberpolitics: Citizen activism in the age of the Internet. Rowman & Littlefield Publishers, Inc.
[20]
Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019a. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact. 26, 5, Article 31 (July 2019), 35 pages.
[21]
Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019b. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 150 (Nov. 2019), 27 pages.
[22]
Ian Kearns, Jamie Bend, and Beatrice Stern. 2002. E-participation in local government. Institute for Public Policy Research.
[23]
Alison King and Barak Rosenshine. 1993. Effects of guided cooperative questioning on children's knowledge construction. The Journal of Experimental Education 61, 2 (1993), 127--148.
[24]
Mark Klein. 2011. How to harvest collective wisdom on complex problems: An introduction to the mit deliberatorium. Center for Collective Intelligence working paper (2011).
[25]
Lorenz Cuno Klopfenstein, Saverio Delpriori, Silvia Malatini, and Alessandro Bogliolo. 2017. The rise of bots: A survey of conversational interfaces, patterns, and paradigms. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 555--565.
[26]
Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett. 2012. Supporting reflective public thought with considerit. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 265--274.
[27]
Lance B Kurke and Howard E Aldrich. 1983. Note-Mintzberg was right!: A replication and extension of the nature of managerial work. Management science 29, 8 (1983), 975--984.
[28]
Sasha Lekach. 2017. The huge TechHasNoWalls protest started on Slack. (Feb 2017). https://news.yahoo.com/ huge-techhasnowalls-protest-started-slack-213408329. html
[29]
Weichen Liu, Sijia Xiao, Jacob T Browne, Ming Yang, and Steven P Dow. 2018. ConsensUs: Supporting multi-criteria group decisions by visualizing points of disagreement. ACM Transactions on Social Computing 1, 1 (2018), 4.
[30]
Kristine Lund. 2004. Human support in CSCL. In What we know about CSCL. Springer, 167--198.
[31]
Brian McInnis, Gilly Leshed, and Dan Cosley. 2018. Crafting Policy Discussion Prompts As a Task for Newcomers. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 121 (Nov. 2018), 23 pages.
[32]
Microsoft. 2017. Word Flow Keyboard. (2017). https://www.microsoft.com/en-us/garage/profiles/ word-flow-keyboard/ Accessed: 2019-09--20.
[33]
Michael D Mumford and Mary S Connelly. 1991. Leaders as creators: Leader performance and problem solving in ill-defined domains. The Leadership Quarterly 2, 4 (1991), 289--315.
[34]
Michael D Mumford and Sigrid B Gustafson. 1988. Creativity syndrome: Integration, application, and innovation. Psychological bulletin 103, 1 (1988), 27.
[35]
Gabriel Murray, Giuseppe Carenini, and Shafiq Joty. 2018. NLP for Conversations: Sentiment, Summarization, and Group Dynamics. In Proceedings of the 27th International Conference on Computational Linguistics: Tutorial Abstracts. 1--4.
[36]
Rachel Quednau. 2016. Top Strong Citizen Discussions this Week. (Apr 2016). https://www.strongtowns.org/journal/2016/4/13/ top-strong-citizens-discussions?rq=slack
[37]
BB Schwartz, Y Neuman, and S Biezuner. 2000. Two wrongs may make a right... if they argue. Cognition and Instruction 18, 4 (2000), 461--494.
[38]
Naama Tepper, Anat Hashavit, Maya Barnea, Inbal Ronen, and Lior Leiba. 2018. Collabot: Personalized Group Chat Summarization. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. ACM, 771--774.
[39]
TouchPal. 2008. TouchPal Keyboard. (2008). http://www.touchpal.com/ Accessed: 2019-09--20.
[40]
TouchType. 2010. SwiftKey Keyboard. (2010). https://swiftkey.com/en Accessed: 2019-09--20.
[41]
Niels van Berkel, Jorge Goncalves, Danula Hettiachchi, Senuri Wijenayake, Ryan M. Kelly, and Vassilis Kostakos. 2019. Crowdsourcing Perceptions of Fair Predictors for Machine Learning: A Recidivism Case Study. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 28 (Nov. 2019), 21 pages.
[42]
Carla Van Boxtel, Jos Van der Linden, and Gellof Kanselaar. 2000. Collaborative learning tasks and the elaboration of conceptual knowledge. Learning and instruction 10, 4 (2000), 311--330.
[43]
Ilse Verdiesen, Martijn Cligge, Jan Timmermans, Lennard Segers, Virginia Dignum, and Jeroen van den Hoven. 2016. MOOD: Massive Open Online Deliberation Platform-A Practical Application. In EDIA@ ECAI. 4--9.
[44]
Scott Wright. 2009. The role of the moderator: Problems and possibilities for government-run online discussion forums. Online deliberation: Design, research, and practice (2009), 233--242.
[45]
GE Xun and Susan M Land. 2004. A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions. Educational technology research and development 52, 2 (2004), 5--22.
[46]
Amy X Zhang and Justin Cranshaw. 2018. Making sense of group chat through collaborative tagging and summarization. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 196.
[47]
Amy X Zhang, Lea Verou, and David Karger. 2017. Wikum: Bridging discussion forums and wikis using recursive summarization. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2082--2096.
[48]
Liang Zhou and Eduard H Hovy. 2006. On the Summarization of Dynamically Introduced Information: Online Discussions and Blogs. In AAAI Spring symposium: Computational approaches to analyzing weblogs. 237.

Cited By

View all
  • (2024)When design workshops meet chatbots: Meaningful participation at scale?International Journal of Architectural Computing10.1177/1478077124125344022:2(216-237)Online publication date: 30-May-2024
  • (2024)Conversational Agents to Facilitate Deliberation on Harmful Content in WhatsApp GroupsProceedings of the ACM on Human-Computer Interaction10.1145/36870308:CSCW2(1-32)Online publication date: 8-Nov-2024
  • (2024)The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design ImplicationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642785(1-21)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. computer mediated communication
    2. moderator
    3. online discussion
    4. structured discussion

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)748
    • Downloads (Last 6 weeks)69
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)When design workshops meet chatbots: Meaningful participation at scale?International Journal of Architectural Computing10.1177/1478077124125344022:2(216-237)Online publication date: 30-May-2024
    • (2024)Conversational Agents to Facilitate Deliberation on Harmful Content in WhatsApp GroupsProceedings of the ACM on Human-Computer Interaction10.1145/36870308:CSCW2(1-32)Online publication date: 8-Nov-2024
    • (2024)The Promise and Peril of ChatGPT in Higher Education: Opportunities, Challenges, and Design ImplicationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642785(1-21)Online publication date: 11-May-2024
    • (2023)Understanding the effect of a virtual moderator on people’s perception in remote discussion using social VRFrontiers in Virtual Reality10.3389/frvir.2023.11980244Online publication date: 18-Jul-2023
    • (2023)Inform, Explain, or Control: Techniques to Adjust End-User Performance Expectations for a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/36101927:CSCW2(1-26)Online publication date: 4-Oct-2023
    • (2023)Designing for AI-Powered Social Computing SystemsCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3606951(572-575)Online publication date: 14-Oct-2023
    • (2023)Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder DeliberationProceedings of the ACM on Human-Computer Interaction10.1145/35796017:CSCW1(1-32)Online publication date: 16-Apr-2023
    • (2023)To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/35795327:CSCW1(1-23)Online publication date: 16-Apr-2023
    • (2023)Compass: Supporting Large Group Mentorship in a Chat-Based UIProceedings of the ACM on Human-Computer Interaction10.1145/35794707:CSCW1(1-25)Online publication date: 16-Apr-2023
    • (2023)Integrating AI in Human-Human Collaborative IdeationExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3573802(1-5)Online publication date: 19-Apr-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media