skip to main content
10.1145/3313831.3376609acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Public Access

SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion

Published:23 April 2020Publication History

ABSTRACT

Online chat is an emerging channel for discussing community problems. It is common practice for communities to assign dedicated moderators to maintain a structured discussion and enhance the problem-solving experience. However, due to the synchronous nature of online chat, moderators face a high managerial overhead in tasks like discussion stage management, opinion summarization, and consensus-building support. To assist moderators with facilitating a structured discussion for community problem-solving, we introduce SolutionChat, a system that (1) visualizes discussion stages and featured opinions and (2) recommends contextually appropriate moderator messages. Results from a controlled lab study (n=55, 12 groups) suggest that participants' perceived discussion trackability was significantly higher with SolutionChat than without. Also, moderators provided better summarization with less effort and better managerial support using system-generated messages with SolutionChat than without. With SolutionChat, we envision untrained moderators to effectively facilitate chat-based discussions of important community matters.

Skip Supplemental Material Section

Supplemental Material

paper482pv.mp4

mp4

1.3 MB

pn6850vf.mp4

mp4

29 MB

References

  1. Christa SC Asterhan and Baruch B Schwarz. 2007. The effects of monological and dialogical argumentation on concept learning in evolutionary theory. Journal of educational psychology 99, 3 (2007), 626.Google ScholarGoogle ScholarCross RefCross Ref
  2. Christa SC Asterhan and Baruch B Schwarz. 2009. Argumentation and explanation in conceptual change: Indications from protocol analyses of peer-to-peer dialog. Cognitive science 33, 3 (2009), 374--400.Google ScholarGoogle Scholar
  3. Christa SC Asterhan and Baruch B Schwarz. 2010. Online moderation of synchronous e-argumentation. International Journal of Computer-Supported Collaborative Learning 5, 3 (2010), 259--282.Google ScholarGoogle ScholarCross RefCross Ref
  4. R Bartlett and M Deseriis. 2016. Loomio and the Problem of Deliberation. Open Democracy (2016).Google ScholarGoogle Scholar
  5. Mia Xu Chen, Benjamin N Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M Dai, Zhifeng Chen, and others. 2019. Gmail Smart Compose: Real-Time Assisted Writing. arXiv preprint arXiv:1906.00080 (2019).Google ScholarGoogle Scholar
  6. Christine Chin and Jonathan Osborne. 2010. Supporting argumentation through students' questions: Case studies in science classrooms. The Journal of the Learning Sciences 19, 2 (2010), 230--284.Google ScholarGoogle ScholarCross RefCross Ref
  7. Elaine B Coleman. 1998. Using explanatory knowledge during collaborative problem solving in science. Journal of the Learning Sciences 7, 3--4 (1998), 387--427.Google ScholarGoogle ScholarCross RefCross Ref
  8. Jeff Conklin. 2006. Wicked problems & social complexity. CogNexus Institute San Francisco, CA.Google ScholarGoogle Scholar
  9. Alice Coucke, Alaa Saade, Adrien Ball, Théodore Bluche, Alexandre Caulier, David Leroy, Clément Doumouro, Thibault Gisselbrecht, Francesco Caltagirone, Thibaut Lavril, and others. 2018. Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces. arXiv preprint arXiv:1805.10190 (2018), 12--16.Google ScholarGoogle Scholar
  10. Fiorella De Cindio and Stefano Stortone. 2013. Experimenting liquidfeedback for online deliberation in civic contexts. In International Conference on Electronic Participation. Springer, 147--158.Google ScholarGoogle ScholarCross RefCross Ref
  11. Erica De Vries, Kristine Lund, and Michael Baker. 2002. Computer-mediated epistemic dialogue: Explanation and argumentation as vehicles for understanding scientific notions. The journal of the learning sciences 11, 1 (2002), 63--103.Google ScholarGoogle Scholar
  12. Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2015. Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General 144, 1 (2015), 114.Google ScholarGoogle ScholarCross RefCross Ref
  13. Thomas Erickson, Christine Halverson, Wendy Kellogg, Mark Laff, Peter Malkin, and Tracee Wolf. 2001. Loops: Designing A Web-Based Environment for Persistent, Semi-Structured Conversation. Yorktown Heights, NY (2001).Google ScholarGoogle Scholar
  14. Shelly Farnham, Harry R Chesley, Debbie E McGhee, Reena Kawal, and Jennifer Landau. 2000. Structured online interactions: improving the decision-making of small discussion groups. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. ACM, 299--308.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Robert Farrell, Peter G Fairweather, and Kathleen Snyder. 2001. Summarization of discussion groups. In Proceedings of the tenth international conference on Information and knowledge management. ACM, 532--534.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Fiona E Fox, Marianne Morris, and Nichola Rumsey. 2007. Doing synchronous online focus groups with young people: Methodological reflections. Qualitative health research 17, 4 (2007), 539--547.Google ScholarGoogle ScholarCross RefCross Ref
  17. Google. 2016. GBoard - the Google Keyword. (May 2016). https://play.google.com/store/apps/details?id= com.google.android.inputmethod.latin Accessed: 2019-09--20.Google ScholarGoogle Scholar
  18. Matthew Henderson, Rami Al-Rfou, Brian Strope, Yun-hsuan Sung, László Lukács, Ruiqi Guo, Sanjiv Kumar, Balint Miklos, and Ray Kurzweil. 2017. Efficient natural language response suggestion for smart reply. arXiv preprint arXiv:1705.00652 (2017).Google ScholarGoogle Scholar
  19. Kevin A Hill and John E Hughes. 1998. Cyberpolitics: Citizen activism in the age of the Internet. Rowman & Littlefield Publishers, Inc.Google ScholarGoogle Scholar
  20. Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019a. Human-Machine Collaboration for Content Regulation: The Case of Reddit Automoderator. ACM Trans. Comput.-Hum. Interact. 26, 5, Article 31 (July 2019), 35 pages. DOI: http://dx.doi.org/10.1145/3338243Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Shagun Jhaver, Amy Bruckman, and Eric Gilbert. 2019b. Does Transparency in Moderation Really Matter?: User Behavior After Content Removal Explanations on Reddit. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 150 (Nov. 2019), 27 pages. DOI: http://dx.doi.org/10.1145/3359252Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ian Kearns, Jamie Bend, and Beatrice Stern. 2002. E-participation in local government. Institute for Public Policy Research.Google ScholarGoogle Scholar
  23. Alison King and Barak Rosenshine. 1993. Effects of guided cooperative questioning on children's knowledge construction. The Journal of Experimental Education 61, 2 (1993), 127--148.Google ScholarGoogle ScholarCross RefCross Ref
  24. Mark Klein. 2011. How to harvest collective wisdom on complex problems: An introduction to the mit deliberatorium. Center for Collective Intelligence working paper (2011).Google ScholarGoogle Scholar
  25. Lorenz Cuno Klopfenstein, Saverio Delpriori, Silvia Malatini, and Alessandro Bogliolo. 2017. The rise of bots: A survey of conversational interfaces, patterns, and paradigms. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, 555--565.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Travis Kriplean, Jonathan Morgan, Deen Freelon, Alan Borning, and Lance Bennett. 2012. Supporting reflective public thought with considerit. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 265--274.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Lance B Kurke and Howard E Aldrich. 1983. Note-Mintzberg was right!: A replication and extension of the nature of managerial work. Management science 29, 8 (1983), 975--984.Google ScholarGoogle Scholar
  28. Sasha Lekach. 2017. The huge TechHasNoWalls protest started on Slack. (Feb 2017). https://news.yahoo.com/ huge-techhasnowalls-protest-started-slack-213408329. htmlGoogle ScholarGoogle Scholar
  29. Weichen Liu, Sijia Xiao, Jacob T Browne, Ming Yang, and Steven P Dow. 2018. ConsensUs: Supporting multi-criteria group decisions by visualizing points of disagreement. ACM Transactions on Social Computing 1, 1 (2018), 4.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Kristine Lund. 2004. Human support in CSCL. In What we know about CSCL. Springer, 167--198.Google ScholarGoogle Scholar
  31. Brian McInnis, Gilly Leshed, and Dan Cosley. 2018. Crafting Policy Discussion Prompts As a Task for Newcomers. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 121 (Nov. 2018), 23 pages. DOI: http://dx.doi.org/10.1145/3274390Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Microsoft. 2017. Word Flow Keyboard. (2017). https://www.microsoft.com/en-us/garage/profiles/ word-flow-keyboard/ Accessed: 2019-09--20.Google ScholarGoogle Scholar
  33. Michael D Mumford and Mary S Connelly. 1991. Leaders as creators: Leader performance and problem solving in ill-defined domains. The Leadership Quarterly 2, 4 (1991), 289--315.Google ScholarGoogle ScholarCross RefCross Ref
  34. Michael D Mumford and Sigrid B Gustafson. 1988. Creativity syndrome: Integration, application, and innovation. Psychological bulletin 103, 1 (1988), 27.Google ScholarGoogle Scholar
  35. Gabriel Murray, Giuseppe Carenini, and Shafiq Joty. 2018. NLP for Conversations: Sentiment, Summarization, and Group Dynamics. In Proceedings of the 27th International Conference on Computational Linguistics: Tutorial Abstracts. 1--4.Google ScholarGoogle Scholar
  36. Rachel Quednau. 2016. Top Strong Citizen Discussions this Week. (Apr 2016). https://www.strongtowns.org/journal/2016/4/13/ top-strong-citizens-discussions?rq=slackGoogle ScholarGoogle Scholar
  37. BB Schwartz, Y Neuman, and S Biezuner. 2000. Two wrongs may make a right... if they argue. Cognition and Instruction 18, 4 (2000), 461--494.Google ScholarGoogle ScholarCross RefCross Ref
  38. Naama Tepper, Anat Hashavit, Maya Barnea, Inbal Ronen, and Lior Leiba. 2018. Collabot: Personalized Group Chat Summarization. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. ACM, 771--774.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. TouchPal. 2008. TouchPal Keyboard. (2008). http://www.touchpal.com/ Accessed: 2019-09--20.Google ScholarGoogle Scholar
  40. TouchType. 2010. SwiftKey Keyboard. (2010). https://swiftkey.com/en Accessed: 2019-09--20.Google ScholarGoogle Scholar
  41. Niels van Berkel, Jorge Goncalves, Danula Hettiachchi, Senuri Wijenayake, Ryan M. Kelly, and Vassilis Kostakos. 2019. Crowdsourcing Perceptions of Fair Predictors for Machine Learning: A Recidivism Case Study. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 28 (Nov. 2019), 21 pages. DOI: http://dx.doi.org/10.1145/3359130Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Carla Van Boxtel, Jos Van der Linden, and Gellof Kanselaar. 2000. Collaborative learning tasks and the elaboration of conceptual knowledge. Learning and instruction 10, 4 (2000), 311--330.Google ScholarGoogle Scholar
  43. Ilse Verdiesen, Martijn Cligge, Jan Timmermans, Lennard Segers, Virginia Dignum, and Jeroen van den Hoven. 2016. MOOD: Massive Open Online Deliberation Platform-A Practical Application.. In EDIA@ ECAI. 4--9.Google ScholarGoogle Scholar
  44. Scott Wright. 2009. The role of the moderator: Problems and possibilities for government-run online discussion forums. Online deliberation: Design, research, and practice (2009), 233--242.Google ScholarGoogle Scholar
  45. GE Xun and Susan M Land. 2004. A conceptual framework for scaffolding III-structured problem-solving processes using question prompts and peer interactions. Educational technology research and development 52, 2 (2004), 5--22.Google ScholarGoogle Scholar
  46. Amy X Zhang and Justin Cranshaw. 2018. Making sense of group chat through collaborative tagging and summarization. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 196.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Amy X Zhang, Lea Verou, and David Karger. 2017. Wikum: Bridging discussion forums and wikis using recursive summarization. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2082--2096.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Liang Zhou and Eduard H Hovy. 2006. On the Summarization of Dynamically Introduced Information: Online Discussions and Blogs.. In AAAI Spring symposium: Computational approaches to analyzing weblogs. 237.Google ScholarGoogle Scholar

Index Terms

  1. SolutionChat: Real-time Moderator Support for Chat-based Structured Discussion

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
      April 2020
      10688 pages
      ISBN:9781450367080
      DOI:10.1145/3313831

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 April 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate6,199of26,314submissions,24%

      Upcoming Conference

      CHI '24
      CHI Conference on Human Factors in Computing Systems
      May 11 - 16, 2024
      Honolulu , HI , USA

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format