skip to main content
10.1145/3613904.3642787acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Third-Party Developers and Tool Development For Community Management on Live Streaming Platform Twitch

Published: 11 May 2024 Publication History

Abstract

Community management is critical for stakeholders to collaboratively build and sustain communities with socio-technical support. However, most of the existing research has mainly focused on the community members and the platform, with little attention given to the developers who act as intermediaries between the platform and community members and develop tools to support community management. This study focuses on third-party developers (TPDs) for the live streaming platform Twitch and explores their tool development practices. Using a mixed method with in-depth qualitative analysis, we found that TPDs maintain complex relationships with different stakeholders (streamers, viewers, platform, professional developers), and the multi-layered policy restricts their agency regarding idea innovation and tool development. We argue that HCI research should shift its focus from tool users to tool developers with regard to community management. We propose designs to support closer collaboration between TPDS and the platform and professional developers and streamline TPDs’ development process with unified toolkits and policy documentation.

Supplemental Material

MP4 File - Video Presentation
Video Presentation
Transcript for: Video Presentation

References

[1]
2012. The Challenges of Dealing with Newcomers. In Building Successful Online Communities. The MIT Press. https://doi.org/10.7551/mitpress/8472.003.0006
[2]
Ava Bartolome and Shuo Niu. 2023. A Literature Review of Video-Sharing Platform Research in HCI. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–20. https://doi.org/10.1145/3544548.3581107
[3]
David M. Blei. 2012. Probabilistic Topic Models. Commun. ACM 55, 4 (apr 2012), 77–84. https://doi.org/10.1145/2133806.2133826
[4]
David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993–1022.
[5]
Kevin J. Boudreau. 2012. Let a Thousand Flowers Bloom? An Early Look at Large Numbers of Software App Developers and Patterns of Innovation. Organization Science 23, 5 (Oct. 2012), 1409–1427. https://doi.org/10.1287/orsc.1110.0678
[6]
Kevin J. Boudreau and Karim R. Lakhani. 2009. How to Manage Outside Innovation. MIT Sloan Management Review (July 2009). https://sloanreview.mit.edu/article/how-to-manage-outside-innovation/
[7]
Jie Cai, Sagnik Chowdhury, Hongyang Zhou, and Donghee Yvette Wohn. 2023. Hate Raids on Twitch: Understanding Real-Time Human-Bot Coordinated Attacks in Live Streaming Communities. Proceedings of the ACM on Human-Computer InteractionCSCW (2023), 1–28.
[8]
Jie Cai and Donghee Y. Wohn. 2019. Categorizing Live Streaming Moderation Tools: An Analysis of Twitch. International Journal of Interactive Communication Systems and Technologies 9, 2 (July 2019), 36–50. https://doi.org/10.4018/IJICST.2019070103
[9]
Jie Cai and Donghee Yvette Wohn. 2021. After Violation But Before Sanction: Understanding Volunteer Moderators’ Profiling Processes Toward Violators in Live Streaming Communities. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 1–25. https://doi.org/10.1145/3479554 Publisher: Association for Computing Machinery.
[10]
Jie Cai and Donghee Yvette Wohn. 2022. Coordination and Collaboration: How do Volunteer Moderators Work as a Team in Live Streaming Communities?. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3491102.3517628
[11]
Jie Cai, Donghee Y. Wohn, and Mashael Almoqbel. 2021. Moderation Visibility: Mapping the Strategies of Volunteer Moderators in Live Streaming Micro Communities. In Proceedings of ACM International Conference on Interactive Media Experiences. 61–72. https://doi.org/10.1145/3452918.3458796
[12]
Jie Cai and Donghee Yvette Wohn. 2023. Understanding Moderators’ Conflict and Conflict Management Strategies with Streamers in Live Streaming Communities; Understanding Moderators’ Conflict and Conflict Management Strategies with Streamers in Live Streaming Communities. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). ACM, Hamburg, Germany, 1–12. https://doi.org/10.1145/3544548.3580982
[13]
Stevie Chancellor, Andrea Hu, and Munmun De Choudhury. 2018. Norms matter: Contrasting social support around behavior change in online weight loss communities. Conference on Human Factors in Computing Systems - Proceedings 2018-April (April 2018). https://doi.org/10.1145/3173574.3174240 ISBN: 9781450356206 Publisher: Association for Computing Machinery.
[14]
Eshwar Chandrasekharan, Chaitrali Gandhi, Matthew Wortley Mustelier, and Eric Gilbert. 2019. Crossmod: A Cross-Community Learning-based System to Assist Reddit Moderators. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–30. https://doi.org/10.1145/3359276
[15]
Eshwar Chandrasekharan, Mattia Samory, Shagun Jhaver, Hunter Charvat, Amy Bruckman, Cliff Lampe, Jacob Eisenstein, and Eric Gilbert. 2018. The Internet’s Hidden Rules: An Empirical Study of Reddit Norm Violations at Micro, Meso, and Macro Scales. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 32:1–32:25. https://doi.org/10.1145/3274301
[16]
Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The bag of communities: Identifying abusive behavior online with preexisting internet data. Conference on Human Factors in Computing Systems - Proceedings 2017-May (May 2017), 3175–3187. https://doi.org/10.1145/3025453.3026018 ISBN: 9781450346559 Publisher: Association for Computing Machinery.
[17]
Anubrata Das, Brandon Dang, and Matthew Lease. 2020. Fast, Accurate, and Healthier: Interactive Blurring Helps Moderators Reduce Exposure to Harmful Content. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 8, 1 (2020), 33–42. https://ojs.aaai.org/index.php/HCOMP/article/view/7461
[18]
Jessica T. DeCuir-Gunby, Patricia L. Marshall, and Allison W. McCulloch. 2011. Developing and Using a Codebook for the Analysis of Interview Data: An Example from a Professional Development Research Project. Field Methods 23, 2 (May 2011), 136–155. https://doi.org/10.1177/1525822X10388468
[19]
Bryan Dosono and Bryan Semaan. 2019. Moderation Practices as Emotional Labor in Sustaining Online Communities. In Proceedings of the ACM Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3290605.3300372
[20]
Ian Drosos and Philip J Guo. 2022. The Design Space of Livestreaming Equipment Setups: Tradeoffs, Challenges, and Opportunities. In Designing Interactive Systems Conference. ACM, New York, NY, USA, 835–848. https://doi.org/10.1145/3532106.3533489
[21]
Jennifer Fereday and Eimear Muir-Cochrane. 2006. Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development. International Journal of Qualitative Methods 5, 1 (March 2006), 80–92. https://doi.org/10.1177/160940690600500107
[22]
Anna Filippova and Hichang Cho. 2015. Mudslinging and manners: Unpacking conflict in free and open source software. In Proceedings of the 2015 ACM International Conference on Computer-Supported Cooperative Work and Social Computing. 1393–1403. https://doi.org/10.1145/2675133.2675254
[23]
Jörg Flecker and Pamela Meil. 2010. Organisational restructuring and emerging service value chains: implications for work and employment. Work, employment and society 24, 4 (2010), 680–698. https://doi.org/10.1177/0950017010380635
[24]
Jens Foerderer, Thomas Kude, Sebastian Walter Schuetz, and Armin Heinzl. 2019. Knowledge boundaries in enterprise software platform development: Antecedents and consequences for platform governance. Information Systems Journal 29, 1 (2019), 119–144. https://doi.org/10.1111/isj.12186 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/isj.12186.
[25]
Awdren Fontão, Bruno Ábia, Igor Wiese, Bernardo Estácio, Marcelo Quinta, Rodrigo Pereira dos Santos, and Arilo Claudio Dias-Neto. 2018. Supporting governance of mobile application developers from mining and analyzing technical questions in stack overflow. Journal of Software Engineering Research and Development 6, 1 (Aug. 2018), 8. https://doi.org/10.1186/s40411-018-0052-6
[26]
aline shakti franzke, Anja Bechmann, Zimmer Michael, Charles Ess, and the Association of Internet Researchers. 2020. Internet Research: Ethical Guidelines 3.0. https://aoir.org/reports/ethics3.pdf
[27]
Guo Freeman. 2016. Making Games as Collaborative Social Experiences: Exploring An Online Gaming Community. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion(CSCW ’16 Companion). Association for Computing Machinery, New York, NY, USA, 265–268. https://doi.org/10.1145/2818052.2869076
[28]
Guo Freeman, Jeffrey Bardzell, Shaowen Bardzell, and Nathan McNeese. 2020. Mitigating Exploitation: Indie Game Developers’ Reconfigurations of Labor in Technology. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (May 2020), 56:1–56:23. https://doi.org/10.1145/3392864
[29]
Guo Freeman, Lingyuan Li, Nathan Mcneese, and Kelsea Schulenberg. 2023. Understanding and Mitigating Challenges for Non-Profit Driven Indie Game Development to Innovate Game Production. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–16. https://doi.org/10.1145/3544548.3580976
[30]
Guo Freeman, Nathan McNeese, Jeffrey Bardzell, and Shaowen Bardzell. 2020. "Pro-Amateur"-Driven Technological Innovation: Participation and Challenges in Indie Game Development. Proceedings of the ACM on Human-Computer Interaction 4, GROUP (Jan. 2020), 04:1–04:22. https://doi.org/10.1145/3375184
[31]
Guo Freeman and Nathan J. McNeese. 2019. Exploring Indie Game Development: Team Practices and Social Experiences in A Creativity-Centric Technology Community. Computer Supported Cooperative Work 28, 3-4 (June 2019), 723–748. https://doi.org/10.1007/s10606-019-09348-x
[32]
Guo Freeman and Nathan J. McNeese. 2021. A Tale of Creativity and Struggles: Team Practices for Bottom-Up Innovation in Virtual Game Jams. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 76:1–76:27. https://doi.org/10.1145/3449150
[33]
Ahmad Ghazawneh and Ola Henfridsson. 2013. Balancing platform control and external contribution in third-party development: the boundary resources model. Information Systems Journal 23, 2 (March 2013), 173–192. https://doi.org/10.1111/J.1365-2575.2012.00406.X Publisher: John Wiley & Sons, Ltd.
[34]
Anja Guzzi, Alberto Bacchelli, Yann Riche, and Arie van Deursen. 2015. Supporting Developers’ Coordination in the IDE. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, New York, NY, USA, 518–532. https://doi.org/10.1145/2675133.2675177
[35]
William A. Hamilton, Oliver Garretson, and Andruid Kerne. 2014. Streaming on twitch: Fostering participatory communities of play within live mixed media. In Conference on Human Factors in Computing Systems - Proceedings. ACM, New York, NY, USA, 1315–1324. https://doi.org/10.1145/2556288.2557048
[36]
Catherine Han, Joseph Seering, Deepak Kumar, Jeffrey T. Hancock, and Zakir Durumeric. 2023. Hate Raids on Twitch: Echoes of the Past, New Modalities, and Implications for Platform Governance. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 1–28. https://doi.org/10.1145/3579609 Publisher: ACM PUB27 New York, NY, USA.
[37]
Jane Hsieh, Joselyn Kim, Laura Dabbish, and Haiyi Zhu. 2023. "Nip it in the Bud": Moderation Strategies in Open Source Software Projects and the Role of Bots. Proceedings of the ACM on Human-Computer Interaction 7, CSCW2 (Oct. 2023), 301:1–301:29. https://doi.org/10.1145/3610092
[38]
Wenjian Huang, Tun Lu, Haiyi Zhu, Guo Li, and Ning Gu. 2016. Effectiveness of Conflict Management Strategies in Peer Review Process of Online Collaboration Projects. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing(CSCW ’16). Association for Computing Machinery, New York, NY, USA, 717–728. https://doi.org/10.1145/2818048.2819950
[39]
Shagun Jhaver, Darren Scott Appling, Eric Gilbert, and Amy Bruckman. 2019. “Did you suspect the post would be removed?”: Understanding user reactions to content removals on reddit. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 1–33. https://doi.org/10.1145/3359294 Publisher: Association for Computing Machinery.
[40]
Shagun Jhaver, Iris Birman, Eric Gilbert, and Amy Bruckman. 2019. Human-machine collaboration for content regulation: The case of reddit automoderator. ACM Transactions on Computer-Human Interaction 26, 5 (2019), 35. https://doi.org/10.1145/3338243 ISBN: 10.1145/3338243.
[41]
Shagun Jhaver, Quan Ze Chen, Detlef Knauss, and Amy X. Zhang. 2022. Designing Word Filter Tools for Creator-led Comment Moderation. In CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–21. https://doi.org/10.1145/3491102.3517505 _eprint: 2202.08818.
[42]
Jialun Jiang, Charles Kiene, Skyler Middler, Jed R. Brubaker, and Casey Fiesler. 2019. Moderation challenges in voice-based online communities on discord. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019). https://doi.org/10.1145/3359157 Publisher: Association for Computing Machinery _eprint: 2101.05258.
[43]
Martin Kauschinger and Maximilian Schreieck. 2023. Detecting Feature Requests of Third-Party Developers through Machine Learning: A Case Study of the SAP Community. In Proceedings of the 56th Hawaii International Conference on System Sciences. 10. https://doi.org/10125/102747
[44]
Martin Kauschinger, Maximilian Schreieck, Markus Boehm, and Helmut Krcmar. 2021. Knowledge Sharing in Digital Platform Ecosystems – A Textual Analysis of SAP’s Developer Community. In Innovation Through Information Systems(Lecture Notes in Information Systems and Organisation), Frederik Ahlemann, Reinhard Schütte, and Stefan Stieglitz (Eds.). Springer International Publishing, Cham, 21–39. https://doi.org/10.1007/978-3-030-86797-3_2
[45]
Charles Kiene, Kate Grandprey-Shores, Eshwar Chandrasekharan, Shagun Jhaver, Jialun "Aaron" Jiang, Brianna Dym, Joseph Seering, Sarah Gilbert, Kat Lo, Donghee Yvette Wohn, and Bryan Dosono. 2019. Volunteer Work: Mapping the Future of Moderation Research. In Conference Companion Publication of the 2019 on Computer Supported Cooperative Work and Social Computing(CSCW ’19). Association for Computing Machinery, New York, NY, USA, 492–497. https://doi.org/10.1145/3311957.3359443
[46]
Charles Kiene, Jialun Aaron Jiang, and Benjamin Mako Hill. 2019. Technological frames and user innovation: Exploring technological change in community moderation teams. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 1–23. https://doi.org/10.1145/3359146 Publisher: Association for Computing Machinery.
[47]
Soomin Kim, Jinsu Eun, Changhoon Oh, Bongwon Suh, and Joonhwan Lee. 2020. Bot in the Bunch: Facilitating Group Chat Discussion by Improving Efficiency and Participation with a Chatbot. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376785
[48]
Soomin Kim, Jinsu Eun, Joseph Seering, and Joonhwan Lee. 2021. Moderator Chatbot for Deliberative Discussion: Effects of Discussion Structure and Discussant Facilitation. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 1–26. https://doi.org/10.1145/3449161
[49]
Yubo Kou. 2021. Punishment and Its Discontents: An Analysis of Permanent Ban in an Online Game Community. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 1–21. https://doi.org/10.1145/3476075 Publisher: Association for Computing Machinery.
[50]
Yubo Kou and Xinning Gui. 2020. Mediating Community-AI Interaction through Situated Explanation: The Case of AI-Led Moderation. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 27. https://doi.org/10.1145/3415173 ISBN: 10.1145/3415173.
[51]
Klaus Krippendorff. 2004. Content Analysis: An Introduction to Its Methodology. SAGE. Google-Books-ID: q657o3M3C8cC.
[52]
Srijan Kumar, William L. Hamilton, Jure Leskovec, and Dan Jurafsky. 2018. Community Interaction and Conflict on the Web. In Proceedings of the 2018 World Wide Web Conference on World Wide Web. ACM Press, New York, New York, USA, 933–943. https://doi.org/10.1145/3178876.3186141 _eprint: 1803.03697.
[53]
Tina Kuo, Alicia Hernani, and Jens Grossklags. 2023. The Unsung Heroes of Facebook Groups Moderation: A Case Study of Moderation Practices and Tools. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (April 2023), 97:1–97:38. https://doi.org/10.1145/3579530
[54]
Lingyuan Li, Guo Freeman, and Nathan J. McNeese. 2022. Channeling End-User Creativity: Leveraging Live Streaming for Distributed Collaboration in Indie Game Development. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 282:1–282:28. https://doi.org/10.1145/3555173
[55]
Ziming Li, Kristen Shinohara, and Roshan L Peiris. 2023. Exploring the Use of the SoundVizVR Plugin with Game Developers in the Development of Sound-Accessible Virtual Reality Games. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585750
[56]
S Likhitha, BS Harish, and HM Keerthi Kumar. 2019. A detailed survey on topic modeling for document and short text data. International Journal of Computer Applications 178, 39 (2019), 1–9. https://doi.org/10.5120/ijca2019919265
[57]
Bin Lin, Alexey Zagalsky, Margaret-Anne Storey, and Alexander Serebrenik. 2016. Why Developers Are Slacking Off: Understanding How Software Teams Use Slack. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion. ACM, New York, NY, USA, 333–336. https://doi.org/10.1145/2818052.2869117
[58]
Yao Lyu, Jie Cai, Anisa Callis, Kelley Cotter, and John M. Carroll. 2024. "I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.": A Study of Blind TikTokers’ Content Moderation Experiences. https://doi.org/10.1145/3613904.3642148 arXiv:2401.11663 [cs].
[59]
Renkai Ma and Yubo Kou. 2021. "How advertiser-friendly is my video?": YouTuber’s Socioeconomic Interactions with Algorithmic Content Moderation. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 1–25. https://doi.org/10.1145/3479573 Publisher: ACM.
[60]
Regan L Mandryk, Julian Frommel, Nitesh Goyal, Guo Freeman, Cliff Lampe, Sarah Vieweg, and Donghee Yvette Wohn. 2023. Combating Toxicity, Harassment, and Abuse in Online Social Spaces: A Workshop at CHI 2023. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3573793
[61]
Enrico Mariconti, Guillermo Suarez-Tangil, Jeremy Blackburn, Emiliano De Cristofaro, Nicolas Kourtellis, Ilias Leontiadis, Jordi Luque Serrano, and Gianluca Stringhini. 2019. “You Know What to Do”: Proactive Detection of YouTube Videos Targeted by Coordinated Hate Attacks. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 1–21. https://doi.org/10.1145/3359309 _eprint: 1805.08168.
[62]
Market.Us. 2023. API Management Market to Reach Valuation of USD 49.9 Billion at Cagr of 28% by 2032 - Report by Market.us. https://www.globenewswire.com/en/news-release/2023/03/21/2631010/0/en/API-Management-Market-to-Reach-Valuation-of-USD-49-9-Billion-at-Cagr-of-28-by-2032-Report-by-Market-us.html
[63]
Nolwenn Maudet, Germán Leiva, Michel Beaudouin-Lafon, and Wendy Mackay. 2017. Design Breakdowns: Designer-Developer Gaps in Representing and Interpreting Interactive Systems. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 630–641. https://doi.org/10.1145/2998181.2998190
[64]
David Mellis and Leah Buechley. 2012. Collaboration in open-source hardware: third-party variations on the arduino duemilanove. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work(CSCW ’12). Association for Computing Machinery, New York, NY, USA, 1175–1178. https://doi.org/10.1145/2145204.2145377
[65]
Ed Nightingale. 2022. Twitch streamers positive about new raid feature in response to harassment. https://www.eurogamer.net/twitch-streamers-positive-about-new-raid-feature-in-response-to-harassment Publication Title: Eurogamer.
[66]
Shirin Nilizadeh, François Labrèche, Alireza Sedighian, Ali Zand, José Fernandez, Christopher Kruegel, Gianluca Stringhini, and Giovanni Vigna. 2017. POISED: Spotting twitter spam off the beaten paths. In Proceedings of the ACM Conference on Computer and Communications Security. ACM, New York, NY, USA, 1159–1174. https://doi.org/10.1145/3133956.3134055 ISSN: 15437221 _eprint: 1708.09058.
[67]
Shuo Niu, Zhicong Lu, Amy X. Zhang, Jie Cai, Carla F. Griggio, and Hendrik Heuer. 2023. Building Credibility, Trust, and Safety on Video-Sharing Platforms. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3573809
[68]
Chris Parnin and Christoph Treude. 2011. Measuring API documentation on the web. In Proceedings of the 2nd International Workshop on Web 2.0 for Software Engineering. ACM, Waikiki, Honolulu HI USA, 25–30. https://doi.org/10.1145/1984701.1984706
[69]
Xuan-Hieu Phan, Cam-Tu Nguyen, Dieu-Thu Le, Le-Minh Nguyen, Susumu Horiguchi, and Quang-Thuy Ha. 2011. A Hidden Topic-Based Framework toward Building Applications with Short Web Documents. IEEE Transactions on Knowledge and Data Engineering 23, 7 (2011), 961–976. https://doi.org/10.1109/TKDE.2010.27
[70]
Suzanne Prior, Annalu Waller, Rolf Black, and Thilo Kroll. 2013. Use of an agile bridge in the development of assistive technology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Paris France, 1579–1588. https://doi.org/10.1145/2470654.2466210
[71]
Reinhard Prügl and Martin Schreier. 2006. Learning from leading-edge customers at The Sims: opening up the innovation process using toolkits. R&D Management 36, 3 (June 2006), 237–250. https://doi.org/10.1111/J.1467-9310.2006.00433.X Publisher: John Wiley & Sons, Ltd.
[72]
Jiali Qi and Aron Lindberg. 2021. Understanding the Reactive Practices of Third-party Developers. Academy of Management Proceedings 2021, 1 (Aug. 2021), 12641. https://doi.org/10.5465/AMBPP.2021.12641abstract Publisher: Academy of Management Briarcliff Manor, NY 10510.
[73]
Rifat Rahman, Md. Rishadur Rahman, Nafis Irtiza Tripto, Mohammed Eunus Ali, Sajid Hasan Apon, and Rifat Shahriyar. 2021. AdolescentBot: Understanding Opportunities for Chatbots in Combating Adolescent Sexual and Reproductive Health Problems in Bangladesh. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems(CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3411764.3445694
[74]
Paolo Ruffino (Ed.). 2020. Independent Videogames: Cultures, Networks, Techniques and Politics. Routledge, London. https://doi.org/10.4324/9780367336219
[75]
Joseph Seering, Tianmi Fang, Luca Damasco, Mianhong Cherie Chen, Likang Sun, and Geoff Kaufman. 2019. Designing User Interface Elements to Improve the Quality and Civility of Discourse in Online Commenting Behaviors. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300836
[76]
Joseph Seering, Juan Pablo Flores, Saiph Savage, and Jessica Hammer. 2018. The Social Roles of Bots: Evaluating Impact of Bots on Discussions in Online Communities. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 157:1–157:29. https://doi.org/10.1145/3274426
[77]
Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 111–125. https://doi.org/10.1145/2998181.2998277
[78]
Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media & Society 21, 7 (July 2019), 1417–1443. https://doi.org/10.1177/1461444818821316
[79]
Robert W Service. 2009. Book Review: Corbin, J., & Strauss, A.(2008). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Thousand Oaks, CA: Sage. Organizational Research Methods 12, 3 (2009), 614–617. https://doi.org/10.1177/1094428108324514
[80]
Jeff T Sheng and Sanjay R Kairam. 2020. From Virtual Strangers to IRL Friends: Relationship Development in Livestreaming Communities on Twitch. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 34. https://doi.org/10.1145/3415165
[81]
Carson Sievert and Kenneth Shirley. 2014. LDAvis: A method for visualizing and interpreting topics. In Proceedings of the workshop on interactive language learning, visualization, and interfaces. 63–70.
[82]
Vandana Singh, Aditya Johri, and Raktim Mitra. 2011. Types of newcomers in an online developer community. In Proceedings of the ACM 2011 conference on Computer supported cooperative work(CSCW ’11). Association for Computing Machinery, New York, NY, USA, 717–720. https://doi.org/10.1145/1958824.1958953
[83]
C. Estelle Smith, Irfanul Alam, Chenhao Tan, Brian C. Keegan, and Anita L. Blanchard. 2022. The Impact of Governance Bots on Sense of Virtual Community: Development and Validation of the GOV-BOTs Scale. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 462:1–462:30. https://doi.org/10.1145/3555563
[84]
Keith Stevens, Philip Kegelmeyer, David Andrzejewski, and David Buttler. 2012. Exploring Topic Coherence over Many Models and Many Topics. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (Jeju Island, Korea) (EMNLP-CoNLL ’12). Association for Computational Linguistics, USA, 952–961.
[85]
Keith Stevens, Philip Kegelmeyer, David Andrzejewski, and David Buttler. 2012. Exploring topic coherence over many models and many topics. In Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning. 952–961.
[86]
Gianluca Stringhini, Pierre Mourlanne, Gregoire Jacob, Manuel Egele, Christopher Kruegel, and Giovanni Vigna. 2015. Evilcohort: Detecting communities of malicious accounts on online services. https://www.usenix.org/conference/usenixsecurity15/technical-sessions/presentation/stringhini ISBN: 9781931971232 Pages: 563–578 Publication Title: Proceedings of the 24th USENIX Security Symposium.
[87]
Sharifa Sultana, Mitrasree Deb, Ananya Bhattacharjee, Shaid Hasan, S.M.Raihanul Alam, Trishna Chakraborty, Prianka Roy, Samira Fairuz Ahmed, Aparna Moitra, M. Ashraful Amin, A.K.M. Najmul Islam, and Syed Ishtiaque Ahmed. 2021. ‘Unmochon’: A Tool to Combat Online Sexual Harassment over Facebook Messenger. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–18. https://doi.org/10.1145/3411764.3445154
[88]
Mohammad Tahaei, Ruba Abu-Salma, and Awais Rashid. 2023. Stuck in the Permissions With You: Developer & End-User Perspectives on App Permissions & Their Privacy Ramifications. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–24. https://doi.org/10.1145/3544548.3581060
[89]
David J. Teece. 1986. Profiting from technological innovation: Implications for integration, collaboration, licensing and public policy. Research Policy 15, 6 (Dec. 1986), 285–305. https://doi.org/10.1016/0048-7333(86)90027-2 Publisher: North-Holland.
[90]
Michael Terry, Matthew Kay, and Ben Lafreniere. 2010. Perceptions and practices of usability in the free/open source software (FoSS) community. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Atlanta Georgia USA, 999–1008. https://doi.org/10.1145/1753326.1753476
[91]
Yuen-Hsien Tseng, Chi-Jen Lin, and Yu-I Lin. 2007. Text mining techniques for patent analysis. Information processing & management 43, 5 (2007), 1216–1247.
[92]
Jirassaya Uttarapong, Jie Cai, and Donghee Yvette Wohn. 2021. Harassment Experiences of Women and LGBTQ Live Streamers and How They Handled Negativity. In ACM International Conference on Interactive Media Experiences. ACM, New York, NY, USA, 7–19. https://doi.org/10.1145/3452918.3458794
[93]
Ruben van Wendel de Joode. 2004. Managing Conflicts in Open Source Communities. Electronic Markets 14, 2 (2004), 104–113. https://doi.org/10.1080/10196780410001675059
[94]
Joel West and Michael Mace. 2010. Browsing as the killer app: Explaining the rapid success of Apple’s iPhone. Telecommunications Policy 34, 5-6 (June 2010), 270–286. https://doi.org/10.1016/J.℡POL.2009.12.002 Publisher: Pergamon.
[95]
Juliane Wissel, Michael Zaggl, and Aron Lindberg. 2019. How Companies Govern Their Open Source Software Contributions: A Case Study. In Fortieth International Conference on Information Systems. 10.
[96]
Donghee Yvette Wohn. 2019. Volunteer Moderators in Twitch Micro Communities. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300390
[97]
Donghee Yvette Wohn, Casey Fiesler, Libby Hemphill, Munmun De Choudhury, and J. Nathan Matias. 2017. How to handle online risks? Discussing content curation and moderation in social media. Conference on Human Factors in Computing Systems - Proceedings Part F1276 (May 2017), 1271–1276. https://doi.org/10.1145/3027063.3051141 ISBN: 9781450346566 Publisher: Association for Computing Machinery.
[98]
Donghee Yvette Wohn and Guo Freeman. 2020. Audience Management Practices of Live Streamers on Twitch. IMX 2020 - Proceedings of the 2020 ACM International Conference on Interactive Media Experiences (June 2020), 106–116. https://doi.org/10.1145/3391614.3393653 ISBN: 9781450379762 Publisher: Association for Computing Machinery, Inc.
[99]
Austin P. Wright, Omar Shaikh, Haekyu Park, Will Epperson, Muhammed Ahmed, Stephane Pinel, Duen Horng (polo) Chau, and Diyi Yang. 2021. Recast: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021). https://doi.org/10.1145/3449280 Publisher: Association for Computing Machinery _eprint: 2102.04427.
[100]
Deepika Yadav, Prerna Malik, Kirti Dabas, and Pushpendra Singh. 2019. Feedpal: Understanding Opportunities for Chatbots in Breastfeeding Education of Women in India. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 170:1–170:30. https://doi.org/10.1145/3359272
[101]
Ryan Yen, Li Feng, Brinda Mehra, Ching Christie Pang, Siying Hu, and Zhicong Lu. 2023. StoryChat: Designing a Narrative-Based Viewer Participation Tool for Live Streaming Chatrooms. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–18. https://doi.org/10.1145/3544548.3580912
[102]
Amy X. Zhang and Justin Cranshaw. 2018. Making Sense of Group Chat through Collaborative Tagging and Summarization. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 196:1–196:27. https://doi.org/10.1145/3274465
[103]
Amy X. Zhang, Grant Hugh, and Michael S. Bernstein. 2020. PolicyKit: Building Governance in Online Communities. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology(UIST ’20). Association for Computing Machinery, New York, NY, USA, 365–378. https://doi.org/10.1145/3379337.3415858
[104]
Lei (Nico) Zheng, Christopher M. Albano, Neev M. Vora, Feng Mai, and Jeffrey V. Nickerson. 2019. The Roles Bots Play in Wikipedia. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 215:1–215:20. https://doi.org/10.1145/3359317

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 May 2024

Permissions

Request permissions for this article.

Check for updates

Badges

  • Honorable Mention

Author Tags

  1. Community Management
  2. Community moderation
  3. Discord
  4. Extension and Bot Development
  5. Live Streaming
  6. Moderation Tools
  7. Platform Governance
  8. Third-Party Developers
  9. Twitch

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHI '24

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 751
    Total Downloads
  • Downloads (Last 12 months)751
  • Downloads (Last 6 weeks)201
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media