skip to main content
10.1145/3369457.3369491acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
short-paper

Towards Effective Crowd-Powered Online Content Moderation

Published: 10 January 2020 Publication History

Abstract

Content moderation is an important element of social computing systems that facilitates positive social interaction in online platforms. Current solutions for moderation including human moderation via commercial teams are not effective and have failed to meet the demands of growing volumes of online user generated content. Through a study where we ask crowd workers to moderate tweets, we demonstrate that crowdsourcing is a promising solution for content moderation. We also report a strong relationship between the sentiment of a tweet and its appropriateness to appear in public media. Our analysis on worker responses further reveals several key factors that affect the judgement of crowd moderators when deciding on the suitability of text content. Our findings contribute towards the development of future robust moderation systems that utilise crowdsourcing.

References

[1]
Daren C. Brabham. 2008. Crowdsourcing as a Model for Problem Solving: An Introduction and Cases. Convergence 14, 1 (2008), 75--90. https://doi.org/10.1177/1354856507084420
[2]
Despoina Chatzakou, Nicolas Kourtellis, Jeremy Blackburn, Emiliano De Cristofaro, Gianluca Stringhini, and Athena Vakali. 2017. Mean Birds: Detecting Aggression and Bullying on Twitter. In Proceedings of the 2017 ACM on Web Science Conference (WebSci '17). ACM, New York, NY, USA, 13--22. https://doi.org/10.1145/3091478.3091487
[3]
Djellel Eddine Difallah, Michele Catasta, Gianluca Demartini, Panagiotis G. Ipeirotis, and Philippe Cudré-Mauroux. 2015. The Dynamics of Micro-Task Crowdsourcing: The Case of Amazon MTurk. In Proceedings of the 24th International Conference on World Wide Web (WWW '15). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 238--247. https://doi.org/10.1145/2736277.2741685
[4]
Antigoni Maria Founta, Constantinos Djouvas, Despoina Chatzakou, Ilias Leontiadis, Jeremy Blackburn, Gianluca Stringhini, Athena Vakali, Michael Sirivianos, and Nicolas Kourtellis. 2018. Large Scale Crowdsourcing and Characterization of Twitter Abusive Behavior. In Twelfth International AAAI Conference on Web and Social Media. AAAI Press.
[5]
Arpita Ghosh, Satyen Kale, and Preston McAfee. 2011. Who Moderates the Moderators?: Crowdsourcing Abuse Detection in User-generated Content. In Proceedings of the 12th ACM Conference on Electronic Commerce (EC '11). ACM, New York, NY, USA, 167--176. https://doi.org/10.1145/1993574.1993599
[6]
Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, content moderation, and the hidden decisions that shape social media. Yale University Press.
[7]
Jorge Goncalves, Denzil Ferreira, Simo Hosio, Yong Liu, Jakob Rogstadius, Hannu Kukka, and Vassilis Kostakos. 2013. Crowdsourcing on the Spot: Altruistic Use of Public Displays, Feasibility, Performance, and Behaviours. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 753--762. https://doi.org/10.1145/2493432.2493481
[8]
Jorge Goncalves, Simo Hosio, Denzil Ferreira, and Vassilis Kostakos. 2014. Game of Words: Tagging Places Through Crowdsourcing on Public Displays. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). 705--714. https://doi.org/10.1145/2598510.2598514
[9]
Jorge Goncalves, Simo Hosio, Jakob Rogstadius, Evangelos Karapanos, and Vassilis Kostakos. 2015. Motivating participation and improving quality of contribution in ubiquitous crowdsourcing. Computer Networks 90 (2015), 34 -- 48. https://doi.org/10.1016/j.comnet.2015.07.002
[10]
Jorge Goncalves, Simo Hosio, Niels van Berkel, Furqan Ahmed, and Vassilis Kostakos. 2017. CrowdPickUp: Crowdsourcing Task Pickup in the Wild. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 51 (Sept. 2017), 22 pages. https://doi.org/10.1145/3130916
[11]
Jorge Goncalves, Hannu Kukka, Iván Sánchez, and Vassilis Kostakos. 2016. Crowdsourcing Queue Estimations in Situ. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 1040--1051. https://doi.org/10.1145/2818048.2819997
[12]
Sian Gooding, Ekaterina Kochmar, Advait Sarkar, and Alan Blackwell. 2019. Comparative judgments are more consistent than binary classification for labelling word complexity. In Proceedings of the 13th Linguistic Annotation Workshop. Association for Computational Linguistics, Florence, Italy, 208--214. https://doi.org/10.18653/v1/W19-4024
[13]
Miriam Greis, Florian Alt, Niels Henze, and Nemanja Memarovic. 2014. I Can Wait a Minute: Uncovering the Optimal Delay Time for Pre-moderated User-generated Content on Public Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1435--1438. https://doi.org/10.1145/2556288.2557186
[14]
Christopher Glenn Harris. 2012. Detecting deceptive opinion spam using human computation. In Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence. AAAI Press.
[15]
Simo Hosio, Jorge Goncalves, Vassilis Kostakos, and Jukka Riekki. 2015. Crowdsourcing Public Opinion Using Urban Pervasive Technologies: Lessons From Real-Life Experiments in Oulu. Policy & Internet 7, 2 (2015), 203--222. https://doi.org/10.1002/poi3.90
[16]
Simo Hosio, Jorge Goncalves, Vili Lehdonvirta, Denzil Ferreira, and Vassilis Kostakos. 2014. Situated Crowdsourcing Using a Market Model. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 55--64. https://doi.org/10.1145/2642918.2647362
[17]
Clayton J. Hutto and Eric Gilbert. 2014. VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. In Eighth International AAAI Conference on Web and Social Media. AAAI Press.
[18]
Aniket Kittur, Ed H. Chi, and Bongwon Suh. 2008. Crowdsourcing User Studies with Mechanical Turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 453--456. https://doi.org/10.1145/1357054.1357127
[19]
Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of Crowd Work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, NY, USA, 1301--1318. https://doi.org/10.1145/2441776.2441923
[20]
Efthymios Kouloumpis, Theresa Wilson, and Johanna Moore. 2011. Twitter Sentiment Analysis: The Good the Bad and the OMG!. In Fifth International AAAI Conference on Web and Social Media. AAAI Press.
[21]
Anand Kulkarni, Philipp Gutheim, Prayag Narula, David Rolnitzky, Tapan Parikh, and Björn Hartmann. 2012. MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture. IEEE Internet Computing 16, 5 (Sep. 2012), 28--35. https://doi.org/10.1109/MIC.2012.72
[22]
Cliff Lampe and Paul Resnick. 2004. Slash(Dot) and Burn: Distributed Moderation in a Large Online Conversation Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 543--550. https://doi.org/10.1145/985692.985761
[23]
Cliff Lampe, Paul Zube, Jusil Lee, Chul Hyun Park, and Erik Johnston. 2014. Crowdsourcing civility: A natural experiment examining the effects of distributed moderation in online forums. Government Information Quarterly 31, 2 (2014), 317 -- 326. https://doi.org/10.1016/j.giq.2013.11.005
[24]
Chikashi Nobata, Joel Tetreault, Achint Thomas, Yashar Mehdad, and Yi Chang. 2016. Abusive Language Detection in Online User Content. In Proceedings of the 25th International Conference on World Wide Web (WWW '16). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 145--153. https://doi.org/10.1145/2872427.2883062
[25]
Sarah T. Roberts. 2016. Commercial Content Moderation: Digital Laborers' Dirty Work. Peter Lang, Bern, Switzerland.
[26]
Anna Schmidt and Michael Wiegand. 2017. A survey on hate speech detection using natural language processing. In Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media. 1--10.
[27]
Oksana Tokarchuk, Roberta Cuel, and Marco Zamarian. 2012. Analyzing Crowd Labor and Designing Incentives for Humans in the Loop. IEEE Internet Computing 16, 5 (Sep. 2012), 45--51. https://doi.org/10.1109/MIC.2012.66
[28]
Hao Wang, Dogan Can, Abe Kazemzadeh, François Bar, and Shrikanth Narayanan. 2012. A system for real-time twitter sentiment analysis of 2012 us presidential election cycle. In Proceedings of the ACL 2012 system demonstrations. Association for Computational Linguistics, 115--120.
[29]
Quanzeng You, Jiebo Luo, Hailin Jin, and Jianchao Yang. 2015. Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks. In Twenty-ninth AAAI Conference on Artificial Intelligence. AAAI Press.

Cited By

View all
  • (2024)Combatting online hate: Crowd moderation and the public goods problemCommunications10.1515/commun-2023-010949:3(444-467)Online publication date: 5-Sep-2024
  • (2024)The Explanation That Hits Home: The Characteristics of Verbal Explanations That Affect Human Perception in Subjective Decision-MakingProceedings of the ACM on Human-Computer Interaction10.1145/36870568:CSCW2(1-37)Online publication date: 8-Nov-2024
  • (2024)Combating Islamophobia: Compromise, Community, and Harmony in Mitigating Harmful Online ContentACM Transactions on Social Computing10.1145/36415107:1-4(1-32)Online publication date: 27-Apr-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction
December 2019
631 pages
ISBN:9781450376969
DOI:10.1145/3369457
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

  • HFESA: Human Factors and Ergonomics Society of Australia Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 January 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. content moderation
  2. crowdsourcing
  3. social computing
  4. twitter sentiment analysis

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

OZCHI'19
OZCHI'19: 31ST AUSTRALIAN CONFERENCE ON HUMAN-COMPUTER-INTERACTION
December 2 - 5, 2019
WA, Fremantle, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)109
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Combatting online hate: Crowd moderation and the public goods problemCommunications10.1515/commun-2023-010949:3(444-467)Online publication date: 5-Sep-2024
  • (2024)The Explanation That Hits Home: The Characteristics of Verbal Explanations That Affect Human Perception in Subjective Decision-MakingProceedings of the ACM on Human-Computer Interaction10.1145/36870568:CSCW2(1-37)Online publication date: 8-Nov-2024
  • (2024)Combating Islamophobia: Compromise, Community, and Harmony in Mitigating Harmful Online ContentACM Transactions on Social Computing10.1145/36415107:1-4(1-32)Online publication date: 27-Apr-2024
  • (2024)Linguistically Differentiating Acts and Recalls of Racial Microaggressions on Social MediaProceedings of the ACM on Human-Computer Interaction10.1145/36373668:CSCW1(1-36)Online publication date: 26-Apr-2024
  • (2024)The ``Colonial Impulse" of Natural Language Processing: An Audit of Bengali Sentiment Analysis Tools and Their Identity-based BiasesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642669(1-18)Online publication date: 11-May-2024
  • (2024)Examining the Impact of Digital Jury Moderation on the Polarization of U.S. Political Communities on Social MediaInteracting with Computers10.1093/iwc/iwae036Online publication date: 30-Aug-2024
  • (2024)Efficiency of Community-Based Content Moderation Mechanisms: A Discussion Focused on BirdwatchGroup Decision and Negotiation10.1007/s10726-024-09881-133:3(673-709)Online publication date: 23-Mar-2024
  • (2023)The ethical ambiguity of AI data enrichment: Measuring gaps in research ethics norms and practicesProceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency10.1145/3593013.3593995(261-270)Online publication date: 12-Jun-2023
  • (2023)Studying Multi-dimensional Marginalization of Identity from Decolonial and Postcolonial PerspectivesCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3608920(437-440)Online publication date: 14-Oct-2023
  • (2023)What You Show is What You Get! Gestures for Microtask CrowdsourcingCompanion Proceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581754.3584175(255-258)Online publication date: 27-Mar-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media