research-article

Predicting Controversy of Wikipedia Articles Using the Article Feedback Tool

Authors:

Michał Jankowski-Lorek,

Radosław Nielek,

Adam Wierzbicki,

Kazimierz ZielińskiAuthors Info & Claims

SocialCom '14: Proceedings of the 2014 International Conference on Social Computing

Pages 1 - 7

https://doi.org/10.1145/2639968.2640074

Published: 04 August 2014 Publication History

Abstract

Different points of view, opinions and controversies constitute the inherent part of modern society. Early detection of controversy is crucial for increasing productivity in peer production systems. The paper presents novelty approach to detecting controversial articles on the Wikipedia based on users ratings from Article Feedback Tool. The performance of proposed approach is on par with state-of-the-art solutions, but may also be applied outside Wikipedia-like systems. Additionally, emotion polarity measures can be used to locate controversial parts of articles, based on talk pages sections. With help of proposed algorithms, all articles in English Wikipedia have been tagged as either controversial or non-controversial. The dataset has been published and can be used by other researchers.

References

[1]

Buriol, editor. Temporal Evolution of the Wikigraph, Hong Kong, Dec. 2006. IEEE CS Press.

[2]

R. Chandy. Wikiganda: Identifying propaganda through text analysis. Caltech Undergraduate Research Journal. Winter, 2009, 2008.

[3]

S. Dori-Hacohen and J. Allan. Detecting controversy on the web. In Proceedings of the 22nd ACM international conference on Conference on information and knowledge management, CIKM '13, pages 1845--1848, New York, NY, USA, 2013. ACM.

Digital Library

[4]

R. Feldman, B. Rosenfeld, R. Bar-Haim, and M. Fresko. The stock sonar - sentiment analysis of stocks based on a hybrid approach. In D. G. Shapiro and M. P. J. Fromherz, editors, IAAI. AAAI, 2011.

[5]

O. Ferschke, I. Gurevych, and Y. Chebotar. Behind the article: Recognizing dialog acts in wikipedia talk pages. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL '12, pages 777--786, Stroudsburg, PA, USA, 2012. Association for Computational Linguistics.

Digital Library

[6]

A. Kittur, B. Suh, B. A. Pendleton, and E. H. Chi. He says, she says: Conflict and coordination in wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '07, pages 453--462, New York, NY, USA, 2007. ACM.

Digital Library

[7]

D. Laniado, A. Kaltenbrunner, C. Castillo, and M. F. Morell. Emotions and dialogue in a peer-production community: The case of wikipedia. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration, WikiSym '12, pages 9:1--9:10, New York, NY, USA, 2012. ACM.

Digital Library

[8]

R. K. Leik. A measure of ordinal consensus. The Pacific Sociological Review, Vol. 9:85--90, 1966.

[9]

R. Nielek, A. Wawer, M. Jankowski-Lorek, and A. Wierzbicki. Temporal, cultural and thematic aspects of web credibility. In Social Informatics, volume 8238 of Lecture Notes in Computer Science, pages 419--428. Springer International Publishing, 2013.

Digital Library

[10]

R. Nielek, A. Wawer, and A. Wierzbicki. Spiral of hatred: social effects in internet auctions. between informativity and emotion. Electronic Commerce Research, 10:313--330, 2010.

Digital Library

[11]

C. Okoli, M. Mehdi, M. Mesgari, F. A. Nielsen, and A. Lanamaki. The people's encyclopedia under the gaze of the sages: a systematic review of scholarly research on wikipedia. Social Science Research Network, 2012.

[12]

H. S. Rad and D. Barbosa. Identifying controversial articles in wikipedia: A comparative study. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration, WikiSym '12, pages 7:1--7:10, New York, NY, USA, 2012. ACM.

Digital Library

[13]

E. T. K. Sang and J. Bos. Predicting the 2011 dutch senate election results with twitter. In Proceedings of the Workshop on Semantic Analysis in Social Media, pages 53--60, Stroudsburg, PA, USA, 2012. Association for Computational Linguistics.

Digital Library

[14]

B. Stvilia, M. B. Twidale, L. C. Smith, and L. Gasser. Assessing information quality of a community-based encyclopedia. In IQ, 2005.

[15]

R. Sumi, T. Yasseri, A. Rung, A. Kornai, and J. Kertész. Characterization and prediction of wikipedia edit wars. In Proceedings of the ACM WebSci 11, 2011.

[16]

R. Sumi, T. Yasseri, A. Rung, A. Kornai, and J. Kertesz. Edit wars in wikipedia. In IEEE third international conference on social computing (socialcom), pages 724--727, Oct 2011.

[17]

A. Tumasjan, T. O. Sprenger, P. G. Sandner, and I. M. Welpe. Election forecasts with twitter: How 140 characters reflect the political landscape. Soc. Sci. Comput. Rev., 29(4):402--418, Nov. 2011.

Digital Library

[18]

F. B. Viegas, M. Wattenberg, and K. Dave. Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 575--582, 2004.

Digital Library

[19]

B.-Q. Vuong, E.-P. Lim, A. Sun, M.-T. Le, H. W. Lauw, and K. Chang. On ranking controversies in wikipedia: Models and evaluation. In Proceedings of the 2008 International Conference on Web Search and Data Mining, WSDM '08, pages 171--182, New York, NY, USA, 2008. ACM.

Digital Library

[20]

D. Wang, S. Zhu, and T. Li. Sumview: A web-based engine for summarizing product reviews and customer opinions. Expert Syst. Appl., 40(1):27--33, Jan. 2013.

Digital Library

[21]

A. Wawer and R. Nielek. Application of automated sentiment extraction from text to modeling of public opinion dynamics. Polish Journal of Environmental Studies, 17(3B):508--513, 2008.

[22]

A. Wawer and R. Nielek. Semantics and the Polish stock market. Towards automated financial web mining. Polish Journal of Environmental Studies, 18:282--285, 2009.

[23]

T. Yasseri, R. Sumi, A. Rung, A. Kornai, and J. Kertész. Dynamics of conflicts in wikipedia. PloS one, 7(6):e38869, 2012.

Cited By

Ren YZhang HKraut R(2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617369
Nielek RLutostańska MKopeć WWierzbicki ASheth ANgonga AWang yChang EŚlęzak DFranczyk BAlt RTao X(2017)Turned 70?Proceedings of the International Conference on Web Intelligence10.1145/3106426.3106539(899-906)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3106426.3106539
Jhandir MTenvir AOn BLee IChoi G(2017)Controversy detection in Wikipedia using semantic dissimilarityInformation Sciences: an International Journal10.1016/j.ins.2017.08.037418:C(581-600)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1016/j.ins.2017.08.037
Show More Cited By

Index Terms

Predicting Controversy of Wikipedia Articles Using the Article Feedback Tool
1. Social and professional topics
  1. Computing / technology policy

Recommendations

Societal Controversies in Wikipedia Articles
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Collaborative content creation inevitably reaches situations where different points of view lead to conflict. We focus on Wikipedia, the free encyclopedia anyone may edit, where disputes about content in controversial articles often reflect larger ...
Identifying controversial articles in Wikipedia: a comparative study
WikiSym '12: Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration

Wikipedia articles are the result of the collaborative editing of a diverse group of anonymous volunteer editors, who are passionate and knowledgeable about specific topics. One can argue that this plurality of perspectives leads to broader coverage of ...
Controversy detection in Wikipedia using semantic dissimilarity

The advent of search engines and wikis has made access to information easy and almost free. Wikipedia is the efficacious outcome of an enormous collaboration, and its peer review-like methods of creation, maintenance, and evolution of contents, ensure ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SocialCom '14: Proceedings of the 2014 International Conference on Social Computing

August 2014

115 pages

ISBN:9781450328883

DOI:10.1145/2639968

General Chairs:
Su Yang
Fudan University, China
,
Kristina Lerman
University of Southern California, USA
,
Program Chairs:
James She
HK Univ. of Science and Technology, HK, China
,
Martin Atzmueller
Universität Kassel, Germany

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SocialCom '14

SocialCom '14: International Conference on Social Computing

August 4 - 7, 2014

Beijing, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ren YZhang HKraut R(2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
https://dl.acm.org/doi/10.1145/3617369
Nielek RLutostańska MKopeć WWierzbicki ASheth ANgonga AWang yChang EŚlęzak DFranczyk BAlt RTao X(2017)Turned 70?Proceedings of the International Conference on Web Intelligence10.1145/3106426.3106539(899-906)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3106426.3106539
Jhandir MTenvir AOn BLee IChoi G(2017)Controversy detection in Wikipedia using semantic dissimilarityInformation Sciences: an International Journal10.1016/j.ins.2017.08.037418:C(581-600)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1016/j.ins.2017.08.037
Balcerzak BKopec WNielek RWarpechowski KCzajka A(2017)From Close the Door to Do not Click and Back. Security by Design for Older AdultsAdvances in Intelligent Systems and Computing II10.1007/978-3-319-70581-1_3(40-53)Online publication date: 22-Nov-2017
https://doi.org/10.1007/978-3-319-70581-1_3
Roozenbeek JTerentieva M(2017)Attention Please!Social Informatics10.1007/978-3-319-67256-4_15(169-191)Online publication date: 2-Sep-2017
https://doi.org/10.1007/978-3-319-67256-4_15
Rafalak MDeja DWierzbicki ANielek RKąkol M(2016)Web Content Classification Using Distributions of Subjective Quality EvaluationsACM Transactions on the Web10.1145/299413210:4(1-30)Online publication date: 15-Nov-2016
https://dl.acm.org/doi/10.1145/2994132
Abramczuk KKa̧kol MWierzbicki A(2016)How to Support the Lay Users Evaluations of Medical Information on the Web?Human Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_1(3-13)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40349-6_1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten