skip to main content
10.1145/1641309.1641333acmotherconferencesArticle/Chapter ViewAbstractPublication PageswikisymConference Proceedingsconference-collections
research-article

Assessing the quality of Wikipedia articles with lifecycle based metrics

Published: 25 October 2009 Publication History

Abstract

The main feature of the free online-encyclopedia Wikipedia is the wiki-tool, which allows viewers to edit the articles directly in the web browser. As a weakness of this openness for example the possibility of manipulation and vandalism cannot be ruled out, so that the quality of any given Wikipedia article is not guaranteed. Hence the automatic quality assessment has been becoming a high active research field. In this paper we offer new metrics for an efficient quality measurement. The metrics are based on the lifecycles of low and high quality articles, which refer to the changes of the persistent and transient contributions throughout the entire life span.

References

[1]
Adler, B. T. and de Alfaro, L. 2007. A Content-Driven Reputation System for the Wikipedia. In Proceedings of the 16th International Conference on the World Wide Web. 261--270, (May, 2007), Banff, Canada.
[2]
Adler, B. T., Chatterjee, K., de Alfaro, L., Faella, M., Pye, I. and Raman, V. 2008. Assigning Trust To Wikipedia Content. In Proceedings of the 2008 International Symposium on Wikis. (September, 2008), Porto, Portugal.
[3]
Blumenstock, J. E. 2008. Size Matters: Word Count as a Measure of Quality on Wikipedia. In Proceedings of the 17th international conference on World Wide Web. 1095--1096, (April, 2008). Beijing, China.
[4]
Cross, T. 2006. Puppy smoothies: Improving the reliability of open, collaborative wikis. In First Monday, 11(9), September 2006.
[5]
Cunningham, W. and Leuf, B. 2001. The Wiki Way. Quick Collaboration on the Web. Addison-Wesley.
[6]
Dondio, P. and Barrett, S. 2007. Computational Trust in Web Content Quality: A Comparative Evalutation on the Wikipedia Project. In Informatica --- An International Journal of Computing and Informatics, 31/2, 151--160.
[7]
Giles, G. 2005. Internet encyclopedias go head to head. In Nature, 438, 7070, 900--901.
[8]
Hoisl, B., Aigner, W. and Miksch, S. 2007. Social Rewarding in Wiki Systems --- Motivating the Community. In Proceedings of the second Online Communities and Social Computing. 362--371, (July, 2007), Beijing, China.
[9]
Hunt, J. and McIlroy, M. 1975. An algorithm for differential file comparison. Computer Science Technical Report 41, Bell Laboratories.
[10]
Kittur, A., Suh, B., Pendleton, B. A. and Chi, E. H. 2007. He says, she says: Conflict and coordination in Wikipedia. 25th Annual ACM Conference on Human Factors in Computing Systems (CHI 2007). 453--462, (April/May, 2007), San Jose, USA
[11]
Kramer, M. Gregorowicz, A. and Iyer, B. 2008. Wiki Trust Metrics based on Phrasal Analysis. In Proceedings of the 2008 International Symposium on Wikis, (September, 2008), Porto, Portugal.
[12]
Lih, A. 2004. Wikipedia as participatory journalism: Reliable sources? metrics for evaluating collaborative media as a news resource. In Proceedings of the 5th International Symposium on Online Journalism, (April, 2004), Austin, USA
[13]
Lim, E. P., Vuong, B. Q., Lauw, H. W. and Sun, A. 2006. Measuring Qualities of Articles Contributed by OnlineCommunities. In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence. 81--87, (December, 2006), Hong Kong.
[14]
O'Reilly, T. 2005. What is Web2.0? http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/what-is-web-20.html.
[15]
Priedhorsky, R., Chen, J., Lam, S. K., Panciera, K., Terveen, L. and Riedl, J. 2007. Creating, Destroying, and Restoring Value in Wikipedia. In Proceedings of the 2007 international ACM conference on Supporting group work, 259--268, (November, 2007), Sanibel Island, USA.
[16]
Sabel, M. 2007. Structuring wiki revision history. In Proceedings of the 2007 International Symposium on Wikis. 125--130. (October, 2007), Montreal, Canada.
[17]
Smets, K., Goethals, B. and Verdonk, B. 2008. Automatic Vandalism Detection in Wikipedia: Towards a Machine Learning Approach. In Proceedings of the AAAI Workshop, Wikipedia and Artificial Intelligence: An Evolving Synergy (WikiAI08). (July, 2008), Chicago, USA
[18]
Stvilia, B., Twidale, M. B., Smith, L. C. and Gasser, L. 2005. Assessing information quality of a community-based encyclopedia. In Proceedings of the International Conference on Information Quality, 442--454, (November, 2005), Cambridge, USA
[19]
Potthast, M., Stein, B., and Gerling, R. 2008. Automatic Vandalism Detection in Wikipedia. In Proceedings of the Advances in Information Retrieval - 30th European Conference on IR Research. 663--668, (March/April, 2008), Glasgow, UK.
[20]
Víegas, F., Wattenberg, M. and Dave, K. 2004. Studying cooperation and conflict between authors with history flow visualizations. In Proceedings of the SIGCHI Conf. on Human Factors in Computing Systems, 575--582, (April, 2004), Vienna, Austria.
[21]
Viégas, F., Wattenberg, M., Kriss, J. and Ham, F. 2007. Talk before you type: Coordination in Wikipedia. In Proceedings of the 40th Hawaii International Conference on System Sciences. 78--88, (January, 2007), Hawaii, USA.
[22]
Wikipedia. 2009. Autorenportal. http://de.wikipedia.org/wiki/Wikipedia:Autorenportal
[23]
Wikipedia. 2009. Multilingual statistics. http://en.wikipedia.org/wiki/Wikipedia:Multilingual_statistics
[24]
Wilkinson, D. and Huberman, B. 2007. Cooperation and quality in Wikipedia. In Proceedings of the 2007 International Symposium on Wikis. 157--164, (October, 2007), Montreal, Canada.
[25]
Zeng, H., Alhoussaini, M., Ding, L., Fikes R., and McGuinness, D. 2006. Computing trust from revision history. In Proceedings of the Intl. Conf. on Privacy, Security and Trust, (October/November, 2006), Markham, Canada.

Cited By

View all
  • (2024)ChatGPT: The Challenges It Presents for Writing AssignmentsTechTrends10.1007/s11528-024-00972-z68:4(705-710)Online publication date: 3-Jun-2024
  • (2023)Automatic Quality Assessment of Wikipedia Articles—A Systematic Literature ReviewACM Computing Surveys10.1145/362528656:4(1-37)Online publication date: 10-Nov-2023
  • (2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WikiSym '09: Proceedings of the 5th International Symposium on Wikis and Open Collaboration
October 2009
200 pages
ISBN:9781605587301
DOI:10.1145/1641309
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • John Ernest Foundation

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Wikipedia
  2. Wikipedia lifecycle
  3. persistent contribution
  4. quality assessment
  5. transient contribution

Qualifiers

  • Research-article

Conference

WikiSym '09
Sponsor:
WikiSym '09: 2009 International Symposium on Wikis
October 25 - 27, 2009
Florida, Orlando

Acceptance Rates

WikiSym '09 Paper Acceptance Rate 16 of 45 submissions, 36%;
Overall Acceptance Rate 69 of 145 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ChatGPT: The Challenges It Presents for Writing AssignmentsTechTrends10.1007/s11528-024-00972-z68:4(705-710)Online publication date: 3-Jun-2024
  • (2023)Automatic Quality Assessment of Wikipedia Articles—A Systematic Literature ReviewACM Computing Surveys10.1145/362528656:4(1-37)Online publication date: 10-Nov-2023
  • (2023)How Did They Build the Free Encyclopedia? A Literature Review of Collaboration and Coordination among Wikipedia EditorsACM Transactions on Computer-Human Interaction10.1145/361736931:1(1-48)Online publication date: 29-Nov-2023
  • (2022)Quality Change: Norm or Exception? Measurement, Analysis and Detection of Quality Change in WikipediaProceedings of the ACM on Human-Computer Interaction10.1145/35129596:CSCW1(1-36)Online publication date: 7-Apr-2022
  • (2022)Templates and Trust-o-meters: Towards a widely deployable indicator of trust in WikipediaProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517523(1-17)Online publication date: 29-Apr-2022
  • (2022)Assessing Information Quality of Wikipedia Articles Through Google’s E-A-T ModelIEEE Access10.1109/ACCESS.2022.317296210(52196-52209)Online publication date: 2022
  • (2021)Assessing the Quality of Sources in Wikidata Across Languages: A Hybrid ApproachJournal of Data and Information Quality10.1145/348482813:4(1-35)Online publication date: 15-Oct-2021
  • (2021)Structural Analysis of Wikigraph to Investigate Quality Grades of Wikipedia ArticlesCompanion Proceedings of the Web Conference 202110.1145/3442442.3452345(584-590)Online publication date: 19-Apr-2021
  • (2021)Tracing the Factoids: the Anatomy of Information Re-organization in Wikipedia ArticlesCompanion Proceedings of the Web Conference 202110.1145/3442442.3452342(572-579)Online publication date: 19-Apr-2021
  • (2021)Mapping Trusted Paths to VGIProvenance and Annotation of Data and Processes10.1007/978-3-030-80960-7_13(207-210)Online publication date: 9-Jul-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media