skip to main content
10.1145/1822258.1822291acmotherconferencesArticle/Chapter ViewAbstractPublication PageswikisymConference Proceedingsconference-collections
research-article

Wiki trust metrics based on phrasal analysis

Published: 08 September 2008 Publication History

Abstract

Wiki users receive very little guidance on the trustworthiness of the information they find. It is difficult for them to determine how long the text in a page has existed, or who originally authored the text. It is also difficult to assess the reliability of authors contributing to a wiki page. In this paper, we create a set of trust indicators and metrics derived from phrasal analysis of the article revision history. These metrics include author attribution, author reputation, expertise ratings, article evolution, and text trustworthiness. We also propose a new technique for collecting and maintaining explicit article ratings across multiple revisions.

References

[1]
Adler, B. T. and de Alfaro, L. 2007. A Content-Driven Reputation System for the Wikipedia. Proceedings of the 16th International World Wide Web Conference, 261--270, Banff, Canada. ACM Press, 2007.
[2]
Broder, A., Glassman, S., Manasse, M. and Zweig, G. 1997. Syntactic Clustering of the Web. In Proceedings of the 6th International Web Conference.
[3]
Brin, S., Davis, J. and García-Molina, H. 1995. Copy detection mechanisms for digital documents. In Proceedings of the 1995 ACM SIGMOD international Conference on Management of Data (San Jose, California, United States, May 22--25, 1995). M. Carey and D. Schneider, Eds. SIGMOD '95. ACM, New York, NY, 398--409.
[4]
Chesney, T. 1006. An empirical examination of Wikipedias credibility. First Monday, 11(11), 2006.
[5]
Chim, H. and Deng, X. 2007. A new suffix tree similarity measure for document clustering. In Proceedings of the 16th international Conference on World Wide Web (Banff, Alberta, Canada, May 08--12, 2007). WWW '07. ACM, New York, NY, 121--130.
[6]
Cormode, G., and Muthukrishnan, S. 2007. The string edit distance matching problem with moves. ACM Trans. on Algorithms. 3, 1 (Feb. 2007).
[7]
Greenwood, M. 1926. The "errors of sampling" of the survivorship tables. Appendix 1. In: Reports on public health and medical subjects. No. 33. London, UK: Her Majesty's Stationery Office.
[8]
Hao, T., Lu, Z., Wang, S., Zou, T., Gu, S., and Wenyin, L. 2008. Categorizing and ranking search engine's results by semantic similarity. In Proceedings of the 2nd international Conference on Ubiquitous information Management and Communication (Suwon, Korea, January 31 - February 01, 2008). ICUIMC '08. ACM, New York, NY, 284--288.
[9]
Kaplan, E. L. and Meier, P. 1958. Nonparametric estimation from incomplete observations, J Am Stat Assoc 53(282), 457--481.
[10]
Levenshtein, V. I. 1966. Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady, Vol. 10, p. 707.
[11]
Salton, G. and Buckley, C. 1988. Term-weighting approaches in automatic text retrieval. Inf. Process. Manage. 24, 5 (Aug. 1988), 513--523.
[12]
Schiffman. S. S., Reynolds, M. L., and Young. F. W. 1981. Introduction to Multidimensional Scaling. Academic Press, New York.
[13]
Viégas, F. B., Wattenberg, M. and Dave, K. 2004. Studying cooperation and conflict between authors with history flow visualization. Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 575--582 (April, 2004), Vienna, Austria.
[14]
Wilkinson, D. M. and Huberman, B. A. 2007. Assessing the value of cooperation in Wikipedia. WikiSym '07. October 2007, Montreal, Canada. ACM. arXiv:cs/070214v1.
[15]
Chi, E., Chi, H. Suh, B. and Kittur, A. 2008. Providing social transparency through visualizations in Wikipedia. Social Data Analysis Workshop, April, 2008, Florence, Italy.
[16]
Fetterly, D., Manasse, M., Nojork, M. 2005. Detecting phrase-level duplication on the World Wide Web. SIGIR '05, Salvador, Brazil (Aug. 2005).

Cited By

View all
  • (2024)ChatGPT: The Challenges It Presents for Writing AssignmentsTechTrends10.1007/s11528-024-00972-z68:4(705-710)Online publication date: 3-Jun-2024
  • (2022)Templates and Trust-o-meters: Towards a widely deployable indicator of trust in WikipediaProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517523(1-17)Online publication date: 29-Apr-2022
  • (2016)Measuring the Effectiveness of Wikipedia ArticlesHandbook of Research on Innovations in Information Retrieval, Analysis, and Management10.4018/978-1-4666-8833-9.ch002(41-61)Online publication date: 2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WikiSym '08: Proceedings of the 4th International Symposium on Wikis
September 2008
219 pages
ISBN:9781605581286
DOI:10.1145/1822258
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • University of Porto

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. attribution
  2. authorship
  3. collaboration
  4. reputation
  5. shingling
  6. wiki

Qualifiers

  • Research-article

Conference

WikiSym08
Sponsor:
WikiSym08: 2008 International Symposium on Wikis
September 8 - 10, 2008
Porto, Portugal

Acceptance Rates

Overall Acceptance Rate 69 of 145 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ChatGPT: The Challenges It Presents for Writing AssignmentsTechTrends10.1007/s11528-024-00972-z68:4(705-710)Online publication date: 3-Jun-2024
  • (2022)Templates and Trust-o-meters: Towards a widely deployable indicator of trust in WikipediaProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517523(1-17)Online publication date: 29-Apr-2022
  • (2016)Measuring the Effectiveness of Wikipedia ArticlesHandbook of Research on Innovations in Information Retrieval, Analysis, and Management10.4018/978-1-4666-8833-9.ch002(41-61)Online publication date: 2016
  • (2015)Quality Assessment of Wikipedia Articles Using h-indexJournal of Information Processing10.2197/ipsjjip.23.2223:1(22-30)Online publication date: 2015
  • (2013)Effects of Implicit Positive Ratings for Quality Assessment of Wikipedia ArticlesJournal of Information Processing10.2197/ipsjjip.21.34221:2(342-348)Online publication date: 2013
  • (2013)Dynamic Publication Formats and Collaborative AuthoringOpening Science10.1007/978-3-319-00026-8_13(191-211)Online publication date: 17-Dec-2013
  • (2012)Moving Wikis Behind the FirewallKnowledge Management 2.010.4018/978-1-61350-195-5.ch003(44-63)Online publication date: 2012
  • (2012)Mutual evaluation of editors and texts for assessing quality of Wikipedia articlesProceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration10.1145/2462932.2462956(1-10)Online publication date: 27-Aug-2012
  • (2011)Quality evaluation of wikipedia articles through edit history and editor groupsProceedings of the 13th Asia-Pacific web conference on Web technologies and applications10.5555/1996794.1996820(188-199)Online publication date: 18-Apr-2011
  • (2011)Wiki-Dic 2.0E-Strategies for Resource Management Systems10.4018/978-1-61692-016-6.ch011(185-198)Online publication date: 2011
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media