B. Thomas Adler
ABSTRACT
The Wikipedia is a collaborative encyclopedia: anyone can contribute to its articles simply by clicking on an "edit" button. The open nature of the Wikipedia has been key to its success, but has also created a challenge: how can readers develop an informed opinion on its reliability? We propose a system that computes quantitative values of trust for the text in Wikipedia articles; these trust values provide an indication of text reliability.
The system uses as input the revision history of each article, as well as information about the reputation of the contributing authors, as provided by a reputation system. The trust of a word in an article is computed on the basis of the reputation of the original author of the word, as well as the reputation of all authors who edited text near the word. The algorithm computes word trust values that vary smoothly across the text; the trust values can be visualized using varying text-background colors. The algorithm ensures that all changes to an article's text are reflected in the trust values, preventing surreptitious content changes.
We have implemented the proposed system, and we have used it to compute and display the trust of the text of thousands of articles of the English Wikipedia. To validate our trust-computation algorithms, we show that text labeled as low-trust has a significantly higher probability of being edited in the future than text labeled as high-trust.
- B. T. Adler and L. de Alfaro. A content-driven reputation system for the Wikipedia. In Proc. of the 16th Intl. World Wide Web Conf. (WWW 2007). ACM Press, 2007. Google Scholar
Digital Library
- C. Castelfranchi and eds. Y. Tan. Trust and Deception in Virtual Societies. Kluwer Academic Publishers, 2001. Google ScholarDigital Library
- A. Cheng and E. Friedman. Sybilproof reputation mechanisms. In Proc. of the ACM SIGCOMM workshop on Economics of peer-to-peer systems. ACM Press, 2005. Google ScholarDigital Library
- T. Cross. Puppy smoothies: Improving the reliability of open, collaborative wikis. First Monday, 11(9), September 2006.Google Scholar
- C. Dellarocas. The digitization of word-of-mouth: Promises and challenges of online reputation systems. Management Science, October 2003. Google ScholarDigital Library
- J. R. Douceur. The sybil attack. In Peer-to-Peer Systems: First Intl. Workshop, volume 2429 of Lect. Notes in Comp. Sci., pages 251--260, 2002. Google ScholarDigital Library
- W. Emigh and S. Herring. Collaborative authoring on the Web. In Proc. of HSCC, 2005.Google Scholar
- J. Giles. Internet encyclopaedias go head to head. Nature, pages 900--901, December 2005.Google Scholar
- J. A. Golbeck. Computing and Applying Trust in Web-Based Social Networks. PhD thesis, University of Maryland, 2005. Google ScholarDigital Library
- T. Grandison and M. Sloman. A survey of trust in internet application. IEEE Comm. Surveys Tutorials, 3(4), 2000. Google ScholarDigital Library
- R. Guha, R. Kumar, P. Raghavan, and A. Tomkins. Propagation of trust and distrust. In Proc. of the 13th Intl. Conf. on World Wide Web, pages 403--412. ACM Press, 2004. Google ScholarDigital Library
- M. Hickman and G. Roberts. Wikipedia --- separating fact from fiction. The New Zealand Herald, Feb. 13 2006.Google Scholar
- S. D. Kamvar, M. T. Schlosser, and H. Garcia-Molina. The eigentrust algorithm for reputation management in p2p networks. In Proc. of the 12th Intl. Conf. on World Wide Web, pages 640--651. ACM Press, 2003. Google ScholarDigital Library
- R. King. Contributor ranking system, 2007. White paper available from http://trust.cse.ucsc.edu/Related_Work.Google Scholar
- J. M. Kleinberg. Authoritative sources in a hyperlinked environment. J. ACM, 46(5):604--632, 1999. Google ScholarDigital Library
- Xavier Leroy. Objective caml. http://caml.inria.fr/ocaml/index.en.html.Google Scholar
- B. N. Levine, C. Shields, and N. B. Margolin. A survey of solutions to the sybil attack. Technical Report Technical Report 2006-052, Univ. of Massachussets Amherst, 2006.Google Scholar
- A. Lih. Wikipedia as participatory journalism. In Proc. 5th International Symposium on Online Journalism, 2004.Google Scholar
- V. B. Livshits and T. Zimmerman. Dynamine: Finding common error patterns by mining software revision histories. In ESEC/FSE, pages 296--305, 2005. Google ScholarDigital Library
- P. Massa. Wikipedia trust network, 2007. http://www.gnuband.org/2007/06/26/wikipedia_trust_network/.Google Scholar
- D. L. McGuinness, H. Zeng, P. P. da Silva, L. Ding, D. Narayanan, and M. Bhaowal. Investigation into trust for collaborative information repositories: A Wikipedia case study. In Proceedings of the Workshop on Models of Trust for the Web, 2006.Google Scholar
- http://www.mediawiki.org/.Google Scholar
- B. Mingus, T. Pincock, and L. Rassbach. Using natural language processing to determine the quality of Wikipedia articles. In Wikimania, Taipei, Taiwan, 2007. http://wikimania2007.wikimedia.org/wiki/Proceedings:BM1.Google Scholar
- F. Ortega and J. M. Gonzales-Barahona. Quantitative analysis of the Wikipedia community of users. In Proc. of Wikisym. ACM Press, 2007. Google ScholarDigital Library
- P. Resnick, R. Zeckhauser, E. Friedman, and K. Kiwabara. Reputation systems. Comm. ACM, 43(12):45--48, 2000. Google ScholarDigital Library
- J.-M. Seigneur, A. Gray, and C. D. Jensen. Trust transfer: Encouraging self-recommendations without sybil attack. In Trust Management, volume 3477 of Lect. Notes in Comp. Sci. Springer-Verlag, 2005. Google ScholarDigital Library
- R. Stross. Anonymous source is not the same as open source. The New York Times, Mar. 12, 2006.Google Scholar
- W. F. Tichy. The string-to-string correction problem with block move. ACM Trans. on Computer Systems, 2(4), 1984. Google ScholarDigital Library
- The ucsc wikipedia trust project, 2007. http://trust.cse.ucsc.edu.Google Scholar
- F. Viégas, M. Wattenberg, and K. Dave. Studying cooperation and conflict between authors with history flow visualizations. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pages 575--582, 2004. Google ScholarDigital Library
- J. Voss. Measuring Wikipedia. In Proc. of ISSI, 2005.Google Scholar
- http://stats.wikimedia.org/EN/TablesDatabaseEdits.htm.Google Scholar
- D. Wilkinson and B. Huberman. Cooperation and quality in Wikipedia. In Proc. of WikiSym. ACM Press, 2007. Google ScholarDigital Library
- H. Zeng, M. Alhossaini, R. Fikes, and D. L. McGuinness. Mining revision history to assess trustworthiness of article fragments. In Proc. of the 2nd Intl. Conf. on Collaborative Computing: Networking, Applications, and Worksharing (COLLABORATECOM), 2006.Google ScholarCross Ref
- H. Zeng, M. A. Alhoussaini, L. Ding, R. Fikes, and D. L. McGuinness. Computing trust from revision history. In Intl. Conf. on Privacy, Security and Trust, 2006. Google ScholarDigital Library
Index Terms
- Assigning trust to Wikipedia content
Recommendations
Trust in wikipedia: how users trust information from an unknown source
WICOW '10: Proceedings of the 4th workshop on Information credibilityThe use of Wikipedia as an information source is becoming increasingly popular. Several studies have shown that its information quality is high. Normally, when considering information trust, the source of information is an important factor. However, ...
Benevolence trust: a key determinant of user continuance use of online social networks
Online social networking (OSN) has attracted increased attention and growing membership in recent years. In this paper, we propose and test an extended and unified theory of acceptance and use of technology (UTAUT) model, including the additional areas ...
Does Technology Trust Substitute Interpersonal Trust?: Examining Technology Trust's Influence on Individual Decision-Making
While an increasing number of trust studies examine technological artifacts as trust recipients, there is still a lack of basic understanding of how technology trust relates to traditional trust and its role within the broader nomological net ...
Comments