research-article

Assessing the Contribution of Subject-matter Experts to Wikipedia

Authors:

Ofer ArazyAuthors Info & Claims

ACM Transactions on Social Computing, Volume 3, Issue 4

Article No.: 21, Pages 1 - 36

https://doi.org/10.1145/3416853

Published: 16 October 2020 Publication History

Abstract

Attempts to explain the success of knowledge co-production communities have focused on organizational design, including structure, motivation, roles, and coordination mechanisms. Meantime, the role that subject-matter-experts play in these knowledge production settings has largely been left in a theoretical and empirical void; its existence has been assumed, but we know little about its nature and scope, as it is difficult to observe. In this article, we start filling that void, using Wikipedia as the setting for our empirical investigation. First, we carefully crossed information from individual Wikipedia editor pages with external sources such as Google Scholar to reliably identify editors who are credentialed experts. Matching these credentialed experts with their Wikipedia editing patterns, we used this dataset to train a machine learning classifier that we then employed to identify additional expert editors and assess the nature and the scope of their work across Wikipedia. Our results suggest that the scope of expert involvement is substantial, albeit with considerable differences across topics. We estimate that approximately 10%--30% of Wikipedia’s contributors have substantial subject-matter expertise in the topics that they edit. We discuss implications for theory and practice of peer-production.

References

[1]

Aleksi Aaltonen and Giovan Francesco Lanzara. 2015. Building governance capability in online social production: Insights from Wikipedia. Organiz. Stud. 36, 12 (2015), 1649--1673.

[2]

Mark S. Ackerman. 1998. Augmenting organizational memory: A field study of answer garden. ACM Trans. Inf. Syst. 16, 3 (1998), 203--224.

Digital Library

[3]

Lada A. Adamic, Jun Zhang, Eytan Bakshy, and Mark S. Ackerman. 2008. Knowledge sharing and Yahoo answers: Everyone knows something. In Proceedings of the 17th International Conference on World Wide Web. ACM, 665--674.

[4]

B. Thomas Adler and Luca De Alfaro. 2007. A content-driven reputation system for the Wikipedia. In Proceedings of the 16th International Conference on World Wide Web. ACM, 261--270.

Digital Library

[5]

B. Thomas Adler, Luca De Alfaro, Ian Pye, and Vishwanath Raman. 2008. Measuring author contributions to the Wikipedia. In Proceedings of the 4th International Symposium on Wikis and Open Collaboration. ACM, 15.

Digital Library

[6]

Denise Anthony, Sean W. Smith, and Tim Williamson. 2007. The quality of open source production: Zealots and good Samaritans in the case of Wikipedia. Rationality and Society (2007), 32.

[7]

Ofer Arazy, J. Daxenberger, H. Lifshitz-Assaf, O. Nov, and I. Gurevych. 2016. Turbulent stability of emergent roles: The dualistic nature of self-organizing knowledge co-production. Inf. Syst. Res. 27, 4 (2016), 792--812.

Digital Library

[8]

Ofer Arazy and Ian Gellatly. 2013. Corporate Wikis: The effects of owners’ motivation and behavior on group members’ engagement. J. Manag. Inf. Syst. 29, 3 (2013), 87--116.

[9]

O. Arazy, I. Gellatly, E. Brainin, and O. Nov. 2016. Motivation to share knowledge using Wiki technology and the moderating effect of role perceptions. Journal of the Association for Information Science and Technology 67, 10 (2016), 2362--2378.

Digital Library

[10]

O. Arazy, H. Lifshitz-Assaf, O. Nov, J. Daxenberger, M. Balestra, and C. Cheshire. 2017. On the how and why of temporal dynamics of emergent roles in Wikipedia. In Proceedings of the 20th Conference on Computer-supported Cooperative Work and Social Computing (CSCW’17).

[11]

Ofer Arazy, Aron Lindberg, Shakked Lev, Kexian Wu, and Alex Yarovoy. 2020. Emergent routines in peer-production: Examining the temporal evolution of Wikipedia’s work sequences. ACM Trans. Soc. Comput. 3, 1 (2020), 1--24.

Digital Library

[12]

Ofer Arazy, Aron Lindberg, Mostafa Rezaei, and Michele Samorani. forthcoming. The evolutionary trajectories of peer-produced artifacts: Group composition, the trajectories’ exploration, and the quality of artifacts. Manag. Inf. Syst. Quart. (forthcoming).

[13]

Ofer Arazy, Oded Nov, and Felipe Ortega. 2014. The Wikipedia world is not flat: On the organizational structure of online production communities. In Proceedings of the 22nd European Conference on Information Systems.

[14]

Ofer Arazy, Oded Nov, Raymond Patterson, and Lisa Yeo. 2011. Information quality in Wikipedia: The effects of group composition and task conflict. J. Manag. Inf. Syst. 27, 4 (2011), 71--98.

Digital Library

[15]

Ofer Arazy, Felipe Ortega, Oded Nov, Lisa Yeo, and Adam Balila. 2015. Functional roles and career paths in Wikipedia. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 1092--1105.

Digital Library

[16]

O. Arazy, L. Yeo, and O. Nov. 2013. Stay on the Wikipedia task: When task-related disagreements slip into personal and procedural conflicts. J. Amer. Soc. Inf. Sci. Technol. 64, 8 (2013), 1634--1648.

[17]

Çiğdem Aslay, Neil O’Hare, Luca Maria Aiello, and Alejandro Jaimes. 2013. Competition-based networks for expert finding. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 1033--1036.

Digital Library

[18]

N. Auray. 2012. Online Communities and Governance Mechanisms. Cambridge University Press.

[19]

Samy A. Azer. 2014. Evaluation of gastroenterology and hepatology articles on Wikipedia: Are they suitable as learning resources for medical students? Eur. J. Gastroent. Hepatol. 26, 2 (2014), 155--163.

[20]

Martina Balestra, Lior Zalmanson, Coye Cheshire, Ofer Arazy, and Oded Nov. 2017. It was fun, but did it last? The dynamic interplay between fun motives and contributors’ activity in peer-production. Hum.-comput. Interact. 1 (2017), 1.

Digital Library

[21]

Yoav Benjamini and Yosef Hochberg. 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc.: Series B (Methodol.) 57, 1 (1995), 289--300.

[22]

Yochai Benkler. 2002. Coase’s Penguin, or, Linux and “The nature of the firm.”Yale Law J. 112, 3 (2002), 369--446. Retrieved from http://www.jstor.org/stable/1562247.

[23]

Yochai Benkler. 2006. The Wealth of Networks: How Social Production Transforms Markets and Freedom. Yale University Press. Retrieved from http://cyber.law.harvard.edu/wealth_of_networks/Main_Page.

Digital Library

[24]

Carl Bereiter and Marlene Scardamalia. 1993. Surpassing Ourselves: An Inquiry into the Nature and Implications of Expertise. Open Court.

[25]

I. Beschastnikh, T. Kriplean, and D. W. McDonald. 2008. Wikipedian self-governance in action: Motivating the policy lens. In Proceedings of the International Conference on Weblogs and Social Media (ICWSM’08). AAAI.

[26]

Mohamed Bouguessa, Benoît Dumoulin, and Shengrui Wang. 2008. Identifying authoritative actors in question-answering forums: The case of Yahoo! answers. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 866--874.

Digital Library

[27]

John G. Breslin, Uldis Bojars, Boanerges Aleman-Meza, Harold Boley, Malgorzata Mochol, Lyndon J. B. Nixon, Axel Polleres, and Anna V. Zhdanova. 2007. Finding experts using Internet-based discussions in online communities and associated social networks. In Proceedings of the 1st International ExpertFinder Workshop, Vol. 11. 38--47.

[28]

Oliver Burkeman. 2006. Wikipedia: Jimmy Wales. The Guardian, International edition. Retrieved from https://www.theguardian.com/technology/2006/nov/04/wikipedia.web20.

[29]

B. Butler, E. Joyce, and J. Pike. 2008. Don’t look now, but we’ve created a bureaucracy: The nature and roles of policies and rules in Wikipedia. In Proceedings of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (Session: Shared Authoring). ACM, 1101--1110.

[30]

Brian Butler, S. Sproull, Sara Kiesler, and Robert E. Kraut. 2007. Community Effort in Online Communities: Who Does the Work and Why. Lawrence Erlbaum Associates, London, UK, 171--194.

[31]

Christopher S. Campbell, Paul P. Maglio, Alex Cozzi, and Byron Dom. 2003. Expertise identification using email communications. In Proceedings of the 12th International Conference on Information and Knowledge Management. ACM, 528--531.

Digital Library

[32]

Nicholas Carr. 2005. The amorality of Web 2.0. [Blog post]. Retrieved from http://www.roughtype.com/?p=110.

[33]

Xavier Carreras, Lluís Màrquez, and Jordi Girona Salgado. 2001. Boosting trees for anti-spam email filtering. In Proceedings of the Conference on Recent Advances in Natural Language Processing (RANLP’01).

[34]

Imogen Casebourne, Chris Davies, Michelle Fernandes, and Naomi Norman. 2012. Assessing the accuracy and quality of Wikipedia entries compared to popular online encyclopaedias: A comparative preliminary study across disciplines in English, Spanish and Arabic. Epic, Brighton, UK. Accedido o 9, 10 (2012), 2012.

[35]

Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 785--794.

Digital Library

[36]

Anna T. Cianciolo, Cynthia Matthew, Robert J. Sternberg, and Richard K. Wagner. 2006. Tacit knowledge, practical intelligence, and expertise. The Cambridge Handbook of Expertise and Expert Performance. Cambridge University Press, 613--632.

[37]

D. V. Cicchetti and R. Heavens. 1981. A computer program for determining the significance of the difference between pairs of independently derived values of kappa or weighted kappa. Educ. Psychol. Meas. 41, 1 (1981), 189--193.

[38]

W. W. Cohen, P. Ravikumar, and S. E. Fienberg. 2003. A comparison of string distance metrics for name-matching tasks. In Proceedings of the IJCAI’03 Workshop on Information Integration on the Web. 73--78.

[39]

Zoe Corbyn. 2011. Wikipedia wants more contributions from academics. The Guardian (29 Mar. 2011). Retrieved from https://www.theguardian.com/education/2011/mar/29/wikipedia-survey-academic-contributions.

[40]

Dan Cosley, Dan Frankowski, Loren Terveen, and John Riedl. 2006. Using intelligent task routing and contribution review to help communities build artifacts of lasting value. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1037--1046.

Digital Library

[41]

Dan Cosley, Dan Frankowski, Loren Terveen, and John Riedl. 2007. SuggestBot: Using intelligent task routing to help people find work in Wikipedia. In Proceedings of the 12th International Conference on Intelligent User Interfaces. ACM, 32--41.

Digital Library

[42]

Nick Craswell, David Hawking, Anne-Marie Vercoustre, and Peter Wilkins. 2001. P@ noptic expert: Searching for experts not just for documents. In Ausweb Poster Proceedings, Queensland, Australia, Vol. 15. 17.

[43]

J. Daley, Barbara. 1999. Novice to expert: An exploration of how professionals learn. Adult Educ. Quart. 49, 4 (1999), 133--147.

[44]

Bhavana Dalvi, Einat Minkov, Partha P. Talukdar, and William W. Cohen. 2015. Automatic gloss finding for a knowledge base using ontological constraints. In Proceedings of the 8th ACM International Conference on Web Search and Data Mining. ACM, 369--378.

[45]

Quang-Vinh Dang and Claudia-Lavinia Ignat. 2016. Measuring quality of collaboratively edited documents: The case of Wikipedia. In Proceedings of the 2nd IEEE International Conference on Collaboration and Internet Computing (CIC’16). IEEE, 266--275.

[46]

Gianluca Demartini. 2007. Finding experts using Wikipedia. In Proceedings of the 2nd International Conference on Finding Experts on the Web with Semantics, Vol. 290. 33--41.

[47]

H. L. Dreyfus, S. E. Dreyfus, and T. Athanasiou. 2000. Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer. Simon and Schuster.

[48]

Ofer Egozi, Shaul Markovitch, and Evgeniy Gabrilovich. 2011. Concept-based information retrieval using explicit semantic analysis. ACM Trans. Inf. Syst. 29, 2 (2011), 8.

Digital Library

[49]

K. Anders Ericsson. 2006. An Introduction to the Cambridge Handbook of Expertise and Expert Performance: Its Development, Organization, and Content. Cambridge University Press.

[50]

K. Anders Ericsson, Ralf T. Krampe, and Clemens Tesch-Römer. 1993. The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 3 (1993), 363.

[51]

K. Anders Ericsson and Jacqui Smith. 1991. Prospects and Limits of the Empirical Study of Expertise: An Introduction. Cambridge University Press.

[52]

Robert D. Finn, Paul P. Gardner, and Alex Bateman. 2012. Making your database available through Wikipedia: The pros and cons. Nucleic Acids Res. 40, D1 (2012), D9--D12.

[53]

J. L. Fleiss. 1981. The Measurement of Interrater Agreement (2nd ed.). John Wiley, New York, 212--236.

[54]

Andrea Forte, Vanessa Larco, and Amy Bruckman. 2009. Decentralization in Wikipedia governance. J. Manag. Inf. Syst. 26, 1 (2009), 49--72.

Digital Library

[55]

Wikimedia Foundation. 2011. Wikipedia editors do it for fun: First results of our 2011 editor survey. [Blog post]. Retrieved from https://diff.wikimedia.org/2011/06/10/wikipedia-editors-do-it-for-fun-first-results-of-our-2011-editor-survey/.

[56]

Evgeniy Gabrilovich, Shaul Markovitch, et al. 2007. Computing semantic relatedness using Wikipedia-based explicit semantic analysis. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’07), Vol. 7. 1606--1611.

[57]

Jay R. Galbraith. 1974. Organization design: An information processing view. Interfaces 4, 3 (1974), 28--36.

Digital Library

[58]

Paul P. Gardner, Jennifer Daub, John Tate, Benjamin L. Moore, Isabelle H. Osuch, Sam Griffiths-Jones, Robert D. Finn, Eric P. Nawrocki, Diana L. Kolbe, Sean R. Eddy, and Alex Bateman. 2011. Rfam: Wikipedia, clans and the “decimal” release. Nucl. Acids Res. 39, suppl-1 (2011), D141--D145.

[59]

Luis Garicano. 2000. Hierarchies and the organization of knowledge in production. J. Polit. Econ. 108, 5 (2000), 874--904.

[60]

Jim Giles. 2005. Internet encyclopaedias go head to head. Nature 438 (2005), 900--901.

[61]

Eric Goldman. 2010. Wikipedia’s labor squeeze and its consequences. J. Telecommun. High Technol. Law 8, 1 (2010), 157--184.

[62]

Shane Greenstein and Feng Zhu. 2018. Do experts or crowd-based models produce more bias? Evidence from Encyclopædia Britannica and Wikipedia. MIS Quarterly 42, 3 (2018), 945--959.

Digital Library

[63]

Guy J. Groen and Vimla L. Patel. 1990. Professional and Novice Expertise in Medicine. Erlbaum, Hillsdale, NJ, 35--44.

[64]

Aaron Halfaker, Aniket Kittur, Robert Kraut, and John Riedl. 2009. A jury of your peers: Quality, experience and ownership in Wikipedia. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration. ACM, 15.

Digital Library

[65]

Todd Holloway, Miran Bozicevic, and Katy Börner. 2007. Analyzing and visualizing the semantic coverage of Wikipedia and its authors. Complexity 12, 3 (2007), 30--40.

Digital Library

[66]

A. Kittur, B. Suh, and E. H. Chi. 2009. What’s in Wikipedia? Mapping topics and conflict using socially annotated category structure. In Proceedings of the 27th Annual CHI Conference on Human Factors in Computing Systems (CHI’09).

[67]

Sotiris B. Kotsiantis, I. Zaharakis, and P. Pintelas. 2007. Supervised machine learning: A review of classification techniques. Emerg. Artif. Intell. Applic. Comput. Eng. 160 (2007), 3--24.

[68]

T. Kriplean, I. Beschastnikh, D. W. McDonald, and S. A. Golder. 2007. Community, consensus, coercion, control: CS*W or how policy mediates mass participation. In Proceedings of the Conference on Supporting Group Work. ACM, 167--176.

[69]

Jie Li, Harold Boley, Virenda Bhavsar, and Jing Mei. 2006. Expert finding for eCollaboration using FOAF with RuleML. In Montreal Conference of eTechnologies, Vol. 2006. 53--65.

[70]

Jun Liu and Sudha Ram. 2011. Who does what: Collaboration patterns in the Wikipedia and their impact on article quality. ACM Trans. Manag. Inf. Syst. 2, 2 (2011), 11.

Digital Library

[71]

Darren W. Logan, Massimo Sandal, Paul P. Gardner, Magnus Manske, and Alex Bateman. 2010. Ten simple rules for editing Wikipedia. PLoS Comput. Biol. 6, 9 (2010), e1000941.

[72]

Omid Madani, Manfred Georg, and David A. Ross. 2012. On using nearly-independent feature families for high precision and confidence. In Proceedings of the Asian Conference on Machine Learning. 269--284.

[73]

Ann Majchrzak and Arvind Malhotra. 2019. Unleashing the Crowd: Collaborative Solutions to Wicked Business and Societal Problems. Springer Nature.

[74]

Ann Majchrzak, Christian Wagner, and Dave Yates. 2013. The impact of shaping on knowledge reuse for organizational improvement with wikis. MIS Quart. 37, 2 (2013), 455--469.

Digital Library

[75]

Thomas W. Malone. 2004. The Future of Work: How the New Order of Business Will Shape Your Organization, Your Management Style, and Your Life. Harvard Business School Press, Boston, MA.

[76]

David Wright Mcdonald. 2000. Supporting Nuance in Groupware Design: Moving from Naturalistic Expertise Location to Expertise Recommendation. PhD Thesis, University of California, Irvine.

[77]

Harald A. Mieg. 2001. The Social Psychology of Expertise: Case Studies in Research, Professional Domains, and Expert Roles. Psychology Press.

[78]

Einat Minkov, Richard Wang, Anthony Tomasic, and William Cohen. 2006. NER systems that suit user’s preferences: Adjusting the recall-precision trade-off for entity extraction. In Proceedings of the Human Language Technology Conference of the NAACL.

[79]

Dana Movshovitz-Attias, Yair Movshovitz-Attias, Peter Steenkiste, and Christos Faloutsos. 2013. Analysis of the reputation system and user contributions on a question answering website: Stackoverflow. In Proceedings of the IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. ACM, 886--893.

Digital Library

[80]

Yiftach Nagar. 2012. What do you think: The structuring of an online community as a collective-sensemaking process. In Proceedings of the ACM Conference on Computer Supported Collaborative Work. ACM, 393--402.

Digital Library

[81]

Sabine Niederer and José van Dijck. 2010. Wisdom of the crowd or technicity of content? Wikipedia as a sociotechnical system. New Media Soc. 12, 8 (2010), 1368--1387.

[82]

Joel Nothman, Hanmin Qin, and Roman Yurchak. 2018. Stop word lists in free open-source software packages. In Proceedings of the Workshop for NLP Open Source Software (NLP-OSS’18). 7--12.

[83]

Mathieu O’Neil. 2010. Shirky and Sanger, or the costs of crowdsourcing. J. Sci. Commun. 9, 1 (2010), 1--6.

[84]

Tim O’Reilly. 2007. What is Web 2.0: Design patterns and business models for the next generation of software. Communications 8 Strategies 1, 65 (2007), 17--37.

[85]

Julian Edgerton Orr. 1996. Talking about Machines: An Ethnography of a Modern Job. Cornell University Press, Ithaca, NY.

[86]

Aditya Pal, F. Maxwell Harper, and Joseph A. Konstan. 2012. Exploring question selection bias to identify experts and potential experts in community question answering. ACM Trans. Inf. Syst. 30, 2 (2012), 10.

Digital Library

[87]

Vimla L. Patel and Guy J. Groen. 1991. The General and Specific Nature of Medical Expertise: A Critical Look. Cambridge University Press, 93--125.

[88]

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12 (2011), 2825--2830.

Digital Library

[89]

Ronaldo C. Prati, Gustavo E. A. P. A. Batista, and Diego F. Silva. 2015. Class imbalance revisited: A new experimental setup to assess the performance of treatment methods. Knowl. Inf. Syst. 45, 1 (2015), 247--270.

Digital Library

[90]

Xiang Ren, Wenqi He, Meng Qu, Clare R. Voss, Heng Ji, and Jiawei Han. 2016. Label noise reduction in entity typing by heterogeneous partial-label embedding. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’16). ACM, 1825--1834.

Digital Library

[91]

Oleg Rokhlenko and Idan Szpektor. 2013. Generating synthetic comparable questions for news articles. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. 742--751.

[92]

Karol G. Ross, Jennifer L. Shafer, and Gary Klein. 2006. Professional Judgments and “Naturalistic Decision Making.”

[93]

Larry Sanger. 2004. Why Wikipedia Must Jettison Its Anti-Elitism [Blog post]. Retrieved from https://web.archive.org/web/20200807044910/https://larrysanger.org/2004/12/why-wikipedia-must-jettison-its-anti-elitism/.

[94]

Lawrence M. Sanger. 2009. The fate of expertise after Wikipedia. Episteme 6, 1 (2009), 52--73.

[95]

Amir Sarabadani, Aaron Halfaker, and Dario Taraborelli. 2017. Building automated vandalism detection tools for Wikidata. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 1647--1654.

Digital Library

[96]

Andreas Schroeder and Christian Wagner. 2012. Governance of open content creation: A conceptualization and analysis of control and guiding mechanisms in the open content domain. J. Amer. Soc. Inf. Sci. Technol. 63, 10 (2012), 1947--1959.

Digital Library

[97]

Clay Shirky. 2008. Here Comes Everybody: The Power of Organizing without Organizations. Penguin Press.

[98]

Stefan Siersdorfer, Sergej Sizov, and Gerhard Weikum. 2004. Goal-oriented methods and meta methods for document classification and their parameter tuning. In Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM’04). ACM, 59--68.

Digital Library

[99]

Ivan Srba and Maria Bielikova. 2016. A comprehensive survey and classification of approaches for community question answering. ACM Trans. Web 10, 3 (2016), 18.

Digital Library

[100]

B. Stvilia, Michael B. Twidale, Linda C. Smith, and Les Gasser. 2008. Information quality work organization in Wikipedia. J. Amer. Soc. Inf. Sci. Technol. 59, 6 (2008), 983--1001.

Digital Library

[101]

Olof Sundin. 2011. Janitors of knowledge: Constructing knowledge in the everyday life of Wikipedia editors. J. Document. 67, 5 (2011), 840--862.

[102]

C. R. Sunstein. 2006. Infotopia: How Many Minds Produce Knowledge. Oxford University Press.

Digital Library

[103]

J. Surowiecki. 2004. The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations. Doubleday, New York.

Digital Library

[104]

D. Tapscott and A. D. Williams. 2006. Wikinomics: How Mass Collaboration Changes Everything. Portfolio.

Digital Library

[105]

Dario Taraborelli, Daniel Mietchen, Panagiota Alevizou, and Alastair Gill. 2011. Expert participation on Wikipedia: Barriers and opportunities. Wikimania 2011, 4-6 Aug 2011, Haifa, Israel. Retrieved from http://oro.open.ac.uk/32619/.

[106]

Neil Thompson and Douglas Hanley. 2018. Science is Shaped by Wikipedia: Evidence from a Randomized Control Trial. MIT Sloan School Working Paper 5238-17.

[107]

Jeffrey W. Treem and Paul M. Leonardi. 2016. Expertise, Communication, and Organizing. Oxford University Press.

[108]

Reuth Vexler and Einat Minkov. 2016. Multi-source named entity typing for social media. In Proceedings of the 6th Named Entities Workshop (NEWS’16), collocated with ACL.

[109]

F. Viegas, M. Wattenberg, and M. McKeon. 2007. The hidden order of Wikipedia. In Proceedings of the 2nd International Conference on Online Communities and Social Computing (OCSD’07), held as part of HCI International. Springer, 445--454.

[110]

Jimmy Wales. 2005. Jimmy Wales: The birth of Wikipedia [Video file]. Retrieved from https://www.ted.com/talks/jimmy_wales_the_birth_of_wikipedia.

[111]

Samuel S. Wineburg. 1991. Historical problem solving: A study of the cognitive processes used in the evaluation of documentary and pictorial evidence. J. Educ. Psychol. 83, 1 (1991), 73--87.

[112]

W. R. Rice. 1989. Analyzing tables of statistical test. Evolution 43 (1989), 223--225.

[113]

J. Yan, L. Du, X. Yao, and Li Shen. 2016. Machine learning in brain imaging genomics. In Machine Learning and Medical Imaging. Elsevier, 411--434.

[114]

Diyi Yang, Aaron Halfaker, Robert Kraut, and Eduard Hovy. 2016. Who did what: Editor role identification in Wikipedia. In Proceedings of the 10th International AAAI Conference on Web and Social Media.

[115]

Jun Zhang, Mark S. Ackerman, and Lada Adamic. 2007. Expertise networks in online communities: Structure and algorithms. In Proceedings of the 16th International Conference on World Wide Web. ACM, 221--230.

Digital Library

[116]

Jianhan Zhu, Alexandre L. Goncalves, Victoria S. Uren, Enrico Motta, and R. Pacheco. 2005. Mining web data for competency management. In Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence. IEEE, 94--100.

Cited By

Singh SMuhuri SMishra SSrivastava DShakya HKumar N(2024)Social Network Analysis: A Survey on Process, Tools, and ApplicationACM Computing Surveys10.1145/364847056:8(1-39)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648470
Clemens-Sewall MRafkin ECervantes C(2024)Domain Knowledge Elicitation for Data Curation to Promote Trustworthiness in Artificial Intelligence2024 International Conference on Assured Autonomy (ICAA)10.1109/ICAA64256.2024.00013(21-30)Online publication date: 10-Oct-2024
https://doi.org/10.1109/ICAA64256.2024.00013
Yang PColavizza G(2022)A Map of Science in WikipediaCompanion Proceedings of the Web Conference 202210.1145/3487553.3524925(1289-1300)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3487553.3524925
Show More Cited By

Index Terms

Assessing the Contribution of Subject-matter Experts to Wikipedia
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Collaborative content creation
    2. Empirical studies in collaborative and social computing

Recommendations

Evaluating Entity Linking with Wikipedia

Named Entity Linking (nel) grounds entity mentions to their corresponding node in a Knowledge Base (kb). Recently, a number of systems have been proposed for linking entity mentions in text to Wikipedia pages. Such systems typically search for candidate ...
An experiment in agent teaching by subject matter experts

This paper presents a successful knowledge-acquisition experiment in which subject matter experts who did not have any prior knowledge-engineering experience succeeded in teaching the Disciple- COA agent how to critique courses of action, a challenge ...
Learning multilingual named entity recognition from Wikipedia

We automatically create enormous, free and multilingual silver-standard training annotations for named entity recognition (ner) by exploiting the text and structure of Wikipedia. Most ner systems rely on statistical models of annotated data to identify ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Social Computing

ACM Transactions on Social Computing Volume 3, Issue 4

December 2020

144 pages

EISSN:2469-7826

DOI:10.1145/3426976

Editor:
Kevin Crowston
Syracuse University, USA

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2020

Accepted: 01 August 2020

Revised: 01 April 2020

Received: 01 May 2019

Published in TSC Volume 3, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
318
Total Downloads

Downloads (Last 12 months)60
Downloads (Last 6 weeks)6

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Singh SMuhuri SMishra SSrivastava DShakya HKumar N(2024)Social Network Analysis: A Survey on Process, Tools, and ApplicationACM Computing Surveys10.1145/364847056:8(1-39)Online publication date: 10-Apr-2024
https://dl.acm.org/doi/10.1145/3648470
Clemens-Sewall MRafkin ECervantes C(2024)Domain Knowledge Elicitation for Data Curation to Promote Trustworthiness in Artificial Intelligence2024 International Conference on Assured Autonomy (ICAA)10.1109/ICAA64256.2024.00013(21-30)Online publication date: 10-Oct-2024
https://doi.org/10.1109/ICAA64256.2024.00013
Yang PColavizza G(2022)A Map of Science in WikipediaCompanion Proceedings of the Web Conference 202210.1145/3487553.3524925(1289-1300)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3487553.3524925
Chou HLin DIshida T(2022)Understanding Open Collaboration of Wikipedia Good Articles with Factor AnalysisJournal of Information & Knowledge Management10.1142/S021964922250030721:03Online publication date: 17-May-2022
https://doi.org/10.1142/S0219649222500307
Miquel Ribé MLaniado DKaltenbrunner A(2021)The Role of Local Content in Wikipedia: A Study on Reader and Editor EngagementÁrea Abierta10.5209/arab.7280121:2(123-151)Online publication date: 17-May-2021
https://doi.org/10.5209/arab.72801

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Issue’s Table of Contents