skip to main content
10.1145/2038558.2038562acmotherconferencesArticle/Chapter ViewAbstractPublication PageswikisymConference Proceedingsconference-collections
research-article

Finding patterns in behavioral observations by automatically labeling forms of wikiwork in Barnstars

Published: 03 October 2011 Publication History

Abstract

Our everyday observations about the behaviors of others around us shape how we decide to act or interact. In social media the ability to observe and interpret others' behavior is limited. This work describes one approach to leverage everyday behavioral observations to develop tools that could improve understanding and sense making capabilities of contributors, managers and researchers of social media systems. One example of behavioral observation is Wikipedia Barnstars. Barnstars are a type of award recognizing the activities of Wikipedia editors. We mine the entire English Wikipedia to extract barnstar observations. We develop a multi-label classifier based on a random forest technique to recognize and label distinct forms of observed and acknowledged activity. We evaluate the classifier through several means including use of separate training and testing datasets and the by application of the classifier to previously unlabeled data. We use the classifier to identify Wikipedia editors who have been observed with some predominant types of behavior and explore whether those patterns of behavior are evident and how observers seem to be making the observations. We discuss how these types of activity observations can be used to develop tools and potentially improve understanding and analysis in wikis and other online communities.

References

[1]
Burke, M. and Kraut, B. 2008. Mopping up: modeling wikipedia promotion decisions. Proceedings of CSCW'08, 27--36.
[2]
Bryant, S. L., Forte, A. and Bruckman. A. 2005. Becoming Wikipedian: Transformation of Participation in a Collaborative Online Encyclopedia. Proceedings of GROUP'05. 1--10.
[3]
Cheng, W. and Hullermeier, E. 2009. Combining instance-based learning and logistic regression for multilabel classification. Machine Learning. 76(2-3):211--225.
[4]
Cosley, D., Frankowski, D., Terveen, L., and Riedl, J. 2007. SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia. Proceedings of IUI.
[5]
Geiger, R. S., and Ribes, D. 2010 The work of Sustaining Order in Wikipedia: The Banning of a Vandal. Proceedings of CSCW'10, 117--126.
[6]
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. 2009. The WEKA Data Mining Software: An Update. SIGKDD Explorations, 11(1).
[7]
Krieger, M., Stark, E. M., and Klemmer, S. 2009. Coordinating tasks on the commons: designing for personal goals, expertise and serendipity. Proceedings of CHI'09. 1485--1494.
[8]
Kriplean, T., Beschastnikh I., and McDonald, D. W. 2008. Articulations of wikiwork: uncovering valued work in wikipedia through barnstars. Proceedings of CSCW'08. 47--56.
[9]
Luther, K., Caine, K., Ziegler, K., and Bruckman, A. 2010. Why It Works (When It Works): Success Factors in Online Creative Collaboration. Proceedings of GROUP'10. 1--10.
[10]
Sajnani, H., Javanmardi, S., McDonald, D. W., Lopes, C. V. 2011. Multi-Label Classification of Short Text: A Study on Wikipedia Barnstars. In the AAAI-11 Workshop on Analyzing Microtext.
[11]
Strauss, A. 1985, Work and the Division of Labor. The Sociological Quarterly. 26, 1. 1--19.
[12]
Suh, B., Chi, E., Kittur, A., and Pendleton, B. 2008. Lifting the veil: improving accountability and social transparency in Wikipedia with wikidashboard. Proceeding of CHI'08. 1037--1040.
[13]
Tsoumakas, G., Vilcek, J., Spyromitros, E., Vlahavas, I. (2010) Mulan: A Java Library for Multi-Label Learning. Journal of Machine Learning Research 1, 1--48.
[14]
Tsoumakas, G. and Katakis, I. 2007. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3 (3) 1--13, 2007.
[15]
Ung, H. and Dalle. J. 2010. Project management in the Wikipedia community. Proceedings of the 6th International Symposium on Wikis and Open Collaboration (WikiSym '10).
[16]
Viegas, F. B., Wattenberg, M., and Dave, K. 2004. Studying Cooperation and Conflict Between Authors with History Flow Visualizations. In Proceedings of CHI'04.
[17]
Wattenberg, M., Viégas, F. B., and Hollenbach, K. 2007. Visualizing Activity on Wikipedia with Chromograms. Proceedings of INTERACT 2007. LNCS 4663, Part II. 272--287.
[18]
Zhang, M. L. and Zhou, Z. H. 2005. A k-Nearest Neighbor Based Algorithm for Multi-label Classification. Proceedings of the 1st IEEE International Conference on Granular Computing.

Cited By

View all
  • (2024)Public Good Superstars: A Lab-in-the-Field Study of WikipediaThe Economic Journal10.1093/ej/ueae093Online publication date: 21-Oct-2024
  • (2021)Evaluating QualiCO: an ontology to facilitate qualitative methods sharing to support open scienceJournal of Internet Services and Applications10.1186/s13174-021-00135-w12:1Online publication date: 9-Aug-2021
  • (2019)Detecting pages to protect in Wikipedia across multiple languagesSocial Network Analysis and Mining10.1007/s13278-019-0555-09:1Online publication date: 14-Mar-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WikiSym '11: Proceedings of the 7th International Symposium on Wikis and Open Collaboration
October 2011
245 pages
ISBN:9781450309097
DOI:10.1145/2038558
  • Conference Chair:
  • Felipe Ortega,
  • Program Chair:
  • Andrea Forte
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • TJEF: The John Ernest Foundation

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 October 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Wikipedia
  2. behavioral patterns
  3. multi-label learning

Qualifiers

  • Research-article

Funding Sources

Conference

WikiSym '11
Sponsor:

Acceptance Rates

Overall Acceptance Rate 69 of 145 submissions, 48%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Public Good Superstars: A Lab-in-the-Field Study of WikipediaThe Economic Journal10.1093/ej/ueae093Online publication date: 21-Oct-2024
  • (2021)Evaluating QualiCO: an ontology to facilitate qualitative methods sharing to support open scienceJournal of Internet Services and Applications10.1186/s13174-021-00135-w12:1Online publication date: 9-Aug-2021
  • (2019)Detecting pages to protect in Wikipedia across multiple languagesSocial Network Analysis and Mining10.1007/s13278-019-0555-09:1Online publication date: 14-Mar-2019
  • (2017)Crowd DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/31347541:CSCW(1-21)Online publication date: 6-Dec-2017
  • (2016)DePPProceedings of the 25th ACM International on Conference on Information and Knowledge Management10.1145/2983323.2983914(2081-2084)Online publication date: 24-Oct-2016
  • (2015)Page protectionProceedings of the 11th International Symposium on Open Collaboration10.1145/2788993.2789846(1-4)Online publication date: 19-Aug-2015
  • (2014)Consider the RedirectProceedings of The International Symposium on Open Collaboration10.1145/2641580.2641616(1-4)Online publication date: 27-Aug-2014
  • (2013)A preliminary study on the effects of barnstars on Wikipedia editingProceedings of the 9th International Symposium on Open Collaboration10.1145/2491055.2491079(1-2)Online publication date: 5-Aug-2013
  • (2013)The illiterate editorProceedings of the 9th International Symposium on Open Collaboration10.1145/2491055.2491066(1-8)Online publication date: 5-Aug-2013
  • (2013)Assessing trustworthiness in collaborative environmentsProceedings of the Eighth Annual Cyber Security and Information Intelligence Research Workshop10.1145/2459976.2460035(1-4)Online publication date: 8-Jan-2013
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media