research-article

Freedom versus Standardization: Structured Data Generation in a Peer Production Community

Authors:

Sarah McRoberts,

Jacob Thebault-Spieker,

Loren TerveenAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 6352 - 6362

https://doi.org/10.1145/3025453.3025940

Published: 02 May 2017 Publication History

Abstract

In addition to encyclopedia articles and software, peer production communities produce structured data, e.g., Wikidata and OpenStreetMap's metadata. Structured data from peer production communities has become increasingly important due to its use by computational applications, such as CartoCSS, MapBox, and Wikipedia infoboxes. However, this structured data is usable by applications only if it follows standards. We did an interview study focused on OpenStreetMap's knowledge production processes to investigate how -- and how successfully -- this community creates and applies its data standards. Our study revealed a fundamental tension between the need to produce structured data in a standardized way and OpenStreetMap's tradition of contributor freedom. We extracted six themes that manifested this tension and three overarching concepts, correctness, community, and code, which help make sense of and synthesize the themes. We also offered suggestions for improving OpenStreetMap's knowledge production processes, including new data models, sociotechnical tools, and community practices (e.g. stronger leadership).

References

[1]

Andrea Ballatore and Peter Mooney. 2015. Conceptualising the geographic world: the dimensions of negotiation in crowdsourced cartography. International Journal of Geographical Information Science 0, 0: 1--18.

Digital Library

[2]

Patti Bao, Brent Hecht, Samuel Carton, Mahmood Quaderi, Michael Horn, and Darren Gergle. 2012. Omnipedia: bridging the wikipedia language gap. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1075--1084. Retrieved September 19, 2016 from http://dl.acm.org/citation.cfm?id=2208553

Digital Library

[3]

Nama R. Budhathoki and Caroline Haythornthwaite. 2013. Motivation for Open Collaboration Crowd and Community Models and the Case of OpenStreetMap. American Behavioral Scientist 57, 5: 548--575.

[4]

Ewa S. Callahan and Susan C. Herring. 2011. Cultural bias in Wikipedia content on famous persons. Journal of the American society for information science and technology 62, 10: 1899--1915.

Digital Library

[5]

Jean-François Girres and Guillaume Touya. 2010. Quality Assessment of the French OpenStreetMap Dataset. Transactions in GIS 14, 4: 435--459.

[6]

Mordechai Haklay. 2010. How good is volunteered geographical information? A comparative study of OpenStreetMap and Ordnance Survey datasets. Environment and planning. B, Planning & design 37, 4: 682.

[7]

Muki Haklay and Nama Budhathoki. OpenStreetMap-- Overview and Motivational Factors. ResearchGate. Retrieved September 18, 2016 from https://www.researchgate.net/publication/44295974_OpenStreetMap-Overview_and_Motivational_Factors

[8]

Scott A. Hale. 2012. Net Increase? Cross-Lingual linking in the blogosphere. Journal of Computer-Mediated Communication 17, 2: 135--151.

Digital Library

[9]

Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2012. The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity is causing its decline. American Behavioral Scientist: 0002764212469365.

[10]

Aaron Halfaker, Aniket Kittur, and John Riedl. 2011. Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work. In Proceedings of the 7th international symposium on wikis and open collaboration, 163--172. Retrieved January 5, 2016 from http://dl.acm.org/citation.cfm?id=2038585

Digital Library

[11]

Brent Hecht and Darren Gergle. 2009. Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the fourth international conference on Communities and technologies, 11--20. Retrieved August 4, 2016 from http://dl.acm.org/citation.cfm?id=1556463

Digital Library

[12]

Brent Hecht and Darren Gergle. 2010. The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In Proceedings of the SIGCHI conference on human factors in computing systems, 291--300. Retrieved September 21, 2016 from http://dl.acm.org/citation.cfm?id=1753370

Digital Library

[13]

Nikos Karagiannakis, Giorgos Giannopoulos, Dimitrios Skoutas, and Spiros Athanasiou. 2015. OSMRec Tool for Automatic Recommendation of Categories on Spatial Entities in OpenStreetMap. In Proceedings of the 9th ACM Conference on Recommender Systems, 337--338. Retrieved October 27, 2015 from http://dl.acm.org/citation.cfm?id=2796555

Digital Library

[14]

Marina Kogan, Jennings Anderson, Leysia Palen, Kenneth M. Anderson, and Robert Soden. 2016. Finding the Way to OSM Mapping Practices: Bounding Large Crisis Datasets for Qualitative Investigation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2783--2795. Retrieved May 26, 2016 from http://dl.acm.org/citation.cfm?id=2858371

Digital Library

[15]

Travis Kriplean, Ivan Beschastnikh, David W. McDonald, and Scott A. Golder. 2007. Community, consensus, coercion, control: cs* w or how policy mediates mass participation. In Proceedings of the 2007 international ACM conference on Supporting group work, 167--176. Retrieved September 11, 2016 from http://dl.acm.org/citation.cfm?id=1316648

Digital Library

[16]

Shyong K. Lam, Jawed Karim, and John Riedl. 2010. The effects of group composition on decision quality in a social production community. In Proceedings of the 16th ACM international conference on Supporting group work, 55--64. Retrieved September 13, 2016 from http://dl.acm.org/citation.cfm?id=1880083

Digital Library

[17]

Ganaele Langlois, Fenwick McKelvey, Greg Elmer, and Kenneth Werbin. 2009. Mapping commercial Web 2.0 worlds: Towards a new critical ontogenesis. Fibreculture 14: 1--14.

[18]

Lawrence Lessig. 1999. Code and Other Laws of Cyberspace.

Digital Library

[19]

Yilun Lin, Bowen Yu, Andrew Hall, and Brent Hecht. 2017. Problematizing and Addressing the Article-as-Concept Assumption in Wikipedia. In Proceedings of the 20th ACM Conference on Computer Supported Cooperative Work & Social Computing.

Digital Library

[20]

Yu-Wei Lin. 2011. A qualitative enquiry into OpenStreetMap making. New Review of Hypermedia and Multimedia 17, 1: 53--71.

Digital Library

[21]

Peter Mooney, Padraig Corcoran, and Adam C. Winstanley. 2010. Towards Quality Metrics for OpenStreetMap. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems (GIS '10), 514--517.

Digital Library

[22]

Michael Muller. 2014. Curiosity, Creativity, and Surprise as Analytic Tools: Grounded Theory Method. In Ways of Knowing in HCI, Judith S. Olson and Wendy A. Kellogg (eds.). Springer New York, 25--48. Retrieved September 18, 2016 from http://link.springer.com.ezp2.lib.umn.edu/chapter/10.1 007/978--1--4939-0378--8_2

[23]

Leysia Palen, Robert Soden, T. Jennings Anderson, and Mario Barrenechea. 2015. Success & scale in a data-producing organization: the socio-technical evolution of OpenStreetMap in response to humanitarian events. In Proceedings of the 33rd annual ACM conference on human factors in computing systems, 4113--4122. Retrieved September 15, 2016 from http://dl.acm.org/citation.cfm?id=2702294

Digital Library

[24]

Shilad Sen, Shyong K. Lam, Al Mamunur Rashid, Dan Cosley, Dan Frankowski, Jeremy Osterhouse, F. Maxwell Harper, and John Riedl. 2006. Tagging, communities, vocabulary, evolution. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work, 181--190. Retrieved September 19, 2016 from http://dl.acm.org/citation.cfm?id=1180904

Digital Library

[25]

Besiki Stvilia, Abdullah Al-Faraj, and Yong Jeong Yi. 2009. Issues of cross-contextual information quality evaluation? The case of Arabic, English, and Korean Wikipedias. Library & Information Science Research 31, 4: 232--239.

[26]

Arnaud Vandecasteele and Rodolphe Devillers. 2015. Improving Volunteered Geographic Information Quality Using a Tag Recommender System: The Case of OpenStreetMap. In OpenStreetMap in GIScience, Jamal Jokar Arsanjani, Alexander Zipf, Peter Mooney and Marco Helbich (eds.). Springer International Publishing, 59--80. Retrieved March 24, 2015 from http://link.springer.com/chapter/10.1007/978--3--31914280--7_4

[27]

Maja van der Velden. 2013. Decentering Design: Wikipedia and Indigenous Knowledge. International Journal of Human-Computer Interaction 29, 4: 308-- 316.

[28]

Good practice - OpenStreetMap Wiki. Retrieved August 8, 2016 from http://wiki.openstreetmap.org/wiki/Good_practice

[29]

Wikipedia:Be bold - Wikipedia, the free encyclopedia. Retrieved August 8, 2016 from https://en.wikipedia.org/wiki/Wikipedia:Be_bold

[30]

Wikidata. Retrieved August 8, 2016 from https://www.wikidata.org/wiki/Wikidata:Main_Page

[31]

Official Google Blog: Introducing the Knowledge Graph: things, not strings. Retrieved August 9, 2016 from https://googleblog.blogspot.com/2012/05/introducing-knowledge-graph-things-not.html

[32]

Humanitarian OpenStreetMap Team. Retrieved August 8, 2016 from https://hotosm.org/

[33]

Reasonator. Retrieved August 8, 2016 from https://tools.wmflabs.org/reasonator/

[34]

Category:Templates using data from Wikidata - Wikipedia, the free encyclopedia. Retrieved August 9, 2016 from https://en.wikipedia.org/wiki/Category:Templates_usin g_data_from_Wikidata

[35]

How did you contribute to OpenStreetMap? Retrieved September 18, 2016 from http://hdyc.neis-one.org/

[36]

About | Humanitarian OpenStreetMap Team. Retrieved August 8, 2016 from https://hotosm.org/about

[37]

HOT Tasking Manager -. Retrieved August 8, 2016 from http://tasks.hotosm.org/

[38]

LearnOSM. Retrieved September 15, 2016 from http://learnosm.org/en/coordination/remote/

[39]

Wikipedia:WikiProject Council/Guide/WikiProject - Wikipedia. Retrieved December 31, 2016 from https://en.wikipedia.org/wiki/Wikipedia:WikiProject_Council/Guide/WikiProject#Violating_policies

[40]

Episode 708: Bitcoin Divided. NPR.org. Retrieved September 13, 2016 from http://www.npr.org/sections/money/2016/06/29/484029238/episode-708-bitcoin-divided

[41]

Semi-colon value separator - OpenStreetMap Wiki. Retrieved December 5, 2016 from http://wiki.openstreetmap.org/wiki/Semi-colon_value_separator

[42]

Import/Guidelines - OpenStreetMap Wiki. Retrieved January 6, 2017 from http://wiki.openstreetmap.org/wiki/Import/Guidelines

Cited By

Berkel NPohl H(2024)Collaborating with Bots and Automation on OpenStreetMapACM Transactions on Computer-Human Interaction10.1145/366532631:3(1-30)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665326
Choe YTomko MKalantari M(2023)Assessing Mapper Conflict in OpenStreetMap Using the Delphi Survey MethodProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580758(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580758
Johnson IGerlach MSáez-Trumper D(2021)Language-agnostic Topic Classification for WikipediaCompanion Proceedings of the Web Conference 202110.1145/3442442.3452347(594-601)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442442.3452347
Show More Cited By

Index Terms

Freedom versus Standardization: Structured Data Generation in a Peer Production Community
1. Human-centered computing

Recommendations

A qualitative enquiry into OpenStreetMap making
Exploring Produsage

Based on a case study on the OpenStreetMap community, this paper provides a contextual and embodied understanding of the user-led, user-participatory and user-generated produsage phenomenon. It employs Grounded Theory, Social Worlds Theory, and ...
Overcoming resource challenges in peer-production communities through bricolage: The case of HomeNets
Abstract
Peer-production communities can create great value and foster innovation for their members, even in situations where resources are extremely scarce. How these communities create or acquire necessary resources in such settings is an ...
Highlights
- This paper is one of the first to explore the processes of bricolage in peer production context.
Standardization of Work: Co-constructed Practice

There is strong pressure to achieve greater uniformity, standardization and application of best practices in the service professions, a sector that is growing in presence and importance. At the same time, there is a conflicting demand for the delivery ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

U.S. Dept. of Education
U.S. National Science Foundation

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
275
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Berkel NPohl H(2024)Collaborating with Bots and Automation on OpenStreetMapACM Transactions on Computer-Human Interaction10.1145/366532631:3(1-30)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665326
Choe YTomko MKalantari M(2023)Assessing Mapper Conflict in OpenStreetMap Using the Delphi Survey MethodProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580758(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580758
Johnson IGerlach MSáez-Trumper D(2021)Language-agnostic Topic Classification for WikipediaCompanion Proceedings of the Web Conference 202110.1145/3442442.3452347(594-601)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442442.3452347
Ntabathia JChen JMankoff JGomes C(2019)Categories of control and visibility in mapping infrastructuresProceedings of the 2nd ACM SIGCAS Conference on Computing and Sustainable Societies10.1145/3314344.3332494(174-183)Online publication date: 3-Jul-2019
https://dl.acm.org/doi/10.1145/3314344.3332494
Piscopo ASimperl E(2018)Who Models the World?Proceedings of the ACM on Human-Computer Interaction10.1145/32744102:CSCW(1-18)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.1145/3274410
Hall ATerveen LHalfaker A(2018)Bot Detection in Wikidata Using Behavioral and Other Informal CuesProceedings of the ACM on Human-Computer Interaction10.1145/32743332:CSCW(1-18)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.1145/3274333
Hall AThebault-Spieker JSen SHecht BTerveen L(2018)Exploring the Relationship Between "Informal Standards" and Contributor Practice in OpenStreetMapProceedings of the 14th International Symposium on Open Collaboration10.1145/3233391.3233962(1-11)Online publication date: 22-Aug-2018
https://dl.acm.org/doi/10.1145/3233391.3233962
Lin AFord JAdar EHecht BChampin PGandon FMédini LLalmas MIpeirotis P(2018)VizByWikiProceedings of the 2018 World Wide Web Conference10.1145/3178876.3186135(873-882)Online publication date: 10-Apr-2018
https://dl.acm.org/doi/10.1145/3178876.3186135
Leyh WFilho H(2017)Interlinking Standardized OpenStreetMap Data and Citizen Science Data in the OpenData CloudAdvances in Human Factors and Systems Interaction10.1007/978-3-319-60366-7_9(85-96)Online publication date: 23-Jun-2017
https://doi.org/10.1007/978-3-319-60366-7_9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten