Abstract
Crowdsourcing is a new kind of organizational structure, one that is conducive to large amounts of short parallel work: thousands of individuals may work for several minutes on tasks, their outputs aggregated into a useful product or service. The dimensions of this new organizational form are described. Areas for future research are identified, focusing on open-ended tasks and the coordination structures that might foster collective creativity.
Chapter PDF
Similar content being viewed by others
Keywords
References
Howe, J.: Crowdsourcing: Why the power of the crowd is driving the future of business. Three Rivers Pr. (2009)
Quinn, A.J., Bederson, B.B.: Human Computation: A Survey and Taxonomy of a Growing Field. In: CHI. ACM Press, New York (2011)
Kittur, A.: Crowdsourcing, collaboration and creativity. Crossroads, XRDS (2010)
Little, G., Chilton, L.B., Goldman, M., Miller, R.C.: Exploring iterative and parallel human computation processes. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 68–76. ACM, New York (2010)
Benkler, Y.: The wealth of networks: How social production transforms markets and freedom. Yale Univ Press (2006)
Gulley, N.: Patterns of innovation: a web-based MATLAB programming contest. In: CHI 2001 extended abstracts on Human factors in computing systems, p. 338. ACM, New York (2001)
Brabham, D.: Moving the crowd at Threadless: Motivations for participation in a crowdsourcing application. Information, Communication & Society 13, 1122–1145 (2010)
Jain, R.: Investigation of Governance Mechanisms for Crowdsourcing Initiatives. In: AMCIS 2010 Proceedings, p. 557 (2010)
Hollan, J., Hutchins, E., Kirsh, D.: Distributed cognition: toward a new foundation for human-computer interaction research. ACM Transactions on Computer-Human Interaction (TOCHI) 7(2), 174–196 (2000)
Salganik, M.J., Dodds, P.S., Watts, D.J.: Experimental study of inequality and unpredictability in an artificial cultural market. Science 311(5762), 854 (2006)
Mason, W.A., Jones, A., Goldstone, R.L.: Propagation of innovations in networked groups. Journal of Experimental Psychology-General 137(3), 422–433 (2008)
Von Ahn, L., Dabbish, L.: Designing games with a purpose. Communications of the ACM 51(8), 58–67 (2008)
Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popović, Z.: Predicting protein structures with a multiplayer online game. Nature 466(7307), 756–760
Galton, F.: Vox Populi. Nature, 450–451 (1907)
Gurnee, H.: Maze Learning in the Collective Situation. The Journal of Psychology 3, 437–443 (1937)
Knight, H.C.: A Comparison of the Reliability of Group and Individual Judgments. Master’s Thesis, Columbia University (1921)
Estes, W.K., Maddox, W.: Risks of drawing inferences about cognitive processes from model fits to individual versus average performance. Psychonomic Bulletin & Review 12(3), 403 (2005)
Brooks, F.: The Design of Design: Essays from a Computer Scientist. Addison Wesley, New York (2010)
Malone, T.W., Laubacher, R., Dellarocas, C.: Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloan School Working Paper 4732-09 (2010)
Boudreau, K., Lacetera, N., Lakhani, K.: Parallel search, incentives and problem type: Revisiting the competition and innovation link. Harvard Business School, Working Paper 09-041, 2008 (2008)
Deci, E.L., Koestner, R., Ryan, R.M.: A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological bulletin 125, 627–668 (1999)
Nickerson, J.V., Sakamoto, Y.: Crowdsourcing Creativity: Combining Ideas in Networks. In: Workshops on Information in Networks (2010)
Yu, L., Nickerson, J.V.: Cooks or Cobblers? Crowd Creativity through Combination. In: CHI. ACM Press, New York (2011)
Amabile, T.: Creativity in context. Westview Press (1996)
Hinds, P., Kiesler, S.: Distributed work. The MIT Press, Cambridge (2002)
Nickerson, J.V., Corter, J.E., Tversky, B., Zahner, D., Rho, Y.J.: The Spatial Nature of Thought: Understanding Systems Design Through Diagrams. In: ICIS 2008 Proceedings, p. 216 (2008)
Thagard, P.: Conceptual revolutions. Princeton University Press, Princeton (1992)
Goldberg, D.E.: Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading (1989)
Holland, J.H.: Building blocks, cohort genetic algorithms, and hyperplane-defined functions. Evolutionary computation 8(4), 373–391 (2000)
Kosorukoff, A.: Human based genetic algorithm. In: IEEE International Conference on Systems, Man, and Cybernetics, vol. 5, pp. 3464–3469. IEEE, Los Alamitos (2002)
Gero, J.S.: Computational models of innovative and creative design processes. Technological Forecasting and Social Change 64(2-3), 183–196 (2000)
Malone, T.W., Crowston, K.: The interdisciplinary study of coordination. ACM Computing Surveys (CSUR) 26(1), 87–119 (1994)
Dennis, A., Williams, M.: Electronic Brainstorming. In: Group creativity: Innovation through collaboration, pp. 160–178 (2003)
Nunamaker, J.F., Dennis, A.R., Valacich, J.S., Vogel, D., George, J.F.: Electronic meeting systems. Communications of the ACM 34(7), 40–61 (1991)
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B.: Scratch: programming for all. Communications of the ACM 52(11), 60–67 (2009)
Tanaka, Y., Mochizuki, T., Manalo, E., Kusumi, T.: Cultural differences between Asian students regarding judgments about using critical thinking. In: 14th International Conference on Thinking (2009)
Nickerson, J.V., Monroy-Hernandez, A.: Appropriation and Creativity: User Initiated Contests in Scratch. In: Hawaii International Conference on System Sciences (2011)
Kearns, M., Suri, S., Montfort, N.: An experimental study of the coloring problem on human subject networks. Science 313(5788), 824 (2006)
Voiklis, J.: A Thing Is What We Say It Is: Referential Communication and Indirect Category Learning. Ph.D., Columbia University (2008)
Galantucci, B.: An experimental study of the emergence of human communication systems. Cognitive Science: A Multidisciplinary Journal 29(5), 737–767 (2005)
Boyd, J.E., Hushlak, G., Jacob, C.J.: SwarmArt: interactive art from swarm intelligence. In: Proceedings of the 12th annual ACM international conference on Multimedia, pp. 628–635. ACM, New York (2004)
Boellstorff, T.: Coming of age in Second Life: An anthropologist explores the virtually human. Princeton University Press, Princeton (2008)
Bell, R.M., Koren, Y.: Lessons from the Netflix prize challenge. ACM SIGKDD Explorations Newsletter 9(2), 75–79 (2007)
West, J.: How open is open enough? Melding proprietary and open source platform strategies. Research Policy 32(7), 1259–1285 (2003)
http://blog.scratch.mit.edu/2010/01/scratch-companies-by-guest-blogger.html (2010)
Raddick, J., Lintott, C.J., Schawinski, K., Thomas, D., Nichol, R.C., Andreescu, D., Bamford, S., Land, K.R., Murray, P., Slosar, A.: Galaxy Zoo: an experiment in public science participation. Bulletin of the American Astronomical Society 38, 892 (2007)
Pickard, G., Rahwan, I., Pan, W., Cebrian, M., Crane, R., Madan, A., Pentland, A.: Time Critical Social Mobilization: The DARPA Network Challenge Winning Strategy. J Arxiv preprint arXiv:1008.3172 (2010)
van Der Aalst, W.M.P., Ter Hofstede, A.H.M., Kiepuszewski, B., Barros, A.P.: Workflow patterns. Distributed and parallel databases 14(1), 5–51 (2003)
Milner, R.: Communicating and mobile systems: the pi-calculus. Cambridge University Press, Cambridge (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sakamoto, Y., Tanaka, Y., Yu, L., Nickerson, J.V. (2011). The Crowdsourcing Design Space. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Foundations of Augmented Cognition. Directing the Future of Adaptive Systems. FAC 2011. Lecture Notes in Computer Science(), vol 6780. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21852-1_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-21852-1_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21851-4
Online ISBN: 978-3-642-21852-1
eBook Packages: Computer ScienceComputer Science (R0)