Rajan Vaish
Michael S. Bernstein
ABSTRACT
To lower the threshold to participation in crowdsourcing, we present twitch crowdsourcing: crowdsourcing via quick contributions that can be completed in one or two seconds. We introduce Twitch, a mobile phone application that asks users to make a micro-contribution each time they unlock their phone. Twitch takes advantage of the common habit of turning to the mobile phone in spare moments. Twitch crowdsourcing activities span goals such as authoring a census of local human activity, rating stock photos, and extracting structured data from Wikipedia pages. We report a field deployment of Twitch where 82 users made 11,240 crowdsourcing contributions as they used their phone in the course of everyday life. The median Twitch activity took just 1.6 seconds, incurring no statistically distinguishable costs to unlock speed or cognitive load compared to a standard slide-to-unlock interface.
Supplemental Material
- Anttila, A., Experience, U., Corporation, N., Jung, Y., Specialist, D., and Tower, A. Discovering Design Drivers for Mobile Media Solutions. Proc. CHI EA'06, (2006). Google Scholar
Digital Library
- Beenen, G., Ling, K., Wang, X., et al. Using social psychology to motivate contributions to online communities. Proc. CSCW'04, (2004). Google ScholarDigital Library
- Benkler, Y. The Wealth of Networks: How Social Production Transforms Markets and Freedom. Yale University Press, 2007. Google ScholarDigital Library
- Bentley, F., Tullio, J., Metcalf, C., Harry, D., and Massey, N. A time to glance: Studying the use of mobile ambient information. Proc. Pervasive'07 Workshop: Ambient Information Systems, (2007).Google Scholar
- Bernstein, M.S., Brandt, J., Miller, R.C., and Karger, D.R. Crowds in two seconds: enabling realtime crowdpowered interfaces. Proc. UIST'11, (2011). Google ScholarDigital Library
- Bernstein, M.S., Teevan, J., Dumais, S., et al. Direct Answers for Search Queries in the Long Tail. Proc. CHI'12, (2012). Google ScholarDigital Library
- Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. Freebase: A Collaboratively Created Graph Database For Structuring Human Knowledge. Proc. SIGMOD'08, (2008). Google ScholarDigital Library
- Campbell, A.T., Eisenman, S.B., Lane, N.D., Miluzzo, E., and Peterson, R.A. People-centric urban sensing. Proc. WICON'06, (2006). Google ScholarDigital Library
- Chilton, L.B. and Teevan, J. Addressing People's Information Needs Directly in a Web Search Result Page. Proc. WWW 2011, (2011). Google ScholarDigital Library
- Cohen, J., Forman, S., Braver, T., Casey, B.., ServanSchreiber, D., and Noll, D.C. Activation of the Prefrontal Cortex in a Nonspatial Working Memory Task With Functional MRI. Human Brain Mapping I, (1994), 293--304.Google ScholarCross Ref
- Das, T. PRISM : Platform for Remote Sensing using Smartphones. Proc. MobiSys'10, (2010). Google ScholarDigital Library
- Eagle, N. txteagle: Mobile Crowdsourcing. Proc. IDGD'09, (2009). Google ScholarDigital Library
- Edge, D., Whitney, M., and Charlotte, C. MemReflex: Adaptive Flashcards for Mobile Microlearning. Proc. MobileHCI'12, (2012). Google ScholarDigital Library
- Fader, A., Soderland, S., and Etzioni, O. Identifying relations for open information extraction. Proc. EMNLP'11, (2011). Google ScholarDigital Library
- Froehlich, J., Dillahunt, T., Klasnja, P., et al. UbiGreen: Investigating a Mobile Tool for Tracking and Supporting Green Transportation Habits. Proc. CHI'09, (2009). Google ScholarDigital Library
- Gupta, A., Thies, W., Cutrell, E., and Balakrishnan, R. mClerk: Enabling Mobile Crowdsourcing in Developing Regions. Proc. CHI'12, (2012). Google ScholarDigital Library
- Hacker, S. and Ahn, L. Von. Matchin: Eliciting User Preferences with an Online Game. Proc. CHI'09, (2009). Google ScholarDigital Library
- Hoffmann, R., Amershi, S., Patel, K., Wu, F., Fogarty, J., and Weld, D.S. Amplifying community content creation with mixed initiative information extraction. Proc. CHI'09, (2009). Google ScholarDigital Library
- Lasecki, W., Miller, C., and Bigham, J.P. Warping time for more effective real-time crowdsourcing. Proc. CHI'13, (2013). Google ScholarDigital Library
- Luon, Y., Aperjis, C., and Huberman, B.A. Rankr: A Mobile System for Crowdsourcing Opinions. Springer Berlin Heidelberg, (2012).Google ScholarCross Ref
- Luther, K. and Bruckman, A. Leadership in online creative collaboration. Proc. CSCW '08, (2008). Google ScholarDigital Library
- Narula, P., Gutheim, P., Rolnitzky, D., Kulkarni, A., and Hartmann, B. MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid. Proc. HCOMP '11.Google Scholar
- Ophir, E., Nass, C., and Wagner, A.D. Cognitive control in media multitaskers. PNAS 106, 37 (2009).Google ScholarCross Ref
- Oulasvirta, A., Tamminen, S., Roto, V., and Kuorelahti, J. Interaction in 4-Second Bursts: The Fragmented Nature of Attentional Resources in Mobile HCI. Proc. CHI'05, (2005). Google ScholarDigital Library
- Poteete, A.R., Janssen, M., and Ostrom, E. Working together: collective action, the commons, and multiple methods in practice. Princeton University Press, 2010.Google Scholar
- Ra, M., Liu, B., Porta, T. La, and Govindan, R. Medusa : A Programming Framework for CrowdSensing Applications Categories and Subject Descriptors. Proc. MobSys'12, (2012). Google ScholarDigital Library
- Ross, L. and Nisbett, R.E. The person and the situation: Perspectives of social psychology. Mcgraw-Hill, 1991.Google Scholar
- Su, H., Deng, J., and Fei-fei, L. Crowdsourcing Annotations for Visual Object Detection. Proc. HCOMP'12, (2012).Google Scholar
- Taraborelli, D., Mietchen, D., Alevizou, P., and Gill, A. Expert participation on Wikipedia: barriers and opportunities. Wikimania 2011, (2011).Google Scholar
- Yan, T., Marzilli, M., Holmes, R., Ganesan, D., and Corner, M. mCrowd - A Platform for Mobile Crowdsourcing. Proc. SenSys'09, (2009). Google ScholarDigital Library
- Yu, C.-H. Mobile continuous reading. Ext. Abs. CHI'12, (2012). Google ScholarDigital Library
- Kitten War. http://www.kittenwar.com/.Google Scholar
- iStockPhoto. http//www.istockphoto.com.Google Scholar
- Freebase. http://www.freebase.com/.Google Scholar
- dbPedia. http://dbpedia.org/.Google Scholar
- Google Knowledge Graph. http://goo.gl/6cCKVP.Google Scholar
- Microsoft Bing Satori. http://binged.it/10nFdH0.Google Scholar
Index Terms
- Twitch crowdsourcing: crowd contributions in short bursts of time
Recommendations
Mobile crowdsourcing in the wild: challenges from a global community
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctRecent research has been devoted to designing mobile applications that encourage users to complete microtasks in everyday context, known as "mobile crowdsourcing". In this case study, we present our ongoing effort of a publicly-available mobile ...
Crowdsourcing GO: Effect of Worker Situation on Mobile Crowdsourcing Performance
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsThe increasing popularity of mobile crowdsourcing platforms has enabled crowd workers to accept jobs wherever/whenever they are, and also provides opportunity for task requesters to order time/location specific tasks to workers. Since workers on mobile ...
Being a turker
CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computingCrowdsourcing is a key current topic in CSCW. We build upon findings of a few qualitative studies of crowdworkers. We conducted an ethnomethodological analysis of publicly available content on Turker Nation, a general forum for Amazon Mechanical Turk (...
Comments