S. Andrew Sheppard
Julian Turner
Haiyi Zhu
Loren Terveen
Skip Abstract Section
Abstract
CoCoRaHS is a multinational citizen science project for observing precipitation. Like many citizen science projects, volunteer retention is a key measure of engagement and data quality. Through survival analysis, we found that participant age (self-reported at account creation) is a significant predictor of retention. Compared to all other age groups, participants aged 60-70 are much more likely to sign up for CoCoRaHS, and to remain active for several years. We also measured the influence of task difficulty and the relative frequency of rain, finding small but statistically significant and counterintuitive effects. Finally, we confirmed previous work showing that participation levels within the first month are highly predictive of eventual retention. We conclude with implications for observational citizen science projects and crowdsourcing research in general.
- Denise Anthony, Sean W. Smith, and Tim Williamson. 2005. Explaining quality in internet collective goods: Zealots and good samaritans in the case of Wikipedia. Hanover: Dartmouth College (2005).Google Scholar
- Avinoam Baruch, Andrew May, and Dapeng Yu. 2016. The motivations, enablers and barriers for voluntary participation in an online crowdsourcing platform. Computers in Human Behavior 64 (2016), 923--931.Google ScholarCross Ref
- Christopher Beirne and Xavier Lambin. 2013. Understanding the Determinants of Volunteer Retention Through Capture-Recapture Analysis: Answering Social Science Questions Using a Wildlife Ecology Toolkit. Conservation Letters 6, 6 (2013), 391--401.Google ScholarCross Ref
- Anne Bowser, Derek Hansen, Yurong He, Carol Boston, Matthew Reid, Logan Gunnell, and Jennifer Preece. 2013. Using gamification to inspire new citizen science volunteers. In Proceedings of the first international conference on gameful design, research, and applications. ACM, 18--25. Google ScholarDigital Library
- Dana Burr Bradley. 1999. A reason to rise each morning: The meaning of volunteering in the lives of older adults. Generations 23, 4 (1999), 45.Google Scholar
- Robin Brewer, Meredith Ringel Morris, and Anne Marie Piper. 2016. Why would anybody do this?: Understanding Older Adults' Motivations and Challenges in Crowd Work. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2246--2257. Google ScholarDigital Library
- S. van Buuren and CGM Oudshoorn. 2000. Multivariate imputation by chained equations: MICE V1. 0 user's manual. Technical Report. TNO.Google Scholar
- Susan M. Chambré. 1993. Volunteerism by elders: Past trends and future prospects. The Gerontologist 33, 2 (1993), 221--229.Google ScholarCross Ref
- Alice Ming Lin Chong, Tina Louisa Rochelle, and Susu Liu. 2013. Volunteerism and positive aging in Hong Kong: A cultural perspective. The International Journal of Aging and Human Development 77, 3 (2013), 211--231.Google ScholarCross Ref
- Ram A. Cnaan and Toni A. Cascio. 1998. Performance and commitment: Issues in management of volunteers in human service organizations. Journal of Social Service Research 24, 3--4 (1998), 1--37.Google ScholarCross Ref
- Joe Cox, Eun Young Oh, Brooke Simmons, Gary Graham, Anita Greenhill, Chris Lintott, Karen Masters, et al. 2016. Doing Good Online: An Investigation into the Characteristics and Motivations of Digital Volunteers. In 12th International Conference of the International Society for Third Sector Research.Google Scholar
- Martin Dittus, Giovanni Quattrone, and Licia Capra. 2016. Analysing volunteer engagement in humanitarian mapping: building contributor communities at large scale. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 108--118. Google ScholarDigital Library
- Kimberly L. Elmore, Z.L. Flamig, V. Lakshmanan, B.T. Kaney, V. Farmer, Heather D. Reeves, and Lans P. Rothfusz. 2014. mPING: Crowd-sourcing weather reports for research. Bulletin of the American Meteorological Society 95, 9 (2014), 1335--1342.Google ScholarCross Ref
- Cameron Davidson-Pilon et al. 2017. CamDavidsonPilon/lifelines. (June 2017).Google Scholar
- Alexandra Eveleigh, Charlene Jennett, Ann Blandford, Philip Brohan, and Anna L. Cox. 2014. Designing for dabblers and deterring drop-outs in citizen science. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2985--2994. Google ScholarDigital Library
- Paul Fugelstad, Patrick Dwyer, Jennifer Filson Moses, John Kim, Cleila Anna Mannino, Loren Terveen, and Mark Snyder. 2012. What makes users rate (share, tag, edit...)?: predicting patterns of participation in online communities. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 969--978. Google ScholarDigital Library
- Ruediger Glott, Philipp Schmidt, and Rishab Ghosh. 2010. Wikipedia survey--overview of results. United Nations University: Collaborative Creativity Group (2010).Google Scholar
- Aaron Halfaker, R. Stuart Geiger, Jonathan T. Morgan, and John Riedl. 2013. The rise and decline of an open collaboration system: How Wikipedia's reaction to popularity is causing its decline. Amer. Behavioral Scientist 57, 5 (2013), 664--688.Google ScholarCross Ref
- Aaron Halfaker, Aniket Kittur, Robert Kraut, and John Riedl. 2009. A jury of your peers: quality, experience and ownership in Wikipedia. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration. ACM, 15. Google ScholarDigital Library
- Catherine Hoffman, Caren B. Cooper, Eric B. Kennedy, Mahmud Farooque, and Darlene Cavalier. 2017. SciStarter 2.0: A Digital Platform to Foster and Study Sustained Engagement in Citizen Science. In Analyzing the Role of Citizen Science in Modern Research. IGI Global, 50--61.Google Scholar
- Caroline Jay, Robert Dunne, David Gelsthorpe, and Markel Vigo. 2016. To Sign Up, or not to Sign Up?: Maximizing Citizen Science Contribution Rates through Optional Registration. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1827--1832. Google ScholarDigital Library
- Raghav Pavan Karumur, Tien T. Nguyen, and Joseph A. Konstan. 2016. Early Activity Diversity: Assessing Newcomer Retention from First-Session Activity. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 595--608. Google ScholarDigital Library
- Masatomo Kobayashi, Shoma Arita, Toshinari Itoko, Shin Saito, and Hironobu Takagi. 2015. Motivating multi-generational crowd workers in social-purpose work. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1813--1824. Google ScholarDigital Library
- Kathrin Komp, Theo Van Tilburg, and Marjolein Broese Van Groenou. 2012. Age, retirement, and health as factors in volunteering in later life. Nonprofit and Voluntary Sector Quarterly 41, 2 (2012), 280--299.Google ScholarCross Ref
- Anne M. Land-Zandstra, Jeroen L.A. Devilee, Frans Snik, Franka Buurmeijer, and Jos M. van den Broek. 2016. Citizen science on a smartphone: Participants' motivations and learning. Public Understanding of Science 25, 1 (2016), 45--60.Google ScholarCross Ref
- Jeffrey Laut, Francesco Cappa, Oded Nov, and Maurizio Porfiri. 2017. Increasing citizen science contribution using a virtual peer. Journal of the Association for Information Science and Technology 68, 3 (2017), 583--593.Google ScholarDigital Library
- Wendy Liu and Derek Ruths. 2013. What's in a Name? Using First Names as Features for Gender Inference in Twitter. In AAAI spring symposium: Analyzing microtext, Vol. 13. 01.Google Scholar
- Ding Ma, Mats Sandberg, and Bin Jiang. 2015. Characterizing the heterogeneity of the OpenStreetMap data and community. ISPRS International Journal of Geo-Information 4, 2 (2015), 535--550.Google ScholarCross Ref
- Andrew Mao, Ece Kamar, and Eric Horvitz. 2013. Why stop now? predicting worker engagement in online crowd-sourcing. In First AAAI Conference on Human Computation and Crowdsourcing.Google Scholar
- Adina M. Merenlender, Alycia W. Crall, Sabrina Drill, Michelle Prysby, and Heidi Ballard. 2016. Evaluating environmental education, citizen science, and stewardship through naturalist programs. Conservation Biology 30, 6 (2016), 1255--1265.Google ScholarCross Ref
- Hannah J. Miller, Shuo Chang, and Loren G. Terveen. 2015. I LOVE THIS SITE! vs. It's a little girly: Perceptions of and Initial User Experience with Pinterest. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1728--1740. Google ScholarDigital Library
- Oded Nov, Ofer Arazy, and David Anderson. 2011. Technology-Mediated Citizen Science Participation: A Motivational Model. In Proceedings of the International AAAI Conference on Web and Social Media.Google Scholar
- Morris A. Okun and Amy Schultz. 2003. Age and motives for volunteering: testing hypotheses derived from socioemo- tional selectivity theory. Psychology and Aging 18, 2 (2003), 231--239.Google ScholarCross Ref
- Allen M. Omoto, Mark Snyder, and Steven C. Martino. 2000. Volunteerism and the life course: Investigating age-related agendas for action. Basic and applied social psychology 22, 3 (2000), 181--197.Google Scholar
- Felipe Ortega and Daniel Izquierdo-Cortazar. 2009. Survival analysis in open development projects. In ICSE Workshop on Emerging Trends in Free/Libre/Open Source Software Research and Development. IEEE, 7--12. Google ScholarDigital Library
- Katherine Panciera, Aaron Halfaker, and Loren Terveen. 2009. Wikipedians are born, not made: a study of power editors on Wikipedia. In Proceedings of the ACM 2009 international conference on Supporting group work. ACM, 51--60. Google ScholarDigital Library
- Jone L. Pearce. 1993. Volunteers: The organizational behavior of unpaid workers. Routledge.Google Scholar
- Lesandro Ponciano, Francisco Brasileiro, Robert Simpson, and Arfon Smith. 2014. Volunteers' Engagement in Human Computation for Astronomy Projects. Computing in Science & Engineering 16, 6 (2014), 52--59.Google ScholarCross Ref
- PRISM Climate Group, Oregon State University. 2017. (2017). http://prism.oregonstate.edu created 11 Mar 2017.Google Scholar
- M Jordan Raddick, Georgia Bracey, Pamela L. Gay, Chris J. Lintott, Carie Cardamone, Phil Murray, Kevin Schawinski, Alexander S. Szalay, and Jan Vandenberg. 2013. Galaxy Zoo: Motivations of citizen scientists. Astronomy Education Survival Analysis of Citizen Science Volunteerism Review 12, 1 (2013).Google Scholar
- Jason Reed, M. Jordan Raddick, Andrea Lardner, and Karen Carney. 2013. An exploratory factor analysis of motivations for participating in Zooniverse, a collection of virtual citizen science projects. In 46th Hawaii International Conference on System Sciences. IEEE, 610--619. Google ScholarDigital Library
- Henry W. Reges, Nolan Doesken, Julian Turner, Noah Newman, Antony Bergantino, and Zach Schwalbe. 2016. COCORAHS: The evolution and accomplishments of a volunteer rain gauge network. Bulletin of the American Meteorological Society 97, 10 (2016), 1831--1846.Google ScholarCross Ref
- Joel Ross, Lilly Irani, M. Silberman, Andrew Zaldivar, and Bill Tomlinson. 2010. Who are the crowdworkers?: shifting demographics in mechanical turk. In CHI'10 extended abstracts on Human factors in computing systems. ACM, 2863--2872. Google ScholarDigital Library
- Dana Rotman, Jen Hammock, Jenny Preece, Derek Hansen, Carol Boston, Anne Bowser, and Yurong He. 2014. Motivations affecting initial and long-term participation in citizen science projects in three countries. iConference 2014 Proceedings (2014).Google Scholar
- Dana Rotman, Jenny Preece, Jen Hammock, Kezee Procita, Derek Hansen, Cynthia Parr, Darcy Lewis, and David Jacobs. 2012. Dynamic changes in motivation in collaborative citizen-science projects. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 217--226. Google ScholarDigital Library
- Robert L. Ryan, Rachel Kaplan, and Robert E. Grese. 2001. Predicting volunteer commitment in environmental stewardship programmes. Journal of Environmental Planning and Management 44, 5 (2001), 629--648.Google ScholarCross Ref
- Henry Sauermann and Chiara Franzoni. 2015. Crowd science user contribution patterns and their implications. Proceedings of the National Academy of Sciences 112, 3 (2015), 679--684.Google ScholarCross Ref
- Shlomo S. Sawilowsky. 2009. New effect size rules of thumb. Journal of Modern Applied Statistical Methods 8, 2 (2009), 597--599.Google ScholarCross Ref
- Avi Segal, Ya'akov Gal, Ece Kamar, Eric Horvitz, Alex Bowyer, and Grant Miller. 2016. Intervention Strategies for Increasing Engagement in Crowdsourcing: Platform, Predictions, and Experiments. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (IJCAI'16). AAAI Press, 3861--3867. Google ScholarDigital Library
- S. Andrew Sheppard and Loren Terveen. 2011. Quality is a verb: the operationalization of data quality in a citizen science community. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration. ACM, 29--38. Google ScholarDigital Library
- S. Andrew Sheppard, Andrea Wiggins, and Loren Terveen. 2014. Capturing quality: retaining provenance for curated volunteer monitoring data. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1234--1245. Google ScholarDigital Library
- Brian L. Sullivan, Jocelyn L. Aycrigg, Jessie H. Barry, Rick E. Bonney, Nicholas Bruns, Caren B. Cooper, Theo Damoulas, André A Dhondt, Tom Dietterich, Andrew Farnsworth, et al. 2014. The eBird enterprise: an integrated approach to development and application of citizen science. Biological Conservation 169 (2014), 31--40.Google ScholarCross Ref
- Viswanath Venkatesh, James Y.L. Thong, and Xin Xu. 2012. Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology. MIS Q. 36, 1 (March 2012), 157--178. Google ScholarDigital Library
- Yair Wand and Richard Y. Wang. 1996. Anchoring data quality dimensions in ontological foundations. Commun. ACM 39, 11 (1996), 86--95. Google ScholarDigital Library
- Andrea Wiggins and Kevin Crowston. 2011. From conservation to crowdsourcing: A typology of citizen science. In 44th Hawaii international conference on System Sciences. IEEE, 1--10. Google ScholarDigital Library
- Andrea Wiggins and Yurong He. 2016. Community-based data validation practices in citizen science. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1548--1559. Google ScholarDigital Library
- Andrea Wiggins, Greg Newman, Robert D. Stevenson, and Kevin Crowston. 2011. Mechanisms for data quality and validation in citizen science. In e-Science Workshops (eScienceW), 2011 IEEE Seventh International Conference on. IEEE. Google ScholarDigital Library
- John Wilson. 2012. Volunteerism research: A review essay. Nonprofit and Voluntary Sector Quarterly 41, 2 (2012), 176--212.Google ScholarCross Ref
- Ilene Wolcott, Dean Ingwersen, Michael A. Weston, Chris Tzaros, et al. 2008. Sustainability of a long-term volunteer- based bird monitoring program: recruitment, retention and attrition. Australian Journal on Volunteering 13, 1 (2008).Google Scholar
- Chris Wood, Brian Sullivan, Marshall Iliff, Daniel Fink, and Steve Kelling. 2011. eBird: engaging birders in science and conservation. PLoS Biol 9, 12 (2011), e1001220.Google ScholarCross Ref
- Taha Yasseri, Giovanni Quattrone, and Afra Mashhadi. 2013. Temporal analysis of activity patterns of editors in collaborative mapping project of OpenStreetMap. In Proceedings of the 9th International Symposium on Open Collaboration. ACM, 13. Google ScholarDigital Library
- Dell Zhang, Karl Prior, and Mark Levene. 2012. How long do Wikipedia editors keep active?. In Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration. ACM, 4. Google ScholarDigital Library
- Haiyi Zhu, Robert E. Kraut, and Aniket Kittur. 2014. The impact of membership overlap on the survival of online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 281--290. Google ScholarDigital Library
Index Terms
- Never Too Old, Cold or Dry to Watch the Sky: A Survival Analysis of Citizen Science Volunteerism
Recommendations
Dynamic changes in motivation in collaborative citizen-science projects
CSCW '12: Proceedings of the ACM 2012 conference on Computer Supported Cooperative WorkOnline citizen science projects engage volunteers in collecting, analyzing, and curating scientific data. Existing projects have demonstrated the value of using volunteers to collect data, but few projects have reached the full collaborative potential ...
An investigation of player motivations in Eyewire, a gamified citizen science project
Sustained engagement of participants is essential for the success of a citizen science project. However, the motivations of why people engage with such activities can be idiosyncratic, varied, and evolving. In this article we examine player ...
Dusting for science: motivation and participation of digital citizen science volunteers
iConference '11: Proceedings of the 2011 iConferenceDigital citizen science offers a low-cost way to strengthen the scientific infrastructure, and engage members of the public in science. It is based on two pillars:(1)a technological pillar, which involves developing computer systems to manage large ...
Comments