Cyrus Shahabi
ABSTRACT
Many studies foresee significant future growth in the number of mobile smart phone users, the phone's hardware and software features, and the broadband bandwidth. Therefore, a transformative area of research is to fully utilize this new platform for various tasks, among which the most promising is spatial crowdsourcing. Spatial crowdsourcing (SC) engages individuals, groups, and communities in the act of collecting, analyzing, and disseminating urban, social, and other spatiotemporal information. This new paradigm of data collection has shown to be useful when traditional means fail (e.g., due to disaster), are censored or do not scale in time and space.
Two major impediments to the success of spatial crowdsourcing in real-world applications are scalability and trust issues. Without scale considerations, it is impossible to develop a generic multi-campaign spatial crowdsourcing system (SC-system) that can efficiently and in real-time match many requesters' tasks to numerous workers. Without trust, the SC-system cannot evaluate the credibility of the contributed data, rendering it ineffective for replacing the traditional data collection means. In this paper, we survey and study both issues of scale and trust in spatial crowdsourcing.
- ABI Research: Mobile broadband subscriptions surpassed 271 million in 2009, March 27, 2010, URL: http://www.intomobile.com/2010/03/27/abi-research-mobile-broadband-subscriptions-surpassed-271-million-in-2009/.Google Scholar
- http://mobithinking.com/mobile-marketing-tools/latest-mobile-stats.Google Scholar
- M. Ergen, Mobile Broadband - Including WiMAX and LTE, Springer, 1st edition, 2009. Google ScholarDigital Library
- L. Kazemi and C. Shahabi, GeoCrowd: Enabling Query Answering with Spatial Crowdsourcing. In ACM SIGSPATIAL GIS, 2012. Google ScholarDigital Library
- M. J. Franklin, D. Kossmann, T. Kraska, S. Ramesh, and R. Xin. Answering queries with crowdsourcing. In Proceedings of the 2011 international conference on Management of data, SIGMOD '11, pages 61--72, 2011. Google ScholarDigital Library
- K.-T. Chen, C.-C. Wu, Y.-C. Chang, and C.-L. Lei. A Crowdsourceable QoE Evaluation Framework for Multimedia Content. In Proceedings of the 17th ACM international conference on Multimedia, MM '09, pages 491--500. Google ScholarDigital Library
- Amazon mechanical turk. http://www.mturk.com/.Google Scholar
- CrowdFlower. http://www.crowdflower.com/.Google Scholar
- F. Alt, A. S. Shirazi, A. Schmidt, U. Kramer, and Z. Nawaz. Location-based crowdsourcing: extending crowdsourcing to the real world. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI '10, pages 13--22, 2010. Google ScholarDigital Library
- University of california berkeley, 2008--2009. http://traffic.berkeley.edu/Google Scholar
- Urban Sensing, CycleSense, http://urban.cens.ucla.edu/projects/. Center for Embedded Networked Sensing (CENS), UCLA.Google Scholar
- B. Hull, V. Bychkovsky, Y. Zhang, K. Chen, M. Goraczko, A. Miu, E. Shih, H. Balakrishnan, and S. Madden. Cartel: a distributed mobile sensor computing system. In SenSys'06, pages 125--138, 2006. Google ScholarDigital Library
- P. Mohan, V. N. Padmanabhan, and R. Ramjee. Nericell: rich monitoring of road and traffic conditions using mobile smartphones. In SenSys'08, pages 323--336, 2008. Google ScholarDigital Library
- Bret Hull, Vladimir Bychkovsky, Yang Zhang, Kevin Chen, Michel Goraczko, Allen Miu, Eugene Shih, Hari Balakrishnan, and Samuel Madden. Cartel: a distributed mobile sensor computing system. In SenSys'06. Google ScholarDigital Library
- http://research.cens.ucla.edu/projects/2007/Urban_Sensing/Applications/.Google Scholar
- Y. Dong, S. S. Kanhere, C. T. Chou, and N. Bulusu. Automatic collection of fuel prices from a network of mobile cameras. In Proceedings of IEEE DCOSS, June 2008. Google ScholarDigital Library
- E. Paulos, R. Honicky, and E. Goodman. Sensing atmosphere. In Workshop on Sensing on Everyday Mobile Phones in Support of Participatory Research, November 2007.Google Scholar
- iReport. http://www.ireport.com/.Google Scholar
- S. Gaonkar, J. Li, R. R. Choudhury, L. Cox, and A. Schmidt. Micro-blog: sharing and querying content through mobile phones and social participation. In MobiSys '08, pages 174--186, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- J. Manweiler, R. Scudellari, and L. P. Cox. SMILE: Encounter-based trust for mobile social services. In Proceedings of ACM CCS 2009, November 2009. Google ScholarDigital Library
- L. Deng and L. P. Cox. Livecompare: grocery bargain hunting through participatory sensing. In HotMobile 2009. Google ScholarDigital Library
- B. Hoh, M. Gruteser, R. Herring, J. Ban, D. Work, Juan-Carlos Herrera, A. M. Bayen, M. Annavaram, Q. Jacobson, Virtual trip lines for distributed privacy-preserving traffic monitoring. In Proceeding of the 6th international conference on Mobile systems, applications, and services, June 17--20, 2008, Breckenridge, CO, USA. Google ScholarDigital Library
- A. Dua, N. Bulusu, W.-C. Feng, and W. Hu. Towards trustworthy participatory sensing. In HotSec'09, pages 8--8. USENIX Association, 2009. Google ScholarDigital Library
- P. Gilbert, L. P. Cox, J. Jung, and D. Wetherall. Toward trustworthy mobile sensing. In HotMobile '10, pages 31--36, Annapolis, Maryland, 2010. ACM. Google ScholarDigital Library
- J. Mullins, How crowdsourcing is helping in Haiti, January 27, 2010, URL: http://www.newscientist.com/article/mg20527453.600-how-crowdsourcing-is-helping-in-haiti.html/.Google Scholar
- A. Marcus, E. Wu, S. Madden, R. C. Miller: Crowdsourced Databases: Query Processing with People. CIDR 2011: 211--214Google Scholar
- Parameswaran, A. G., Garcia-Molina, H., Park, H., Polyzotis, N., Ramesh, A., & Widom, J. (2012, May). Crowdscreen: Algorithms for filtering data with humans. In Proceedings of the 2012 international conference on Management of Data (pp. 361--372). ACM. Google ScholarDigital Library
- Marcus, A., Wu, E., Karger, D., Madden, S., & Miller, R. (2011). Human-powered sorts and joins. In Proceedings of the VLDB Endowment, 5(1), 13--24. Google ScholarDigital Library
- Demartini, G., Kraska, B. T. T., & Franklin, M. J.. CrowdQ: Crowdsourced Query Understanding. CIDR 2013Google Scholar
- Zhao, Z., Ng, W., & Zhang, Z. (2013, March). CrowdSeed: query processing on microblogs. In Proceedings of the 16th International Conference on Extending Database Technology (pp. 729--732). ACM. Google ScholarDigital Library
- Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, Meihui Zhang: CDAS: A Crowdsourcing Data Analytics System. PVLDB 2012, 5(10). Google ScholarDigital Library
- Wang, J., Kraska, T., Franklin, M. J., & Feng, J. (2012). Crowder: Crowdsourcing entity resolution. In Proceedings of the VLDB Endowment Google ScholarDigital Library
- oDesk. http://www.odesk.com/.Google Scholar
- Musthag, M., & Ganesan, D. (2013). Labor Dynamics in a Mobile Micro-Task Market.Google Scholar
- Benouaret, K., Valliyur-Ramalingam, R., & Charoy, F. (2013). CrowdSC: Building Smart Cities with Large Scale Citizen Participation. Research Report.Google Scholar
- Sadilek, A., Krumm, J., & Horvitz, E. (2013). Crowdphysics: Planned and Opportunistic Crowdsourcing for Physical Tasks. SEA, 21(10,424), 125--620.Google Scholar
- Goodchild, M. F., & Glennon, J. A. (2010). Crowdsourcing geographic information for disaster response: a research frontier. International Journal of Digital Earth, 3(3), 231--241.Google ScholarCross Ref
- Brabham, D. C. (2009). Crowdsourcing the public participation process for planning projects. Planning Theory, 8(3), 242--262.Google ScholarCross Ref
- Bozzon, A., Brambilla, M., & Ceri, S. (2012, April). Answering search queries with crowdsearcher. In Proceedings of the 21st international conference on World Wide Web (pp. 1009--1018). ACM. Google ScholarDigital Library
- Panagiotis G. Ipeirotis, Foster Provost, and Jing Wang. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD Workshop on Human Computation, HCOMP '10, pages 64--67,Washington DC, 2010. ACM. Google ScholarDigital Library
- Vikas C. Raykar, Shipeng Yu, Linda H. Zhao, Gerardo Hermosillo Valadez, Charles Florin, Luca Bogoni, and Linda Moy. Learning from crowds. Journal of Machine Learning Research, 11:1297--1322, 2010. Google ScholarDigital Library
- Alban Galland, Serge Abiteboul, Am'elie Marian, and Pierre Senellart. Corroborating information from disagreeing views. In Proceedings of the third ACM international conference on Web search and data mining, WSDM '10, pages 131--140, New York, New York, USA, 2010. ACM. Google ScholarDigital Library
- Vuurens, J., de Vries, A. P., & Eickhoff, C. (2011). How much spam can you take? an analysis of crowdsourcing results to increase accuracy. In Proc. ACM SIGIR Workshop on Crowdsourcing for Information Retrieval (CIR'11) (pp. 21--26).Google Scholar
- Caleb Chen Cao, Jieying She, Yongxin Tong, and Lei Chen. Whom to ask? jury selection for decision making tasks on micro-blog services. PVLDB, 5(11):1495--1506, 2012. Google ScholarDigital Library
- Tian, Y., & Zhu, J. (2012, August). Learning from Crowds in the Presence of Schools of Thought. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 226--234). ACM. Google ScholarDigital Library
- Mashhadi, A. J., Capra, L. (2011, September). Quality control for real-time ubiquitous crowdsourcing. In Proceedings of the 2nd international workshop on Ubiquitous crowdsouring (pp. 5--8). ACM. Google ScholarDigital Library
- Ramesh, A., Parameswaran, A., Garcia-Molina, H., & Polyzotis, N. (2012). Identifying Reliable Workers Swiftly. Infolab Technical Report. Stanford University.Google Scholar
- Joglekar, M., Garcia-Molina, H., & Parameswaran, A. (2012). Evaluating the crowd with confidence. Infolab Technical Report. Stanford University.Google Scholar
Index Terms
- Towards a generic framework for trustworthy spatial crowdsourcing
Recommendations
A Survey of Spatial Crowdsourcing
Best of PODS 2017 and Regular PapersWidespread use of advanced mobile devices has led to the emergence of a new class of crowdsourcing called spatial crowdsourcing. Spatial crowdsourcing advances the potential of a crowd to perform tasks related to real-world scenarios involving physical ...
A Server-Assigned Spatial Crowdsourcing Framework
Inaugural IssueWith the popularity of mobile devices, spatial crowdsourcing is rising as a new framework that enables human workers to solve tasks in the physical world. With spatial crowdsourcing, the goal is to crowdsource a set of spatiotemporal tasks (i.e., tasks ...
Maximizing the number of worker's self-selected tasks in spatial crowdsourcing
SIGSPATIAL'13: Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information SystemsWith the progress of mobile devices and wireless broadband, a new eMarket platform, termed spatial crowdsourcing is emerging, which enables workers (aka crowd) to perform a set of spatial tasks (i.e., tasks related to a geographical location and time) ...
Comments