Abstract
With the popularity of mobile devices, spatial crowdsourcing is rising as a new framework that enables human workers to solve tasks in the physical world. With spatial crowdsourcing, the goal is to crowdsource a set of spatiotemporal tasks (i.e., tasks related to time and location) to a set of workers, which requires the workers to physically travel to those locations in order to perform the tasks. In this article, we focus on one class of spatial crowdsourcing, in which the workers send their locations to the server and thereafter the server assigns to every worker tasks in proximity to the worker’s location with the aim of maximizing the overall number of assigned tasks. We formally define this maximum task assignment (MTA) problem in spatial crowdsourcing, and identify its challenges. We propose alternative solutions to address these challenges by exploiting the spatial properties of the problem space, including the spatial distribution and the travel cost of the workers. MTA is based on the assumptions that all tasks are of the same type and all workers are equally qualified in performing the tasks. Meanwhile, different types of tasks may require workers with various skill sets or expertise. Subsequently, we extend MTA by taking the expertise of the workers into consideration. We refer to this problem as the maximum score assignment (MSA) problem and show its practicality and generality. Extensive experiments with various synthetic and two real-world datasets show the applicability of our proposed framework.
- Omar Alonso, Daniel E. Rose, and Benjamin Stewart. 2008. Crowdsourcing for relevance evaluation. In ACM SigIR Forum, Vol. 42. ACM, New York, NY, 9--15. Google ScholarDigital Library
- Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt, Urs Kramer, and Zahid Nawaz. 2010. Location-based crowdsourcing: Extending crowdsourcing to the real world. In Proceedings of the 6th Nordic Conference on Human--Computer Interaction: Extending Boundaries. ACM, New York, NY, 13--22. Google ScholarDigital Library
- Amazon Mechanical Turk. 2005. http://www.mturk.com/.Google Scholar
- Alessandro Bozzon, Marco Brambilla, and Stefano Ceri. 2012. Answering search queries with crowdsearcher. In Proceedings of the 21st International Conference on World Wide Web. ACM, New York, NY, 1009--1018. Google ScholarDigital Library
- Muhammed Fatih Bulut, Yavuz Selim Yilmaz, and Murat Demirbas. 2011. Crowdsourcing location-based queries. In 2011 IEEE International Conference onPervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 513--518.Google ScholarCross Ref
- Kuan-Ta Chen, Chen-Chi Wu, Yu-Chun Chang, and Chin-Laung Lei. 2009. A crowdsourceable QoE evaluation framework for multimedia content. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, New York, NY, 491--500. Google ScholarDigital Library
- Cory Cornelius, Apu Kapadia, David Kotz, Dan Peebles, Minho Shin, and Nikos Triandopoulos. 2008. Anonysense: Privacy-aware people-centric sensing. In Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 211--224. Google ScholarDigital Library
- Justin Cranshaw, Eran Toch, Jason Hong, Aniket Kittur, and Norman Sadeh. 2010. Bridging the gap between physical location and online social networks. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing. ACM, New York, NY, 119--128. Google ScholarDigital Library
- Crowdflower. 2009. http://www.crowdflower.com/.Google Scholar
- Hung Dang, Tuan Nguyen, and Hien To. 2013. Maximum complex task assignment: Towards tasks correlation in spatial crowdsourcing. In Proceedings of International Conference on Information Integration and Web-based Applications & Services. ACM, New York, NY, 77. Google ScholarDigital Library
- Gianluca Demartini, Beth Trushkowsky, Tim Kraska, and Michael J. Franklin. 2013. CrowdQ: Crowdsourced query understanding. In CIDR.Google Scholar
- Dingxiong Deng, Cyrus Shahabi, and Ugur Demiryurek. 2013. Maximizing the number of worker’s self-selected tasks in spatial crowdsourcing. In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 314--323. Google ScholarDigital Library
- Field Agent. 2010. http://www.fieldagent.net/.Google Scholar
- Michael J. Franklin, Donald Kossmann, Tim Kraska, Sukriti Ramesh, and Reynold Xin. 2011. CrowdDB: Answering queries with crowdsourcing. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 61--72. Google ScholarDigital Library
- Gigwalk. 2010. http://gigwalk.com/.Google Scholar
- GoogleMapMaker. 2008. http://www.google.com/mapmaker/.Google Scholar
- Ido Guy, Adam Perer, Tal Daniel, Ohad Greenshpan, and Itai Turbahn. 2011. Guess who?: Enriching the social graph through a crowdsourcing game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1373--1382. Google ScholarDigital Library
- Seth Hettich and Michael J. Pazzani. 2006. Mining for proposal reviewers: Lessons learned at the National Science Foundation. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 862--871. Google ScholarDigital Library
- Bret Hull, Vladimir Bychkovsky, Yang Zhang, Kevin Chen, Michel Goraczko, Allen Miu, Eugene Shih, Hari Balakrishnan, and Samuel Madden. 2006. CarTel: A distributed mobile sensor computing system. In Proceedings of the 4th International Conference on Embedded Networked Sensor Systems. ACM, New York, NY, 125--138. Google ScholarDigital Library
- ILOG CPLEX. 2007. 11.0 Users Manual. ILOG SA, Gentilly, France.Google Scholar
- Bala Kalyanadundaram and Kirk R. Pruhs. 1993. Online weighted matching. Journal of Algorithms (1993), 478--488. Issue 3. Google ScholarDigital Library
- Bala Kalyanasundaram and Kirk R. Pruhs. 2000. An optimal deterministic algorithm for online b-matching. Theoretical Computer Science 233, 1, 319--325. Google ScholarDigital Library
- Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani. 1990. An optimal algorithm for on-line bipartite matching. 352--258. Google ScholarDigital Library
- Leyla Kazemi and Cyrus Shahabi. 2011. A privacy-aware framework for participatory sensing. ACM SIGKDD Explorations Newsletter 13, 1, 43--51. Google ScholarDigital Library
- Leyla Kazemi and Cyrus Shahabi. 2012. GeoCrowd: Enabling query answering with spatial crowdsourcing. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 189--198. Google ScholarDigital Library
- Leyla Kazemi, Cyrus Shahabi, and Lei Chen. 2013. Geotrucrowd: Trustworthy query answering with spatial crowdsourcing. In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 314--323. Google ScholarDigital Library
- Samir Khuller, Stephen G. Mitchell, and Vijay V. Vazirani. 1994. On-line algorithms for weighted bipartite matching and stable marriages. Theoretical Computer Science 2, 255--267. Google ScholarDigital Library
- Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work. ACM, New York, NY, 1301--1318. Google ScholarDigital Library
- Jon Kleinberg and Eva Tardos. 2006. Algorithm design. Pearson Education India, Delhi, India. Google ScholarDigital Library
- Eugene L. Lawler, Jan Karel Lenstra, A. H. G. Rinnooy Kan, and David B. Shmoys. 1985. The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. Vol. 3. Wiley, New York, NY.Google Scholar
- Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, and Meihui Zhang. 2012. CDAS: A crowdsourcing data analytics system. Proceedings of the VLDB Endowment 5, 10, 1040--1051. Google ScholarDigital Library
- Adam Marcus, Eugene Wu, David Karger, Samuel Madden, and Robert Miller. 2011. Human-powered sorts and joins. Proceedings of the VLDB Endowment 5, 1, 13--24. Google ScholarDigital Library
- Aranyak Mehta, Amin Saberi, Umesh Vazirani, and Vijay Vazirani. 2007. Adwords and generalized online matching. Journal of the ACM (JACM) 54, 5, 22. Google ScholarDigital Library
- David Mimno and Andrew McCallum. 2007. Expertise modeling for matching papers with reviewers. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 500--509. Google ScholarDigital Library
- Prashanth Mohan, Venkata N. Padmanabhan, and Ramachandran Ramjee. 2008. Nericell: Rich monitoring of road and traffic conditions using mobile smartphones. In Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems. ACM, New York, NY, 323--336. Google ScholarDigital Library
- Mohamed Musthag and Deepak Ganesan. 2013. Labor dynamics in a mobile micro-task market. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 641--650. Google ScholarDigital Library
- oDesk. 2005. https://www.odesk.com/.Google Scholar
- OpenStreetMap. 2004. http://www.openstreetmap.org/.Google Scholar
- Christos H. Papadimitriou and Kenneth Steiglitz. 1998. Combinatorial Optimization: Algorithms and Complexity. Courier Dover Publications, Mineola, NY. Google ScholarDigital Library
- Aditya Parameswaran, Anish Das Sarma, Hector Garcia-Molina, Neoklis Polyzotis, and Jennifer Widom. 2011. Human-assisted graph search: it’s okay to ask questions. Proceedings of the VLDB Endowment 4, 5, 267--278. Google ScholarDigital Library
- Aditya G. Parameswaran, Hector Garcia-Molina, Hyunjung Park, Neoklis Polyzotis, Aditya Ramesh, and Jennifer Widom. 2012. Crowdscreen: Algorithms for filtering data with humans. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 361--372. Google ScholarDigital Library
- Layla Pournajaf, Li Xiong, Vaidy Sunderam, and Slawomir Goryczka. 2014. Spatial task assignment for crowd sensing with cloaked locations. In 2014 IEEE 15th International Conference on Mobile Data Management (MDM), Vol. 1. IEEE, 73--82. Google ScholarDigital Library
- Alexander J. Quinn and Benjamin B. Bederson. 2011. Human computation: A survey and taxonomy of a growing field. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1403--1412. Google ScholarDigital Library
- Rion Snow, Brendan O’Connor, Daniel Jurafsky, and Andrew Y. Ng. 2008. Cheap and fast—but is it good?: Evaluating non-expert annotations for natural language tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 254--263. Google ScholarDigital Library
- Alexander Sorokin and David Forsyth. 2008. Utility data annotation with Amazon Mechanical Turk. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008 (CVPRW’08). IEEE, 1--8.Google ScholarCross Ref
- Yong-Hong Sun, Jian Ma, Zhi-Ping Fan, and Jun Wang. 2008. A hybrid knowledge and model approach for reviewer assignment. Expert Systems with Applications 34, 2, 817--824. Google ScholarDigital Library
- Wenbin Tang, Jie Tang, Tao Lei, Chenhao Tan, Bo Gao, and Tian Li. 2012. On optimization of expertise matching with various constraints. Neurocomputing 76, 1, 71--83. Google ScholarDigital Library
- Hien To, Gabriel Ghinita, and Cyrus Shahabi. 2014. A framework for protecting worker location privacy in spatial crowdsourcing. Proceedings of the VLDB Endowment 7, 10. Google ScholarDigital Library
- Hien To, Gabriel Ghinita, and Cyrus Shahabi. 2015. PrivGeoCrowd: A toolbox for studying private spatial crowdsourcing. Proceedings of the 31st IEEE International Conference on Data Engineering.Google ScholarCross Ref
- Paolo Toth and Daniele Vigo. 2001. The vehicle routing problem. Siam, Philadelphia, PA. Google ScholarDigital Library
- UCB. 2008. http://traffic.berkeley.edu/.Google Scholar
- Umair ul Hassan and Edward Curry. 2014. A multi-armed bandit approach to online spatial task assignment. In 11th IEEE International Conference on Ubiquitous Intelligence and Computing (UIC’14). Google ScholarDigital Library
- Kasturi R. Varadarajan. 1998. A divide-and-conquer algorithm for min-cost perfect matching in the plane. In Proceedings of the 39th Annual Symposium on Foundations of Computer Science 1998. IEEE, 320--329. Google ScholarDigital Library
- Luis Von Ahn and Laura Dabbish. 2008. Designing games with a purpose. Communications of the ACM 51, 8, 58--67. Google ScholarDigital Library
- Jiannan Wang, Tim Kraska, Michael J. Franklin, and Jianhua Feng. 2012. Crowder: Crowdsourcing entity resolution. Proceedings of the VLDB Endowment 5, 11, 1483--1494. Google ScholarDigital Library
- Jacob Whitehill, Ting-fan Wu, Jacob Bergsma, Javier R. Movellan, and Paul L. Ruvolo. 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In Advances in Neural Information Processing Systems. 2035--2043.Google ScholarDigital Library
- Wikimapia. 2006. http://wikimapia.org/.Google Scholar
- Raymond Chi-Wing Wong, Yufei Tao, Ada Wai-Chee Fu, and Xiaokui Xiao. 2007. On efficient spatial matching. In Proceedings of the 33rd International Conference on Very Large Data Bases. VLDB Endowment, 579--590. Google ScholarDigital Library
- Tingxin Yan, Vikas Kumar, and Deepak Ganesan. 2010. Crowdsearch: Exploiting crowds for accurate real-time image search on mobile phones. In Proceedings of the 8th International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 77--90. Google ScholarDigital Library
- Man Lung Yiu, Kyriakos Mouratidis, Nikos Mamoulis, and others. 2008. Capacity constrained assignment in spatial databases. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 15--28. Google ScholarDigital Library
- Zhou Zhao, Wilfred Ng, and Zhijun Zhang. 2013. CrowdSeed: Query processing on microblogs. In Proceedings of the 16th International Conference on Extending Database Technology. ACM, New York, NY, 729--732. Google ScholarDigital Library
Index Terms
- A Server-Assigned Spatial Crowdsourcing Framework
Recommendations
Maximizing the number of worker's self-selected tasks in spatial crowdsourcing
SIGSPATIAL'13: Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information SystemsWith the progress of mobile devices and wireless broadband, a new eMarket platform, termed spatial crowdsourcing is emerging, which enables workers (aka crowd) to perform a set of spatial tasks (i.e., tasks related to a geographical location and time) ...
GeoCrowd: enabling query answering with spatial crowdsourcing
SIGSPATIAL '12: Proceedings of the 20th International Conference on Advances in Geographic Information SystemsWith the ubiquity of mobile devices, spatial crowdsourcing is emerging as a new platform, enabling spatial tasks (i.e., tasks related to a location) assigned to and performed by human workers. In this paper, for the first time we introduce a taxonomy ...
Destination-aware Task Assignment in Spatial Crowdsourcing
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge ManagementWith the proliferation of GPS-enabled smart devices and increased availability of wireless network, spatial crowdsourcing (SC) has been recently proposed as a framework to automatically request workers (i.e., smart device carriers) to perform location-...
Comments