skip to main content
research-article

A Server-Assigned Spatial Crowdsourcing Framework

Published:27 July 2015Publication History
Skip Abstract Section

Abstract

With the popularity of mobile devices, spatial crowdsourcing is rising as a new framework that enables human workers to solve tasks in the physical world. With spatial crowdsourcing, the goal is to crowdsource a set of spatiotemporal tasks (i.e., tasks related to time and location) to a set of workers, which requires the workers to physically travel to those locations in order to perform the tasks. In this article, we focus on one class of spatial crowdsourcing, in which the workers send their locations to the server and thereafter the server assigns to every worker tasks in proximity to the worker’s location with the aim of maximizing the overall number of assigned tasks. We formally define this maximum task assignment (MTA) problem in spatial crowdsourcing, and identify its challenges. We propose alternative solutions to address these challenges by exploiting the spatial properties of the problem space, including the spatial distribution and the travel cost of the workers. MTA is based on the assumptions that all tasks are of the same type and all workers are equally qualified in performing the tasks. Meanwhile, different types of tasks may require workers with various skill sets or expertise. Subsequently, we extend MTA by taking the expertise of the workers into consideration. We refer to this problem as the maximum score assignment (MSA) problem and show its practicality and generality. Extensive experiments with various synthetic and two real-world datasets show the applicability of our proposed framework.

References

  1. Omar Alonso, Daniel E. Rose, and Benjamin Stewart. 2008. Crowdsourcing for relevance evaluation. In ACM SigIR Forum, Vol. 42. ACM, New York, NY, 9--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Florian Alt, Alireza Sahami Shirazi, Albrecht Schmidt, Urs Kramer, and Zahid Nawaz. 2010. Location-based crowdsourcing: Extending crowdsourcing to the real world. In Proceedings of the 6th Nordic Conference on Human--Computer Interaction: Extending Boundaries. ACM, New York, NY, 13--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Amazon Mechanical Turk. 2005. http://www.mturk.com/.Google ScholarGoogle Scholar
  4. Alessandro Bozzon, Marco Brambilla, and Stefano Ceri. 2012. Answering search queries with crowdsearcher. In Proceedings of the 21st International Conference on World Wide Web. ACM, New York, NY, 1009--1018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Muhammed Fatih Bulut, Yavuz Selim Yilmaz, and Murat Demirbas. 2011. Crowdsourcing location-based queries. In 2011 IEEE International Conference onPervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 513--518.Google ScholarGoogle ScholarCross RefCross Ref
  6. Kuan-Ta Chen, Chen-Chi Wu, Yu-Chun Chang, and Chin-Laung Lei. 2009. A crowdsourceable QoE evaluation framework for multimedia content. In Proceedings of the 17th ACM International Conference on Multimedia. ACM, New York, NY, 491--500. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cory Cornelius, Apu Kapadia, David Kotz, Dan Peebles, Minho Shin, and Nikos Triandopoulos. 2008. Anonysense: Privacy-aware people-centric sensing. In Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 211--224. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Justin Cranshaw, Eran Toch, Jason Hong, Aniket Kittur, and Norman Sadeh. 2010. Bridging the gap between physical location and online social networks. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing. ACM, New York, NY, 119--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Crowdflower. 2009. http://www.crowdflower.com/.Google ScholarGoogle Scholar
  10. Hung Dang, Tuan Nguyen, and Hien To. 2013. Maximum complex task assignment: Towards tasks correlation in spatial crowdsourcing. In Proceedings of International Conference on Information Integration and Web-based Applications & Services. ACM, New York, NY, 77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gianluca Demartini, Beth Trushkowsky, Tim Kraska, and Michael J. Franklin. 2013. CrowdQ: Crowdsourced query understanding. In CIDR.Google ScholarGoogle Scholar
  12. Dingxiong Deng, Cyrus Shahabi, and Ugur Demiryurek. 2013. Maximizing the number of worker’s self-selected tasks in spatial crowdsourcing. In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 314--323. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Field Agent. 2010. http://www.fieldagent.net/.Google ScholarGoogle Scholar
  14. Michael J. Franklin, Donald Kossmann, Tim Kraska, Sukriti Ramesh, and Reynold Xin. 2011. CrowdDB: Answering queries with crowdsourcing. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 61--72. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Gigwalk. 2010. http://gigwalk.com/.Google ScholarGoogle Scholar
  16. GoogleMapMaker. 2008. http://www.google.com/mapmaker/.Google ScholarGoogle Scholar
  17. Ido Guy, Adam Perer, Tal Daniel, Ohad Greenshpan, and Itai Turbahn. 2011. Guess who?: Enriching the social graph through a crowdsourcing game. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1373--1382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Seth Hettich and Michael J. Pazzani. 2006. Mining for proposal reviewers: Lessons learned at the National Science Foundation. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 862--871. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Bret Hull, Vladimir Bychkovsky, Yang Zhang, Kevin Chen, Michel Goraczko, Allen Miu, Eugene Shih, Hari Balakrishnan, and Samuel Madden. 2006. CarTel: A distributed mobile sensor computing system. In Proceedings of the 4th International Conference on Embedded Networked Sensor Systems. ACM, New York, NY, 125--138. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. ILOG CPLEX. 2007. 11.0 Users Manual. ILOG SA, Gentilly, France.Google ScholarGoogle Scholar
  21. Bala Kalyanadundaram and Kirk R. Pruhs. 1993. Online weighted matching. Journal of Algorithms (1993), 478--488. Issue 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Bala Kalyanasundaram and Kirk R. Pruhs. 2000. An optimal deterministic algorithm for online b-matching. Theoretical Computer Science 233, 1, 319--325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani. 1990. An optimal algorithm for on-line bipartite matching. 352--258. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Leyla Kazemi and Cyrus Shahabi. 2011. A privacy-aware framework for participatory sensing. ACM SIGKDD Explorations Newsletter 13, 1, 43--51. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Leyla Kazemi and Cyrus Shahabi. 2012. GeoCrowd: Enabling query answering with spatial crowdsourcing. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 189--198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Leyla Kazemi, Cyrus Shahabi, and Lei Chen. 2013. Geotrucrowd: Trustworthy query answering with spatial crowdsourcing. In Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, New York, NY, 314--323. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Samir Khuller, Stephen G. Mitchell, and Vijay V. Vazirani. 1994. On-line algorithms for weighted bipartite matching and stable marriages. Theoretical Computer Science 2, 255--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The future of crowd work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work. ACM, New York, NY, 1301--1318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Jon Kleinberg and Eva Tardos. 2006. Algorithm design. Pearson Education India, Delhi, India. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Eugene L. Lawler, Jan Karel Lenstra, A. H. G. Rinnooy Kan, and David B. Shmoys. 1985. The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. Vol. 3. Wiley, New York, NY.Google ScholarGoogle Scholar
  31. Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, and Meihui Zhang. 2012. CDAS: A crowdsourcing data analytics system. Proceedings of the VLDB Endowment 5, 10, 1040--1051. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Adam Marcus, Eugene Wu, David Karger, Samuel Madden, and Robert Miller. 2011. Human-powered sorts and joins. Proceedings of the VLDB Endowment 5, 1, 13--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Aranyak Mehta, Amin Saberi, Umesh Vazirani, and Vijay Vazirani. 2007. Adwords and generalized online matching. Journal of the ACM (JACM) 54, 5, 22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. David Mimno and Andrew McCallum. 2007. Expertise modeling for matching papers with reviewers. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, New York, NY, 500--509. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Prashanth Mohan, Venkata N. Padmanabhan, and Ramachandran Ramjee. 2008. Nericell: Rich monitoring of road and traffic conditions using mobile smartphones. In Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems. ACM, New York, NY, 323--336. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Mohamed Musthag and Deepak Ganesan. 2013. Labor dynamics in a mobile micro-task market. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 641--650. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. oDesk. 2005. https://www.odesk.com/.Google ScholarGoogle Scholar
  38. OpenStreetMap. 2004. http://www.openstreetmap.org/.Google ScholarGoogle Scholar
  39. Christos H. Papadimitriou and Kenneth Steiglitz. 1998. Combinatorial Optimization: Algorithms and Complexity. Courier Dover Publications, Mineola, NY. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Aditya Parameswaran, Anish Das Sarma, Hector Garcia-Molina, Neoklis Polyzotis, and Jennifer Widom. 2011. Human-assisted graph search: it’s okay to ask questions. Proceedings of the VLDB Endowment 4, 5, 267--278. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Aditya G. Parameswaran, Hector Garcia-Molina, Hyunjung Park, Neoklis Polyzotis, Aditya Ramesh, and Jennifer Widom. 2012. Crowdscreen: Algorithms for filtering data with humans. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 361--372. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Layla Pournajaf, Li Xiong, Vaidy Sunderam, and Slawomir Goryczka. 2014. Spatial task assignment for crowd sensing with cloaked locations. In 2014 IEEE 15th International Conference on Mobile Data Management (MDM), Vol. 1. IEEE, 73--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Alexander J. Quinn and Benjamin B. Bederson. 2011. Human computation: A survey and taxonomy of a growing field. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1403--1412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Rion Snow, Brendan O’Connor, Daniel Jurafsky, and Andrew Y. Ng. 2008. Cheap and fast—but is it good?: Evaluating non-expert annotations for natural language tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 254--263. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Alexander Sorokin and David Forsyth. 2008. Utility data annotation with Amazon Mechanical Turk. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008 (CVPRW’08). IEEE, 1--8.Google ScholarGoogle ScholarCross RefCross Ref
  46. Yong-Hong Sun, Jian Ma, Zhi-Ping Fan, and Jun Wang. 2008. A hybrid knowledge and model approach for reviewer assignment. Expert Systems with Applications 34, 2, 817--824. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Wenbin Tang, Jie Tang, Tao Lei, Chenhao Tan, Bo Gao, and Tian Li. 2012. On optimization of expertise matching with various constraints. Neurocomputing 76, 1, 71--83. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Hien To, Gabriel Ghinita, and Cyrus Shahabi. 2014. A framework for protecting worker location privacy in spatial crowdsourcing. Proceedings of the VLDB Endowment 7, 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Hien To, Gabriel Ghinita, and Cyrus Shahabi. 2015. PrivGeoCrowd: A toolbox for studying private spatial crowdsourcing. Proceedings of the 31st IEEE International Conference on Data Engineering.Google ScholarGoogle ScholarCross RefCross Ref
  50. Paolo Toth and Daniele Vigo. 2001. The vehicle routing problem. Siam, Philadelphia, PA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. UCB. 2008. http://traffic.berkeley.edu/.Google ScholarGoogle Scholar
  52. Umair ul Hassan and Edward Curry. 2014. A multi-armed bandit approach to online spatial task assignment. In 11th IEEE International Conference on Ubiquitous Intelligence and Computing (UIC’14). Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Kasturi R. Varadarajan. 1998. A divide-and-conquer algorithm for min-cost perfect matching in the plane. In Proceedings of the 39th Annual Symposium on Foundations of Computer Science 1998. IEEE, 320--329. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Luis Von Ahn and Laura Dabbish. 2008. Designing games with a purpose. Communications of the ACM 51, 8, 58--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Jiannan Wang, Tim Kraska, Michael J. Franklin, and Jianhua Feng. 2012. Crowder: Crowdsourcing entity resolution. Proceedings of the VLDB Endowment 5, 11, 1483--1494. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Jacob Whitehill, Ting-fan Wu, Jacob Bergsma, Javier R. Movellan, and Paul L. Ruvolo. 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In Advances in Neural Information Processing Systems. 2035--2043.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Wikimapia. 2006. http://wikimapia.org/.Google ScholarGoogle Scholar
  58. Raymond Chi-Wing Wong, Yufei Tao, Ada Wai-Chee Fu, and Xiaokui Xiao. 2007. On efficient spatial matching. In Proceedings of the 33rd International Conference on Very Large Data Bases. VLDB Endowment, 579--590. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Tingxin Yan, Vikas Kumar, and Deepak Ganesan. 2010. Crowdsearch: Exploiting crowds for accurate real-time image search on mobile phones. In Proceedings of the 8th International Conference on Mobile Systems, Applications, and Services. ACM, New York, NY, 77--90. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Man Lung Yiu, Kyriakos Mouratidis, Nikos Mamoulis, and others. 2008. Capacity constrained assignment in spatial databases. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. ACM, New York, NY, 15--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Zhou Zhao, Wilfred Ng, and Zhijun Zhang. 2013. CrowdSeed: Query processing on microblogs. In Proceedings of the 16th International Conference on Extending Database Technology. ACM, New York, NY, 729--732. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Server-Assigned Spatial Crowdsourcing Framework

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Spatial Algorithms and Systems
      ACM Transactions on Spatial Algorithms and Systems  Volume 1, Issue 1
      Inaugural Issue
      August 2015
      116 pages
      ISSN:2374-0353
      EISSN:2374-0361
      DOI:10.1145/2807914
      • Editor:
      • Hanan Samet
      Issue’s Table of Contents

      Copyright © 2015 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 July 2015
      • Accepted: 1 January 2015
      • Revised: 1 September 2014
      • Received: 1 November 2013
      Published in tsas Volume 1, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader