Abstract
Crowdsourcing has facilitated a wide range of applications by leveraging public workers to contribute large number of tasks. However, most prior works only considered static environments and overlooked the system dynamics. In practice, the task set to be allocated is time-varying and the workers may be strategic when deciding whether to accept the tasks. In this paper, we formulate the online crowdsourcing problem as a sequential optimization problem, where a requestor needs to allocate tasks repeatedly to the workers to maximize the long-term cumulative utility. To deal with the dynamics, we first build an environmental model to predict the system dynamics. The model can also embed the tasks into a fixed lower-dimensional space. Next, we propose a multi-agent reinforcement learning algorithm to optimize the allocation mechanism for the requestor. The underlying intuition is that the mechanism can be robust even with adversarial workers. In the experiment, we conducted extensive experiments to evaluate the performance. The results validate that our method can achieve the best performance in almost all cases. The results are robust when deployed in an adversarial environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alabbadi, A.A., Abulkhair, M.F.: Multi-objective task scheduling optimization in spatial crowdsourcing. Algorithms 14(3), 77 (2021)
An, N., Wang, R., Luan, Z., Qian, D., Cai, J., Zhang, H.: Adaptive assignment for quality-aware mobile sensing network with strategic users. In: 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems, pp. 541–546. IEEE (2015)
Bhatti, S.S., Fan, J., Wang, K., Gao, X., Wu, F., Chen, G.: An approximation algorithm for bounded task assignment problem in spatial crowdsourcing. IEEE Trans. Mob. Comput. 20(8), 2536–2549 (2020)
Chi, C., Wang, Y., Li, Y., Tong, X.: Multistrategy repeated game-based mobile crowdsourcing incentive mechanism for mobile edge computing in internet of things. Wirel. Commun. Mob. Comput. 2021, 1–18 (2021)
Ding, Y., et al.: A city-wide crowdsourcing delivery system with reinforcement learning. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5(3), 1–22 (2021)
Haarnoja, T., et al.: Soft actor-critic algorithms and applications. arXiv preprint arXiv:1812.05905 (2018)
Kingma, D.P., Welling, M.: Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013)
Li, Y., Li, Y., Peng, Y., Fu, X., Xu, J., Xu, M.: Auction-based crowdsourced first and last mile logistics. IEEE Trans. Mob. Comput. (2022)
Liu, C.H., Dai, Z., Zhao, Y., Crowcroft, J., Wu, D., Leung, K.K.: Distributed and energy-efficient mobile crowdsensing with charging stations by deep reinforcement learning. IEEE Trans. Mob. Comput. 20(1), 130–146 (2019)
Liu, C.H., et al.: Curiosity-driven energy-efficient worker scheduling in vehicular crowdsourcing: A deep reinforcement learning approach. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp. 25–36. IEEE (2020)
Liu, S., et al.: Truthful online double auctions for mobile crowdsourcing: an on-demand service strategy. IEEE Internet Things J. 9(17), 16096–16112 (2022)
Lu, Z., Wang, Y., Tong, X., Mu, C., Chen, Y., Li, Y.: Data-driven many-objective crowd worker selection for mobile crowdsourcing in industrial iot. IEEE Trans. Industr. Inf. 19(1), 531–540 (2021)
Mak, T.S.H., Lam, A.Y.: Two-stage auction mechanism for long-term participation in crowdsourcing. IEEE Trans. Comput. Soc. Syst. (2022)
Miao, X., Peng, H., Gao, Y., Zhang, Z., Yin, J.: On dynamically pricing crowdsourcing tasks. ACM Trans. Knowl. Discov. Data (TKDD) 17(2), 1–27 (2022)
Tong, Y., Chen, L., Zhou, Z., Jagadish, H.V., Shou, L., Lv, W.: Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans. Knowl. Data Eng. 30(8), 1588–1601 (2018)
Tong, Y., Wang, L., Zhou, Z., Chen, L., Du, B., Ye, J.: Dynamic pricing in spatial crowdsourcing: a matching-based approach. In: Proceedings of the 2018 International Conference on Management of Data, pp. 773–788 (2018)
Wang, R., Zeng, F., Yao, L., Wu, J.: Game-theoretic algorithm designs and analysis for interactions among contributors in mobile crowdsourcing with word of mouth. IEEE Internet Things J. 7(9), 8271–8286 (2020)
Wang, Y., Cai, Z., Zhan, Z.H., Gong, Y.J., Tong, X.: An optimization and auction-based incentive mechanism to maximize social welfare for mobile crowdsourcing. IEEE Trans. Comput. Soc. Syst. 6(3), 414–429 (2019)
Wang, Y., Gao, Y., Li, Y., Tong, X.: A worker-selection incentive mechanism for optimizing platform-centric mobile crowdsourcing systems. Comput. Netw. 171, 107144 (2020)
Wu, Z., Li, Q., Wu, W., Zhao, M.: Crowdsourcing model for energy efficiency retrofit and mixed-integer equilibrium analysis. IEEE Trans. Industr. Inf. 16(7), 4512–4524 (2019)
Yang, D., Xue, G., Fang, X., Tang, J.: Incentive mechanisms for crowdsensing: crowdsourcing with smartphones. IEEE/ACM Trans. Netw. 24(3), 1732–1744 (2015)
Zhang, W., Hong, Z., Chen, W.: Hierarchical pricing mechanism with financial stability for decentralized crowdsourcing: a smart contract approach. IEEE Internet Things J. 8(2), 750–765 (2020)
Zhao, Y., Zheng, K., Guo, J., Yang, B., Pedersen, T.B., Jensen, C.S.: Fairness-aware task assignment in spatial crowdsourcing: game-theoretic approaches. In: 2021 IEEE 37th International Conference on Data Engineering (ICDE), pp. 265–276. IEEE (2021)
Zhu, X., Luo, Y., Liu, A., Tang, W., Bhuiyan, M.Z.A.: A deep learning-based mobile crowdsensing scheme by predicting vehicle mobility. IEEE Trans. Intell. Transp. Syst. 22(7), 4648–4659 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, B., Zhang, J., Wu, L., Xiao, F. (2024). Robust Online Crowdsourcing with Strategic Workers. In: Li, C., Li, Z., Shen, L., Wu, F., Gong, X. (eds) Advanced Parallel Processing Technologies. APPT 2023. Lecture Notes in Computer Science, vol 14103. Springer, Singapore. https://doi.org/10.1007/978-981-99-7872-4_23
Download citation
DOI: https://doi.org/10.1007/978-981-99-7872-4_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7871-7
Online ISBN: 978-981-99-7872-4
eBook Packages: Computer ScienceComputer Science (R0)
