Abstract
With the massive deployment of mobile devices, crowdsourcing has become a new service paradigm in which a task requester can proactively recruit a batch of participants with a mobile IoT device from our system for quick and accurate results. In a mobile industrial crowdsourcing platform, a large amount of data is collected, extracted information, and distributed to requesters. In an entire task process, the system receives a task, allocates some suitable participants to complete it, and collects feedback from the requesters. We present a participant selection method, which adopts an end-to-end deep neural network to iteratively update the participant selection policy. The neural network consists of three main parts: (1) task and participant ability prediction part which adopts a bag of words method to extract the semantic information of a query, (2) feature transformation part which adopts a series of linear and nonlinear transformations and (3) evaluation part which uses requesters’ feedback to update the network. In addition, the policy gradient method which is proved effective in the deep reinforcement learning field is adopted to update our participant selection method with the help of requesters’ feedback. Finally, we conduct an extensive performance evaluation based on the combination of real traces and a real question and answer dataset and numerical results demonstrate that our method can achieve superior performance and improve more than 150% performance gain over a baseline method.
Y. Wang and Y. Tian—Contribute equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu, Y., Wang, Y., Cao, G.: Photo crowdsourcing for area coverage in resource constrained environments. In: Proceeding of IEEE Conference on Computer Communications, pp. 1–9 (2017)
Fan, J., Zhang, M., Kok, S., Lu, M., Ooi, B.C.: CrowdOp: query optimization for declarative crowdsourcing systems. In: Proceeding of Conference on Empirical Methods in Natural Language Processing, pp. 1546–1547 (2016)
Agadakos, I., Polakis, J., Portokalidis, G.: Techu: open and privacy-preserving crowdsourced GPS for the masses. In: Proceeding of International Conference on Mobile Systems, Applications, and Services, pp. 475–487 (2017)
Wang, X., Zheng, X., Zhang, Q., Wang, T., Shen, D.: Crowdsourcing in its: the state of the work and the networking. IEEE Trans. Intell. Transp. Syst. 17(6), 1596–1605 (2016)
Mao, K., Capra, L., Harman, M., Jia, Y.: A survey of the use of crowdsourcing in software engineering. J. Syst. Softw. 126(22), 15–27 (2016)
To, H., Ghinita, G., Fan, L., Shahabi, C.: Differentially private location protection for worker datasets in spatial crowdsourcing. IEEE Trans. Mob. Comput. 16, 934–949 (2017)
Tong, Y., She, J., Ding, B., Wang, L., Chen, L.: Online mobile micro-task allocation in spatial crowdsourcing. In: Proceeding of IEEE International Conference on Data Engineering, pp. 49–60 (2016)
Pan, Z., Yu, H., Miao, C., Leung, C.: Efficient collaborative crowd-sourcing. In: Proceeding of the National Conference on Artificial Intelligence, pp. 4248–4249 (2016)
Qiu, C., Carminati, B., Carminati, B., Caverlee, J., Khare, D.R.: CrowdSelect: increasing accuracy of crowdsourcing tasks through behavior prediction and user selection. In: Proceedings of International on Conference on Information and Knowledge Management, pp. 539–548 (2016)
Pu, L., Chen, X., Xu, J., Fu, X.: Crowdlet: optimal worker recruitment for self-organized mobile crowdsourcing. In: Proceedings of International Conference on Computer Communications, pp. 1–9 (2016)
Duan, Y., Chen, X., Houthooft, R., Schulman, J., Abbeel, P.: Benchmarking deep reinforcement learning for continuous control. In: Proceedings of International Conference on International Conference on Machine Learning, pp. 1329–1338 (2016)
Narasimhan, K., Yala, A., Barzilay, R.: Improving information extraction by acquiring external evidence with reinforcement learning. In: Proceeding of International Conference on Data Engineering, pp. 2355–2365 (2016)
Zheng, Y., Li, Q., Chen, Y., Xie, X., Ma, W.Y.: Understanding mobility based on GPS data. In: Proceedings of International Conference on Ubiquitous Computing, pp. 312–321 (2008)
Zheng, Y., Zhang, L., Xie, X., Ma, W.-Y.: Mining interesting locations and travel sequences from GPS trajectories. In: Proceedings of International Conference on World Wide Web, pp. 791–800 (2009)
Zheng, Y., Xie, X., Ma, W.Y.: GeoLife: a collaborative social networking service among user, location and trajectory. Trans. Bull. Tech. Committee Data Eng. 33(2), 32–39 (2010)
Cheng, P., Lian, X., Chen, L., Han, J., Zhao, J.: Task assignment on multi-skill oriented spatial crowdsourcing. IEEE Trans. Knowl. Data Eng. 28(8), 2201–2215 (2015)
Cui, L., Zhao, X., Liu, L., Yu, H., Miao, Y.: Learning complex crowdsourcing task allocation strategies from humans. In: Proceedings of International Conference on Crowd Science and Engineering, pp. 33–37 (2017)
Zhang, D., Xiong, H., Wang, L., Chen, G.: CrowdRecruiter: selecting participants for piggyback crowdsensing under probabilistic coverage constraint. In: Proceedings of International Joint Conference on Pervasive and Ubiquitous Computing, pp. 703–714 (2014)
Li, H., Li, T., Wang, Y.: Dynamic participant recruitment of mobile crowd sensing for heterogeneous sensing tasks. In: Proceeding of International Conference on Mobile Ad Hoc and Sensor Systems, pp. 136–144 (2015)
Jung, S.H., Moon, B.C., Han, D.: Unsupervised learning for crowd-sourced indoor localization in wireless networks. IEEE Trans. Mob. Comput. 15(11), 2892–2906 (2016)
Gao, J., Li, Q., Zhao, B., Fan, W., Han, J.: Mining reliable information from passively and actively crowdsourced data. In: Proceedings of International Conference on Knowledge Discovery and Data Mining, pp. 2121–2122 (2016)
Kulkarni, T.D., Narasimhan, K., Saeedi, A., Tenenbaum, J.: Hierarchical deep reinforcement learning: integrating temporal abstraction and intrinsic motivation. In: Proceedings of Annual Conference on Neural Information Processing Systems, pp. 3675–3683 (2016)
Acknowledgment
Dr Xuyun Zhang is the recipient of an ARC DECRA (project No. DE210101458) funded by the Australian Government.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Wang, Y., Tian, Y., Zhang, X., He, X., Li, S., Zhu, J. (2022). Deep Reinforcement Learning Based Iterative Participant Selection Method for Industrial IoT Big Data Mobile Crowdsourcing. In: Li, B., et al. Advanced Data Mining and Applications. ADMA 2022. Lecture Notes in Computer Science(), vol 13087. Springer, Cham. https://doi.org/10.1007/978-3-030-95405-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-95405-5_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95404-8
Online ISBN: 978-3-030-95405-5
eBook Packages: Computer ScienceComputer Science (R0)