Abstract
Crowdsourcing is an economical and efficient tool that hires human labour to execute tasks which are difficult to solve otherwise. Verification of the quality of the workers is a major problem in Crowd sourcing. We need to judge the performance of the workers based on their history of service and it is difficult to do so without hiring other workers. In this paper, we propose an Ant Colony Optimization (ACO) based reputation management system that can differentiate between good and bad workers. Using experimental evaluation, we show that, the algorithm works fine on the real scenario and efficiently differentiate workers with higher reputations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2004)
Ara, S.S., Thakur, S., Breslin, J.G.: Expertise discovery in decentralised online social networks. In: ASONAM 2017 (2017)
Awwad, T.: Context-aware worker selection for efficient quality control in crowdsourcing (2018)
Dalvi, N., Dasgupta, A., Kumar, R., Rastogi, V.: Aggregating crowdsourced binary ratings. In: WWW 2013 (2013)
Dorigo, S.: Ant Colonies and the Mesh-Partitioning Problem, pp. 203–208. MIT Press, Cambridge (2004)
Dwarakanath, A., Shrikanth, N.C., Abhinav, K., Kass, A.: Trustworthiness in enterprise crowdsourcing: a taxonomy and evidence from data. In: ICSE 2016 (2016)
Anta, A.F., Georgiou, C., Mosteiro, M.A., Pareja, D.: Algorithmic mechanisms for reliable crowdsourcing computation under collusion. PLoS One 10, e0116520 (2015)
Ho, C.J., Slivkins, A., Vaughan, J.W.: Adaptive Contract Design for Crowdsourcing Markets: Bandit Algorithms for Repeated Principal-Agent Problems (2014)
Jagabathula, S., Subramanian, L., Venkataraman, A.: Reputation-based worker filtering in crowdsourcing. In: Advances in Neural Information Processing Systems 27 (2014)
Kamar, E., Horvitz, E.: Incentives for truthful reporting in crowdsourcing. In: AAMAS 2012 (2012)
Liu, N., Yang, H., Hu, X.: Adversarial detection with model interpretation. In: KDD 2018 (2018)
Liu, S., Miao, C., Liu, Y., Yu, H., Zhang, J., Leung, C.: An incentive mechanism to elicit truthful opinions for crowdsourced multiple choice consensus tasks. In: WI-IAT (2015)
Lu, J., Pan, L., Liu, S., Liu, X.: Distributed ACO based on a crowdsourcing model for multiobjective problem. In: CSCWD (2017)
Movshovitz-Attias, D., Movshovitz-Attias, Y., Steenkiste, P., Faloutsos, C.: Analysis of the reputation system and user contributions on a question answering website: stackoverflow. In: ASONAM 2013 (2013)
Tan, C.H., Agichtein, E., Ipeirotis, P., Gabrilovich, E.: Trust, but verify: predicting contribution quality for knowledge base construction and curation. In: WSDM 2014 (2014)
Viswanath, B., Post, A., Gummadi, K.P., Mislove, A.: An analysis of social network-based sybil defenses. SIGCOMM Comput. Commun. Rev. 41, 363–374 (2011)
Ye, B., Wang, Y., Liu, L.: Crowd trust: a context-aware trust model for worker selection in crowdsourcing environments. In: ICWS (2015)
Bachrach, Y., Graepel, T., Minka, T., Guiver, J.: How to grade a test without knowing the answers - a Bayesian graphical model for adaptive crowdsourcing and aptitude testing. In: ICML 2012 (2012)
Yu, H., Shen, Z., Leung, C.: Bringing reputation-awareness into crowdsourcing. In: ICICS 2013 (2013)
Acknowledgement
This publication has emanated from research supported in part by a research grant from Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/ 2289-P2(Insight) and by a research grant from SFI and the Department of Agriculture, Food and the Marine on behalf of the Government of Ireland under Grant Number SFI/12/RC/3835(VistaMilk), co-funded by the European Regional Development Fund.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ara, S.S., Thakur, S., Breslin, J.G. (2019). Distributed ACO Based Reputation Management in Crowdsourcing. In: Montella, R., Ciaramella, A., Fortino, G., Guerrieri, A., Liotta, A. (eds) Internet and Distributed Computing Systems . IDCS 2019. Lecture Notes in Computer Science(), vol 11874. Springer, Cham. https://doi.org/10.1007/978-3-030-34914-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-34914-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34913-4
Online ISBN: 978-3-030-34914-1
eBook Packages: Computer ScienceComputer Science (R0)