Roee Shraga
Avigdor Gal
ABSTRACT
We present InCognitoMatch, the first cognitive-aware crowdsourcing application for matching tasks. InCognitoMatch provides a handy tool to validate, annotate, and correct correspondences using the crowd whilst accounting for human matching biases. In addition, InCognitoMatch enables system administrators to control context information visible for workers and analyze their performance accordingly. For crowd workers, InCognitoMatch is an easy-to-use application that may be accessed from multiple crowdsourcing platforms. In addition, workers completing a task are offered suggestions for followup sessions according to their performance in the current session. For this demo, the audience will be able to experience InCognitoMatch thorough three use-cases, interacting with system as workers and as administrators.
- Rakefet Ackerman. 2014. The diminishing criterion model for metacognitive regulation of time investment. Journal of Experimental Psychology: General (2014).Google Scholar
- Rakefet Ackerman, Avigdor Gal, Tomer Sagi, and Roee Shraga. 2019. A Cognitive Model of Human Bias in Matching. In PRICAI.Google Scholar
- Anne Anastasi and Susana Urbina. 1997. Psychological testing .Prentice Hall/Pearson Education.Google Scholar
- Chen Chen, Behzad Golshan, Alon Y Halevy, Wang-Chiew Tan, and AnHai Doan. 2018. BigGorilla: An Open-Source Ecosystem for Data Preparation and Integration. IEEE Data Eng. Bull. (2018).Google Scholar
- H. H. Do and E. Rahm. 2002. COMA: a system for flexible combination of schema matching approaches. In VLDB. VLDB Endowment.Google Scholar
- Avigdor Gal. 2011. Uncertain Schema Matching .Morgan & Claypool Publishers.Google Scholar
- E. Rahm and P. A. Bernstein. 2001. A survey of approaches to automatic schema matching. VLDBJ (2001).Google Scholar
- C. Sarasua, E. Simperl, and N. F Noy. 2012. Crowdmap: Crowdsourcing ontology alignment with microtasks. In ISWC.Google Scholar
- Roee Shraga, Avigdor Gal, and Haggai Roitman. 2018. What Type of a Matcher Are You?: Coordination of Human and Algorithmic Matchers. In HILDA@SIGMOD.Google Scholar
- Y Wayne Wu and Brian P Bailey. 2016. Novices Who Focused or Experts Who Didn't?. In SIGCHI. ACM.Google Scholar
- Chen Zhang, Lei Chen, HV Jagadish, Mengchen Zhang, and Yongxin Tong. 2018. Reducing Uncertainty of Schema Matching via Crowdsourcing with Accuracy Rates. TKDE (2018).Google Scholar
Index Terms
- InCognitoMatch: Cognitive-aware Matching via Crowdsourcing
Recommendations
Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing SystemsCrowdsourcing is increasingly being used as a means to tackle problems requiring human intelligence. With the ever-growing worker base that aims to complete microtasks on crowdsourcing platforms in exchange for financial gains, there is a need for ...
Two-sided preferences task matching mechanisms for blockchain-based crowdsourcing
AbstractIn this paper, novel task matching mechanisms with two-sided preferences of workers and requesters are proposed for blockchain-based crowdsourcing. Existing blockchain-based crowdsourcing frameworks match workers to tasks using ...
Graphical abstractDisplay Omitted
Toward crowdsourcing micro-level behavior annotations: the challenges of interface, training, and generalization
IUI '14: Proceedings of the 19th international conference on Intelligent User InterfacesResearch that involves human behavior analysis usually requires laborious and costly efforts for obtaining micro-level behavior annotations on a large video corpus. With the emerging paradigm of crowdsourcing however, these efforts can be considerably ...
Comments