Sujoy Chatterjee
ABSTRACT
Collection of multiple annotations from the crowd workers is useful for diverse applications. In this paper, the problem of obtaining the final judgment from such crowd-based annotations has been addressed in an unsupervised way using a biclustering-based approach. Results on multiple datasets show that the proposed approach is competitively better than others, without even using the entire dataset.
- D. Hovy, T. B. Kirkpatrick, A. Vaswani, and E. Hovy. Learning whom to trust with mace. In Proceedings of the NAACL-HLT, pages 1120--1130, 2013.Google Scholar
- Q. Liu, J. Peng, and A. Ihler. Report of crowdscale shared task challenge 2013. In Proceedings of the Crowdscale Shared Task Challenge, 2013.Google Scholar
- V. Rayker and S. Yu. Eliminating spammers and ranking annotators for crowdsourced labeling tasks. Journal of Machine Learning Research, 13: 491--518, 2011. Google ScholarDigital Library
- A. Sheshadri and M. Lease. SQUARE: A Benchmark for Research on computing crowd consensus. In Proceedings of the AAAI HCOMP, pages 2035--2043, 2013.Google ScholarCross Ref
- M. Venanzi, J. Guiver, G. Kazai, and P. Kohli. Bayesian combination of crowd-based tweet sentiment analysis judgments. In Proceedings of the Crowdscale Shared Task Challenge, 2013.Google Scholar
Index Terms
- A biclustering approach for crowd judgment analysis
Recommendations
Judgment analysis of crowdsourced opinions using biclustering
The problem of deriving final judgment from crowdsourced opinions is addressed with an unsupervised approach.Biclustering is shown to be useful for identifying the annotators crucial for a judgment.We establish that a suitable fraction of the entire ...
Crowd behavior analysis
Although the traits emerged in a mass gathering are often non-deliberative, the act of mass impulse may lead to irrevocable crowd disasters. The two-fold increase of carnage in crowd since the past two decades has spurred significant advances in the ...
Gene interaction - An evolutionary biclustering approach
DNA Microarray experiments form a powerful tool for studying gene expression patterns, in large scale. Sharing of the regulatory mechanism among genes, in an organism, is predominantly responsible for their co-expression. Biclustering aims at finding a ...
Comments