Walter S. Lasecki
ABSTRACT
Training intelligent systems is a time-consuming and costly process that often limits real-world applications. Prior work has attempted to compensate for this challenge by generating sets of labeled training data for machine learning algorithms using affordable human contributors. In this paper, we present ARchitect, a system that uses the crowd to extract context-dependent relational structure. We focus on activity recognition because of its broad applicability, high level of variation, and difficulty of training systems a priority. We demonstrate that using our approach, the crowd can accurately and consistently identify relationships between actions even over sessions containing different workers and varied executions of an activity. This results in the ability to identify multiple valid execution paths from a single observation, suggesting that one-off learning can be facilitated by using the crowd as an on-demand source of human intelligence in the knowledge acquisition process.
- M. S. Bernstein, J. R. Brandt, R. C. Miller, and D. R. Karger. Crowds in two seconds: Enabling realtime crowd-powered interfaces. In Proc. of UIST ?11, p.33?42, 2011. Google Scholar
Digital Library
- M. S. Bernstein, G. Little, R. C. Miller, B. Hartmann, M. S. Ackerman, D. R. Karger, D. Crowell, and K. Panovich. Soylent: a word processor with a crowd inside. In Proc. of UIST ?10, p.313?322, 2010. Google ScholarDigital Library
- J. P. Bigham, C. Jayant, H. Ji, G. Little, A. Miller, R. C. Miller, R. Miller, A. Tatarowicz, B. White, S. White, and T. Yeh. Vizwiz: nearly real-time answers to visual questions. In Proc. of UIST ?10, p.333?342, 2010. Google ScholarDigital Library
- L. B. Chilton, G. Little, D. Edge, D. S. Weld, and J. A. Landay. Cascade: Crowdsourcing taxonomy creation. In Proc. of CHI ?13, To Appear, 2013. Google ScholarDigital Library
- G. Demartini, B. Trushkowsky, T. Kraska, and M. Franklin. CrowdQ: Crowdsourced query understanding. In Proc. of CIDR ?13, 2013.Google Scholar
- W. S. Lasecki, Y. C. Song, H. Kautz, and J. P. Bigham. Real-Time Crowd Labeling for Deployable Activity Recognition. In Proc. of CSCW ?13, p.1203?1212, 2013. Google ScholarDigital Library
- L. von Ahn and L. Dabbish. Labeling images with a computer game. In Proceedings of the conf. on Human factors in computing systems, CHI ?04, p.319?326, 2004. Google ScholarDigital Library
Index Terms
- Finding action dependencies using the crowd
Recommendations
Finding dependencies between actions using the crowd
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsActivity recognition can provide computers with the context underlying user inputs, enabling more relevant responses and more fluid interaction. However, training these systems is difficult because it requires observing every possible sequence of ...
Modus Operandi of Crowd Workers: The Invisible Role of Microtask Work Environments
The ubiquity of the Internet and the widespread proliferation of electronic devices has resulted in flourishing microtask crowdsourcing marketplaces, such as Amazon MTurk. An aspect that has remained largely invisible in microtask crowdsourcing is that ...
Efficient Crowd Exploration of Large Networks: The Case of Causal Attribution
Accurately and efficiently crowdsourcing complex, open-ended tasks can be difficult, as crowd participants tend to favor short, repetitive "microtasks". We study the crowdsourcing of large networks where the crowd provides the network topology via ...
Comments