Jon Chamberlain
ABSTRACT
The goal of the ANAWIKI project is to experiment with Web collaboration and human computation to create largescale linguistically annotated corpora. We will present ongoing work and initial results of Phrase Detectives, a game designed to collect judgments about anaphoric annotations.
- J. Chamberlain, M. Poesio, and U. Kruschwitz. Phrase Detectives: A Web-based Collaborative Annotation Game. In Proceedings of the International Conference on Semantic Systems (I-Semantics'08), Graz, 2008.Google Scholar
- J. Chamberlain, M. Poesio, and U. Kruschwitz. A new life for a dead parrot: Incentive structures in the Phrase Detectives game. In Proceedings of the Webcentives Workshop at WWW'09, Madrid, 2009.Google Scholar
- J. Cohen. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37--46, 1960.Google ScholarCross Ref
- N. L. Johnson, S. Rasmussen, C. Joslyn, L. Rocha, S. Smith, and M. Kantor. Symbiotic Intelligence: Self-Organizing Knowledge on Distributed Networks Driven by Human Interaction. In Proceedings of the Sixth International Conference on Artificial Life. MIT Press, 1998. Google ScholarDigital Library
- U. Kruschwitz, J. Chamberlain, and M. Poesio. (Linguistic) Science Through Web Collaboration in the ANAWIKI Project. In Proceedings of WebSci'09, Athens, 2009.Google Scholar
- J. Mrozinski, E. Whittaker, and S. Furui. Collecting a why-question corpus for development and evaluation of an automatic QA-system. In Proceedings of ACL-08: HLT, pages 443--451, Columbus, Ohio, June 2008. Association for Computational Linguistics.Google Scholar
- M. Poesio. Discourse annotation and semantic annotation in the gnome corpus. In Proceedings of the ACL Workshop on Discourse Annotation, 2004. Google ScholarDigital Library
- K. Siorpaes and M. Hepp. Games with a purpose for the semantic web. IEEE Intelligent Systems, 23(3):50--60, 2008. Google ScholarDigital Library
- J. Surowiecki. The Wisdom of Crowds. Anchor, 2005. Google ScholarDigital Library
- L. von Ahn. Games with a purpose. Computer, 39(6):92--94, 2006. Google ScholarDigital Library
Index Terms
- A demonstration of human computation using the Phrase Detectives annotation game
Recommendations
Phrase detectives: Utilizing collective intelligence for internet-scale language resource creation
Special section on internet-scale human problem solving and regular papersWe are witnessing a paradigm shift in Human Language Technology (HLT) that may well have an impact on the field comparable to the statistical revolution: acquiring large-scale resources by exploiting collective intelligence. An illustration of this new ...
Italian Anaphoric Annotation with the Phrase Detectives Game-with-a-Purpose
Proceedings of the XIIth International Conference on AI*IA 2011: Artificial Intelligence Around Man and Beyond - Volume 6934Recently, web collaboration also known as crowd sourcing has started to emerge as a viable alternative for building the large resources that are needed to build and evaluate NLP systems.
In this spirit, the Anawiki project http://anawiki.essex.ac.uk/ [8]...
Key phrase extraction: a hybrid assignment and extraction approach
iiWAS '09: Proceedings of the 11th International Conference on Information Integration and Web-based Applications & ServicesAutomatic key phrase extraction is fundamental to the success of many recent digital library applications and semantic information retrieval techniques and a difficult and essential problem in Vietnamese natural language processing (NLP). In this work, ...
Comments