Abstract
This paper describes the News People Search (NePS) Task organized as part of EVALITA 2011. The NePS Task aims at evaluating cross-document coreference resolution of person entities in Italian news and consists of clustering a set of Italian newspaper articles that mention a person name according to the different people sharing that name. The motivation behind the task, the dataset used for the evaluation and the results obtained are described and discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ACE (2008), http://projects.ldc.upenn.edu/ace/docs/ACE08_XDOC_1.6.pdf
Artiles, J., Gonzalo, J., Sekine, S.: The SemEval-2007 WePS Evaluation: Establishing a benchmark for the Web People Search Task. In: Proceedings of SemEval 2007, Prague, Czech Republic (2007)
Artiles, J., Gonzalo, J., Sekine, S.: WePS 2 Evaluation Campaign: Overview of the Web People Search Clustering Task. In: Proceedings of WePS 2 Workshop, Madrid, Spain (2009)
Artiles, J., Borthwick, A., Gonzalo, J., Sekine, S., Amigó, E.: WePS-3 Evaluation Campaign: Overview of the Web People Search Clustering and Attribute Extraction Tasks. In: CLEF 2010 LABs and Workshops Notebook Papers, Padua, Italy (2010)
Bagga, A., Baldwin, B.: Algorithms for Scoring Coreference Chains. In: The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, Granada, Spain (1998)
Mann, G.S., Yarowsky, D.: Unsupervised personal name disambiguation. In: Proceedings of CoNLL-7, Edmonton, Canada (2003)
Gooi, C.H., Allan, J.: Cross-Document Coreference on a Large Scale Corpus. In: Proceedings of the Human Language Technology Conference (HLTNAACL), Boston, Massachusetts (2004)
Blume, M.: Automatic Entity Disambiguation: Benefits to NER, Relation Extraction, Link Analysis, and Inference. In: Proceedings of the International Conference on Intelligence Analysis, McLean, Virginia, USA (2005)
Bollegala, D., Matsuo, Y., Ishizuka, M.: Extracting Key Phrases to Disambiguate Personal Name Queries in Web Search. In: Proceedings of the ACL 2006 Workshop on How Can Computational Linguistics Improve Information Retrieval?, Sidney, Australia (2006)
Day, D., Hitzeman, J., Wick, M., Crouch, K., Poesio, M.: A corpus for cross-document co-reference. In: International Conference on Language Resources and Evaluation, LREC (2008)
Doddington, G.: Value-based Evaluation of EDT. Technical Report of the ACE 6-Month Meeting (2001)
Magnini, B., Pianta, E., Girardi, C., Negri, M., Romano, L., Speranza, M., Bartalesi-Lenzi, V., Sprugnoli, R.: I-CAB: the Italian Content Annotation Bank. In: Proceedings of LREC 2006, Genova, Italy (2006)
Popescu, O., Magnini, B., Pianta, E., Serafini, L., Speranza, M., Tamilin, A.: From Mention to Ontology: A Pilot Study. In: Proceedings of SWAP 2006, 3rd Italian Semantic Web Workshop on Semantic Web Applications and Perspectives, Scuola Normale Superiore, Pisa, December 18-20 (2006)
Bentivogli, L., Girardi, C., Pianta, E.: Creating a Gold Standard for Person Cross-Document Coreference Resolution in Italian News. In: Proceedings of the LREC 2008 Workshop on Resources and Evaluation for Identity Matching, Entity Resolution and Entity Management, Marrakech, Morocco (2008)
Amigó, E., Gonzalo, J., Artiles, J., Verdejo, F.: A comparison of extrinsic clustering evaluation metrics based on formal constraints. Information Retrieval, 461–486 (2008)
Zanoli, R., Corcoglioniti, F., Girardi, C.: Exploiting Background Knowledge for Clustering Person Names. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds.) EVALITA 2012. LNCS(LNAI), vol. 7689, pp. 135–145. Springer, Heidelberg (2012)
Heyer, L.J., Kruglyak, S., Yooseph, S.: Exploring Expression Data: Identification and Analysis of Coexpressed Genes. Genome Research 9, 1106–1115 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bentivogli, L., Marchetti, A., Pianta, E. (2013). The News People Search Task at EVALITA 2011: Evaluating Cross-Document Coreference Resolution of Named Person Entities in Italian News. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds) Evaluation of Natural Language and Speech Tools for Italian. EVALITA 2012. Lecture Notes in Computer Science(), vol 7689. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35828-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-35828-9_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35827-2
Online ISBN: 978-3-642-35828-9
eBook Packages: Computer ScienceComputer Science (R0)